Electronic device for displaying icons, method of operating same, and non-transitory computer-readable storage medium

Abstract

The invention relates to an electronic device and a method for displaying icons. According to one embodiment, an electronic device may include a display, a memory, and one or more processors. The memory may store one or more computer programs including computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to: display a user-selectable icon for executing an application in a three-dimensional virtual space, wherein the user-selectable icon includes a first graphic object representing the virtual window and a second graphic object representing the application, and the second graphic object is selectable by the first graphic object; when the user selectable icon is displayed in the three-dimensional virtual space, detecting movement of a finger of the user; and displaying an operation screen of the application based on the detected movement of the finger of the user in the depth direction of the virtual window of the first graphic object for selecting the second graphic object.

Description

Technical Field

[0001] The present disclosure relates to an electronic device for displaying icons for executing applications, an operating method thereof, and a non-transitory computer-readable storage medium. Background Art

[0002] With the advancement of digital technology, electronic devices have become of various types, such as smartphones, tablet personal computers (PCs), or personal digital assistants (PDAs). Electronic devices have been developed to be worn by users in order to enhance portability and user accessibility.

[0003] With recent technological advancements, electronic devices can now offer a variety of applications, allowing users to simply display icons representing these applications on a home screen or a designated screen. This technological advancement has led to the development of technologies (e.g., virtual reality (VR)) that allow electronic devices to visualize specific locations or scenes using three-dimensional computer graphics, providing virtual environments for indirect experience. In these virtual environments, electronic devices can be configured to be worn on a user's body in various configurations, display icons in a virtual space, and run applications.

[0004] To assist in understanding the present disclosure, the above information may be provided as related art. No statement or assertion is made as to whether any of the foregoing is applicable as background art related to the present disclosure. Summary of the Invention

[0005] Solution to the problem Conventional electronic devices display icons in the form of shortcut icons (e.g., shortcuts) for the same application in both 2D and 3D environments, and do not reflect changes in the application state. With the recent development of technologies for running applications in a 3D virtual space, there is a need to enhance the structure of icons used to run applications so that they can be configured to receive various interactive functions, and to provide icons that can be used in both 2D and 3D environments.

[0006] According to an embodiment of the present disclosure, a wearable electronic device includes a display, a memory, a camera, and one or more processors communicatively connected to the display, the memory, and the camera. In one embodiment, the memory stores one or more computer programs including computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to display a user-selectable icon for running an application in a 3D virtual space. The user-selectable icon includes a first graphical object representing a virtual window and a second graphical object representing the application, and the second graphical object is selectable via the first graphical object. In one embodiment, the one or more computer programs include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to detect movement of a user's finger while the user-selectable icon is displayed in the 3D virtual space. In one embodiment, the one or more computer programs include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to display a running screen of the application based on detecting movement of the user's finger in the depth direction of the virtual window of the first graphical object to select the second graphical object.

[0007] According to an embodiment, an operating method in a wearable electronic device includes displaying a user-selectable icon for running an application in a 3D virtual space, wherein the user-selectable icon includes a first graphical object representing a virtual window and a second graphical object representing the application, and the second graphical object is selectable through the first graphical object.

[0008] According to an embodiment, the method includes detecting movement of a user's finger when displaying a user-selectable icon in a 3D virtual space.

[0009] According to an embodiment, the method includes displaying the execution screen of the application based on detecting movement of a user's finger in a depth direction of the virtual window of the first graphic object for selecting the second graphic object.

[0010] According to an embodiment, one or more non-transitory computer-readable storage media store one or more computer programs including computer-executable instructions that, when executed by one or more processors of a wearable electronic device, cause the wearable electronic device to perform operations. The operations include: displaying a user-selectable icon for executing an application in a three-dimensional (3D) virtual space, wherein the user-selectable icon includes a first graphical object representing a virtual window and a second graphical object representing the application, and the second graphical object is selectable via the first graphical object; detecting movement of a user's finger while the user-selectable icon is displayed in the 3D virtual space; and displaying an execution screen of the application based on the detection of movement of the user's finger in a depth direction of the virtual window of the first graphical object to select the second graphical object. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 is a diagram illustrating electronic devices in a network environment according to various embodiments.

[0012] Figure 2 is a perspective view showing the structure of an electronic device according to an embodiment.

[0013] Figure 3a is a perspective view showing the structure of an electronic device according to an embodiment.

[0014] Figure 3b and Figure 3c is a perspective view showing the structure of an electronic device according to an embodiment.

[0015] Figure 4a and Figure 4b is a view illustrating example icons to be displayed on an electronic device according to an embodiment.

[0016] Figure 5a and Figure 5b is a view illustrating example icons to be displayed on an electronic device according to an embodiment.

[0017] Figure 6a and Figure 6b is a view illustrating example icons to be displayed on an electronic device according to an embodiment.

[0018] Figure 7 is a view illustrating example icons to be displayed on an electronic device according to an embodiment.

[0019] Figure 8a and Figure 8b is a view illustrating example icons to be displayed on an electronic device according to an embodiment.

[0020] Figure 9 is a flowchart illustrating an example of an operating method in an electronic device according to an embodiment.

[0021] Figure 10a 、 Figure 10b 、 Figure 10c 、 Figure 10d and Figure 10e is a view illustrating an example of displaying icons in an electronic device according to an embodiment.

[0022] Figure 11a 、 Figure 11b 、 Figure 11c 、 Figure 11d 、 Figure 11e 、 Figure 11f 、 Figure 11g 、 Figure 11h and Figure 11iis a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0023] Figure 12a 、 Figure 12b 、 Figure 12c 、 Figure 12d 、 Figure 12e and Figure 12f is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0024] Figure 13a 、 Figure 13b 、 Figure 13c 、 Figure 13d 、 Figure 13e and Figure 13f is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0025] Figure 14a 、 Figure 14b 、 Figure 14c 、 Figure 14d 、 Figure 14e 、 Figure 14f 、 Figure 14g and Figure 14h is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0026] Figure 15 is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0027] Figure 16a 、 Figure 16b and Figure 16c is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0028] Figure 17a and Figure 17b is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0029] Figure 18a 、 Figure 18b and Figure 18c is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0030] Figure 19 is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0031] Figure 20 is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0032] Throughout the specification and drawings, the same or similar reference numerals may be used to refer to the same or similar elements. DETAILED DESCRIPTION

[0033] Embodiments of the present invention will now be described in detail with reference to the accompanying drawings in a manner readily practiced by those skilled in the art. However, the present disclosure may be implemented in various other forms and is not limited to the embodiments described herein. Throughout the specification and drawings, the same or similar reference numerals may be used to refer to the same or similar elements. In addition, for the sake of clarity and brevity, well-known functions and configurations are not described in the drawings and related descriptions.

[0034] Various embodiments of the present disclosure will now be described with reference to the accompanying drawings.As used herein, the term "user" may refer to a person using an electronic device or another device.

[0035] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 In the network environment 100, the electronic device 101 can communicate with the electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or can communicate with at least one of the electronic device 104 and the server 108 via a second network 199 (e.g., a long-range wireless communication network). Depending on the embodiment, the electronic device 101 can communicate with the electronic device 104 via the server 108. Depending on the embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a subscriber identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the aforementioned components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the above-described components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) may be implemented as a single integrated component (eg, display module 160 ).

[0036] The processor 120 may execute, for example, software (e.g., program 140) to control at least one other component of the electronic device 101 connected to the processor 120 (e.g., a hardware component or a software component), and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may store commands or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the commands or data stored in the volatile memory 132, and store the resulting data in the non-volatile memory 134. Depending on the embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or integrated with the main processor 121. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121 or be adapted to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of the main processor 121.

[0037] When the main processor 121 is inactive (e.g., sleeping), the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states associated with at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190). Alternatively, when the main processor 121 is active (e.g., running an application), the auxiliary processor 123 may work with the main processor 121 to control at least some of the functions or states associated with at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190). Depending on the embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component functionally related to the auxiliary processor 123 (e.g., the camera module 180 or the communication module 190). Depending on the embodiment, the auxiliary processor 123 (e.g., a neural processing unit) may include hardware structures dedicated to artificial intelligence model processing. The artificial intelligence model may be generated through machine learning. For example, such learning may be performed by the electronic device 101 where the artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network, or a combination of two or more thereof, but is not limited thereto. Additionally or alternatively, the artificial intelligence model may include a software structure in addition to a hardware structure.

[0038] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.

[0039] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0040] The input module 150 may receive commands or data from outside the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101 (e.g., the processor 120). The input module 150 may include, for example, a microphone, a mouse, a keyboard, keys (e.g., buttons), or a digital pen (e.g., a stylus).

[0041] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. Depending on the embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0042] The display module 160 can visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. Depending on the embodiment, the display module 160 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of the force caused by the touch.

[0043] The audio module 170 can convert sound into an electrical signal, and vice versa. Depending on the embodiment, the audio module 170 can obtain sound via the input module 150, or output sound via the sound output module 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0044] The sensor module 176 can detect the operating state of the electronic device 101 (e.g., power or temperature) or the environmental state outside the electronic device 101 (e.g., the state of the user), and then generate an electrical signal or data value corresponding to the detected state. Depending on the embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0045] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). Depending on the embodiment, the interface 177 may include, for example, a High-Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital (SD) card interface, or an audio interface.

[0046] The connection end 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102). Depending on the embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0047] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0048] The camera module 180 may capture still images or moving images. Depending on the embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

[0049] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0050] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0051] The communication module 190 can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and support direct (e.g., wired) communication or wireless communication. Depending on the embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 may identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0052] The wireless communication module 192 can support 5G networks following 4G networks and next-generation communication technologies (e.g., New Radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 192 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 can support various technologies for ensuring performance in high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 can support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., the second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane latency for implementing URLLC (e.g., 0.5 ms or less for each of downlink (DL) and uplink (UL), or 1 ms or less round trip).

[0053] Antenna module 197 can transmit or receive signals or power to or from an external device (e.g., an external electronic device) outside of electronic device 101. Depending on the embodiment, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). Depending on the embodiment, antenna module 197 may include multiple antennas (e.g., an array antenna). In this case, at least one antenna suitable for the communication scheme used in a communication network (e.g., first network 198 or second network 199) may be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. Depending on the embodiment, additional components besides the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may also be formed as part of antenna module 197.

[0054] According to various embodiments, antenna module 197 may form a millimeter wave antenna module. According to embodiments, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and multiple antennas (e.g., array antennas). The RFIC is disposed on or adjacent to a first surface (e.g., the bottom surface) of the printed circuit board and is capable of supporting a designated high-frequency band (e.g., the millimeter wave band). The multiple antennas are disposed on or adjacent to a second surface (e.g., the top surface or a side surface) of the printed circuit board and are capable of transmitting or receiving signals in the designated high-frequency band.

[0055] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, general purpose input output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and communicatively transfer signals (e.g., commands or data) therebetween.

[0056] According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 or the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type than the electronic device 101. According to an embodiment, all or some operations to be executed on the electronic device 101 may be executed on one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or execute another function or service related to the request, and transmit the results of the execution to the electronic device 101. The electronic device 101 may provide the results as at least a partial response to the request, either with or without further processing. To this end, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technologies may be used, for example. Electronic device 101 may use distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server that utilizes machine learning and / or neural networks. Depending on the embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be used for intelligent services based on 5G communication technology or IoT-related technologies (e.g., smart homes, smart cities, smart cars, or healthcare).

[0057] Figure 2 is a perspective view showing the structure of an electronic device according to an embodiment.

[0058] refer to Figure 1 and Figure 2 , the electronic device 200 according to the embodiment may be Figure 1 The electronic device 101 and Figure 1 The electronic device 102 or 104 that communicates with the electronic device 101, or a device that can provide services related to virtual reality technology, which provides services similar to Figure 1A virtual environment of the electronic device 101 is provided. Virtual reality (VR) technology, which is a technology for providing a virtual environment, may evolve into augmented reality (AR), mixed reality (MR), and / or extended reality (XR) including AR and MR. Depending on the embodiment, virtual reality (VR) technology may be described as encompassing the concepts of augmented reality (AR), mixed reality (MR), and / or extended reality (XR).

[0059] like Figure 2 As shown, electronic device 200 may be a device configured to be worn on a user's body (e.g., a head-mounted display (HMD) or a glasses-type AR glasses device). For example, electronic device 200 may be configured to couple with an external electronic device (e.g., a mobile device) to utilize components of the external electronic device (e.g., a display module, a camera module, an audio output module, or other components). Without limitation, electronic device 200 may be implemented in various other forms that are wearable on a user's body.

[0060] According to an embodiment, the electronic device 200 can control the display module 160 to configure a virtual reality space (e.g., an augmented reality space) that displays an augmented reality image or a virtually provided image (e.g., a 2D or 3D image) corresponding to an actual environment captured in the surrounding environment in which the user is located, and display at least one virtual object corresponding to something for user interaction and / or at least one virtual object corresponding to the user in the virtual reality space.

[0061] According to an embodiment, the electronic device 200 may include a processor 120, a memory 130, a display module 160, a sensor module 176, a camera module 180, a charging module (eg, Figure 1 The battery 189) and the communication module 190, such as Figure 1 The electronic device 200 may further include a sound output module 155, an input module 150, or a Figure 1 In addition, the electronic device 200 may further include other components required to provide augmented reality functions (eg, services or solutions).

[0062] Depending on the embodiment, the processor 120 may be electrically connected to other components to control them. The processor 120 may perform various data processing or calculations based on the execution of various functions (e.g., operations, services, or programs) provided by the electronic device 200. The processor 120 may perform various types of data processing and calculations to display at least one virtual object related to real objects included in images captured in the real space and / or a virtual object corresponding to a user (e.g., an avatar) in the virtual reality space. The processor 120 may also perform various types of data processing or calculations to represent user interactions or movements of virtual objects displayed in the virtual reality space.

[0063] Return Reference Figure 2 , an electronic device 200 according to an embodiment is described. As described above, the electronic device 200 is not limited to a glasses-type (e.g., AR glasses) augmented reality device, and it can be implemented as various devices (e.g., AR head-mounted display type, 2D / 3D head-mounted display device, or VR head-mounted display device) that can provide immersive content (e.g., content based on XR technology) to the user's eyes.

[0064] According to an embodiment, the camera module of the electronic device 200 (eg, Figure 1 The camera module 180 can capture still images and / or videos. Depending on the embodiment, the camera module can be provided in the frame and positioned around the first display 251 and the second display 252. Depending on the embodiment, the camera module can include one or more first cameras 211-1 and 211-2, one or more second cameras 212-1 and 212-2, and one or more third cameras 213. Depending on the embodiment, images obtained by the one or more first cameras 211-1 and 211-2 can be used to detect user gestures, track the user's head, and / or perform spatial recognition. The one or more first cameras 211-1 and 211-2 can be global shutter (GS) cameras or rolling shutter (RS) cameras. The one or more first cameras 211-1 and 211-2 can perform simultaneous localization and mapping (SLAM) operations by capturing depth. The one or more first cameras 211-1 and 211-2 can perform spatial recognition and / or motion recognition for 3 degrees of freedom (DoF) and / or 6 DoF. According to an embodiment, the first cameras 211-1 and 211-2 may periodically or aperiodically transmit information related to the trajectory of the user's eyes or gaze (eg, trajectory information) to the processor (eg, Figure 1 processor 120).

[0065] Depending on the embodiment, the electronic device 200 may use another camera (e.g., the third camera 213) to detect hands and track and recognize user gestures. Depending on the embodiment, at least one of the first and second cameras 211-1, 211-2, through the third camera module 213 may be replaced with a sensor module (e.g., a LiDAR sensor). For example, the sensor module may include at least one of a vertical cavity surface emitting laser (VCSEL), an infrared sensor, and / or a photodiode.

[0066] According to an embodiment, images obtained by one or more second cameras 212-1 and 212-2 can be used to detect and track the user's pupils. One or more second cameras 212-1 and 212-2 can be GS cameras. One or more second cameras 212-1 and 212-2 can correspond to the left eye and the right eye, respectively. One or more second cameras 212-1 and 212-2 can have substantially the same performance. One or more third cameras 213 can be relatively high-resolution cameras. One or more third cameras 213 can perform autofocus (AF) and optical image stabilization (OIS). One or more third cameras 213 can be global shutter (GS) cameras or rolling shutter (RS) cameras. One or more third cameras 213 can be color cameras.

[0067] According to an embodiment, the electronic device 200 may include one or more light-emitting devices 214-1 and 214-2. The light-emitting devices 214-1 and 214-2 are different from the light sources described below for irradiating light to the screen output area of ​​the display. According to an embodiment, the light-emitting devices 214-1 and 214-2 may irradiate light to facilitate pupil detection when detecting and tracking the user's pupils through one or more second cameras 212-1 and 212-2. According to an embodiment, each of the light-emitting devices 214-1 and 214-2 may include an LED. According to an embodiment, the light-emitting devices 214-1 and 214-2 may irradiate light in the infrared band. According to various embodiments, the light-emitting devices 214-1 and 214-2 may be attached around the frame of the electronic device 200. According to an embodiment, the light-emitting devices 214-1 and 214-2 may be located around the one or more first cameras 211-1 and 211-2 and may assist the one or more first cameras 211-1 and 211-2 in gesture detection, head tracking, and spatial recognition when the electronic device 200 is used in a dark environment. According to an embodiment, the light-emitting devices 214-1 and 214-2 may be located around the one or more third cameras 213 and may assist the one or more third cameras 213 in obtaining images when the electronic device 200 is used in a dark environment.

[0068] According to an embodiment, the electronic device 200 may include batteries 235-1 and 235-2 (eg, Figure 1 The batteries 235 - 1 and 235 - 2 may store power for operating the remaining components of the electronic device 200 .

[0069] According to the embodiment, the above combination Figure 1 The display module of the electronic device 200 (eg, Figure 1 The display module 160 may include a first display 251, a second display 252, one or more input optical members 253-1 and 253-2, one or more transparent members 290-1 and 290-2, and one or more screen display portions 254-1 and 254-2. According to embodiments, the first and second displays 251 and 252, serving as optical output modules, may include, for example, a liquid crystal display (LCD), a digital mirror device (DMD), liquid crystal on silicon (LCOS), an organic light-emitting diode (OLED), or a micro light-emitting diode (micro-LED). According to embodiments, when the first and second displays 251 and 252 are formed from one of an LCD, a DMD, or a liquid crystal on silicon display, the electronic device 200 may include a light source for illuminating the screen output areas of the displays. According to embodiments, when the first and second displays 251 and 252 can generate their own light, such as when formed from organic light-emitting diodes or micro-LEDs, the electronic device 200 can provide the user with high-quality virtual images (e.g., images of a virtual reality space) even without a separate light source.

[0070] According to an embodiment, the one or more transparent members 290-1 and 290-2 included in the electronic device 200 may be arranged to face the user's eyes when the user wears the electronic device 200. The one or more transparent members 290-1 and 290-2 may include at least one of a glass plate, a plastic plate, and a polymer. When the user wears the electronic device 200, the user can view the outside world through the one or more transparent members 290-1 and 290-2.

[0071] According to an embodiment, one or more input optical members 253-1 and 253-2 included in the electronic device 200 can guide light generated by the first display 251 and the second display 252 to the user's eyes. The light generated by the first display 251 and the second display 252 can form an image on one or more screen display parts 254-1 and 254-2 above the one or more transparent members 290-1 and 290-2, and the user can see the image formed on the one or more screen display parts 254-1 and 254-2.

[0072] According to an embodiment, the electronic device 200 may include one or more optical waveguides (not shown). The optical waveguides may transmit light generated by the first display 251 and the second display 252 to the user's eyes. The electronic device 200 may include one optical waveguide for each of the left and right eyes. According to an embodiment, the optical waveguide may be made of at least one of glass, plastic, or polymer. The optical waveguide may include a nanopattern formed internally or on an external surface, such as a polygonal or curved grating structure. The optical waveguide may include a free-form prism, in which case the optical waveguide may provide incident light to the user via a reflector. According to an embodiment, the optical waveguide may include at least one of a diffractive element (e.g., a diffractive optical element (DOE) or a holographic optical element (HOE)) or a reflective element (e.g., a reflector). Display light emitted from a light source may be guided to the user's eyes using the at least one diffractive element or reflective element included in the optical waveguide. According to an embodiment, the diffractive element may include an input / output optical element. According to an embodiment, the reflective element may include a member that causes total internal reflection.

[0073] According to an embodiment, the electronic device 200 may include one or more sound input devices 262 - 1 , 262 - 2 , and 262 - 3 and one or more sound output devices 263 - 1 and 263 - 2 .

[0074] According to an embodiment, the electronic device 200 may include a first PCB 270-1 and a second PCB 270-2. The first PCB 270-1 and the second PCB 270-2 may transmit electrical signals to components included in the electronic device 200, such as the first cameras 211-1 and 211-2, the second cameras 212-1 and 212-2, and the third camera 213 included in the camera module 180, the displays 251 and 252, an audio module (e.g., Figure 1 audio module 170) and sensor modules (e.g., Figure 1 Sensor module 176). According to an embodiment, the first PCB 270-1 and the second PCB 270-2 may be flexible printed circuit boards (FPCBs). According to an embodiment, the first PCB 270-1 and the second PCB 270-2 may each include a first substrate, a second substrate, and an interposer disposed between the first substrate and the second substrate.

[0075] Figure 3a is a perspective view showing the structure of an electronic device according to an embodiment.

[0076] refer to Figure 3a , according to the electronic device 300 of the embodiment (eg, Figure 1 electronic device 101 or Figure 2The electronic device 200 may be a wearable electronic device such as a head mounted device (HMD) that is worn on the user's head to provide an image (eg, a virtual reality space image) in front of the user's eyes. Figure 3a The configuration of the electronic device 300 may be wholly or partially related to Figure 2 The configuration of the electronic device 200 is the same.

[0077] According to an embodiment, the electronic device 300 may include cases 310 , 320 , and 330 , which may form an exterior and provide a space in which components of the electronic device 300 may be disposed.

[0078] According to an embodiment, the electronic device 300 may include a first housing 310 that may surround at least a portion of the user's head. According to an embodiment, the first housing 310 may include a first surface 300a facing the outside (eg, +X direction) of the electronic device 300.

[0079] According to an embodiment, the first housing 310 may surround at least a portion of the internal space I. For example, the first housing 310 may include a second surface 300 b facing the internal space I of the electronic device 300 and a third surface 300 c opposite the second surface 300 b. According to an embodiment, the first housing 310 may be coupled to the third housing 330 and may be formed in a closed loop shape surrounding the internal space I.

[0080] According to an embodiment, the first housing 310 may surround at least some components of the electronic device 300. For example, a light output module, a circuit board, and a speaker module may be provided within the first housing 310.

[0081] According to an embodiment, the electronic device 300 may include one display member 340 corresponding to the left eye and the right eye. The display member 340 may be provided in the first housing 310. Figure 3a The configuration of the display member 340 may be in whole or in part with Figure 2 The configurations of the screen display portions 254-1 and 254-2 are the same.

[0082] According to an embodiment, the electronic device 300 may include a second housing 320 that can be placed on the user's face. According to an embodiment, the second housing 320 may include a fourth surface 300d that can at least partially face the user's face. According to an embodiment, the fourth surface 300d may be a surface facing the interior space I of the electronic device 300 (e.g., the -X direction). According to an embodiment, the second housing 320 may be coupled to the first housing 310.

[0083] According to an embodiment, the electronic device 300 may include a third housing 330 that may be placed on the back of the user's head. According to an embodiment, the third housing 330 may be coupled to the first housing 310. According to an embodiment, the third housing 330 may surround at least some components of the electronic device 300. For example, a battery (e.g., Figure 2 The batteries 235 - 1 and 235 - 2 ) may be disposed in the third housing 330 .

[0084] In order to enhance the user's overall usage experience, usage environment, and usability of the head-mounted wearable electronic device 300, the sensations that the user feels and experiences in virtual reality (VR), augmented reality (AR), and mixed reality (MR) spaces may need to be as similar as possible to those in the real world.

[0085] Figure 3b and Figure 3c is a perspective view showing the structure of an electronic device according to an embodiment.

[0086] refer to Figure 3b and Figure 3c In an embodiment, camera modules 311, 312, 313, 314, 315 and 316 and / or a depth sensor 317 for obtaining information related to the surrounding environment of the electronic device 300 (e.g., a wearable device) may be disposed on the first surface 301 of the housing.

[0087] In an embodiment, the camera modules 311 and 312 may obtain images related to the surrounding environment of the electronic device 300 .

[0088] In embodiments, camera modules 313, 314, 315, and 316 can capture images while a user is wearing electronic device 300. Camera modules 313, 314, 315, and 316 can be used for hand detection, tracking, and recognition of user gestures (e.g., hand movements). Camera modules 313, 314, 315, and 316 can be used for 3DoF or 6DoF head tracking, location (spatial or environmental) recognition, and / or movement recognition. In embodiments, camera modules 311 and 312 can be used for hand detection and tracking and recognition of user gestures.

[0089] In an embodiment, the depth sensor 317 may be configured to transmit and receive signals reflected from an object and used to identify the distance of the object, such as time of flight (TOF). As an alternative or supplement to the depth sensor 317, the camera modules 313, 314, 315, and 316 may identify the distance of the object.

[0090] According to an embodiment, camera modules 325 and 326 and / or the display module 321 (and / or the lens) for facial recognition may be provided on the second surface 302 of the housing of the electronic device 300 . Figure 3c The display module 321 (and / or lens) may be Figure 3a The display member 340 may be or may be a part thereof.

[0091] In embodiments, facial recognition camera modules 325 and 326 adjacent to the display may be used to recognize the user's face or may recognize and / or track the user's eyes.

[0092] In an embodiment, the display module 321 (and / or the lens) may be provided on the second surface 320 of the electronic device 300. In an embodiment, the electronic device 300 may not include the camera modules 315 and 316 among the plurality of camera modules 313, 314, 315, and 316. In an embodiment, the electronic device 300 may not include the camera modules 315 and 316 among the plurality of camera modules 313, 314, 315, and 316. Although Figure 3b and Figure 3c Not shown, but the electronic device 300 may also include Figure 2 At least one of the components shown.

[0093] As described above, depending on the embodiment, the electronic device 300 may have a form factor designed to be worn on a user's head. The electronic device 300 may also include a strap and / or a wearable component for securing to a part of the user's body. When worn on the user's head, the electronic device 300 may provide a user experience based on augmented reality, virtual reality, and / or mixed reality.

[0094] Hereinafter, the present disclosure may provide an electronic device and method for displaying an icon (e.g., a user-selectable icon) for running an application, the icon including a plurality of graphic objects and capable of changing at least one of the graphic objects based on a change in the state of the application in a 2D environment and a 3D environment (e.g., a virtual space). Hereinafter, the electronic device described in the present disclosure may be a wearable electronic device that can be worn on a user's head, such as, for example, AR glasses, an HMD device, and / or a VST device, as combined with Figure 2 and Figures 3a to 3c The electronic device described may also be referred to as a wearable electronic device.

[0095] The objects of the present disclosure are not limited to the foregoing, and those skilled in the art will understand other unmentioned objects from the following description.

[0096] Figure 4a 、 Figure 4b 、 Figure 5a and Figure 5b is a view illustrating example icons to be displayed on an electronic device according to an embodiment.

[0097] refer to Figure 1 、 Figure 4a 、 Figure 4b 、 Figure 5a and Figure 5b , according to the electronic device 200 of the embodiment (eg, Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The processor 120 of the electronic device 300 may control the display module 160 to display an icon 410 (eg, a user-selectable icon) for running at least one application on the 3D space 401. Here, the display module 160 may display the icon 410 (eg, a user-selectable icon) for running at least one application through multiple displays (eg, Figure 2 The first display 251 and the second display 252, Figure 3a Display component 340, Figure 3c The display module 321 of the display module 321 displays (e.g., provides) an image (e.g., icon 410 or an execution screen related to a designated application) in a 3D virtual space 401 (e.g., an augmented reality, virtual reality, mixed reality, and / or extended reality space). Icon 410 may include multiple graphical objects (e.g., multiple 3D graphical objects) arranged in each of multiple layers having a depth (e.g., a predetermined distance in the depth direction (z direction)) and may be configured as a minimum-sized tile representing the application. Icon 410 may be configured to execute the application upon receiving user input (e.g., a tap). Icon 410 may be displayed in a variable form with a sense of space in the virtual space of a 3D environment and may be displayed not only in a 3D environment but also in a 2D environment. Icon 410 is a three-dimensional (3D) icon for the designated application and may be displayed in the 3D virtual space via the display as a three-dimensional (3D) graphical object generated at least in part based on the group of graphical objects. The graphic objects may include: a first graphic object (e.g., a world) 411 representing a background area that includes content of at least one application and is fixedly displayed in the 3D virtual space; a second graphic object (e.g., a pictogram or symbol image) 413 representing at least one application (e.g., a specified application) or one or more content of at least one application; and a third graphic object (e.g., a virtual window) 415 representing a frame area (e.g., an outline) directly exposed to the user and configured as a transparent window, through which the first and second graphic objects are shown to the user in the 3D virtual space 401. Multiple graphic objects may be displayed in the 3D virtual space 401, and the camera module (e.g., Figure 1 Camera module 180, Figure 2 The first cameras 211-1 and 211-2, the third camera 213, Figure 3bThe camera modules 313, 314, 315, and 316 of the image processing unit 410 are spaced apart from each other by a predetermined distance (e.g., with a gap) in the depth direction (e.g., the z-direction) toward the third graphic object. The first graphic object 411, the second graphic object 413, and the third graphic object 415 can be arranged in a specified arrangement order along the depth direction and displayed in the 3D virtual space. The arrangement order, shape, size, or display position can be changed based on the state of the application. The icon 410 can be configured to be flexibly expandable or contractible. For example, the forms (tiles) of the flexibly expandable icons 410 may include: quick swipes, which expose tasks of the application when the icon is swiped, as a form (tile) in which the user can quickly use the functions of the application with fewer actions; application notifications, which expose notifications of the application when the icon is swiped with the application notification badge floating, as a form (tile) in which notifications of the application can be quickly identified with fewer actions; and / or application widgets (e.g., small screens), which are expanded to expose functions related to the application when the user expands the icon area through specific gesture input (e.g., two fingers), as a form (tile) in which instant actions or detailed information related to the application can be performed.

[0098] According to an embodiment, when a user input (eg, a tap) is received, the at least one processor 120 may execute an application and may control the display module 160 (eg, Figure 1 The first display 251 and the second display 252, Figure 3a Display component 340, Figure 3c According to an embodiment, at least one processor 120 can display the running screen of the application through user interaction or at least one sensor (for example, Figure 1 The at least one processor 120 may control the display module 160 to display a changed icon 410 in the 3D virtual space 401, reflecting the changed at least one graphical object.

[0099] According to an embodiment, at least one processor 120 may change the layer order (e.g., arrangement order relative to the depth direction (z direction)) of multiple graphic objects 411, 413, and 415 based on state information regarding at least one application. According to an embodiment, as shown in FIG. 5 , at least one processor 120 may display an icon 410a arranged in layers of a first graphic object 411, a second graphic object 413, and a third graphic object 415 in a direction toward the user. When at least one processor 120 identifies a state change of an application corresponding to a user interaction, at least one processor 120 may display an icon 410b in which second graphic object 413, arranged in a layer between first graphic object 411 and third graphic object 415, is sequentially changed (e.g., in a transition state) to a higher layer than first graphic object 411. When at least one processor 120 identifies a change in the state of an application in response to a user interaction, processor 120 adjusts the layers between first graphic object 411 and third graphic object 415 based on the change in the state of the application. Icon 410b may be displayed, resulting from changing the order of second graphical object 413 to a higher level than first graphical object 411 (e.g., a transition state). At least one processor 120 may display icon 410c in the form of content object 501, with some (e.g., second graphical object 413 among the plurality of graphical objects) maintained for continuity / consistency, to expose content included in at least one application (e.g., displayed in a virtual space). When content objects 501 included in the application are exposed, changed icon 410c is a metaphorical icon form of the application (e.g., including the icon form of content object 501 to which second graphical object 413 has become). It may be retained in a portion of the application's running screen or a partial area of ​​the expanded content, while some (e.g., second graphical object 413) of the plurality of graphical objects are maintained. For example, content object 501 may be an object transformed by applying a visual effect (e.g., a graphic effect) to second graphical object 413. When the running screen of the content is displayed, the content object 501 may be displayed in an area overlapping or adjacent to the running screen, and a visual effect may be applied in response to a change in the content state. According to an embodiment, if the changed icon 410c is displayed when the second graphic object 413 is changed to the content object 501, the processor 120 may not display the third graphic object 415 (e.g., a virtual window), as shown in FIG. Figure 5a As shown, the changed icon 410c (eg, the changed second graphic object) may be maintained (eg, displayed or provided) adjacent to or overlapped with the running screen. Figure 5bAs shown, if the graphic object 413 moves closer to the camera module than the icon 410b, the processor 120 may control the display module to enlarge and display the graphic object 415, such as the icon 410d. In this case, when the graphic object 413 is shown to be larger than the third graphic object 415 (e.g., virtual window) (such as the icon 410d) to the user's eyes, the third graphic object 415 may not be displayed to the user.

[0100] Figure 6a and Figure 6b is a view illustrating example icons to be displayed on an electronic device according to an embodiment.

[0101] refer to Figure 1 、 Figure 4a 、 Figure 4b 、 Figure 6a and Figure 6b , according to the electronic device 200 of the embodiment (eg, Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c At least one processor 120 of an electronic device 300 may display an icon 410 in a 3D virtual space 401. In the icon 410, based on status information about at least one application (e.g., a designated application), a visual effect is applied to a second graphical object 413 (e.g., a pictographic or symbolic image) and / or a third graphical object 415, or the size of the second graphical object 413 and / or the third graphical object 415 (e.g., a virtual window) is changed. According to an embodiment, when a specific application related to the user's movement (e.g., a health-related application or a sleep-related application) is running, the at least one processor 120 may apply a visual effect (e.g., a visual effect representing a heartbeat) to the second graphical object 413, as in the first example 601 of the icon 410. As in the second example 602, the third example 603, the fourth example 604, and the fifth example 605 of the icon 410, the at least one processor 120 may obtain information related to the user's movement as state information about the application over time, and may apply a visual effect that changes dynamically based on the information related to the user's movement (for example, a visual effect that changes color according to the movement or number of heartbeats). For example, Figure 6aAs shown, when the at least one processor 120 recognizes that the user is moving normally based on the movement information about the user obtained using the at least one sensor, the at least one processor 120 may apply a visual effect representing the movement of a heartbeat in a first color (e.g., green) to the second graphic object 413, as in the first example 601. For example, when it is recognized based on the obtained user movement information that the user's movement has changed from their usual movement to a faster movement, the at least one processor 120 may apply a visual effect representing the movement of a heartbeat to the second graphic object 413, the visual effect gradually and dynamically changing from the first color (e.g., green) in the first example 601 to the second color (e.g., red) in the second example 602. Thereafter, when it is recognized based on the obtained user movement information that the user's movement changes from a higher speed to a lower speed, the at least one processor 120 may apply a visual effect representing the movement of a heartbeat to the second graphic object 413, the visual effect gradually and dynamically changes from the second color (e.g., red) of the second example 602 to the third color (e.g., yellow or orange) of the third example 603, and dynamically changes to the first color (e.g., green) of the fourth example 604 according to the continuous movement change, and then, when it is recognized that the movement continuously changes to a higher speed, the at least one processor 120 may apply a visual effect representing the movement of a heartbeat to the second graphic object 413, the visual effect dynamically changing from the first color (e.g., green) of the fourth example 604 to the second color (e.g., red) of the fifth example 605. For example, as Figure 6b As shown, at least one processor 120 can apply a visual effect to the second graphic object 413 and / or the third graphic object 415, which gradually changes color or brightness according to the change of content information (for example, adjusting the size according to the number of received messages), or adjust the size of the second graphic object 413 and / or the third graphic object 415 in response to the change of content information based on content information about a specific application (for example, a messaging application or a messaging-related application) (for example, the number of received messages), as in Examples 611 and 612 of icon 410.

[0102] Figure 7 is a view illustrating example icons to be displayed on an electronic device according to an embodiment.

[0103] refer to Figure 1 、 Figure 2 、 Figure 3a 、 Figure 3b 、 Figure 3c and Figure 7As in examples 701, 702, and 703, at least one processor 120 according to an embodiment may display an icon 410 reflecting a visual effect (e.g., a graphic effect) of dynamically moving the second graphic object 413 to the left / right or up / down in the area of ​​the third graphic object 415 in response to user interaction. When the icon 410 is selected by user input (e.g., a tap), the at least one processor 120 may run the application indicated by the icon 410 and may display a content object 711 in which the color, size, or shape of the second graphic object 413 is changed in the form of an icon capable of exposing the content of the application, as shown in example 704.

[0104] Figure 8a and Figure 8b is a view illustrating example icons to be displayed on an electronic device according to an embodiment.

[0105] refer to Figure 1 、 Figure 2 、 Figure 3a 、 Figure 3b 、 Figure 3c and Figure 8a When an icon 410 including a plurality of graphic objects is displayed in a 2D environment, at least one processor 120 according to an embodiment may display the icon 410 on the display, wherein the plurality of graphic objects are configured in the form of one image 801 (e.g., a 2D graphic object) in the 2D environment, and may execute an application in response to user inputs (e.g., user gestures (tap or swipe)) 811 and 813 (e.g., a third user input). The entire image 801 may be an object to which an action may be applied.

[0106] refer to Figure 1 、 Figure 2 、 Figure 3a 、 Figure 3b 、 Figure 3c and Figure 8bWhen an icon 410 including multiple graphical objects is displayed in a virtual space of a 3D environment (e.g., an XR environment), at least one processor 120 according to an embodiment may display icon 410 in the form of a 3D image 803 (e.g., a 3D graphical object), such that each of the multiple graphical objects can dynamically change within the 3D environment based on state information about the application. At least one processor 120 may receive user input (e.g., a tap, swipe, or drag) (e.g., a first user input) in the area of ​​a second graphical object 413 and each of the first graphical object 411 or the third graphical object 415 among the multiple graphical objects. According to an embodiment, upon receiving an input to drag the second graphical object 413, the at least one processor 120 may execute a function of the corresponding application or an operation related to the content of the application. For example, upon receiving an input 821 (e.g., a first user input) to tap the second graphical object 413, the at least one processor 120 may function as a shortcut capable of immediately executing the application. For example, upon receiving input 823 (e.g., second user input) for tapping first graphical object 411, at least one processor 120 may expand (e.g., apply a graphical effect that adjusts to the window size) the smallest unit of the virtual window. For example, upon receiving input 825 (e.g., third user input) for sliding or dragging second graphical object 413, at least one processor 120 may immediately execute a pre-specified operation (e.g., a function, content, widget, or uniform resource locator (URL)) in response to the sliding or dragging. For example, upon receiving input 827 for sliding first graphical object 411, at least one processor 120 may expand the execution screen to the largest and most detailed execution screen of a specified application, or immediately execute the execution screen of the last operation during the previous execution, the execution screen of the user's preferred operation, or the execution screen of an operation resulting from a specified event (e.g., a notification).

[0107] According to an embodiment, the processor 120 of the electronic device 101 may arrange the first, second, and third graphical objects 411, 413, and 415 in a specified arrangement order in the depth direction (e.g., the z-direction). While displaying the first, second, and third graphical objects 411, 413, and 415 in the specified arrangement order in the depth direction, the processor 120 may receive a user input (e.g., a first user input or a second user input) for selecting at least one of the first, second, or third graphical objects 411, 413, and 415 that the user is gazing at. Here, gazing may be a binocular field of view, where the viewing angles of the user's left and right eyes overlap, and the binocular field of view is known to be approximately 120 degrees. The aforementioned viewing angle values ​​are exemplary, and those skilled in the art will readily appreciate that they may vary slightly depending on the shape of the user's face or the relative position of the left and right eyes. According to an embodiment, upon receiving a first user input (e.g., a gesture input), the processor 120 may execute at least one function of a designated application based on the first user input. According to an embodiment, upon receiving a second user input (e.g., a gesture input or a gaze input) different from the first user input, the processor 120 may apply a graphical effect (e.g., size, shape, position, color, or arrangement order) to at least one of the multiple graphical objects based on the second user input. According to an embodiment, the processor 120 may execute at least one function of a designated application based on a third user input (e.g., a gesture input or a gaze input), apply (e.g., change, provide, or display) a graphical effect to at least one of the multiple graphical objects, and display the at least one graphical object (or an icon including the graphical object (e.g., icon 410 in FIG. 4 )) to which the graphical effect is applied in a 3D virtual space. Here, the third user input may be an input different from the first and second user inputs. According to an embodiment, the electronic device may identify the direction of gaze and, if the first graphical object 411, the second graphical object 413, or the third graphical object 415 is gazed at for a designated time (e.g., N seconds) and the second user input is received, the processor 120 may apply the graphical effect to the at least one graphical object.

[0108] According to an embodiment, the processor 120 can recognize that the user is looking at the third graphical object 415, and if a first user input for selecting the third graphical object 415 is received, at least one widget (e.g., at least one running screen) corresponding to at least one function of the specified application is displayed in a 3D virtual space (e.g., an XR or AR environment).

[0109] According to an embodiment, the processor 120 may recognize the gaze at the second graphic object 413 and, if a first user input for selecting the second graphic object 413 is received, run a designated application in a 3D virtual space (eg, an XR or AR environment).

[0110] Depending on the embodiment, processor 120 may recognize that gaze is being directed at first graphical object 411 and, upon receiving a sixth user input selecting first graphical object 411, may change the virtual 3D space displaying third graphical object 415 from set space 1641 (e.g., an AR space (or environment)) to another space (e.g., a VR space (or environment)). Here, the sixth user input may be different from the first through fifth user inputs. The virtual 3D space may be selectively switched from one of the first space generated using camera modules 180, 211-1, 211-2, 213, 313, 314, 315, and 316 or the second space previously stored in memory 130. Depending on the embodiment, processor 120 may display content provided by a designated application in the changed space (e.g., a VR environment). According to an embodiment, in response to at least one of the first user input or the second user input, processor 120 may provide an interaction (e.g., a visual effect (or graphical effect) or a layout change) to at least partially change at least a portion of the arrangement order of first, second, or third graphical objects 411, 413, or 415 arranged in the gaze direction, and cause at least some of first, second, or third graphical objects 411, 413, or 415 to move along the gaze direction. For example, processor 120 may sequentially change the arrangement order of at least one widget (e.g., a running screen) corresponding to second graphical object 413 that is immediately adjacent to first graphical object 411 in a depth direction that is not visible to the user due to first graphical object 411, based on the direction in which second graphical object 413 is being gazed at by the user, and may also provide an effect of being absorbed by (or disappearing from) third graphical object 415. For another example, if a specified event occurs (e.g., generation of a notification, widget update, and / or user's request), the processor 120 may change the arrangement order so that at least some of the one or more widgets and the newly running widget are set in front of the first graphic object 411 for display to the user, and provide a graphical effect (e.g., interaction, visual effect, or layout change) as if at least some of the one or more widgets and the newly running widget penetrate the first graphic object 411.

[0111] Depending on the embodiment, the processor 120 may change the order of the first, second, and third graphical objects 411, 413, and 415 in a depthwise direction (e.g., z-direction) in an arrangement order different from a designated arrangement order. According to the embodiment, the processor 120 may change a graphical effect (e.g., size, position, shape, color, or transparency) to at least a portion of at least one of the first, second, or third graphical objects 411, 413, or 415 upon receiving a second user input when performing an operation to apply a graphical effect based on gaze information (e.g., gaze information and / or eye shape information). Depending on the embodiment, the processor 120 may change at least one of the size or color of the first graphical object 411 upon receiving a second user input to the first graphical object 411. Depending on the embodiment, the processor 120 may change at least one of the size, position, shape, or color of the second graphical object 413 upon receiving a second user input to the second graphical object 413. Depending on the embodiment, the processor 120 may change at least one of the size or transparency of the third graphical object 415 upon receiving a second user input to the third graphical object 415.

[0112] According to an embodiment, when second graphic object 413 includes objects (e.g., graphic objects) representing multiple applications, processor 120 may execute the multiple applications based on receiving a first user input to second graphic object 413 and control display module 160 to display corresponding execution screens of the executed applications in a 3D virtual space. Processor 120 may control display module 160 to independently display the objects representing the multiple applications between first graphic object 411 and third graphic object 415 while replacing second graphic object 413 based on receiving a fourth user input. Here, the fourth user input may be different from the first to third user inputs.

[0113] Depending on the embodiment, the second graphical object 413 may include objects (e.g., graphical objects) that respectively represent one or more sub-functions provided by a designated application. Depending on the embodiment, upon receiving a fifth user input (e.g., a double-click or a swipe in a specific direction) on the second graphical object 413, the processor 120 may control the display module 160 to display objects representing the sub-functions of the designated application in place of or adjacent to the second graphical object 413. Here, the fifth user input may be different from the first to fourth user inputs. Depending on the embodiment, upon receiving a first user input (e.g., a tap) for selecting any one of the objects representing the sub-functions of the designated application, the processor 120 may execute the function corresponding to the selected object.

[0114] According to an embodiment, the processor 120 may use a camera module for facial recognition (e.g., Figure 1 Camera module 180, Figure 2 Camera modules 212-1 and 212-2, Figure 3c The processor 120 may use the camera modules 325 and 326 of the user's computer to obtain image information, use the obtained image information to identify at least one of eye movement or eyelid movement, and obtain (e.g., determine or identify) gaze information of the user based on the identified eye movement or eyelid movement. Here, the gaze information may include information related to at least one of fixed gaze, shifted gaze, or gaze direction. Depending on the embodiment, the processor 120 may obtain shape information about the user's eyes (e.g., eye size obtained based on eyelid movement) based on the obtained image information.

[0115] According to an embodiment, if the user gazes at the third graphic object 415 during a designated time as the second user input, the processor 120 may change the size of the third graphic object 415 based on the size of the user's eyes or the position of the user's gaze.

[0116] According to an embodiment, if the (eg, designated) second graphic object 413 that the user gazes at during a designated time is recognized as a second user input, the processor 120 may change the position of the second graphic object 413 based on fixation or movement of the user's gaze.

[0117] According to an embodiment, if the (e.g., specified) first graphic object 411 that the user is gazing at during a specified time is identified as a second user input, the processor 120 may apply a graphic effect (e.g., changing the brightness, saturation, or transparency of the first graphic object 411) to the first graphic object 411 based on at least one of the fixation or movement of the user's gaze (e.g., eye direction) or eye size.

[0118] According to an embodiment, when a plurality of icons are provided, the processor 120 may recognize user gaze at a first icon during a designated time (N seconds) as a second user input, assign the user's gaze to the first icon, and change the color or size of the first icon.

[0119] The electronic device 101 according to an embodiment may implement a software module (eg, Figure 1 The memory 130 of the electronic device 101 may store a program for implementing Figure 1 At least one processor 120 may execute the instructions stored in the memory 130 to implement Figure 1 The software modules shown in FIG. 1 and FIG. 2 may control hardware associated with the functions of the software modules (e.g., sensor module 176, camera module 180, communication module 190, display module 160, or Figure 1 other necessary modules).

[0120] According to an embodiment, the software modules of the electronic device 101 may include a kernel (or HAL), an architecture (eg, Figure 1 middleware 144) and applications (e.g., Figure 1 At least a portion of the software module may be preloaded on the electronic device 101, 200, or may be downloaded from a server (e.g., Figure 1 server 108) to download.

[0121] Thus, in the embodiment, Figure 1 electronic device 101, Figure 1 The electronic device 200 and Figure 3a 、 Figure 3b and Figure 3c The electronic device 300 depicts the main components of the electronic device. However, in various embodiments, instead of Figure 1 、 Figure 2 、 Figure 3a 、 Figure 3b and Figure 3c All components are essential components, and the electronic devices 101, 200 and 300 can be implemented with more or fewer components than those shown. Figure 1 、 Figure 2 、 Figure 3a 、 Figure 3b and Figure 3c The positions of the main components of the described electronic devices 101 , 200 , and 300 may vary according to various embodiments.

[0122] According to an embodiment, an electronic device (e.g., Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The electronic device 300 may include a display (eg, Figure 1 Display module 160, Figure 2 The first display 251 and the second display 252, Figure 3a Display component 340, Figure 3c display module 321), memory (eg, Figure 1 Memory 130) and at least one processor (e.g., Figure 1 processor 120).

[0123] According to an embodiment, at least one processor of the electronic device may be configured to: control the display to display an icon (eg, Figure 4a and Figure 4b an icon 410 comprising a plurality of graphic objects; based on status information about at least one application, changing at least one graphic object among the plurality of graphic objects to indicate a status of the at least one application; and controlling the display to display a changed icon reflecting the changed at least one graphic object.

[0124] According to an embodiment, the plurality of graphic objects may include a first graphic object in a frame area, a second graphic object representing content of at least one application, and a third graphic object in a background area. The plurality of graphic objects each have a layer depth. According to an embodiment, the icon may be configured to be displayed in a variable form in a 2D environment and a 3D environment.

[0125] According to an embodiment, at least one processor may be configured to change a layer order of a plurality of graphic objects based on operation state information about at least one application.

[0126] According to an embodiment, the at least one processor may be configured to change a layer order of the second graphic object to a higher layer than the first graphic object in response to a change in a state of the at least one application or user interaction.

[0127] According to an embodiment, the at least one processor may be configured to apply the visual effect to the second graphic object in response to a change in a state of the at least one application or a user input.

[0128] According to an embodiment, at least one processor may be configured to execute a function corresponding to a different operation for each of a plurality of graphic objects to which the user input is applied.

[0129] According to an embodiment, at least one processor may be configured to: in response to a first user input, run at least one application and control a display to display an icon in which a visual effect is applied to at least one of a plurality of objects; and in response to a second user input of a user, run an operation of the application corresponding to the second user input, and in response to a change in a state of the operation of the application, control the display to display an icon in which a visual effect is applied to at least one of a plurality of objects.

[0130] According to an embodiment, at least one processor may also be configured to: when exposing content included in an application, change the icon to a contact icon in the form of a content object in which some of a plurality of objects are maintained, and display the contact icon in a portion of the running screen of the application or a partial area of ​​the content; enlarge or reduce the content in response to user interaction with the contact icon; and change the display position and shape of the contact icon in response to user interaction, and display the contact icon.

[0131] According to an embodiment, the at least one processor may be configured to enlarge the second graphic object in response to an increase in the amount of content, and to reduce the second graphic object in response to a decrease in the amount of content.

[0132] According to an embodiment, at least one processor may be configured to control the display to display an icon with a visual effect applied to the second graphic object based on a change in the distance between the first graphic object and the second graphic object, the receipt of an event affecting a third graphic object, or the execution of multiple applications.

[0133] Figure 9 is a flowchart illustrating an example of an operating method in an electronic device according to an embodiment.

[0134] In the following embodiments, operations may be performed in sequence, but may not be performed in sequence. For example, the order of operations may be changed, and at least two operations may be performed in parallel.

[0135] According to an embodiment, it can be understood that operations 901 to 907 are performed by an electronic device (e.g., Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The processor of the electronic device 300 (eg, Figure 1 processor 120) to execute.

[0136] Reference Figure 9 In operation 901, an electronic device according to an embodiment (eg, Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The electronic device 300) can perform control so that the display module (eg, Figure 1 Display module 160, Figure 2 Displays 251 and 252, Figure 3a Display component 340, Figure 3b and Figure 3c The display module 321) displays an icon for running at least one application in the 3D virtual space. The icon (for example, Figure 4a and Figure 4bThe icon 410) may include multiple graphic objects having depth (e.g., spaced apart or having a predetermined distance or gap) in a depth direction (e.g., z direction) and may be configured as a tile of minimum size as an image representing a designated application. The icon may be configured to run the designated application when a user input (e.g., a tap) (e.g., a first user input) is received. The icon may be displayed in a variable form to have a sense of space in the virtual space of the 3D environment and may be displayed not only in a 3D environment but also in a 2D environment. The icon may be displayed on a home screen in a 2D environment and a 3D environment, for example. The icon 410 displayed in a 2D environment may represent a 2D graphic object. The icon 410 displayed in a 3D environment may represent a 3D graphic object. The electronic device may generate a 2D graphic object corresponding to a shape projected onto a plane according to the order in which the 3D graphic objects are arranged, and display the generated 2D graphic object using the display module 160 in the 2D environment. The third graphic object of the background area (e.g., Figure 4a and Figure 4b The third graphic object 415) includes the content of at least one application, the second graphic object (eg, Figure 4a and Figure 4b The second graphic object 413 of the frame area represents one or more contents of at least one application, and the plurality of graphic objects may include a first graphic object of the frame area (eg, Figure 4a and Figure 4b The plurality of graphic objects may be arranged to be spaced apart from each other (e.g., at gaps) by a predetermined distance along a depth direction (e.g., a z direction) of the first graphic object, the second graphic object, and the third graphic object in a specified arrangement order, and at least one of the arrangement order, shape, size, color, transparency, or display position may be changed based on a state of a specified application.

[0137] In operation 903, the electronic device according to the embodiment can run the specified application according to the reception of the first user input and obtain status information about the specified application. The electronic device can obtain information indicating whether the application indicated by the icon is running, the function of the running application, or the change of the operating state of the content included in the running application as the status information.

[0138] In operation 905, the electronic device according to an embodiment may change at least one graphic object among a plurality of graphic objects of an icon based on state information about at least one application to indicate the state of the at least one application. The electronic device may dynamically change the icon by applying (e.g., changing, providing, or displaying) a graphic effect corresponding to the state change of at least one graphic object among the plurality of graphic objects in response to the state change of the application.

[0139] In operation 907 , the electronic device according to the embodiment may display a changed icon including the changed at least one graphic object in a 3D virtual space through a display module.

[0140] Figures 10a to 10e is a view illustrating an example of displaying icons in an electronic device according to an embodiment.

[0141] refer to Figure 10a , according to the electronic device of the embodiment (eg, Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The electronic device 300 may identify a change in the distance between a first graphic object 411 and a second graphic object 413 based on status information about a designated application, and may display a change in the state of the icon 410 by changing (e.g., resizing) the second graphic object 413 in accordance with the identified change in distance. In one embodiment, when the second graphic object 413 approaches the first graphic object 411, the electronic device may dynamically change the icon 410 by applying a visual effect 1001b (e.g., a graphic effect) that enlarges the second graphic object 413. In another embodiment, when the second graphic object 413 moves away from the first graphic object 411, the electronic device may dynamically change the icon 410 by applying a visual effect 1001a that reduces the size of the second graphic object 413. For example, when a first user input (e.g., a gesture input) is received, the designated application indicated by the icon 410 may be executed, and the execution of the designated application may be used to display a change in the state of the icon 410 in accordance with the change in the distance between the first and second graphic objects 411, 413. For example, the state change of the icon 410 may be displayed according to the state change of the content included in the running designated application (e.g., an increase or decrease in the number of received messages) and the change in the distance between the first graphic object 411 and the second graphic object 413.

[0142] refer to Figure 10b and Figure 10cWhen an event 1011 or 1013 (e.g., a change in brightness or luminance of an application) that affects at least one of the graphic objects 411, 413, and 415 occurs, the electronic device according to an embodiment may dynamically change the icon 410 by applying a visual effect (e.g., lighting or fading) 1003 or 1005 according to the event 1011 to the second graphic object 413 based on state information of the designated application. For example, when there is an active application currently in use, the electronic device may display an object 1011 indicating the event as the event that affects the at least one of the graphic objects 411, 413, and 415, and apply the visual effect 1003 to the at least one of the graphic objects 411, 413, and 415 to display the application or illuminate it brightly. For example, when there is an inactive application that may not be currently being used, an application that needs to be updated, or an application running in the background, the electronic device can display an object 1013 indicating an event as an event affecting at least one graphic object 411, 413, and 415, and apply a visual effect 1005 to at least one graphic object 411, 413, and 415 to display the application or dim the lighting.

[0143] refer to Figure 10d When objects representing multiple applications included in the second graphic object are included, the electronic device according to an embodiment can execute multiple applications based on receiving the first user input. The electronic device can display corresponding execution screens of the multiple applications in a 3D virtual space, and when displaying the execution screens, dynamically change the icon 410 by applying a visual effect representing the execution of the multiple applications (e.g., displaying multiple second graphic objects) 1007 to the second graphic object while the multiple applications are executing.

[0144] refer to Figure 10e According to an embodiment, the electronic device can dynamically change the icon 410 by rotating the second graphic object 413 in response to a user's gesture input (e.g., sliding) according to a change in the state of the specified application when running a specified application (e.g., a message application or a message sending and receiving related application) to apply a visual effect (e.g., a digital representation based on the number of messages and / or the rotation of the second graphic object) representing the state of the specified application (e.g., the number of messages).

[0145] Figure 11a to Figure 1 1I is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0146] refer to Figure 11a to Figure 1 1I, according to the electronic device of the embodiment (for example, Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3cThe electronic device 300 may display an icon 410 including a plurality of graphic objects in a virtual space. In response to a first user input (e.g., a tap) 1101, the electronic device may run a designated application (e.g., a message application or a messaging-related application) indicated by the icon 410, maintain the display of the icon 410 while running the designated application, and display the icon 410 with a visual effect 1111 (e.g., a graphic effect) reflecting that the second graphic object 413 is pressed. For example, in response to a first user input (e.g., a tap) 1101, the electronic device may run a designated application (e.g., a message application or a messaging-related application) indicated by the icon 410, maintain the display of the icon 410 while running the designated application, and display the icon 410 with a visual effect 1111 (e.g., a graphic effect) reflecting that the second graphic object 413 is pressed. Figure 11b According to the first user input 1101 shown, the second graphic object 413 of the icon 410 can be reduced in size and displayed to the user according to the change in the distance it moves away from the third graphic object 415 (e.g., a virtual window). The electronic device can display an operation screen 1112 including some information (e.g., a brief message) of the content according to the operation of the specified application. Here, the operation screen 1112 can be a screen in which the third graphic object 415 included in the icon 410 is enlarged. The electronic device can maintain or change the shape of the second graphic object 413 in response to the first user input (e.g., a tap) 1101. When displaying the operation screen 1112, the electronic device can display (e.g., maintain or provide) the second graphic object 413 with the maintained or changed shape adjacent to or overlapping the operation screen 1112.

[0147] According to the embodiment, Figure 11d and Figure 11e As shown, when receiving user input 1103 while running a specified application, the electronic device (eg, Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The electronic device 300 can display an operation screen 1113 including additional information about the content (e.g., detailed information about the message) by enlarging the operation screen 1112 in response to second user input 1103, apply a visual effect (e.g., recoloring) to the second graphic object 413 in response to the content state change, and change the second graphic object 413 to a content object (e.g., a content icon) and display the content object while retaining the second graphic object 413. The second graphic object 413 can be displayed on a higher layer of the operation screen 1113, where the layer order has been changed to expand the first graphic object 411. Here, the operation screen 1113 can be a screen in which the first graphic object 411 included in the icon 410 is enlarged. The user input 1103 can be a different type of user input than the first user input 1101 (e.g., pinch-to-zoom, magnification, swipe, or drag).

[0148] According to the embodiment, Figure 11f to Figure 1As shown in FIG1I , in response to user input 1105, the electronic device may enlarge an operation screen 1113 to overlap and display other operation screens 1114 and 1115 including one or more other contents. In response to fourth user input 1107, the electronic device may change (e.g., expand the screen) the states of the operation screens 1114 and 1115 and may display the changed states.

[0149] According to an embodiment, in contrast to expanding the operation screen 1113, the electronic device may reduce the operation screen 1113 through a user's input of reducing the enlarged content (eg, pinching or pinching out), and display another operation screen including other functions or other contents, such as Figure 11f to Figure 1 As shown in 1I.

[0150] Figures 12a to 12f is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0151] refer to Figures 12a to 12f , according to the electronic device of the embodiment (eg, Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The electronic device 300) can display an icon 410 including a plurality of graphic objects in a virtual space. Figure 12a As shown, the electronic device may display an object 1201 corresponding to the movement of the user's hand and display an icon 410 in which a visual effect 1211 indicating a state change of an application is applied to a second graphic object 413. For example, Figure 12b As shown, the layer order may be changed such that the second graphical object 413 is shown on an upper layer of the first graphical object 411 in response to a first user input (eg, dragging) 1203 .

[0152] According to the embodiment, Figures 12b to 12dAs shown, the electronic device can execute an application (e.g., a memo or image editing application) indicated by icon 410 and display an execution screen 1213 of the application in a 3D environment (e.g., an XR environment) in response to a first user input (e.g., a metaphorical gesture of dragging a second graphical object). For example, while icon 410 is displayed in the virtual space of the 3D environment (e.g., an XR environment), upon receiving user input 1203 based on a user's dragging motion of a second graphical object 413 included in icon 410, the electronic device can display a content icon (e.g., a drawing tool or pen) 1205 that is a metaphorical icon corresponding to the second graphical object 413 and display execution screen 1213 including a function or content corresponding to user input 1203. The electronic device can dynamically display the content icon (e.g., a drawing tool or pen) 1205 corresponding to the second graphical object 413 in response to movement of object 1201 or user interaction, and execute the input (e.g., drawing) corresponding to the movement of object 1201 or user interaction. Here, the content icon 1205 may be an icon in which some of the multiple graphic objects of the icon 410 (e.g., the second graphic object) are changed into a content object form to be maintained and may be displayed in a partial area of ​​the content or a portion of the running screen of the application, so that some of the multiple graphic objects have consistency / continuity. The electronic device may change and display the changed display position and shape of the content icon in response to the movement of the object 1201 or the user interaction. For example, Figure 12b As shown, the electronic device may display the content icon at the location where the content icon is dragged by the user's hand, and if the content is separated from the user's hand, the content icon 1205 may be displayed continuously or consistently at another location of the object 1201 displaying the user's hand, without removing the content icon 1205. Here, the operation screen 1213 may be a screen in which the first graphic object 411 included in the icon 410 is displayed in an enlarged manner. In response to the first user input (e.g., dragging) 1203, the electronic device may maintain or change the shape of at least one graphic object (e.g., the second graphic object 413) among the multiple graphic objects included in the icon 410 by applying a visual effect.

[0153] According to the embodiment, Figure 12e As shown, upon recognizing a user input (e.g., a gesture or interaction) in which the user's hand taps (e.g., touches) the icon 410 when an application (e.g., a memo or image editing application) is executed, the electronic device may display the object 1201 of the user's hand adjacent to or overlapping the icon 410, execute an application corresponding to a first execution result (e.g., the icon 410) corresponding to the recognized user input of tapping the icon 410 or execute another function (e.g., an editing function) of the executed application, and display the execution result (e.g., as shown in FIG. 1 ). Figure 12cAccording to an embodiment, the electronic device may recognize a user input (eg, a gesture or interaction) of the user's hand dragging the content icon 1205, such as the running screen 1213 or the editing screen shown. Figure 12c As shown, the user's hand is displayed adjacent to or overlapped with the running screen 1213 away from the metaphorical icon (ie, the content icon (eg, drawing tool or pen) 1205). Figure 12c As shown, when the user input (eg, gesture or interaction) of the user's hand dragging the content icon 1205 is recognized, the electronic device may execute a second execution result (eg, Figure 12d The operation result is displayed on the operation screen 1213. Figure 12e and Figure 12f As shown, the electronic device according to an embodiment may provide different application execution results according to recognition of different types of user inputs (eg, gestures or interactions) on the icon 410 of the same application.

[0154] Figures 13a to 13f is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0155] refer to Figures 13a to 13f , according to the electronic device of the embodiment (eg, Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The electronic device 300 may display an icon 410 including a plurality of graphic objects and an object 1301 representing a user's hand in a virtual space. The electronic device may display the icon 410 in which, in response to a first user input (e.g., a tap) 1303, a visual effect 1311 (e.g., a graphic effect) indicating an application state change is applied to the first graphic object (e.g., Figure 4a and Figure 4b ), a first graphic object 411), a second graphic object (eg, Figure 4a and Figure 4b 413) and / or a third graphic object (eg, Figure 4a and Figure 4b For example, in response to the first user input 1303, the second graphic object 413 of the icon 410 may be changed in layer order (eg, arrangement order) to be positioned above the first graphic object (eg, Figure 4a and Figure 4bThe electronic device may execute the application indicated by icon 410 (e.g., a content editing application) in response to a second user input (e.g., a gesture to pull the second graphic object) 1305 and display an execution screen 1313 of the application. Here, execution screen 1313 may be an enlarged screen of the first graphic object included in icon 410. The electronic device may maintain the shapes of the multiple graphic objects or change at least some of the multiple graphic objects by applying a visual effect in response to the first user input (e.g., a tap) 1303. According to an embodiment, when the application is executed to expose the content (display of execution screen 1313), the electronic device may display content icon 1321 in which changes have occurred such that some of the multiple graphic objects (e.g., the second graphic object) of icon 410 are retained.

[0156] According to an embodiment, the electronic device may change the second graphic object to a content object, maintaining the second graphic object in an overlapping or adjacent area on the operation screen 1313 and displaying a content icon 1321. The content icon 1321 may be displayed on a higher layer of the operation screen 1313, where the third graphic object 415 (e.g., a virtual window) has been changed. According to an embodiment, the electronic device may move the operation screen 1313 in response to user input 1307 and display the operation screen 1315 including other content.

[0157] Figures 14a to 14h is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0158] refer to Figures 14a to 14h , according to the electronic device of the embodiment (eg, Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The electronic device 300 may display an icon 410 including a plurality of graphic objects in a virtual space. In response to a first user input (e.g., a tap) 1401, the electronic device may display the changed icon 410 by applying a visual effect 1411 of enlarging the plurality of graphic objects based on a change in application state (e.g., enlarging and displaying the icon). In response to a user input (e.g., a gesture of pulling a second graphic object) 1403, the electronic device may run an application (e.g., a document-related application) indicated by the icon 410 and display an execution screen 1413 of the application including content. The electronic device may change the second graphic object 413 and display it as a content object in an overlapping or adjacent area on the execution screen 1413. Here, the execution screen 1413 may be a screen in which the first graphic object 411 included in the icon 410 is enlarged.

[0159] According to the embodiment, Figure 14d and Figure 14e As shown, the electronic device may display an operation screen 1415 for providing detailed information about the content in response to user input 1403. Here, the operation screen 1413 may be a screen in which the first graphic object 411 included in the icon 410 is enlarged. The electronic device may maintain or change the second graphic object 413 and the third graphic object 415 by applying a visual effect in response to user input (e.g., a tap) 1403.

[0160] According to the embodiment, Figures 14e to 14h As shown, the electronic device may change the state of the content in response to user input 1405 or 1407 and display it on the running screen 1415 (eg, move to the next page or display several pages).

[0161] Combined with the above Figures 11a to 14h In the described embodiment, when the running screen is displayed in the 3D virtual space (for example, Figure 11e to Figure 1 1I operation screen 1112 to 1114, Figures 12c to 12f Running screen 1213, Figures 13c to 13f Operation screen 1313 and / or Figures 14c to 14d When the electronic device displays an operating screen 1413 (e.g., a user-selectable icon), the electronic device may display a second graphical object 413 of the icon in an adjacent area of ​​the operating screen based on a user's finger movement in the depth direction (e.g., the z-direction) of a third graphical object (e.g., a virtual window) 415 to select an icon (e.g., a user-selectable icon). Depending on the embodiment, the electronic device may perform different operations upon receiving user input (e.g., a first user input) for selecting the operating screen and upon receiving user input (e.g., a second user input or a third user input) for selecting the second graphical object 413 while the second graphical object 413 is displayed adjacent to the operating screen. Depending on the embodiment, upon receiving user input selecting the second graphical object 413 displayed in the adjacent area while the operating screen is displayed, the electronic device may apply a graphical effect to the second graphical object 413 or execute at least one function related to the application indicated by the second graphical object 413 (e.g., a sub-function or a function different from the displayed operating screen). Depending on the embodiment, upon receiving user input selecting a portion of the operating screen while the second graphical object 413 is displayed adjacent to the operating screen, the electronic device may execute a function related to the operating screen or switch to another operating screen of the application. According to an embodiment, when displaying the execution screen, the electronic device may not display (eg, remove or make disappear) the third graphic object of the virtual screen representing the icon.

[0162] According to an embodiment, an electronic device (e.g., Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The operating method of the electronic device 300 may include: controlling a display of the electronic device (eg, Figure 1 Display module 160, Figure 2 Displays 251 and 252, Figure 3a Display component 340, Figure 3c The display module 321) is used to display an icon (eg, Figure 4a and Figure 4b The invention also provides an icon 410 including a plurality of graphic objects; obtaining status information about at least one application; changing at least one object among the plurality of graphic objects to indicate the status of the at least one application based on the status information about the at least one application; and controlling the display module to display a changed icon reflecting the changed at least one graphic object.

[0163] According to an embodiment, the plurality of graphic objects may include a first graphic object in the frame area, a second graphic object representing content of at least one application, and a third graphic object in the background area. According to an embodiment, each of the plurality of graphic objects may have a layer depth.

[0164] According to an embodiment, changing at least one object among the plurality of graphic objects may include changing a layer order of the plurality of graphic objects based on operation state information about the at least one application.

[0165] According to an embodiment, changing at least one object among the plurality of graphic objects may include changing a layer order (eg, arrangement order) of a second graphic object to a higher layer than the first graphic object in response to a change in a state of at least one application or user interaction.

[0166] According to an embodiment, changing at least one object among the plurality of graphic objects may include applying a visual effect to a second graphic object in response to a change in a state of at least one application or a user input.

[0167] According to an embodiment, changing at least one object among the plurality of graphic objects may include enlarging the second graphic object in response to an increase in the amount of content and reducing the second graphic object in response to a decrease in the amount of content.

[0168] According to an embodiment, controlling the display module to display a changed icon reflecting at least one changed graphical object may include: in response to a first user input, running at least one application represented by the icon and displaying an icon to which a visual effect is applied to at least one of the multiple objects; and in response to a second user input of the user, running an operation of the application corresponding to the second user input and displaying an icon to which a visual effect is applied to at least one of the multiple objects in response to a change in the state of the operation of the application.

[0169] According to an embodiment, controlling the display module to display a changed icon reflecting at least one changed graphic object may include: displaying an icon to which a visual effect is applied to the second graphic object based on a change in the distance between the first graphic object and the second graphic object, receipt of an event affecting a third graphic object, or the running of multiple applications.

[0170] According to an embodiment, the method may further include executing a function corresponding to a different operation for each of the plurality of graphic objects of the icon to which the user input is applied.

[0171] According to an embodiment, the icon may be configured to be displayed in a changeable form in a 2D environment and a 3D environment.

[0172] According to an embodiment, the method may further include: when exposing content included in the application, changing the icon to a contact icon in the form of a content object in which some of the multiple objects are maintained, and displaying the contact icon in a portion of the running screen of the application or a partial area of ​​the content; enlarging or reducing the content in response to user interaction with the contact icon, changing the display position and shape of the contact icon in response to user interaction, and displaying the contact icon.

[0173] According to an embodiment, in a non-transitory storage medium storing a program, the program may include instructions that, when executed by a processor of an electronic device, enable the electronic device to: display an icon running at least one application on a display of the electronic device, the icon including multiple graphic objects; obtain status information about at least one application; change at least one of the multiple graphic objects based on the status information about at least one application to indicate the status of the at least one application; and display a changed icon reflecting the changed at least one graphic object using a display module.

[0174] Figure 15 is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0175] refer to Figure 15 In operation 1501, an electronic device according to an embodiment (eg, Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The electronic device 300 (hereinafter referred to as a wearable electronic device) can be used to display the user's mobile phone through a display module (eg, Figure 1 Display module 160, Figure 2 Displays 251 and 252, Figure 3a Display component 340, Figure 3c The display module 321 of the electronic device 321 displays a 3D graphical object corresponding to a designated application in a 3D virtual space. According to an embodiment, the electronic device can display, via the display, a first graphical object 411 (e.g., a virtual window object or first graphical object 411 in FIG. 4 ), a second graphical object 413 (e.g., a pictographic object or second graphical object 413 in FIG. 4 ), and a third graphical object 415 (e.g., a world object or third graphical object 415 in FIG. 4 ) included in the icon in a virtual 3D space, arranged in a designated depthwise arrangement order. According to an embodiment, first graphical object 411 may indicate the background in which content provided by the designated application will be displayed, may be fixed and arranged (displayed) in the 3D virtual space, and may be configured to be viewed only through third graphical object 415. Second graphical object 413 may indicate the designated application. Third graphical object 415 may indicate the outline of icon 410. The electronic device according to the embodiment may display at least a portion of at least one of the second graphic object 413 or the first graphic object 411 on an extension line between a point in the 3D virtual space and an inner area of ​​the first graphic object 411 to be viewed through the third graphic object 415. The first graphic object 411, the second graphic object 413, and the third graphic object 415 may be sequentially arranged in a specified arrangement order from far to near, and when a second user input is received, the arrangement order of at least some of the first graphic object 411, the second graphic object 413, and the third graphic object 415 may be changed. The second graphic object 413 may be set to be in the camera module (e.g., Figure 1 Camera module 180, Figure 2 The first cameras 211-1 and 211-2, the third camera 213, Figure 3b The camera modules 313, 314, 315, and 316 of the camera module 313 are spaced apart from the first graphic object 411 in the depth direction (e.g., the Z direction) facing the first graphic object 411 (e.g., a point in the area of ​​the first graphic object) by a specified distance (e.g., a gap). The second graphic object 413 may be set by the specified distance in the depth direction between the first graphic object 411 and the third graphic object 415.

[0176] In operation 1503, the electronic device according to an embodiment may, when arranging and displaying the first, second, and third graphic objects 411, 413, and 415 in a specified arrangement order in the depth direction (e.g., the Z direction), identify at least one graphic object on which the user is gazing 1601, and receive user input (e.g., a first user input and / or a second user input) for the at least one graphic object among the first, second, or third graphic objects 411, 413, or 415 on which the user is gazing 1601. According to an embodiment, the electronic device may receive a first user input for at least one graphic object among the first, second, or third graphic objects 411, 413, or 415 based on the gaze 1601 to execute at least one function of a specified application. According to an embodiment, the electronic device may receive a second user input for at least one graphic object among the first, second, or third graphic objects 411, 413, or 415 based on the gaze 1601. Here, the second user input may be different from the first user input.

[0177] In operation 1505, the electronic device according to an embodiment may apply (e.g., change, provide, or display) a graphical effect to at least one of the plurality of graphical objects based on a second user input, or may run a designated application based on a first user input. According to an embodiment, the electronic device may run at least one function of the designated application based on a third user input. Here, the third user input may be a gaze input or gesture input different from the first and second user inputs. According to an embodiment, the electronic device may apply a graphical effect to the at least one graphical object and display the at least one graphical object (or an icon including the graphical object (e.g., icon 410 in FIG. 4 )) with the changed graphical effect applied in a 3D virtual space. According to an embodiment, the electronic device may recognize a gaze 1601 and, if a first user input is received during a specified time (e.g., N seconds) of gazing at the first graphical object 411, the second graphical object 413, or the third graphical object 415, the electronic device may apply a graphical effect to the at least one graphical object. According to an embodiment, the electronic device may apply a different graphical effect to the at least one graphical object for each of the different input types included in the second user input. For example, when the second user input is a gaze input, the electronic device may specify and set gaze times, gaze directions, or eye movement types of different input types to be different from each other.

[0178] According to an embodiment, an electronic device may perform the following operations: changing the arrangement order of first, second, and third graphical objects 411, 413, and 415 to an order different from a specified order based on a gaze direction, and applying a graphical effect associated with the change in arrangement order. According to an embodiment, when applying a graphical effect, the electronic device may change at least one of the size, position, shape, color, or transparency of at least a portion of at least one of the first, second, and third graphical objects 411, 413, and 415 that received the second user input based on gaze information (e.g., gaze information and / or eye shape information). According to an embodiment, second graphical object 413 may include one or more objects (e.g., graphic objects). Each of the one or more objects may correspond to one of one or more sub-functions provided by a specified application. According to an embodiment, in response to a first user input selecting any of the one or more objects, the electronic device may execute a function corresponding to the selected object.

[0179] Figures 16a to 16c is a view illustrating an operating method in an electronic device according to an embodiment.

[0180] refer to Figure 16a According to an embodiment, the electronic device may recognize that gaze 1601 is directed at first graphic object 411 and, upon receiving user input 1611a (e.g., third user input) for selecting third graphic object 415, display at least one widget 1620 (e.g., a running screen) corresponding to at least one function of a designated application between first graphic object 411 and third graphic object 415 in a 3D virtual space (e.g., an XR environment or an AR environment) in place of or together with second graphic object 413. Here, the size of third graphic object 415 may be adjusted according to the size of widget 1620 so that at least one widget 1620 is displayed to the user.

[0181] refer to Figure 16bAccording to an embodiment, the electronic device may recognize that gaze 1601 is directed at second graphical object 413 and, upon receiving user input 1611b (e.g., first user input) for selecting second graphical object 413, execute a designated application in a 3D virtual space (e.g., an XR environment or an AR environment) and display an execution screen 1630 of the designated application. According to an embodiment, the electronic device may maintain second graphical object 413 adjacent to or overlapping with execution screen 1630 of the designated application. When the designated application is executed, the electronic device may remove first graphical object 411 and third graphical object 415 and display second graphical object 413 by maintaining or changing its shape. For example, second graphical object 413 displayed with execution screen 1630 may be an object in the form of a metaphorical icon (e.g., including an icon form of an object obtained by changing second graphical object 413 to content object 501). According to an embodiment, when receiving a user input (e.g., a gesture input or a gaze input) for selecting the second graphic object 413 displayed together with the operation screen 1630, the electronic device may remove the operation screen 1630 and then display an icon including a plurality of graphic objects, execute at least one function or sub-function of a designated application, display an object of at least one function or sub-function of a designated application, or display a detailed screen related to the notification event displayed on the second graphic object 413. According to an embodiment, the electronic device may reflect a state change related to the operation of the designated application on the second graphic object 413 displayed together with the operation screen 1630.

[0182] refer to Figure 16cAccording to an embodiment, the electronic device may recognize that gaze 1601 is directed at the third graphical object 415 and, upon receiving user input 1611c (e.g., sixth user input) for selecting the third graphical object 415, selectively switch the virtual 3D space displaying the third graphical object 415 from a first space generated using a camera or a second space pre-stored in the electronic device to another space. For example, upon receiving sixth user input 1611c, the electronic device may switch a set space 1641 (e.g., an AR environment) to another space 1643 (e.g., a VR space (or environment)). Here, the sixth user input may be different from the first through fifth user inputs. According to an embodiment, the electronic device may display content 1631a, 1631b, and / or 1631c (e.g., a running screen) provided by a designated application in the changed space (e.g., VR environment) 1641. The electronic device may also display the second graphical object, whose shape has been maintained or changed, along with the content 1631a, 1631b, and / or 1631c. In response to the second user input, the electronic device according to an embodiment may provide an interaction (e.g., a visual effect (or graphic effect) or a layout change) to move at least some of the first graphic objects 411, the second graphic objects 413, or the third graphic objects 415 along the gaze direction to at least partially change the arrangement order of the first graphic objects 411, the second graphic objects 413, or the third graphic objects 415 arranged in the gaze direction.

[0183] Figure 17a and Figure 17b is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0184] refer to Figure 17a and Figure 17bAccording to an embodiment, the electronic device may recognize that the user is gazing 1701 at the third graphic object 415, and if a user input 1711 (e.g., a third user input) for selecting the second graphic object 413 is received, run one or more widgets 1721, 1722, and / or 1723 (e.g., objects) corresponding to at least one function of a specified application, and display the one or more widgets 1721, 1722, and / or 1723 in place of the second graphic object 413 or overlapping with the second graphic object 413 at a predetermined distance between the first graphic object 411 and the third graphic object 415 in a 3D virtual space (e.g., an AR environment). In some embodiments, the electronic device may apply (e.g., change, provide, or display) a graphical effect that changes the arrangement order (e.g., an engaging interaction, a visual effect (or graphical effect), or a layout change) of at least one widget 1721, 1722, and / or 1723 corresponding to the second graphical object 413 that is immediately adjacent to the first graphical object 411 (e.g., not shown through the first graphical object 411) in the depth direction in response to a second user input (e.g., a gaze input) to the second graphical object 413. In some embodiments, upon receiving a third user input different from the second user input (e.g., a gaze input) to the second graphical object 413, the electronic device may maintain the arrangement order of the second graphical object 413 without changing it, and may execute one or more widgets 1721, 1722, and / or 1723, sequentially arranging them at a specified distance immediately adjacent to the first graphical object 411. Here, the one or more widgets 1721, 1722, and / or 1723 may be configured to correspond to one or more graphical objects (e.g., pictographic forms of one or more sub-functions). According to an embodiment, if a specified event occurs (e.g., generation of a notification, widget update, and / or user's request), the electronic device may change so that at least some 1721 of the one or more widgets 1721, 1722, and / or 1723 and the widget 1724 running in relation thereto are sequentially arranged before the first graphical object 411 in the depth direction (e.g., the z direction) (e.g., to provide such interaction, visual effect (or graphical effect), or layout change), as if the corresponding widget 1721 among the plurality of widgets 1721, 1722, and / or 1723 and the newly running widget 1724 were shown to the user through the third graphical object 415. For example, the electronic device may apply a graphical effect for adjusting the transparency of the background of the first graphical object 411 so that at least some of the one or more widgets 1721, 1722, and / or 1723 sequentially arranged adjacent to the first graphical object 411 are shown to the user.

[0185] Figures 18a to 18c is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0186] refer to Figure 18a According to an embodiment, icons 1811, 1812, and 1813, each indicating an application with multiple instances (e.g., Internet, Notes, and Email), may be provided as a multi-window icon 1820. Multi-window icon 1820 may be displayed in a 3D virtual space as a single icon 1820 including a second graphical object 1821, which includes objects (e.g., second graphical objects) corresponding to icons 1811, 1812, and 1813, respectively. Upon receiving a first user input, the electronic device may independently display (e.g., independently display icons 1811, 1812, and 1813) icons representing multiple applications or corresponding running screens of multiple applications. For example, the electronic device may simultaneously display the corresponding running screens of multiple applications in a 3D virtual space. For example, the electronic device may display the running screen of at least one application (e.g., a recent running screen, a preferred running screen, a specified running screen, or a running screen with an event) from among the multiple applications while removing the other running screens. The functions corresponding to at least some of icons 1811, 1812, and 1813 (e.g., icon 1811) may include one or more sub-functions 1830. Upon receiving a fourth user input (e.g., gesture input and / or gaze input) for at least some of icons 1811, 1812, and 1813 (e.g., icon 1811), the electronic device may display objects 1830 (e.g., widgets including objects) corresponding to the sub-functions adjacent to second graphical object 1821, or replace second graphical object 1821 with objects corresponding to the sub-functions 1830 (e.g., second graphical objects). For example, the electronic device may display any one of the objects 1823 based on specified criteria (e.g., most recently used sub-functions or sub-functions with high frequency of use), or may display the switched object in response to the user switching object 1823 to an object corresponding to another sub-function. For example, the electronic device may display the objects corresponding to the sub-functions independently or overlapping one another.

[0187] refer to Figure 18b According to an embodiment, if the size of the third graphic object 415 (e.g., a virtual window) of the icon 1811 is enlarged, the electronic device may run one or more widgets 1841 and 1842 related to the second graphic object 1821 of the icon 1811 and display the run one or more widgets 1841 and 1842 together with the second graphic object 1821.

[0188] refer to Figure 18cAccording to an embodiment, the electronic device may recognize that the user's gaze 1801 is at the second widget 1842 , and if a second user input (eg, gaze input) for selecting the second widget 1842 is received, execute a designated function provided by the second widget 1842 .

[0189] Figure 19 is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0190] refer to Figure 19 , the electronic device according to the embodiment may use a camera module for facial recognition (eg, Figure 1 Camera module 180, Figure 2 The second camera modules 212-1 and 212-2, Figure 3c The electronic device may identify at least one of eye movement or eyelid movement based on image information obtained by the camera modules 325 and 326 of the user's camera module, and obtain (e.g., determine or identify) gaze information of the user based on the identified eye movement or eyelid movement. Here, the gaze information may include information related to at least one of fixed gaze, shifted gaze, or gaze direction. The electronic device according to an embodiment may obtain shape information about the user's eyes (e.g., eye size obtained based on eyelid movement) based on the obtained image information.

[0191] If the user's gaze 1901 is recognized as being at the first graphic object 411, the second graphic object 413, or the third graphic object 415, the electronic device may change at least one of the first graphic object 411, the second graphic object 413, or the third graphic object 415 based on a specified change condition (e.g., eye shape information including information related to eye size or gaze information). For example, the electronic device may recognize the user's gaze 1901, recognize that the first graphic object 411, the second graphic object 413, or the third graphic object 415 is selected when the user's gaze is during a specified time, and apply (e.g., provide or display) a graphic effect to the selected first graphic object 411, the second graphic object 413, or the third graphic object 415.

[0192] According to an embodiment, if the user's gaze is recognized and a (e.g., designated) third graphical object 415 at which the user's gaze is located during a designated period of time is identified as the second user input, the electronic device may change the size of the third graphical object 415 based on the size of the user's eyes 1903 or the position of the user's gaze 1901. For example, the electronic device may recognize the user's eyes 1903 and, in response to the recognized first eye size 1911 being smaller than the designated eye size 1912, reduce (1914) the size of the third graphical object 415 to a size smaller than the designated size 1915, and, in response to the recognized second eye size 1913 being larger than the designated size 1912, increase (1917) the size of the first graphical object 411 to a size larger than the designated size 1915. As another example, the electronic device may recognize the position of the user's gaze after it has moved and, when the recognized position of the gaze after it has moved is at a designated first position (e.g., above or to the right of the region of the third graphical object 415), increase the size of the third graphical object 415 to a size larger than the designated size. When the identified moved position of the gaze is at a designated second position (eg, at a lower side or a left side in the area of ​​the third graphic object 415 ), the electronic device may reduce the size of the third graphic object 415 to be smaller than the designated size.

[0193] According to an embodiment, if the electronic device identifies as the second user input a second graphical object 413 where the user's gaze is located (e.g., designated) during a specified time, the electronic device may change the position of the second graphical object 413 based on the fixation or movement of the user's gaze. The electronic device may recognize the fixation of the user's gaze and, in response to the movement of the gaze relative to the fixed position 1922 of the user's gaze, move the second graphical object 413 from position 1925 (e.g., change the position of the second graphical object 413). As an example, when the gaze moves in a first direction (e.g., left) (1921), the electronic device may move the second graphical object 413 in the first direction (e.g., left) (1924) (e.g., change the position of the second graphical object 413 to the position after the movement in the first direction). When the gaze moves in a second direction (e.g., right) (1923), the electronic device may move the second graphical object 413 in the second direction (e.g., right) (1926) (e.g., change the position of the second graphical object 413 to the position after the movement in the second direction). As another example, the electronic device may change the size or distance (eg, move away or closer) of the second graphic object 413 corresponding to the size of the user's eyes.

[0194] According to an embodiment, the electronic device may recognize and specify the user's gaze, and if it is recognized as an object change operation, change the first graphic object 411 (e.g., change the brightness, saturation, or transparency of the first graphic object 411) based on at least one of the fixation of the user's gaze, the movement of the gaze (e.g., the direction of the eyes), or the size of the eyes. For example, if the size of the user's eyes decreases (1931), the electronic device may change (1942) at least one of the brightness, saturation, or transparency of the first graphic object 411 to be lower than the reference state 1941. If the size of the user's eyes increases (1932), the electronic device may change (1943) at least one of the brightness, saturation, or transparency of the first graphic object 411 to be higher than the reference state 1941. For another example, if the user's gaze is fixed, the electronic device may display the first graphic object 411 in the currently specified shape, and if the user's gaze moves along a first direction (e.g., to the left), increase at least one of the brightness, saturation, or transparency of the first graphic object 411, and if the user's gaze moves along a second direction (e.g., to the right), decrease at least one of the brightness, saturation, or transparency of the first graphic object 411.

[0195] Figure 20 is a view illustrating an example of an operating method in an electronic device according to an embodiment.

[0196] refer to Figure 20 When multiple icons 2010 are provided, the electronic device according to an embodiment may recognize that the user's gaze 2001 is at a first icon 2011 (2021) during a specified time (N seconds) as a first user input, and assign the user's gaze 2001 to the first icon 2011. As an example, if the first user input is received in which the user's gaze 2001 is at a first icon 2011 among the multiple icons 2010 during the specified time (N seconds), the electronic device may change the color or size of the first icon 2011. As another example, if the second user input is received in which the user's gaze 2001 moves (2023) in a first direction (e.g., rightward) to a second icon 2013 among the multiple icons 2010, the electronic device may change the color or size of the second icon 2013.

[0197] According to an embodiment, a wearable electronic device (e.g., Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The electronic device 300 may include a display (eg, Figure 1 Display module 160, Figure 2 Displays 251 and 252, Figure 3aThe display member 340 and Figure 3c display module 321), a camera (eg, Figure 1 Camera module 180, Figure 2 The first cameras 211-1 and 211-2, the third camera 213, Figure 3b camera modules 313, 314, 315, and 316), memory (e.g., Figure 1 130) and one or more processors communicatively coupled to the display, memory, and camera (e.g., Figure 1 processor 120).

[0198] According to an embodiment, the memory may store one or more computer programs including computer executable instructions that, when executed by one or more processors, cause the wearable electronic device to display user-selectable icons and execute applications in a 3D virtual space, wherein the user-selectable icons may include a first graphical object representing a virtual window (e.g., Figure 4a and Figure 4b ) and a second graphic object representing an application (e.g., Figure 4a and Figure 4b The second graphic object 413 is selected through the first graphic object.

[0199] According to an embodiment, one or more computer programs may include computer-executable instructions that, when executed by one or more processors, cause the wearable electronic device to detect movement of a user's finger when a user-selectable icon is displayed in a 3D virtual space.

[0200] According to an embodiment, one or more computer programs may include computer-executable instructions that, when executed by one or more processors, enable the wearable electronic device to display a running screen of an application based on detecting movement of a user's finger in a depth direction of a virtual window of a first graphic object to select a second graphic object.

[0201] According to an embodiment, the one or more computer programs may further include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to display the second graphic object adjacent to the execution screen of the application.

[0202] According to an embodiment, the one or more computer programs may further include computer executable instructions that, when executed by the one or more processors, cause the wearable electronic device to display a representation of the movement of the user's finger relative to the user-selectable icon based on the detected movement of the user's finger.

[0203] According to an embodiment, one or more computer programs may also include computer-executable instructions, which, when executed by one or more processors, enable the wearable electronic device to not display the virtual window of the first graphic object when displaying the second graphic object when displaying the running screen of the application.

[0204] According to an embodiment, one or more computer programs may also include computer-executable instructions, which, when executed by one or more processors, enable the wearable electronic device to change the arrangement order between the first graphic object and the second graphic object along the depth direction based on user input regarding the second graphic object received when a user-selectable icon is displayed in a 3D virtual space, wherein the user input is different from the first user input and is at least one of a gesture input or a gaze input.

[0205] According to an embodiment, one or more computer programs may also include computer-executable instructions that, when executed by one or more processors, cause the wearable electronic device to change at least one of the size or transparency of the first graphical object based on receiving a second user input regarding the first graphical object, and to change at least one of the size, position, shape, or color of the second graphical object based on receiving a second user input regarding the second graphical object when a user-selectable icon is displayed in a 3D virtual space, wherein the second user input is different from the first user input and is at least one of a gesture input or a gaze input.

[0206] According to an embodiment, one or more computer programs may also include computer-executable instructions that, when executed by one or more processors, enable the wearable electronic device to execute at least one function of an application based on receiving a third user input regarding a second graphical object, wherein the third user input is at least one of a gesture input or a gaze input that is different from the first user input and the second user input.

[0207] According to an embodiment, the second graphic object may include objects respectively representing a plurality of applications.

[0208] According to an embodiment, one or more computer programs may also include computer-executable instructions, which, when executed by one or more processors, enable the wearable electronic device to: display a corresponding running screen for each of a plurality of applications based on receiving a first user input for a second graphic object; independently display an object representing each of a plurality of applications based on receiving a fourth user input regarding the second graphic object; and display an object representing each of a plurality of sub-functions of the application based on receiving a fifth user input regarding the second graphic object.

[0209] According to an embodiment, the one or more computer programs may further include computer executable instructions that, when executed by the one or more processors, cause the wearable electronic device to perform a user-selectable operation based on receiving a user's gaze at a designated location in the 3D virtual space and a finger of the user directed to a third graphical object (e.g., a background representing a user-selectable icon). Figure 4a and Figure 4b The 3D virtual space is selectively switched from a first space created using a camera or a second space stored in the wearable electronic device to another space by moving the first graphic object 411 .

[0210] According to an embodiment, the one or more computer programs may also include computer-executable instructions, which, when executed by one or more processors, enable the wearable electronic device to move the running screen of the application in the depth direction to behind the third graphic object based on the second user input so that the running screen of the application is invisible through the first graphic object, and to move at least a part of the running screen along the depth direction to in front of the third graphic object based on a specified event.

[0211] According to an embodiment, the wearable electronic device includes a facial recognition camera (e.g., Figure 1 Camera module 180, Figure 2 first cameras 211-1 and 211-2, Figure 3c ), the facial recognition camera may be provided on a side of the wearable electronic device facing the first graphic object.

[0212] According to an embodiment, one or more computer programs may also include computer-executable instructions, which, when executed by one or more processors, enable the wearable electronic device to use image information obtained by a facial recognition camera of the wearable electronic device to determine at least one of eye movement or eyelid movement, obtain gaze information based on at least one of the eye movement or eyelid movement, and determine a second user input based at least on the gaze information.

[0213] According to an embodiment, when a user wears the wearable electronic device, the display may emit light toward the user's eyes to display a plurality of graphic objects in a 3D virtual space.

[0214] According to an embodiment, a wearable electronic device (e.g., Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3cThe operating method in the electronic device 300 may include displaying a user-selectable icon for running an application in a 3D virtual space, wherein the user-selectable icon may include a first graphical object representing a virtual window (eg, Figure 4a and Figure 4b ) and a second graphic object representing an application (e.g., Figure 4a and Figure 4b The method may further include detecting movement of a user's finger when displaying user-selectable icons in a 3D virtual space. Furthermore, the method may include detecting movement of a user's finger in the depth direction of the virtual window of the first graphical object to select the second graphical object, and displaying a running screen of the application upon detecting movement of the user's finger in the depth direction of the virtual window of the first graphical object to select the second graphical object.

[0215] According to an embodiment, displaying the running screen of the application may include displaying the second graphic object adjacent to the running screen of the application, and displaying the running screen of the application may include not displaying the virtual window of the first graphic object when displaying the second graphic object when displaying the running screen of the application.

[0216] According to an embodiment, the method may further comprise displaying a representation of the movement of the user's finger with respect to the user-selectable icon based on the detected movement of the user's finger.

[0217] According to an embodiment, a head mounted device (e.g., Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c The electronic device 300 may include: a display (eg, Figure 1 Display module 160, Figure 2 Displays 251 and 252, Figure 3a The display component 340 and Figure 3c display module 321), which is configured to substantially surround the user's eyes when mounted on the user's head; a memory (eg, Figure 1 130 ), which stores a graphic object group, wherein the graphic object group includes a first graphic object corresponding to the background area (eg, Figure 4a and Figure 4b ) and a second graphic object corresponding to an icon representing a specified application (eg, Figure 4a and Figure 4b 413 in the second graphic object); and at least one processor (eg, Figure 1According to an embodiment, at least one processor may be configured to: display a three-dimensional (3D) graphic object generated at least in part based on the graphic object group as a three-dimensional (3D) icon (e.g., a 3D icon) of a designated application in a virtual three-dimensional space via a display. Figure 4a and Figure 4b 410 in the virtual three-dimensional space), wherein the display operation includes displaying a first graphic object and a second graphic object layered with each other so that the 3D icon appears to overlap on at least a portion of the background area, and the 3D graphic object is displayed as a 3D icon; detecting user input of the 3D graphic object; and, in response to the user input, displaying at least a portion of the 3D graphic object while continuously moving so that a distance between at least a portion of the first graphic object and at least a portion of the second graphic object in the virtual three-dimensional space increases or decreases.

[0218] According to an embodiment, at least one processor may be configured to generate a plurality of image elements based on a contour object (e.g., Figure 4a and Figure 4b ), while the outline object, the first graphic object and the second graphic object are in an aligned state, controlling the display to display only a partial area of ​​the graphic object group corresponding to the interior of the specified shape as a 3D graphic object.

[0219] According to an embodiment, the first graphic object may correspond to the first layer.

[0220] According to an embodiment, the second graphic object may correspond to a second layer different from the first layer.

[0221] According to an embodiment, at least one processor may be configured, as part of an operation of displaying at least a portion of a 3D graphical object while continuously moving, to change the depth by moving any one of a first layer corresponding to a first graphical object and a second layer corresponding to a second graphical object in a direction toward a user.

[0222] According to an embodiment, the width of the area corresponding to the inside of the designated shape may be set to be smaller than the width of the third layer corresponding to the outline object.

[0223] According to an embodiment, the memory may be configured to further store the contour object as part of the group of graphical objects.

[0224] According to an embodiment, one or more non-transitory computer-readable storage media storing one or more computer programs including computer-executable instructions that are executed by a wearable electronic device (e.g., Figure 1 electronic device 101, Figure 2 electronic device 200, Figure 3a 、 Figure 3b and Figure 3c One or more processors (eg, Figure 1 The processor 120 of the embodiment of the present invention is configured to cause the wearable electronic device to: display a user-selectable icon for running an application in a 3D virtual space, wherein the user-selectable icon may include a first graphical object representing a virtual window (eg, Figure 4a and Figure 4b ) and a second graphic object representing an application (e.g., Figure 4a and Figure 4b a second graphic object 413 selected through the first graphic object; detecting movement of a user's finger when the user-selectable icon is displayed in the 3D virtual space; and displaying a running screen of the application based on movement of the user's finger in the depth direction of the virtual window of the first graphic object for selecting the second graphic object.

[0225] According to an embodiment, the second graphic object may be displayed as a camera module (eg, Figure 1 Camera module 180, Figure 2 The first cameras 211-1 and 211-2, the third camera 213, Figure 3b The camera modules 313, 314, 315 and 316) face the first graphic object and are at a specified distance from the first graphic object in the depth direction.

[0226] According to an embodiment, the wearable electronic device 101 may include a display module (eg, Figure 1 Display module 160, Figure 2 Displays 251 and 252, Figure 3a Display component 340, Figure 3c display module 321), a camera module (eg, Figure 1 Camera module 180, Figure 2 The first cameras 211-1 and 211-2, the third camera 213, Figure 3b camera modules 313, 314, 315, and 316), a memory storing instructions (e.g., Figure 1 Memory 130) and a processor (e.g., Figure 1 processor 120).

[0227] According to an embodiment, the instructions can be configured to, when executed by at least one processor, enable the wearable electronic device to: control the display module to display multiple graphic objects corresponding to a specified application in a 3D virtual space through the display module, the multiple graphic objects including a first graphic object representing a background on which content provided by the specified application will be displayed and a second graphic object representing the specified application, the first graphic object and the second graphic object being arranged to be a specified distance away from each other in a depth direction in which the camera module faces the first graphic object; run at least one function of the specified application based on at least a part of a first user input for at least one of the first graphic object or the second graphic object; receive a second user input different from the first user input for at least one of the first graphic object or the second graphic object; and apply a graphic effect to the at least one graphic object based on at least a part of the second user input.

[0228] The icon used to run the application (for example, Figure 4a and Figure 4b The icon 410) (which is set as the smallest unit representing an application in the present disclosure) can change shape, size or color by applying a visual effect (for example, a graphic effect) to at least one graphic object among a plurality of graphic objects according to user interaction. Since the electronic device according to the embodiment enhances the system structure of the icon including a plurality of graphic objects, the electronic device can utilize the icon in various devices and apply it to a 3D environment as well as a 2D environment. The electronic device according to the embodiment configures a plurality of graphic objects of the icon in a 3D environment virtual space in a form that is changeable according to the state of the application, thereby visually providing the state change of the application to the user. Various other effects may be provided directly or indirectly in the present disclosure.

[0229] The embodiments disclosed herein are provided for describing and understanding the disclosed technology, but not for limiting the scope of the present disclosure. Therefore, the scope of the present disclosure should be interpreted as including all changes or various embodiments based on the technical spirit of the present disclosure.

[0230] Embodiments of the present disclosure may be based on a metaverse service. Metaverse services may provide content that enhances user immersion based on augmented reality environments, virtual reality environments, mixed environments, and / or extended reality. Metaverse services may be provided by eyeglass-type electronic devices, smart lenses, or smartphones that support augmented reality. Metaverse services may be provided by head-mounted devices (HMDs), video see-through (VST) devices, smartphones that support virtual reality, or smart mirrors. Metaverse services may provide social interaction content, such as avatar-based games, concerts, gatherings, and conferences, or content related to economic activities, such as user creation of content, sales of created content, and shopping. Ownership of user-created content may be verified through blockchain-based NFTs, and / or economic activities may be conducted based on real currency and / or cryptocurrency. Metaverse services may also provide virtual content corresponding to the real world, such as digital twins, mirror worlds, or life logs.

[0231] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to embodiments of the present disclosure, the electronic device is not limited to those described above.

[0232] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but rather include various changes, equivalents, or alternative forms for the corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that nouns in the singular form corresponding to a term may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, each of phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding phrase in the multiple phrases. As used herein, terms such as "first" and "second" or "first" and "second" may be used to simply distinguish a corresponding component from another component and do not limit the components in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “coupled with another element (e.g., a second element)”, “coupled to another element (e.g., a second element)”, “connected with another element (e.g., a second element)”, or “connected to another element (e.g., a second element)”, with or without the terms “operably” or “communicatively” being used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0233] As used in connection with various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions, or the smallest unit or portion of the single integrated component. For example, depending on the embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0234] The various embodiments described herein can be implemented as software (e.g., program 140) comprising one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that is readable by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke and execute at least one of the one or more instructions stored in the storage medium, with or without the use of one or more other components. This enables the machine to operate to perform at least one function in accordance with the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. The term "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

[0235] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., the Play Store). TM ) The computer program product may be published online (e.g., downloaded or uploaded) or distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smartphones). If published online, at least part of the computer program product may be temporarily generated or at least temporarily stored in a machine-readable storage medium (e.g., a memory of a manufacturer's server, an application store's server, or a forwarding server).

[0236] According to various embodiments, each of the aforementioned components (e.g., a module or program) may include a single entity or multiple entities, and some of the multiple entities may be separately provided in different components. According to various embodiments, one or more of the aforementioned components may be omitted, or one or more additional components may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In such a case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding one of the multiple components performed the one or more functions prior to integration. According to various embodiments, the operations performed by a module, program, or another component may be performed sequentially, in parallel, repeatedly, or in a heuristic manner, or one or more of the operations may be performed in a different order or omitted, or one or more additional operations may be added.

Claims

1. A wearable electronic device (101, 200, 300), comprising: Display (160, 251, 252, 340, 321); Memory (130); Cameras (180, 211-1, 211-2, 213, 313, 314, 315, 316); and one or more processors communicatively connected to the display, the memory, and the camera, The memory stores one or more computer programs including computer-executable instructions, which, when executed by the one or more processors, cause the wearable electronic device to: Displaying a user-selectable icon for running an application in a three-dimensional (3D) virtual space, wherein the user-selectable icon includes a first graphical object (415) representing a virtual window and a second graphical object (413) representing the application, and the second graphical object is selectable via the first graphical object, detecting movement of a user's finger while displaying the user-selectable icon in the 3D virtual space, and Based on detecting that the user's finger moves in the depth direction of the virtual window of the first graphic object to select the second graphic object, the execution screen of the application is displayed.

2. The wearable electronic device according to claim 1, wherein: The one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to: The second graphic object is displayed adjacent to the execution screen of the application.

3. The wearable electronic device according to claim 1 or claim 2, wherein: The one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to: Based on the detected movement of the user's finger, a representation of the movement of the user's finger relative to the user-selectable icon is displayed.

4. The wearable electronic device according to any one of claims 1 to 3, wherein: The one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to: When the execution screen of the application is displayed, the virtual window of the first graphic object is not displayed when the second graphic object is displayed.

5. The wearable electronic device according to any one of claims 1 to 4, in, The one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to: changing an arrangement order between the first graphic object and the second graphic object in the depth direction based on receiving a user input regarding the second graphic object when the user-selectable icon is displayed in the 3D virtual space, and The user input is different from the first user input and is at least one of a gesture input or a gaze input.

6. The wearable electronic device according to any one of claims 1 to 5, wherein: The one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to: based on receiving a second user input regarding the first graphical object, changing at least one of a size or a transparency of the first graphical object, and based on receiving the second user input regarding the second graphical object while the user-selectable icon is displayed in the 3D virtual space, changing at least one of a size, a position, a shape, or a color of the second graphical object, and The second user input is different from the first user input and is at least one of a gesture input or a gaze input.

7. The wearable electronic device according to any one of claims 1 to 6, wherein: The one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to: executing at least one function of the application based on receiving a third user input regarding the second graphical object, and The third user input is at least one of a gesture input or a gaze input that is different from the first user input and the second user input.

8. The wearable electronic device according to any one of claims 1 to 7, in, The second graphical object includes an object representing each of a plurality of applications, and The one or more computer programs further include computer-executable instructions, which, when executed by the one or more processors, cause the wearable electronic device to: displaying a running screen for each of the plurality of applications based on receiving a first user input for the second graphic object; independently displaying the object representing each of the plurality of applications based on receiving a fourth user input regarding the second graphical object, and Based on receiving a fifth user input regarding the second graphical object, an object representing each of a plurality of sub-functions of the application is displayed.

9. The wearable electronic device according to any one of claims 1 to 8, wherein: The one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to: Based on receiving the user's gaze at a specified location in the 3D virtual space and the movement of the user's finger with respect to a third graphical object (411) representing a background of the user-selectable icon, the 3D virtual space is selectively switched from one of a first space created using the camera or a second space stored in the wearable electronic device to the other.

10. The wearable electronic device according to any one of claims 1 to 9, wherein: The one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the wearable electronic device to: Based on the second user input, the running screen of the application is moved behind the third graphic object in the depth direction so that the running screen of the application is not visible through the first graphic object; and Based on a designated event, at least a portion of the execution screen is moved along the depth direction to a position in front of the third graphic object.

11. The wearable electronic device according to any one of claims 1 to 10, further comprising: a facial recognition camera disposed on a side of the wearable electronic device facing the first graphic object, The one or more computer programs further include computer-executable instructions, which, when executed by the one or more processors, cause the wearable electronic device to: determining at least one of eye movement or eyelid movement using image information obtained by the facial recognition camera, obtaining gaze information based on at least one of the eye movement or the eyelid movement, and determining the second user input based at least in part on the gaze information, and When the user wears the wearable electronic device, the display emits light to both eyes of the user to display a plurality of graphic objects in the 3D virtual space.

12. An operating method in a wearable electronic device (101, 200, 300), the method comprising: Displaying a user-selectable icon for running an application in a three-dimensional (3D) virtual space, wherein the user-selectable icon includes a first graphical object (415) representing a virtual window and a second graphical object (413) representing the application, and the second graphical object is selectable via the first graphical object; detecting movement of a user's finger while the user-selectable icon is displayed in the 3D virtual space; and Based on detecting that the user's finger moves in the depth direction of the virtual window of the first graphic object to select the second graphic object, the execution screen of the application is displayed.

13. A head-mounted device (101, 200, 300), comprising: a display (160, 251, 252, 340, 321) arranged to substantially surround the user's eyes when mounted on the user's head; a memory (130) storing a graphic object group, wherein the graphic object group includes a first graphic object (411) corresponding to a background area and a second graphic object (413) corresponding to an icon representing a designated application; and At least one processor (120), the at least one processor being functionally connected to the memory, wherein the at least one processor is configured to: displaying, via the display, in a virtual three-dimensional (3D) space, a 3D graphic object generated at least in part based on the graphic object group as a 3D icon of the designated application (410), wherein the display operation includes displaying the first graphic object and the second graphic object layered with each other such that the 3D icon appears to overlap at least a portion of the background area; detecting a user input of the 3D graphic object while the 3D graphic object is displayed as the 3D icon; and In response to the user input, at least a portion of the 3D graphic object is displayed while continuously moving so that a distance between at least a portion of the first graphic object and at least a portion of the second graphic object in the virtual three-dimensional space increases or decreases.

14. The head-mounted device according to claim 13, in, The first graphics object corresponds to the first layer, wherein the second graphic object corresponds to a second layer different from the first layer, and Wherein, the at least one processor is configured to: As part of the operation of displaying the at least a portion of the 3D graphical object while continuously moving, the depth is changed by moving any one of the first layer corresponding to the first graphical object and the second layer corresponding to the second graphical object in a direction toward the user.

15. One or more non-transitory computer-readable storage media storing one or more computer programs comprising computer-executable instructions that, when executed by one or more processors (120) of a wearable electronic device (101, 3200, 300), cause the wearable electronic device to: Displaying a user-selectable icon for running an application in a three-dimensional 3D virtual space, wherein: The user-selectable icon comprises a first graphical object (415) representing a virtual window and a second graphical object (413) representing the application, and the second graphical object is selectable via the first graphical object; detecting movement of a user's finger while displaying the user-selectable icon in the 3D virtual space; as well as Based on detecting that the user's finger moves in the depth direction of the virtual window of the first graphic object to select the second graphic object, the execution screen of the application is displayed.

Images