Wearable electronic device for adjusting magnitude of sound, operation method, and recording medium

Abstract

A method for operating a wearable electronic device comprises the operations of: displaying first content in a first virtual area corresponding to a first direction with respect to the wearable electronic device; displaying second content in a second virtual area corresponding to a second direction with respect to the wearable electronic device; outputting a first sound of the first content at a first magnitude and outputting a second sound of the second content at a second magnitude on the basis of identifying that the line of sight of a user wearing the wearable electronic device is directed in the first direction; and outputting the first sound at a third magnitude different from the first magnitude and outputting the second sound at a fourth magnitude different from the second magnitude on the basis of identifying that the line of sight of the user moves from the first direction to the second direction.

Description

Wearable electronic device for adjusting the size of sound, method of operation and recording medium

[0001] The present disclosure relates to a wearable electronic device for adjusting the size of sound, an operating method, and a recording medium.

[0002] The variety of services and additional features offered through wearable electronic devices, such as augmented reality (AR) glasses, video-see-through (VST) devices, and virtual reality (VR) devices, is steadily increasing. To enhance the utility of these devices and satisfy the needs of diverse users, telecommunications service providers and electronic device manufacturers are developing electronic devices with differentiated and diverse features. Consequently, the various functions offered through wearable electronic devices are also becoming more sophisticated.

[0003] AR glasses, VST devices, and VR devices can provide users with a realistic experience by displaying virtual images while worn on the user's body. AR glasses, VST devices, and VR devices can replace the usability of smartphones in various fields such as gaming entertainment, education, and social networking services (SNS). Through AR glasses, VST devices, and VR devices, users can receive realistic content, and through interaction with realistic content, they can feel as if they are immersed in a virtual world.

[0004] According to one aspect of the present disclosure, a wearable electronic device comprises: a first sensor; a speaker; a display; a memory storing instructions; And a processor operatively connected to the first sensor, the speaker, the display, and the memory, wherein the instructions, when executed by the processor, cause the wearable electronic device to display, through the display, first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual areas, and to display, through the display, second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device among a plurality of virtual areas, and, based on confirming through the first sensor that the gaze of a user wearing the wearable electronic device is directed toward the first direction, output a first sound for the first content at a first size through the speaker, and output a second sound for the second content at a second size, wherein the first size is different from the second size, and based on confirming through the first sensor that the gaze of the user is moved from the first direction to the second direction, output the first sound at a third size different from the first size. and causes the second sound to be outputted at a fourth size different from the second size.

[0005] The instructions, when executed by the processor, may further cause the wearable electronic device to determine the third size and the fourth size based on a number of virtual areas between the virtual first area and the virtual second area, and as the number of virtual areas between the virtual first area and the virtual second area increases, a difference in sound level between the first size and the third size may increase, and a difference in sound level between the second size and the fourth size may increase.

[0006] The instructions, when executed by the processor, may further cause the wearable electronic device to determine the output size of the first sound as a third size that is decreased by a size corresponding to a distance the gaze moves from the first direction to the second direction from the first size, and to determine the output size of the second sound as a fourth size that is increased by a size corresponding to the distance from the second size.

[0007] The instructions, when executed by the processor, may further cause the wearable electronic device to apply a filter effect to the second sound and output a second sound to which the filter effect has been applied based on determining that the user's gaze is directed in the first direction, and to apply the filter effect to the first sound and output the first sound to which the filter effect has been applied based on determining that the user's gaze moves from the first direction to the second direction, and to output a second sound to which the filter effect has not been applied.

[0008] The above filter effect may include a dim effect.

[0009] The above instructions, when executed by the processor, may further cause the wearable electronic device to output a designated sound associated with at least one object included in the first content.

[0010] The above instructions, when executed by the processor, may further cause the wearable electronic device to cause the location of the sound image of the designated sound to correspond to the location of the sound image of the second sound.

[0011] The above instructions, when executed by the processor, may further cause the wearable electronic device to output the specified sound at a specified volume regardless of the direction of movement of the user's gaze.

[0012] The instructions, when executed by the processor, may further cause the wearable electronic device to identify a user's gesture corresponding to a designated gesture for adjusting a position of the virtual first area while the user's gaze is directed in the first direction, adjust the position of the virtual first area, and adjust the output size of the first sound based on the adjusted position of the virtual first area.

[0013] The instructions, when executed by the processor, may further cause the wearable electronic device to determine that the user's gaze is directed in the first direction while the wearable electronic device is worn on the user's head and the first wearable electronic device is worn on the user's right wrist, wherein the second direction corresponds to a right direction based on the direction of the user's gaze, obtain notification information related to the second content, and transmit the notification information to the first wearable electronic device.

[0014] The position of the sound image of the first sound may correspond to the first direction, and the position of the sound image of the second sound may correspond to the second direction.

[0015] The wearable electronic device may further include a second sensor, and the instructions, when executed by the processor, may cause the wearable electronic device to output a first sound for the first content at a first volume through the speaker based on determining through the first sensor that a gaze of a user wearing the wearable electronic device is directed in the first direction and through the second sensor that the wearable electronic device is directed in the first direction, and to output the first sound at the third volume and to output the second sound at the fourth volume based on determining through the first sensor that the gaze of the user moves from the first direction to the second direction and through the second sensor that the wearable electronic device moves from the first direction to the second direction.

[0016] According to one aspect of the present disclosure, a method for operating a wearable electronic device includes: displaying first content in a virtual first region corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual regions through a display of the wearable electronic device; displaying second content in a virtual second region corresponding to a second direction with respect to the wearable electronic device among a plurality of virtual regions through the display of the wearable electronic device; and outputting a first sound for the first content at a first size and a second sound for the second content at a second size through a speaker of the wearable electronic device based on confirming that a gaze of a user wearing the wearable electronic device is directed in the first direction through a first sensor of the wearable electronic device, wherein the first size is different from the second size; And based on confirming that the user's gaze moves from the first direction to the second direction through the first sensor, an operation of outputting the first sound in a third size different from the first size and outputting the second sound in a fourth size different from the second size is included.

[0017] The method may further include an operation of determining the third size and the fourth size based on the number of virtual areas between the virtual first area and the virtual second area among the plurality of virtual areas, and as the number of virtual areas between the virtual first area and the virtual second area increases, the difference in sound level between the first size and the third size and the difference in sound level between the second size and the fourth size increase.

[0018] The method may further include an operation of determining the output size of the first sound as the third size, which is reduced by a size corresponding to the distance the gaze moves from the first direction to the second direction from the first size; and an operation of determining the output size of the second sound as the fourth size, which is increased by a size corresponding to the distance from the second size.

[0019] The method may further include an operation of applying a filter effect to the second sound and outputting the second sound to which the filter effect has been applied, based on confirming that the user's gaze is directed toward the first direction; and an operation of applying the filter effect to the first sound and outputting the first sound to which the filter effect has been applied, based on confirming that the user's gaze moves from the first direction to the second direction, and outputting the second sound to which the filter effect has not been applied.

[0020] The above filter effect may include a dim effect.

[0021] The method may further include an action of outputting a designated sound associated with at least one object included in the first content.

[0022] According to one aspect of the present disclosure, a storage medium stores computer-readable instructions, which, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, the at least one operation comprising: displaying, through a display of the wearable electronic device, first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual areas; displaying, through the display of the wearable electronic device, second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device among the plurality of virtual areas; The method includes: an operation of outputting a first sound for the first content at a first size through a speaker of the wearable electronic device based on confirming that the gaze of a user wearing the wearable electronic device is directed in the first direction through a first sensor of the wearable electronic device, and an operation of outputting a second sound for the second content at a second size, wherein the first size is different from the second size; and an operation of outputting the first sound at a third size different from the first size, and outputting the second sound at a fourth size different from the second size, based on confirming that the gaze of the user is moving from the first direction to the second direction through the first sensor.

[0023] According to one aspect of the present disclosure, a wearable electronic device comprises: a sensor; a speaker; a display; a memory storing instructions; And a processor operatively connected to the sensor, the speaker, the display, and the memory, wherein the instructions, when executed by the processor, cause the wearable electronic device to display, through the display, first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual areas, and to display, through the display, second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device among a plurality of virtual areas, and based on confirming through the sensor that the wearable electronic device is facing the first direction, output a first sound for the first content at a first size through the speaker, and output a second sound for the second content at a second size, wherein the first size is different from the second size, and a position of a sound image of the first sound corresponds to the first direction, and a position of a sound image of the second sound corresponds to the second direction, and wherein the wearable electronic device, through the sensor, causes the wearable electronic device to move in the first direction. Based on confirmation of movement in the second direction, the first sound having a third size different from the first size is output, and the second sound having a fourth size different from the second size is output.

[0024] The above and other aspects, features, and advantages of specific embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0025] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0026] FIG. 2 is a perspective view illustrating a configuration of a wearable electronic device according to an embodiment of the present disclosure.

[0027] FIGS. 3A and 3B are drawings showing the front and back of a wearable electronic device according to one embodiment.

[0028] FIG. 4 is a schematic block diagram of a wearable electronic device according to one embodiment.

[0029] FIG. 5 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to output sound for content displayed in a virtual area.

[0030] FIG. 6 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of sound for content displayed in a virtual area.

[0031] FIG. 7 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of sound for content displayed in a virtual area.

[0032] FIG. 8 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of sound for content displayed in a virtual area.

[0033] FIG. 9 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to apply a filter effect to a sound for content and output a sound with the filter effect applied.

[0034] FIG. 10 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to output a specified sound related to an object included in content.

[0035] FIG. 11 is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of sound for content displayed in a virtual area based on a movement direction of a user's gaze and / or a movement direction of the wearable electronic device.

[0036] FIG. 12 is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to display a virtual object for adjusting the size of sound for content displayed in a virtual area.

[0037] FIG. 13A is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to apply a filter effect to a sound for content and output a sound with the filter effect applied.

[0038] FIG. 13b is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to output a specified sound related to an object included in specified content.

[0039] FIG. 14 is a diagram for explaining an operation of a wearable electronic device according to one embodiment transmitting notification information to a first wearable electronic device connected to the device.

[0040] FIG. 15A and FIG. 15B are diagrams for explaining an operation of a wearable electronic device according to one embodiment of the present invention to adjust the output size of a sound by adjusting the position of a virtual area.

[0041] FIG. 16 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to output sound for content displayed in a virtual area.

[0042] FIG. 17 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to output sound for content displayed in a virtual area.

[0043] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0044] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0045] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0046] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0047] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0048] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0049] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0050] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0051] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0052] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0053] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0054] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0055] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0056] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0057] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0058] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0059] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0060] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0061] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0062] In one embodiment, the antenna module (197) may generate a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0063] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0064] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0065] FIG. 2 is a perspective view illustrating a configuration of a wearable electronic device according to an embodiment of the present disclosure.

[0066] Referring to FIG. 2, a wearable electronic device (200) according to one embodiment of the present disclosure may include at least one of a light output module (211), a display member (201), and a camera module (250).

[0067] According to one embodiment of the present disclosure, the light output module (211) may include a light source capable of outputting an image, and a lens for guiding the image to the display member (201). According to one embodiment of the present disclosure, the light output module (211) may include at least one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED).

[0068] According to one embodiment of the present disclosure, the display member (201) may include an optical waveguide (e.g., a waveguide). According to one embodiment of the present disclosure, an output image of an optical output module (211) incident on one end of the optical waveguide may be propagated inside the optical waveguide and provided to a user. According to one embodiment of the present disclosure, the optical waveguide may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or at least one reflective element (e.g., a reflective mirror). For example, the optical waveguide may guide an output image of the optical output module (211) to a user's eye by using at least one diffractive element or reflective element.

[0069] According to one embodiment of the present disclosure, the camera module (250) can capture still images and / or moving images. According to one embodiment, the camera module (250) is disposed within a lens frame and can be disposed around the display member (201).

[0070] According to one embodiment of the present disclosure, the first camera module (251) can capture and / or recognize the trajectory of the user's eye (e.g., pupil, iris) or gaze. According to one embodiment of the present disclosure, the first camera module (251) can periodically or aperiodically transmit information related to the trajectory of the user's eye or gaze (e.g., trajectory information) to a processor (e.g., processor (120) of FIG. 1).

[0071] According to one embodiment of the present disclosure, the second camera module (253) can capture an external image.

[0072] According to one embodiment of the present disclosure, the third camera module (255) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. According to one embodiment of the present disclosure, the third camera module (255) can be used for 3 degrees of freedom (3DoF), 6DoF head tracking, position (space, environment) recognition, and / or movement recognition. According to one embodiment of the present disclosure, the second camera module (253) can also be used for hand detection and tracking, and user gesture recognition. According to one embodiment of the present disclosure, at least one of the first camera module (251) to the third camera module (255) can be replaced with a sensor module (e.g., a LiDAR sensor). For example, the sensor module can include at least one of a vertical cavity surface emitting laser (VCSEL), an infrared sensor, and / or a photodiode.

[0073] FIGS. 3A and 3B illustrate the front and back of a wearable electronic device according to one embodiment.

[0074] Referring to FIGS. 3A and 3B, in one embodiment, camera modules (311, 312, 313, 314, 315, 316) and / or depth sensors (317) for obtaining information related to the surrounding environment of the wearable electronic device (300) may be arranged on the first surface (310) of the housing.

[0075] In one embodiment, the camera modules (311, 312) can acquire images related to the environment surrounding the wearable electronic device.

[0076] In one embodiment, the camera modules (313, 314, 315, 316) can acquire images while the wearable electronic device is worn by a user. The camera modules (313, 314, 315, 316) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. The camera modules (313, 314, 315, 316) can be used for 3DoF, 6DoF head tracking, position (spatial, environmental) recognition, and / or movement recognition. In one embodiment, the camera modules (311, 312) can also be used for hand detection and tracking, and user gesture.

[0077] In one embodiment, a depth sensor (317) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for purposes such as time of flight (TOF) to determine the distance to an object. Instead of or in addition to the depth sensor (317), camera modules (313, 314, 315, 316) may determine the distance to an object.

[0078] According to one embodiment, a camera module (325, 326) for facial recognition and / or a display (321) (and / or a lens) may be disposed on the second side (320) of the housing.

[0079] In one embodiment, a face recognition camera module (325, 326) adjacent to the display may be used to recognize a user's face, or may recognize and / or track both eyes of the user.

[0080] In one embodiment, the display (321) (and / or lens) may be disposed on the second side (320) of the wearable electronic device (300). In one embodiment, the wearable electronic device (300) may not include camera modules (315, 316) among the plurality of camera modules (313, 314, 315, 316). In one embodiment, the wearable electronic device (300) may further include at least one of the configurations illustrated in FIG. 2.

[0081] As described above, according to one embodiment, the wearable electronic device (300) may have a form factor for being worn on a user's head. The wearable electronic device (300) may further include a strap and / or a wearing member for being secured to a body part of the user. The wearable electronic device (300) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.

[0082] FIG. 4 is a schematic block diagram of a wearable electronic device according to one embodiment.

[0083] Referring to FIG. 4, according to one embodiment, a wearable electronic device (401) may include a first sensor (411) (e.g., sensor module (176) of FIG. 1), a second sensor (412) (e.g., sensor module (176) of FIG. 1), a processor (420) (e.g., processor (120) of FIG. 1), a memory (430) (e.g., memory (130) of FIG. 1), a speaker (450) (e.g., audio output module (155) of FIG. 1), and a display (460) (e.g., display (160) of FIG. 1).

[0084] According to one embodiment, the wearable electronic device (401) may be implemented in a manner identical to or similar to the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2, and the wearable electronic device (300) of FIGS. 3A and 3B. According to one embodiment, the wearable electronic device (401) may be implemented as an augmented reality (AR) glass, an extended reality (XR) device, a mixed reality (MR) device, a virtual reality (VR) device, or a video see-through (VST) device. However, these are examples, and embodiments of the present invention may be implemented as various devices.

[0085] According to one embodiment, the memory (410) can store at least one instruction that causes the wearable electronic device (401) to perform at least one operation.

[0086] According to one embodiment, the wearable electronic device (401) can display content in a plurality of virtual areas through the display (460). For example, the plurality of virtual areas may represent areas (e.g., virtual windows) capable of displaying content. For example, the content may include various contents stored in the wearable electronic device (401) or acquired from an external electronic device. For example, the content may include an execution screen of an application stored in the wearable electronic device (401). For example, the content may include a video or image stored in the memory (430).

[0087] Conventional wearable electronic devices could output sound of content based on preset volume or sound quality without considering the user's movements (e.g., the user's gaze or the direction the user is facing (e.g., the direction of movement of the wearable electronic device)). In other words, conventional wearable electronic devices were unable to perform functions that actively respond to the user's movements (e.g., the user's gaze or the direction the user is facing) or the user's intention (e.g., the function of controlling sound).

[0088] According to one embodiment, a wearable electronic device (401) can change the sound output size (or sound output volume) of content displayed in a virtual area corresponding to the direction in which the user's gaze is directed, based on the direction in which the wearable electronic device (401) is facing. Hereinafter, the sound volume may also be referred to as the sound level or level of the sound. According to one embodiment, a wearable electronic device (401) can greatly adjust the sound output size for content displayed in a virtual area corresponding to the direction in which the user's gaze is directed. Through this, the wearable electronic device (401) according to one embodiment can effectively provide an environment in which the user can focus on the content displayed in the virtual area corresponding to the direction in which the user's gaze is directed.

[0089] Alternatively or additionally, the wearable electronic device (401) according to one embodiment can change the sound output size (or sound output volume) of content displayed in a virtual area corresponding to the direction in which the wearable electronic device (401) is facing, based on the direction in which the wearable electronic device (401) is facing, regardless of the direction in which the user's gaze is directed. The wearable electronic device (401) according to one embodiment can greatly adjust the sound output size for content displayed in a virtual area corresponding to the direction in which the wearable electronic device (401) is facing. Through this, the wearable electronic device (401) according to one embodiment can effectively provide an environment in which the user can focus on content displayed in a virtual area corresponding to the direction in which the wearable electronic device (401) is facing.

[0090] Alternatively or additionally, the wearable electronic device (401) according to one embodiment may change the sound output size (or sound output volume) of content displayed in a virtual area corresponding to the direction in which the user's gaze is directed when it is confirmed that the direction in which the user's gaze is directed and the direction in which the wearable electronic device (401) is directed are the same. At this time, the wearable electronic device (401) according to one embodiment may significantly adjust the sound output size for content displayed in a virtual area corresponding to the direction in which the user's gaze is directed and the direction in which the wearable electronic device (401) is directed. Through this, the wearable electronic device (401) according to one embodiment may effectively provide an environment in which the user can focus on content displayed in a virtual area corresponding to the direction in which the user's gaze and the wearable electronic device (401) are directed. That is, the wearable electronic device (401) according to one embodiment may adjust the sound of content displayed in a virtual area in response to a movement according to the user's intention. Through this, the wearable electronic device (401) can perform a function that actively responds to the user's movements and effectively provide an environment in which the user can focus on the content.

[0091] According to one embodiment, the speaker (450) may output a sound related to the content. For example, the speaker (450) may output a spatialized sound related to the content. For example, the spatialized sound may represent a sound based on head tracking technology so that a user wearing the wearable electronic device (401) may feel that the sound is output from a specific direction. For example, the processor (420) may output a first sound through the speaker (450) in a first direction (e.g., a frontal direction with respect to the wearable electronic device (401)) that represents the direction of the user's gaze and the direction in which the wearable electronic device (401) is facing. The processor (420) may adjust (e.g., fix) the sound image position of the first sound for the first content corresponding to the first direction to the position corresponding to the first direction, even when the wearable electronic device (401) and / or the user's gaze moves from the first direction to the second direction. Hereinafter, the position of the sound image may also be referred to as the position of the virtual sound source. That is, if the direction of the user's gaze and / or the direction in which the wearable electronic device (401) is facing moves to the right with respect to the wearable electronic device (401) in the first direction, the user may feel that the first sound is output from the left direction.

[0092] According to one embodiment, the processor (420) may display first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device (401) among a plurality of virtual areas through the display (460).

[0093] According to one embodiment, the processor (420) may display second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device (401) among a plurality of virtual areas through the display (460).

[0094] According to one embodiment, the processor (420) can identify the gaze of a user wearing the wearable electronic device (401) through the first sensor (411). For example, the first sensor (411) can be implemented as a sensor that can identify the gaze by identifying the eyes (e.g., pupil, iris) of the user wearing the wearable electronic device (401). Alternatively or additionally, according to one embodiment, the processor (420) can identify the gaze of a user wearing the wearable electronic device (401) by using a gaze tracking camera (e.g., the first camera module (251) of FIG. 2, the face recognition camera modules (325, 326) of FIG. 3).

[0095] According to one embodiment, the processor (420) can determine the direction in which the wearable electronic device (401) moves through the second sensor (412). For example, the second sensor can be implemented as an acceleration sensor, a gyro sensor, or a gravity sensor (or a geomagnetic sensor).

[0096] According to one embodiment, the processor (420) can confirm that the user's gaze is directed in a first direction through the first sensor (411), and can confirm that the wearable electronic device (401) is directed in the first direction through the second sensor (412). For example, the processor (420) can confirm that the user's gaze is directed in the first direction when the user's gaze is located within a specified distance from the center position of the virtual first area. For example, the specified distance may represent a distance at which the user's gaze is determined not to have left the virtual first area. For example, the specified distance may be automatically specified by the processor (420) or may be specified by the user.

[0097] According to one embodiment, the processor (420) may output a first sound for the first content at a first volume and output a second sound for the second content at a second volume through the speaker (450) based on determining that the user's gaze is directed in a first direction. In one embodiment, the first volume may be greater than the second volume (i.e., louder or higher). For example, the first volume and the second volume may be determined within a volume range supported by the wearable electronic device (401). Alternatively or additionally, according to one embodiment, the processor (420) may output the first sound for the first content at a first volume and output the second sound for the second content at a second volume through the speaker (450) based on determining that the wearable electronic device (401) is directed in the first direction. Alternatively or additionally, according to one embodiment, the processor (420) may output a first sound for the first content at a first volume and output a second sound for the second content at a second volume through the speaker (450) based on the wearable electronic device (401) and the user's gaze being directed in the first direction.

[0098] In one embodiment, the first size and the second size may include sizes specified by the user or the processor (420). In one embodiment, if either the first size or the second size is specified, the size of the other may be determined based on the distance between the virtual first area and the virtual second area.

[0099] In one embodiment, the first size may include a size specified by the user or the processor (420). In one embodiment, the second size may be a size determined based on a distance between the virtual first area and the virtual second area. For example, the processor (420) may determine the output size of the second sound to be a second size that is reduced by a size corresponding to the distance between the center position of the virtual first area and the center position of the virtual second area from the first size.

[0100] According to one embodiment, the second size may be a size determined based on the number of virtual areas between the first virtual area and the second virtual area. For example, the horizontal lengths of each of the plurality of virtual areas may be the same. According to one embodiment, the processor (420) may use a camera to check the number of virtual areas between the first virtual area and the second virtual area. For example, the processor (420) may determine the output size of the second sound as a second size that is reduced from the first size by a size corresponding to the number of virtual areas between the first virtual area and the second virtual area. However, this is an example, and even when the horizontal lengths of each of the plurality of virtual areas are different from each other, the second size may be determined based on the number of virtual areas between the first virtual area and the second virtual area.

[0101] According to one embodiment, the processor (420) can determine, through the first sensor (411), that the user's gaze moves from the first direction to the second direction. Alternatively or additionally, according to one embodiment, the processor (420) can determine, through the second sensor (412), that the wearable electronic device (401) moves from the first direction to the second direction. Alternatively or additionally, according to one embodiment, the processor (420) can determine, through the first sensor (411), that the user's gaze moves from the first direction to the second direction, and through the second sensor (412), that the wearable electronic device (401) moves from the first direction to the second direction.

[0102] According to one embodiment, when it is determined that the user's gaze has moved from the first direction to the second direction, the processor (420) may determine the distance that the user's gaze (e.g., pupil, iris) has moved from the first direction to the second direction. Alternatively or additionally, according to one embodiment, when it is determined that the wearable electronic device (401) has moved from the first direction to the second direction, the processor (420) may determine the distance that the wearable electronic device (401) has moved from the first direction to the second direction. Alternatively or additionally, according to one embodiment, when it is determined that the user's gaze and the wearable electronic device (401) have moved from the first direction to the second direction, the processor (420) may determine the distance that the wearable electronic device (401) has moved from the first direction to the second direction and / or the distance that the user's gaze (e.g., pupil, iris) has moved from the first direction to the second direction.

[0103] According to one embodiment, when it is determined that the user's gaze has moved from the first direction to the second direction, the processor (420) may adjust the first size of the first sound and adjust the second size of the second sound based on the distance that the user's gaze (e.g., pupil, iris) has moved from the first direction to the second direction. Alternatively or additionally, according to one embodiment, when it is determined that the wearable electronic device (401) has moved from the first direction to the second direction, the processor (420) may adjust the first size of the first sound and adjust the second size of the second sound based on the distance that the wearable electronic device (401) has moved from the first direction to the second direction.

[0104] Alternatively or additionally, according to one embodiment, when the processor (420) determines that the wearable electronic device (401) and the user's gaze have moved from the first direction to the second direction, the processor (420) may adjust the first size of the first sound and adjust the second size of the second sound based on a distance that the user's gaze (e.g., pupil, iris) has moved from the first direction to the second direction and / or a distance that the wearable electronic device (401) has moved. For example, the processor (420) may adjust the first size of the first sound and adjust the second size of the second sound based on an average value of a distance that the user's gaze (e.g., pupil, iris) has moved from the first direction to the second direction and a distance that the wearable electronic device (401) has moved. For example, the processor (420) may adjust the first size of the first sound and adjust the second size of the second sound based on a larger or smaller value among the distances that the user's gaze (e.g., pupil, iris) moves from the first direction to the second direction and the distances that the wearable electronic device (401) moves.

[0105] According to one embodiment, a lookup table indicating a relationship between a distance that the wearable electronic device (401) or the user's gaze moves from a first direction to a second direction and a sound volume may be stored in the memory (430). According to one embodiment, the processor (420) may use the lookup table to determine the output volume of the first sound as a third size that is decreased by a size corresponding to the distance that the wearable electronic device (401) or the user's gaze moves from the first direction to the second direction. According to one embodiment, the processor (420) may use the lookup table to determine the output volume of the second sound as a fourth size that is increased by a size corresponding to the distance that the wearable electronic device (401) or the user's gaze moves from the first direction to the second direction.

[0106] According to one embodiment, the horizontal and vertical lengths of each of the plurality of virtual areas may be equal to each other. According to one embodiment, the processor (420) may determine the output size of the first sound and the size of the second sound based on the number of virtual areas between the first virtual area and the second virtual area among the plurality of virtual areas. According to one embodiment, a lookup table indicating the relationship between the number of virtual areas and the size of the sound may be stored in the memory (430). According to one embodiment, the processor (420) may use the lookup table to determine the output size of the first sound as a third size that is reduced by a size corresponding to the number of virtual areas between the first virtual area and the second virtual area from the first size. According to one embodiment, the processor (420) may use the lookup table to determine the output size of the second sound as a fourth size that is increased by a size corresponding to the number of virtual areas between the first virtual area and the second virtual area from the second size. For example, the greater the number of virtual regions between the first virtual region and the second virtual region, the greater the difference between the first size and the third size, and the greater the difference between the second size and the fourth size. Accordingly, the wearable electronic device (401) according to one embodiment can determine the output size of the sound based on the number of virtual regions between the first virtual region and the second virtual region corresponding to the first direction when the horizontal lengths of each of the plurality of virtual regions are the same, thereby reducing the time and resources required to calculate the output size of the sound. However, this is an example, and even when the horizontal lengths and vertical lengths of each of the plurality of virtual regions are different from each other, the second size may be determined based on the number of virtual regions between the first virtual region and the second virtual region.

[0107] According to one embodiment, the processor (420) may output a first sound reduced from a first size to a third size and output a second sound increased from a second size to a fourth size through the speaker (450) based on determining that the user's gaze moves from a first direction to a second direction. Alternatively or additionally, according to one embodiment, the processor (420) may output a first sound reduced from a first size to a third size and output a second sound increased from a second size to a fourth size through the speaker (450) based on determining that the wearable electronic device (401) moves from a first direction to a second direction. Alternatively or additionally, according to one embodiment, the processor (420) may output a first sound reduced from a first size to a third size and output a second sound increased from a second size to a fourth size through the speaker (450) based on determining that the wearable electronic device (401) and the user's gaze move from a first direction to a second direction.

[0108] According to an implementation, according to one embodiment, the processor (420) can maintain the output size of the first sound at the first size and maintain the output size of the second sound at the second size based on determining that the movement direction of the user's gaze and the movement direction of the wearable electronic device (401) do not correspond to each other.

[0109] Alternatively or additionally, depending on the implementation, the processor (420) may determine the output size of the first sound and the output size of the second sound based on the moving direction of the wearable electronic device (401) when the movement direction of the user's gaze and the movement direction of the wearable electronic device (401) do not correspond to each other. For example, when the processor (420) determines that the wearable electronic device (401) moves from the first direction to the second direction and the user's gaze does not move from the first direction to the second direction, the processor (420) may adjust the first size of the first sound and adjust the second size of the second sound based on the distance that the wearable electronic device (401) moves from the first direction to the second direction.

[0110] According to one embodiment, when the processor (420) detects that the user's gaze moves from the first direction to the second direction, a virtual object may be displayed that adjusts the output volume of the first sound and the output volume of the second sound after a specified period of time (e.g., 2 seconds) has elapsed from the time the user's gaze movement is detected. For example, since the user may move their gaze unintentionally, a specified period of time may be set so that it can be identified that the movement is intentional.

[0111] Alternatively or additionally, according to one embodiment, when the processor (420) determines that the wearable electronic device (401) is moving from the first direction to the second direction, a virtual object may be displayed that adjusts the output size of the first sound and the output size of the second sound after a specified time (e.g., 2 seconds) has elapsed from the time of determining the movement of the wearable electronic device (401). For example, since the user may move the wearable electronic device (401) unintentionally, a specified time may be set so that it can be identified that the movement is according to the user's intention.

[0112] Alternatively or additionally, according to one embodiment, when it is confirmed that the user's gaze moves from the first direction to the second direction and the wearable electronic device (401) moves from the first direction to the second direction, the processor (420) may display a virtual object that adjusts the output size of the first sound and the output size of the second sound after a specified time (e.g., 2 seconds) has passed from the time of confirming the movement. For example, the specified time may represent a time for determining whether the directions in which the user's gaze and the wearable electronic device (401) are facing are identical (e.g., determining that they are facing the same direction (e.g., the second direction)). For example, since the user may move the gaze and the wearable electronic device (401) unintentionally, the specified time may be set so that it can be identified that the movement is according to the user's intention.

[0113] According to one embodiment, when the processor (420) confirms a user input (or user gesture) for selecting a virtual object, the processor (420) may output a first sound reduced from a first size to a third size and output a second sound increased from a second size to a fourth size through the speaker (450). For example, the user input (or user gesture) may include at least one of a touch input (or gesture), a drag input (or gesture), or a pinch input (or gesture). However, this is an example, and embodiments of the present invention may include various user inputs (or user gestures).

[0114] According to one embodiment, the processor (420) may apply a filter effect to the second sound based on determining that the user's gaze is directed in the first direction, regardless of the direction of the wearable electronic device (401). For example, the filter effect may include a dim effect. For example, the filter effect may include an effect that outputs or blocks a sound of a specific frequency band by using at least one of a low pass filter (LPF), a high pass filter (HPF), a band pass filter (BPF), or a band reject filter (BRF). According to one embodiment, the processor (420) may output the first sound to which the filter effect is not applied, and output the second sound to which the filter effect is applied.

[0115] Alternatively or additionally, according to one embodiment, the processor (420) may apply a filter effect to the second sound based on determining that the wearable electronic device (401) is facing the first direction, regardless of the direction of the user's gaze.

[0116] Alternatively or additionally, according to one embodiment, the processor (420) may apply a filter effect to the second sound based on determining that the wearable electronic device (401) and the user's gaze are directed in the first direction.

[0117] According to one embodiment, the processor (420) may apply a filter effect to the first sound based on determining that the user's gaze moves from a first direction to a second direction. According to one embodiment, the processor (420) may output the first sound with the filter effect applied and output the second sound without the filter effect applied.

[0118] Alternatively or additionally, according to one embodiment, the processor (420) may apply a filter effect to the first sound based on determining that the wearable electronic device (401) is moving from the first direction to the second direction, regardless of the direction of movement of the user's gaze.

[0119] Alternatively or additionally, according to one embodiment, the processor (420) may apply a filter effect to the first sound based on determining that the user's gaze and the wearable electronic device (401) are moving from a first direction to a second direction.

[0120] According to one embodiment, the processor (420) may confirm a user input for designating (or selecting) first content displayed in a virtual first area among a plurality of virtual areas. According to one embodiment, the processor (420) may analyze the first content designated by the user (e.g., analyze the content or scene of the first content). According to one embodiment, the processor (420) may confirm at least one object included in the first content. The processor (420) may analyze the first content (e.g., analyze the content or scene of the first content) based on the confirmed at least one object. For example, if the first content includes trees, birds, and streams, the processor (420) may determine that the content represents a forest. Alternatively or additionally, if the first content includes planets or outer space, the processor (420) may determine that the content represents outer space. For example, the processor (420) may identify at least one object using an artificial intelligence model stored in the memory (430), or may identify at least one object by an external electronic device or server.

[0121] According to one embodiment, the processor (420) may output a designated sound related to the first content. For example, the processor (420) may output a designated sound related to at least one object included in the first content. For example, if the first content is determined to be content representing a forest, the processor (420) may output a designated sound related to the forest (e.g., birdsong and / or the sound of a stream). For example, the designated sound may include a sound stored in the memory (430) or acquired from an external electronic device. According to one embodiment, the processor (420) may determine the sound location of the designated sound to correspond to the sound location of the second sound. At this time, the processor (420) may output the designated sound related to at least one object included in the first content at a designated size based on the sound location of the second sound while outputting the first sound and the second sound. For example, if the first content is an image containing a bird, the processor (420) may determine the designated sound as a bird sound. For example, if the first content is an image containing an ocean, the processor (420) may determine the designated sound as the sound of waves. For example, if the first content is an image containing a forest, the processor (420) may determine the designated sound as the sound of wind.

[0122] According to one embodiment, the processor (420) may convert the first sound of the first content into text and store it in the memory (430). For example, the text may include lyrics of the first sound and / or onomatopoeia related to the first sound. According to one embodiment, the processor (420) may convert the second sound of the second content into text and store it. For example, the processor (420) may convert the sound into text using an artificial intelligence model stored in the memory (430), or may convert the sound into text using an external electronic device or server. For example, the processor (420) may convert the first sound of the first content into text and convert the second sound of the second content into text using a speech recognition model stored in the memory (430).

[0123] According to one embodiment, the processor (420) may determine a user input or user gesture for adjusting the position of a virtual first region when the user's gaze is directed toward a first direction and / or the wearable electronic device (401) is directed toward the first direction. According to one embodiment, the processor (420) may determine that the user input corresponds to a specified input or that the user gesture corresponds to a specified gesture. According to one embodiment, the processor (420) may adjust the position of the virtual first region. According to one embodiment, the processor (420) may adjust the first size of the first sound to a size corresponding to the adjusted position based on the adjusted position of the virtual first region. According to one embodiment, the processor (420) may determine that the wearable electronic device (401) and the first wearable electronic device are worn on the user's body. According to one embodiment, the first wearable electronic device may include a wearable electronic device that can be worn on a wrist. In one embodiment, the processor (420) can confirm that the first wearable electronic device is worn on the user's right wrist. For example, the processor (420) can display a user interface through the display (460) that allows the user to select a body part on which the first wearable electronic device is worn. The processor (420) can confirm a user input indicating that the first wearable electronic device is worn on the right wrist through the user interface. Based on the user input, the processor (420) can confirm that the first wearable electronic device is worn on the user's right wrist. However, this is merely an example, and the wearable electronic device (401) can confirm the body part of the user on which the first wearable electronic device is worn through various methods.According to one embodiment, the processor (420) may check notification information for second content displayed in a virtual second area corresponding to a second direction when the user's gaze is directed toward a first direction and / or the wearable electronic device (401) is directed toward the first direction. In this case, the second direction may indicate a right direction with respect to the wearable electronic device (401). According to one embodiment, the processor (420) may transmit notification information for the second content to the first wearable electronic device. According to one embodiment, the first wearable electronic device may output the notification information for the second content in the form of vibration or voice. For example, the second content may include an execution screen of a music application of the wearable electronic device (401). The notification information may include information indicating that the currently playing music has ended or information indicating that new music is being played. For example, the second content may further include an execution screen of a text application of the wearable electronic device (401). The notification information may include information indicating that a message has been acquired from an external electronic device. However, this is merely an example, and the notification information and the second content may not be limited to the above example.

[0124] According to one embodiment, when the processor (420) determines that the notification information for the second content is displayed in a virtual second area corresponding to the second direction while the user's gaze is directed in the first direction and / or the wearable electronic device (401) is directed in the first direction, the processor (420) may output the notification information for the second content by vibration.

[0125] In some embodiments, the operations of the wearable electronic device (401) described below may be performed by the processor (420). In some embodiments, the operations performed by the processor (420) will be described as being performed by the wearable electronic device (401).

[0126] FIG. 5 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to output sound for content displayed in a virtual area.

[0127] Referring to FIG. 5, according to one embodiment, in operation 510, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may display first content in a first virtual area corresponding to a first direction with respect to the wearable electronic device (401) among a plurality of virtual areas. For example, the plurality of virtual areas may represent areas capable of displaying content. For example, the content may include various contents stored in the wearable electronic device (401) or acquired from an external electronic device. For example, the content may include an execution screen of an application stored in the wearable electronic device (401). For example, the content may include a video or image stored in the memory (430) (e.g., the memory (430) of FIG. 4).

[0128] According to one embodiment, in operation 513, the wearable electronic device (401) may display second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device (401) among a plurality of virtual areas.

[0129] According to one embodiment, in operation 515, the wearable electronic device (401) can determine that the user's gaze is directed in a first direction through the first sensor (411) (e.g., the first sensor (411) of FIG. 4).

[0130] According to one embodiment, in operation 517, the wearable electronic device (401) may output a first sound for the first content at a first volume and output a second sound for the second content at a second volume through the speaker (450) (e.g., the speaker (450) of FIG. 4) based on determining that the user's gaze is directed in a first direction. According to one embodiment, the first volume may be larger (higher) than the second volume. According to one embodiment, the sound image of the first sound may correspond to the first direction, and the sound image of the second sound may correspond to the second direction.

[0131] According to one embodiment, in operation 519, the wearable electronic device (401) can detect, through the first sensor (411), that the user's gaze moves from a first direction to a second direction.

[0132] According to one embodiment, in operation 521, the wearable electronic device (401) may output a first sound reduced from a first size to a third size and output a second sound increased from a second size to a fourth size through the speaker (450) based on a distance moved from a first direction to a second direction. According to one embodiment, the wearable electronic device (401) may use the first sensor (411) to determine a distance by which the user's gaze (e.g., pupil, iris) has moved from the first direction to the second direction.

[0133] In one embodiment, the greater the distance traveled from the first direction to the second direction, the greater the difference between the first size and the third size. In one embodiment, the greater the distance traveled from the first direction to the second direction, the greater the difference between the second size and the fourth size.

[0134] Through this, the wearable electronic device (401) according to one embodiment adjusts the sound output size of the content displayed (in the virtual area corresponding to the direction in which the user's gaze is directed) to be larger (higher) than the sound output size of the content displayed in the remaining virtual areas, thereby effectively providing an environment in which the user can focus on the content displayed in the virtual area corresponding to the direction in which the user's gaze is directed.

[0135] FIG. 6 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of sound for content displayed in a virtual area.

[0136] Referring to FIG. 6, according to one embodiment, in operation 611, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can detect, through a first sensor (411) (e.g., the first sensor (411) of FIG. 4), that a user's gaze (e.g., an iris, a pupil) moves from a first direction to a second direction.

[0137] According to one embodiment, in operation 613, the wearable electronic device (401) may determine the number of virtual areas between the first virtual area and the second virtual area. For example, the wearable electronic device (401) may determine the number of virtual areas between the first virtual area and the second virtual area using a camera.

[0138] According to one embodiment, in operation 615, the wearable electronic device (401) may decrease the first size of the first sound to a third size and increase the second size of the second sound to a fourth size based on the number of virtual areas between the virtual first area and the virtual second area.

[0139] According to one embodiment, a lookup table indicating a relationship between the number of virtual areas between a virtual first area corresponding to a first direction before the direction of the user's gaze moves and a virtual second area corresponding to a second direction after the direction of the user's gaze moves and a sound volume may be stored in the memory (430). According to one embodiment, the wearable electronic device (401) may determine the output volume of the first sound corresponding to the number of virtual areas between the virtual first area and the virtual second area as a third volume and determine the output volume of the second sound as a fourth volume using the lookup table. For example, the greater the number of virtual areas between the virtual first area and the virtual second area, the greater the difference between the first volume and the third volume, and the greater the difference between the second volume and the fourth volume.

[0140] Through this, the wearable electronic device (401) according to one embodiment can determine the output size of the sound based on the number of virtual areas between the first virtual area corresponding to the first direction before the direction of the user's gaze moves and the second virtual area corresponding to the second direction after the direction of the user's gaze moves when the horizontal lengths of each of the plurality of virtual areas are equal to each other, thereby reducing the time and resources required to calculate the output size of the sound.

[0141] FIG. 7 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of sound for content displayed in a virtual area.

[0142] Referring to FIG. 7, according to one embodiment, in operation 711, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can detect that the user's gaze moves from a first direction to a second direction through a first sensor (411) (e.g., the first sensor (411) of FIG. 4).

[0143] According to one embodiment, in operation 713, the wearable electronic device (401) can determine the distance that the user's gaze (e.g., iris, pupil) has moved from a first direction to a second direction.

[0144] According to one embodiment, in operation 715, the wearable electronic device (401) may output the first sound at a third size that is reduced by a size corresponding to the distance traveled from the first size, and may output the second sound at a fourth size that is increased by a size corresponding to the distance traveled from the second size. According to one embodiment, the difference between the first size and the third size may be greater as the distance traveled increases. According to one embodiment, the difference between the second size and the fourth size may be greater as the distance traveled increases.

[0145] According to one embodiment, a lookup table indicating a relationship between a distance that a user's gaze moves from a first direction to a second direction and a sound volume may be stored in the memory (430). According to one embodiment, the wearable electronic device (401) may use the lookup table stored in the memory (430) to determine the output volume of the first sound as a third size that is decreased by a size corresponding to the distance that the user's gaze moves from the first direction to the second direction. According to one embodiment, the wearable electronic device (401) may use the lookup table to determine the output volume of the second sound as a fourth size that is increased by a size corresponding to the distance that the user's gaze moves from the first direction to the second direction.

[0146] FIG. 8 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of sound for content displayed in a virtual area.

[0147] Referring to FIG. 8, according to one embodiment, in operation 811, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can detect that the user's gaze moves from a first direction to a second direction through a first sensor (411) (e.g., the first sensor (411) of FIG. 4).

[0148] According to one embodiment, in operation 813, the wearable electronic device (401) may display a virtual object through the display (460) (e.g., the display (460) of FIG. 4) that adjusts the size of a first sound and a second sound output through the speaker (450) (e.g., the speaker (450) of FIG. 4). For example, the first sound may represent a sound output from a first content displayed in a first virtual area corresponding to a first direction. For example, the second sound may represent a sound output from a second content displayed in a second virtual area corresponding to a second direction. For example, when the wearable electronic device (401) determines that the user's gaze moves from the first direction to the second direction, the wearable electronic device (401) may display the virtual object after a specified time (e.g., 2 seconds) has elapsed from the time of determining the movement. For example, the specified time may represent a time for determining whether the direction in which the user's gaze is directed moves. For example, since the user's gaze may move unintentionally, a designated time can be set to identify that the movement is intentional.

[0149] According to one embodiment, the wearable electronic device (401) can determine whether sound of second content displayed in a virtual second area corresponding to the second direction is being output based on determining that the user's gaze moves from a first direction to a second direction through the first sensor (411).

[0150] According to one embodiment, the wearable electronic device (401) may display a virtual object that allows the size of the first sound and the second sound to be adjusted when it is confirmed that the sound of the second content displayed in the virtual second area corresponding to the second direction is being output and is output at the size of the second sound.

[0151] According to one embodiment, the wearable electronic device (401) may not display a virtual object that adjusts the size of the first sound and the second sound when it is determined that the sound of the second content displayed in the virtual second area corresponding to the second direction is not being output.

[0152] According to one embodiment, in operation 815, the wearable electronic device (401) may identify a user input or user gesture for selecting a virtual object. For example, the user input may include a touch input. For example, the user gesture may include a touch gesture.

[0153] According to one embodiment, in operation 817, the wearable electronic device (401) may output a first sound reduced from a first size to a third size and output a second sound increased from a second size to a fourth size through the speaker (450) based on confirming the user input.

[0154] FIG. 9 is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to apply a filter effect to a sound for content and output a sound with the filter effect applied.

[0155] Referring to FIG. 9, according to one embodiment, in operation 911, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can determine that the user's gaze is directed in a first direction through the first sensor (411) (e.g., the first sensor (411) of FIG. 4).

[0156] According to one embodiment, in operation 913, the wearable electronic device (401) may output a first sound to which a filter effect is not applied through a speaker (450) (e.g., the speaker (450) of FIG. 4 ) and output a second sound to which a filter effect is applied. For example, the filter effect may include a dim effect. For example, the filter effect may include an effect that outputs or blocks a sound of a specific frequency band by using at least one of a low pass filter (LPF), a high pass filter (HPF), a band pass filter (BPF), or a band reject filter (BRF).

[0157] According to one embodiment, in operation 915, the wearable electronic device (401) can detect, through the first sensor (411), that the user's gaze moves from a first direction to a second direction.

[0158] According to one embodiment, in operation 917, the wearable electronic device (401) may output a first sound with a filter effect applied through the speaker (450) and output a second sound without a filter effect applied.

[0159] Through this, the wearable electronic device (401) according to one embodiment can effectively provide an environment in which the user can focus on content displayed in a virtual area corresponding to the direction in which the user's gaze is directed.

[0160] FIG. 10 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present invention to output a specified sound related to an object included in content.

[0161] Referring to FIG. 10, according to one embodiment, in operation 1011, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may analyze first content specified by a user. According to one embodiment, the wearable electronic device (401) may confirm a user input specifying first content displayed in a virtual first area among a plurality of virtual areas. According to one embodiment, the wearable electronic device (401) may analyze the first content using an artificial intelligence model stored in a memory (430) (e.g., the memory (430) of FIG. 4), or may analyze the first content by an external electronic device or server. For example, the wearable electronic device (401) may analyze the content or scene of the first content.

[0162] According to one embodiment, in operation 1013, the wearable electronic device (401) may identify at least one object included in the first content. For example, if the first content includes trees, birds, and streams, the wearable electronic device (401) may determine that the content represents a forest. Alternatively or additionally, if the first content includes planets or outer space, the processor (420) may determine that the content represents space.

[0163] According to one embodiment, in operation 1015, the wearable electronic device (401) may output a first sound and a second sound through the speaker (450) (e.g., the speaker (450) of FIG. 4 ), while outputting a designated sound associated with at least one object. For example, the designated sound may be stored in the memory (430) or may be acquired from an external electronic device or server. For example, if the first content is an image including a bird, the wearable electronic device (401) may determine the designated sound as a bird sound. For example, if the first content is an image including an ocean, the wearable electronic device (401) may determine the designated sound as a wave sound. For example, if the first content is an image including a forest, the wearable electronic device (401) may determine the designated sound as a wind sound. For example, if the processor (420) determines that the first content is content representing a forest, the processor (420) may output a designated sound associated with the forest (e.g., a bird sound and / or a stream sound).

[0164] According to one embodiment, the position of the sound image of the designated sound may correspond to the position of the sound image of the second sound. According to one embodiment, the wearable electronic device (401) may output the designated sound based on the position of the sound image of the second sound, regardless of the movement direction of the user's gaze and the movement direction of the wearable electronic device (401). For example, the designated sound may be output at a designated size.

[0165] FIG. 11 is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to adjust the size of sound for content displayed in a virtual area based on a movement direction of a user's gaze and / or a movement direction of the wearable electronic device.

[0166] To illustrate embodiments of the present disclosure, the sound output sizes (1111, 1112, 1121, 1122, 1131, and / or 1132) are visually depicted. For example, the sound output sizes (1111, 1112, 1121, 1122, 1131, and / or 1132) may not be displayed on a display (e.g., display 460 of FIG. 4). Depending on the implementation, the wearable electronic device (401) may also display a virtual object representing the sound output sizes (1111, 1112, 1121, 1122, 1131, and / or 1132) through a display (e.g., display 460 of FIG. 4). For example, the object may be displayed near the relevant content (e.g., inside or outside the screen of the content). Additionally, the object may contain information indicating volume.

[0167] To illustrate embodiments of the present disclosure, the directions (1101, 1102) of a user's gaze are visually depicted. For example, the directions (1101, 1102) of a user's gaze may not be displayed on a display (e.g., display (460) of FIG. 4 ). Depending on the implementation, the wearable electronic device (401) may also display a virtual object representing the directions (1101, 1102) of a user's gaze through a display (e.g., display (460) of FIG. 4 ). For example, the object may be displayed near the relevant content (e.g., inside or outside the content screen).

[0168] Referring to (a) of FIG. 11, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may display first content in a virtual first area (1110) corresponding to a first direction with respect to the wearable electronic device (401) among a plurality of virtual areas through a display (460) (e.g., the display (460) of FIG. 4), display second content in a virtual second area (1120) corresponding to a second direction with respect to the wearable electronic device (401), and display third content in a virtual third area (1130) corresponding to a third direction with respect to the wearable electronic device (401). For example, the first content may include a playback screen of a movie stored in the wearable electronic device (401). For example, the second content may include an execution screen of a music application of the wearable electronic device (401). For example, the third content may include an execution screen of a video application of the wearable electronic device (401).

[0169] According to one embodiment, the wearable electronic device (401) can detect that the gaze of a user wearing the wearable electronic device (401) is directed in a first direction through the first sensor (411) (e.g., the first sensor (411) of FIG. 4).

[0170] According to one embodiment, the wearable electronic device (401) may determine the output size of the first sound for the first content as the first size (1111), the output size of the second sound for the second content as the second size (1121), and the output size of the third sound for the third content as the third size (1131).

[0171] For example, the first size (1111), the second size (1121), and the third size (1131) of the first sound can be preset by the user. In this case, the second size (1121) and the third size (1131) can be smaller (i.e., quieter or lower) than the first size (1111).

[0172] For example, the first size (1111) of the first sound may be preset by the user, the second size (1121) may be determined based on the distance between the virtual first area (1110) and the virtual second area (1120), and the third size (1131) may be determined based on the distance between the virtual first area (1110) and the virtual third area (1130). In this case, the second size (1121) and the third size (1131) may be smaller than the first size (1111).

[0173] According to one embodiment, the wearable electronic device (401) may determine the output size of the second sound based on the distance between the virtual first area (1110) and the virtual second area (1120). For example, the wearable electronic device (401) may determine the distance between the center position of the virtual first area (1110) and the center position of the virtual second area (1120) as the first distance between the virtual first area (1110) and the virtual second area (1120). According to one embodiment, the wearable electronic device (401) may determine the second size, which is reduced by the amount of sound corresponding to the distance between the virtual first area (1110) and the virtual second area (1120) from the first size, as the output size of the second sound.

[0174] According to one embodiment, the wearable electronic device (401) may determine the output size of the third sound based on the distance between the virtual first area (1110) and the virtual third area (1130). For example, the wearable electronic device (401) may determine the size of the third sound to be a third size that is smaller than the first size by a size of the sound corresponding to the distance between the virtual first area (1110) and the virtual third area (1130).

[0175] According to one embodiment, the wearable electronic device (401) may output a second sound for a second content at a second size (1121) and output a third sound for a third content at a third size (1131). For example, since the distance between the virtual first area (1110) and the virtual third area (1130) and the distance between the virtual first area (1110) and the virtual second area (1120) are the same, the second size (1121) and the third size (1131) may be the same.

[0176] In one embodiment, the distance between the virtual first area (1110) and the virtual second area (1120) and the distance between the virtual first area (1110) and the virtual third area (1130) are described as being the same. Even when the distance between the virtual first area (1110) and the virtual second area (1120) and the distance between the virtual first area (1110) and the virtual third area (1130) are different, the description of the operation for determining the size of the sound can be equally applied.

[0177] According to one embodiment, the wearable electronic device (401) may determine the size of the second sound based on the number of virtual areas between the virtual first area (1110) and the virtual second area (1120). For example, the wearable electronic device (401) may determine the output size of the second sound to be a second size that is smaller than the first size by a corresponding amount when the number of virtual areas is 0.

[0178] According to one embodiment, the wearable electronic device (401) may determine the size of the third sound based on the number of virtual areas between the virtual first area (1110) and the virtual third area (1130). For example, the wearable electronic device (401) may determine the output size of the third sound to be a third size that is smaller by a corresponding amount when the number of virtual areas is 0 from the first size.

[0179] Through this, according to one embodiment, the wearable electronic device (401) outputs sound for content located in the direction of the user's gaze louder (higher) than sound for other content, thereby providing an environment in which the user can focus on content located in the direction of the user's gaze.

[0180] Referring to (b) of FIG. 11, according to one embodiment, the wearable electronic device (401) can detect, through the first sensor (411), that the gaze of a user wearing the wearable electronic device (401) moves from a first direction to a second direction.

[0181] According to one embodiment, the wearable electronic device (401) can determine the distance that the user's gaze has moved from the first direction to the second direction. According to one embodiment, the wearable electronic device (401) can determine the output size of the second sound as the fourth size (1122), the output size of the first sound as the fifth size (1112), and the output size of the third sound as the sixth size (1132) based on the distance that the user's gaze has moved from the first direction to the second direction.

[0182] For example, the wearable electronic device (401) may determine the output size of the second sound as a fourth size (1122) that is increased by a size corresponding to the distance moved from the first direction to the second direction from the second size (1121). The wearable electronic device (401) may determine the output size of the first sound as a fifth size (1112) that is decreased by a size corresponding to the distance moved from the first direction to the second direction from the first size (1111). The wearable electronic device (401) may determine the output size of the third sound as a sixth size (1132) that is decreased by a size corresponding to the distance moved from the first direction to the second direction from the third size (1131).

[0183] For example, the wearable electronic device (401) may determine the output size of the second sound as a fourth size (1122) that is increased by a size corresponding to the case where the number of virtual regions is 0 from the second size (1121) based on the fact that the number of virtual regions between the virtual first region (1110) and the virtual second region (1120) is 0. The wearable electronic device (401) may determine the output size of the first sound as a fifth size (1112) that is decreased by a size corresponding to the case where the number of virtual regions is 0 from the first size (1111). The wearable electronic device (401) may determine the output size of the third sound as a sixth size (1132) that is decreased by a size corresponding to the case where the number of virtual regions is 1 from the third size (1131) based on the fact that the number of virtual regions between the virtual third region (1130) and the virtual second region (1120) is 1.

[0184] In addition, according to one embodiment, the descriptions described in (a) and (b) of FIG. 11 may be equally applicable when the direction in which the wearable electronic device (401) faces matches the direction in which the user's gaze faces. For example, referring to (a) of FIG. 11, the wearable electronic device (401) may determine that the direction in which the user's gaze faces and the wearable electronic device (401) face are the first direction. According to one embodiment, the wearable electronic device (401) may output a second sound for the second content at a second size (1121), and output a third sound for the third content at a third size (1131). For example, referring to (b) of FIG. 11, the wearable electronic device (401) may determine that the user's gaze and the wearable electronic device (401) move from the first direction to the second direction. According to one embodiment, the wearable electronic device (401) may determine the output size of the second sound as a fourth size (1122), the output size of the first sound as a fifth size (1112), and the output size of the third sound as a sixth size (1132).

[0185] In addition, according to one embodiment, the descriptions in (a) and (b) of FIG. 11, the descriptions regarding the direction in which the user's gaze is directed may be replaced with descriptions regarding the direction in which the wearable electronic device (401) is directed. For example, referring to (a) of FIG. 11, the wearable electronic device (401) may determine that the direction in which the wearable electronic device (401) is directed is the first direction. According to one embodiment, the wearable electronic device (401) may output the second sound for the second content at the second size (1121), and output the third sound for the third content at the third size (1131). For example, referring to (b) of FIG. 11, the wearable electronic device (401) may determine that the wearable electronic device (401) has moved from the first direction to the second direction. According to one embodiment, the wearable electronic device (401) may determine the output size of the second sound as a fourth size (1122), the output size of the first sound as a fifth size (1112), and the output size of the third sound as a sixth size (1132).

[0186] FIG. 12 illustrates an operation of a wearable electronic device according to one embodiment of the present invention to display a virtual object for adjusting the size of sound for content displayed in a virtual area.

[0187] To illustrate embodiments of the present disclosure, the sound output sizes (1111, 1112, 1121, 1122, 1131, and / or 1132) are visually depicted. For example, the sound output sizes (1111, 1112, 1121, 1122, 1131, and / or 1132) may not be displayed on a display (e.g., display 460 of FIG. 4). Depending on the implementation, the wearable electronic device (401) may also display a virtual object representing the sound output sizes (1111, 1112, 1121, 1122, 1131, and / or 1132) through a display (e.g., display 460 of FIG. 4). For example, the object may be displayed near the relevant content (e.g., inside or outside the screen of the content). Additionally, the object may contain information indicating volume.

[0188] To illustrate embodiments of the present disclosure, the direction of the user's gaze (1102) is visually depicted. For example, the direction of the user's gaze (1102) may not be displayed on a display (e.g., display (460) of FIG. 4 ). Depending on the implementation, the wearable electronic device (401) may also display a virtual object representing the direction of the user's gaze (1102) through a display (e.g., display (460) of FIG. 4 ). For example, the object may be displayed near the relevant content (e.g., within or outside the content screen).

[0189] Referring to (a) of FIG. 12, according to one embodiment, the wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can confirm that the gaze of a user wearing the wearable electronic device (401) moves from a first direction to a second direction through a first sensor (411) (e.g., the first sensor (411) of FIG. 4) while a first sound for a first content is output at a first size (1111) (e.g., the first size (1111) of FIG. 11), a second sound for a second content is output at a second size (1121) (e.g., the second size (1121) of FIG. 11), and a third sound for a third content is output at a third size (1131) (e.g., the third size (1131) of FIG. 11).

[0190] According to one embodiment, the wearable electronic device (401) may display a virtual object (1210) that adjusts the output size (1111) of the first sound, the output size (1121) of the second sound, and the output size (1131) of the third sound after a specified time (e.g., 2 seconds) has elapsed from the time when the user's gaze is confirmed to move from the first direction to the second direction. For example, the wearable electronic device (401) may display the virtual object (1210) around the virtual second area (1120) in the second direction toward which the user's gaze is directed.

[0191] In one embodiment, the wearable electronic device (401) may identify a user input or user gesture that causes a virtual object (1210) to be selected. For example, the user input or user gesture may include a touch input or a touch gesture.

[0192] Referring to (b) of FIG. 12, according to one embodiment, the wearable electronic device (401) may output the second sound at a fourth size (1122), output the output size of the first sound at a fifth size (1112), and output the output size of the third sound at a sixth size (1132) based on confirming a user input or user gesture for selecting a virtual object (1210).

[0193] Alternatively or additionally, according to one embodiment, the wearable electronic device (401) may display a virtual object (1210) only when the user's gaze and the direction in which the wearable electronic device (401) is facing are aligned.

[0194] Alternatively or additionally, according to one embodiment, the wearable electronic device (401) may display a virtual object (1210) based on the direction in which the wearable electronic device (401) is facing, regardless of the direction of the user's gaze.

[0195] FIG. 13A is a diagram for explaining an operation of a wearable electronic device according to one embodiment of the present invention to apply a filter effect to a sound for content and output a sound with the filter effect applied.

[0196] To illustrate embodiments of the present disclosure, filter effects (1320, and / or 1330) applied to sound and output volumes (1111, 1121, and / or 1131) of the sound are visually depicted. For example, the output volumes (1111, 1121, and / or 1131) of the sound may not be displayed on a display (e.g., display 460 of FIG. 4 ). Depending on the implementation, the wearable electronic device (401) may also display a virtual object representing the output volumes (1111, 1121, and / or 1131) of the sound through a display (e.g., display 460 of FIG. 4 ). For example, the object may be displayed near the relevant content (e.g., inside or outside the screen of the content). Additionally, the object may include information indicating volume. For example, a filter effect (1320, and / or 1330) applied to a sound is illustrated to illustrate embodiments of the present disclosure and may not be displayed on a display (e.g., display 460 of FIG. 4 ). Depending on the implementation, the wearable electronic device (401) may also display a virtual object representing the filter effect (1320, and / or 1330) applied to the sound through a display (e.g., display 460 of FIG. 4 ). For example, the object may be displayed near the relevant content (e.g., within or outside the screen of the content).

[0197] To illustrate embodiments of the present disclosure, the directions (1101, 1102) of a user's gaze are visually depicted. For example, the directions (1101, 1102) of a user's gaze may not be displayed on a display (e.g., display (460) of FIG. 4 ). Depending on the implementation, the wearable electronic device (401) may also display a virtual object representing the directions (1101, 1102) of a user's gaze through a display (e.g., display (460) of FIG. 4 ). For example, the object may be displayed near the relevant content (e.g., inside or outside the content screen).

[0198] Referring to (a) of FIG. 13A, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can confirm that the gaze of a user wearing the wearable electronic device (401) is directed toward a first direction through a first sensor (411) (e.g., the first sensor (411) of FIG. 4).

[0199] According to one embodiment, the wearable electronic device (401) may apply a filter effect (1320) to a second sound for second content displayed in a virtual second area (1120) and a virtual third area (1130) corresponding to a direction where the user's gaze is not directed, and may apply a filter effect (1330) to a third sound for third content. According to one embodiment, the wearable electronic device (401) may not apply a filter effect to the first sound for the first content displayed in the virtual first area (1110). For example, the filter effects (1320, 1330) may include an effect of dimming the sound. For example, the filter effect (1320, 1330) may include an effect that outputs or blocks sounds of a specific frequency band using at least one of a low pass filter (LPF), a high pass filter (HPF), a band pass filter (BPF), or a band reject filter (BRF).

[0200] According to one embodiment, the wearable electronic device (401) may output a first sound to which a filter effect is not applied at a first size (1111), a second sound to which a filter effect (1320) is applied at a second size (1121), and a third sound to which a filter effect (1330) is applied at a third size (1131). For example, the filter effect (1320) applied to the second sound and the filter effect (1330) applied to the third sound may be the same or different from each other.

[0201] Referring to (b) of FIG. 13a, according to one embodiment, the wearable electronic device (401) can detect, through the first sensor (411), that the gaze of a user wearing the wearable electronic device (401) moves from a first direction to a second direction.

[0202] According to one embodiment, the wearable electronic device (401) may not apply a filter effect (1330) to the third sound. According to one embodiment, the wearable electronic device (401) may apply a filter effect (1350) to the first sound. According to one embodiment, the wearable electronic device (401) may maintain the filter effect (1330) of the third sound.

[0203] According to one embodiment, the wearable electronic device (401) can output a first sound to which a filter effect (1350) is applied at a fifth size (1112), a second sound to which a filter effect is not applied at a fourth size (1122), and a third sound to which a filter effect (1330) is applied at a sixth size (1132).

[0204] Additionally, according to one embodiment, the wearable electronic device (401) may apply a filter effect to sound for content displayed in a virtual area corresponding to a direction in which the wearable electronic device (401) is not facing.

[0205] Additionally, according to one embodiment, when the direction in which the wearable electronic device (401) and the user's gaze are directed are the same, the wearable electronic device (401) may not apply a filter to the sound for the content displayed in the virtual area corresponding to the direction. In this case, the wearable electronic device (401) may apply a filter to the sound for the content displayed in the virtual area corresponding to the remaining directions.

[0206] FIG. 13b is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present invention to output a specified sound related to an object included in specified content.

[0207] To illustrate embodiments of the present disclosure, the output magnitudes of sounds (1111, 1121, and / or 1131) and the output magnitudes of designated sounds (1360, and / or 1370) associated with at least one object included in the first content are visually depicted. For example, the output magnitudes of sounds (1111, 1121, and / or 1131) and the output magnitudes of designated sounds (1360, and / or 1370) may not be displayed on a display (e.g., display 460 of FIG. 4 ). Depending on the implementation, the wearable electronic device (401) may also display a virtual object representing the output magnitudes of sounds (1111, 1121, and / or 1131) and the output magnitudes of designated sounds (1360, and / or 1370) through a display (e.g., display 460 of FIG. 4 ). For example, the objects may be displayed near the relevant content (e.g., within or outside the content's screen). Additionally, the objects may include information indicating volume.

[0208] To illustrate embodiments of the present disclosure, the directions (1101, 1102) toward which a user's gaze is directed are visually depicted. For example, the directions (1101, 1102) toward which the user's gaze is directed may not be displayed on a display (e.g., display (460) of FIG. 4 ). Depending on the implementation, the wearable electronic device (401) may also display a virtual object representing the directions (1101, 1102) toward which the user's gaze is directed through a display (e.g., display (460) of FIG. 4 ). For example, the object may be displayed near the relevant content (e.g., within or outside the screen of the content).

[0209] Referring to (a) of FIG. 13B, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may analyze first content designated by a user. For example, the wearable electronic device (401) may obtain a user input for the first content that causes the wearable electronic device (401) to output a designated sound (1360, 1370) related to at least one object included in the first content.

[0210] According to one embodiment, the wearable electronic device (401) can analyze the first content to identify at least one object included in the first content. According to one embodiment, the wearable electronic device (401) can identify at least one object included in the first content using an artificial intelligence model stored in the memory (430) (e.g., the memory (430) of FIG. 4), or can identify at least one object by an external electronic device or server.

[0211] According to one embodiment, the wearable electronic device (401) may output a first sound at a first size (1111), a second sound at a second size (1121), and a third sound at a third size (1131) through a speaker (450) (e.g., the speaker (450) of FIG. 4), while outputting a designated sound associated with at least one object at a designated size (1360, 1370). For example, the designated sound may be stored in the memory (430) or may be acquired from an external electronic device or server. For example, if the first content is an image including a bird, the wearable electronic device (401) may determine the designated sound as a bird sound. For example, if the first content is an image including an ocean, the wearable electronic device (401) may determine the designated sound as a wave sound. For example, if the first content is an image including a forest, the wearable electronic device (401) may determine the designated sound as a wind sound.

[0212] According to one embodiment, the sound image position of the designated sound may correspond to the sound image position of the second sound and the sound image position of the third sound. According to one embodiment, the wearable electronic device (401) may output the designated sound through the speaker (450) based on the sound image position of the second sound. In addition, according to one embodiment, the wearable electronic device (401) may output the designated sound through the speaker (450) based on the sound image position of the third sound.

[0213] Referring to (b) of FIG. 13B, according to one embodiment, the wearable electronic device (401) can determine that the user's gaze and / or the wearable electronic device (401) has moved from the first direction to the second direction. According to one embodiment, the wearable electronic device (401) can output a designated sound (1360, 1370) related to at least one object included in the first content at a designated size regardless of the direction in which the wearable electronic device (401) is facing and the direction in which the user's gaze is facing. At this time, the sound image position of the designated sound (1360, 1370) may correspond to the sound image position of the second sound (1121) and the sound image position of the third sound (1131).

[0214] FIG. 14 illustrates an operation of a wearable electronic device according to one embodiment transmitting notification information to a first wearable electronic device with which it is connected.

[0215] Referring to FIG. 14, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) can confirm that the wearable electronic device (401) and the first wearable electronic device (1401) are worn on a user's body. According to one embodiment, the first wearable electronic device (1401) may include a wearable electronic device that can be worn on a wrist.

[0216] According to one embodiment, the wearable electronic device (401) can confirm that the first wearable electronic device (1401) is worn on the user's left wrist. For example, the wearable electronic device (401) can display a user interface for selecting a body part on which the first wearable electronic device (1401) is worn through the display (460) (e.g., the display (460) of FIG. 4). The wearable electronic device (401) can confirm a user input indicating that the first wearable electronic device (1401) is worn on the user's left wrist through the user interface. Based on the user input, the wearable electronic device (401) can confirm that the first wearable electronic device (1401) is worn on the user's left wrist.

[0217] According to one embodiment, the wearable electronic device (401) may check notification information (1410) regarding third content displayed in a virtual third area (1130) corresponding to a third direction when the user's gaze is directed toward a first direction and / or the wearable electronic device (401) is directed toward the first direction. In this case, the third direction may indicate a left direction based on the user's gaze. For example, the third content may include an execution screen of a video application of the wearable electronic device (401). The notification information may include information indicating that the currently playing video has ended or information indicating that a new video is being played. For example, the third content may further include an execution screen of a text application of the wearable electronic device (401). The notification information may include information indicating that a message has been acquired from an external electronic device. However, this is an example, and the notification information and the third content may not be limited to the above example.

[0218] According to one embodiment, the wearable electronic device (401) can transmit notification information about the third content to the first wearable electronic device (1401). According to one embodiment, the first wearable electronic device (1401) can output the notification information about the third content through vibration or voice.

[0219] FIG. 15A illustrates an operation of a wearable electronic device according to one embodiment of the present invention to adjust the output size of a sound by adjusting the position of a virtual area.

[0220] Referring to FIG. 15A, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may output a second sound for second content displayed in a virtual second area (1120) (e.g., 1120 of FIG. 11) corresponding to a second direction at a fourth size (1122) (e.g., 1122 of FIG. 11) when the direction of the user's gaze and / or the direction of the wearable electronic device (401) is in a second direction.

[0221] At this time, the wearable electronic device (401) can identify a user gesture (1520) that adjusts the position of the virtual second area (1120) corresponding to the second direction. For example, the user gesture (1520) may include a gesture of moving the palm in the +Z-axis direction while the palm is facing the +Z-axis direction.

[0222] In one embodiment, the wearable electronic device (401) can determine a first distance to which the palm has moved based on confirming a user gesture (1520). In one embodiment, the wearable electronic device (401) can move a virtual second area (1120) to a position corresponding to the first distance to which the palm has moved.

[0223] According to one embodiment, the wearable electronic device (401) may display second content on a virtual second area (1530) displayed at a location corresponding to the distance the palm has moved.

[0224] In one embodiment, the wearable electronic device (401) may determine the output size of the second sound from a fourth size (1122) to mute (1510) based on identifying a user gesture (1520).

[0225] In one embodiment, the wearable electronic device (401) may detect an additional user gesture for adjusting the position of the virtual second area (1530) after the output size of the second sound is changed to mute (1510). For example, the additional user gesture may represent a gesture of moving the palm in the +Z-axis direction for a specific period of time.

[0226] According to one embodiment, the wearable electronic device (401) may increase the mute (1510) size of the second sound to a fourth size (1122) when an additional user gesture is confirmed. According to one embodiment, the wearable electronic device (401) may also decrease the output size of the second sound by a size corresponding to the first distance the palm is moved from the fourth size (1122) based on confirming the user gesture (1520).

[0227] According to one embodiment, the wearable electronic device (401) may determine the output size of the second sound based on the location of the virtual second area (1530) based on the confirmation of the user gesture (1520). For example, the wearable electronic device (401) may determine the second sound to be reduced in size by a distance corresponding to the distance between the virtual first area (1110) corresponding to the user's gaze and the first direction in which the wearable electronic device (401) is facing (e.g., the virtual first area (1110) of FIG. 11) and the virtual second area (1530) whose location has changed.

[0228] In one embodiment, the wearable electronic device (401) may determine an additional user gesture for adjusting the position of the virtual second area (1530) after reducing the output size of the second sound by a size corresponding to the first distance the palm has moved from the fourth size (1122). For example, the additional user gesture may represent a gesture for moving the palm in the +Z-axis direction for a specific period of time.

[0229] In one embodiment, the wearable electronic device (401) may increase the reduced volume of the second sound by the volume of the sound corresponding to a specific time when an additional user gesture is confirmed. In one embodiment, the wearable electronic device (401) may also increase the reduced volume of the second sound by the volume of the sound corresponding to a second distance the palm has moved based on the additional user gesture when an additional user gesture is confirmed.

[0230] FIG. 15b illustrates an operation of a wearable electronic device according to one embodiment of the present invention to adjust the output size of a sound by adjusting the position of a virtual area.

[0231] Referring to FIG. 15B, according to one embodiment, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may identify a user gesture (1540) that adjusts the position of a virtual second area (1530) (e.g., 1530 of FIG. 15A) corresponding to a second direction. For example, the user gesture (1540) may include a gesture of moving a palm in the -Z-axis direction while the palm is facing the -Z-axis direction.

[0232] In one embodiment, the wearable electronic device (401) can determine a first distance by which the palm has moved based on the user gesture (1540). In one embodiment, the wearable electronic device (401) can move a virtual second area (1530) to a position corresponding to the first distance by which the palm has moved.

[0233] According to one embodiment, the wearable electronic device (401) can display second content on a virtual second area (1120) displayed at a location corresponding to the first distance the palm has moved.

[0234] In one embodiment, the wearable electronic device (401) may determine the output size of the second sound from mute (1510) (e.g., mute (1510) of FIG. 15A) to a fourth size (1122) based on confirming the user gesture (1540). For example, the fourth size (1122) may include the output size of the second sound before confirming the user gesture (1520).

[0235] According to one embodiment, the wearable electronic device (401) may increase the volume of the second sound by an amount corresponding to a second distance the palm has moved in the muting of the second sound (1510) based on identifying the user gesture (1540).

[0236] According to one embodiment, the wearable electronic device (401) may identify an additional user gesture for adjusting the position of the virtual second area (1120) after the output size of the second sound is changed to a fourth size (1122). For example, the additional user gesture may represent a gesture of moving a palm in the -Z axis direction for a specific period of time. For example, the additional user gesture may include a push-push type switch. However, this is an example, and the gesture may not be limited thereto. According to one embodiment, when the additional user gesture is identified, the wearable electronic device (401) may increase the fourth size (1122) of the second sound to a mute (1510) size.

[0237] FIG. 16 illustrates an operation of a wearable electronic device according to one embodiment of the present invention to output sound for content displayed in a virtual area.

[0238] Referring to FIG. 16, according to one embodiment, in operation 1610, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may display first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual areas.

[0239] According to one embodiment, in operation 1613, the wearable electronic device (401) may display second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device (401) among a plurality of virtual areas.

[0240] According to one embodiment, in operation 1615, the wearable electronic device (401) can determine that the wearable electronic device (401) is facing a first direction through the second sensor (412) (e.g., the second sensor (412) of FIG. 4). For example, the wearable electronic device (401) can determine that the wearable electronic device (401) is facing a first direction in which the first content is displayed based on determining, through the second sensor (412), first content displayed in a designated area of ​​a field of view (FOV) area of ​​the wearable electronic device (401).

[0241] According to one embodiment, in operation 1617, the wearable electronic device (401) may output a first sound for the first content at a first volume and a second sound for the second content at a second volume through the speaker (450) (e.g., the speaker (450) of FIG. 4) based on determining that the wearable electronic device (401) is facing the first direction. In one embodiment, the first volume may be greater than the second volume. In one embodiment, the second volume may be greater than the first volume.

[0242] According to one embodiment, the sound image of the first sound may correspond to a first direction, and the sound image of the second sound may correspond to a second direction.

[0243] According to one embodiment, in operation 1619, the wearable electronic device (401) can determine that the wearable electronic device is moving from a first direction to a second direction.

[0244] According to one embodiment, in operation 1621, the wearable electronic device (401) may output a first sound at a third magnitude (e.g., lower than the first magnitude) and output a second sound at a fourth magnitude (e.g., higher than the second magnitude) through the speaker (450) based on the wearable electronic device (401) moving from a first direction to a second direction. For example, the wearable electronic device (401) may determine that the wearable electronic device (401) is facing a second direction in which the second content is displayed based on determining second content displayed in a designated area of ​​a field of view (FOV) of the wearable electronic device (401) using the second sensor (412). According to one embodiment, the wearable electronic device (401) can maintain the output size of the first sound at the first size and maintain the output size of the second sound at the second size based on determining that the movement direction of the user's gaze and the movement direction of the wearable electronic device (401) do not correspond to each other.

[0245] In one embodiment, the greater the distance traveled from the first direction to the second direction, the greater the difference between the first size and the third size. In one embodiment, the greater the distance traveled from the first direction to the second direction, the greater the difference between the second size and the fourth size.

[0246] According to one embodiment, the operations described when the direction of the user's gaze and the direction in which the wearable electronic device (401) is facing correspond to each other can be equally applied even when only the direction in which the wearable electronic device (401) is facing is moved.

[0247] FIG. 17 illustrates an operation of a wearable electronic device according to one embodiment of the present invention to output sound for content displayed in a virtual area.

[0248] Referring to FIG. 17, according to one embodiment, in operation 1711, a wearable electronic device (401) (e.g., the wearable electronic device (401) of FIG. 4) may display first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual areas.

[0249] According to one embodiment, in operation 1713, the wearable electronic device (401) may display second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device (401) among a plurality of virtual areas.

[0250] According to one embodiment, in operation 1715, the wearable electronic device (401) can determine that the user's gaze is directed toward a first direction through a first sensor (411) (e.g., the first sensor (411) of FIG. 4 ), and that the wearable electronic device (401) is directed toward the first direction through a second sensor (412) (e.g., the second sensor (412) of FIG. 4 ).

[0251] According to one embodiment, in operation 1717, the wearable electronic device (401) may output a first sound for the first content at a first volume and a second sound for the second content at a second volume through the speaker (450) (e.g., the speaker (450) of FIG. 4) based on determining that the user's gaze is directed toward a first direction and that the wearable electronic device (401) is directed toward the first direction. In one embodiment, the first volume may be larger than the second volume. In one embodiment, the second volume may be larger than the first volume. In one embodiment, the sound image of the first sound may correspond to the first direction, and the sound image of the second sound may correspond to the second direction.

[0252] According to one embodiment, in operation 1719, the wearable electronic device (401) can determine that the user's gaze moves from a first direction to a second direction through the first sensor (411), and can determine that the wearable electronic device (401) moves from the first direction to the second direction through the second sensor (412).

[0253] According to one embodiment, in operation 1721, the wearable electronic device (401) may output a first sound at a third magnitude smaller than the first magnitude and output a second sound at a fourth magnitude (e.g., larger (higher) than the second magnitude) through the speaker (450) based on a movement of the user's gaze and the direction in which the wearable electronic device (401) is facing from the first direction to the second direction.

[0254] In one embodiment, the greater the distance traveled from the first direction to the second direction, the greater the difference between the first size and the third size. In one embodiment, the greater the distance traveled from the first direction to the second direction, the greater the difference between the second size and the fourth size.

[0255] Through this, the wearable electronic device (401) according to one embodiment adjusts the sound output size of the content displayed in the virtual area corresponding to the direction in which the user's gaze and the wearable electronic device (401) are directed to be larger (higher) than the sound output size of the content displayed in the remaining virtual areas, thereby effectively providing an environment in which the user can focus on the content displayed in the virtual area corresponding to the direction in which the user's gaze and the wearable electronic device (401) are directed. According to one embodiment, the wearable electronic device may include a first sensor, a speaker, a display, a memory storing instructions, and a processor.

[0256] According to one embodiment, the instructions may store instructions that, when executed by the processor, cause the wearable electronic device to display first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual areas through the display.

[0257] According to one embodiment, the instructions may store instructions that, when executed by the processor, cause the wearable electronic device to display second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device among the plurality of virtual areas through the display.

[0258] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to output a first sound for the first content at a first volume and output a second sound for the second content at a second volume through the speaker based on determining that a gaze of a user wearing the wearable electronic device is directed in the first direction through the first sensor. In one embodiment, the first volume may be larger (higher) than the second volume.

[0259] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to output the first sound reduced from the first size to a third size and to output the second sound increased from the second size to a fourth size based on determining that the user's gaze moves from the first direction to the second direction through the first sensor.

[0260] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to determine the third size and the fourth size based on the number of virtual areas between the virtual first area and the virtual second area among the plurality of virtual areas.

[0261] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to cause a difference in sound volume between the first size and the third size and a difference in sound volume between the second size and the fourth size to increase as the number of virtual areas between the virtual first area and the virtual second area increases.

[0262] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to determine the output size of the first sound as the third size, which is reduced by a size corresponding to a distance the gaze has moved from the first direction to the second direction, from the first size.

[0263] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to determine the output size of the second sound as a fourth size increased by a size corresponding to the distance from the second size.

[0264] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to apply a filter effect to the second sound and output the second sound with the filter effect applied based on determining that the user's gaze is directed in the first direction.

[0265] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to apply the filter effect to the first sound and output the first sound with the filter effect applied, and output the second sound without the filter effect applied, based on determining that the user's gaze moves from the first direction to the second direction.

[0266] According to one embodiment, the filter effect may include an effect that dims the sound.

[0267] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to output a specified sound associated with at least one object included in the first content.

[0268] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to cause a location of an image of the specified sound to correspond to a location of an image of the second sound.

[0269] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to output the specified sound at a specified volume regardless of the direction of movement of the user's gaze.

[0270] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to identify a user gesture corresponding to a designated gesture for adjusting a position of the virtual first area while the user's gaze is directed in the first direction.

[0271] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to adjust the output size of the first sound based on the position of the adjusted virtual first area.

[0272] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to determine that the user's gaze is directed in the first direction while the wearable electronic device is worn on the user's head and a first wearable electronic device is worn on the user's right wrist, wherein the second direction may indicate a right direction with respect to the wearable electronic device.

[0273] According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to transmit notification information to the first wearable electronic device when notification information related to the second content is obtained.

[0274] According to one embodiment, in the wearable electronic device, the position of the sound image of the first sound may correspond to the first direction, and the position of the sound image of the second sound may correspond to the second direction.

[0275] According to one embodiment, the wearable electronic device may further include a second sensor (412), and the instructions, when executed by the processor, may cause the wearable electronic device to output a first sound for the first content at a first volume through the speaker based on determining through the first sensor that a gaze of a user wearing the wearable electronic device is directed toward the first direction and through the second sensor that the wearable electronic device is directed toward the first direction, and to output the first sound at a third volume (e.g., smaller (lower) than the first volume) and to output the second sound at a fourth volume (e.g., larger (higher) than the second volume) based on determining through the first sensor that the gaze of the user wearing the wearable electronic device is moved from the first direction to the second direction and through the second sensor that the wearable electronic device is moved from the first direction to the second direction.

[0276] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual areas through a display of the wearable electronic device.

[0277] According to one embodiment, a method of operating a wearable electronic device may include an operation of displaying second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device among the plurality of virtual areas through a display of the wearable electronic device.

[0278] According to one embodiment, a method of operating a wearable electronic device may include an operation of outputting a first sound for the first content at a first volume through a speaker of the wearable electronic device and outputting a second sound for the second content at a second volume based on confirming that a gaze of a user wearing the wearable electronic device is directed in the first direction through a first sensor of the wearable electronic device. In one embodiment, the first volume may be larger (higher) than the second volume. In one embodiment, the second volume may be larger (higher) than the first volume.

[0279] According to one embodiment, a method of operating a wearable electronic device may include an operation of outputting the first sound reduced from the first size to a third size and outputting the second sound increased from the second size to a fourth size based on confirming that the user's gaze moves from the first direction to the second direction through the first sensor.

[0280] According to one embodiment, the method of operating a wearable electronic device may include determining the third size and the fourth size based on the number of virtual areas between the virtual first area and the virtual second area among the plurality of virtual areas.

[0281] According to one embodiment, the method of operating a wearable electronic device may be such that the greater the number of virtual areas between the virtual first area and the virtual second area, the greater the difference in sound volume between the first size and the third size and the difference in sound volume between the second size and the fourth size.

[0282] According to one embodiment, a method of operating a wearable electronic device may include determining the output size of the first sound as the third size, which is reduced by a size corresponding to a distance the gaze moves from the first direction to the second direction, from the first size.

[0283] According to one embodiment, a method of operating a wearable electronic device may include determining the output size of the second sound as a fourth size increased by a size corresponding to the distance from the second size.

[0284] According to one embodiment, a method of operating a wearable electronic device may include an operation of applying a filter effect to the second sound and outputting the second sound with the filter effect applied, based on confirming that the user's gaze is directed in the first direction.

[0285] According to one embodiment, a method of operating a wearable electronic device may include an operation of applying the filter effect to the first sound and outputting the first sound to which the filter effect is applied, and outputting the second sound to which the filter effect is not applied, based on confirming that the user's gaze moves from the first direction to the second direction.

[0286] According to one embodiment, a method of operating a wearable electronic device may include an operation of outputting a designated sound associated with at least one object included in the first content.

[0287] According to one embodiment, the method of operating a wearable electronic device may be such that the position of the sound image of the specified sound corresponds to the position of the sound image of the second sound.

[0288] According to one embodiment, a method of operating a wearable electronic device may include an operation of outputting the specified sound at a specified size regardless of a movement direction of the user's gaze.

[0289] According to one embodiment, a method of operating a wearable electronic device may include an operation of confirming a user's gesture corresponding to a designated gesture for adjusting a position of the virtual first area while the user's gaze is directed in the first direction.

[0290] According to one embodiment, a method of operating a wearable electronic device may include an operation of adjusting the first size based on a position of the adjusted virtual first area.

[0291] According to one embodiment, a method of operating a wearable electronic device includes an operation of confirming that the user's gaze is directed toward the first direction while the wearable electronic device is worn on the user's head and a first wearable electronic device is worn on the user's right wrist, wherein the second direction may indicate a right direction based on the wearable electronic device.

[0292] According to one embodiment, a method of operating a wearable electronic device may include an operation of transmitting notification information to the first wearable electronic device when notification information related to the second content is obtained.

[0293] According to one embodiment, a method for operating a wearable electronic device may include an operation of outputting a first sound for the first content at a first volume through the speaker based on confirming through the first sensor that a gaze of a user wearing the wearable electronic device is directed toward the first direction and through the second sensor that the wearable electronic device is directed toward the first direction, and an operation of outputting the first sound at a third volume smaller (lower) than the first volume and outputting the second sound at a fourth volume larger (higher) than the second volume, for example, based on confirming through the first sensor that the gaze of the user wearing the wearable electronic device is moved from the first direction to the second direction and through the second sensor that the wearable electronic device is moved from the first direction to the second direction.

[0294] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation may include an operation of displaying first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual areas through a display of the wearable electronic device.

[0295] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of displaying second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device among the plurality of virtual areas through a display of the wearable electronic device.

[0296] According to one embodiment, a storage medium storing computer-readable instructions may be provided, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation may include an operation of outputting a first sound for the first content at a first volume through a speaker of the wearable electronic device and outputting a second sound for the second content at a second volume based on determining that a gaze of a user wearing the wearable electronic device is directed in the first direction through a first sensor of the wearable electronic device. In one embodiment, the first volume may be larger (higher) than the second volume. In one embodiment, the second volume may be larger (higher) than the first volume.

[0297] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of outputting the first sound reduced from the first size to a third size and outputting the second sound increased from the second size to a fourth size based on determining through the first sensor that the user's gaze moves from the first direction to the second direction, wherein the output size of the first sound is reduced based on a distance moved from the first direction to the second direction, and the output size of the second sound is increased based on a distance moved from the first direction to the second direction.

[0298] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of determining the third size and the fourth size based on the number of virtual areas between the virtual first area and the virtual second area among the plurality of virtual areas.

[0299] According to one embodiment, in a storage medium storing computer-readable instructions, the greater the number of virtual areas between the virtual first area and the virtual second area, the greater the difference in sound volume between the first size and the third size and the difference in sound volume between the second size and the fourth size.

[0300] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of determining the output size of the first sound to be reduced from the first size to the third size by a size corresponding to a distance the gaze has moved from the first direction to the second direction.

[0301] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of determining the output size of the second sound as a fourth size increased by a size corresponding to the distance from the second size.

[0302] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of applying a filter effect to the second sound and outputting the second sound with the filter effect applied, based on determining that the gaze of the user is directed in the first direction.

[0303] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of applying a filter effect to the first sound and outputting a first sound to which the filter effect is applied, based on determining that the user's gaze moves from the first direction to the second direction, and outputting a second sound to which the filter effect is not applied.

[0304] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of outputting a specified sound associated with at least one object included in the first content.

[0305] According to one embodiment, in a storage medium storing computer-readable instructions, the position of the sound image of the specified sound may correspond to the position of the sound image of the second sound.

[0306] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation may include an operation of outputting a specified sound at a specified volume regardless of a movement direction of a user's gaze.

[0307] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of confirming a user's gesture corresponding to a designated gesture for adjusting a position of the virtual first area while the user's gaze is directed in the first direction.

[0308] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of adjusting the first size based on a position of the adjusted virtual first area.

[0309] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes an operation of confirming that the user's gaze is directed in the first direction while the wearable electronic device is worn on the user's head and a first wearable electronic device is worn on the user's right wrist, wherein the second direction may indicate a right direction with respect to the wearable electronic device.

[0310] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation may include an operation of transmitting notification information to the first wearable electronic device when notification information related to the second content is obtained.

[0311] According to one embodiment, a storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, wherein the at least one operation includes: an operation of outputting a first sound for the first content at a first volume through the speaker based on determining through the first sensor that a gaze of a user wearing the wearable electronic device is directed toward the first direction and through the second sensor that the wearable electronic device is directed toward the first direction; and an operation of outputting the first sound at a third volume (e.g., smaller (lower) than the first volume) and outputting the second sound at a fourth volume (e.g., larger (higher) than the second volume) based on determining through the first sensor that the gaze of the user moving from the first direction to the second direction and through the second sensor that the wearable electronic device moving from the first direction to the second direction. Can be.

[0312] According to one embodiment, a wearable electronic device may include a first sensor, a speaker, a display, a memory storing instructions, and a processor. According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to display, through the display, first content in a virtual first region corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual regions. According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to display, through the display, second content in a virtual second region corresponding to a second direction with respect to the wearable electronic device among the plurality of virtual regions. According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to output a first sound for the first content at a first volume and to output a second sound for the second content at a second volume through the speaker based on determining through the sensor that the wearable electronic device is facing the first direction. In one embodiment, the first volume may be larger (higher) than the second volume, and a position of a sound image of the first sound may correspond to the first direction, and a position of a sound image of the second sound may correspond to the second direction. According to one embodiment, the instructions, when executed by the processor, may cause the wearable electronic device to output the first sound at a third magnitude (e.g., smaller (lower) than the first magnitude) and to output the second sound at a fourth magnitude (e.g., larger (higher) than the second magnitude) based on determining, through the sensor, that the wearable electronic device is moving from the first direction to the second direction.

[0313] Electronic devices according to one or more embodiments of the present disclosure may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of the present disclosure are not limited to the aforementioned devices.

[0314] It should be understood that one or more embodiments of the present disclosure and terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but rather to encompass various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly dictates otherwise. In this document, each of the phrases "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0315] The term "module" as used in one or more embodiments of the present disclosure may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0316] One or more embodiments of the present disclosure may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101, 200, 300, 401)). For example, a processor (e.g., a processor (120, 420)) of a machine (e.g., an electronic device (101, 200, 300, 401)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the called at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'Non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0317] According to one embodiment, a method according to one or more embodiments of the present disclosure may be provided as a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0318] According to one or more embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one or more embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, according to one or more embodiments, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one or more embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In wearable electronic devices, Sensor 1; speaker; display; Memory for storing instructions; and A processor operatively connected to the first sensor, the speaker, the display, and the memory, The above instructions, when executed by the processor, cause the wearable electronic device to: Through the above display, the first content is displayed in a virtual first area corresponding to a first direction based on the wearable electronic device among a plurality of virtual areas, Through the above display, the second content is displayed in a virtual second area corresponding to the second direction with respect to the wearable electronic device among the plurality of virtual areas, Based on the determination that the gaze of the user wearing the wearable electronic device is directed toward the first direction through the first sensor, the first sound for the first content is output at a first size through the speaker, and the second sound for the second content is output at a second size, wherein the first size is different from the second size, A wearable electronic device that outputs the first sound of a third size different from the first size and causes the second sound of a fourth size different from the second size based on confirming that the user's gaze moves from the first direction to the second direction through the first sensor.

2. In paragraph 1, The first size is larger than the second size, the third size is smaller than the first size, and the fourth size is larger than the second size. The above instructions, when executed by the processor, cause the wearable electronic device to: The third size and the fourth size are determined based on the number of virtual areas between the virtual first area and the virtual second area, A wearable electronic device that causes a greater difference in sound levels between the first size and the third size and a greater difference in sound levels between the second size and the fourth size as the number of virtual areas between the first virtual area and the second virtual area increases.

3. In paragraph 1, The above instructions, when executed by the processor, cause the wearable electronic device to: The output size of the first sound is determined as the third size, which is reduced by a size corresponding to the distance the gaze moves from the first direction to the second direction from the first size, A wearable electronic device further causing the output size of the second sound to be determined as a fourth size increased by a size corresponding to the distance from the second size.

4. In paragraph 1, The above instructions, when executed by the processor, cause the wearable electronic device to: Based on confirming that the user's gaze is directed toward the first direction, a filter effect is applied to the second sound and the second sound with the filter effect applied is output. A wearable electronic device that applies the filter effect to the first sound based on determining that the user's gaze moves from the first direction to the second direction, outputs the first sound to which the filter effect is applied, and further causes the second sound to be output to which the filter effect is not applied.

5. In paragraph 1, The above instructions, when executed by the processor, cause the wearable electronic device to: Outputting a specified sound associated with at least one object included in the first content; A wearable electronic device further causing the sound position of the sound image of the above-mentioned designated sound to correspond to the sound position of the sound image of the second sound.

6. In paragraph 1, The above instructions, when executed by the processor, cause the wearable electronic device to: In a state where the user's gaze is directed in the first direction, a user's gesture corresponding to a designated gesture for adjusting the position of the virtual first area is confirmed, Adjusting the position of the above virtual first area, A wearable electronic device further causing the output size of the first sound to be adjusted based on the position of the adjusted virtual first area.

7. In paragraph 1, The above instructions, when executed by the processor, cause the wearable electronic device to: The wearable electronic device is worn on the user's head, and the first wearable electronic device is worn on the user's right wrist, and it is confirmed that the user's gaze is directed toward the first direction, wherein the second direction corresponds to the right direction based on the direction of the user's gaze, A wearable electronic device that obtains notification information related to the second content and further causes the notification information to be transmitted to the first wearable electronic device.

8. In paragraph 1, The position of the sound image of the first sound corresponds to the first direction, A wearable electronic device in which the position of the sound image of the second sound corresponds to the second direction.

9. In paragraph 1, Including a second sensor, The above instructions, when executed by the processor, cause the wearable electronic device to: Based on confirming that the gaze of the user wearing the wearable electronic device is directed toward the first direction through the first sensor and that the wearable electronic device is directed toward the first direction through the second sensor, a first sound for the first content is output at a first size through the speaker, A wearable electronic device that outputs the first sound of the third size and outputs the second sound of the fourth size based on determining that the user's gaze moves from the first direction to the second direction through the first sensor and that the wearable electronic device moves from the first direction to the second direction through the second sensor.

10. A method for operating a wearable electronic device, An operation of displaying first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual areas through a display of the wearable electronic device; An operation of displaying second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device among the plurality of virtual areas through a display of the wearable electronic device; An operation of outputting a first sound for the first content at a first size and a second sound for the second content at a second size through a speaker of the wearable electronic device based on confirming that the gaze of a user wearing the wearable electronic device is directed toward the first direction through a first sensor of the wearable electronic device, wherein the first size is different from the second size; and A method of operating a wearable electronic device, comprising: outputting the first sound at a third size different from the first size, and outputting the second sound at a fourth size different from the second size, based on confirming that the user's gaze moves from the first direction to the second direction through the first sensor.

11. In paragraph 10, Further comprising an operation of determining the third size and the fourth size based on the number of virtual areas between the virtual first area and the virtual second area among the plurality of virtual areas, The first size is larger than the second size, the third size is smaller than the first size, and the fourth size is larger than the second size. A method of operating a wearable electronic device, wherein the greater the number of virtual regions between the virtual first region and the virtual second region, the greater the difference in sound levels between the first size and the third size and the difference in sound levels between the second size and the fourth size.

12. In paragraph 10, An operation of determining the output size of the first sound as the third size, which is reduced by a size corresponding to the distance the gaze has moved from the first direction to the second direction from the first size; and A method of operating a wearable electronic device further comprising an operation of determining the output size of the second sound as a fourth size increased by a size corresponding to the distance from the second size.

13. In paragraph 10, An operation of applying a filter effect to the second sound and outputting the second sound with the filter effect applied based on confirming that the user's gaze is directed toward the first direction; and A method of operating a wearable electronic device further comprising: applying the filter effect to the first sound, outputting the first sound to which the filter effect is applied, and outputting the second sound to which the filter effect is not applied, based on confirming that the user's gaze moves from the first direction to the second direction.

14. In paragraph 10, A method of operating a wearable electronic device further comprising an action of outputting a designated sound associated with at least one object included in the first content.

15. A storage medium storing computer-readable instructions, wherein the instructions, when executed by a processor of a wearable electronic device, cause the wearable electronic device to perform at least one operation, the at least one operation being: An operation of displaying first content in a virtual first area corresponding to a first direction with respect to the wearable electronic device among a plurality of virtual areas through a display of the wearable electronic device; An operation of displaying second content in a virtual second area corresponding to a second direction with respect to the wearable electronic device among the plurality of virtual areas through a display of the wearable electronic device; An operation of outputting a first sound for the first content at a first size and a second sound for the second content at a second size through a speaker of the wearable electronic device based on confirming that the gaze of a user wearing the wearable electronic device is directed toward the first direction through a first sensor of the wearable electronic device, wherein the first size is different from the second size; and A storage medium including an operation of outputting the first sound in a third size different from the first size and outputting the second sound in a fourth size different from the second size based on confirming that the user's gaze moves from the first direction to the second direction through the first sensor.

Images