Wearable device for providing sound setting, and operating method thereof

Abstract

According to various embodiments, a wearable device may comprise: a display; a communication circuit for transmitting and receiving sound signals; at least one processor; and a memory for storing instructions. The instructions are individually or collectively executed by the at least one processor so that the wearable device can be instructed to: acquire spatial information about a virtual space for generating spatial sound; output, through the display, a first screen for setting a virtual speaker in the virtual space; acquire speaker setting information on the basis of a user input on the first screen; acquire sound setting information on the basis of the spatial information and the speaker setting information; acquire, on the basis of the sound setting information, spatial sound signals obtained by converting sound signals into spatial sound; and transmit the spatial sound signals to at least one speaker connected to the wearable device, such that the at least one speaker outputs the spatial sound signals.

Description

Wearable device providing sound settings and method of operation thereof

[0001] Various embodiments disclosed in this document relate to a wearable device providing sound settings, a method of operating the same, and a recording medium for performing the method.

[0002] Recently, various forms and structures of wearable devices are being developed to improve user convenience. These advancements can enhance the convenience of wearable devices for users. Accordingly, extensive research is being conducted on providing various functions using wearable devices.

[0003] For example, recently, eXtended Reality (XR) technology, which includes functions such as Augmented Reality (AR) and Virtual Reality (VR) provided by wearable devices, has been attracting attention as a disruptive innovation following the smartphone era and continues to grow. As XR technology continues to develop, many companies are releasing various forms of XR devices, such as Head Mount Displays (HMDs), glasses, and smart lenses.

[0004] These wearable devices can be connected to at least one speaker and provide stereo sound to the user through the speaker. However, the wearable device may also provide spatial audio, without limitation. Spatial audio technology precisely conveys the location and directionality of sound sources, enabling users to experience an immersive audio experience. Spatial audio systems have primarily been utilized in fixed environments, such as movie theaters, game consoles, or high-end audio systems, and these systems require precise hardware installation and complex setup processes.

[0005] Recent advancements in wearable devices and display devices have led to efforts to provide spatial audio experiences while on the move. However, existing technologies have limitations, such as not being able to easily configure the user's desired audio environment or adaptively adjust audio based on the wearable device's operating mode. Specifically, to provide optimal spatial audio experiences across various activity levels, device-user interaction and automatic audio control based on operating mode are required.

[0006] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0007] A problem to be solved in the present disclosure may be to provide a wearable device that allows a user to easily set spatial sound.

[0008] The problem to be solved in the present disclosure may be to enable a user to easily set spatial sound through a display of a wearable device, and to provide the user with various selection elements so that various spatial sounds can be generated when setting spatial sound.

[0009] A problem to be solved in the present disclosure may be to provide a wearable device that can adaptively provide spatial sound according to changes in the state of the wearable device.

[0010] A problem to be solved in the present disclosure may be to provide a wearable device that provides spatial sound automatically adjusted according to the operating mode of the wearable device.

[0011] The problem to be solved in the present disclosure may be to provide a wearable device that further increases immersion by changing sound settings in real time according to the user's actions and environment.

[0012] According to various embodiments, a wearable device may include a display, a communication circuit for transmitting and receiving an audio signal, at least one processor, and a memory for storing instructions. The instructions may be individually or collectively executed by the at least one processor to cause the wearable device to: obtain spatial information about a virtual space for generating spatial sound, output a first screen for setting virtual speakers in the virtual space through the display, obtain speaker setting information based on a user input for the first screen, obtain audio setting information based on the spatial information and the speaker setting information, obtain a spatial sound signal converted into an audio signal based on the audio setting information, and transmit the spatial sound signal to at least one speaker so that at least one speaker connected to the wearable device outputs the spatial sound signal.

[0013] According to various embodiments, a method of operating a wearable device may include an operation of obtaining spatial information about a virtual space for generating spatial sound, an operation of outputting a first screen for setting virtual speakers in the virtual space through a display connected to the wearable device, an operation of obtaining speaker setting information based on a user input for the first screen, an operation of obtaining sound setting information based on the spatial information and the speaker setting information, an operation of obtaining a spatial sound signal by converting an acquired sound signal into spatial sound based on the sound setting information, and an operation of outputting a spatial sound signal through at least one speaker connected to the wearable device.

[0014] Wearable devices according to various embodiments disclosed in this document can provide a function that allows a user to easily set spatial sound.

[0015] The wearable device according to various embodiments disclosed in this document can enable a user to easily set spatial sound through a display of the wearable device, and can provide the user with various selection elements so that various spatial sounds can be generated when setting spatial sound.

[0016] A wearable device according to various embodiments disclosed in this document can adaptively provide spatial sound according to changes in the state of the wearable device.

[0017] A wearable device according to various embodiments disclosed in this document can provide spatial sound that is automatically adjusted according to the operating mode of the wearable device.

[0018] Wearable devices according to various embodiments disclosed in this document can further enhance immersion by changing sound settings in real time according to the user's actions and environment.

[0019] In addition, various effects may be provided directly or indirectly through this document.

[0020] FIG. 1 is a diagram illustrating a usage environment of a wearable device according to various embodiments.

[0021] FIG. 2 illustrates a wearable device according to various embodiments worn on at least a portion of a user's body.

[0022] FIG. 3 illustrates a wearable device according to various embodiments worn on at least a part of the body.

[0023] FIG. 4 is a block diagram of a wearable device according to various embodiments.

[0024] FIG. 5 is a flowchart illustrating an operation of a wearable device generating a spatial sound signal according to various embodiments.

[0025] FIG. 6 is a flowchart illustrating an operation of a wearable device outputting a screen for setting up a virtual speaker according to various embodiments.

[0026] FIG. 7 is a drawing for explaining a first user interface of spatial sound settings displayed on a display according to various embodiments.

[0027] FIG. 8 is a flowchart illustrating an operation of a wearable device outputting a screen for setting up a virtual speaker according to various embodiments.

[0028] FIG. 9 is a diagram illustrating a second user interface (Usert Interface) of spatial sound settings displayed on a display according to various embodiments.

[0029] FIG. 10 is a diagram illustrating a third user interface (Usert Interface) of spatial sound settings displayed on a display according to various embodiments.

[0030] FIG. 11 is a flowchart illustrating an operation of a wearable device according to various embodiments to update sound setting information according to a change in the user's position in a virtual space.

[0031] FIG. 12 is a diagram for explaining changes in spatial sound output according to changes in a user's position in a virtual space, according to various embodiments.

[0032] FIG. 13 is a flowchart illustrating providing spatial sound in a spatial sound providing system according to various embodiments.

[0033] FIG. 14 is a flowchart illustrating an operation of a wearable device according to various embodiments to change an output mode depending on the position of a rotation frame.

[0034] FIG. 15 is a flowchart illustrating an operation of a wearable device according to various embodiments to update an output mode of music output according to a change in the position of a rotation frame.

[0035] FIG. 16 is a diagram for explaining providing empathetic sound according to a change in the state of a wearable device according to various embodiments.

[0036] FIG. 17 is a flowchart illustrating an operation of a wearable device according to various embodiments to update an output mode of a video output according to a change in the position of a rotation frame.

[0037] FIG. 18 is a drawing for explaining providing video content in conjunction with an external device according to a change in the state of a wearable device according to various embodiments.

[0038] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0039] Specific structural or functional descriptions of various embodiments are merely illustrative for the purpose of explaining the various embodiments, and the various embodiments may be implemented in various forms and should not be construed as limited to the embodiments described in this specification or application.

[0040] Since various embodiments may have various modifications and take various forms, various embodiments are illustrated in the drawings and described in detail in this specification or application. However, the matters disclosed in the drawings are not intended to specify or limit the various embodiments, and should be understood to include all modifications, equivalents, and alternatives included within the spirit and technical scope of the various embodiments.

[0041] While terms such as "first" and / or "second" may be used to describe various components, these components should not be limited by these terms. These terms are only intended to distinguish one component from another; for example, without departing from the scope of the present disclosure, a first component may be referred to as a "second component," and similarly, a second component may also be referred to as a "first component."

[0042] When a component is referred to as being "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, but that there may be other components in between. Conversely, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between. Other expressions that describe the relationship between components, such as "between" and "directly between" or "adjacent to" and "directly adjacent to", should be interpreted similarly.

[0043] The terminology used herein is for the purpose of describing specific embodiments only and is not intended to limit the various embodiments. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this specification, it should be understood that the terms "comprises" or "has" specify the presence of a described feature, number, step, operation, component, part, or combination thereof, but do not exclude in advance the presence or possibility of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0044] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by those of ordinary skill in the art to which this disclosure pertains. Terms defined in commonly used dictionaries should be interpreted to have a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined herein.

[0045] Hereinafter, the present disclosure will be described in detail by describing preferred embodiments of the present disclosure with reference to the attached drawings. The same reference numerals in each drawing represent the same components.

[0046]

[0047] FIG. 1 is a diagram illustrating a usage environment of a wearable device according to various embodiments.

[0048] Referring to FIG. 1, a user environment of a wearable device according to an embodiment of the present invention may include a wearable device (1), an external device (2), and a speaker (3). According to one embodiment, the speaker (3) may be configured as a form included in the wearable device (1). In addition, the speaker (3) may be configured as a device distinct from the wearable device (1). In this case, the wearable device (1), the external device (2), and the speaker (3) may be connected via any network. However, the user environment is not limited to the illustrated and / or described examples, and may be implemented to include more components and / or fewer components.

[0049] According to various embodiments, the wearable device (1) and / or the external device (2) may be devices of various forms. For example, they may include a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, a headset, headphones, AR glasses, an HMD device, or a home appliance device.

[0050] According to various embodiments, the wearable device (1) may be implemented to provide various contents to the user. For example, the wearable device (1) may be implemented to establish a connection with an external device (2) through a network so that contents that can be provided through the external device (2) may also be provided through the wearable device (1). At this time, the network according to one embodiment of the present invention may be configured regardless of the communication type, such as wired or wireless, and may be configured as various networks, such as a personal area network (PAN), a local area network (LAN), and a wide area network (WAN). In addition, the network may be the well-known World Wide Web (WWW), and may also use a wireless transmission technology used for short-distance communication, such as infrared data association (IrDA) or Bluetooth. At this time, the type of network is not limited to the above-described embodiment, and various communication systems may be included in the network.

[0051] According to various embodiments, the wearable device (1) can be implemented to provide services to the user in various ways using an external device (2) and / or a speaker (3).

[0052] In one embodiment, the wearable device (1) may be implemented as a system type. The system type may be defined as a type that provides a service in cooperation with other external devices. For example, the wearable device (1) may be implemented to provide a service based on exchanging (e.g., transmitting and / or receiving) data (or information) with a server or the like via an external device (2). The wearable device (1) may establish a communication connection with the external device (2), and the external device (2) may establish a communication connection with the server or the like. Accordingly, the wearable device (1) and the server may transmit and / or receive data (or information) via the external device (2). In addition, for example, the wearable device (1) may be implemented to provide a service based on exchanging (e.g., transmitting and / or receiving) data (or information) with the server. The wearable device (1) can establish a direct communication connection with the server, transmit data (or information) to the server, or receive data (or information) from the server (20).

[0053] In another embodiment, the wearable device (1) may be implemented as an on-device type. For example, the wearable device (1) may be implemented to provide a service on its own without exchanging data (or information) with a server or external device (2).

[0054] According to various embodiments, the wearable device (1) may obtain media data from an external device (2) through the network and provide the media data to a user through components (e.g., a display, a speaker, etc.) of the wearable device (1). In another embodiment, the wearable device (1) may independently provide the media data to a user through components of the wearable device (1). In another embodiment, the wearable device (1) may determine an output mode of the media data and control the speaker (3) to output the media data according to the output mode.

[0055] Below, various media data output methods utilizing a wearable device (1) are described, such as providing media data to a user by linking the wearable device (1) with an external device (2) and providing media data to a user through a speaker (3).

[0056]

[0057] FIG. 2 illustrates a wearable device according to various embodiments worn on at least a portion of a user's body.

[0058] FIG. 3 illustrates a wearable device according to various embodiments worn on at least a part of the body.

[0059] Hereinafter, the coordinate axes illustrated in FIGS. 2 and 3 represent the left (L), right (R), upper (U), lower (D), front (F), and rear (B) sides defined based on the user. The above coordinate axes may be understood as exemplary coordinate axes for explaining the wearable device (1) according to one embodiment of the present disclosure.

[0060] The configurations of FIGS. 2 and 3 may be referenced by configurations of other drawings to the extent that they are not mutually superimposed. The same terms and / or the same reference numerals are used for configurations that are identical or substantially identical to those of other drawings.

[0061] Referring to FIGS. 2 and 3, a wearable device (1) according to one embodiment of the present disclosure may include a display device (DR, DL). The display device (DR, DL) may be configured to provide visual information (e.g., images or videos) to a user. As an example, the display device (DR, DL) may be connected to the outside world via separate wiring (not shown).

[0062] According to one embodiment of the present disclosure, a display device (DR, DL) may include a right display (DR) and a left display (DL). The right display (DR) may correspond to the user's right eye, and the left display (DL) may correspond to the user's left eye. The right display (DR) may provide visual information to the user's right eye, and the left display (DL) may provide visual information to the user's left eye. The display devices (DR, DL) may be configured to provide the user with visual information associated with sounds output from a pair of ear cups (101, 102).

[0063] According to one embodiment, the display device (DR, DL) may include at least one lens unit and a window. At least one lens unit may include a first lens unit disposed on the right display (DR) and a second lens unit disposed on the left display (DL). According to one embodiment, the lens unit may be implemented to receive image light output from the display (DR, DL) and provide it to the user's pupil. In addition, the lens unit may be implemented to receive image light output from the display (DR, DL) and provide it to the user's pupil while providing light provided from the outside to the user's pupil of the wearable device (1).

[0064] According to one embodiment, a wearable device (1) may include a pair of ear cups (101, 102) configured to output sound. At least one of the pair of ear cups (101, 102) may have a built-in speaker (not shown) configured to generate sound. Auditory information may be provided to a user through the pair of ear cups (101, 102).

[0065] For convenience of explanation, a pair of ear cups (101, 102) may be described as a right ear cup (101) and a left ear cup (102) based on the user. As an example, the right ear cup (101) and the left ear cup (102) may have structures that are symmetrical left and right based on the user, and unless specifically mentioned, the description of the right ear cup (101) described below may be substantially equally applied to the left ear cup (102) to the extent that they are not arranged with each other.

[0066] According to one embodiment of the present disclosure, a wearable device (1) may include a right rotational part (201) and a left rotational part (202) coupled to a pair of ear cups (101, 102) such that at least a portion thereof is rotatable relative to the pair of ear cups. The right rotational part (201) and the left rotational part (202) may be configured to rotate relative to the ear cups (101, 102) about a left-right axis. The right rotational part (201) may be coupled to the right ear cup (101), and the left rotational part (202) may be coupled to the left ear cup (102). As an example, the right ear cup (101) and the left ear cup (102) may have structures that are symmetrical left and right with respect to the user, and unless specifically mentioned, the description of the right rotational part (201) described below may be substantially equally applied to the left rotational part (202) to the extent that they are not arranged with each other.

[0067] However, the right rotation part (201) and the left rotation part (202) are not limited to the illustrated example, and may be arranged in various forms. For example, the right rotation part (201) may be arranged between the right ear cup (101) and the right ear cushion. For example, the left rotation part (202) may be arranged between the left ear cup (102) and the left ear cushion.

[0068] According to one embodiment of the present disclosure, a wearable device (1) may include a rotation frame (M) configured to rotate (see FIG. 3) and / or move with respect to a pair of ear cups (101, 102). The rotation frame (M) may be connected to the pair of ear cups (101, 102) via a rotational portion (e.g., a right rotational portion (201) and a left rotational portion (202)). The rotation frame (M) may include a display device (DR, DL) and a connection portion (301). The display device (D) may be rotated and / or moved with respect to the pair of ear cups (101, 102) to facilitate providing visual information to a user. The rotation frame (M) may include a right connection portion and a left connection portion, which will be described below, but is not limited thereto.

[0069] According to one embodiment of the present disclosure, a wearable device (1) may include a right connection part (301) connecting the display device (DR, DL) and the right rotation part (201). The wearable device (1) may include a left connection part (not shown) connecting the display device (DR, DL) and the left rotation part (202). As an example, the right connection part (301) and the left connection part (not shown) may have a structure that is symmetrical left and right with respect to the user, and unless specifically mentioned, the description of the right connection part (301) described below may be substantially equally applied to the left connection part (not shown) to the extent that they are not arranged with each other.

[0070] Referring to FIGS. 2 and 3, a rotation frame (M) of a wearable device (1) according to one embodiment of the present disclosure can be rotated relative to a pair of ear cups (101, 102) so that a display device (DR, DL) is positioned in front of a user. FIG. 3 illustrates a first state in which the display device (DR, DL) is positioned in front of a user. FIG. 2 illustrates a second state in which the display device (DR, DL) is not positioned in front of the user, and as an example, the display device (DR, DL) is positioned above the user's head. FIG. 2 illustrates the first state in which the display device (DR, DL) is rotated from the second state to be positioned in front of the user. FIG. 2 illustrates the second state in which the display device (DR, DL) is rotated from the first state to be positioned above the user's head.

[0071] According to various embodiments, and not limited to the illustrated example, the rotation frame (M) may be positioned at various locations. Accordingly, a state other than the first state in which the rotation frame (M) is positioned in front of the user may be referred to as a second state. For example, the rotation frame (M) of the wearable device (1) may be formed in a structure that is connected / detached to the mounting frame (H) of the wearable device (1). Accordingly, the wearable device (1) may include a first state in which the rotation frame (M) is directly or indirectly connected to the mounting frame (H) and positioned in front of the user, and a second state in which the rotation frame (M) is directly or indirectly separated from the mounting frame (H) and positioned at a location other than in front of the user.

[0072] Referring to FIGS. 2 and 3, a wearable device (1) according to one embodiment of the present disclosure can provide visual information to a user through a display device (DR, DL) and provide auditory information to a user through a pair of ear cups (101, 102) by changing from the second state to the first state.

[0073] According to one embodiment of the present disclosure, a wearable device (1) may include a mounting frame (H) that connects a pair of ear cups (101, 102) to each other. When a user wears the wearable device (1), the mounting frame (H) may be mounted on the user's head. The mounting frame (H) may be referred to as a connecting member or a head band. Referring to FIG. 2, a right connection portion (301) and a left connection portion (not shown) may extend along the mounting frame (H), for example, a right connection portion (301) and a left connection portion (302) may extend along an outer side of the mounting frame (H).

[0074] The description of the right ear cup (101), the right rotational part (201), the right connection part (301), and the coupling relationship therebetween described below can be substantially equally applied to the left ear cup (102), the left rotational part (202), the left connection part (not shown), and the coupling relationship therebetween, to the extent that they are not mutually arranged.

[0075] Referring to FIGS. 2 and 3, at least one sensor according to one embodiment (e.g., at least one sensor (460) of FIG. 4) may be disposed on the rotation frame (M). In addition, for example, at least one sensor may be disposed on at least one of the right rotation part (201) or the left rotation part (202). However, the present invention is not limited thereto. In one example, at least one sensor may be disposed on the rotation frame (M) and an ear cup (e.g., at least one of the right ear cup (101) or the left ear cup (102).

[0076] According to one embodiment, the wearable device (1) can determine the state of the rotation frame (M) through at least one sensor (not shown). For example, the wearable device (1) can sense, through at least one sensor (not shown), whether the rotation frame (M) is in a first state located at a first position adjacent to the user's eyes, or in a second state located at a second position (e.g., above the head) that is not adjacent to the user's eyes.

[0077]

[0078] FIG. 4 is a block diagram of a wearable device according to various embodiments.

[0079] The configuration of FIG. 4 may be referenced by configurations of other drawings to the extent that they are not mutually superimposed. The same terminology and / or the same reference numerals are used for configurations that are identical or substantially identical to those of other drawings.

[0080] Referring to FIG. 4, the wearable device (1) may include a processor (410), at least one display (420) (hereinafter, referred to as a display (420) for convenience), a memory (430), a communication circuit (440), at least one speaker (450) (hereinafter, referred to as a speaker (450) for convenience), at least one sensor (460) (hereinafter, referred to as a sensor (460) for convenience), and at least one camera (470) (hereinafter, referred to as a camera (470) for convenience). The components listed above may be operatively or electrically connected to each other. The components of the wearable device (1) illustrated in FIG. 4 may be partially modified, deleted, or added, as an example.

[0081] According to various embodiments, the wearable device (1) may include a processor (410). In various embodiments, the processor (410) may execute software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of the wearable device (1) connected to the processor (410) and perform various data processing or calculations. According to various embodiments, as at least a part of the data processing or calculations, the processor (410) may store a command or data received from another component (e.g., a communication circuit (440)) in a volatile memory, process the command or data stored in the volatile memory, and store the resulting data in a non-volatile memory. According to various embodiments, the processor (410) may include a main processor (e.g., a central processing unit) or an auxiliary processor (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if a wearable device (1) includes a main processor and a secondary processor, the secondary processor may be configured to use less power than the main processor or to be specialized for a specific function. The secondary processor may be implemented separately from the main processor or as part of the main processor.

[0082] The auxiliary processor may control at least a part of functions or states related to at least one component (e.g., the display (420) or the communication circuit (440)) of the wearable device (1), for example, on behalf of the main processor while the main processor is in an inactive (e.g., sleep) state, or together with the main processor while the main processor is in an active (e.g., application execution) state. According to various embodiments, the auxiliary processor (e.g., the communication processor) may be implemented as a part of another functionally related component (e.g., the communication circuit (440)). According to various embodiments, the auxiliary processor (e.g., the neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. Such learning may be performed, for example, in the wearable device (1) itself on which artificial intelligence is performed, or may be performed through a separate server.

[0083] According to various embodiments, the processor (410) may execute operations or data processing related to control and / or communication of at least one other component of the wearable device (1) using instructions stored in the memory (430). According to one embodiment, the processor (410) may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), a micro controller unit (MCU), a sensor hub, a supplementary processor, a communication processor, an application processor, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or a neural processing unit (NPU), and may have multiple cores.

[0084] According to various embodiments, the wearable device (1) may include a display (420). The display (420) may visually provide information to an external device (e.g., a user) of the wearable device (1). According to various embodiments, the display (420) may display various contents (e.g., text, images, videos, icons, and / or symbols). According to various embodiments, the display (420) may include a liquid crystal display (LCD), a light emitting diode (LED) display, or an organic light emitting diode (OLED) display. According to various embodiments, the display (420) may be configured with various displays (420) that allow image light to be emitted to the user's pupil through a lens unit. For example, the display (420) may include various displays such as a laser display, an LCOS display, and an LED display. The structure of the lens unit may vary depending on the type of the display (420) of the wearable device (1).

[0085]

[0086] According to various embodiments, the wearable device (1) may include a memory (430). According to various embodiments, the memory (430) may store various data used by at least one component (e.g., processor (410)) of the wearable device (1). The data may include, for example, software (e.g., program) and input data or output data for commands related thereto. The memory (430) may include volatile memory or non-volatile memory.

[0087] According to various embodiments, the program may be stored as software in the memory (430) and may include, for example, an operating system, middleware, or an application. According to various embodiments, the memory (430) may store instructions that cause the processor (410) to process data or control components of the wearable device (1) to perform operations of the wearable device (1) when executed. The instructions may include code generated by a compiler or code that can be executed by an interpreter.

[0088] According to various embodiments, the memory (430) may store various information acquired through the processor (410). For example, the memory (430) may store setting information for controlling components of the wearable device (1). Accordingly, the processor (410) may control components of the wearable device (1) so that the wearable device (1) can operate based on the setting information stored in the memory (430).

[0089] According to various embodiments, the wearable device (1) may include a communication circuit (440). The communication circuit (440) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the wearable device (1) and an external device (2), a speaker (3), or a server (not shown) and performing communication through the established communication channel. The communication circuit (440) may operate independently from the processor (410) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication circuit (130) may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device via a first network (e.g., a short-range communication network such as Bluetooth, WiFi Direct (wireless fidelity direct), or IrDA (infrared data association)) or a second network (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network or a wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).

[0090] According to various embodiments, the wearable device (1) may include a speaker (450). For example, the wearable device (1) may be configured to have the speaker (450) built into a pair of ear cups (101, 102) configured to output sound. According to one embodiment, auditory information may be provided to a user through the pair of ear cups (101, 102). According to various embodiments, the wearable device (1) may control the output mode of the speaker (450). For example, the wearable device (1) may control the speaker (450) to output sound according to various sound modes such as mono sound, stereo sound, spatial sound, surround sound, 3D sound, stereoscopic sound, live sound, and dynamic sound when outputting media data.

[0091] According to various embodiments, the wearable device (1) may include a sensor (460). In one embodiment, the wearable device (1) may obtain information regarding the rotation of the rotation frame (M) using the sensor (460). For example, the wearable device (1) may obtain information regarding the rotation of at least a portion of the rotation frame (M) with respect to the ear cup using the sensor (460).

[0092] According to one embodiment, at least one sensor (460) may include, but is not limited to, a position sensor, a gesture sensor, a gyro sensor, a pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0093] According to one embodiment, the position sensor may include at least one of a Hall sensor, a tunnel magnetoresistance (TMR) sensor, an anisotropic magneto-resistance (AMR) sensor, or a giant magneto-resistance (GMR) sensor, but is not limited thereto.

[0094] According to various embodiments, the wearable device (1) may include a camera (470). For example, the wearable device (1) may include a plurality of cameras arranged correspondingly within the user's body. For example, at least one camera (470) may be arranged in the rotating frame (M). For example, the wearable device (1) may include a camera (or image sensor) (470) for photographing an external environment (e.g., front, side, rear).

[0095] According to various embodiments, the camera (470) may include components for photographing. For example, the camera (470) may include a lens assembly, an image sensor, memory, and / or an image signal processor.

[0096] According to various embodiments, the wearable device (1) may include various devices without being limited to the components described above. For example, the wearable device (1) may include an input device implemented to obtain predetermined information from the outside of the wearable device (1). For example, the input device may include a touch sensor and a physical key for receiving a user's physical input (e.g., touch) to the wearable device (1). For example, the input device may include a microphone for obtaining external sounds (e.g., the user's speech, sounds of the surrounding environment). In addition, the input device may include a camera (470) configured to capture an external environment and obtain a user's gesture input.

[0097] According to various embodiments, the wearable device (1) may include a connection terminal (not shown). The connection terminal may include a connector through which the wearable device (1) can be physically connected to an external electronic device (e.g., an external device (2) of FIG. 1, a speaker (3) of FIG. 1).

[0098] According to various embodiments, the wearable device (1) may cause the speaker (450) (e.g., the speaker (3)) to output an acoustic signal acquired from an external device (2) as a spatial acoustic signal. For example, the wearable device (1) may acquire spatial information about a virtual space for generating spatial sound, and output a screen for setting a virtual speaker within the virtual space through the display (420). In one embodiment, the wearable device (1) may acquire acoustic setting information based on a user input for the screen for setting the virtual speaker, and generate spatial sound based on the acoustic setting information. For example, the wearable device (1) may convert the acquired acoustic signal into a spatial acoustic signal based on the acoustic setting information, and provide the spatial sound to the user.

[0099] According to various embodiments, the wearable device (1) can adaptively provide the spatial audio signal to the user depending on the state of the rotation frame (M) of the wearable device (1). For example, the wearable device (1) can obtain media data including at least one of an audio signal or a video signal, and output the media data through a speaker (450) (e.g., speaker (3) of FIG. 1).

[0100] At this time, the wearable device (1) can identify a change in the state of the rotation frame (M) through the sensor (460) and change the output mode of the media data according to the change in the state of the rotation frame (M). For example, it can change from the first output mode, which is a general output mode, to the second output mode, which is a spatial audio output mode. According to one embodiment, as the output mode of the wearable device (1) changes, the speaker (450) can output the media data in the changed output mode.

[0101] According to various embodiments, the wearable device (1) acquires sound setting information for setting spatial sound and adaptively changes the output mode according to a change in the state of the wearable device (1) is described in detail below with reference to FIGS. 5 to 18.

[0102]

[0103] FIG. 5 is a flowchart illustrating an operation of a wearable device generating a spatial sound signal according to various embodiments.

[0104] FIG. 6 is a flowchart illustrating an operation of a wearable device outputting a screen for setting up a virtual speaker according to various embodiments.

[0105] FIG. 7 is a drawing for explaining a first user interface of spatial sound settings displayed on a display according to various embodiments.

[0106] Each of the operations described below may be performed in combination with one another. In addition, among the operations described below, the operations performed by the wearable device (1) may refer to operations performed by the processor (410) of the wearable device (1).

[0107] In addition, the “information” described below may be interpreted to mean “data” or “signal,” and “data” may be understood as a concept that includes both analog data and digital data.

[0108] According to various embodiments, the operations illustrated in FIGS. 5 and / or 6 may be performed in various orders, not limited to the order illustrated. Furthermore, according to various embodiments, more operations may be performed than those illustrated in FIGS. 5 and / or 6, or at least one operation may be performed less than those illustrated in FIGS.

[0109] Referring to FIG. 5, the wearable device (1) can obtain spatial information about a virtual space for generating spatial sound in operation 501. For example, the wearable device (1) can obtain spatial information for generating spatial sound stored in the memory (430). According to various embodiments, the spatial information can include various spatial information such as pre-configured spatial information, spatial information generated based on a user location, spatial information generated by a user setting, and spatial information obtained through a server (e.g., the server of FIG. 1).

[0110] According to various embodiments, the wearable device (1) may output a first screen for setting a virtual speaker within the virtual space through the display (420) in operation 503. For example, the wearable device (1) may output a virtual space determined based on spatial information and a screen for setting a speaker in the virtual space through the display (420).

[0111] According to various embodiments, a screen for setting a virtual space and a speaker for the virtual space based on the spatial information may be composed of various elements. For example, the wearable device (1) may output a screen including a pre-set virtual space and a virtual speaker to be placed in the virtual space through the display (420). In addition, as an example, the wearable device (1) may obtain spatial information based on generating a virtual space based on a real space in which the user is located, and output a screen including a virtual space based on the real space and a speaker to be placed in the virtual space through the display (420). In addition, as an example, the wearable device (1) may output a screen including a virtual space selected by the user from among a plurality of pre-generated virtual spaces and a speaker to be placed in the virtual space through the display (420).

[0112] Referring to FIG. 6, the wearable device (1) can obtain an image or video through the camera (470) in operation 601. For example, the wearable device (1) can obtain an image or video through the camera (470) to obtain a virtual space based on the real space in which the user is located.

[0113] According to one embodiment, the wearable device (1) can generate the first screen based on an image frame acquired based on the image or video in operation 603. For example, the wearable device (1) can acquire an image frame of a real space where the user is located through a camera (470), and generate a virtual space based thereon to generate the first screen.

[0114] According to one embodiment, the wearable device (1) can output the first screen including a virtual space based on a real space generated through an image frame through the display (420) in operation 605 and a speaker to be placed in the virtual space through the display (420).

[0115] According to various embodiments, the wearable device (1) can acquire spatial information based on the real space through various methods. For example, the wearable device (1) can acquire user location information through at least one sensor (e.g., sensor (460)) and generate spatial information based thereon. For example, the wearable device (1) can acquire information about the user's current location (place) through a location sensor and generate spatial information based thereon.

[0116] According to various embodiments, the wearable device (1) may obtain speaker setting information based on a user input to the first screen in operation 505.

[0117] According to one embodiment, referring to FIG. 7, a wearable device (1) can output a first screen (701) including a virtual space (A) displayed based on spatial information and a virtual speaker (721) to be placed in the virtual space (A) through a display (420).

[0118] According to one embodiment, the wearable device (1) can obtain speaker setting information by obtaining user input for the first screen (701). For example, the wearable device (1) can obtain speaker setting information based on user input for the virtual space (A), user input for the virtual speaker (721), and / or user input for an interface (722) that allows selection of the type of speaker (711).

[0119] For example, the wearable device (1) can obtain the user inputs through various input devices. For example, the wearable device (1) can obtain user inputs through a touch sensor and a physical key for receiving a user's physical input (e.g., touch), a microphone for obtaining external sounds (e.g., the user's speech, sounds of the surrounding environment), and a camera (470) configured to capture the external environment and obtain the user's gesture input.

[0120] According to various embodiments, a user may generate a desired spatial sound through input to a virtual space (A), input to a virtual speaker (721) for the virtual space (A), and input to a speaker type selection interface (722). For example, the wearable device (1) may obtain speaker setting information based on the user inputs, such as input to at least one of the position, number, type, or sound volume of at least one virtual speaker (721) in the virtual space (A). For convenience of explanation, one virtual speaker (721) is shown in FIG. 7, but the present invention is not limited thereto, and a plurality of virtual speakers of various types may be output through the first screen (701).

[0121] According to various embodiments, the wearable device (1) can obtain sound setting information based on the spatial information and the speaker setting information in operation 507.

[0122] For example, the wearable device (1) may generate sound setting information based on spatial information for a virtual space (A) and speaker setting information including at least one of the number, type, and position of speakers for the virtual space (A) based on a user input for the first screen (701). According to one embodiment, the sound setting information may include setting information that provides an effect similar to hearing sound through speakers arranged based on the number, type, and position of speakers (721) selected by the user in the virtual space (A) according to the user input.

[0123] According to various embodiments, the wearable device (1) may, in operation 509, obtain a spatial sound signal by converting an acoustic signal into spatial sound based on acoustic setting information. According to one embodiment, the wearable device (1) may obtain a spatial sound signal by converting an acquired original acoustic signal into spatial sound based on the acoustic setting information acquired according to a user input. For example, the wearable device (1) may generate a spatial sound signal by converting an original acoustic signal acquired from an external device (2) into spatial sound based on the acoustic setting information.

[0124] According to various embodiments, the wearable device (1) may transmit the spatial sound signal so that at least one speaker (450) (e.g., speaker (3) of FIG. 1) may output the spatial sound signal in operation 511. For example, the wearable device (1) may output the spatial sound signal through the speaker (450). Accordingly, the user may listen to sound based on sound settings more suitable to the user's intention.

[0125] According to various embodiments, the first screen (701) may be displayed by overlapping real light provided from the outside of the user through a lens unit (e.g., the lens unit of FIG. 2). In this case, the real space (A) may be perceived by the user instead of the virtual space (A), and an interface (722) for selecting a virtual speaker (721) and a type (711) of the virtual speaker may be displayed through the display (720) and perceived by the user in the real space (A). For example, while the user perceives an external real space based on external light provided from the outside of the user (e.g., various types of objects, natural objects, real space), image light may be provided to the user at the same time, and the user may perceive an interface (722) for selecting a type (711) of the virtual speaker, which is digital content (i.e., augmented reality content) based on the image light. At this time, the external real space may be perceived as external light passing through the wearable device (1) and being provided to the user, and / or as an image acquired by the wearable device (1) based on the external light is provided to the user.

[0126]

[0127] FIG. 8 is a flowchart illustrating an operation of a wearable device outputting a screen for setting up a virtual speaker according to various embodiments.

[0128] FIG. 9 is a diagram illustrating a second user interface (Usert Interface) of spatial sound settings displayed on a display according to various embodiments.

[0129] FIG. 10 is a diagram illustrating a third user interface (Usert Interface) of spatial sound settings displayed on a display according to various embodiments.

[0130] Each of the operations described below may be performed in combination with one another. In addition, among the operations described below, the operations performed by the wearable device (1) may refer to operations performed by the processor (410) of the wearable device (1).

[0131] According to various embodiments, the operations illustrated in FIG. 8 may be performed in various orders, not limited to the order illustrated. Furthermore, according to various embodiments, more operations may be performed than those illustrated in FIG. 8, or at least one operation may be performed less than those illustrated in FIG.

[0132] According to various embodiments, the wearable device (1) can obtain spatial information about a virtual space for generating spatial sound. For example, the wearable device (1) can obtain spatial information for generating spatial sound stored in the memory (430). According to various embodiments, the spatial information can include various spatial information such as pre-configured spatial information, spatial information generated based on a user's location, spatial information generated by a user setting, and spatial information obtained through a server (e.g., the server of FIG. 1).

[0133] According to various embodiments, a screen for setting a virtual space and a speaker for the virtual space based on the spatial information may be composed of various elements. For example, the wearable device (1) may output a screen including a pre-set virtual space and a virtual speaker to be placed in the virtual space through the display (420). In addition, as an example, the wearable device (1) may obtain spatial information based on generating a virtual space based on a real space in which the user is located, and output a screen including a virtual space based on the real space and a speaker to be placed in the virtual space through the display (420). In addition, as an example, the wearable device (1) may output a screen including a virtual space selected by the user from among a plurality of pre-generated virtual spaces and a speaker to be placed in the virtual space through the display (420).

[0134] Referring to FIG. 8, the wearable device (1) can output an interface for obtaining spatial information through the display (420) in operation 801.

[0135] According to various embodiments, the wearable device (1) may obtain spatial information through user input to the interface in operation 803. For example, the wearable device (1) may create a virtual space based on the user input and obtain spatial information through the virtual space.

[0136] Referring to FIG. 9, the wearable device (1) may output a user interface to generate a virtual space based on user input. For example, the wearable device (1) may include a user interface (903) for a virtual space (A) to be generated through the display (420), a space configuration interface (901) related to setting the virtual space (A), and a space type interface (902). However, the present invention is not limited to the illustrated example, and various user interfaces for setting a virtual space for generating spatial sound may be displayed through the display (420).

[0137] According to various embodiments, the wearable device (1) can create a virtual space based on the spatial information in operation 805.

[0138] According to various embodiments, the wearable device (1) can generate a virtual space based on user input obtained through a user interface (903) for the virtual space (A), a space configuration interface (901) related to setting the virtual space (A), and a space type interface (902). For example, if the wearable device (1) selects “A Opera House” in the space type interface (902), selects “Indoor” in the space configuration interface (901), and obtains a user input for inputting “ceiling height” as 3 m, the wearable device (1) can generate a virtual space (A) in which the ceiling height is changed to 3 m in the virtual space of the pre-set A Opera House. The wearable device (1) can generate and store information about the virtual space (A) as space information.

[0139] At this time, the wearable device (1) can obtain the user inputs through various input devices. For example, the wearable device (1) can obtain user inputs through a touch sensor and a physical key for receiving a user's physical input (e.g., touch), a microphone for obtaining external sounds (e.g., the user's speech, sounds of the surrounding environment), and a camera (470) configured to capture the external environment and obtain the user's gesture input.

[0140] According to various embodiments, the wearable device (1) may display a virtual space through the display (420) in operation 807. For example, the wearable device (1) may display a virtual space (A) generated based on a user input through the display (420).

[0141] According to various embodiments, the wearable device (1) may obtain speaker setting information for a virtual space obtained with reference to FIG. 8. For example, the wearable device (1) may obtain speaker setting information based on a user input for a virtual space (A) displayed based on spatial information for the generated virtual space and at least one virtual speaker to be placed in the virtual space (A).

[0142] Referring to FIG. 10, it is illustrated that a wearable device (1) obtains speaker setting information by outputting a user interface through a display (420). For example, the wearable device (1) can obtain speaker setting information by outputting a screen (1000) for virtual speaker setting through the display (420).

[0143] According to one embodiment, the wearable device (1) can output a first-stage screen (1001) through the display (420). The first-stage screen (1001) can include a generated virtual space (A) and a user interface (1011) for placing at least one virtual speaker in at least a part of the virtual space. According to one embodiment, the user can determine a location for placing at least one virtual speaker in the virtual space (A) through an input for moving the user interface (1011) in the virtual space (A). According to one embodiment, the wearable device (1) can control an output so that the user interface (1011) adaptively changes its location in the virtual space (A) according to the user input.

[0144] According to one embodiment, the wearable device (1) can output a two-step screen (1002) through the display (420). The two-step screen (1002) can include a virtual speaker (1022) to be placed at a location within the virtual space (A) determined through the user interface (1011) and an interface (1021) for determining the type of the virtual speaker (1022). The wearable device (1) can obtain speaker setting information based on a user input to the interface (1021) for determining the virtual speaker (1022) to be placed at a location within the virtual space (A) determined through the user interface (1011) and the type of the virtual speaker (1022).

[0145] According to one embodiment, the wearable device (1) can obtain a user input for placing a plurality of virtual speakers in a virtual space (A). That is, the wearable device (1) can place a plurality of virtual speakers in the virtual space (A) by repeatedly outputting a first-stage screen (1001) and a second-stage screen (1002) through the display (420) to obtain a plurality of user inputs. Accordingly, the wearable device (1) can output a third-stage screen (1003) in which a plurality of virtual speakers (1031, 1032, 1033, 1034) are placed in the virtual space (A) through the display (420). The wearable device (1) can generate speaker setting information based on the placement of the plurality of virtual speakers (1031, 1032, 1033, 1034) in the virtual space (A) displayed on the third-stage screen (1003). For example, the wearable device (1) can obtain speaker setting information based on at least one of the positions, numbers, types, or sound volumes of a plurality of virtual speakers (1031, 1032, 1033, 1034) within the virtual space (A). The wearable device (1) is not limited to the illustrated example and can obtain user input for arranging a plurality of virtual speakers in the virtual space and generate speaker setting information based thereon.

[0146] According to various embodiments, the wearable device (1) may obtain sound setting information based on the spatial information and the speaker setting information. For example, the wearable device (1) may generate sound setting information based on spatial information for a virtual space (A) corresponding to a three-step screen (1003) and speaker setting information including at least one of the number, type, and position of speakers for the virtual space (A). According to one embodiment, the sound setting information may include setting information that provides an effect similar to listening to sound through speakers arranged based on the number, type, and position of a plurality of virtual speakers (1031, 1032, 1033, 1034) selected by the user in the virtual space (A) according to a user input.

[0147] According to various embodiments, the wearable device (1) can obtain a spatial sound signal by converting an acoustic signal into spatial sound based on acoustic setting information. According to one embodiment, the wearable device (1) can obtain a spatial sound signal by converting an acquired original acoustic signal into spatial sound based on the acoustic setting information acquired according to a user input. For example, the wearable device (1) can generate a spatial sound signal by converting an original acoustic signal acquired from an external device (2) into spatial sound based on the acoustic setting information.

[0148] According to various embodiments, the wearable device (1) can set not only the arrangement of a plurality of virtual speakers (1031, 1032, 1033, 1034) for the virtual space (A), but also the virtual location of the user in the virtual space (A). For example, the wearable device (1) can obtain a user input for determining the virtual location of the user in the virtual space (A) in a three-step screen (1003). The wearable device (1) can obtain the user's location setting information for the virtual space (A) based on the user input.

[0149] According to one embodiment, the wearable device (1) can obtain the spatial sound signal converted into the spatial sound based on the position setting information, the spatial information, and the speaker setting information. For example, the wearable device (1) can generate sound setting information based on spatial information for a virtual space (A) corresponding to a three-step screen (1003), speaker setting information including at least one of the number, type, and position of speakers for the virtual space (A), and the user's position setting information for the virtual space (A). According to one embodiment, the sound setting information can include setting information that provides an effect similar to hearing sound at a virtual position of the user within the virtual space (A) selected by the user through speakers arranged based on the number, type, and position of a plurality of virtual speakers (1031, 1032, 1033, 1034) selected by the user in the virtual space (A) according to a user input.

[0150] According to various embodiments, the wearable device (1) may output a sample sound of a sound that will change according to a user input through a speaker (450) (e.g., speaker (3)) so that the user can help determine the input. For example, the wearable device (1) may output a sample sound through the speaker (450) (e.g., speaker (3)) so that the user can check and make a user input how the sound will change according to the setting of the virtual space (A), how the sound will change according to the number, type, and position of virtual speakers (e.g., multiple virtual speakers (1031, 1032, 1033, 1034)) of the virtual space (A), and how the sound will change according to the virtual position of the user within the virtual space (A).

[0151]

[0152] FIG. 11 is a flowchart illustrating an operation of a wearable device according to various embodiments to update sound setting information according to a change in the user's position in a virtual space.

[0153] FIG. 12 is a diagram for explaining changes in spatial sound output according to changes in a user's position in a virtual space, according to various embodiments.

[0154] Each of the operations described below may be performed in combination with one another. In addition, among the operations described below, the operations performed by the wearable device (1) may refer to operations performed by the processor (410) of the wearable device (1).

[0155] According to various embodiments, the operations illustrated in FIG. 11 may be performed in various orders, not limited to the order illustrated. Furthermore, according to various embodiments, more operations may be performed than those illustrated in FIG. 11, or at least one operation may be performed less than those illustrated in FIG.

[0156] Referring to FIG. 11, the wearable device (1) can acquire a first location of a user through at least one sensor (e.g., sensor (460) of FIG. 4) in operation 1101. For example, the wearable device (1) can acquire a location of a virtual user within a set virtual space. According to one embodiment, the first location of the user can include a location determined by projecting the user's location in reality onto the virtual space.

[0157] According to various embodiments, the wearable device (1) may determine, in operation 1103, whether the position of the virtual user in the virtual space has changed to a second position. For example, the wearable device (1) may determine whether the position of the virtual user set within the virtual space has changed to a second position. According to one embodiment, the second position of the user may include a position determined by projecting a change in the position of the user in reality onto the virtual space.

[0158] According to various embodiments, the wearable device (1) may update sound setting information based on the second location and the speaker setting information in operation 1105. For example, the sound setting information may be updated to reflect an acoustic difference that occurs due to a change in the distance between at least one virtual speaker in the virtual space and the virtual user as the location of the virtual user in the virtual space changes.

[0159] Referring to FIG. 12, a wearable device (1) can output a screen (1200) in which a virtual space (A) and a plurality of virtual speakers (1201, 1202) are arranged through a display (420). At this time, the screen (1200) can include a visual object for a virtual user that can indicate the user's location within the virtual space (A).

[0160] According to various embodiments, the wearable device (1) may acquire a first location (1211) of a virtual user within a set virtual space (A) based on a location of the user acquired through at least one sensor (460). According to one embodiment, the first location (1211) of the user may include a location determined by projecting the location of the user in reality onto the virtual space.

[0161] According to various embodiments, the wearable device (1) can determine whether the position of the virtual user in the virtual space (A) has changed to a second position (1212). For example, the wearable device (1) can determine whether the position of the virtual user set within the virtual space has changed to the second position. According to one embodiment, the second position of the user may include a position determined by projecting the change in the position of the user in reality onto the virtual space.

[0162] According to various embodiments, the wearable device (1) may update sound setting information based on the second location (1212) and the speaker setting information. For example, as the location of the virtual user in the virtual space (A) changes (1210), the sound setting information may be updated to reflect the sound difference caused by the change in the distance between the virtual user and multiple virtual speakers (1201, 1202) in the virtual space.

[0163] According to various embodiments, the wearable device (1) can provide a service that allows the user to set various sound settings according to changes in the position of the virtual user, in addition to setting the position, type, and number of virtual space (A) and multiple speakers (1201, 1202) through the screen (1200).

[0164] According to various embodiments, the wearable device (1) can provide a service that allows the user to listen to more realistic sounds by not only setting the location, type, and number of a virtual space (A) and multiple speakers (1201, 1202) through the screen (1200), but also adaptively changing the output sound according to changes in the location of the virtual user within the virtual space (A).

[0165]

[0166] FIG. 13 is a flowchart illustrating providing spatial sound in a spatial sound providing system according to various embodiments.

[0167] Each of the operations described below may be performed in combination with one another. In addition, among the operations described below, the operations performed by the wearable device (1) may refer to operations performed by the processor (410) of the wearable device (1).

[0168] According to various embodiments, the operations illustrated in FIG. 13 may be performed in various orders, not limited to the order illustrated. Furthermore, according to various embodiments, more operations may be performed than those illustrated in FIG. 13, or at least one operation may be performed less than those illustrated in FIG.

[0169] According to various embodiments, some of the wearable device (1), the external device (2), and the speaker (3) may be implemented as a single device. For example, the wearable device (1) may be implemented as a single device with the speaker (3), such that the speaker (3) is included in the wearable device (1). In this case, data transmission between devices implemented as a single device may be omitted.

[0170] Referring to FIG. 13, the operation between a wearable device (1), an external device (2), and a speaker (3) to provide spatial sound to a user is illustrated.

[0171] According to various embodiments, the wearable device (1) may be driven in operation 1301. The driving may mean that the wearable device (1) is powered ON by a user's input. In one embodiment, the wearable device (1) is not limited to the user input, and may be driven when the wearable device (1) is worn on at least a part of the user's body. In one embodiment, the wearable device (1) may be driven through the control of an external device (2).

[0172] According to various embodiments, the wearable device (1) can generate sound setting information in operation 1302. According to various embodiments, the generation of the sound setting information can be performed through the operation of the wearable device (1) described with reference to FIGS. 2 to 12.

[0173] According to various embodiments, the wearable device (1) can transmit the sound setting information generated in operation 1303 to an external device (2). In operation 1304, the wearable device (1) and the external device (2) can store the sound setting information.

[0174] According to various embodiments, the external device (2) may receive a media data output signal in operation 1305. For example, the external device (2) may receive an output signal for media data that needs to be provided to a user. In one embodiment, the media data may include various contents such as video, audio, music, images, animation, text, interactive media, and live broadcasting. Accordingly, the media data may include an audio signal and / or a video signal.

[0175] According to various embodiments, the external device (2) may transmit the media data to the wearable device (1) in operation 1306. For example, the wearable device (1) may obtain the media data from the external device (2) through the communication circuit (440). For example, the wearable device (1) may obtain an audio signal from the external device (2) through the communication circuit (440).

[0176] According to various embodiments, the wearable device (1) may convert the acoustic signal in operation 1307. For example, the wearable device (1) may generate an acoustic signal by converting an acoustic signal (or media data) acquired based on the acoustic setting information based on the acoustic setting information. At this time, the converted acoustic signal may include a spatial acoustic signal.

[0177] According to various embodiments, in operation 1309, the wearable device (1) may transmit the converted acoustic signal. For example, the wearable device (1) may transmit the converted acoustic signal to an external device (2) so that the external device (2) can output the converted acoustic signal. For example, the wearable device (1) may transmit the converted acoustic signal to a speaker (3) so that the speaker (3) can output the converted acoustic signal.

[0178] According to various embodiments, the converted audio signal may be output in operation 1310. For example, the external device (2) may output the converted audio signal in operation 1310. For example, the speaker (3) may output the converted audio signal in operation 1310.

[0179]

[0180] FIG. 14 is a flowchart illustrating an operation of a wearable device according to various embodiments to change an output mode depending on the position of a rotation frame.

[0181] Each of the operations described below may be performed in combination with one another. In addition, among the operations described below, the operations performed by the wearable device (1) may refer to operations performed by the processor (410) of the wearable device (1).

[0182] According to various embodiments, the operations illustrated in FIG. 14 may be performed in various orders, not limited to the order illustrated. Furthermore, according to various embodiments, more operations may be performed than those illustrated in FIG. 14, or at least one operation may be performed less than those illustrated in FIG.

[0183] Referring to FIG. 14, in operation 1401, a wearable device (1) may obtain media data. For example, the wearable device (1) may obtain media data stored in a memory (430). For example, the wearable device (1) may obtain the media data by obtaining an output request for media data from an external device (2). According to one embodiment, the media data may include various contents such as video, audio, music, images, animation, text, interactive media, and live broadcasting. Accordingly, the media data may include an audio signal and / or a video signal.

[0184] According to various embodiments, the wearable device (1) may control at least one speaker (450) (e.g., speaker (3) of FIG. 1) to output media data in a first output mode in operation 1403. For example, the wearable device (1) may control the speaker (450) and / or the display (420) to output the media data in a first output mode that outputs the media data as it is acquired. For example, the wearable device (1) may control the speaker (450) and / or the display (420) to output the media data in the first output mode according to an initial setting mode.

[0185] According to various embodiments, the wearable device (1) may determine, in operation 1405, whether the rotation frame (M) is positioned at a first position in front of the user's eyes. However, the present invention is not limited thereto, and the wearable device (1) may determine whether the rotation frame (M) is positioned at a first position adjacent to the user's eyes. For example, the wearable device (1) may determine, through the sensor (460), whether the rotation frame (M) has changed from a second state to a first state.

[0186] According to various embodiments, the wearable device (1) can control at least one speaker to output media data by changing from a first output mode to a second output mode based on the position change in operation 1407.

[0187] According to one embodiment, the wearable device (1) can control the speaker (450) to output the media data in a second output mode, which is spatial sound, from a first output mode as the rotation frame (M) changes to a first state. For example, the wearable device (1) can obtain sound setting information through the operations described through FIGS. 2 to 13, and output the media data in a second output mode that outputs the media data based on the sound setting information as the rotation frame (M) changes from the second state to the first state.

[0188] According to various embodiments, the wearable device (1) can activate a display (420) coupled to the rotation frame (M) as the rotation frame (M) changes from a second state to a first state, and output a screen for media data through the display (420). The screen for media data can include a screen that is determined and output according to the type of media data.

[0189] According to various embodiments, the wearable device (1) may output the media data through the speaker (450) and the display (420) when the media data includes both an audio signal and an image signal. For example, when the rotation frame (M) is in the second state, the wearable device (1) operates in the first output mode to output only the original audio signal, and when the rotation frame (M) is changed to the first state, the wearable device (1) may operate in the second output mode to output the image signal of the media data through the display (420) and output an audio signal converted from the audio signal according to the audio setting information through the speaker (450).

[0190]

[0191] FIG. 15 is a flowchart illustrating an operation of a wearable device according to various embodiments to update an output mode of music output according to a change in the position of a rotation frame.

[0192] FIG. 16 is a diagram for explaining providing empathetic sound according to a change in the state of a wearable device according to various embodiments.

[0193] Each of the operations described below may be performed in combination with one another. In addition, among the operations described below, the operations performed by the wearable device (1) may refer to operations performed by the processor (410) of the wearable device (1).

[0194] According to various embodiments, the operations illustrated in FIG. 15 may be performed in various orders, not limited to the order illustrated. Furthermore, according to various embodiments, more operations may be performed than those illustrated in FIG. 15, or at least one operation may be performed less than those illustrated in FIG.

[0195]

[0196] Referring to FIG. 15, the wearable device (1) can identify, in operation 1501, that the rotation frame (M) has moved from a second position to a first position. For example, the wearable device (1) can identify, through at least one sensor (460), whether the rotation frame (M) has moved from a second position (e.g., head) that is not adjacent to the user's eyes to a first position that is adjacent to the user's eyes.

[0197] Referring to FIG. 16, for example, the wearable device (1) can determine whether the rotation frame (M) has changed from the first stage (1610) in which the rotation frame (M) is in the second state to the second stage (1620) in which the rotation frame (M) is in the first state. For example, the wearable device (1) can determine whether the rotation frame (M) has changed from the second stage (1620) in which the rotation frame (M) is in the first state while outputting an audio signal (1611) in the first output mode by acquiring media data in the first stage (1610).

[0198] According to various embodiments, the wearable device (1) may activate the display (420) in operation 1503. For example, the wearable device (1) may activate the display (420) to output a screen when the display (420) coupled to the rotating frame (M) is positioned at a first position adjacent to the user's eyes.

[0199] According to various embodiments, the wearable device (1) may output a screen for media data through the display (420) in operation 1505. For example, in step 2 (1620), the wearable device (1) may output a screen (1622) for media data through the display (420). According to one embodiment, as the rotation frame (M) is changed to the first state, the wearable device (1) may convert the sound output to the speaker (450) into spatial sound (1621) of the second output mode described with reference to FIG. 14 and output it.

[0200] According to various embodiments, the wearable device (1) can identify, in operation 1507, that the rotation frame (M) has moved from a first position to a second position. For example, it can be determined whether the rotation frame (M) has changed from a first state to a second state in step 3 (1630).

[0201] According to various embodiments, the wearable device (1) may deactivate the display (420) at operation 1509. For example, the wearable device (1) may deactivate the display (420) at step 3 (1630) when the display (420) is positioned at a location that is not adjacent to the user's eyes (e.g., above the user's head).

[0202] According to various embodiments, the wearable device (1) may update the output mode in operation 1511. For example, the wearable device (1) may identify that, while outputting an audio signal of media data in a second output mode, spatial sound (1621), through the speaker (450) in a second step (1620) in which the rotation frame (M) is in a first state, the rotation frame (M) changes to a second state and a third step (1630) occurs. At this time, the wearable device (1) may update the output mode to output the audio signal (1631) of the media data. For example, the wearable device (1) may output a first output mode, general sound (1631), through the speaker (450) in spatial sound (1621). However, without being limited to the described examples, the wearable device (1) may include various output modes and may adaptively change the output mode according to a change in the position (i.e., a change in state) of the rotation frame (M). For example, the wearable device (1) may update the output mode of the speaker (450) based on the type of media data according to a change in the position of the rotation frame (M).

[0203]

[0204] FIG. 17 is a flowchart illustrating an operation of a wearable device according to various embodiments to update an output mode of a video output according to a change in the position of a rotation frame.

[0205] FIG. 18 is a drawing for explaining providing video content in conjunction with an external device according to a change in the state of a wearable device according to various embodiments.

[0206] Each of the operations described below may be performed in combination with one another. In addition, among the operations described below, the operations performed by the wearable device (1) may refer to operations performed by the processor (410) of the wearable device (1).

[0207] According to various embodiments, the operations illustrated in FIG. 17 may be performed in various orders, not limited to the order illustrated. Furthermore, according to various embodiments, more operations may be performed than those illustrated in FIG. 17, or at least one operation may be performed less than those illustrated in FIG.

[0208] Referring to FIG. 17, the wearable device (1) can identify, in operation 1701, that the rotation frame (M) has moved from a second position to a first position. For example, the wearable device (1) can identify, through at least one sensor (460), whether the rotation frame (M) has moved from a second position (e.g., head) that is not adjacent to the user's eyes to a first position that is adjacent to the user's eyes.

[0209] Referring to FIG. 18, for example, the wearable device (1) can determine whether the rotation frame (M) has changed from the first stage (1810) in which the rotation frame (M) is in the second state to the second stage (1820) in which the rotation frame (M) is in the first state. For example, the wearable device (1) can determine whether the rotation frame (M) has changed from the first stage (1820) in which the rotation frame (M) is in the first state while the external device (2) is in a state (1811) in which the video signal of the media data is output and the audio signal (1812) of the media data is output in the first output mode upon acquiring the media data from the external device (2).

[0210] According to various embodiments, the wearable device (1) may activate the display (420) in operation 1703. For example, the wearable device (1) may activate the display (420) to output a screen when the display (420) coupled to the rotating frame (M) is positioned at a first position adjacent to the user's eyes.

[0211] According to various embodiments, the wearable device (1) may output media data through at least one speaker (450) and a display (420) in operation 1705. For example, if the media data is a video, the wearable device (1) may output an audio signal included in the media data through at least one speaker (450) and output an image signal included in the media data through the display (420). For example, in step 2 (1820), the wearable device (1) may output a screen (1823) for an image signal of the media data that was output through the external device (2) through the display (420). According to one embodiment, as the rotation frame (M) is changed to the first state, the wearable device (1) may convert and output the sound output through the speaker (450) into spatial sound (1822) of the second output mode described with reference to FIG. 14.

[0212] Meanwhile, as a screen (1823) for the video signal of the media data is output through the wearable device (1) and spatial sound (1822) of the second output mode is output, the external device (2) may be in a state (1821) of stopping the output of the video signal of the media data.

[0213] According to various embodiments, the wearable device (1) can identify, in operation 1707, that the rotation frame (M) has moved from a first position to a second position. For example, it can be determined whether the rotation frame (M) has changed from a first state to a second state in step 3 (1830).

[0214] According to various embodiments, the wearable device (1) may deactivate the display (420) at operation 1709. For example, the wearable device (1) may deactivate the display (420) at step 3 (1830) when the display (420) is positioned at a location that is not adjacent to the user's eyes (e.g., above the user's head).

[0215] According to various embodiments, the wearable device (1) may update the output mode in operation 1711. For example, the wearable device (1) may output a screen (1823) for a video signal of media data through the display (420) in the second step (1820) in which the rotation frame (M) is in the first state, and output an audio signal of the media data in a second output mode, spatial sound (1822), through the speaker (450), and then may identify that the rotation frame (M) changes to the second state and the third step (1830) occurs. At this time, the wearable device (1) may control the output of the media data by updating the output mode. For example, the wearable device (1) may stop outputting the media data and stop outputting the audio signal of the media data (1832). At this time, the external device (2) may output a screen (1831) including an interface that enables outputting the media data again. In one embodiment, media data may be re-output based on user input on the screen (1831) displayed via an external device (2). In this case, media data may be re-played from the last playback point of the media data being output via the wearable device (1).

[0216] According to one embodiment, the wearable device (1) may output a first output mode, general sound (1832), in spatial sound (1822) through the speaker (450) when it identifies that the rotation frame (M) has changed to the second state and entered the third stage (1830). However, without being limited to the described example, the wearable device (1) may include various output modes and may adaptively change the output mode according to a change in the position (i.e., a change in the state) of the rotation frame (M). For example, the wearable device (1) may update the output mode of the speaker (450) based on the type of media data according to a change in the position of the rotation frame (M).

[0217] As described above, a wearable device according to an embodiment may include a display, a communication circuit for transmitting and receiving an audio signal, at least one processor, and a memory for storing instructions. The instructions may be individually or collectively executed by the at least one processor to cause the wearable device to: obtain spatial information about a virtual space for generating spatial sound, output a first screen for setting virtual speakers in the virtual space through the display, obtain speaker setting information based on a user input for the first screen, obtain audio setting information based on the spatial information and the speaker setting information, obtain a spatial sound signal converted from the audio signal into spatial sound based on the audio setting information, and transmit the spatial sound signal to at least one speaker connected to the wearable device so that the at least one speaker outputs the spatial sound signal.

[0218] According to one embodiment, the first screen may be generated based on image frames acquired through a camera connected to the wearable device.

[0219] In one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to: output an interface for obtaining the spatial information through the display, obtain the spatial information as a user input to the interface, and generate the virtual space based on the spatial information. The first screen may include a screen for the virtual space.

[0220] According to one embodiment, the speaker setting information may include at least one of the position, number, type, or sound volume of at least one virtual speaker within the virtual space obtained based on the user input for the first screen.

[0221] According to one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to: obtain user location setting information for the virtual space based on user input for the first screen, and obtain the spatial sound signal converted into the spatial sound based on the location setting information, the spatial information, and the speaker setting information.

[0222] According to one embodiment, the wearable device may include at least one sensor. The spatial information may be acquired based on the user's location acquired through the at least one sensor.

[0223] In one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to: obtain a first location of the user through the at least one sensor; determine whether a location of the user with respect to the virtual space has changed from the first location to a second location through the at least one sensor; and update the sound setting information based on the second location and the speaker setting information.

[0224] According to one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to obtain the acoustic signal from an external device via the communication circuit.

[0225] In one embodiment, the instructions may be individually or collectively executed by the at least one processor to cause the wearable device to transmit the spatial audio signal to the external device.

[0226] According to one embodiment, the at least one speaker connected to the wearable device may include at least one of at least one speaker included in the wearable device or at least one external speaker device connected to the wearable device via the communication circuit.

[0227] As described above, a method for operating a wearable device according to an embodiment may include an operation of obtaining spatial information about a virtual space for generating spatial sound, an operation of outputting a first screen for setting virtual speakers in the virtual space through a display connected to the wearable device, an operation of obtaining speaker setting information based on a user input for the first screen, an operation of obtaining sound setting information based on the spatial information and the speaker setting information, an operation of obtaining a spatial sound signal by converting an acquired sound signal into spatial sound based on the sound setting information, and an operation of outputting the spatial sound signal through at least one speaker connected to the wearable device.

[0228] According to one embodiment, the first screen may be generated based on image frames acquired through a camera connected to the wearable device.

[0229] According to one embodiment, the method of operating the wearable device may include an operation of outputting an interface for obtaining the spatial information through the display, an operation of obtaining the spatial information through a user input to the interface, and an operation of generating the virtual space based on the spatial information. The first screen may include a screen for the virtual space.

[0230] According to one embodiment, the speaker setting information may include at least one of the position, number, type, or sound volume of at least one virtual speaker within the virtual space obtained based on the user input for the first screen.

[0231] According to one embodiment, the method of operating the wearable device may include an operation of obtaining user location setting information for the virtual space based on a user input for the first screen, and an operation of obtaining the spatial sound signal converted into the spatial sound based on the location setting information, the spatial information, and the speaker setting information.

[0232] According to one embodiment, the wearable device may include at least one sensor. The spatial information may be acquired based on the user's location acquired through the at least one sensor.

[0233] According to one embodiment, the method of operating the wearable device may include an operation of obtaining a first location of the user through the at least one sensor, an operation of determining whether the location of the user with respect to the virtual space has changed from the first location to a second location through the at least one sensor, and an operation of updating the sound setting information based on the second location and the speaker setting information.

[0234] According to one embodiment, the method of operating the wearable device may include transmitting the spatial sound signal to an external device.

[0235] According to one embodiment, the at least one speaker connected to the wearable device may include at least one of at least one speaker included in the wearable device or at least one external speaker device connected via a communication circuit of the wearable device.

[0236] According to one embodiment, a computer-readable recording medium storing one or more programs may include instructions for performing at least one operation among the operating methods of the wearable device.

[0237]

[0238] In this disclosure, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof.

[0239] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not qualify the components in any other respect (e.g., importance or order).

[0240] The terms "unit" and "module" used in various embodiments of the present disclosure may include units implemented in hardware, software, or firmware. For example, they may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integrally formed component or a minimum unit or part of the component that performs one or more functions. The "unit" and "module" used in various embodiments of the present disclosure may be stored in an addressable storage medium and implemented by various programs that can be executed by a processor.

[0241] Various embodiments of the present disclosure may be implemented as software (e.g., a program) including one or more commands stored in a memory (430) (e.g., built-in memory or external memory) readable by a device (e.g., a wearable device (1)). The memory (430) may be represented as a storage medium.

[0242] According to one embodiment, the methods according to the various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a device-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices.

[0243] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the above-described components may be omitted, or one or more other components or operations may be added. Additionally or alternatively, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in a manner identical to or similar to that performed by the corresponding component among the plurality of components prior to the integration.

[0244] According to various embodiments, the operations performed by a module, program, or other component may be performed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be performed in a different order, omitted, or one or more other operations may be added.

[0245] The methods according to the embodiments described in the claims or specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.

[0246] When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. The one or more programs stored in the computer-readable storage medium are configured for execution by one or more processors within an electronic device. The one or more programs include instructions that cause the electronic device to execute methods according to the embodiments described in the claims or specification of the present disclosure.

[0247] In the present disclosure, a function or operation performed by an electronic device may be performed by one or more processors executing one or more instructions stored in a memory. The function or operation of the electronic device mentioned in the present disclosure may be performed by one processor executing one or more instructions, or may be performed by a combination of multiple processors executing one or more instructions. The processor mentioned in the present disclosure may be understood to include a circuit for performing calculations or controlling other components of the electronic device. For example, the one or more processors may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), a micro controller unit (MCU), a sensor hub, a supplementary processor, a communication processor, an application processor, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a neural processing unit (NPU), a system on a chip (SoC), or an integrated circuit implemented to execute one or more instructions, and may have a plurality of cores.

[0248] In the present disclosure, a program (software module, software) may be stored in a non-volatile memory including a random access memory, a flash memory, a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic disc storage device, a compact disc ROM (CD-ROM), a digital versatile disc (DVD) or other forms of optical storage devices, a magnetic cassette. Or, it may be stored in a memory formed by a combination of some or all of these. The memory may be formed by a single storage medium or may be formed by a combination of multiple storage media. The one or more commands may be stored in a single storage medium or may be distributed and stored in multiple storage media.

Claims

1. In wearable devices, display; A communication circuit that transmits and receives audio signals; at least one processor; and Contains memory for storing commands, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: Obtain spatial information about a virtual space for generating spatial sound, Outputting a first screen for setting up a virtual speaker within the virtual space through the above display, Obtain speaker setting information based on user input for the first screen above, Acquire sound setting information based on the above spatial information and the above speaker setting information, Based on the above sound setting information, a spatial sound signal is obtained by converting the sound signal into spatial sound, and A wearable device that transmits the spatial sound signal to at least one speaker connected to the wearable device so that the at least one speaker outputs the spatial sound signal.

2. In claim 1, A wearable device wherein the first screen is generated based on image frames acquired through a camera connected to the wearable device.

3. In claim 1, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: Outputting an interface for obtaining the spatial information through the above display, Obtaining the spatial information through user input to the above interface, and To create the virtual space based on the above spatial information, A wearable device, wherein the first screen includes a screen for the virtual space.

4. In claim 1, A wearable device, wherein the speaker setting information includes at least one of the location, number, type, or sound volume of at least one virtual speaker within the virtual space obtained based on the user input for the first screen.

5. In claim 1, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: Obtaining user location setting information for the virtual space based on user input for the first screen, A wearable device that obtains the spatial sound signal by converting the acoustic signal into the spatial sound based on the location setting information, the spatial information, and the speaker setting information.

6. In claim 1, further comprising at least one sensor; A wearable device, wherein the above spatial information is obtained based on the user's location obtained through at least one sensor.

7. In claim 6, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: Obtaining the user's first location through at least one sensor, Determine whether the user's location in the virtual space has changed from the first location to the second location through at least one sensor; A wearable device that updates the sound setting information based on the second location and the speaker setting information.

8. In claim 1, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: A wearable device that obtains the acoustic signal from an external device through the above communication circuit.

9. In claim 8, The above instructions are individually or collectively executed by the at least one processor so that the wearable device: A wearable device that transmits the above spatial sound signal to the above external device.

10. In claim 1, A wearable device, wherein at least one speaker connected to the wearable device comprises at least one of at least one speaker included in the wearable device or at least one external speaker device connected to the wearable device via the communication circuit.

11. In the method of operating a wearable device, An act of acquiring spatial information about a virtual space for generating spatial sound; An action of outputting a first screen for setting a virtual speaker within the virtual space through a display connected to the wearable device; An operation of obtaining speaker setting information based on user input for the first screen; An operation of obtaining sound setting information based on the above spatial information and the above speaker setting information; An operation of obtaining a spatial sound signal by converting the acquired sound signal into spatial sound based on the above sound setting information; and A method of operating a wearable device, comprising an action of outputting the spatial sound signal through at least one speaker connected to the wearable device.

12. In claim 11, A method for operating a wearable device, wherein the first screen is generated based on image frames acquired through a camera connected to the wearable device.

13. In claim 11, An operation of outputting an interface for obtaining the spatial information through the display; An operation of obtaining the spatial information through user input to the above interface; and Further comprising an action of generating the virtual space based on the above spatial information, A method of operating a wearable device, wherein the first screen includes a screen for the virtual space.

14. In claim 11, A method for operating a wearable device, wherein the speaker setting information includes at least one of the location, number, type, or sound volume of at least one virtual speaker within the virtual space obtained based on the user input for the first screen.

15. In claim 11, An operation of obtaining user location setting information for the virtual space based on user input for the first screen; and A method of operating a wearable device, further comprising an operation of obtaining a spatial sound signal by converting the acoustic signal into the spatial sound based on the location setting information, the spatial information, and the speaker setting information.

16. In claim 12, The wearable device further comprises at least one sensor; A method of operating a wearable device, wherein the above spatial information is obtained based on the user's location obtained through at least one sensor.

17. In claim 16, An operation of acquiring a first location of a user through at least one sensor; An operation of determining whether the user's location in the virtual space has changed from the first location to the second location through at least one sensor; and A method of operating a wearable device, further comprising an operation of updating the sound setting information based on the second location and the speaker setting information.

18. In claim 11, A method of operating a wearable device, further comprising an action of transmitting the above spatial sound signal to an external device.

19. In claim 11, A method for operating a wearable device, wherein at least one speaker connected to the wearable device comprises at least one of at least one speaker included in the wearable device or at least one external speaker device connected via a communication circuit of the wearable device.

20. A computer-readable recording medium storing one or more programs including commands for performing the method of any one of claims 11 to 19.

Images