Electronic device and method for controlling noise canceling function of wireless audio device in electronic device

The electronic device addresses the inconvenience of manual noise canceling control by automatically adjusting the function in wireless audio devices based on conditions like AR mode, VR mode, or surroundings, through communication and control signal transmission.

WO2025058258A1PCT designated stage expired Publication Date: 2025-03-20SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/012117
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-11-14
Filing Date
2024-08-14
Publication Date
2025-03-20

AI Technical Summary

Technical Problem

Existing electronic devices rely on user input to control the noise canceling function of external wireless audio devices, which can be inconvenient as it does not automatically adjust based on conditions such as AR mode, VR mode, or environmental surroundings.

Method used

An electronic device that communicates with an external wireless audio device to automatically control the noise canceling function based on conditions such as AR mode, VR mode, or environmental surroundings, by transmitting appropriate control signals and audio data.

Benefits of technology

Enables convenient and automatic adjustment of the noise canceling function in wireless audio devices, enhancing user experience by optimizing audio output based on specific usage conditions and environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024012117_20032025_PF_FP_ABST
    Figure KR2024012117_20032025_PF_FP_ABST
Patent Text Reader

Abstract

An electronic device is provided. The electronic device comprises: a communication circuit; a memory for storing one or more computer programs; and one or more processors communicatively connected to the communication circuit and the memory. The one or more computer programs, when executed by the one or more processors individually or collectively, may cause the electronic device to: communicate with a wireless audio device outside the electronic device through the communication circuit; identify activation or deactivation of a noise canceling function of the wireless audio device on the basis of a request for transmission of audio data to the wireless audio device; transmit a noise canceling function activation control signal and the audio data to the wireless audio device when the activation of the noise canceling function is identified; and transmit a noise canceling deactivation control signal and the audio data to the wireless audio device when the deactivation of the noise canceling function is identified.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic devices and methods for controlling the noise-cancelling function of wireless audio devices in electronic devices

[0001] The present disclosure relates to a method for controlling a noise canceling function of an external wireless audio device in an electronic device.

[0002] Electronic devices can provide content, and recently, they can provide virtual reality (VR), augmented reality (AR), and mixed reality (MR) content to users. As technology advances, the boundaries between VR, AR, and MR content are becoming blurred, and a concept encompassing all of VR, AR, and MR is also called extended reality (XR) content. Electronic devices can include various types of electronic devices that can provide XR functions, and electronic devices that can provide XR content can be referred to as XR electronic devices. For example, XR electronic devices can include smartphones, AR glasses, VR headsets, HMDs (head-mounted devices), or other XR electronic devices.

[0003] Electronic devices can output audio data using an external wireless audio device when providing content. The wireless audio device may be, for example, earphones, a wireless headset, a wireless ear speaker, or any other device capable of receiving and outputting audio data wirelessly. The wireless audio device may provide a noise cancelling function when outputting audio data, blocking unwanted ambient sounds or providing only sounds in a certain frequency band to the user.

[0004] The above information is provided solely as background information to aid in understanding the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0005] Activation or deactivation of the noise canceling function of a wireless audio device may be controlled by an electronic device that provides audio data to the wireless audio device, but activation or deactivation of the noise canceling function of the wireless audio device may not be automatically controlled in conjunction with whether audio data is output.

[0006] When an electronic device wants to output audio data through a wireless audio device, noise cancellation may or may not be required depending on whether the wireless audio device outputs audio data. However, it may be inconvenient if the electronic device simply relies on user input to control activation or deactivation of the noise cancellation function of the wireless audio device regardless of whether the wireless audio device outputs audio data. It would be convenient if the electronic device could automatically control activation or deactivation of the noise cancellation function of the wireless audio device depending on whether the wireless audio device outputs audio data.

[0007] When an electronic device wants to output audio data through a wireless audio device, noise cancellation may or may not be required on the wireless audio device depending on conditions (e.g., AR mode, VR mode, situation, or surrounding environment), but the electronic device controls activation or deactivation of the noise cancellation function of the wireless audio device solely based on user input regardless of the conditions. It would be convenient if the electronic device could automatically control activation or deactivation of the noise cancellation function of the wireless audio device based on conditions such as AR mode, VR mode, situation, or surrounding environment.

[0008] Aspects of the present disclosure address at least the problems and / or disadvantages mentioned above, and provide at least the advantages described below.

[0009] According to one aspect of the present disclosure, an electronic device capable of controlling activation or deactivation of a noise canceling function of a wireless audio device according to conditions when outputting audio data through a wireless audio device and a method of controlling a noise canceling function of a wireless audio device in the electronic device are provided.

[0010] Additional aspects will be partly described in the following description, partly apparent from the description, or may be learned by practice of the embodiments presented.

[0011] According to one aspect of the present disclosure, an electronic device is provided. The electronic device includes a communication circuit, a memory storing one or more computer programs, and one or more processors communicatively connected to the communication circuit and the memory, wherein the one or more computer programs, when individually or collectively executed by the one or more processors, cause the electronic device to perform communication with a wireless audio device external to the electronic device through the communication circuit, identify activation or deactivation of a noise-canceling function of the wireless audio device based on a request for transmission of audio data to the wireless audio device, and transmit a noise-canceling function activation control signal and the audio data to the wireless audio device when the noise-canceling function activation is identified, and transmit the noise-canceling deactivation control signal and the audio data to the wireless audio device when the noise-canceling function deactivation is identified.

[0012] According to another aspect of the present disclosure, a wireless audio device is provided. The wireless audio device includes a communication circuit, an audio circuit, a noise canceling circuit, a memory storing one or more computer programs, and one or more processors communicatively connected to the communication circuit, the audio circuit, and the memory, wherein the one or more programs include computer-readable instructions that, when individually or collectively executed by the one or more processors, cause the wireless audio device to perform communication with an electronic device external to the wireless audio device through the communication circuit, receive audio data from the electronic device, receive a control signal from the electronic device, and, when the control signal is a noise canceling function activation control signal, control the noise canceling circuit to activate the noise canceling function when reproducing the audio data, and when the control signal is a noise canceling function deactivation control signal, control the noise canceling circuit to deactivate the noise canceling function.

[0013] According to another aspect of the present disclosure, an electronic device is provided. The electronic device includes a communication circuit, a memory storing one or more computer programs, and one or more processors communicatively connected to the communication circuit and the memory, wherein the one or more computer programs include one or more computer-readable instructions that, when individually or collectively executed by the one or more processors, cause the electronic device to activate a virtual reality (VR) function while performing an augmented reality (AR) function based on a request to perform the VR function, or to activate the AR function based on a request to perform the AR function while performing the VR function, and when the VR function is activated, to transmit a noise-canceling function activation control signal to a wireless audio device connected to the electronic device using the communication circuit, and when the AR function is activated, to transmit a noise-canceling function activation control signal or an ambient sound listening control signal to the wireless audio device connected to the electronic device using the communication circuit.

[0014] According to another aspect of the present disclosure, a method for controlling a noise-canceling function of a wireless audio device performed by an electronic device is provided. The method includes an operation in which the electronic device performs communication with a wireless audio device external to the electronic device through a communication circuit, an operation in which the electronic device identifies whether to activate or deactivate a noise-canceling function of the wireless audio device based on a request for transmitting audio data to the wireless audio device, an operation in which the electronic device transmits a noise-canceling function activation control signal and the audio data to the wireless audio device when the noise-canceling function activation is identified, and an operation in which the electronic device transmits the noise-canceling deactivation control signal and the audio data to the wireless audio device when the noise-canceling function deactivation is identified.

[0015] According to another aspect of the present disclosure, there is provided one or more non-transitory computer-readable storage media storing one or more computer programs including computer-readable instructions, which, when individually or collectively executed by one or more processors of an electronic device, cause the electronic device to perform operations. The operations include: allowing the electronic device to communicate with a wireless audio device external to the electronic device through a communication circuit; allowing the electronic device to identify whether to activate or deactivate a noise-canceling function of the wireless audio device based on a request for transmission of audio data to the wireless audio device; allowing the electronic device to transmit a noise-canceling function activation control signal and the audio data to the wireless audio device when the noise-canceling function activation is identified; and allowing the electronic device to transmit the noise-canceling deactivation control signal and the audio data to the wireless audio device based on the noise-canceling function deactivation identification.

[0016] Other aspects, advantages and salient features of the present disclosure will become apparent to those skilled in the art from the following detailed description of various embodiments of the present disclosure taken in conjunction with the accompanying drawings.

[0017] According to various embodiments of the present disclosure, it may be convenient for an electronic device to automatically control activation or deactivation of a noise canceling function of a wireless audio device depending on conditions such as AR mode, VR mode, situation, or surrounding environment.

[0018] The above and other aspects, features and advantages of specific embodiments of the present invention will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0019] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment of the present disclosure.

[0020] FIG. 2 is a diagram illustrating an electronic device and a wireless audio device according to an embodiment of the present disclosure.

[0021] FIG. 3 is a diagram illustrating a mobile electronic device according to an embodiment of the present disclosure.

[0022] FIG. 4A is a diagram illustrating an XR electronic device according to one embodiment of the present disclosure.

[0023] FIG. 4b is a diagram illustrating the structure of a display and an eye tracking camera of an XR electronic device according to an embodiment of the present disclosure.

[0024] FIG. 5 is a block diagram of an electronic device according to an embodiment of the present disclosure.

[0025] FIG. 6 is a flowchart illustrating an operation for controlling noise canceling of a wireless audio device in an electronic device according to an embodiment of the present disclosure.

[0026] FIG. 7 is a flowchart illustrating an operation for controlling noise canceling of an external wireless audio device in a VR function-activated state of an electronic device according to an embodiment of the present disclosure.

[0027] FIG. 8 is a block diagram of a wireless audio device according to an embodiment of the present disclosure.

[0028] FIG. 9 is a flowchart of the operation of a wireless audio device according to an embodiment of the present disclosure.

[0029] FIG. 10A is a diagram illustrating an example of transmitting a noise canceling activation signal and audio data to a wireless audio device based on a user input in a mobile electronic device according to an embodiment of the present disclosure.

[0030] FIG. 10b is a diagram illustrating an example of transmitting a noise canceling activation signal and audio data to a wireless audio device based on a control signal from another electronic device in a mobile electronic device according to an embodiment of the present disclosure.

[0031] FIG. 11A is a diagram illustrating an example of transmitting a noise canceling activation control signal and audio data to one of a pair of wireless audio devices in a mobile electronic device according to an embodiment of the present disclosure.

[0032] FIG. 11b is a diagram illustrating an example of transmitting a noise canceling activation signal and audio data to one of a pair of wireless audio devices and transmitting audio data to the other wireless audio device in a mobile electronic device according to an embodiment of the present disclosure.

[0033] FIG. 11c is a diagram illustrating an example of transmitting a noise canceling activation signal and audio data to each of a pair of wireless audio devices in a mobile electronic device according to an embodiment of the present disclosure.

[0034] FIG. 12A is a diagram illustrating an example of transmitting a noise canceling activation control signal and audio data to a wireless audio device when a VR function is activated in an XR electronic device according to an embodiment of the present disclosure.

[0035] FIG. 12b is a diagram illustrating an example of an XR electronic device transmitting a noise canceling activation control signal and audio data to a wireless audio device based on a control signal from another electronic device according to an embodiment of the present disclosure.

[0036] FIG. 12c is a diagram illustrating an example of controlling an XR electronic device in a mobile electronic device according to an embodiment of the present disclosure and transmitting a noise canceling activation (or deactivation) control signal and audio data to a wireless audio device.

[0037] FIG. 12d is a diagram illustrating an example of transmitting a noise canceling activation (or deactivation) control signal and audio data to a wireless audio device via a mobile electronic device in an XR electronic device according to an embodiment of the present disclosure.

[0038] Throughout the drawings, like reference numbers will be understood to refer to like parts, components and structures.

[0039] The following description, with reference to the attached drawings, is provided to facilitate a comprehensive understanding of various embodiments of the present invention as defined by the claims and their equivalents. While it includes numerous specific details to aid understanding, these should be considered merely exemplary. Accordingly, those skilled in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of the present disclosure. Furthermore, descriptions of well-known functions and structures may be omitted for clarity and brevity.

[0040] The terms and words used in the following description and claims are not intended to be limited by their bibliographic meanings, but rather have been used by the inventors solely to facilitate a clear and consistent understanding of the present disclosure. Therefore, it should be apparent to those skilled in the art that the following description of various embodiments of the present invention is provided for illustrative purposes only and is not intended to limit the present invention as defined by the appended claims and their equivalents.

[0041] The singular forms "a," "an," and "the" should be understood to include the plural unless the context clearly indicates otherwise. Thus, for example, a reference to "a surface of a part" includes a reference to one or more such surfaces.

[0042] It should be understood that the blocks and combinations of flowcharts can be performed by one or more computer programs containing instructions. The entirety of one or more computer programs may be stored in a single memory device, or the one or more computer programs may be divided into different parts stored in different memory devices.

[0043] Any function or operation described in this document may be performed by a single processor or a combination of processors. A single processor or a combination of processors is a circuit that performs processing and includes circuits such as an application processor (AP, e.g., a central processing unit (CPU)), a communication processor (CP, e.g., a modem), a graphics processing unit (GPU), a neural processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a Wi-Fi chip, a Bluetooth® chip, a global positioning system (GPS) chip, a near field communication (NFC) chip, a connection chip, a sensor controller, a touch controller, a fingerprint sensor controller, a display drive integrated circuit (IC), an audio codec chip, a universal serial bus (USB) controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system on a chip (SoC), an integrated circuit (IC), and the like.

[0044] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to one embodiment of the present disclosure.

[0045] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0046] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0047] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0048] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0049] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0050] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0051] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0052] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0053] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0054] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0055] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0056] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0057] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0058] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0059] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0060] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0061] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a fifth generation (5G) network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0062] The wireless communication module (192) can support a 5G network and next-generation communication technologies following the 4G (fourth generation) network, for example, NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0063] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0064] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0065] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0066] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices, such as the external electronic devices (102 or 104) or the server (108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service by itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0067] In the detailed description below, reference numerals in the drawings may be used interchangeably or omitted for configurations that can be easily understood through the preceding embodiments, and their detailed descriptions may also be omitted. The electronic device (101) according to one embodiment disclosed in this document may be implemented by selectively combining the configurations of each embodiment, and the configurations of one embodiment may be replaced. For example, it should be noted that the present disclosure is not limited to a specific drawing or embodiment.

[0068] FIG. 2 is a diagram illustrating an electronic device and a wireless audio device according to an embodiment of the present disclosure.

[0069] Referring to FIG. 2, an electronic device (201) according to an embodiment (e.g., the electronic device (101) of FIG. 1) may perform communication (e.g., short-range wireless communication) with an external wireless audio device (202) (e.g., the electronic device (102) of FIG. 1). The electronic device (201) according to an embodiment may transmit audio data to the wireless audio device (202) through communication. The electronic device (201) according to an embodiment may identify whether a noise canceling function of the wireless audio device (202) is activated or deactivated based on a request for audio data transmission (or occurrence of an audio data transmission event) to the wireless audio device (202) through communication (or occurrence of a request for activating or deactivating a noise canceling function during audio data transmission). According to an embodiment, the electronic device (201) may transmit audio data and a noise-canceling function activation control signal to the wireless audio device (202) or transmit a noise-canceling function activation control signal to the wireless audio device (202) while broadcasting audio data (e.g., using a broadcast isochronous stream) when the activation of the noise-canceling function of the wireless audio device (202) is identified based on a request for audio data transmission to the wireless audio device (202). According to an embodiment, the electronic device (201) may transmit audio data and a noise-canceling function deactivation control signal to the wireless audio device (202) or transmit a noise-canceling function deactivation control signal to the wireless audio device (202) while broadcasting audio data when the deactivation of the noise-canceling function of the wireless audio device (202) is identified based on a request for audio data transmission to the wireless audio device (202).In one embodiment, the electronic device (201) may transmit audio data and an ambient sound listening function control signal to the wireless audio device (202) when the ambient sound listening function of the wireless audio device (202) is identified based on a request for audio data transmission to the wireless audio device (202), or transmit a noise canceling function deactivation control signal to the wireless audio device (202) while broadcasting the audio data.

[0070] In one embodiment, the electronic device (201) may transmit or broadcast audio data to the wireless audio device (202) without a noise-canceling function activation control signal, a noise-canceling function deactivation control signal, or an ambient sound listening function control signal, based on a request for audio data transmission to the wireless audio device (202) when the noise-canceling function of the wireless audio device (202) is not identified, or when the noise-canceling function is not activated, or when the noise-canceling function is not activated. The noise-canceling function according to one embodiment may be a function that prevents the user from hearing surrounding sounds other than the sound of the audio data through the wireless audio device (202). The noise-canceling deactivation function according to one embodiment may be a function that turns off the noise-canceling activation of the wireless audio device (202). The ambient sound listening function according to one embodiment may be a function that allows the user to hear surrounding sounds other than the sound of the audio data through the wireless audio device (202). The ambient sound listening function according to one embodiment may be a function that allows the user wearing the wireless audio device to hear surrounding sounds while noise-canceling is deactivated. For example, the ambient sound listening function may be a function that allows the wireless audio device (202) to allow the user to hear ambient sounds other than the sounds of audio data at a designated ambient sound listening level (e.g., low, medium, high). For example, when the ambient sound listening level is designated (or set) to low, the electronic device (201) may transmit a low-level ambient sound listening function control signal to the wireless audio device (202), and the wireless audio device (202) may allow the ambient sounds to be heard at a designated low level based on the low-level ambient sound listening control signal.For example, when the ambient sound hearing level is designated (or set) to medium, the electronic device (201) can transmit a medium-level ambient sound hearing function control signal to the wireless audio device (202), and the wireless audio device (202) can cause ambient sounds to be heard at the designated medium level based on the medium-level ambient sound hearing control signal. For example, when the ambient sound hearing level is designated (or set) to high, the electronic device (201) can transmit a high-level ambient sound hearing function control signal to the wireless audio device (202), and the wireless audio device (202) can cause ambient sounds to be heard at the designated high level based on the high-level ambient sound hearing control signal. According to an embodiment, the ambient sound hearing level may be adjusted to various levels according to user settings in addition to low, medium, and high.

[0071] An electronic device (201) according to an embodiment may include an XR electronic device capable of providing an extended reality (XR) function or XR content, or an electronic device that operates in conjunction with an XR electronic device when providing an XR function or XR content through an XR electronic device. The XR function according to an embodiment may include a virtual reality (VR) function, an augmented reality (AR) function, and / or a mixed reality (MR) function, and the XR content may include VR content, AR content, and / or MR content. An XR electronic device according to an embodiment or an electronic device that operates in conjunction with an XR electronic device may broadcast audio data (e.g., audio data corresponding to the XR function or XR content and / or audio data (e.g., music) output separately from the provision of the XR function or XR content) or transmit the audio data to a wireless audio device (202) so that the audio data is output from the wireless audio device (202). For example, the XR electronic device may include AR glasses, a VR headset, a head-mounted device (HMD), or other XR electronic device. For example, the electronic device that operates in conjunction with the XR electronic device may include a mobile electronic device (e.g., a smartphone or tablet), a PC, or other electronic device.

[0072] A wireless audio device (202) according to an embodiment can communicate with an electronic device (201). The wireless audio device (202) according to an embodiment can receive a noise-canceling function activation control signal, a noise-canceling function deactivation control signal, or an ambient sound listening control signal associated with audio data received from the electronic device (201). According to an embodiment, the electronic device (201) can broadcast or transmit audio data to the wireless audio device (202) when a request for audio data transmission is made, and can transmit a noise-canceling function activation control signal, a noise-canceling deactivation control signal, or an ambient sound listening control signal to be applied when outputting audio data to the wireless audio device (202). The wireless audio device (202) according to an embodiment can activate the noise-canceling function and output audio data based on the noise-canceling function activation control signal. The wireless audio device (202) according to an embodiment can deactivate the noise-canceling function and output audio data based on the noise-canceling function deactivation control signal. A wireless audio device (202) according to an embodiment may output audio data while allowing ambient sounds to be heard based on an ambient sound hearing function control signal. The wireless audio device (202) according to an embodiment may further include a wireless headset, wireless earphones, or other wireless audio devices including audio data output and noise canceling functions.

[0073] FIG. 3 is a diagram illustrating a mobile electronic device according to an embodiment of the present disclosure.

[0074] Referring to FIG. 3, a mobile electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (201) of FIG. 2) (300) according to an embodiment can transmit audio data to a wireless audio device (202) and output it. The mobile electronic device (300) according to an embodiment can operate in conjunction with an external XR electronic device, and when providing an XR function or XR content through the XR electronic device, audio data corresponding to the XR function or XR content can be transmitted to the wireless audio device (202) and output from the wireless audio device (202).

[0075] A mobile electronic device (300) according to one embodiment may include a housing (310) including a first side (or front side) (310A), a second side (or back side) (310B), and a side surface (310C) enclosing a space between the first side (310A) and the second side (310B). In another embodiment (not shown), the housing may refer to a structure forming a portion of the first side (310A), the second side (310B), and the side surface (310C) of FIG. 3. According to one embodiment, the first side (310A) may be formed by a front plate (302) that is at least partially transparent (e.g., a glass plate or a polymer plate including various coating layers). The second side (310B) may be formed by a substantially opaque back plate (not shown). The back plate may be formed of, for example, coated or colored glass, ceramic, polymer, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of the foregoing materials. The side (310C) may be formed by a side bezel structure (or “side member”) (318) that is coupled to the front plate (302) and the back plate and comprises a metal and / or polymer. In some embodiments, the back plate and the side bezel structure (318) may be formed integrally and comprise the same material (e.g., a metal material such as aluminum).

[0076] According to one embodiment, the front plate (302) may include two first regions (310D) that extend seamlessly from the first surface (310A) toward the rear plate, at both ends of a long edge of the front plate (302). In some embodiments, the front plate (302) (or the rear plate) may include only one of the first regions (310D). In other embodiments, some of the first regions (310D) may not be included. In the embodiments, when viewed from the side of the mobile electronic device (300), the side bezel structure (318) may have a first thickness (or width) on the side that does not include the first regions (310D), and a second thickness that is thinner than the first thickness on the side that includes the first regions (310D).

[0077] According to one embodiment, the mobile electronic device (300) may include at least one of a display (301), an audio module (303, 307, 314), a sensor module (304), a camera module (305), a key input device (317), a light emitting element (306), and a connector hole (308, 309). In some embodiments, the mobile electronic device (300) may omit at least one of the components (e.g., the key input device (317) or the light emitting element (306)) or may additionally include other components.

[0078] The display (301) may be exposed, for example, through a significant portion of the front plate (302). In some embodiments, at least a portion of the display (301) may be exposed through the front plate (302), which forms the first surface (310A) and the first areas (310D) of the side surfaces (310C). In some embodiments, the edges of the display (301) may be formed to be substantially identical to the adjacent outer shape of the front plate (302). In other embodiments (not shown), the gap between the outer edge of the display (301) and the outer edge of the front plate (302) may be formed to be substantially identical in order to expand the area over which the display (301) is exposed.

[0079] In another embodiment (not shown), a recess or opening may be formed in a portion of the screen display area of ​​the display (301), and at least one of an audio module (314), a sensor module (304), a camera module (305), and a light-emitting element (306) may be included aligned with the recess or opening. In another embodiment (not shown), at least one of an audio module (314), a sensor module (304), a camera module (305), a fingerprint sensor (not shown), and a light-emitting element (306) may be included on the back surface of the screen display area of ​​the display (301). In another embodiment (not shown), the display (301) may be coupled to or disposed adjacent to a touch detection circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer capable of detecting a magnetic field-type stylus pen. In some embodiments, at least a portion of the sensor module (304) and / or at least a portion of the key input device (317) may be disposed in the first areas (310D).

[0080] The audio module (303, 307, 314) may include a microphone hole (303) and a speaker hole (307, 314). The microphone hole (303) may have a microphone disposed inside to acquire external sounds, and in some embodiments, multiple microphones may be disposed to detect the direction of sounds. The speaker hole (307, 314) may include an external speaker hole (307) and a receiver hole (314) for calls. In some embodiments, the speaker hole (307, 314) and the microphone hole (303) may be implemented as a single hole, or a speaker may be included without the speaker hole (307, 314) (e.g., a piezo speaker).

[0081] The sensor module (304) can generate an electrical signal or data value corresponding to an internal operating state of the mobile electronic device (300) or an external environmental state. The sensor module (304) can include, for example, a first sensor module (304) (e.g., a proximity sensor) and / or a second sensor module (not shown) (e.g., a fingerprint sensor) disposed on a first surface (310A) of the housing (310), and / or a third sensor module (not shown) (e.g., an HRM sensor) and / or a fourth sensor module (not shown) (e.g., a fingerprint sensor) disposed on a second surface (310B) of the housing (310). The fingerprint sensor may be disposed on the first side (310A) of the housing (310) (e.g., the display (301) as well as the second side (310B). The mobile electronic device (300) may further include at least one of a sensor module not shown, for example, a gesture sensor, a gyro sensor, a pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor (304).

[0082] The camera module (305) may include a first camera device (305) disposed on a first side (310A) of the mobile electronic device (300), a second camera device (not shown) disposed on a second side (310B), and / or a flash (not shown). The camera devices (305) may include one or more lenses, an image sensor, and / or an image signal processor. The flash (not shown) may include, for example, a light-emitting diode or a xenon lamp. In some embodiments, two or more lenses (infrared camera, wide-angle and telephoto lenses) and image sensors may be disposed on one side of the mobile electronic device (300).

[0083] The key input device (317) may be disposed on a side surface (310C) of the housing (310). In other embodiments, the mobile electronic device (300) may not include some or all of the above-mentioned key input devices (317), and the key input devices (317) that are not included may be implemented in other forms, such as soft keys, on the display (301). In some embodiments, the key input device may include a sensor module (not shown) disposed on a second surface (310B) of the housing (310).

[0084] The light-emitting element (306) may be disposed, for example, on the first surface (310A) of the housing (310). The light-emitting element (306) may provide, for example, status information of the mobile electronic device (300) in the form of light. In another embodiment, the light-emitting element (306) may provide a light source that is linked to the operation of, for example, the camera module (305). The light-emitting element (306) may include, for example, an LED, an IR LED, and a xenon lamp.

[0085] The connector holes (308, 309) may include a first connector hole (308) that can accommodate a connector (e.g., a USB connector) for transmitting and receiving power and / or data with an external electronic device, and / or a second connector hole (e.g., an earphone jack) (309) that can accommodate a connector for transmitting and receiving audio signals with an external electronic device. When the electronic device (300) according to one embodiment is a foldable electronic device, the foldable electronic device (not shown) may include a pair of housing structures (not shown) (e.g., a foldable housing structure) that are rotatably coupled about a folding axis via a hinge structure (not shown) so as to be folded with respect to each other, and a display (not shown) (e.g., a flexible display, a foldable display) that is arranged in a space formed by the pair of housing structures (not shown). According to one embodiment, the foldable electronic device (not shown) may have a display that can be folded or unfolded together depending on folding or unfolding.

[0086] FIG. 4A is a diagram illustrating an XR electronic device according to one embodiment of the present disclosure.

[0087] Referring to FIG. 4a, an XR electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (201) of FIG. 2) (400) according to one embodiment may perform an XR function or provide XR content, and when performing an XR function or providing XR content, may transmit audio data corresponding to the XR function or XR content to a wireless audio device (202) and output it.

[0088] An XR electronic device (400) according to an embodiment may include a wearable electronic device (e.g., a glasses-type electronic device). An XR electronic device (400) according to an embodiment may include a frame (405), a first support (401), a second support (402), a first hinge (403) connecting the frame (405) and the first support (401), and / or a second hinge (404) connecting the frame (405) and the second support (402). According to one embodiment, the frame (405) may include at least one camera (e.g., a first camera (411-1, 411-2), a second camera (412-1, 412-2), and / or a third camera (413)), one or more light-emitting elements (414-1, 414-2), at least one display (e.g., a first display (451), a second display (452)), one or more sound input devices (462-1, 462-2, 462-3), or one or more transparent members (490-1, 490-2). The XR electronic device (400) according to one embodiment may include one or more first cameras (411-1, 411-2), one or more second cameras (412-1, 412-2), and / or one or more third cameras (413). Images acquired through one or more first cameras (411-1, 411-2) according to an embodiment may be used for detecting hand gestures by a user, tracking the user's head, and / or spatial recognition. One or more first cameras (411-1, 411-2) according to an embodiment may be GS (global shutter) cameras. One or more first cameras (411-1, 411-2) according to an embodiment may perform SLAM (simultaneous localization and mapping) operations through depth imaging. One or more first cameras (411-1, 411-2) according to an embodiment may perform spatial recognition for 6DoF (degrees of freedom).In one embodiment, the images acquired through one or more second cameras (412-1, 412-2) may be used to detect and track the user's pupils. For example, the images acquired through one or more second cameras (412-1, 412-2) may be used to track the user's gaze direction. In one embodiment, the one or more second cameras (412-1, 412-2) may be GS cameras. In one embodiment, the one or more second cameras (412-1, 412-2) may correspond to the left eye and the right eye, respectively, and the performance of the one or more second cameras (412-1, 412-2) may be substantially the same. In one embodiment, the one or more third cameras (413) may be high-resolution cameras. In one embodiment, the one or more third cameras (413) may perform an auto-focusing (AF) function or a shake correction function. One or more third cameras (413) according to an embodiment may be a GS camera or a RS (rolling shutter) camera. An XR electronic device (400) according to an embodiment may include one or more light-emitting elements (414-1, 414-2). The light-emitting elements (414-1, 414-2) are different from a light source, which will be described later, that radiates light to a screen output area of ​​a display. The light-emitting elements (414-1, 414-2) according to an embodiment may radiate light to facilitate pupil detection when detecting and tracking the user's pupils through one or more second cameras (412-1, 412-2). The light-emitting elements (414-1, 414-2) according to an embodiment may include an LED. The light-emitting elements (414-1, 414-2) according to an embodiment may radiate light in the infrared region. According to one embodiment, a light emitting element (414-1, 414-2) may be attached around a frame (405) of an XR electronic device (400).In one embodiment, the light-emitting elements (414-1, 414-2) are positioned around one or more first cameras (411-1, 411-2) and can assist gesture detection, head tracking, and / or spatial recognition by one or more first cameras (411-1, 411-2) when the XR electronic device (400) is used in a dark environment. In one embodiment, the light-emitting elements (414-1, 414-2) are positioned around one or more third cameras (413) and can assist image acquisition by one or more third cameras (413) when the XR electronic device (400) is used in a dark environment. An XR electronic device (400) according to an embodiment may include a first display (451), a second display (452), one or more input optical members (453-1, 453-2), one or more transparent members (490-1, 490-2), and / or one or more screen display portions (454-1, 454-2) positioned in a frame (405). The first display (451) and the second display (452) according to an embodiment may include, for example, a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED). When the first display (451) and the second display (452) according to one embodiment are made of one of a liquid crystal display device, a digital mirror display device, or a silicon liquid crystal display device, the XR electronic device (400) may include a light source that irradiates light to the screen output area of ​​the display.When the first display (451) and / or the second display (452) according to an embodiment can generate light on their own, for example, when they are made of one of an organic light-emitting diode or a micro LED, the XR electronic device (400) can provide a good quality virtual image to the user even without including a separate light source. One or more transparent members (490-1, 490-2) according to an embodiment can be placed to face the eyes of the user when the user wears the XR electronic device (400). One or more transparent members (490-1, 490-2) according to an embodiment can include at least one of a glass plate, a plastic plate, or a polymer. When the user according to an embodiment wears the XR electronic device (400), the user can see the outside world through one or more transparent members (490-1, 490-2). According to one embodiment, one or more input optical elements (453-1, 453-2) can guide light generated from the first display (451) and / or the second display (452) to the user's eyes. An image based on the light generated from the first display (451) and the second display (452) is formed on one or more screen display portions (454-1, 454-2) on one or more transparent elements (490-1, 490-2) according to one embodiment, and the user can see the image formed on the one or more screen display portions (454-1, 454-2). The XR electronic device (400) according to one embodiment may include one or more optical waveguides (not shown). The optical waveguides can transmit light generated from the first display (451) and the second display (452) to the user's eyes. The XR electronic device (400) may include one optical waveguide each corresponding to the left eye and the right eye. An optical waveguide according to one embodiment may comprise at least one of glass, plastic or polymer.An optical waveguide according to an embodiment may include a nano-pattern formed on one surface of the inner or outer surface, for example, a grating structure having a polygonal or curved shape. An optical waveguide according to an embodiment may include a free-form prism, in which case the optical waveguide may provide incident light to a user through a reflective mirror. An optical waveguide according to an embodiment may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or a reflective element (e.g., a reflective mirror), and may guide display light emitted from a light source to a user's eye using at least one diffractive element or reflective element included in the optical waveguide. The diffractive element according to an embodiment may include an input / output optical member. The reflective element according to an embodiment may include a member causing total reflection. An XR electronic device (400) according to one embodiment may include one or more sound input devices (462-1, 462-2, 462-3) (e.g., a microphone), and the one or more sound input devices (462-1, 462-2, 462-3) may receive a user's sound or a sound generated in the vicinity of the XR electronic device (400). For example, the one or more sound input devices (462-1, 462-2, 462-3) may receive a sound generated in the vicinity and transmit the sound to a processor (e.g., a processor (520) of FIG. 5). According to one embodiment, one or more supports (e.g., first support (401), second support (402)) may include a PCB (e.g., first PCB (470-1) and second PCB (470-2)), one or more sound output devices (463-1, 463-2), and / or one or more batteries (435-1, 435-2).The first PCB (470-1) and the second PCB (470-2) can transmit electrical signals to components included in the XR electronic device (400), such as the first camera (511), the second camera (512), the third camera (513), the display (550), the audio device (561), and / or the sensor (580), which will be described later with reference to FIG. 5. The first PCB (470-1) and the second PCB (470-2) according to one embodiment may be FPCB. The first PCB (470-1) and the second PCB (470-2) according to one embodiment may each include a first substrate, a second substrate, and an interposer disposed between the first substrate and the second substrate. The XR electronic device (400) according to one embodiment may include a battery (435-1, 435-2). The battery (435-1, 435-2) may store power to operate the remaining components of the XR electronic device (400). One or more sound output devices (463-1, 463-2) (e.g., speakers) according to an embodiment may output audio data to a user. For example, they may provide feedback on a user's command (or input) or provide information about a virtual object to the user through the audio data. The XR electronic device (400) according to an embodiment may include one or more hinge parts (e.g., a first hinge part (403), a second hinge part (404)). For example, the first hinge portion (403) may be configured such that the first support portion (401) is coupled to the frame (405) and can rotate relative to the frame (405), and the second hinge portion (404) may be configured such that the second support portion (402) is coupled to the frame (405) and can rotate relative to the frame (405).

[0089] FIG. 4b is a diagram illustrating the structure of a display and an eye tracking camera of an XR electronic device according to an embodiment of the present disclosure.

[0090] Referring to FIG. 4B, an XR electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (201) of FIG. 2) (400) according to one embodiment may include a display (421), an input optical member (422), a display optical waveguide (423), an output optical member (424), an eye tracking camera (410), a first splitter (441), an eye tracking optical waveguide (442), and / or a second splitter (443).

[0091] In an XR electronic device (400) according to an embodiment, the display (421) may be the first display (451) or the second display (452) illustrated in FIG. 4A. Light output from the display (421) may pass through an input optical member (422) (e.g., input optical members (453-1, 453-2) of FIG. 4A) and be incident on a display optical waveguide (423), and may be output through an output optical member (424) through the display optical waveguide (423). The light output from the output optical member (424) may be visible to the user's eyes (430). According to an embodiment, the light output from the display (421) is output through the output optical member (424), and the shape of an object is visible to the user's eyes (430) by the light output through the output optical member (424), which may mean displaying the object on the display. In one embodiment, light output from a display (421) is output through an output optical member (424), and controlling the display (421) so that the shape of an object is visible to the user's eye (430) by the light output through the output optical member (424) may mean controlling to display an object. Light (432) reflected from the user's eye (430) may pass through a first splitter (441) and be incident on an eye-tracking optical waveguide (442), and may pass through the eye-tracking optical waveguide (442) and be output to the eye-tracking camera (410) through a second splitter (443). According to various embodiments, light (432) reflected from the user's eye (430) may be light output from the light-emitting elements (414-1, 414-2) of FIG. 4A and reflected from the user's eye (430). According to various embodiments, the eye tracking camera (410) may be one or more of the second cameras (412-1, 412-2) illustrated in FIG. 4A.

[0092] FIG. 5 is a block diagram of an electronic device according to an embodiment of the present disclosure.

[0093] Referring to FIG. 5, an electronic device (e.g., an electronic device (101) of FIG. 1, an electronic device (201) of FIG. 2, a mobile electronic device (300) of FIG. 3, or an XR electronic device (400) of FIG. 4B) (500) according to an embodiment may include a communication circuit (570), a memory (540), and a processor (520). The electronic device (500) according to an embodiment may further include a first camera (511), a second camera (512), a third camera (513), a PMIC (power management integrated chip) (530), a battery (535), a display (550), an audio device (561), a sound input device (562), a sound output device (563), and / or a sensor (580). The electronic device (500) according to an embodiment is not limited thereto and may be configured to further include various components or may be configured to exclude some of the above components. An electronic device (500) according to one embodiment may further include all or part of the electronic device (101) illustrated in FIG. 1.

[0094] A processor (520) according to an embodiment (e.g., processor (120) of FIG. 1) may control at least one other component (e.g., hardware or software component) of an electronic device (500) and perform various data processing or calculations. A processor (520) according to an embodiment may control other components of an electronic device (500), for example, a first camera (511), a second camera (512), a third camera (513), a PMIC (530), a memory (540), a display (550), an audio device (561), a communication circuit (570), and / or a sensor (580), and perform various data processing or calculations.

[0095] According to an embodiment, a processor (520) may communicate with an external wireless audio device (e.g., an electronic device (102) of FIG. 1 or a wireless audio device (202) of FIG. 2) via a communication circuit (570) (e.g., a communication module (190) of FIG. 1). According to an embodiment, the processor (520) may identify whether to control the activation of a noise-canceling function of the wireless audio device, the deactivation of a noise-canceling function, or the control of an ambient sound listening function based on a request for transmitting audio data to the wireless audio device. According to an embodiment, the processor (520) may transmit a noise-canceling function activation control signal and audio data to the wireless audio device based on the identification of the noise-canceling function activation control, or transmit a noise-canceling function activation control signal to the wireless audio device while broadcasting the audio data (e.g., using a broadcast isochronous stream (BIS)). According to an embodiment, the processor (520) may transmit a noise-cancelling function deactivation control signal and audio data to the wireless audio device based on the noise-cancelling function deactivation control identification, or transmit a noise-cancelling function deactivation control signal to the wireless audio device (202) while broadcasting the audio data. According to an embodiment, the processor (520) may transmit audio data and an ambient sound listening function control signal to the wireless audio device based on the request for audio data transmission to the wireless audio device when the ambient sound listening function control of the wireless audio device is identified, or transmit a noise-cancelling function deactivation control signal to the wireless audio device while broadcasting the audio data.

[0096] According to one embodiment, the noise canceling function may be a function that prevents the user from hearing surrounding sounds other than the sound of audio data through the wireless audio device. The noise canceling deactivation function according to one embodiment may be a function that turns off the noise canceling activation of the wireless audio device. The ambient sound listening function according to one embodiment may be a function that allows the user to hear surrounding sounds other than the sound of audio data through the wireless audio device. For example, the ambient sound listening function may be a function that allows the wireless audio device to hear surrounding sounds other than the sound of audio data according to a designated ambient sound listening level (e.g., low, medium, high). For example, when the ambient sound listening level is designated (or set) to low, the processor (520) may control the wireless audio device to transmit a low-level ambient sound listening function control signal, and the wireless audio device may allow the ambient sounds to be heard at a designated low level based on the low-level ambient sound listening control signal. For example, when the ambient sound hearing level is designated (or set) as medium, the processor (520) can control to transmit a medium-level ambient sound hearing function control signal to the wireless audio device, and the wireless audio device can cause the ambient sound to be heard at the designated medium level based on the medium-level ambient sound hearing control signal. For example, when the ambient sound hearing level is designated (or set) as high, the processor (520) can control to transmit a high-level ambient sound hearing function control signal to the wireless audio device, and the wireless audio device can cause the ambient sound to be heard at the designated high level based on the high-level ambient sound hearing control signal. According to one embodiment, the ambient sound hearing level can be adjusted to various levels according to user settings in addition to low, medium, and high.According to one embodiment, the processor (520) can amplify ambient sounds received through the sound input device (562) and output them through the sound output device (563) when the ambient sound hearing level is designated (or set) to high.

[0097] According to an embodiment, the processor (520) may identify AR function activation (or AR mode) or VR function activation (or VR mode) based on a request for transmitting audio data to a wireless audio device, identify noise canceling function deactivation control or ambient sound listening function based on AR function activation, and identify noise canceling function activation control based on VR function activation. According to an embodiment, the processor (520) may perform an AR function in an AR function activation state, output AR content, and transmit audio data included in the AR content to an external wireless audio device to be output. According to an embodiment, the AR content may be content in which a virtual image is superimposed on an external environment visible to the eye through a lens in front of the eyes or an external environment image of the electronic device (500) captured through at least one camera (e.g., the first camera (511), the second camera (512), and / or the third camera (513)). An electronic device (500) according to an embodiment may provide AR content in an optical see-through (OST) manner that allows the user to view an external environment through a lens in front of the eyes and simultaneously superimpose a virtual image projected onto the lens. Alternatively, the electronic device (500) according to an embodiment may provide AR content in a video see-through (VST) manner that superimposes a virtual image onto an external environment image of the electronic device (500) captured by at least one camera (e.g., a first camera (511), a second camera (512), and / or a third camera (513)). The AR content according to an embodiment may include a virtual image that is superimposed on an external environment (or an image of the external environment) and may further include audio data associated with the AR content. The processor (520) according to an embodiment may transmit audio data included in the AR content to an external wireless audio device and output the audio data.In one embodiment, the processor (520) may transmit audio data included in AR content to an external wireless audio device for output, and may transmit a noise canceling function deactivation control signal or an ambient sound listening function control signal based on AR function activation and audio data to the wireless audio device.

[0098] According to an embodiment, the processor (520) may perform a VR function in a VR function-activated state, output VR content, and transmit audio data included in the VR content to an external wireless audio device for output. The VR content according to an embodiment may be content in which a virtual image of a virtual environment is displayed in a state in which the external real environment is blocked. The VR content according to an embodiment may include a virtual image of a virtual environment and further include audio data associated with the VR content. The processor (520) according to an embodiment may transmit audio data included in the VR content to an external wireless audio device for output. When the processor (520) according to an embodiment transmits audio data corresponding to the VR content to an external wireless audio device for output, the processor may transmit a noise-canceling function activation control signal and audio data based on the activation of the VR function to the wireless audio device. According to an embodiment, while the electronic device (500) performs an AR function, it may be possible for the user to recognize the external environment, but while performing a VR function, it may be difficult for the user to recognize the external environment. An electronic device (500) according to one embodiment may acquire information about an external environment (e.g., external environment images, external sounds, external sensing information, and / or operation information of other external electronic devices) independently from a VR function while performing a VR function, and perform control to enable a user to recognize the external environment based on the acquired information about the external environment.

[0099] According to an embodiment, the processor (520) may obtain an image and / or sensing information of an external environment of the electronic device (500) by using at least one of the first to third cameras (511 to 513) and / or a sensor (580) while performing a VR function, and may obtain first information (e.g., object shape, external object location, proximity of external object, external object size, and / or other information associated with the external object) associated with an external object (or surrounding object) (e.g., a person, an animal, or an obstacle) of the electronic device (500) by using the captured image and / or sensing information. According to an embodiment, the processor (520) may obtain a sound external to the electronic device (500) by using a sound input device (562) (e.g., a microphone) while performing a VR function, and may obtain second information (e.g., sound type, sound size, and / or other information associated with the external sound) associated with the external sound of the electronic device (500) by using the obtained external sound. According to an embodiment, the processor (520) may obtain operation information of another electronic device (not shown) from another external electronic device connected using a communication circuit (570) while performing a VR function, and may obtain third information (e.g., operation information of an induction stove, opening of a digital door lock, or other operation information) related to the operation of the other external electronic device using the obtained operation information of the other electronic device. According to an embodiment, the processor (520) may obtain external environment sensing information (e.g., temperature, light intensity, and / or GPS information) of the electronic device (500) using a sensor (580) while performing a VR function, and may obtain fourth information (e.g., external temperature, external light intensity, and / or location information) related to the external environment using the external environment sensing information.

[0100] According to an embodiment, the processor (520) may identify whether the surrounding environment of the electronic device (500) satisfies a specified first condition based on first information associated with an external object, second information associated with an external sound, third information associated with the operation of another external electronic device, and / or fourth information associated with the external environment. According to an embodiment, the specified first condition may be a low-risk condition that requires notifying a user of an external object, an external sound, the operation of another external electronic device, and / or the external environment. According to an embodiment, the processor (520) may identify whether the surrounding environment of the electronic device (500) satisfies a specified second condition based on first information associated with an external object, second information associated with an external sound, third information associated with the operation of another external electronic device, and / or fourth information associated with the external environment. According to an embodiment, the specified second condition may be a high-risk condition that requires notifying a user of an external object, an external sound, the operation of another external electronic device, and / or the external environment.

[0101] According to one embodiment, a condition for a low-risk state in which a user should be notified when an external object approaches within a first distance specified for the user, and a condition for a high-risk state in which a user should be warned when an external object approaches within a second distance that is closer than the first distance specified for the user may be a condition for a high-risk state in which a user should be warned. According to one embodiment, a condition for a low-risk state in which a user should be notified when an external sound is a first type and / or first intensity sound that requires user recognition, and a condition for a high-risk state in which a user should be warned when an external sound is a second type and / or second intensity sound that alerts the user may be a condition for a low-risk state in which a user should be notified when an operation of another external electronic device is a first operation that requires user recognition, and a condition for a high-risk state in which a user should be warned when an operation of another external electronic device is a second operation that requires user recognition. According to one embodiment, if the external environment is a first environment that requires user recognition (e.g., a first temperature or higher, a first light intensity or higher, or a first location), it may be a low-risk condition that requires user notification, and if the external environment is a second environment that requires user warning (e.g., a second temperature or higher, a second light intensity or higher, or a second location), it may be a high-risk condition that requires user warning.

[0102] According to an embodiment, the processor (520) may display visual information corresponding to the specified first condition through the display (550) when the surrounding environment of the electronic device (500) satisfies a specified first condition or transmit a control signal to the wireless audio device to lower the level of the noise canceling function. According to an embodiment, the processor (520) may stop performing the VR function based on the second condition when the surrounding environment of the electronic device (500) satisfies a specified second condition and transmit a noise canceling function deactivation control signal or an ambient sound listening function control signal to the wireless audio device. According to an embodiment, the processor (520) may stop performing the VR function and activate the AR function when the surrounding environment of the electronic device (500) satisfies a specified second condition.

[0103] According to one embodiment, a PMIC (530) can convert power stored in a battery (535) into a current or voltage required by other components of the electronic device (500) and supply it to other components of the electronic device (500).

[0104] A memory (540) according to one embodiment may store various data used by at least one component (e.g., a processor (520), a sensor (580), or another component) of an electronic device (500). A memory (540) according to one embodiment may store instructions (or commands or programs) that cause the processor (520) to operate when executed.

[0105] A display (550) according to one embodiment may display a screen to be provided to a user. The display (550) according to one embodiment may include a display (301) exposed through a significant portion of a front plate (302) as illustrated in FIG. 3, or may include a first display (451), a second display (452), one or more input optical members (453-1, 453-2), one or more transparent members (490-1, 490-2), and / or one or more screen display portions (454-1, 454-2) as illustrated in FIG. 4A.

[0106] An audio device (561) according to an embodiment is connected to a sound input device (562) (e.g., a microphone) and a sound output device (563), and can convert data input through the sound input device (562) and convert data to be output to the sound output device (563). The audio device (561) according to an embodiment may refer to the audio modules (303, 307, 314) of FIG. 3. The sound output device (563) may include a speaker and an amplifier. The sound output device (563) may refer to one or more sound output devices (463-1, 463-2) of FIG. 4A. The sound input device (562) may refer to one or more sound input devices (462-1, 462-2, 462-3) of FIG. 4A.

[0107] A communication circuit (570) according to one embodiment may support the establishment of a wireless communication channel with an electronic device (e.g., a wireless audio device or other electronic device) external to the electronic device (500) and the performance of communication through the established communication channel. The wireless communication according to one embodiment may include short-range wireless communication.

[0108] According to an embodiment, a sensor (580) may include a 6-axis sensor (581), a magnetic sensor (582), a proximity sensor (583), and / or a light sensor (584). According to an embodiment, a sensor (580) may further include a sensor for obtaining a biosignal for detecting whether the electronic device (500) is being worn by a user. For example, the sensor (580) may further include at least one of a heart rate sensor, a skin sensor, or a temperature sensor. According to an embodiment, a processor (520) may confirm (or identify) a movement of a user wearing the electronic device (500) based on sensing information obtained through the 6-axis sensor (581). For example, the 6-axis sensor (581) may detect a change in a direction in which a user faces (or a direction in which the user looks through the electronic device (500)) while the electronic device (500) is being worn, generate a sensor value, and transmit the generated sensor value or the amount of change in the sensor value to the processor (520). A processor (520) according to one embodiment can perform an AR function or a VR function based on a sensor value or a change in a sensor value by a 6-axis sensor (581).

[0109] An audio device (561) according to one embodiment can receive external sounds generated around an electronic device (500) (or a user) through a sound input device (562) and transmit data converted from the received sounds to a processor (520).

[0110] A communication circuit (570) according to one embodiment can transmit and receive data by communicating with an external wireless audio device (e.g., a wireless headset or wireless earphones or other wireless audio device or other electronic device (e.g., a home appliance or a smart watch or other electronic device).

[0111] An electronic device (e.g., an electronic device (101) of FIG. 1, an electronic device (201) of FIG. 2, a mobile electronic device (300) of FIG. 3, an XR electronic device (400) of FIG. 4B, or an electronic device (500) of FIG. 5) according to an embodiment may include a communication circuit (e.g., a communication module (190) of FIG. 1 or a communication circuit (570) of FIG. 5), a memory for storing commands (e.g., a memory (130) of FIG. 1 or a memory (540) of FIG. 5), and a processor (e.g., a processor (120) of FIG. 1 or a processor (520) of FIG. 5). The commands according to an embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to communicate with a wireless audio device (e.g., a wireless audio device (202) of FIG. 2) external to the electronic device through the communication circuit. The commands according to one embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to identify activation or deactivation of a noise-canceling function of the wireless audio device based on a request for transmission of audio data to the wireless audio device. The commands according to one embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to transmit a noise-canceling function activation control signal and the audio data to the wireless audio device based on the identification of the noise-canceling function activation. The commands according to one embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to transmit the noise-canceling deactivation control signal and the audio data to the wireless audio device based on the identification of the noise-canceling function deactivation.

[0112] The commands according to one embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to identify AR function activation or VR function activation based on a request for transmission of the audio data to the wireless audio device. The commands according to one embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to identify noise canceling function deactivation based on AR function activation and to identify noise canceling function activation based on VR function activation.

[0113] According to an embodiment, the electronic device may further include a display (e.g., the display module (160) of FIG. 1 or the display module (550) of FIG. 5), and at least one camera (e.g., the camera module (180) of FIG. 1, the first camera (511) of FIG. 5, the second camera (512) of FIG. 5, or the third camera (513) of FIG. 5). The instructions according to an embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to obtain an image associated with the exterior of the electronic device using the at least one camera while performing the VR function, and to obtain first information associated with an object external to the electronic device (500) using the obtained image.

[0114] According to an embodiment, the electronic device (500) may further include a microphone (e.g., a sound input device (562) of FIG. 5). The instructions according to an embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to obtain sound from the outside of the electronic device using the microphone (562) while performing the VR function, and to obtain second information associated with the sound from the outside of the electronic device (500).

[0115] The above commands according to one embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to obtain operation information of the external electronic device from an external electronic device connected to the electronic device (500) through the communication circuit (570) while performing the VR function, and to obtain third information related to the operation of the external electronic device using the operation information of the external electronic device.

[0116] The electronic device according to one embodiment may further include a sensor (e.g., sensor module (176) of FIG. 1 or sensor (580) of FIG. 5).

[0117] The above commands according to one embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to obtain fourth information related to the external environment of the electronic device (500) using sensing information obtained by the sensor (580) while performing the VR function.

[0118] The instructions according to one embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to identify whether a specified first condition is satisfied based at least in part on the first information, the second information, the third information, or the fourth information, and to display visual information corresponding to the specified first condition on the display (550) based on the satisfaction of the specified first condition, or to transmit a signal to the wireless audio device for controlling the lowering of the level of the noise canceling function.

[0119] The instructions according to one embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to identify whether a second condition specified based at least in part on the first information, the second information, the third information, or the fourth information is satisfied, and to stop performing the VR function based on satisfaction of the second condition specified, and to transmit a noise canceling function deactivation control signal or an ambient sound listening function control signal to the wireless audio device.

[0120] The above commands according to one embodiment, when executed by the processor, may cause the electronic device (500) (or the processor (520)) to activate the AR function after stopping the execution of the VR function based on satisfaction of the specified second condition.

[0121] An electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (500) of FIG. 5) according to an embodiment may include a communication circuit (e.g., the communication module (190) of FIG. 1 or the communication circuit (570) of FIG. 5), a memory (e.g., the memory (130) of FIG. 1 or the memory (540) of FIG. 5) for storing commands), and a processor (e.g., the processor (120) of FIG. 1 or the processor (520) of FIG. 5). The commands according to an embodiment, when executed by the processor, may cause the electronic device (500) to activate a VR function based on a request for performing a VR function while performing an AR function, or to activate the AR function based on a request for performing the AR function while performing the VR function. The commands according to one embodiment, when executed by the processor, may cause the electronic device (500) to transmit a noise canceling function activation control signal to a wireless audio device connected to the electronic device (500) using the communication circuit (570) based on the activation of the VR function. The commands according to one embodiment, when executed by the processor, may cause the electronic device (500) to transmit a noise canceling function deactivation control signal or an ambient sound listening control signal to the wireless audio device connected to the electronic device using the communication circuit (570) based on the activation of the AR function.

[0122] An electronic device according to an embodiment may further include a display (e.g., a display module (160) of FIG. 1 or a display (550) of FIG. 5), at least one camera (e.g., 180, 511, 512, 513), a microphone, and a sensor (e.g., a sensor module (176) of FIG. 1 or a sensor (580) of FIG. 5). The instructions according to an embodiment, when executed by the processor, may cause the electronic device (500) to obtain information related to a surrounding environment of the electronic device (500) by using at least one of the at least one camera (511, 512, 513), the microphone (562), the communication circuit (570), and the sensor (580) while performing a VR function. Information related to the surrounding environment of the electronic device (500) according to one embodiment may include at least some of first information related to an object outside the electronic device (500) obtained based on an image captured by the at least one camera (511, 512, 513), second information related to a sound outside the electronic device (500) obtained through the microphone (562), third information related to an operation of another electronic device received from another electronic device connected to the electronic device (500) through the communication circuit (570), and fourth information related to an external environment of the electronic device (500) obtained using sensing information obtained by the sensor (580).

[0123] The instructions according to one embodiment, when executed by the processor, may cause the electronic device (500) to identify whether a first condition specified based on information associated with the surrounding environment of the electronic device (500) is satisfied, and to display visual information corresponding to the first condition specified based on satisfaction of the first condition on the display or to transmit an ambient sound listening control signal to the wireless audio device.

[0124] The instructions according to one embodiment, when executed by the processor, may cause the electronic device (500) to identify whether a second condition specified based on information associated with the surrounding environment of the electronic device (500) is satisfied, and to stop performing the VR function based on satisfaction of the second condition specified, and to transmit a noise canceling function deactivation control signal or an ambient sound listening function control signal to the wireless audio device.

[0125] FIG. 6 is a flowchart illustrating an operation for controlling noise canceling of a wireless audio device in an electronic device according to an embodiment of the present disclosure.

[0126] Referring to FIG. 6, a processor (e.g., processor 120 of FIG. 1 or processor 520 of FIG. 5) of an electronic device (e.g., electronic device 101 of FIG. 1, electronic device 201 of FIG. 2, mobile electronic device 300 of FIG. 3, XR electronic device 400 of FIG. 4A, or electronic device 500 of FIG. 5) according to an embodiment may perform at least one of operations 610, 620, and 630. In an embodiment, at least one of operations 610, 620, and 630 may be omitted, the order of some operations may be changed, or another operation may be added.

[0127] In operation 610, the processor (520) according to one embodiment may perform a communication connection with an external wireless audio device (e.g., the electronic device (102) of FIG. 1 or the wireless audio device (202) of FIG. 2) through a communication circuit (570). When connected to a pair of wireless earphones, the processor (520) according to one embodiment may establish communication with each of the pair of wireless earphones, or establish communication with one earphone and allow the other earphone to receive data from the electronic device (500) through sniffing based on communication connected to the one earphone.

[0128] In operation 620, the processor (520) according to an embodiment may identify whether to activate the noise canceling function of the wireless audio device, deactivate the noise canceling function, or control the ambient sound listening function based on transmission of audio data to the wireless audio device. The processor (520) according to an embodiment may identify whether to activate the noise canceling function of the wireless audio device, deactivate the noise canceling function, or control the ambient sound listening function based on a request for transmission of audio data through a communication connection with the wireless audio device. The processor (520) according to an embodiment may identify whether to activate the noise canceling function of the wireless audio device, deactivate the noise canceling function, or control the ambient sound listening function of the wireless audio device that receives the broadcasted audio data while broadcasting audio data (e.g., using a broadcast isochronous stream). According to one embodiment, a processor (520) can identify whether to activate or deactivate the noise canceling function of the wireless audio device or control the ambient sound listening function based on audio data transmission from an external electronic device (not shown) (e.g., an audio data providing VHS device) to the wireless audio device during a communication connection with the wireless audio device.

[0129] According to one embodiment, the noise canceling function may be a function that prevents the user from hearing surrounding sounds other than the sound of audio data through the wireless audio device. According to one embodiment, the noise canceling deactivation function may be a function that turns off the noise canceling activation of the wireless audio device. According to one embodiment, the ambient sound listening function may be a function that allows the user to hear surrounding sounds other than the sound of audio data through the wireless audio device. According to one embodiment, the ambient sound listening function may be a function that allows the user wearing the wireless audio device to hear surrounding sounds when noise canceling is deactivated. For example, the ambient sound listening function may be a function that allows the wireless audio device to allow the user to hear surrounding sounds other than the sound of audio data according to a designated ambient sound listening level (e.g., low, medium, high). For example, when the ambient sound listening level is designated (or set) to low, the processor (520) may control the wireless audio device to transmit a low-level ambient sound listening function control signal, and the wireless audio device may allow the ambient sounds to be heard at a designated low level based on the low-level ambient sound listening control signal. For example, when the ambient sound hearing level is designated (or set) as medium, the processor (520) can control to transmit a medium-level ambient sound hearing function control signal to the wireless audio device, and the wireless audio device can cause the ambient sound to be heard at the designated medium level based on the medium-level ambient sound hearing control signal. For example, when the ambient sound hearing level is designated (or set) as high, the processor (520) can control to transmit a high-level ambient sound hearing function control signal to the wireless audio device, and the wireless audio device can cause the ambient sound to be heard at the designated high level based on the high-level ambient sound hearing control signal.According to one embodiment, the ambient sound hearing level may be adjusted to various levels, in addition to low, medium, and high, depending on user settings. According to one embodiment, when the ambient sound hearing level is designated (or set) to high, the processor (520) may amplify the ambient sound received through the sound input device (562) and output it through the sound output device (563).

[0130] In one embodiment, the processor (520) may identify AR function activation (or AR mode) or VR function activation (or VR mode) based on a request for transmitting audio data to a wireless audio device, identify noise-canceling function deactivation control or ambient sound listening function control based on the AR function activation, and identify noise-canceling function activation control based on the VR function activation. In one embodiment, the processor (520) may identify noise-canceling function deactivation control or ambient sound listening function control for the wireless audio device based on a request for transmitting audio data to an external wireless audio device in an AR function activated state. In one embodiment, the processor (520) may identify noise-canceling function activation control for the wireless audio device based on a request for transmitting audio data to an external wireless audio device in a VR function activated state.

[0131] According to an embodiment, the processor (520) may identify AR function activation based on an AR button input during transmission of audio data from the electronic device (500) or an external electronic device (not shown) to the wireless audio device, or may identify VR function activation based on a VR button input. According to an embodiment, the processor (520) may identify a transition from AR function activation to VR function activation (AR function deactivation and VR function activation) based on an AR / VR switching button input during transmission of audio data from the electronic device (500) or an external electronic device (not shown) to the wireless audio device, or may identify a transition from VR function activation to AR function activation (VR function deactivation and AR function activation). According to an embodiment, when AR function activation is identified during transmission of audio data to the wireless audio device, the processor (520) may identify noise canceling function deactivation control or ambient sound listening function control for the wireless audio device. According to one embodiment, the processor (520) may identify a control to activate a noise canceling function for the wireless audio device when activation of a VR function is identified during transmission of audio data to the wireless audio device.

[0132] In operation 630, the processor (520) according to an embodiment may transmit a noise-canceling function activation control signal, a noise-canceling function deactivation control signal, or an ambient sound listening function control signal to the wireless audio device based on identification of the noise-canceling function activation, the noise-canceling function deactivation, or the ambient sound listening function for the wireless audio device. The processor (520) according to an embodiment may transmit a noise-canceling function activation control signal, a noise-canceling function activation control signal, or an ambient sound listening function control signal to be applied in association with the output of audio data transmitted to or received from the wireless audio device. The processor (520) according to an embodiment may transmit a noise-canceling function deactivation control signal or an ambient sound listening function control signal to the wireless audio device when a request for audio data transmission is made to an external wireless audio device in an AR function activated state, and may transmit audio data to the wireless audio device. According to one embodiment, when a request is made to transmit audio data to an external wireless audio device while the VR function is activated, the processor (520) may transmit a noise canceling function activation control signal to the wireless audio device and then transmit audio data to the wireless audio device.

[0133] FIG. 7 is a flowchart illustrating an operation for controlling noise canceling of an external wireless audio device in a VR function-activated state of an electronic device according to an embodiment of the present disclosure.

[0134] Referring to FIG. 7, a processor (e.g., the processor (120) of FIG. 1 or the processor (520) of FIG. 5) of an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4A, or the electronic device (500) of FIG. 5) according to an embodiment may perform at least one operation among operations 710, 720, 730, 740, 750, and 760. In an embodiment, at least one of operations 710, 720, 730, 740, 750, and 760 may be omitted, the order of some operations may be changed, or another operation may be added.

[0135] In operation 710, the processor (520) according to one embodiment may transmit audio data associated with performing the VR function and a noise canceling activation control signal to an external wireless audio device based on the activation of the VR function. For example, the audio data associated with performing the VR function may include audio data corresponding to the VR function or VR content and / or audio data (e.g., music) that is requested to be output separately from the provision of the VR function or VR content.

[0136] In operation 720, the processor (520) according to an embodiment may obtain information associated with the exterior of the electronic device (500) while performing a VR function. The processor (520) according to an embodiment may obtain at least one of first information associated with an object external to the electronic device (500) while performing a VR function, second information associated with a sound external to the electronic device (500), third information associated with an operation of another electronic device external to the electronic device (500), and fourth information associated with an external environment of the electronic device (500). According to an embodiment, the processor (520) may obtain an image and / or sensing information of an external environment of the electronic device (500) by using at least one of the first to third cameras (511 to 513) and / or a sensor (580) while performing a VR function, and may obtain first information (e.g., object shape, external object location, proximity of external object, external object size, and / or other information associated with the external object) associated with an external object (or surrounding object) (e.g., a person, an animal, or an obstacle) of the electronic device (500) by using the captured image and / or sensing information. According to an embodiment, the processor (520) may obtain a sound external to the electronic device (500) by using a sound input device (562) (e.g., a microphone) while performing a VR function, and may obtain second information (e.g., sound type, sound size, and / or other information associated with the external sound) associated with the external sound of the electronic device (500) by using the obtained external sound. According to one embodiment, a processor (520) may obtain operation information of another electronic device from another external electronic device (not shown) connected using a communication circuit (570) while performing a VR function, and may obtain third information (e.g., operation information of an induction stove, opening of a digital door lock, or other operation information) related to the operation of another external electronic device using the obtained operation information of the other electronic device.According to one embodiment, a processor (520) may obtain external environment sensing information (e.g., temperature, light intensity, and / or GPS information) of an electronic device (500) using a sensor (580) while performing a VR function, and may obtain fourth information (e.g., external temperature, external light intensity, and / or location information) related to an external environment using the external environment sensing information.

[0137] In operation 730, the processor (520) according to an embodiment may identify whether information associated with the outside of the electronic device (500) (e.g., the surrounding environment) satisfies a specified first condition based on first information associated with an external object, second information associated with an external sound, third information associated with an operation of another external electronic device, and / or fourth information associated with an external environment. The specified first condition according to an embodiment may be a low-risk condition that requires notifying the user of an external object, an external sound, an operation of another external electronic device, and / or an external environment.

[0138] In operation 740, the processor (520) according to one embodiment may, when the surrounding environment of the electronic device (500) satisfies a specified first condition, display visual information corresponding to the specified first condition (e.g., information on an external object, an external sound, an operation of another external electronic device, and / or a low-risk state for the external environment) through the display module (550) or transmit a control signal to the wireless audio device to lower the level of the noise canceling function.

[0139] In operation 750, the processor (520) according to an embodiment may identify whether the surrounding environment of the electronic device (500) satisfies a specified second condition based on first information associated with an external object, second information associated with an external sound, third information associated with an operation of another external electronic device, and / or fourth information associated with an external environment, if information associated with the outside of the electronic device (500) does not satisfy the first condition. The specified second condition according to an embodiment may be a high-risk condition that requires a user to be warned of an external object, an external sound, an operation of another external electronic device, and / or an external environment.

[0140] According to one embodiment, a condition for a low-risk state in which a user should be notified when an external object approaches within a first distance specified for the user, and a condition for a high-risk state in which a user should be warned when an external object approaches within a second distance that is closer than the first distance specified for the user may be a condition for a high-risk state in which a user should be warned. According to one embodiment, a condition for a low-risk state in which a user should be notified when an external sound is a first type and / or first intensity sound that requires user recognition, and a condition for a high-risk state in which a user should be warned when an external sound is a second type and / or second intensity sound that alerts the user may be a condition for a low-risk state in which a user should be notified when an operation of another external electronic device is a first operation that requires user recognition, and a condition for a high-risk state in which a user should be warned when an operation of another external electronic device is a second operation that requires user recognition. According to one embodiment, if the external environment is a first environment that requires user recognition (e.g., a first temperature or higher, a first light intensity or higher, or a first location), it may be a low-risk condition that requires user notification, and if the external environment is a second environment that requires user warning (e.g., a second temperature or higher, a second light intensity or higher, or a second location), it may be a high-risk condition that requires user warning.

[0141] In operation 760, the processor (520) according to one embodiment may, if the surrounding environment of the electronic device (500) satisfies the specified second condition, stop performing the VR function in response to the specified second condition and transmit a noise canceling function deactivation control signal or an ambient sound listening function control signal to the wireless audio device. The processor (520) according to one embodiment may also stop performing the VR function and activate the AR function in response to the specified second condition.

[0142] In the description of FIG. 7 according to one embodiment, an example of first identifying whether information related to the outside of the electronic device (500) satisfies a specified first condition, such as operation 730, was described, but it is also possible to first identify whether information related to the outside of the electronic device (500) satisfies a specified second condition, such as operation 750, and then perform operation 730. According to one embodiment, the processor (520) may periodically perform operation 720, operation 730, and / or operation 750.

[0143] In an embodiment, a method for controlling a noise canceling function of a wireless audio device (e.g., the electronic device (102) of FIG. 1 or the electronic device (202) of FIG. 2) in an electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4a, or the electronic device (500) of FIG. 5) may include an operation of performing communication with a wireless audio device external to the electronic device through a communication circuit (e.g., the communication module (190) of FIG. 1 or the communication circuit (570) of FIG. 5). In an embodiment, the method may include an operation of identifying activation or deactivation of a noise canceling function of the wireless audio device based on a request for transmitting audio data to the wireless audio device. The method according to one embodiment may include an operation of transmitting a noise-canceling function activation control signal and the audio data to the wireless audio device based on the noise-canceling function activation identification, or transmitting a noise-canceling function deactivation control signal and the audio data to the wireless audio device based on the noise-canceling function deactivation identification.

[0144] According to one embodiment, the method may further include an operation of identifying AR function activation or VR function activation based on a request for transmission of the audio data to the wireless audio device. According to one embodiment, the method may further include an operation of identifying noise-canceling function deactivation based on AR function activation, or identifying noise-canceling function activation based on VR function activation.

[0145] According to an embodiment, the method may further include an operation of performing a VR function based on activation of the VR function, and obtaining information related to a surrounding environment of the electronic device by using at least one of a camera (e.g., a camera module (180) of FIG. 1 or the first to third cameras (511, 512, 513) of FIG. 5), a microphone (e.g., a sound input device of FIG. 5), a communication circuit (e.g., a communication module (190) of FIG. 1 or a communication circuit (570) of FIG. 5), and a sensor (e.g., a sensor module (176) of FIG. 1 or a sensor (580) of FIG. 5) while performing the VR function.

[0146] In the method according to one embodiment, information related to the surrounding environment of the electronic device (500) may include at least some of first information related to an object outside the electronic device (500) obtained based on an image captured by the at least one camera (180, 511, 512, 513), second information related to a sound outside the electronic device (500) obtained through the microphone (564), third information related to an operation of another electronic device received from another electronic device connected to the electronic device (500) through the communication circuit (570), and fourth information related to the surrounding environment of the electronic device (500) obtained using sensing information obtained by the sensor (580).

[0147] According to one embodiment, the method may further include an operation of acquiring an image associated with the exterior of the electronic device (500) using the at least one camera (180, 511, 512, 513) while performing the VR function based on the activation of the VR function. According to one embodiment, the method may further include an operation of acquiring first information associated with an object external to the electronic device (500) using the acquired image.

[0148] According to one embodiment, the method may further include an operation of acquiring external sound of the electronic device (500) using a microphone (564) while performing the VR function based on activation of the VR function. According to one embodiment, the method may further include an operation of acquiring second information associated with the external sound of the electronic device (500) using the acquired sound.

[0149] According to one embodiment, the method may further include an operation of acquiring operation information of another electronic device from another external electronic device connected to the electronic device (500) through the communication circuit (570) while performing the VR function based on the activation of the VR function. According to one embodiment, the method may further include an operation of acquiring third information related to the operation of the other electronic device using the acquired operation information of the other electronic device.

[0150] The method according to one embodiment may further include an operation of identifying whether a specified first condition is satisfied based on information associated with the surrounding environment of the electronic device (500). The method according to one embodiment may further include an operation of displaying visual information corresponding to the specified first condition on the display based on satisfaction of the specified first condition, or transmitting a signal for controlling the wireless audio device to lower the level of the noise canceling function.

[0151] The method according to one embodiment may further include an operation of identifying whether a second condition specified based on information associated with the surrounding environment of the electronic device (500) is satisfied. The method according to one embodiment may further include an operation of stopping the performance of the VR function based on satisfaction of the second condition specified and transmitting a noise canceling function deactivation control signal or an ambient sound listening function control signal to the wireless audio device.

[0152] The method according to one embodiment may further include an operation of activating the AR function after stopping the execution of the VR function based on satisfaction of the second condition specified above.

[0153] FIG. 8 is a block diagram of a wireless audio device according to an embodiment of the present disclosure.

[0154] Referring to FIG. 8, a wireless audio device (e.g., an electronic device (102) of FIG. 1 or an electronic device (202) of FIG. 2) (802) according to an embodiment may be an ear-wearable device implemented as a pair (or both) of earphones (e.g., earbuds) or a headset. The wireless audio device (802) according to an embodiment may also be configured to be wiredly connected to an electronic device (e.g., an electronic device (101) of FIG. 1, an electronic device (201) of FIG. 2, a mobile electronic device (300) of FIG. 3, an XR electronic device (400) of FIG. 4A, or an electronic device (500) of FIG. 5) (hereinafter, the electronic device (500) of FIG. 5 will be described as an example). According to an embodiment, a wireless audio device (802) may form a communication link (e.g., a communication link using a short-range communication technology (e.g., Bluetooth communication technology) or a wired communication link (or connection)) with an electronic device. According to an embodiment, the wireless audio device (802) may receive a noise-canceling activation control signal, a noise-canceling deactivation control signal, or an ambient sound listening function control signal and audio data from the electronic device (500) through the communication link. According to an embodiment, the wireless audio device (802) may receive audio data broadcast using BIS, and may also receive a noise-canceling activation control signal, a noise-canceling deactivation control signal, or an ambient sound listening function control signal and audio data from the electronic device (500). For convenience of explanation, in this document, the configuration of one earphone among a pair of earphones may be described as the configuration of the electronic device (802). The technical features of the electronic device (802) may be equally applied to the other earphone among the pair.

[0155] A wireless audio device (802) according to one embodiment may include a processor (820), a memory (830), a communication circuit (840), an audio device (850), a sensor (860), an input device (870), a noise canceling circuit (880), at least one microphone (852), and at least one speaker (854).

[0156] A processor (820) according to an embodiment may receive data from other components of a wireless audio device (802), for example, a memory (830), a communication circuit (840), an audio device (850), a sensor (860), an input device (870), a noise canceling circuit (880), at least one microphone (852), or at least one speaker (854), perform a calculation based on the received data, and transmit a signal for controlling other components to other components. A processor (820) according to an embodiment may communicate with an electronic device (500) through a communication circuit (840). A processor (820) according to an embodiment may receive a noise canceling function activation control signal, a noise canceling function deactivation control signal, or an ambient sound listening function control signal and audio data from the electronic device (500) using the communication circuit (840). According to an embodiment, the processor (820) may control the noise canceling circuit (880) to activate (or perform) the noise canceling function when playing audio data based on receiving a noise canceling function activation control signal. According to an embodiment, the processor (820) may control the noise canceling circuit (880) to deactivate (or not perform) the noise canceling function when playing audio data based on receiving a noise canceling function deactivation control signal. According to an embodiment, the processor (820) may control the noise canceling circuit (880) to perform the ambient sound listening function when playing audio data based on receiving an ambient sound listening function control signal.

[0157] According to an embodiment, the processor (820) may control the noise canceling circuit (880) to deactivate the noise canceling function when the noise canceling function is activated based on a user input through the input device (870), or control the noise canceling circuit (880) to activate the noise canceling function when the noise canceling function is deactivated, or control the noise canceling circuit (880) to perform the ambient sound listening function when the noise canceling function is deactivated, or control the noise canceling circuit (880) to deactivate the noise canceling function when the ambient sound listening function is performed.

[0158] According to one embodiment, the memory (830) may store instructions (or commands or programs) that are set to cause the processor (820) to perform a specified operation when executed. According to one embodiment, the memory (830) may store instructions that are set to cause other components other than the processor (820) to perform a specified operation. According to one embodiment, the memory (830) may store acquired audio data received through the communication circuit (840).

[0159] A communication circuit (840) according to an embodiment may perform communication (e.g., short-range wireless communication) with an electronic device (500). As an example, the short-range wireless communication may include at least one of Bluetooth, BLE (Bluetooth low energy), IrDA (infrared data association), or wireless LAN. The type of communication supported by the communication circuit (840) may not be limited. A communication circuit (840) according to an embodiment may receive a noise-canceling function activation control signal, a noise-canceling function deactivation control signal, or an ambient sound listening function control signal and audio data from the electronic device (500).

[0160] An audio device (850) according to one embodiment may convert audio data into an analog audio signal and output the same through at least one speaker (854). An audio device (850) according to one embodiment may convert an audio signal received through at least one microphone (852) into audio data and provide the converted audio data to a processor (820).

[0161] A noise canceling circuit (880) according to an embodiment may include a noise canceling circuit (not shown), at least one microphone (not shown) (e.g., at least one microphone for a noise canceling circuit), and at least one speaker (not shown) (e.g., at least one speaker for a noise canceling circuit). The noise canceling circuit (880) according to an embodiment may cancel or block external noise that interferes when outputting an analog audio signal corresponding to audio data by using the noise canceling circuit, at least one microphone (not shown), and at least one speaker (not shown). The noise canceling circuit (880) according to an embodiment may cancel noise by analyzing a wave of external noise received by using at least one microphone (not shown) and generating (or outputting) a wave having an opposite phase thereto through at least one speaker (not shown) by using the noise canceling circuit.

[0162] A sensor (860) according to one embodiment may include a biometric sensor for detecting whether a user is wearing the wireless audio device (802). For example, the biometric sensor may include at least one of a heart rate sensor, a skin sensor, or a temperature sensor.

[0163] An input device (870) according to one embodiment may receive at least one input by a user. The at least one input by a user according to one embodiment may include an input associated with turning on or off the wireless audio device, stopping or starting audio data output, activating a noise canceling function, deactivating a noise canceling function, or listening to an ambient sound function.

[0164] A wireless audio device (e.g., a wireless audio device (202) of FIG. 2 or a wireless audio device (802) of FIG. 8) according to an embodiment may include a communication circuit (e.g., a communication circuit (840) of FIG. 8), an audio device (e.g., an audio device (850) of FIG. 8), a noise canceling circuit (e.g., a noise canceling circuit (880) of FIG. 8), a memory for storing commands (e.g., a memory (830) of FIG. 8), and a processor (e.g., a processor (820) of FIG. 8). The commands according to an embodiment, when executed by the processor, may cause the wireless audio device to communicate with an external electronic device (e.g., an electronic device (101) of FIG. 1, an electronic device (201) of FIG. 2, or an electronic device (500) of FIG. 5) through the communication circuit (840). The instructions according to one embodiment, when executed by the processor, may cause the wireless audio device to receive audio data from the electronic device. The instructions according to one embodiment, when executed by the processor, may cause the wireless audio device to control the noise canceling circuit to activate the noise canceling function when playing the audio data based on receiving a noise canceling function activation control signal from the electronic device. The instructions according to one embodiment, when executed by the processor, may cause the wireless audio device to control the noise canceling circuit to deactivate the noise canceling function when playing the audio data based on receiving a noise canceling function deactivation control signal from the electronic device.

[0165] The wireless audio device according to one embodiment may further include an input device (e.g., input device (870) of FIG. 8). The instructions according to one embodiment, when executed by the processor, may cause the wireless audio device to control the noise canceling circuit to deactivate or activate the noise canceling function based on a user input through the input device (870).

[0166] FIG. 9 is a flowchart of the operation of a wireless audio device according to an embodiment of the present disclosure.

[0167] Referring to FIG. 9, a processor (e.g., a processor (820) of FIG. 8) of a wireless audio device (e.g., an electronic device (102) of FIG. 1, a wireless audio device (202) of FIG. 2, or a wireless audio device (802) of FIG. 8) according to an embodiment may perform at least one of operations 910, 920, and 930. In an embodiment, at least one of operations 910, 920, and 930 may be omitted, the order of some operations may be changed, or another operation may be added.

[0168] In operation 910, the processor (820) according to an embodiment may communicate with the electronic device (500) through the communication circuit (840). The processor (820) according to an embodiment may communicate with another wireless audio device that is paired with the wireless audio device (802) while performing BLE (Bluetooth low energy) communication with the electronic device (500) through the communication circuit (840). The processor (820) according to an embodiment may enable the other wireless audio device to obtain data or signals transmitted from the electronic device (500) to the wireless audio device through sniffing. The processor (820) according to an embodiment may also communicate with another audio data providing device that provides audio data through the communication circuit (840) based on control through communication with the electronic device (500).

[0169] In operation 920, the processor (820) according to an embodiment may receive a noise canceling function activation control signal, a noise canceling function deactivation control signal, or a noise canceling control signal and audio data from the electronic device (500) using the communication circuit (840). The processor (820) according to an embodiment may not receive audio data from the electronic device (500), but may also receive audio data broadcast from a BIS (broadcast isochronous stream) source device (e.g., an external electronic device) by synchronizing with the BIS source device.

[0170] In operation 930, the processor (820) according to an embodiment may control the noise canceling circuit (880) to activate (or perform) the noise canceling function, deactivate (or not perform) the noise canceling function, or perform the ambient sound listening function when playing audio data based on reception of a noise canceling function activation control signal, a noise canceling deactivation control signal, or an ambient sound listening function control signal. The noise canceling function according to an embodiment may be a function that prevents the user from hearing ambient sounds other than the sound of the audio data through the wireless audio device (202). The noise canceling deactivation function according to an embodiment may be a function that turns off the noise canceling activation of the wireless audio device (202). The ambient sound listening function according to an embodiment may be a function that allows the user to hear ambient sounds other than the sound of the audio data through the wireless audio device (202). The ambient sound listening function according to an embodiment may be a function that allows the user wearing the wireless audio device to hear ambient sounds in a state where noise canceling is deactivated. For example, the ambient sound listening function may be a function that allows the wireless audio device (202) to allow the user to hear ambient sounds other than the sounds of audio data at a designated ambient sound listening level (e.g., low, medium, high). For example, when the ambient sound listening level is designated (or set) to low, the electronic device (201) may transmit a low-level ambient sound listening function control signal to the wireless audio device (202), and the wireless audio device (202) may allow the ambient sounds to be heard at a designated low level based on the low-level ambient sound listening control signal.For example, when the ambient sound hearing level is designated (or set) to medium, the electronic device (201) can transmit a medium-level ambient sound hearing function control signal to the wireless audio device (202), and the wireless audio device (202) can cause ambient sounds to be heard at the designated medium level based on the medium-level ambient sound hearing control signal. For example, when the ambient sound hearing level is designated (or set) to high, the electronic device (201) can transmit a high-level ambient sound hearing function control signal to the wireless audio device (202), and the wireless audio device (202) can cause ambient sounds to be heard at the designated high level based on the high-level ambient sound hearing control signal. According to an embodiment, the ambient sound hearing level may be adjusted to various levels according to user settings in addition to low, medium, and high. According to an embodiment, a method of operating a wireless audio device (e.g., the wireless audio device (202) of FIG. 2 or the wireless audio device (802) of FIG. 8) may include an operation of performing communication with an external electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, or the electronic device (500) of FIG. 5) through a communication circuit (e.g., the communication circuit (840) of FIG. 8). The method according to an embodiment may include an operation of receiving audio data from the electronic device. The method according to an embodiment may include an operation of activating the noise canceling function when playing the audio data based on receiving a noise canceling function activation control signal from the electronic device. The method according to an embodiment may include an operation of deactivating the noise canceling function when playing the audio data based on receiving a noise canceling function deactivation control signal from the electronic device.

[0171] FIG. 10A is a diagram illustrating an example of transmitting a noise canceling activation signal and audio data to a wireless audio device based on a user input in a mobile electronic device according to an embodiment of the present disclosure.

[0172] Referring to FIG. 10A, a mobile electronic device (1001) (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4A, or the electronic device (500) of FIG. 5) (e.g., a smart phone) according to an embodiment may execute an application and identify a user input (e.g., an audio data playback request) (control(play)) using a control interface of the application. The mobile electronic device (1001) according to an embodiment may transmit a noise cancelling function activation control signal (noise cancelling) and audio data to a wireless audio device (1002) based on the audio playback request. In one embodiment, a mobile electronic device (1001) may transmit a noise cancelling function activation control signal (noise cancelling) and audio data to a wireless audio device (1002) based on an audio playback request when noise cancelling activation and audio playback are linked.

[0173] A wireless audio device (1002) according to one embodiment can receive a noise canceling function activation control signal and audio data from a mobile electronic device (1001) and activate the noise canceling function when playing audio data.

[0174] FIG. 10b is a diagram illustrating an example of transmitting a noise canceling activation signal and audio data to a wireless audio device based on a control signal from another electronic device in a mobile electronic device according to an embodiment of the present disclosure.

[0175] Referring to FIG. 10B, a mobile electronic device (1001) (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4A, or the electronic device (500) of FIG. 5) (e.g., a smart phone) according to an embodiment may receive an audio data playback request (control(play)) from another electronic device (1003) (e.g., a smart watch) connected through separate communication. The mobile electronic device (1001) according to an embodiment may transmit a noise cancelling function activation control signal (noise cancelling) and audio data to a wireless audio device (1002) based on the audio playback request received from the other electronic device (1003) connected through communication. According to an embodiment, a mobile electronic device (1001) may transmit a noise cancelling function activation control signal (noise cancelling) and audio data to a wireless audio device (1002) based on an audio playback request received from another electronic device (1003) when noise cancelling activation and audio playback are linked. According to an embodiment, a wireless audio device (1002) may receive a noise cancelling function activation control signal and audio data from the mobile electronic device (1001) and activate the noise cancelling function when playing the audio data. According to an embodiment, another electronic device (1003) may also transmit a noise cancelling function activation control signal (noise cancelling) and audio data to the wireless audio device (1002) based on a direct audio playback request.

[0176] FIG. 11A is a diagram illustrating an example of transmitting a noise canceling activation control signal and audio data to one of a pair of wireless audio devices in a mobile electronic device according to an embodiment of the present disclosure.

[0177] Referring to FIG. 11A, an example may be shown in which a mobile electronic device (1001) transmits a noise cancelling activation control signal (noise cancelling) and audio data to one of a pair (or both) of wireless audio devices (1102-1, 1102-2) (e.g., the first wireless audio device (1102-1)), and the first wireless audio device (1102-1) relays the noise cancelling activation control signal (noise cancelling) and audio data to another second wireless audio device (1102-2).

[0178] Referring to FIG. 11A, a mobile electronic device (1001) (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4A, or the electronic device (500) of FIG. 5) (e.g., a smart phone) according to an embodiment may execute an application and identify a user input (e.g., an audio data playback request) (control(play)) using a control interface of the application. The mobile electronic device (1001) according to an embodiment may transmit a noise cancelling activation control signal (noise cancelling) and audio data (audio data) to a first wireless audio device (1102-1) (primary(L)) among a pair (or both) of wireless audio devices (1102-1, 1102-2) based on the audio playback request. According to an embodiment, a first wireless audio device (1102-1) (primary (L)) may transmit the received noise canceling activation control signal (noise cancelling) and audio data to a second wireless audio device (1102-2) (secondary (R)) through separate communication with the second wireless audio device (1102-2). According to an embodiment, the first wireless audio device (1102-1) (primary (L)) and the second wireless audio device (1102-2) (secondary (R)) may output audio data while performing audio data playback synchronization.

[0179] FIG. 11b is a diagram illustrating an example of transmitting a noise canceling activation signal and audio data to one of a pair of wireless audio devices and transmitting audio data to the other wireless audio device in a mobile electronic device according to an embodiment of the present disclosure.

[0180] Referring to FIG. 11b, when a mobile electronic device (1001) transmits a noise cancelling activation control signal (noise cancelling) and audio data to one of a pair (or both) of wireless audio devices (1102-1, 1102-2) (e.g., the first wireless audio device (1102-1)), the noise cancelling activation control signal is relayed by the first wireless audio device (1102-1) to a second wireless audio device (1102-2), and the audio data is transmitted in a sniffing manner by the second wireless audio device (1102-2).

[0181] Referring to FIG. 11B, a mobile electronic device (1001) (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4A, or the electronic device (500) of FIG. 5) (e.g., a smart phone) according to an embodiment may execute an application and identify a user input (e.g., an audio data playback request) (control(play)) using a control interface of the application. The mobile electronic device (1001) according to an embodiment may transmit a noise cancelling activation control signal (noise cancelling) and audio data (audio data) to a first wireless audio device (1102-1) (primary(L)) among a pair (or both) of wireless audio devices (1102-1, 1102-2) based on the audio playback request. According to an embodiment, a first wireless audio device (1102-1) (primary (L)) may transmit the received noise cancelling activation control signal (noise cancelling) to a second wireless audio device (1102-2) (secondary (R)) through separate communication with the second wireless audio device (1102-2). According to an embodiment, a second wireless audio device (1102-2) (secondary (R)) may receive audio data transmitted from a mobile electronic device (1001) to the first wireless audio device (1102-1) (primary (L)) by eavesdropping (sniffing), and may receive a noise cancelling activation control signal from the first wireless audio device (1102-1) (primary (L)).According to one embodiment, the second wireless audio device (1102-2) (secondary (R)) may also receive audio data and noise canceling activation control signals (noise cancelling) transmitted from the mobile electronic device (1001) to the first wireless audio device (1102-1) (primary (L)) by eavesdropping (sniffing).

[0182] FIG. 11c is a diagram illustrating an example of transmitting a noise canceling activation signal and audio data to each of a pair of wireless audio devices in a mobile electronic device according to an embodiment of the present disclosure.

[0183] FIG. 11c illustrates an example in which a mobile electronic device (1001) transmits a noise canceling activation control signal (noise cancelling) and audio data to each of a pair (or both) of wireless audio devices (1102-1, 1102-2) using a BLE audio transmission method.

[0184] Referring to FIG. 11C, a mobile electronic device (1001) (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4A, or the electronic device (500) of FIG. 5) (e.g., a smart phone) according to an embodiment can execute an application and identify a user input (e.g., an audio data playback request) (control(play)) using a control interface of the application. The mobile electronic device (1001) according to an embodiment can perform a communication connection with each of the wireless audio devices (1102-1, 1102-2). According to one embodiment, a mobile electronic device (1001) may transmit a noise cancelling activation control signal (noise cancelling) and audio data to each of a pair (or both) of wireless audio devices (1102-1, 1102-2) based on an audio playback request.

[0185] FIG. 12A is a diagram illustrating an example of transmitting a noise canceling activation control signal and audio data to a wireless audio device when a VR function is activated in an XR electronic device according to an embodiment of the present disclosure.

[0186] Referring to FIG. 12A, an XR electronic device (1201) (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4A, or the electronic device (500) of FIG. 5) (e.g., XR glasses) according to an embodiment may receive (or identify) a user input (control (VR play)) corresponding to a VR content playback request. The XR electronic device (1201) according to an embodiment may transmit a noise cancelling function activation control signal (noise cancelling) and audio data to a wireless audio device (1202) (e.g., a wireless headset) based on the VR content playback request. The wireless audio device (1202) according to an embodiment may receive the noise cancelling function activation control signal and audio data from the XR electronic device (1201) and activate the noise cancelling function when playing the audio data.

[0187] FIG. 12b is a diagram illustrating an example of an XR electronic device transmitting a noise canceling activation control signal and audio data to a wireless audio device based on a control signal from another electronic device according to an embodiment of the present disclosure.

[0188] Referring to FIG. 12B, an XR electronic device (1201) (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4A, or the electronic device (500) of FIG. 5) (e.g., XR glasses) according to an embodiment may receive (or identify) a control signal (control(VR play)) corresponding to a VR content playback request from another electronic device (e.g., a smart phone (1203) or a smart watch (1205)) connected through separate communication. The XR electronic device (1201) according to an embodiment may transmit a noise cancelling function activation control signal (noise cancelling) and audio data to a wireless audio device (1202) (e.g., a wireless headset) based on the VR content playback request. According to an embodiment, an XR electronic device (1201) may transmit only a noise cancelling function activation control signal (noise cancelling) to a wireless audio device (1202) based on a VR content playback request, and the wireless audio device (1202) may also receive audio data from a smart phone (1203) or a smart watch (1205). According to an embodiment, the wireless audio device (1202) may receive a noise cancelling function activation control signal and audio data from the XR electronic device (1201) and activate the noise cancelling function when playing audio data.

[0189] Although not shown in FIG. 12B, an XR electronic device (1201) according to an embodiment may transmit information notifying receipt of a VR content playback request (or operation information indicating that VR content is being played in response to a VR content playback request) to another electronic device (e.g., a smart phone (1203) or a smart watch (1205)) connected via communication when the device receives a VR content playback request on its own, and the other electronic device (e.g., a smart phone (1203) or a smart watch (1205)) may transmit a noise-canceling function activation control signal and / or audio data to a wireless audio device (1202) upon receiving information notifying receipt of a VR content playback request from the XR electronic device (1201). For example, a smart phone (1203) may transmit a noise-canceling function activation control signal and audio data to the wireless audio device (1202). For another example, the smartwatch (1205) may transmit a noise-cancelling function activation control signal and audio data to the wireless audio device (1202). For another example, the smartphone (1203) may transmit a noise-cancelling function activation control signal to the wireless audio device (1202), and the smartwatch (1205) may transmit audio data to the wireless audio device (1202). For another example, the smartwatch (1205) may transmit a noise-cancelling function activation control signal to the wireless audio device (1202), and the smartphone (1203) may transmit audio data to the wireless audio device (1202).

[0190] FIG. 12c is a diagram illustrating an example of controlling an XR electronic device in a mobile electronic device according to an embodiment of the present disclosure and transmitting a noise canceling activation control signal, a noise canceling deactivation control signal, or an ambient sound listening function control signal and audio data to a wireless audio device.

[0191] Referring to FIG. 12c, a mobile electronic device (1203) (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4a, or the electronic device (500) of FIG. 5) (e.g., a smart phone) according to one embodiment may receive (or identify) a user input corresponding to an AR content playback request or a user input corresponding to a VR content playback request (control (AR play or VR play)). In one embodiment, the mobile electronic device (1203) may transmit an AR content playback request or a VR content playback request (control (AR play or VR play)) to the XR electronic device (1201) (e.g., XR glasses) based on a user input corresponding to the AR content playback request or a user input corresponding to the VR content playback request, and transmit a noise canceling function activation control signal, a noise canceling function deactivation control signal (noise cancelling), or an ambient sound listening function control signal and audio data to the wireless audio device (1202) (e.g., wireless headset). In one embodiment, the mobile electronic device (1203) may transmit a noise canceling function activation control signal, a noise canceling function deactivation control signal (noise cancelling), or an ambient sound listening function control signal to the wireless audio device (1202), and the audio data may be transmitted from the XR electronic device (1201).

[0192] In one embodiment, a mobile electronic device (1203) may transmit an AR content playback request (control(AR play)) to an XR electronic device (1201) (e.g., XR glasses) based on a user input corresponding to the AR content playback request, and transmit a noise canceling function deactivation control signal or an ambient sound listening function control signal and audio data to a wireless audio device (1202) (e.g., a wireless headset). In one embodiment, a mobile electronic device (1203) may transmit a VR content playback request (control(VR play)) to an XR electronic device (1201) (e.g., XR glasses) based on a user input corresponding to the VR content playback request, and transmit a noise canceling function activation control signal and audio data to a wireless audio device (1202) (e.g., a wireless headset).

[0193] FIG. 12d is a diagram illustrating an example of transmitting a noise canceling activation control signal, a noise canceling deactivation control signal, or an ambient sound listening function control signal and audio data to a wireless audio device through a mobile electronic device in an XR electronic device according to an embodiment of the present disclosure.

[0194] Referring to FIG. 12d, an XR electronic device (1201) (e.g., the electronic device (101) of FIG. 1, the electronic device (201) of FIG. 2, the mobile electronic device (300) of FIG. 3, the XR electronic device (400) of FIG. 4a, or the electronic device (500) of FIG. 5) (e.g., XR glasses) according to one embodiment can receive (or identify) a user input corresponding to an AR content playback request or a user input corresponding to a VR content playback request (control (AR play or VR play)). According to an embodiment, an XR electronic device (1201) may perform an operation to play AR content or play VR content based on a user input corresponding to an AR content playback request or a user input corresponding to a VR content playback request, and transmit a control signal (control (AR play or VR play)) to a mobile electronic device (1203) to transmit a noise canceling function activation control signal, a noise canceling function deactivation control signal (noise cancelling), or an ambient sound listening function control signal and audio data associated with the AR content or VR content to a wireless audio device (1202) (e.g., a wireless headset). According to an embodiment, a mobile electronic device (1203) may transmit a noise canceling function deactivation control signal or an ambient sound listening control signal and audio data to a wireless audio device (1202) (e.g., a wireless headset) when playing AR content based on the control of an XR electronic device (1201), and may transmit a noise canceling function activation control signal and audio data to a wireless audio device (1202) (e.g., a wireless headset) when playing VR content.According to one embodiment, the mobile electronic device (1203) may transmit only a noise cancelling function activation control signal, a noise cancelling function deactivation control signal (noise cancelling), or an ambient sound listening function control signal to the wireless audio device (1202), and audio data may also be transmitted from the XR electronic device (1201).

[0195] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0196] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0197] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0198] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0199] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0200] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0201] According to one embodiment, one or more non-transitory computer-readable storage media are provided that store one or more computer programs comprising computer-readable instructions, wherein the computer-readable instructions, when individually or collectively executed by a processor (e.g., processor (120) of FIG. 1 or processor (520) of FIG. 5) of an electronic device (e.g., electronic device (101) of FIG. 1, electronic device (201) of FIG. 2, or electronic device (500) of FIG. 5), cause the electronic device to perform operations. The above operations may include an operation in which the electronic device performs communication with the wireless audio device external to the electronic device through a communication circuit (570) based on a request for audio data transmission to the wireless audio device, an operation in which the electronic device identifies activation or deactivation of a noise canceling function of the wireless audio device, an operation in which the electronic device transmits a noise canceling function activation control signal and the audio data to the wireless audio device when the noise canceling function activation is identified, and an operation in which the electronic device transmits the noise canceling deactivation control signal and the audio data to the wireless audio device when the noise canceling function deactivation is identified.

[0202] While the present disclosure has been illustrated and described with reference to various embodiments, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents.

Claims

1. In electronic devices, communication circuit; Memory that stores one or more computer programs; comprising one or more processors, The above one or more computer programs, when individually or collectively executed by the one or more processors, cause the electronic device to: Communicating with a wireless audio device external to the electronic device through the above communication circuit, Identifying whether to activate or deactivate the noise canceling function of the wireless audio device based on a request for transmission of audio data to the wireless audio device; When the activation of the above noise canceling function is identified, a noise canceling function activation control signal and the audio data are transmitted to the wireless audio device, and An electronic device including computer-executable instructions that cause the wireless audio device to transmit the noise-cancelling deactivation control signal and the audio data when the noise-cancelling function deactivation is identified.

2. In paragraph 1, The above one or more computer programs, when individually or collectively executed by the one or more processors, cause the electronic device to: Further comprising computer executable instructions for identifying activation of an augmented reality (AR) function or activation of a virtual reality (VR) function based on a request for transmission of the audio data to the wireless audio device; To identify the activation or deactivation of the noise canceling function of the wireless audio device, the one or more computer programs, when individually or collectively executed by the one or more processors, cause the electronic device to: identify deactivation of the noise canceling function when activation of the AR function is identified; and An electronic device further comprising computer executable instructions that identify activation of the noise canceling function when activation of the VR function is identified.

3. In paragraph 2, display; At least one camera; Mike; and Including more sensors, The one or more processors are communicatively connected to the display, the at least one camera, the microphone, and the sensor, and The above one or more computer programs, when individually or collectively executed by the one or more processors, cause the electronic device to: An operation of obtaining an image associated with the exterior of the electronic device by using at least one camera while performing the VR function, and obtaining first information associated with an object external to the electronic device; An operation of obtaining external sound of the electronic device using the microphone while performing the VR function to obtain second information related to the external sound of the electronic device, an operation of obtaining operation information of the external electronic device from an external electronic device connected to the electronic device through the communication circuit while performing the VR function to obtain third information related to the operation of the external electronic device, and An electronic device including computer-readable instructions for performing at least a part of an operation of obtaining fourth information related to an external environment of the electronic device by using sensing information obtained by the sensor while performing the VR function.

4. In paragraph 3, The above one or more computer programs, when individually or collectively executed by the one or more processors, cause the electronic device to: Identifying whether a specified first condition is satisfied based at least on the first information, the second information, the third information, or the fourth information, and An electronic device including computer readable instructions that cause the display to display visual information corresponding to the first specified condition based on satisfaction of the first specified condition, or transmit a signal to the wireless audio device to control lowering the level of the noise canceling function.

5. In paragraph 3, The above one or more computer programs, when individually or collectively executed by the one or more processors, cause the electronic device to: Identifying whether a second condition specified based at least on the first information, the second information, the third information, or the fourth information is satisfied, and An electronic device including computer readable instructions for stopping performance of the VR function based on satisfaction of the second condition specified above and transmitting a noise canceling function deactivation control signal or an ambient sound listening function control signal to the wireless audio device.

6. In paragraph 5, The above one or more programs, when individually or collectively executed by the one or more processors, cause the electronic device to: An electronic device comprising computer readable instructions for activating the AR function after cessation of performance of the VR function based on satisfaction of the second condition specified above.

7. For wireless audio devices, communication circuit; audio circuit; noise canceling circuit; A memory storing one or more computer programs; and comprising one or more processors communicatively connected to the communication circuit, the audio circuit, and the memory; The above one or more programs, when individually or collectively executed by the one or more processors, cause the wireless audio device to: Communicating with an electronic device external to the wireless audio device through the above communication circuit, Receive audio data from the above electronic device, Receive a control signal from the above electronic device, If the above control signal is a noise canceling function activation control signal, the noise canceling circuit is controlled to activate the noise canceling function when the audio data is played, and A wireless audio device including computer-readable commands for controlling the noise canceling circuit to deactivate the noise canceling function when the control signal is a noise canceling function deactivation control signal.

8. In electronic devices, communication circuit; Memory that stores one or more computer programs; comprising one or more processors communicatively connected to the communication circuit and the memory; The above one or more computer programs, when individually or collectively executed by the one or more processors, cause the electronic device to: Activating a VR (virtual reality) function based on a request to perform a VR function while performing an AR (augmented reality) function, or activating an AR function based on a request to perform an AR function while performing the VR function, and When the above VR function is activated, a noise canceling function activation control signal is transmitted to a wireless audio device connected using the electronic device and the communication circuit, or An electronic device including computer-readable instructions for transmitting a noise-cancelling deactivation control signal or an ambient sound listening control signal to the wireless audio device connected using the electronic device and the communication circuit when the AR function is activated.

9. In paragraph 8, display; At least one camera; Mike; and Including more sensors, The one or more processors are communicatively connected to the display, the at least one camera, and the sensor, and The one or more computer programs, when individually or collectively executed by the one or more processors, cause the electronic device to: Comprising computer readable instructions for obtaining information related to the surrounding environment of the electronic device by using at least one of the camera, the microphone, the communication circuit, and the sensor while performing the VR function; Information related to the surrounding environment of the above electronic device, An electronic device comprising at least a portion of first information associated with an external object of the electronic device acquired based on an image captured by the at least one camera, second information associated with a sound external to the electronic device acquired through the microphone, third information associated with an operation of another electronic device received from another external electronic device connected to the electronic device through the communication circuit, and fourth information associated with an external environment of the electronic device acquired using sensing information acquired by the sensor.

10. In paragraph 9, The above one or more programs, when individually or collectively executed by the one or more processors, cause the electronic device to: If a first condition specified based on information related to the surrounding environment of the electronic device is satisfied, a signal is transmitted to the display to control display of visual information corresponding to the first condition specified or to lower the level of the noise canceling function of the wireless audio device, and An electronic device including computer-readable instructions for causing the electronic device to stop performing a VR function and transmit a noise canceling function deactivation control signal or an ambient sound listening function control signal to the wireless audio device when a second condition specified based on information associated with the surrounding environment of the electronic device is satisfied.

11. A method for controlling a noise canceling function of a wireless audio device performed by an electronic device, An action of the electronic device performing communication with the wireless audio device external to the electronic device through a communication circuit; An action of the electronic device identifying whether to activate or deactivate a noise canceling function of the wireless audio device based on a request for transmission of audio data to the wireless audio device; When the activation of the noise canceling function is identified, the electronic device transmits a noise canceling function activation control signal and the audio data to the wireless audio device; and A method comprising the action of the electronic device transmitting the noise canceling deactivation control signal and the audio data to the wireless audio device when the deactivation of the noise canceling function is identified.

12. In paragraph 11, Further comprising an action of identifying activation of an augmented reality (AR) function or activation of a virtual reality (VR) function based on a request for transmission of the audio data to the wireless audio device; An action for identifying activation or deactivation of the noise canceling function of the wireless audio device is: When the activation of the above AR function is identified, an operation for identifying the deactivation of the noise canceling function; and A method further comprising an action of identifying activation of the noise canceling function when activation of the VR function is identified.

13. In paragraph 12, An action for performing a VR function based on the activation of the above VR function; Further comprising an operation of obtaining information related to the surrounding environment of the electronic device by using at least one of the camera, microphone, the communication circuit, and at least one of the sensors while performing the VR function. Information related to the surrounding environment of the above electronic device, A method comprising at least a part of first information associated with an external object of the electronic device acquired based on an image captured through the at least one camera, second information associated with a sound external to the electronic device acquired through the microphone, third information associated with an operation of another electronic device received from another external electronic device connected to the electronic device through the communication circuit, and fourth information associated with an external environment of the electronic device acquired using sensing information acquired by the sensor.

14. In paragraph 13, An operation of displaying visual information corresponding to the specified first condition on a display or transmitting a signal to control lowering the level of the noise canceling function to the wireless audio device when a specified first condition is satisfied based on information related to the surrounding environment of the electronic device; and A method further comprising: if a second condition specified based on information related to the surrounding environment of the electronic device is satisfied, an action of stopping the performance of the VR function and transmitting a noise canceling function deactivation control signal or an ambient sound listening function control signal to the wireless audio device.

15. One or more non-transitory computer-readable storage media storing one or more computer programs including computer-readable instructions, wherein the computer-readable instructions, when individually or collectively executed by one or more processors of an electronic device, cause the electronic device to perform operations, the operations comprising: An operation in which the electronic device communicates with a wireless audio device external to the electronic device through a communication circuit; An action of the electronic device identifying whether to activate or deactivate a noise canceling function of the wireless audio device based on a request for transmission of audio data to the wireless audio device; When the activation of the noise canceling function is identified, the electronic device transmits a noise canceling function activation control signal and the audio data to the wireless audio device; and A storage medium including an operation for transmitting the noise canceling deactivation control signal and the audio data to the wireless audio device when the deactivation of the noise canceling function is identified.

Citation Information

Patent Citations

  • Apparatus and method for canceling feedback in hearing aid

    KR1020150105130A

  • Mobile terminal and method for controlling the same

    KR1020150140050A

  • Locating wireless devices

    US20180199138A1

  • Audio systems and methods

    US20190082307A1

  • KR20210122568A