Electronic device and method for recording audio data acquired from a plurality of devices

Abstract

Various embodiments of the present invention disclose a method and apparatus comprising a microphone, a communication module, a memory including a transmission buffer, and a processor operatively connected to the microphone, the communication module, or the memory, wherein the processor connects a first communication link with a first external electronic device through the communication module, connects a second communication link with a second external electronic device through the communication module, drives the microphone to acquire a microphone input signal upon receiving a recording request from the first external electronic device, monitors a transmission environment with the communication module or the second external electronic device, determines a bit rate of audio based on the transmission environment, encodes audio based on the determined bit rate, and transmits the encoded audio data to the first external electronic device. Various embodiments are possible.

Description

Technology Field

[0001] Various embodiments of the present invention disclose a method for recording audio data obtained from a plurality of devices and an electronic device. Background Technology

[0002] With the development of digital technology, various types of electronic devices such as mobile communication terminals, PDAs (personal digital assistants), electronic notebooks, smartphones, tablet PCs (personal computers), or wearable devices are widely used. These electronic devices can exchange information by connecting with external devices, such as laptops, earphones, or headphones, using short-range wireless technology like Bluetooth. For example, an electronic device can connect with earphones via Bluetooth to output the sound of music or videos through the earphones.

[0003] Reflecting user needs, earphones are being released in the form of TWS (true wireless stereo) wireless headsets (or wireless input / output devices) that can be inserted into each ear. Since wireless headsets include microphones in both the left and right units, binaural recording is possible, allowing for the recording of more realistic sound. The problem to be solved

[0004] Due to the nature of wireless input / output devices, audio interruptions may occur in weak signal conditions where the wireless environment is poor. Furthermore, in TWS (True Wireless Stereo) devices where the left and right channels are separated, audio interruptions caused by the wireless environment may occur more frequently. While reducing the size of the audio data is one way to address this issue, doing so may result in a decrease in sound quality. Additionally, with TWS devices, if audio interruptions occur at different timings between the left and right channels, it may be difficult to ensure synchronization between the two devices.

[0005] Furthermore, when a standard Bluetooth headset using Bluetooth A2DP (advanced audio distribution profile) determines the codec during the audio codec setting stage, it transmits audio signals using a fixed bit rate and packet type, and the bit rate and packet type may not change. Therefore, audio interruptions may occur in crowded environments such as subways where wireless devices are frequently used, and if the transmission environment changes, it may be impossible to respond in real time to the changed transmission environment.

[0006] In various embodiments, a method and apparatus for preventing audio interruption and obtaining high-quality audio data may be disclosed by variably adjusting the bit rate of audio data obtained from the first device and the second device, respectively, according to the transmission environment between a wearable device (e.g., wireless input / output device) and an electronic device (e.g., a smartphone) including the first device and the second device. means of solving the problem

[0007] An electronic device according to various embodiments of the present invention may include a microphone, a communication module, a memory including a transmission buffer, and a processor operatively connected to the microphone, the communication module, or the memory, wherein the processor may be configured to connect a first communication link with a first external electronic device through the communication module, connect a second communication link with a second external electronic device through the communication module, drive the microphone to acquire a microphone input signal upon receiving a recording request from the first external electronic device, monitor a transmission environment with the communication module or the second external electronic device, determine a bit rate of audio based on the transmission environment, encode audio based on the determined bit rate, and transmit the encoded audio data to the first external electronic device.

[0008] An electronic device according to various embodiments of the present invention may include a microphone, a communication module, a memory including a transmission buffer, and a processor operatively connected to the microphone, the communication module, or the memory, wherein the processor may be configured to connect a second external electronic device and a second communication link, which is connected to a first external electronic device and a first communication link through the communication module, receive a microphone open command from the second external electronic device, drive the microphone to obtain a microphone input signal, monitor a transmission environment with the communication module or the second external electronic device, determine a bit rate of audio based on the transmission environment, encode audio based on the determined bit rate, and transmit the encoded audio data to the first external electronic device or the second external electronic device.

[0009] An electronic device according to various embodiments of the present invention comprises a communication module, a memory, and a processor operatively connected to the communication module or the memory, wherein the processor is connected to a first external electronic device via a first communication link through the communication module, instructs the first external electronic device to record upon receiving a recording request from a user, receives first audio data obtained from the first external electronic device or second audio data obtained from a second external electronic device connected to the first external electronic device, and may be configured to synchronize the first audio data and the second audio data. Effects of the invention

[0010] According to various embodiments, the bit rate of audio data acquired from the first device and the second device, respectively, can be variably adjusted according to the transmission environment between the wearable device including the first device and the second device and the electronic device.

[0011] According to various embodiments, if the transmission environment is a strong electric field condition (e.g., good condition), audio data can be encoded using a high bit rate, and if the transmission environment is a weak electric field condition (e.g., bad condition), the bit rate can be adjusted to a low value to facilitate packet transmission.

[0012] According to various embodiments, instead of the existing method of using a fixed bit rate regardless of changes in the transmission environment, by variably adjusting the bit rate according to the transmission environment, it is possible to minimize audio interruptions and provide a high-quality recording service.

[0013] According to various embodiments, by assigning the same index number to audio data acquired simultaneously in the first device and the second device, respectively, and synchronizing the audio data acquired in the first device and the second device, respectively, based on the index number, it is possible to provide a high-quality recording service. Brief explanation of the drawing

[0014] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 2 is a diagram illustrating the configuration of a wearable device according to various embodiments. FIG. 3 is another block diagram of a wearable device according to various embodiments. FIGS. 4a to 4d are drawings illustrating network environments between electronic devices and wearable devices according to various embodiments. FIG. 5 is a flowchart illustrating a method of operation according to a first method between an electronic device and a wearable device according to various embodiments. FIG. 6 is a diagram illustrating the state of a transmission buffer of a wearable device according to various embodiments. FIG. 7 is a flowchart illustrating an audio processing method according to a first method in a first device of a wearable device according to various embodiments. FIG. 8 is a flowchart illustrating an audio processing method according to a first method of a second device of a wearable device according to various embodiments. FIG. 9 is a flowchart illustrating a method of operation according to a second method between an electronic device and a wearable device according to various embodiments. FIG. 10 is a flowchart illustrating an audio processing method according to a second method in a first device of a wearable device according to various embodiments. FIG. 11 is a flowchart illustrating an audio processing method according to a second method of a second device of a wearable device according to various embodiments. FIG. 12 is a diagram illustrating an example of audio data transmitted from a wearable device according to various embodiments. FIG. 13 is a flowchart illustrating a method for processing audio data in an electronic device according to various embodiments. FIG. 14 is a flowchart illustrating a method of operation according to a third method between an electronic device and a wearable device according to various embodiments. FIG. 15 is a flowchart illustrating a method of operation according to a fourth method between an electronic device and a wearable device according to various embodiments. FIGS. 16a and FIGS. 16b are flowcharts illustrating a method of operation according to the fifth method between an electronic device and a wearable device according to various embodiments. Specific details for implementing the invention

[0015] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.

[0016] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0017] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0018] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0019] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0020] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0021] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0022] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0023] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0024] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0025] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0026] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0027] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0028] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0029] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0030] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0031] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0032] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0033] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0034] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0035] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0036] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0037] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0038] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0039] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., first) component is referred to as “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., by wire), wirelessly, or through a third component.

[0040] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0041] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0042] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0043] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0044] FIG. 2 is a diagram illustrating the configuration of a wearable device according to various embodiments.

[0045] Referring to FIG. 2, a wearable device (200) (or wireless communication device, wireless output device) according to various embodiments may be a device that is wirelessly connected to an external electronic device (e.g., the electronic device (101) of FIG. 1) and exchanges information (or signals) with the electronic device (101). In the following description, the wearable device (200) is described as a type of TWS wireless earphone, but it may be a concept that includes IoT (Internet of Things) devices such as Bluetooth speakers, washing machines, and refrigerators. For example, the wearable device (200) may be a device that receives an audio signal output from the electronic device (101) and outputs it through a speaker, or transmits an audio signal input from the outside (e.g., a user) through a microphone to the electronic device (101). The wearable device (200) may include at least one of a first device (210), a second device (230), and a case (250). The wearable device according to the various embodiments disclosed in this document may be a device of various forms, for example, a wireless earphone. Hereinafter, the wearable device (200) described in the present invention may refer to the first device (210) or the second device (230).

[0046] The first device (210) and the second device (230) may be housed (or mounted) in the case (250) or separated (or detached) from the case (250). The first device (210) and the second device (230) may be worn on a part of the user's body (e.g., the user's left ear or the user's right ear), respectively. Each of the first device (210) and the second device (230) may include a speaker or a microphone. Each of the first device (210) and the second device (230) may output an audio signal through the speaker or receive (or input) an audio signal from the outside through the microphone. When the first device (210) and the second device (230) are removed from the case (250), the power may be turned on. When the first device (210) and the second device (230) are mounted in the case (250), the power of the first device (210) and the second device (230) can be turned off or charged.

[0047] According to various embodiments, the first device (210) may act as a master and the second device (230) may act as a slave. Conversely, the first device (210) may act as a slave and the second device (230) may act as a master. The first device (210) and the second device (230) may transmit sensing information to an external electronic device periodically or in real time.

[0048] A case (250) may include a housing having a receiving portion (or space portion) configured to receive (or store) a first device (210) or a second device (230), and a cover attached to said housing. The receiving portion may be configured to magnetically attract and retain the first device (210) or the second device (230) inside the case (250). The case (250) may control the power of the first device (210) and the second device (230) to be turned off or charged when the first device (210) and the second device (230) are mounted in said receiving portion or when said cover is closed. The case (250) may turn on the power of the first device (210) and the second device (230) when the first device (210) and the second device (230) are separated from said receiving portion or when said cover is opened.

[0049] FIG. 3 is another block diagram of a wearable device according to various embodiments.

[0050] Referring to FIG. 3, a wearable device according to various embodiments (e.g., the wearable device (200) of FIG. 2) may include at least one of a first device (e.g., the first device (210) of FIG. 2), a second device (e.g., the second device (230) of FIG. 2), and a case (e.g., the case (250) of FIG. 2). Hereinafter, the wearable device (200) described in the present invention may refer to the first device (210) or the second device (230).

[0051] The first device (210) may include at least one of a first sensor module (311), a first microphone (313), a first speaker (315), a first charging module (317), a first interface (319), a first communication module (321), a first processor (323), a first touch sensor (325), a first memory (327), or a first battery (329). In some embodiments, at least one of these components may be omitted from the first device (210), or one or more other components may be added. In some embodiments, some of these components may be integrated into a single component.

[0052] The first sensor module (311) is used to determine whether the first device (210) is being worn and may include at least one of a proximity sensor, a touch sensor, an accelerometer, or a gyroscope. For example, the first sensor module (311) may be a proximity sensor or a touch sensor that detects an object approaching the first device (210). If the first sensor module (311) is a proximity sensor or a touch sensor, it may be placed in an area that is inserted into the user's ear. Alternatively, the first sensor module (311) may be an accelerometer that measures dynamic forces such as acceleration, vibration, or impact of an object. Alternatively, the first sensor module (311) may be a gyroscope that measures the angular velocity of an object.

[0053] The first microphone (313) can convert sound into an electrical signal. According to one embodiment, the first microphone (313) can acquire sound (or audio) and convert it into an electrical signal. According to one embodiment, the first microphone (313) may include an external microphone capable of receiving external sound and an internal microphone capable of receiving sound reflected from the user's ear (e.g., reverberation, echo). The first speaker (315) can convert the electrical signal into sound. The first speaker (315) can output an audio (or acoustic) signal to the outside of the first device (210). The first speaker (315) may include a receiver. The first speaker (315) may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the first speaker (315) or as part thereof. According to one embodiment, the number of the first microphone (313) and the first speaker (315) can be varied as needed.

[0054] The first charging module (317) can manage power supplied to the first device (210). The first charging module (317) can charge the first battery (329) with power received through the first interface (319). The first charging module (317) can be implemented as at least part of a power management integrated circuit (PMIC). The first interface (319) may include a connector that allows the first device (210) to be physically connected to the case (350).

[0055] The first communication module (321) can establish a wireless communication channel with an external electronic device (e.g., the electronic device (101) of FIG. 1 or the second device (230)) and support communication through the established communication channel. The first communication module (321) can be connected to an external electronic device or connected to an access point or network via Bluetooth, low-power Bluetooth, Wi-Fi, ANT+ (adaptive network topology), LTE (long term evolution), 5G (5th generation mobile communication), or NB-IoT (narrowband internet of things). The first communication module (321) can receive an acoustic signal from an external electronic device or transmit sensing information (or sensing signal) or an acoustic signal to an external electronic device.

[0056] The first processor (323) can execute software to control at least one other component (e.g., a hardware or software component) of the first device (210) connected to the first processor (323) and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the first processor (323) can store commands or data received from other components (e.g., a first sensor module (311) or a first communication module (321)) in a first memory (327), process the commands or data stored in the first memory (327), and store result data in the first memory (327). According to one embodiment, the first processor (323) may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor (e.g., a sensor hub processor or a communication processor) that can operate independently or together with it. For example, if the first device (210) includes a main processor and an auxiliary processor, the auxiliary processor may be configured to use less power than the main processor or to be specialized for a designated function. The auxiliary processor may be implemented separately from the main processor or as part thereof.

[0057] According to various embodiments, the first processor (323) may connect a first communication link with the electronic device (101) and a second communication link with the second device (230). The first communication link and the second communication link may be different links (or channels) or connected by a different communication method. The first processor (323) may transmit information about the first communication link (e.g., Bluetooth address, FHS (filesystem hierarchy system) packet information, link key) to the second device (230). When the first processor (323) receives a recording instruction from the electronic device (101), it may instruct the second device (230) to open the microphone. When the first processor (323) instructs the second device (230) to open the microphone (or microphone open command) and a certain amount of time has elapsed, it may open the first microphone (313) to receive (or acquire) audio. The first processor (323) can monitor (or analyze) the transmission environment (or wireless transmission environment) by exchanging transmission buffer states or signal strengths with the second device (230). The transmission buffer state may refer to the current remaining buffer space of the controller transmission buffer of the first device (210) or the current remaining buffer space of the controller transmission buffer of the second device (230). The signal strength may include the signal strength of the first device (210) (e.g., RSSI (receiver signal strength indicator)) or the signal strength of the second device (230).

[0058] According to various embodiments, the first processor (323) may determine the bit rate of the audio based on the transmission environment. For example, the first processor (323) may determine a first bit rate by determining that the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and that the transmission environment is in a strong state (e.g., a good state). Alternatively, the first processor (323) may determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold, and that the transmission environment is in a weak state (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the first processor (323) may determine a packet type based on the determined bit rate. The first processor (323) may encode and store the audio based on the determined bit rate. The first processor (323) can encode audio by assigning the same index number (or index value, index information) as the second device (230) to audio acquired at the same time as the second device (230). The first processor (323) can transmit the stored first audio data (or audio packet) to the electronic device (101) or transmit it to the electronic device (101) together with the second audio data acquired from the second device (230).

[0059] The first touch sensor (325) may be a sensor for controlling the first device (210). When a touch is detected at the first touch sensor (325) while the first device (210) is outputting sound, the first device (210) may stop playback. After playback is stopped, when a touch is detected at the first touch sensor (325), the first device (210) may start playback. The first touch sensor (325) may be placed in an external area of ​​the first device (210) that is not inserted into the user's ear in order to receive touch input while the user is wearing the first device (210). Touch input may include, for example, a single touch, multiple touches, a swipe, or a flick. In some embodiments, touch recognition through the first touch sensor (325) may be performed in various ways. For example, touch input may be recognized in at least one of capacitive, resistive, infrared, or ultrasonic methods. In some embodiments, the first device (210) may include a physical button or an optical key.

[0060] The first memory (327) (or buffer) can store various data used by at least one component of the first device (210) (e.g., the first sensor module (311), or the first processor (323)). The data may include, for example, input data or output data for software (e.g., a program) and related commands.

[0061] The first battery (329) can supply power to at least one component of the first device (210). According to one embodiment, the first battery (329) may include a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0062] The second device (230) may include at least one of a second sensor module (331), a second microphone (333), a second speaker (335), a second charging module (337), a second interface (339), a second communication module (341), a second processor (343), a second touch sensor (345), a second memory (347), or a second battery (349). In some embodiments, at least one of these components may be omitted from the second device (230), or one or more other components may be added. In some embodiments, some of these components may be integrated into a single component. Since the components included in the first device (210) and the components included in the second device (230) are identical or similar, "first" and "second" may be indicated before the components for distinction. Components identical to those in the first device (210) may be described briefly.

[0063] The second sensor module (331) is used to determine whether the first device (210) is being worn and may include at least one of a proximity sensor, a touch sensor, an accelerometer, or a gyroscope. The second microphone (333) may convert sound into an electrical signal. The second speaker (335) may convert the electrical signal into sound. The second speaker (335) may output an audio (or acoustic) signal to the outside of the second device (230). The second speaker (335) may include a receiver. The second speaker (335) may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the second speaker (335) or as part thereof.

[0064] The second charging module (337) is at least part of the PMIC and can manage power supplied to the second device (230). The second charging module (337) can charge the first battery (329) with power received through the second interface (339). The second interface (339) may include a connector that allows the second device (230) to be physically connected to the case (350).

[0065] The second communication module (341) can establish a wireless communication channel with an external electronic device (e.g., the electronic device (101) of FIG. 1 or the first device (210)) and support communication through the established communication channel. The second communication module (341) can receive an acoustic signal from the external electronic device or transmit sensing information (or sensing signal) or an acoustic signal to the external electronic device.

[0066] The second processor (343) can execute software to control at least one other component (e.g., a hardware or software component) of the second device (230) connected to the second processor (343) and can perform various data processing or operations. According to various embodiments, the second processor (343) can connect a second communication link with the first device (210) or connect a first communication link with the electronic device (101) based on first communication link information received from the first device (210). When the second processor (343) receives a microphone open instruction (or microphone open command) from the first device (210), it can open the second microphone (333) after a certain period of time has elapsed to receive (or acquire) audio. The second processor (343) can monitor (or analyze) the transmission environment (or wireless transmission environment) by exchanging transmission buffer states or signal strengths with the first device (210). The above transmission buffer state may refer to the current remaining buffer space of the controller transmission buffer of the first device (210) or the current remaining buffer space of the controller transmission buffer of the second device (230). The above signal strength may include the signal strength of the first device (210) (e.g., RSSI) or the signal strength of the second device (230).

[0067] According to various embodiments, the second processor (343) may determine the bit rate of the audio based on the transmission environment. For example, the second processor (343) may determine a first bit rate by determining that the transmission buffer state is below a first threshold or that the signal strength exceeds a signal threshold, and that the transmission environment is in a strong state (e.g., a good state). Alternatively, the second processor (343) may determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or that the signal strength is below a signal threshold, and that the transmission environment is in a weak state (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the second processor (343) may determine a packet type based on the determined bit rate. The second processor (343) may encode and store the audio based on the determined bit rate. The second processor (343) can encode audio by assigning the same index number (or index value, index information) as the first device (210) to audio acquired at the same time as the first device (210). The second processor (343) can transmit the stored second audio data (or audio packet) to the first device (210) or the electronic device (101).

[0068] The second touch sensor (345) may be a sensor for controlling the second device (230). When a touch is detected at the second touch sensor (345) while the second device (230) is outputting sound, the second device (230) may stop playback. After playback is stopped, when a touch is detected at the second touch sensor (345), the second device (230) may start playback. The second memory (347) (or buffer) may store various data used by at least one component of the second device (230) (e.g., the second sensor module (331), or the second processor (343)). The data may include, for example, input data or output data for software (e.g., a program) and related commands. The second battery (349) may supply power to at least one component of the second device (230).

[0069] The case (250) may include at least one of a first device interface (371), a second device interface (373), a detection module (375), a power interface (377), a case processor (380), a battery (385), or a charging module (390). The first device interface (371) or the second device interface (373) may be physically connected to the first device (210) or the second device (230). For example, the first device interface (371) may be connected to the first interface (319) of the first device (210). The second device interface (373) may be connected to the second interface (339) of the second device (230).

[0070] The case processor (380) may control the operation of the case (250). The case processor (380) may control other components included in the case (250) (e.g., charging module (390), detection module (375)) and perform various data processing or operations. For example, the case processor (380) may control the first device (210) to be charged when the first device (210) is connected, and control the second device (230) to be charged when the second device (230) is connected.

[0071] The charging module (390) can manage power supplied to the first device (210), the second device (230), or the case (250). The charging module (390) can supply power to the first device (210) through the first device interface (371) and supply power to the second device (230) through the second device interface (373). The charging module (390) can charge the battery (385) with power received through the power interface (377). The charging module (390) may be the same or similar to the charging module (170) of FIG. 1.

[0072] The detection module (375) can detect whether the first device (210) or the second device (230) is mounted (or accommodated) in the case (250). The detection module (375) can transmit to the case processor (380) if the first device (210) or the second device (230) is mounted in the accommodation portion of the case (250). The detection module (375) may include at least one sensor that detects whether at least one of the first device (210) or the second device (230) is located in the case (250). The detection module (375) may be a circuit that periodically "pings" contact portions (e.g., the first device interface (371) or the second device interface (373)) that are in contact (or connected) to the first device (210) or the second device (230). The detection module (375) may be a magnetic sensor, a light sensor, a switch, a Hall effect sensor, a magnetic flux sensor, a capacitive sensor, a photodetector, a proximity detector, a momentary switch, a mechanical sensor, or an electric sensor. The battery (385) may supply power to at least one component of the case (250). The battery (385) may be the same or similar as the battery (190) of FIG. 1. The power interface (377) may be physically connected to an external power supply.

[0073] FIGS. 4a to 4d are drawings illustrating network environments between electronic devices and wearable devices according to various embodiments.

[0074] FIG. 4a is a diagram illustrating a state in which an electronic device and a wearable device are networked in a first manner.

[0075] Referring to FIG. 4a, an electronic device according to various embodiments (e.g., the electronic device (101) of FIG. 1) may be connected to a wearable device (e.g., the wearable device (200) of FIG. 2) in a first manner (410). The wearable device (200) may include a first device (e.g., the first device (210) of FIG. 2) and a second device (e.g., the second device (230) of FIG. 2) with the left and right separated in a TWS manner. The first device (210) is referred to as a PE (primary equipment) device capable of direct communication connection with the electronic device (101), and the second device (230) may refer to the remaining device not directly connected to the electronic device (101) as a SE (secondary equipment) device. The first method (410) is a relay method, and the first device (210) may form a first communication link (401) with the electronic device (101) and form (or connect) a second communication link (403) with the second device (230). The first communication link (401) and the second communication link (403) may be different links (or channels) or different communication methods. For example, the first communication link (401) may be connected via Bluetooth, and the second communication link (403) may be connected via Bluetooth Low Energy.

[0076] The second device (230) can transmit the second audio data it has acquired (e.g., audio packet 2) to the first device (210) via the second communication link (403). The first device (210) can synchronize the first audio data it has acquired (e.g., audio packet 1) with the second audio data acquired from the second device (230) (e.g., audio packet 1 + audio packet 2) and transmit them to the electronic device (101) via the first communication link (401). The electronic device (101) can store the received first audio data and second audio data in a memory (e.g., memory (130) of FIG. 1). Alternatively, the electronic device (101) may synchronize and store the first audio data and second audio data based on an index number included in each audio data. The electronic device (101) can output the first audio data and second audio data through a speaker (e.g., sound output module (155) of FIG. 1).

[0077] FIG. 4b is a diagram illustrating the state in which an electronic device and a wearable device are networked in a second manner.

[0078] Referring to FIG. 4b, the electronic device (101) may be connected to the wearable device (200) by a second method (430). The second method (430) may be a sniffing method in which the first device (210) forms a first communication link (401) with the electronic device (101), forms (or connects) a second communication link (403) with the second device (230), and transmits information about the first communication link (401) (e.g., first communication link information) to the second device (230), so that the second device (230) forms (or connects) a first-1 communication link (401-1) with the electronic device (101) based on the first communication link information. The first communication link information may include information for connecting to the first communication link (401), such as a Bluetooth address, FHS packet information, and a link key. The first communication link (401) and the first-1 communication link (401-1) may be the same channel or the same communication method. The second device (230) can receive (e.g., sniff) information (or packets) transmitted and received between the first device (210) and the electronic device (101) through the first-1 communication link (401-1). The electronic device (101) can recognize the first device (210) connected to the first communication link (401) and the second device (230) connected to the first-1 communication link (401-1) as the same device.

[0079] In the second method (430), unlike the first method (410), the second communication link (403) is used for transmitting and receiving control signals and information between the first device (210) and the second device (230), and may not be used for transmitting data packets. The first device (210) can transmit the first audio data (e.g., audio packet 1) it has acquired to the electronic device (101) through the first communication link (401), and the second device (230) can directly transmit the second audio data (e.g., audio packet 2) it has acquired to the electronic device (101) through the first-1 communication link (401-1). The first device (210) and the second device (230) can each transmit the audio data they have acquired to the electronic device (101) through the first communication link (401) or the first-1 communication link (401-1). The electronic device (101) can synchronize the first audio data and the second audio data based on index numbers included in the first audio data and the second audio data and store them in memory (130). The electronic device (101) can output the first audio data and the second audio data through an audio output module (155).

[0080] FIG. 4c is a diagram illustrating the state in which an electronic device and a wearable device are networked in a third manner.

[0081] Referring to FIG. 4c, the electronic device (101) can be connected to the wearable device (200) in a third manner (450). The third manner (450) is an independent link manner, wherein the first device (210) forms a first communication link (401) with the electronic device (101), the second device (230) forms a third communication link (405) with the electronic device (101), and a second communication link (403) can be formed (or connected) between the first device (210) and the second device (230). The first communication link (401) and the third communication link (405) may be the same or similar communication method.

[0082] In the third method (450), unlike the first method (410), the second communication link (403) is used for transmitting and receiving control signals and information between the first device (210) and the second device (230), and may not be used for transmitting data packets. The first device (210) can transmit the first audio data (e.g., audio packet 1) it has acquired to the electronic device (101) via the first communication link (401), and the second device (230) can directly transmit the second audio data (e.g., audio packet 2) it has acquired to the electronic device (101) via the third communication link (405). The electronic device (101) can synchronize the first audio data and the second audio data based on index numbers included in the first audio data and the second audio data and store them in memory (130). The electronic device (101) can output the first audio data and the second audio data through the sound output module (155).

[0083] FIG. 4d is a diagram illustrating a state in which an electronic device and a plurality of wearable devices are networked in a fourth manner.

[0084] Referring to FIG. 4d, the electronic device (101) can be connected to a plurality of wireless input / output devices in a fourth method (470). The fourth method (470) is an independent link method, wherein the first device (210) forms a first communication link (401) with the electronic device (101), the second device (230) forms a third communication link (405) with the electronic device (101), the third device (270) forms a fourth communication link (407) with the electronic device (101), and the nth device (27N) forms a fifth communication link (409) with the electronic device (101). The first communication link (401), the third communication link (405), the fourth communication link (407), and the fifth communication link (409) may be the same or similar communication methods.

[0085] The third device (270) is a Bluetooth speaker, and the nth device (27N) may be a home appliance (e.g., a refrigerator). These examples are provided to aid in understanding the invention and do not limit the invention.

[0086] In the fourth method (470), the first device (210) transmits the first audio data (e.g., audio packet 1) it has acquired to the electronic device (101) via the first communication link (401), the second device (230) transmits the second audio data (e.g., audio packet 2) it has acquired to the electronic device (101) via the third communication link (405), the third device (270) transmits the third audio data (e.g., audio packet 3) it has acquired to the electronic device (101) via the fourth communication link (407), and the nth device (27n) transmits the nth audio data (e.g., audio packet n) it has acquired to the electronic device (101) via the fifth communication link (409). The electronic device (101) can synchronize the first audio data to the nth audio data based on index numbers included in the first audio data to the nth audio data and store them in memory (130). The electronic device (101) can output the first audio data to the nth audio data through the sound output module (155).

[0087] An electronic device according to various embodiments (e.g., the first device (210) of FIG. 2) comprises a microphone (e.g., the first microphone (313) of FIG. 3), a communication module (e.g., the first communication module (321) of FIG. 3), a memory including a transmission buffer (e.g., the first memory (327) of FIG. 3), and a processor (e.g., the first processor (323) of FIG. 3) operatively connected to the microphone, the communication module, or the memory, wherein the processor connects a first communication link with a first external electronic device (e.g., the electronic device (101) of FIG. 1) through the communication module, connects a second communication link with a second external electronic device (e.g., the second device (230) of FIG. 2) through the communication module, drives the microphone to acquire a microphone input signal upon receiving a recording request from the first external electronic device, monitors a transmission environment with the communication module or the second external electronic device, determines a bit rate of audio based on the transmission environment, and the determined bit Audio can be encoded based on a rate, and the encoded audio data can be configured to be transmitted to the first external electronic device.

[0088] The processor may be configured to exchange a transmission buffer state or signal strength with the second external electronic device and to monitor the transmission environment based on the transmission buffer state or signal strength.

[0089] The processor may be configured to determine a first bit rate when the transmission buffer state is below a first threshold or when the signal strength exceeds a signal threshold, and to determine a second bit rate smaller than the first bit rate when the transmission buffer state exceeds a first threshold or when the signal strength is below a signal threshold.

[0090] The processor may be configured to assign the same index number as the second external electronic device to audio acquired at the same time as the second external electronic device.

[0091] The processor may be configured to encode the audio to obtain first audio data, receive second audio data from the second external electronic device through the second communication link, and synchronize the first audio data and the second audio data to transmit them to the first external electronic device through the first communication link.

[0092] The processor may be configured to synchronize the first audio data and the second audio data based on index numbers included in the first audio data and the second audio data, respectively.

[0093] The above processor may be configured to transmit information about the first communication link to the second external electronic device.

[0094] An electronic device according to various embodiments (e.g., the second device (230) of FIG. 2) comprises a microphone (e.g., the second microphone (333) of FIG. 3), a communication module (e.g., the second communication module (341) of FIG. 3), a memory including a transmission buffer (e.g., the second memory (347) of FIG. 3), and a processor (e.g., the second processor (343) of FIG. 3) operatively connected to the microphone, the communication module, or the memory, and the processor connects a second communication link to a second external electronic device (e.g., the first device (210) of FIG. 2) which is connected to a first communication link to a first external electronic device (e.g., the electronic device (101) of FIG. 1) through the communication module, receives a microphone open command from the second external electronic device, drives the microphone to obtain a microphone input signal, monitors a transmission environment with the communication module or the second external electronic device, determines a bitrate of audio based on the transmission environment, and transmits audio based on the determined bitrate It can be configured to encode and transmit the encoded audio data to the first external electronic device or the second external electronic device.

[0095] The processor may be configured to exchange a transmission buffer state or signal strength with the second external electronic device and to monitor the transmission environment based on the transmission buffer state or signal strength.

[0096] The processor may be configured to determine a first bit rate when the transmission buffer state is below a first threshold or when the signal strength exceeds a signal threshold, and to determine a second bit rate smaller than the first bit rate when the transmission buffer state exceeds a first threshold or when the signal strength is below a signal threshold.

[0097] The processor may be configured to assign the same index number as the second external electronic device to audio acquired at the same time as the second external electronic device.

[0098] The processor may be configured to transmit the encoded audio data to the second external electronic device via the second communication link.

[0099] The processor may be configured to receive information about the first communication link from the second external electronic device through the second communication link, and to connect the first external electronic device and the first communication link based on the information about the first communication link.

[0100] The processor may be configured to transmit the encoded audio data to the first external electronic device through the first communication link.

[0101] An electronic device according to various embodiments (e.g., the electronic device (101) of FIG. 1) comprises a communication module (e.g., the communication module (190) of FIG. 1), a memory (e.g., the memory (130) of FIG. 1), and a processor (e.g., the processor (120) of FIG. 1) operatively connected to the communication module or the memory, and the processor may be configured to connect to a first external electronic device (e.g., the first device (210) of FIG. 2) via a first communication link through the communication module, instruct the first external electronic device to record upon receiving a recording request from a user, receive first audio data obtained from the first external electronic device or second audio data obtained from a second external electronic device (e.g., the second device (230) of FIG. 2) connected to the first external electronic device, and synchronize the first audio data and the second audio data.

[0102] The processor may be configured to receive the second audio data from a second external electronic device that sniffs the first communication link.

[0103] The processor may be configured to synchronize the first audio data and the second audio data based on an index number included in each audio data.

[0104] The above processor may be configured to be connected to the second external electronic device via a second communication link through the communication module, and to be connected to the third external electronic device via a third communication link through the communication module.

[0105] The processor may be configured to receive the second audio data from the second external electronic device through the second communication link and to receive the third audio data from the third external electronic device through the third communication link.

[0106] The above processor may be configured to synchronize the first audio data to the third audio data.

[0107] FIG. 5 is a flowchart (500) illustrating a method of operation according to a first method between an electronic device and a wearable device according to various embodiments.

[0108] Referring to FIG. 5, in operation 501, an electronic device according to various embodiments (e.g., the electronic device (101) of FIG. 1) may connect (or form) a first communication link (e.g., the first communication link (401) of FIG. 4a to 4d) with a first device (e.g., the first device (210) of FIG. 2) of a wearable device (e.g., the wearable device (200) of FIG. 2). The first device (210) may form the first communication link (401) with the electronic device (101) through a communication module (e.g., the first communication module (321) of FIG. 3). The first communication link (401) may be a short-range wireless communication such as Bluetooth or low-power Bluetooth. Since the operation of forming the communication link is a known technology, a detailed description may be omitted.

[0109] In operation 503, the first device (210) may connect (or form) a second communication link (e.g., the second device (230) of FIG. 2) of the wearable device (200) and a second communication link (e.g., the second communication link (403) of FIG. 4a to 4c) through the first communication module (321). The second communication link (403) may be different from the first communication link (401) or may use a different communication method. FIG. 5 may illustrate a method of processing audio data using the relay method of FIG. 4a.

[0110] In operation 505, the electronic device (101) may receive a recording request from a user. For example, the electronic device (101) may run an application for recording, and when user input is received that selects (or presses) a recording button, it may determine that a recording request has been received.

[0111] In operation 507, the electronic device (101) can give a recording instruction to the first device (210) in response to a recording request. Since the electronic device (101) is connected only to the first device (210) via the first communication link (401), it can transmit the recording instruction to the first device (210).

[0112] In operation 509, the first device (210) may instruct the second device (230) to open the microphone in accordance with the recording instruction. The microphone open instruction may be a command to drive (or open) the microphone to acquire audio. The microphone open instruction may indicate (or guide) the time (or timing) to drive the microphone based on synchronized clock information between the first device (210) and the second device (230). For example, the microphone open instruction may be to drive the microphone after a certain period of time after receiving the microphone open instruction.

[0113] In operation 511-1, the first device (210) can open (or drive) the first microphone (e.g., the first microphone (313) of FIG. 3). The first device (210) transmits the microphone open instruction and, after a certain period of time, drives the first microphone (313) to acquire audio at the same time as the second device (230). The first device (210) can acquire (or receive) audio through the first microphone (313).

[0114] In operation 511-2, the second device (230) can open (or drive) the second microphone (e.g., the second microphone (333) of FIG. 3). The second device (230) receives the microphone open instruction and, after a certain period of time, drives the second microphone (333) to acquire audio at the same time as the first device (210). The second device (230) can acquire (or receive) audio through the second microphone (333).

[0115] Operation 511-1 and Operation 511-2 can be interpreted as being performed simultaneously.

[0116] In operation 513, the first device (210) and the second device (230) can monitor (or analyze) the transmission environment. To monitor the transmission environment, the first device (210) and the second device (230) can exchange transmission buffer status or signal strength with each other. For example, the transmission buffer status may refer to the current remaining buffer space of the controller transmission buffer of the transmitting device (e.g., the first device (210), the second device (230)). The first device (210) can determine the packet transmission status between the first device (210) and the second device (230) based on the remaining buffer space of the first device (210) and the remaining buffer space of the second device (230). The controller transmission buffer may be an output buffer that stores an audio signal (or audio data) encoded by the microphone input buffer or audio encoder of the transmitting device.

[0117] The above signal strength may refer to the signal strength measured at the first device (210) (e.g., RSSI) or the signal strength measured at the second device (230). When the distance between the first device (210) and the second device (230) or the distance between the first device (210) and the electronic device (101) is close, the signal strength may exceed the signal threshold (e.g., good transmission condition). Alternatively, when the distance between the first device (210) and the second device (230) or the distance between the first device (210) and the electronic device (101) is far apart, the signal strength may be below the signal threshold (e.g., poor transmission condition). The first device (210) and the second device (230) may share each other's transmission environments.

[0118] In operation 515-1, the first device (210) can determine a bit rate based on the monitored transmission environment. The first device (210) can determine a first bit rate by determining that the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and that the transmission environment is in a strong state (e.g., a good state). Alternatively, the first device (210) can determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold, and that the transmission environment is in a weak state (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the first device (210) can determine a packet type based on the determined bit rate.

[0119] In operation 515-2, the second device (230) can determine a bit rate based on the monitored transmission environment. The second device (230) can determine a first bit rate by determining that the transmission buffer state is below a first threshold or that the signal strength exceeds the signal threshold, and that the transmission environment is in a strong state (e.g., a good state). Alternatively, the second device (230) can determine a second bit rate by determining that the transmission buffer state exceeds the first threshold or that the signal strength is below the signal threshold, and that the transmission environment is in a weak state (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the second device (230) can determine a packet type based on the determined bit rate.

[0120] According to various embodiments, FIG. 5 is a relay method of FIG. 4a, in which the first device (210) communicates with the electronic device (101) or the second device (230), and the second device (230) can communicate with the first device (210). The first device (210) or the second device (230) may have different transmission environments, and if the transmission environment of the first device (210) and the transmission environment of the second device (230) are different, the bit rate may be determined based on the device with the poor transmission environment. For example, in a wearable device (200) of the TWS type with left and right separated, if the first device (210) and the second device (230) are encoded at different bit rates, the user may feel discomfort in the matching of the first device (210) and the second device (230) when listening. Therefore, if the transmission environment of the first device (210) or the second device (230) exceeds the second threshold, the first device (210) or the second device (230) can lower the bit rate.

[0121] According to various embodiments, there may be one or more thresholds related to the transmission buffer state, and the bit rate may be determined differently based on each threshold. There may be one or more signal thresholds related to the signal strength, and the bit rate may be determined differently based on each signal threshold. If the transmission environment based on the transmission buffer state is different from the transmission environment based on the signal strength, the bit rate may be determined by prioritizing the transmission environment based on the transmission buffer state. Alternatively, the bit rate may be determined based on the corresponding threshold among one or more thresholds according to the transmission buffer state and the corresponding threshold among one or more thresholds according to the signal strength. A specific description of determining the bit rate will be explained in detail below through FIG. 7.

[0122] Operations 515-1 and 515-2 can be interpreted as being performed simultaneously or at similar times.

[0123] In operation 517-1, the first device (210) can perform encoding on audio (e.g., microphone input signal) obtained through the first microphone (313). The first device (210) can encode (or encode) the microphone input signal at the determined bit rate. The first device (210) can synchronize the microphone input with the second device (230) via the second communication link (403). The synchronized microphone input signal is encoded through the audio encoder of the first device (210), and the first device (210) can assign the same index number (or index value) as the second device (230) to the audio data encoded at the same time. The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0124] In operation 517-2, the second device (230) can perform encoding on audio obtained through the second microphone (333). The second device (230) can encode (or encode) the microphone input signal at the determined bit rate. The second device (230) can synchronize the microphone input with the first device (210) through the second communication link (403). The synchronized microphone input signal is encoded through the audio encoder of the second device (230), and the second device (230) can assign the same index number (or index value) as the first device (210) to the audio data encoded at the same time. The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0125] Operations 517-1 and 517-2 can be interpreted as being performed simultaneously or at similar times.

[0126] In operation 519-1, the first device (210) may store encoded audio data in a first memory (e.g., the first memory (327) of FIG. 3). Storing in the first memory (327) may mean temporarily storing in an output buffer before transmitting to the electronic device (101). Audio data output from the output buffer of the first device (210) may be referred to as 'first audio data', 'first audio bitstream', or 'first audio packet'.

[0127] In operation 519-2, the second device (230) may store encoded audio data in a second memory (e.g., the second memory (347) of FIG. 3). Storing in the second memory (347) may mean temporarily storing in an output buffer before transmitting to the first device (210). Audio data output from the output buffer of the second device (230) may be referred to as 'second audio data', 'second audio bitstream', or 'second audio packet'.

[0128] To distinguish between audio data acquired and encoded in the first device (210) and audio data acquired and encoded in the second device (230), they may be labeled as "first" and "second".

[0129] Operation 519-1 and Operation 519-2 can be interpreted as being performed simultaneously or at similar times.

[0130] In operation 521, the second device (230) can transmit audio data (e.g., second audio data) to the first device (210) through the second communication link (403). The second device (230) can transmit audio data obtained from the second microphone (333) at the same time as the first device (210), including an index number, to the first device (210).

[0131] In operation 523, the first device (210) can synchronize the first audio data with the second audio data received from the second device (230). The audio signal acquired and encoded by the first device (210) may represent the first audio data. In a relay method, since the second device (230) cannot communicate with the electronic device (101), the first device (210) can transmit the second audio data on behalf of the second device (230). The first device (210) can synchronize the first audio data and the second audio data based on the index number included in each of the audio data. The first device (210) can synchronize audio data having the same index number. According to an embodiment, when synchronizing audio data in the electronic device (101), operation 523 may be omitted.

[0132] In operation 525, the first device (210) can transmit synchronized audio data through the first communication link (401). The synchronized audio data may include first audio data and second audio data having the same index number.

[0133] In operation 527, the electronic device (101) can synchronize audio data. Depending on the embodiment, operation 527 may be omitted if operation 523 is performed. The electronic device (101) may store the first audio data and the second audio data in memory (e.g., memory (130) of FIG. 1). Alternatively, the electronic device (101) may generate a stereo audio signal by decoding the first audio data and the second audio data through an audio decoder. The input to the audio decoder may be a bitstream encoded from the first device (210) and the second device (230) at the same time through sync adjustment. The generated stereo audio signal may be signal processed and output through a speaker (e.g., sound output module (155) of FIG. 1).

[0134] According to various embodiments, the electronic device (101) can compensate for audio data lost during wireless transmission. An index number included in each audio data may increase sequentially each time an audio frame is encoded (e.g., Index=0, 1, 2, 3, 4, 5). If an index number is missing in the middle, it can be verified through the frame index value. For example, if the frame index of the audio data is '0, 1, 2, 4, 5', the electronic device (101) may determine that the third frame is missing. The electronic device (101) may generate (or compensate) the third frame based on the second frame or the fourth frame. Since frame compensation is a known technology, a detailed description may be omitted.

[0135] According to various embodiments, the audio data is transmitted via a Bluetooth packet, and the Bluetooth packet may include a sequence number. Similar to a frame number, the sequence number may also increase sequentially each time the Bluetooth packet is transmitted. The electronic device (101) may generate a missing frame based on the sequence number of the Bluetooth packet in which the audio data is transmitted.

[0136] FIG. 6 is a diagram illustrating the state of a transmission buffer of a wearable device according to various embodiments.

[0137] Referring to FIG. 6, a wearable device according to various embodiments (e.g., the wearable device (200) of FIG. 2) may obtain a microphone input signal from a microphone (e.g., the first microphone (313) and the second microphone (333) of FIG. 3) respectively included in a first device (e.g., the first device (210) of FIG. 2) and a second device (230)). In a first transmission environment (610) (e.g., a state where the transmission environment is good), the microphone input signal is transmitted to a microphone input buffer (601) and may be stored up to a first buffer level (611). The microphone input signal stored in the microphone input buffer (601) may be transmitted to an audio encoder (603) and encoded. The encoded audio signal may be input to an output buffer (605) (or transmission buffer). The audio signal stored in the output buffer (605) may be transmitted as an audio bitstream (or audio packet). In the first transmission environment (610), audio signals can be stored in the output buffer (605) up to a first threshold (613). The first transmission environment (610) is a normal transmission environment without audio interruptions, and the microphone input buffer (601) or output buffer (605) can always output audio data while maintaining a constant buffer level (e.g., a first buffer level (611) or a first threshold (613)).

[0138] In a second transmission environment (650) (e.g., a poor transmission environment), the microphone input signal is transmitted to the microphone input buffer (601), stored up to the first buffer level (611), and transmitted to the audio encoder (603) to be encoded. The encoded audio signal is stored in the output buffer (605), and in the second transmission environment (650), the audio signal may be stored in the output buffer (605) in excess of the second threshold (651). The first device (210) or the second device (230) can determine the size of the audio data according to the bit rate, and the larger the size of the audio data, the better the audio quality. However, even in a poor transmission environment, if the size of the audio data is not reduced, audio interruption may occur.

[0139] According to various embodiments, the second transmission environment (650) is a weak field condition, so packet transmission is not smooth, and packet misses are repeated, and retransmission attempts may be continuously made. In this case, audio data stored in the microphone input buffer (601) or output buffer (605) may not be output normally and may accumulate in the microphone input buffer (601) or output buffer (605). If the audio signal stored in the output buffer (605) exceeds the second threshold (651), the first device (210) or the second device (230) determines that the transmission environment is in a bad state and can reduce the bit rate to reduce the size of the audio data stored in the output buffer (605). For example, if the bit rate is high, the size of the audio data may be large, and if the bit rate is low, the size of the audio data may be small. The first device (210) or the second device (230) may be determined to a first bit rate when the first transmission environment (610) is present, and to a second bit rate smaller than the first bit rate when the second transmission environment (650) is present.

[0140] According to various embodiments, the first device (210) or the second device (230) may select a packet type advantageous for transmission based on the size of the audio data. The first device (210) or the second device (230) may enable smooth data communication even in the second transmission environment (650) and prevent overflow of the microphone input buffer (601) or output buffer (605). When the transmission environment improves and the buffer level of the microphone input buffer (601) or output buffer (605) returns to a normal state (e.g., below the first buffer level (611) or the first threshold (613)), the first device (210) or the second device (230) may adjust the bit rate to raise it again.

[0141] According to various embodiments, in a TWS type wearable device (200) with left and right separated, if the first device (210) and the second device (230) are encoded at different bit rates, the user may feel discomfort in the matching of the first device (210) and the second device (230) when listening. Therefore, if the transmission environment of the first device (210) or the second device (230) exceeds the second threshold (651), the first device (210) or the second device (230) may lower the bit rate of both.

[0142] In the drawing, it is shown that in the second transmission environment (650), the microphone input signal is stored in the microphone input buffer (601) up to the first buffer level (611), but the microphone input signal may be stored in the microphone input buffer (601) beyond the first buffer level (611). If the microphone input signal is stored in the microphone input buffer (601) beyond the first buffer level (611), the first device (210) or the second device (230) may determine that the transmission environment is in a bad state.

[0143] FIG. 7 is a flowchart (700) illustrating an audio processing method according to a first method in a first device of a wearable device according to various embodiments.

[0144] Referring to FIG. 7, in operation 701, a first processor (e.g., the first processor (323) of FIG. 3) included in a first device (e.g., the first device (210) of FIG. 2) of a wearable device (e.g., the wearable device (200) of FIG. 2) according to various embodiments may connect a first communication link (e.g., the first communication link (401) of FIG. 4a to 4d) with an electronic device (e.g., the electronic device (101) of FIG. 1) through a communication module (e.g., the first communication module (321) of FIG. 3), and may connect a second communication link (e.g., the second communication link (403) of FIG. 4a to 4c) with a second device (e.g., the second device (230) of FIG. 2) of the wearable device (200). The first communication link (401) and the second communication link (403) may be different links (or channels) or different communication methods.

[0145] In operation 703, the first processor (323) may instruct the second device (230) to open the microphone. When the electronic device (101) receives a recording request from a user, it may instruct the first device (210) to record via the first communication link (401). For example, the electronic device (101) may execute an application for recording, and when user input is received that selects (or presses) a recording button, it may instruct the first device (210) to record. Upon receiving the recording instruction from the electronic device (101), the first processor (323) may instruct the second device (230) to open the microphone via the second communication link (403).

[0146] In operation 705, the first processor (323) can drive a microphone (e.g., the first microphone (313) of FIG. 3) and acquire a microphone input signal. The first processor (323) can transmit the microphone open instruction and drive the first microphone (313) after a certain period of time. The first processor (323) can acquire a microphone input signal through the first microphone (313). The microphone input signal can be stored in a microphone input buffer (e.g., the microphone input buffer (601) of FIG. 6).

[0147] In operation 707, the first processor (323) can monitor (or analyze) the transmission environment. To monitor the transmission environment, the first processor (323) can exchange transmission buffer status or signal strength (e.g., RSSI) with the second device (230). For example, the transmission buffer status may refer to the current remaining buffer space of the controller transmission buffer of the transmitting device (e.g., the first device (210), the second device (230)). The first processor (323) can determine the packet transmission status between the first device (210) and the second device (230) based on the remaining buffer space of the first device (210) and the remaining buffer space of the second device (230). The controller transmission buffer may be a microphone input buffer (601) or an output buffer (e.g., the output buffer (605) of FIG. 6) that stores an audio signal (or audio data) encoded by an audio encoder.

[0148] In operation 709, the first processor (323) can determine a bit rate based on the transmission environment. The first processor (323) can determine a first bit rate by determining that the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and that the transmission environment is a strong field (e.g., a good state). Alternatively, the first processor (323) can determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold, and that the transmission environment is a weak field (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the first processor (323) can determine a packet type based on the determined bit rate.

[0149] According to various embodiments, the Bluetooth standard defines various profiles for different uses, and for audio signal transmission, the Advanced Audio Distribution Profile (A2DP) can generally be used. A2DP is a profile for transmitting high-quality audio signals that transmits audio data using packets, and an appropriate packet type can be selected depending on the size of the audio data being transmitted. The number of time slots used by packet types may differ; for example, packet type '2-DH3' uses three time slots, and packet type '2-DH5' can use five time slots. One time slot can have a duration of 625 μsec. Packet types using fewer time slots may have a lower probability of transmission errors than packet types using more time slots. Packet types using fewer time slots may be more robust against transmission errors because they can obtain more retransmission opportunities within the same transmission cycle.

[0150] For example, assuming that an audio signal is transmitted in 20 msec increments, 20 msec can have 32 type slots (e.g., 625 usec * 32 = 20 msec). If the packet type is '2-DH3', there are 8 transmission opportunities during 20 msec, and if the packet type is '2-DH5', there are 5 transmission opportunities during 20 msec. If an error (or miss) occurs during packet transmission, the '2-DH3' packet type, which has many retransmission opportunities, may have more robust characteristics against errors than the '2-DH5' packet type. Taking this into consideration, the first processor (323) can provide high-quality audio services by transmitting a large amount of audio data by selecting a packet type such as 2-DH5 or 3-DH5 based on the bitrate when the transmission environment is good. When the transmission environment is poor, the first processor (323) selects a packet type such as '2-DH3' based on the bitrate, thereby reducing the amount of audio data transmitted, which slightly lowers the sound quality but minimizes audio interruptions.

[0151] According to various embodiments, there may be one or more thresholds related to the transmission buffer state, and the bit rate may be determined differently based on each threshold. There may be one or more signal thresholds related to the signal strength, and the bit rate may be determined differently based on each signal threshold. If the transmission environment based on the transmission buffer state is different from the transmission environment based on the signal strength, the bit rate may be determined by prioritizing the transmission environment based on the transmission buffer state. Alternatively, the bit rate may be determined based on a corresponding threshold among one or more thresholds according to the transmission buffer state and a corresponding threshold among one or more thresholds according to the signal strength.

[0152] For example, if the transmission buffer state is below a first threshold and the signal strength is below a signal threshold, the transmission environment according to the transmission buffer state and the transmission environment according to the signal strength may be different. If the transmission environment according to the transmission buffer state and the transmission environment according to the signal strength are different, the first processor (323) may determine a first bit rate based on the transmission buffer state. Alternatively, if the transmission environment according to the transmission buffer state and the transmission environment according to the signal strength are different, the first processor (323) may determine a bit rate based on the signal strength. Alternatively, the threshold corresponding to the transmission buffer state may be divided into a first threshold or a second threshold greater than the first threshold.

[0153] The first processor (323) may determine a first bit rate based on the transmission buffer state when the transmission buffer state is below a first threshold and the signal strength is below the signal threshold. Alternatively, the first processor (323) may determine a second bit rate when the transmission buffer state is between a first threshold and a second threshold and the signal strength is below the signal threshold. The first processor (323) may determine a third bit rate when the transmission buffer state exceeds the second threshold and the signal strength is below the signal threshold. The first bit rate may be greater than the second bit rate, and the second bit rate may be greater than the third bit rate.

[0154] According to various embodiments, a threshold corresponding to the signal strength may be divided into a first signal threshold and a second signal threshold greater than the first signal threshold. The first processor (323) may determine a first bit rate when the transmission buffer state is below the first threshold and the signal strength exceeds the second signal threshold. Alternatively, the first processor (323) may determine a second bit rate when the transmission buffer state is between the first threshold and the second threshold and the signal strength is between the first signal threshold and the second signal threshold. The first processor (323) may determine a third bit rate when the transmission buffer state exceeds the second threshold and the signal strength is below the first signal threshold. The first bit rate may be greater than the second bit rate, and the second bit rate may be greater than the third bit rate.

[0155] According to various embodiments, when the transmission environment of the first device (210) and the transmission environment of the second device (230) are different, the bit rate may be determined based on the device with the poor transmission environment. For example, if the transmission environment of the first device (210) is a strong electric field situation and the transmission environment of the second device (230) is a weak electric field situation, the first processor (323) may determine the bit rate based on the weak electric field situation. If the transmission environment of the first device (210) is a weak electric field situation and the transmission environment of the second device (230) is a strong electric field situation, the first processor (323) may determine the bit rate based on the weak electric field situation.

[0156] According to various embodiments, in the first method (e.g., the relay method of FIG. 4a), the bit rate may be determined by giving priority to the transmission environment of the first device (210). For example, if the transmission environment of the first device (210) is a strong electric field situation and the transmission environment of the second device (230) is a weak electric field situation, the first processor (323) may determine the bit rate based on the strong electric field situation. If the transmission environment of the first device (210) is a weak electric field situation and the transmission environment of the second device (230) is a strong electric field situation, the first processor (323) may determine the bit rate based on the weak electric field situation.

[0157] In operation 711, the first processor (323) can encode or store audio based on the determined bit rate. The first processor (323) can encode the microphone input signal at the determined bit rate and store the encoded audio data in the output buffer (605). The size of the audio data can be determined according to the bit rate, and the larger the size of the audio data, the better the audio quality. The first processor (323) can encode the microphone input signal through an audio encoder based on the determined bit rate. The audio data that is encoded and stored from the microphone input signal obtained through the first microphone (313) of the first device (210) can be referred to as the 'first audio data', 'first audio bitstream', or 'first audio packet'.

[0158] According to various embodiments, the first processor (323) may assign the same index number (or index value) as the second device (230) to audio data encoded simultaneously with the second device (230). The index number may be located within the encoded audio data (or bitstream) or included in the header of the transmitted audio packet.

[0159] In operation 713, the first processor (323) can receive audio data (e.g., second audio data) from the second device (230) via the second communication link (403). The second device (230) can encode the microphone input signal at the determined bit rate and store the encoded audio data in the output buffer (605). The second device (230) can transmit the second audio data stored in the output buffer (605) to the first device (210).

[0160] In operation 715, the first processor (323) can synchronize or transmit audio data. The first processor (323) can synchronize the first audio data encoded and stored in operation 711 with the second audio data received in operation 713. The first processor (323) can synchronize the first audio data and the second audio data based on an index number included in each audio data. The first processor (323) can synchronize the first audio data and the second audio data having the same index number. The first processor (323) can store the synchronized audio data to the electronic device (101) via the first communication link (401).

[0161] According to various embodiments, the first processor (323) may transmit the first audio data encoded and stored in operation 711 and the second audio data received in operation 713 to the electronic device (101) without synchronizing them. If the first audio data and the second audio data are not synchronized, they may be synchronized in the electronic device (101).

[0162] FIG. 8 is a flowchart (800) illustrating an audio processing method according to a first method of a second device of a wearable device according to various embodiments.

[0163] Referring to FIG. 8, in operation 801, a second processor (e.g., second processor (343) of FIG. 3) included in a second device (e.g., second device (230) of FIG. 2) of a wearable device (e.g., wearable device (200) of FIG. 2) according to various embodiments may connect a first device (e.g., first device (210) of FIG. 2) and a second communication link (e.g., second communication link (403) of FIG. 4a to 4c) through a communication module (e.g., second communication module (341) of FIG. 3). The second communication link (403) may be a communication link formed between the first device (210) and the second device (230).

[0164] In operation 803, the second processor (343) can receive a microphone open instruction from the first device (210) via the second communication link (403). When the electronic device (101) receives a recording request from a user, it can instruct the first device (210) to record via the first communication link (401). Upon receiving the recording instruction from the electronic device (101), the first device (210) can instruct the second device (230) to open the microphone via the second communication link (403).

[0165] In operation 805, the second processor (343) can drive a microphone (e.g., the second microphone (333) of FIG. 3) and acquire a microphone input signal (e.g., the second microphone input signal). The second processor (343) can receive the microphone open instruction and drive the second microphone (333) after a certain period of time. The second processor (343) can acquire the second microphone input signal through the second microphone (333). The second microphone input signal can be stored in a microphone input buffer (e.g., the microphone input buffer (601) of FIG. 6).

[0166] In operation 807, the second processor (343) can monitor (or analyze) the transmission environment. To monitor the transmission environment, the second processor (343) can exchange the transmission buffer status or signal strength (e.g., RSSI) with the first device (210). For example, the transmission buffer status may refer to the current remaining buffer space of the controller transmission buffer of the transmitting device (e.g., the first device (210), the second device (230)). The second processor (343) can determine the packet transmission status between the first device (210) and the second device (230) based on the remaining buffer space of the first device (210) and the remaining buffer space of the second device (230). The controller transmission buffer may be a microphone input buffer (601) or an output buffer (e.g., the output buffer (605) of FIG. 6) that stores an audio signal (or audio data) encoded by an audio encoder.

[0167] In operation 809, the second processor (343) can determine a bit rate based on the transmission environment. The second processor (343) can determine a first bit rate by determining that the transmission buffer state is below a first threshold or that the signal strength exceeds a signal threshold, and that the transmission environment is a strong field (e.g., a good state). Alternatively, the second processor (343) can determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or that the signal strength is below a signal threshold, and that the transmission environment is a weak field (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the second processor (343) can determine a packet type based on the determined bit rate.

[0168] According to various embodiments, there may be one or more thresholds related to the transmission buffer state, and the bit rate may be determined differently based on each threshold. There may be one or more signal thresholds related to the signal strength, and the bit rate may be determined differently based on each signal threshold. If the transmission environment based on the transmission buffer state is different from the transmission environment based on the signal strength, the bit rate may be determined by prioritizing the transmission environment based on the transmission buffer state. Alternatively, the bit rate may be determined based on a corresponding threshold among one or more thresholds according to the transmission buffer state and a corresponding threshold among one or more thresholds according to the signal strength.

[0169] According to various embodiments, when the transmission environment of the first device (210) and the transmission environment of the second device (230) are different, the bit rate may be determined based on the device with the poor transmission environment. For example, if the transmission environment of the first device (210) is a strong electric field situation and the transmission environment of the second device (230) is a weak electric field situation, the first processor (323) may determine the bit rate based on the weak electric field situation. If the transmission environment of the first device (210) is a weak electric field situation and the transmission environment of the second device (230) is a strong electric field situation, the first processor (323) may determine the bit rate based on the weak electric field situation.

[0170] Since operation 809 is identical or similar to operation 709 of FIG. 7, a detailed description may be omitted.

[0171] In operation 811, the second processor (343) can encode or store audio based on the determined bit rate. The second processor (343) can encode the second microphone input signal at the determined bit rate and store the encoded second audio data in the output buffer (605). The size of the audio data can be determined according to the bit rate, and the larger the size of the audio data, the better the audio quality. The second processor (343) can encode the second microphone input signal through an audio encoder based on the determined bit rate. The audio data that is encoded and stored from the second microphone input signal obtained through the second microphone (333) of the second device (230) can be referred to as 'second audio data', 'second audio bitstream', or 'second audio packet'.

[0172] According to various embodiments, the second processor (343) may assign the same index number (or index value) as the first device (210) to audio data encoded at the same time as the first device (210). The index number may be located within the encoded audio data (or bitstream) or included in the header of the transmitted audio packet.

[0173] In operation 813, the second processor (343) can transmit audio data (e.g., second audio data) to the first device (210) via the second communication link (403). The second processor (343) can store the second audio data encoded and stored in operation 811 in the output buffer (605) and transmit it to the first device (210). In the first method (e.g., relay method), since the second device (230) is not connected to the electronic device (e.g., the electronic device (101) of FIG. 1), the second audio data can be transmitted to the electronic device (101) through the first device (210).

[0174] FIG. 9 is a flowchart (900) illustrating a method of operation according to a second method between an electronic device and a wearable device according to various embodiments.

[0175] Referring to FIG. 9, in operation 901, an electronic device according to various embodiments (e.g., the electronic device (101) of FIG. 1) may connect (or form) a first communication link (e.g., the first communication link (401) of FIG. 4a to 4d) with a first device (e.g., the first device (210) of FIG. 2) of a wearable device (e.g., the wearable device (200) of FIG. 2). The first communication link (401) may be a short-range wireless communication such as Bluetooth or low-power Bluetooth. Since the operation of forming the communication link is a known technology, a detailed description may be omitted.

[0176] In operation 903, the first device (210) may connect (or form) a second communication link (e.g., the second device (230) of FIG. 2) of the wearable device (200) and a second communication link (e.g., the second communication link (403) of FIG. 4a to FIG. 4c). The second communication link (403) may be different from the first communication link (401) or may have a different communication method.

[0177] In operation 905, the first device (210) can transmit first communication link information to the second device (230) through the second communication link (403). The first communication link information is information for connecting to the first communication link (401) and may include, for example, a Bluetooth address, FHS packet information, or a link key.

[0178] In operation 907, the second device (230) can connect the electronic device (101) with the first communication link (e.g., the first-1 communication link (401-1) of FIG. 4b) based on the first communication link information. The first communication link (401) and the first-1 communication link (401-1) may be the same channel or the same communication method. The second device (230) can receive (e.g., sniff) information (or packets) transmitted and received between the first device (210) and the electronic device (101) through the first-1 communication link (401-1). The electronic device (101) may recognize the first device (210) connected via the first communication link (401) and the second device (230) connected via the first-1 communication link (401-1) as the same device. FIG. 9 may illustrate a method of processing audio data using the sniffing method of FIG. 4b.

[0179] In operation 909, the electronic device (101) may receive a recording request from a user. For example, the electronic device (101) may run an application for recording, and when user input is received such as selecting (or pressing) a recording button, it may determine that a recording request has been received.

[0180] In operation 911, the electronic device (101) can give a recording instruction to the first device (210) in response to a recording request. The electronic device (101) can transmit the recording instruction to the first device (210) through the first communication link (401).

[0181] In operation 913, the first device (210) may instruct the second device (230) to open the microphone in accordance with the recording instruction. The microphone open instruction may be a command to drive (or open) the microphone to obtain audio. For example, the microphone open instruction may be to drive the microphone after a certain period of time after receiving the microphone open instruction.

[0182] In operation 915-1, the first device (210) can open (or drive) the first microphone (e.g., the first microphone (313) of FIG. 3). The first device (210) transmits the microphone open instruction and, after a certain period of time, drives the first microphone (313) to acquire audio at the same time as the second device (230). The first device (210) can acquire (or receive) audio through the first microphone (313).

[0183] In operation 915-2, the second device (230) can open (or drive) the second microphone (e.g., the second microphone (333) of FIG. 3). The second device (230) receives the microphone open instruction and, after a certain period of time, drives the second microphone (333) to acquire audio at the same time as the first device (210). The second device (230) can acquire (or receive) audio through the second microphone (333).

[0184] Operation 915-1 and Operation 915-2 can be interpreted as being performed simultaneously.

[0185] In operation 917, the first device (210) and the second device (230) can monitor (or analyze) the transmission environment. To monitor the transmission environment, the first device (210) and the second device (230) can exchange transmission buffer status or signal strength with each other. For example, the transmission buffer status may refer to the current remaining buffer space of the controller transmission buffer of the transmitting device (e.g., first device (210), second device (230)). The signal strength may refer to the signal strength measured at the first device (210) (e.g., RSSI) or the signal strength measured at the second device (230). When the distance between the first device (210) and the second device (230) or the distance between the first device (210) and the electronic device (101) is short, the signal strength may exceed a signal threshold (e.g., good transmission status). Alternatively, when the distance between the first device (210) and the second device (230) or the distance between the first device (210) and the electronic device (101) is far apart, the signal strength may be below the signal threshold (e.g., poor transmission condition). The first device (210) and the second device (230) may share each other's transmission environment. Since operation 917 is identical or similar to operation 513 of FIG. 5, a detailed description may be omitted.

[0186] In operation 919-1, the first device (210) can determine a bit rate based on the monitored transmission environment. The first device (210) can determine a first bit rate by determining that the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and that the transmission environment is in a strong state (e.g., a good state). Alternatively, the first device (210) can determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold, and that the transmission environment is in a weak state (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the first device (210) can determine a packet type based on the determined bit rate.

[0187] In operation 919-2, the second device (230) can determine a bit rate based on the monitored transmission environment. The second device (230) can determine a first bit rate by determining that the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and that the transmission environment is in a strong state (e.g., a good state). Alternatively, the second device (230) can determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold, and that the transmission environment is in a weak state (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the second device (230) can determine a packet type based on the determined bit rate.

[0188] Operation 919-1 and Operation 919-2 can be interpreted as being performed simultaneously or at similar times.

[0189] In operation 921-1, the first device (210) can perform encoding on audio (e.g., microphone input signal) obtained through the first microphone (313). The first device (210) can encode (or encode) the microphone input signal at the determined bit rate. The first device (210) can synchronize the microphone input with the second device (230) via the second communication link (403). The synchronized microphone input signal is encoded through the audio encoder of the first device (210), and the first device (210) can assign the same index number (or index value) as the second device (230) to the audio data encoded at the same time. The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0190] In operation 921-2, the second device (230) can perform encoding on audio obtained through the second microphone (333). The second device (230) can encode (or encode) the microphone input signal at the determined bit rate. The second device (230) can synchronize the microphone input with the first device (210) through the second communication link (403). The synchronized microphone input signal is encoded through the audio encoder of the second device (230), and the second device (230) can assign the same index number (or index value) as the first device (210) to the audio data encoded at the same time. The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0191] Operation 921-1 and Operation 921-2 can be interpreted as being performed simultaneously or at similar times.

[0192] In operation 923-1, the first device (210) may store encoded audio data in a first memory (e.g., the first memory (327) of FIG. 3). Storing in the first memory (327) may mean temporarily storing in an output buffer before transmitting to the electronic device (101). Audio data output from the output buffer of the first device (210) may be referred to as 'first audio data', 'first audio bitstream', or 'first audio packet'.

[0193] In operation 923-2, the second device (230) may store encoded audio data in a second memory (e.g., the second memory (347) of FIG. 3). Storing in the second memory (347) may mean temporarily storing in an output buffer before transmitting to the first device (210). Audio data output from the output buffer of the second device (230) may be referred to as 'second audio data', 'second audio bitstream', or 'second audio packet'.

[0194] To distinguish between audio data acquired and encoded in the first device (210) and audio data acquired and encoded in the second device (230), they may be labeled as "first" and "second".

[0195] Operation 923-1 and Operation 923-2 can be interpreted as being performed simultaneously or at similar times.

[0196] In operation 925, the first device (210) can transmit the first audio data to the electronic device (101) through the first communication link (401). In the sniffing method, since the second device (230) can communicate with the electronic device (101), the first device (210) can transmit only its own first audio data to the electronic device (101). The first device (210) can transmit the first audio data obtained from the first microphone (313) at the same time as the second device (230), including an index number, to the electronic device (101).

[0197] In operation 927, the second device (230) can transmit second audio data to the electronic device (101) via the first communication link (401) (e.g., the first-1 communication link (401-1)). The second device (230) can transmit second audio data obtained from the second microphone (333) at the same time as the first device (210) to the electronic device (101) including an index number.

[0198] Although the drawing shows that operation 925 is performed first and operation 927 is performed later, depending on the transmission environment of the first device (210) or the second device (230), operation 927 may be performed first and operation 925 may be performed later. Alternatively, operation 925 or operation 927 may be performed simultaneously.

[0199] In operation 929, the electronic device (101) can synchronize audio data. The electronic device (101) can receive the first audio data and the second audio data, respectively, through a first communication link (401). For example, the electronic device (101) can receive the first audio data from the first device (210) and receive the second audio data from the second device (230) through a first-1 communication link (401-1). The electronic device (101) can synchronize the first audio data and the second audio data, respectively, that are received. The electronic device (101) can synchronize the first audio data and the second audio data based on index numbers included in the first audio data and the second audio data, respectively. Alternatively, the electronic device (101) can synchronize the first audio data and the second audio data based on sequential numbers included in a Bluetooth packet. The electronic device (101) can generate a stereo audio signal by decoding the first audio data and the second audio data through an audio decoder. The input to the audio decoder may be a bitstream encoded at the same time from the first device (210) and the second device (230) through sync adjustment. The generated stereo audio signal may be signal processed and stored in memory (e.g., memory (130) in FIG. 1) or output through a speaker (e.g., sound output module (155) in FIG. 1).

[0200] FIG. 10 is a flowchart (1000) illustrating an audio processing method according to a second method in a first device of a wearable device according to various embodiments.

[0201] Referring to FIG. 10, in operation 1001, a first processor (e.g., the first processor (323) of FIG. 3) included in a first device (e.g., the first device (210) of FIG. 2) of a wearable device (e.g., the wearable device (200) of FIG. 2) according to various embodiments may connect an electronic device (e.g., the electronic device (101) of FIG. 1) and a first communication link (e.g., the first communication link (401) of FIG. 4a to 4d) through a communication module (e.g., the first communication module (321) of FIG. 3)) and connect a second device (e.g., the second device (230) of FIG. 2) and a second communication link (e.g., the second communication link (403) of FIG. 4a to 4c). Operation 1001 may be the same or similar to operation 701 of FIG. 7.

[0202] In operation 1003, the first device (210) can transmit first communication link information to the second device (230) via the second communication link (403). The first communication link information is information for connecting to the first communication link (401) and may include, for example, a Bluetooth address, FHS packet information, or a link key. The second device (230) can connect the electronic device (101) with the first communication link (e.g., the first-1 communication link (401-1) of FIG. 4b) based on the first communication link information.

[0203] In operation 1005, the first processor (323) may instruct the second device (230) to open the microphone. When the electronic device (101) receives a recording request from a user, it may instruct the first device (210) to record via the first communication link (401). For example, the electronic device (101) may execute an application for recording, and when user input selecting (or pressing) a recording button is received, it may instruct the first device (210) to record. Upon receiving the recording instruction from the electronic device (101), the first processor (323) may instruct the second device (230) to open the microphone via the second communication link (403). Operation 1005 may be the same or similar to operation 703 of FIG. 7.

[0204] In operation 1007, the first processor (323) can drive a microphone (e.g., the first microphone (313) of FIG. 3) and acquire a microphone input signal (e.g., the first microphone input signal). The first processor (323) can transmit the microphone open instruction and drive the first microphone (313) after a certain period of time. The first processor (323) can acquire the first microphone input signal through the first microphone (313). The first microphone input signal can be stored in a microphone input buffer (e.g., the microphone input buffer (601) of FIG. 6). Operation 1007 may be the same or similar to operation 705 of FIG. 7.

[0205] In operation 1009, the first processor (323) can monitor (or analyze) the transmission environment. To monitor the transmission environment, the first processor (323) can exchange transmission buffer status or signal strength (e.g., RSSI) with the second device (230). For example, the transmission buffer status may refer to the current remaining buffer space of the controller transmission buffer of the transmitting device (e.g., the first device (210), the second device (230)). The first processor (323) can determine the packet transmission status between the first device (210) and the second device (230) based on the remaining buffer space of the first device (210) and the remaining buffer space of the second device (230). The controller transmission buffer may be a microphone input buffer (601) or an output buffer (e.g., the output buffer (605) of FIG. 6) that stores an audio signal (or audio data) encoded by an audio encoder. Operation 1009 may be the same or similar to Operation 707 of FIG. 7.

[0206] In operation 1011, the first processor (323) can determine a bit rate based on the transmission environment. The first processor (323) can determine a first bit rate by determining that the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and that the transmission environment is a strong field (e.g., a good state). Alternatively, the first processor (323) can determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold, and that the transmission environment is a weak field (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the first processor (323) can determine a packet type based on the determined bit rate. Since operation 1011 is identical or similar to operation 709 of FIG. 7, a detailed description may be omitted.

[0207] In operation 1013, the first processor (323) can encode or store audio based on the determined bit rate. The first processor (323) can encode the first microphone input signal at the determined bit rate and store the encoded first audio data in the output buffer (605). The first processor (323) can encode the first microphone input signal through an audio encoder based on the determined bit rate. The audio data that is encoded and stored from the first microphone input signal obtained through the first microphone (313) of the first device (210) may be referred to as 'first audio data', 'first audio bitstream', or 'first audio packet'.

[0208] According to various embodiments, the first processor (323) may assign the same index number (or index value) as the second device (230) to the first audio data encoded simultaneously with the second device (230). The index number may be located within the encoded audio data (or bitstream) or included in the header of the transmitted audio packet.

[0209] In operation 1015, the first processor (323) can transmit the first audio data to the electronic device (101) through the first communication link (401). In the sniffing method (or second method), since the second device (230) can be connected to the electronic device (101), the first device (210) can transmit only the first audio data it has acquired to the electronic device (101).

[0210] According to various embodiments, in a sniffing method, an electronic device (101) can synchronize first audio data transmitted from a first device (210) with second audio data transmitted from a second device (230). The electronic device (101) can synchronize the first audio data and the second audio data based on an index number included in each audio data.

[0211] FIG. 11 is a flowchart (1100) illustrating an audio processing method according to a second method of a second device of a wearable device according to various embodiments.

[0212] Referring to FIG. 11, in operation 1101, a second processor (e.g., second processor (343) of FIG. 3) included in a second device (e.g., second device (230) of FIG. 2) of a wearable device (e.g., wearable device (200) of FIG. 2) according to various embodiments may connect a first device (e.g., first device (210) of FIG. 2) and a second communication link (e.g., second communication link (403) of FIG. 4a to 4c) through a communication module (e.g., second communication module (341) of FIG. 3). The second communication link (403) may be a communication link formed between the first device (210) and the second device (230).

[0213] In operation 1103, the second processor (343) may receive first communication link information from the first device (210) through the second communication link (403). The first communication link information is information for connecting to the first communication link (e.g., the first communication link (401) of FIGS. 4a to 4d), and may include, for example, a Bluetooth address, FHS packet information, or a link key.

[0214] In operation 1105, the second processor (343) can connect the electronic device (101) and the first communication link (e.g., the first-1 communication link (401-1) of FIG. 4b) based on the first communication link information. The first communication link (401) and the first-1 communication link (401-1) may be the same channel or the same communication method. The second processor (343) can receive (e.g., sniff) information (or packets) transmitted and received between the first device (210) and the electronic device (101) through the first-1 communication link (401-1). The electronic device (101) can recognize the first device (210) connected via the first communication link (401) and the second device (230) connected via the first-1 communication link (401-1) as the same device.

[0215] In operation 1107, the second processor (343) can receive a microphone open instruction from the first device (210) via the second communication link (403). When the electronic device (101) receives a recording request from a user, it can instruct the first device (210) to record via the first communication link (401). Upon receiving the recording instruction from the electronic device (101), the first device (210) can instruct the second device (230) to open the microphone via the second communication link (403).

[0216] In operation 1109, the second processor (343) can drive a microphone (e.g., the second microphone (333) of FIG. 3) and acquire a microphone input signal (e.g., the second microphone input signal). The second processor (343) can receive the microphone open instruction and drive the second microphone (333) after a certain period of time. The second processor (343) can acquire the second microphone input signal through the second microphone (333). The second microphone input signal can be stored in a microphone input buffer (e.g., the microphone input buffer (601) of FIG. 6).

[0217] In operation 1111, the second processor (343) can monitor (or analyze) the transmission environment. To monitor the transmission environment, the second processor (343) can exchange the transmission buffer status or signal strength (e.g., RSSI) with the first device (210). For example, the transmission buffer status may refer to the current remaining buffer space of the controller transmission buffer of the transmitting device (e.g., the first device (210), the second device (230)). The second processor (343) can determine the packet transmission status between the first device (210) and the second device (230) based on the remaining buffer space of the first device (210) and the remaining buffer space of the second device (230). The controller transmission buffer may be a microphone input buffer (601) or an output buffer (e.g., the output buffer (605) of FIG. 6) that stores an audio signal (or audio data) encoded by an audio encoder. Operation 1111 may be the same or similar to operation 807 of FIG. 8.

[0218] In operation 1113, the second processor (343) can determine a bit rate based on the transmission environment. The second processor (343) can determine a first bit rate by determining that the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and that the transmission environment is a strong field (e.g., a good state). Alternatively, the second processor (343) can determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold, and that the transmission environment is a weak field (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the second processor (343) can determine a packet type based on the determined bit rate. Since operation 1113 is identical or similar to operation 809 of FIG. 8, a detailed description may be omitted.

[0219] In operation 1115, the second processor (343) can encode or store audio based on the determined bit rate. The second processor (343) can encode the second microphone input signal at the determined bit rate and store the encoded audio data in the output buffer (605). The second processor (343) can encode the second microphone input signal through an audio encoder based on the determined bit rate. The audio data that is encoded and stored from the second microphone input signal obtained through the second microphone (333) of the second device (230) may be referred to as 'second audio data', 'second audio bitstream', or 'second audio packet'.

[0220] In operation 1117, the second processor (343) can transmit the second audio data to the electronic device (101) via the first communication link (e.g., the first-1 communication link (401-1)). The second processor (343) can store the second audio data encoded and stored in operation 1115 in the output buffer (605) and transmit it to the electronic device (101). In the second method (e.g., sniffing method), the second device (230) is connected to the electronic device (e.g., the electronic device (101) of FIG. 1), so the second audio data can be transmitted directly to the electronic device (101).

[0221] FIG. 12 is a diagram illustrating an example of audio data transmitted from a wearable device according to various embodiments.

[0222] Referring to FIG. 12, a first device (e.g., the first device (210) of FIG. 2) of a wearable device (e.g., the wearable device (200) of FIG. 2) according to various embodiments may generate first audio data (1210). The first audio data (1210) may be an encoded microphone input signal (e.g., the first microphone input signal) obtained through a first microphone (e.g., the first microphone (313) of FIG. 3) included in the first device (210). The first audio data (1210) may include at least one of a sync word (1211), a cyclical redundancy check (CRC) (1213), an index number (1215), or a frame payload 1 (1217). The illustrated first audio data (1210) may only show the fields corresponding to audio data among the Bluetooth packets. The sync word (1211) may be an identifier indicating that it is for audio data. CRC (1213) may be a field for detecting errors in audio data. Index number (1215) may be assigned to a microphone input signal acquired at the same time as the first device (210) and the second device (e.g., the second device (230) of FIG. 2). Frame payload 1 (1217) may contain an encoded audio signal.

[0223] The second device (230) can generate second audio data (1230). The second audio data (1230) may be an encoded microphone input signal (e.g., second microphone input signal) obtained through a second microphone (e.g., the second microphone (333) of FIG. 3) included in the second device (230). The second audio data (1230) may include at least one of a sync word (1231), a cyclical redundancy check (CRC) (1233), an index number (1235), or a frame payload 2 (1237). The sync word (1231) may be an identifier indicating that it is for audio data. The CRC (1233) may be a field for detecting errors in the audio data. The index number (1235) may be assigned to the microphone input signal obtained at the same time as the first device (210) in the second device (230). frame payload 2(1237) may contain an encoded audio signal.

[0224] When the first audio data (1210) and the second audio data (1230) are generated from microphone input signals acquired at the same time, the index number (1215) included in the first audio data (1210) and the index number (1235) included in the second audio data (1230) may be the same. When the transmission environment is good (e.g., the first transmission environment (610) of FIG. 6), the index number (1215) included in the first audio data (1210) and the index number (1235) included in the second audio data (1230) may be the same. In the case of poor transmission conditions (or crowded conditions such as a subway) (e.g., the second transmission environment (650) of FIG. 6), the index number (1215) included in the first audio data (1210) and the index number (1235) included in the second audio data (1230) may be audio data from different time periods that can be transmitted to an electronic device (e.g., the electronic device (101) of FIG. 1). When audio data generated at different time periods is transmitted to the electronic device (101), the left and right synchronization may not be well aligned. The first device (210) or the electronic device (101) can synchronize audio data having the same index number. The electronic device (101) can achieve good left and right synchronization by synchronizing and decoding the audio data with the same index number.

[0225] FIG. 13 is a flowchart (1300) illustrating a method of processing audio data in an electronic device according to various embodiments.

[0226] Referring to FIG. 13, in operation 1301, a processor (e.g., processor (120) of FIG. 1) of an electronic device (e.g., electronic device (101) of FIG. 1) according to various embodiments may connect (or form) a first communication link (e.g., first device (210) of FIG. 2) of a wearable device (e.g., wearable device (200) of FIG. 2) and a first communication link (e.g., first communication link (401) of FIG. 4a to 4d) through a communication module (e.g., communication module (190) of FIG. 1). The first communication link (401) may be a short-range wireless communication such as Bluetooth or low-power Bluetooth. In a relay method (e.g., first method (410) of FIG. 4a), the processor (120) may be connected to the first device (210) via the first communication link (401). In a sniffing method (e.g., the second method (430) of FIG. 4b), the processor (120) is connected to the first device (210) via a first communication link (401) and can form (or connect) a second device (e.g., the second device (230) of FIG. 2) via a first-1 communication link (e.g., the first-1 communication link (401-1) of FIG. 4b).

[0227] In operation 1303, the processor (120) may request a recording. The processor (120) may receive a recording request from a user and request (or instruct) the first device (210) to record (or instruct) the recording in accordance with the recording request. The processor (120) may execute an application for recording and, when user input selecting (or pressing) a recording button is received, determine that a recording request has been received. Since the processor (120) is connected to the first device (210) via a first communication link (401), it may transmit a recording instruction to the first device (210).

[0228] In operation 1305, the processor (120) can receive first audio data from the first device (210). In the first method (410), the first audio data may include audio data obtained from the first device (210) and the second device (230). In the second method (430), the first audio data may include audio data obtained from the first device (210).

[0229] In operation 1307, the processor (120) may receive second audio data from the second device (230). In the case of the first method (410), operation 1307 may be omitted. The second audio data may include audio data obtained from the second device (230).

[0230] In operation 1309, the processor (120) can synchronize audio data based on an index of the audio data. The processor (120) can synchronize the first audio data and the second audio data based on index numbers included in the first audio data of the first device (210) and the second audio data of the second device (230), respectively. The processor (120) can synchronize the first audio data and the second audio data having the same index number and store them in memory (e.g., memory (130) of FIG. 1). The processor (120) can generate a stereo audio signal by decoding the first audio data and the second audio data through an audio decoder. The input of the audio decoder may be a bitstream encoded from the first device (210) and the second device (230) at the same time through sync adjustment. The generated stereo audio signal may be signal processed and output through a speaker (e.g., sound output module (155) of FIG. 1).

[0231] According to various embodiments, the processor (120) can compensate for audio data lost due to wireless transmission. An index number included in each audio data may be sequentially increased each time an audio frame is encoded (e.g., Index=0, 1, 2, 3, 4, 5). If an index number is missing in the middle, it can be verified through the frame index value. For example, if the frame index of the audio data is '0, 1, 2, 4, 5', the processor (120) may determine that the third frame is missing. The processor (120) may generate (or compensate) the third frame based on the second frame or the fourth frame. Since frame compensation is a known technology, a detailed description may be omitted.

[0232] According to various embodiments, the audio data is transmitted via a Bluetooth packet, and the Bluetooth packet may include a sequence number. Similar to a frame number, the sequence number may also increase sequentially each time the Bluetooth packet is transmitted. The processor (120) may generate a missing frame based on the sequence number of the Bluetooth packet in which the audio data is transmitted.

[0233] FIG. 14 is a flowchart (1400) illustrating a method of operation according to a third method between an electronic device and a wearable device according to various embodiments.

[0234] Referring to FIG. 14, in operation 1401, an electronic device according to various embodiments (e.g., the electronic device (101) of FIG. 1) may connect (or form) a first communication link (e.g., the first communication link (401) of FIG. 4a to 4d) with a first device (e.g., the first device (210) of FIG. 2) of a wearable device (e.g., the wearable device (200) of FIG. 2). The first communication link (401) may be a short-range wireless communication such as Bluetooth or low-power Bluetooth. Since the operation of forming the communication link is a known technology, a detailed description may be omitted.

[0235] In operation 1403, the electronic device (101) may connect (or form) a third communication link (e.g., a third communication link (405) in FIG. 4c and FIG. 4d) with a second device of the wearable device (200) (e.g., a second device (230) of FIG. 2). The third communication link (405) may be a communication method identical or similar to the first communication link (401).

[0236] Although the drawing shows that operation 1401 is performed first and operation 1403 is performed later, operation 1403 may be performed first and operation 1401 later, or operation 1401 and operation 1403 may be performed simultaneously.

[0237] In operation 1405, the electronic device (101) may request a second communication link connection to the first device (210) and the second device (230). The electronic device (101) may transmit device information regarding the second device (230) to the first device (210) and instruct the first device (210) to form a second communication link (e.g., the second communication link (403) of FIGS. 4a to 4c) with the second device (230). The electronic device (101) may transmit device information regarding the first device (210) to the second device (230) and instruct the second device (230) to form a second communication link (403) with the first device (210).

[0238] In operation 1407, the first device (210) and the second device (230) may form a second communication link (403). The first device (210) may form a second communication link (403) with the second device (230) based on device information of the second device (230) received from the electronic device (101). The second device (230) may form a second communication link (403) with the first device (210) based on device information of the first device (210) received from the electronic device (101). However, depending on the embodiment, operation 1407 may be omitted.

[0239] In operation 1409, the electronic device (101) may receive a recording request from a user. For example, the electronic device (101) may run an application for recording, and when user input is received such as selecting (or pressing) a recording button, it may determine that a recording request has been received.

[0240] In operation 1411, the electronic device (101) may give a recording instruction (or a microphone open instruction) to the first device (210) in response to the recording request. The electronic device (101) may transmit the recording instruction to the first device (210) via the first communication link (401). The first device (210) may drive (or open) the microphone in response to the recording instruction to obtain audio. For example, the first device (210) may drive the microphone after a certain period of time after receiving the recording instruction.

[0241] In operation 1413, the electronic device (101) may instruct the second device (230) to record in response to the recording request. The electronic device (101) may transmit the recording instruction to the second device (230) via the third communication link (405). The second device (230) may drive (or open) the microphone in response to the recording instruction to obtain audio.

[0242] Although the drawings illustrate that operation 1411 is performed first and operation 1413 is performed later, operations 1411 and 1413 may be performed simultaneously, or operation 1413 may be performed first and operation 1411 later. The description is intended to aid in understanding the invention and is not intended to limit the invention.

[0243] In operation 1415-1, the first device (210) can open (or drive) the first microphone (e.g., the first microphone (313) of FIG. 3). The first device (210) transmits the microphone open instruction and, after a certain period of time, drives the first microphone (313) to acquire audio at the same time as the second device (230). The first device (210) can acquire (or receive) audio through the first microphone (313).

[0244] In operation 1415-2, the second device (230) can open (or drive) the second microphone (e.g., the second microphone (333) of FIG. 3). The second device (230) receives the microphone open instruction and, after a certain period of time, drives the second microphone (333) to acquire audio at the same time as the first device (210). The second device (230) can acquire (or receive) audio through the second microphone (333).

[0245] Operation 1415-1 and Operation 1415-2 can be interpreted as being performed simultaneously.

[0246] In operation 1417, the first device (210) and the second device (230) can monitor (or analyze) the transmission environment. To monitor the transmission environment, the first device (210) and the second device (230) can exchange transmission buffer status or signal strength with each other via the second communication link (403). For example, the transmission buffer status may refer to the current remaining buffer space of the controller transmission buffer of the transmitting device (e.g., first device (210), second device (230)). The signal strength may refer to the signal strength measured at the first device (210) (e.g., RSSI) or the signal strength measured at the second device (230). When the distance between the first device (210) and the second device (230) or the distance between the first device (210) and the electronic device (101) is short, the signal strength may exceed the signal threshold (e.g., good transmission status). Alternatively, when the distance between the first device (210) and the second device (230) or the distance between the first device (210) and the electronic device (101) is far apart, the signal strength may be below the signal threshold (e.g., poor transmission condition). The first device (210) and the second device (230) may share each other's transmission environment. Since operation 1417 is identical or similar to operation 513 of FIG. 5, a detailed description may be omitted.

[0247] In operation 1419-1, the first device (210) can determine a bit rate based on the monitored transmission environment. The first device (210) can determine a first bit rate by determining that the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and that the transmission environment is in a strong state (e.g., a good state). Alternatively, the first device (210) can determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold, and that the transmission environment is in a weak state (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the first device (210) can determine a packet type based on the determined bit rate.

[0248] In operation 1419-2, the second device (230) can determine a bit rate based on the monitored transmission environment. The second device (230) can determine a first bit rate by determining that the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and that the transmission environment is in a strong state (e.g., a good state). Alternatively, the second device (230) can determine a second bit rate by determining that the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold, and that the transmission environment is in a weak state (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the second device (230) can determine a packet type based on the determined bit rate.

[0249] Operation 1419-1 and Operation 1419-2 can be interpreted as being performed simultaneously or at similar times.

[0250] In operation 1421-1, the first device (210) can perform encoding on audio (e.g., microphone input signal) obtained through the first microphone (313). The first device (210) can encode (or encode) the microphone input signal at the determined bit rate. The first device (210) can synchronize the microphone input with the second device (230) via the second communication link (403). The synchronized microphone input signal is encoded through the audio encoder of the first device (210), and the first device (210) can assign the same index number (or index value) as the second device (230) to the audio data encoded at the same time. The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0251] In operation 1421-2, the second device (230) can perform encoding on audio obtained through the second microphone (333). The second device (230) can encode (or encode) the microphone input signal at the determined bit rate. The second device (230) can synchronize the microphone input with the first device (210) through the second communication link (403). The synchronized microphone input signal is encoded through the audio encoder of the second device (230), and the second device (230) can assign the same index number (or index value) as the first device (210) to the audio data encoded at the same time. The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0252] Operation 1421-1 and Operation 1421-2 can be interpreted as being performed simultaneously or at similar times.

[0253] In operation 1423-1, the first device (210) may store encoded audio data in a first memory (e.g., the first memory (327) of FIG. 3). Storing in the first memory (327) may mean temporarily storing in an output buffer before transmitting to the electronic device (101). Audio data output from the output buffer of the first device (210) may be referred to as 'first audio data', 'first audio bitstream', or 'first audio packet'.

[0254] In operation 1423-2, the second device (230) may store encoded audio data in a second memory (e.g., the second memory (347) of FIG. 3). Storing in the second memory (347) may mean temporarily storing in an output buffer before transmitting to the electronic device (101). Audio data output from the output buffer of the second device (230) may be referred to as 'second audio data', 'second audio bitstream', or 'second audio packet'.

[0255] To distinguish between audio data acquired and encoded in the first device (210) and audio data acquired and encoded in the second device (230), they may be labeled as "first" and "second".

[0256] Operation 1423-1 and Operation 1423-2 can be interpreted as being performed simultaneously or at similar times.

[0257] In operation 1425, the first device (210) can transmit the first audio data to the electronic device (101) through the first communication link (401). In the independent link method, since the second device (230) can communicate with the electronic device (101), the first device (210) can transmit only its own first audio data to the electronic device (101). The first device (210) can transmit the first audio data obtained from the first microphone (313) at the same time as the second device (230), including an index number, to the electronic device (101).

[0258] In operation 1427, the second device (230) can transmit second audio data to the electronic device (101) via the third communication link (405). The second device (230) can transmit second audio data obtained from the second microphone (333) at the same time as the first device (210), including an index number, to the electronic device (101).

[0259] Although the drawing shows that operation 1425 is performed first and operation 1427 is performed later, depending on the transmission environment of the first device (210) or the second device (230), operation 1427 may be performed first and operation 1425 may be performed later. Alternatively, operation 1425 or operation 1427 may be performed simultaneously.

[0260] In operation 1429, the electronic device (101) can synchronize audio data. For example, the electronic device (101) can receive the first audio data from the first device (210) via the first communication link (401) and receive the second audio data from the second device (230) via the third communication link (405). The electronic device (101) can synchronize the first audio data and the second audio data received, respectively. The electronic device (101) can synchronize the first audio data and the second audio data based on index numbers included in the first audio data and the second audio data, respectively. Alternatively, the electronic device (101) can synchronize the first audio data and the second audio data based on sequential numbers included in Bluetooth packets. The electronic device (101) can generate a stereo audio signal by decoding the first audio data and the second audio data through an audio decoder. The input to the audio decoder may be a bitstream encoded at the same time from the first device (210) and the second device (230) through sync adjustment. The generated stereo audio signal may be signal processed and stored in memory (e.g., memory (130) of FIG. 1) or output through a speaker (e.g., sound output module (155) of FIG. 1).

[0261] FIG. 15 is a flowchart (1500) illustrating a method of operation according to a fourth method between an electronic device and a wearable device according to various embodiments.

[0262] Referring to FIG. 15, in operation 1501, an electronic device according to various embodiments (e.g., the electronic device (101) of FIG. 1) may connect (or form) a first communication link (e.g., the first communication link (401) of FIG. 4a to 4d) with a first device (e.g., the first device (210) of FIG. 2) of a wearable device (e.g., the wearable device (200) of FIG. 2). The first communication link (401) may be a short-range wireless communication such as Bluetooth or low-power Bluetooth. Since the operation of forming the communication link is a known technology, a detailed description may be omitted.

[0263] In operation 1503, the electronic device (101) may connect (or form) a third communication link (e.g., a third communication link (405) in FIG. 4c and FIG. 4d) with a second device of the wearable device (200) (e.g., a second device (230) of FIG. 2). The third communication link (405) may be the same or similar communication method as the first communication link (401).

[0264] Although the drawing shows that operation 1501 is performed first and operation 1503 is performed later, operation 1503 may be performed first and operation 1501 later, or operation 1501 and operation 1503 may be performed simultaneously.

[0265] In operation 1505, the electronic device (101) may receive a recording request from a user. For example, the electronic device (101) may run an application for recording, and when user input such as selecting (or pressing) a recording button is received, it may determine that a recording request has been received.

[0266] In operation 1507, the electronic device (101) may give a recording instruction (or a microphone open instruction) to the first device (210) in response to the recording request. The electronic device (101) may transmit the recording instruction to the first device (210) via the first communication link (401). The first device (210) may drive (or open) the microphone in response to the recording instruction to obtain audio. For example, the first device (210) may drive the microphone after a certain period of time after receiving the recording instruction.

[0267] In operation 1509, the electronic device (101) may instruct the second device (230) to record in response to the recording request. The electronic device (101) may transmit the recording instruction to the second device (230) via the third communication link (405). The second device (230) may drive (or open) the microphone in response to the recording instruction to obtain audio.

[0268] Although operations 1507 and 1509 are described as being performed separately, they may be performed simultaneously or at similar times. The description is intended to aid in understanding the invention and does not limit the invention.

[0269] In operation 1511-1, the first device (210) can open (or drive) the first microphone (e.g., the first microphone (313) of FIG. 3). The first device (210) can receive the recording instruction and, after a certain period of time, drive the first microphone (313) to acquire audio at the same time as the second device (230). The first device (210) can acquire (or receive) audio through the first microphone (313).

[0270] In operation 1511-2, the second device (230) can open (or drive) the second microphone (e.g., the second microphone (333) of FIG. 3). The second device (230) receives the recording instruction and, after a certain period of time, drives the second microphone (333) to acquire audio at the same time as the first device (210). The second device (230) can acquire (or receive) audio through the second microphone (333).

[0271] Operation 1511-1 and Operation 1511-2 can be interpreted as being performed simultaneously.

[0272] In operation 1513, the first device (210) can transmit a first transmission environment to the electronic device (101). The first transmission environment may include a transmission buffer state or a signal strength of the first device (210). For example, the transmission buffer state may refer to the current remaining buffer space of the controller transmission buffer of the first device (210). The signal strength may refer to a signal strength (e.g., RSSI) measured by the first device (210).

[0273] In operation 1515, the second device (230) can transmit a second transmission environment to the electronic device (101). The second transmission environment may include a transmission buffer state or a signal strength of the second device (230). For example, the transmission buffer state may refer to the current remaining buffer space of the controller transmission buffer of the second device (230). The signal strength may refer to a signal strength (e.g., RSSI) measured by the second device (230).

[0274] In operation 1517, the electronic device (101) can determine a bit rate based on the first transmission environment and the second transmission environment. The electronic device (101) can determine a first bit rate by determining that the transmission buffer state of the first device (210) or the second device (230) is below a first threshold or that the signal strength exceeds the signal threshold, and that the transmission environment is strong (e.g., a good state). Alternatively, the electronic device (101) can determine a second bit rate by determining that the transmission buffer state of the first device (210) or the second device (230) exceeds the first threshold or that the signal strength is below the signal threshold, and that the transmission environment is weak (e.g., a bad state). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the electronic device (101) can determine a packet type based on the determined bit rate. The electronic device (101) can transmit the determined bit rate to the first device (210) and the second device (230).

[0275] If the transmission environment of the first device (210) or the second device (230) is different, the bit rate may be determined based on the device with the poor transmission environment. For example, the electronic device (101) may determine the first bit rate if the transmission buffer state of the first device (210) and the second device (230) is below a first threshold or if the signal strength exceeds the signal threshold. The electronic device (101) may determine the second bit rate if the transmission buffer state of the first device (210) and the second device (230) exceeds the first threshold or if the signal strength is below the signal threshold. Alternatively, the electronic device (101) may determine the second bit rate if the transmission buffer state of either the first device (210) or the second device (230) exceeds the first threshold or if the signal strength is below the signal threshold.

[0276] In operation 1519-1, the first device (210) can perform encoding on audio (e.g., microphone input signal) obtained through the first microphone (313). The first device (210) can encode (or encode) the microphone input signal at the determined bit rate. The microphone input signal is encoded through the audio encoder of the first device (210), and the first device (210) can assign the same index number (or index value) as the second device (230) to the audio data encoded at the same time. The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0277] In operation 1519-2, the second device (230) can perform encoding on audio obtained through the second microphone (333). The second device (230) can encode (or encode) the microphone input signal at the determined bit rate. The microphone input signal is encoded through the audio encoder of the second device (230), and the second device (230) can assign the same index number (or index value) as the first device (210) to the audio data encoded at the same time. The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0278] Operation 1519-1 and Operation 1519-2 can be interpreted as being performed simultaneously or at similar times.

[0279] In operation 1521-1, the first device (210) may store encoded audio data in a first memory (e.g., the first memory (327) of FIG. 3). Storing in the first memory (327) may mean temporarily storing in an output buffer before transmitting to the electronic device (101). Audio data output from the output buffer of the first device (210) may be referred to as 'first audio data', 'first audio bitstream', or 'first audio packet'.

[0280] In operation 1521-2, the second device (230) may store encoded audio data in a second memory (e.g., the second memory (347) of FIG. 3). Storing in the second memory (347) may mean temporarily storing in an output buffer before transmitting to the electronic device (101). Audio data output from the output buffer of the second device (230) may be referred to as 'second audio data', 'second audio bitstream', or 'second audio packet'.

[0281] To distinguish between audio data acquired and encoded in the first device (210) and audio data acquired and encoded in the second device (230), they may be labeled as "first" and "second".

[0282] Operation 1521-1 and Operation 1521-2 can be interpreted as being performed simultaneously or at similar times.

[0283] In operation 1523, the first device (210) can transmit the first audio data to the electronic device (101) through the first communication link (401). In the independent link method, since the second device (230) can communicate with the electronic device (101), the first device (210) can transmit only its own first audio data to the electronic device (101). The first device (210) can transmit the first audio data obtained from the first microphone (313) at the same time as the second device (230), including an index number, to the electronic device (101).

[0284] In operation 1523, the second device (230) can transmit second audio data to the electronic device (101) via the third communication link (405). The second device (230) can transmit second audio data obtained from the second microphone (333) at the same time as the first device (210), including an index number, to the electronic device (101).

[0285] Although the drawing shows that operation 1523 is performed first and operation 1525 is performed later, depending on the transmission environment of the first device (210) or the second device (230), operation 1525 may be performed first and operation 1523 may be performed later. Alternatively, operation 1523 or operation 1525 may be performed simultaneously.

[0286] In operation 1527, the electronic device (101) can synchronize audio data. For example, the electronic device (101) can receive the first audio data from the first device (210) via the first communication link (401) and receive the second audio data from the second device (230) via the third communication link (405). The electronic device (101) can synchronize the first audio data and the second audio data received, respectively. The electronic device (101) can synchronize the first audio data and the second audio data based on index numbers included in the first audio data and the second audio data, respectively. Alternatively, the electronic device (101) can synchronize the first audio data and the second audio data based on sequential numbers included in Bluetooth packets. The electronic device (101) can generate a stereo audio signal by decoding the first audio data and the second audio data through an audio decoder. The input to the audio decoder may be a bitstream encoded at the same time from the first device (210) and the second device (230) through sync adjustment. The generated stereo audio signal may be signal processed and stored in memory (e.g., memory (130) of FIG. 1) or output through a speaker (e.g., sound output module (155) of FIG. 1).

[0287] FIGS. 16a and FIGS. 16b are flowcharts illustrating a method of operation according to the fifth method between an electronic device and a wearable device according to various embodiments.

[0288] Referring to FIGS. 16a and 16b, in operation 1601, an electronic device according to various embodiments (e.g., the electronic device (101) of FIG. 1) may connect (or form) a first communication link (e.g., the first communication link (401) of FIG. 4a to 4d) with a first device (e.g., the first device (210) of FIG. 2) of a wearable device (e.g., the wearable device (200) of FIG. 2). The first communication link (401) may be a short-range wireless communication such as Bluetooth or low-power Bluetooth. Since the operation of forming the communication link is a known technology, a detailed description may be omitted.

[0289] In operation 1603, the electronic device (101) may connect (or form) a third communication link (e.g., a third communication link (405) in FIG. 4c and FIG. 4d) with a second device of the wearable device (200) (e.g., a second device (230) of FIG. 2). The third communication link (405) may be on the same channel or have the same communication method as the first communication link (401).

[0290] In operation 1605, the electronic device (101) may connect (or form) a third device (e.g., the third device (270) of FIG. 4d) and a fourth communication link (e.g., the fourth communication link (407) of FIG. 4d). The fourth communication link (407) may be the same or similar communication method as the first communication link (401) or the third communication link (405).

[0291] In operation 1607, the electronic device (101) may connect (or form) a fifth communication link (e.g., the first device (27n) of FIG. 4d) with the nth device (e.g., the first device (27n) of FIG. 4d). The fifth communication link (409) may be a communication method identical or similar to the first communication link (401), the third communication link (405), or the fourth communication link (407).

[0292] Although the drawings show that operations 1601 to 1607 are performed sequentially, operations 1601 to 1607 may be performed simultaneously or in any order.

[0293] In operation 1609, the electronic device (101) may receive a recording request from a user. For example, the electronic device (101) may run an application for recording, and when user input is received that selects (or presses) a recording button, it may determine that a recording request has been received.

[0294] In operation 1611, the electronic device (101) may instruct the first device (210) to the nth device (27n) to record in accordance with the recording request. The electronic device (101) may transmit the recording instruction to the first device (210) via the first communication link (401), transmit the recording instruction to the second device (230) via the third communication link (405), transmit the recording instruction to the third device (270) via the fourth communication link (407), and transmit the recording instruction to the nth device (27n) via the fifth communication link (409).

[0295] In operation 1613-1, the first device (210) can open (or drive) the first microphone (e.g., the first microphone (313) of FIG. 3). The first device (210) receives the recording instruction and, after a certain period of time, drives the first microphone (313) to acquire audio. The first device (210) can acquire (or receive) audio through the first microphone (313).

[0296] In operation 1613-2, the second device (230) can open (or drive) the second microphone (e.g., the second microphone (333) of FIG. 3). The second device (230) receives the recording instruction and, after a certain period of time, drives the second microphone (333) to acquire audio. The second device (230) can acquire (or receive) audio through the second microphone (333).

[0297] In operation 1613-3, the third device (270) may open (or drive) a third microphone (e.g., the first microphone (313) or the second microphone (333) of FIG. 3). The third microphone may be included in the third device (270). The third device (270) may receive the recording instruction and, after a certain period of time, drive the third microphone to acquire audio. The third device (270) may acquire (or receive) audio through the third microphone.

[0298] In operation 1613-4, the n-th device (27n) may open (or drive) the n-th microphone (e.g., the first microphone (313) or the second microphone (333) of FIG. 3). The n-th microphone may be included in the n-th device (27n). The n-th device (27n) may receive the recording instruction and, after a certain period of time, drive the n-th microphone to acquire audio. The n-th device (27n) may acquire (or receive) audio through the n-th microphone.

[0299] Operations 1613-1 through 1613-4 can be interpreted as being performed simultaneously. The first device (210) through the nth device (27n) can acquire audio at the same time.

[0300] In operation 1615, the first device (210) can transmit a first transmission environment to the electronic device (101). The first transmission environment may include a transmission buffer state or a signal strength of the first device (210). For example, the transmission buffer state may refer to the current remaining buffer space of the controller transmission buffer of the first device (210). The signal strength may refer to a signal strength (e.g., RSSI) measured by the first device (210).

[0301] In operation 1617, the second device (230) can transmit a second transmission environment to the electronic device (101). The second transmission environment may include a transmission buffer state or a signal strength of the second device (230). For example, the transmission buffer state may refer to the current remaining buffer space of the controller transmission buffer of the second device (230). The signal strength may refer to a signal strength (e.g., RSSI) measured by the second device (230).

[0302] In operation 1619, the third device (270) can transmit a third transmission environment to the electronic device (101). The third transmission environment may include a transmission buffer state or a signal strength of the third device (270). For example, the transmission buffer state may refer to the current remaining buffer space of the controller transmission buffer of the third device (270). The signal strength may refer to a signal strength (e.g., RSSI) measured by the third device (270).

[0303] In operation 1621, the n-th device (27n) can transmit the n-th transmission environment to the electronic device (101). The n-th transmission environment may include the transmission buffer state or signal strength of the n-th device (27n). For example, the transmission buffer state may refer to the current remaining buffer space of the controller transmission buffer of the n-th device (27n). The signal strength may refer to the signal strength (e.g., RSSI) measured by the n-th device (27n).

[0304] In operation 1623, the electronic device (101) can determine a bit rate based on the first transmission environment to the nth transmission environment. The electronic device (101) can determine a first bit rate by determining that the transmission buffer state of the first device (210) to the nth device (27n) is below a first threshold or that the signal strength exceeds the signal threshold, and determine that the first bit rate is a strong field (e.g., a good transmission environment). Alternatively, the electronic device (101) can determine a second bit rate by determining that the transmission buffer state of the first device (210) to the nth device (27n) exceeds the first threshold or that the signal strength is below the signal threshold, and determine that the second bit rate is a weak field (e.g., a bad transmission environment). The first bit rate may be greater than the second bit rate. Once the bit rate is determined, the electronic device (101) can determine a packet type based on the determined bit rate. The electronic device (101) can transmit the determined bit rate to the first device (210) to the nth device (27n).

[0305] If the transmission environments of the first device (210) to the nth device (27n) are different, the bit rate can be determined based on the device with the poor transmission environment. For example, the electronic device (101) can determine the first bit rate if the transmission buffer state of all the first device (210) to the nth device (27n) is below the first threshold or the signal strength exceeds the signal threshold. The electronic device (101) can determine the second bit rate if the transmission buffer state of any one of the first device (210) to the nth device (27n) exceeds the first threshold or the signal strength is below the signal threshold.

[0306] In operation 1625-1, the first device (210) can perform encoding on audio (e.g., microphone input signal) obtained through the first microphone (313). The first device (210) can encode (or encode) the microphone input signal at the determined bit rate. The microphone input signal is encoded through the audio encoder of the first device (210), and the first device (210) can assign the same index number (or index value) to the audio data encoded at the same time as the second device (230) through the nth device (27n). The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0307] In operation 1625-2, the second device (230) can perform encoding on audio obtained through the second microphone (333). The second device (230) can encode (or encode) the microphone input signal at the determined bit rate. The microphone input signal is encoded through the audio encoder of the second device (230), and the second device (230) can assign the same index number (or index value) to the audio data encoded at the same time as the first device (210), the third device (270), and the nth device (27n). The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0308] In operation 1625-3, the third device (270) can perform encoding on audio obtained through the third microphone. The third device (270) can encode (or encode) the microphone input signal at the determined bit rate. The microphone input signal is encoded through the audio encoder of the third device (270), and the third device (270) can assign the same index number (or index value) to the audio data encoded at the same time as the first device (210), the second device (230), and the nth device (27n). The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0309] In operation 1625-4, the n-th device (27n) can perform encoding on audio obtained through the third microphone. The n-th device (27n) can encode (or encode) the microphone input signal at the determined bit rate. The microphone input signal is encoded through the audio encoder of the n-th device (27n), and the n-th device (27n) can assign the same index number (or index value) to the audio data encoded at the same time as the first device (210) through the third device (270). The index number may be located within the encoded audio data (or bitstream) or may be included in the header of the audio packet being transmitted.

[0310] Operations 1625-1 through 1625-4 can be interpreted as being performed simultaneously or at similar times.

[0311] In operation 1627-1, the first device (210) may store encoded audio data in a first memory (e.g., the first memory (327) of FIG. 3). Storing in the first memory (327) may mean temporarily storing in an output buffer before transmitting to the electronic device (101). Audio data output from the output buffer of the first device (210) may be referred to as 'first audio data', 'first audio bitstream', or 'first audio packet'.

[0312] In operation 1627-2, the second device (230) may store encoded audio data in a second memory (e.g., the second memory (347) of FIG. 3). Storing in the second memory (347) may mean temporarily storing in an output buffer before transmitting to the electronic device (101). Audio data output from the output buffer of the second device (230) may be referred to as 'second audio data', 'second audio bitstream', or 'second audio packet'.

[0313] In operation 1627-3, the third device (270) may store the encoded audio data in a third memory (e.g., the first memory (347) or the second memory (347) of FIG. 3). Storing in the third memory may mean temporarily storing it in an output buffer before transmitting it to the electronic device (101). The audio data output from the output buffer of the third device (270) may be referred to as the 'third audio data', 'third audio bitstream', or 'third audio packet'.

[0314] In operation 1627-4, the n-th device (27n) may store encoded audio data in the n-th memory (e.g., the first memory (347) or the second memory (347) of FIG. 3). Storing in the n-th memory may mean temporarily storing in an output buffer before transmitting to the electronic device (101). Audio data output from the output buffer of the n-th device (27n) may be referred to as 'n-th audio data', 'n-th audio bitstream', or 'n-th audio packet'.

[0315] To distinguish between audio data acquired and encoded in the first device (210), audio data acquired and encoded in the second device (230), audio data acquired and encoded in the third device (270), and audio data acquired and encoded in the nth device (27n), they may be labeled as “first”, “second”, “third”, and “nth”.

[0316] Operation 1627-1 and Operation 1627-2 can be interpreted as being performed simultaneously or at similar times.

[0317] In operation 1629, the first device (210) can transmit the first audio data to the electronic device (101) through the first communication link (401). In an independent link method, since the second device (230) to the nth device (27n) can communicate with the electronic device (101), the first device (210) can transmit only its own first audio data to the electronic device (101). The first device (210) can transmit the first audio data obtained from the first microphone (313) at the same time as the second device (230) to the nth device (27n), including an index number, to the electronic device (101).

[0318] In operation 1631, the second device (230) can transmit second audio data to the electronic device (101) via the third communication link (405). The second device (230) can transmit to the electronic device (101) the second audio data obtained from the second microphone (333) at the same time as the first device (210), the third device (270), and the nth device (27n), including an index number.

[0319] In operation 1633, the third device (270) can transmit third audio data to the electronic device (101) via the fourth communication link (407). The third device (270) can transmit to the electronic device (101) the third audio data obtained from the third microphone at the same time as the first device (210), the second device (230), and the nth device (27n), including an index number.

[0320] In operation 1635, the nth device (27n) can transmit the nth audio data to the electronic device (101) via the fifth communication link (409). The nth device (27n) can transmit the nth audio data obtained from the nth microphone at the same time as the first device (210), the second device (230), and the third device (270), including an index number, to the electronic device (101).

[0321] Although the drawings show operations 1629 to 1635 being performed sequentially, depending on the transmission environment of the first device (210) to the nth device (27n), operations 1629 to 1635 may be performed simultaneously or regardless of the order.

[0322] In operation 1637, the electronic device (101) can synchronize audio data. For example, the electronic device (101) can receive the first audio data from the first device (210) via the first communication link (401), receive the second audio data from the second device (230) via the third communication link (405), receive the third audio data from the third device (270) via the fourth communication link (407), and receive the nth audio data from the nth device (27n) via the fifth communication link (409). The electronic device (101) can synchronize the first audio data to the nth audio data received, respectively. The electronic device (101) can synchronize the first audio data to the nth first audio data based on the index numbers included in the first audio data to the nth audio data, respectively.

[0323] Alternatively, the electronic device (101) may synchronize the first audio data through the nth audio data based on a sequential number included in a Bluetooth packet. The electronic device (101) may generate a stereo audio signal by decoding the first audio data through the nth audio data through an audio decoder. The input to the audio decoder may be a bitstream encoded from the first device (210) through the nth device (27n) at the same time through sync adjustment. The generated stereo audio signal may be signal processed and stored in a memory (e.g., memory (130) in FIG. 1) or output through a speaker (e.g., sound output module (155) in FIG. 1).

[0324] The various embodiments of the present invention disclosed in this specification and drawings are provided merely as specific examples to facilitate the explanation of the technical content of the invention and to aid in understanding the invention, and are not intended to limit the scope of the invention. Accordingly, the scope of the present invention should be interpreted to include all modifications or variations derived based on the technical concept of the invention, in addition to the embodiments disclosed herein. Explanation of the symbols

[0325] 101: Electronic devices 120: Processor 130: Memory 210: First device 230: Second device

Claims

Claim 1 An electronic device comprising: a microphone; a communication module; a memory including a transmission buffer; and a processor operatively connected to the microphone, the communication module, or the memory, wherein the processor is configured to connect a first communication link with a first external electronic device through the communication module, connect a second communication link with a second external electronic device through the communication module, drive the microphone to acquire a microphone input signal upon receiving a recording request from the first external electronic device, identify a transmission environment with the communication module or the second external electronic device, determine a bit rate of audio based on the transmission environment, encode audio based on the determined bit rate to acquire first audio data, receive second audio data from the second external electronic device through the second communication link, synchronize the first audio data and the second audio data, and transmit the synchronized audio data to the first external electronic device through the first communication link. Claim 2 In claim 1, the processor is an electronic device configured to exchange a transmission buffer state or signal strength with the second external electronic device and to monitor a transmission environment based on the transmission buffer state or the signal strength. Claim 3 An electronic device according to paragraph 2, wherein the processor is configured to determine a first bit rate when the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and to determine a second bit rate smaller than the first bit rate when the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold. Claim 4 In claim 1, the processor is an electronic device configured to assign the same index number as the second external electronic device to audio acquired at the same time as the second external electronic device. Claim 5 delete Claim 6 In claim 1, the processor is an electronic device configured to synchronize the first audio data and the second audio data based on index numbers included in the first audio data and the second audio data, respectively. Claim 7 In claim 1, the processor is an electronic device configured to transmit information about the first communication link to the second external electronic device. Claim 8 An electronic device comprising: a microphone; a communication module; a memory including a transmission buffer; and a processor operatively connected to the microphone, the communication module, or the memory, wherein the processor is configured to connect a second external electronic device and a second communication link, the second external electronic device and the first external electronic device connected to the first external electronic device via the communication module, receive a microphone open command from the second external electronic device, drive the microphone to acquire a microphone input signal, identify a transmission environment with the communication module or the second external electronic device, determine a bit rate of audio based on the transmission environment, assign an index number identical to that of the second external electronic device to audio acquired at the same time as the second external electronic device, encode audio based on the determined bit rate, and transmit the encoded audio data to the first external electronic device or the second external electronic device. Claim 9 In claim 8, the processor is an electronic device configured to exchange a transmission buffer state or signal strength with the second external electronic device and to identify a transmission environment based on the transmission buffer state or the signal strength. Claim 10 An electronic device according to claim 9, wherein the processor is configured to determine a first bit rate when the transmission buffer state is below a first threshold or the signal strength exceeds a signal threshold, and to determine a second bit rate smaller than the first bit rate when the transmission buffer state exceeds a first threshold or the signal strength is below a signal threshold. Claim 11 delete Claim 12 In paragraph 8, the processor is an electronic device configured to transmit the encoded audio data to the second external electronic device via the second communication link. Claim 13 In claim 8, the processor is an electronic device configured to receive information about the first communication link from the second external electronic device through the second communication link and to connect the first external electronic device and the first communication link based on the information about the first communication link. Claim 14 In paragraph 13, the processor is an electronic device configured to transmit the encoded audio data to the first external electronic device via the first communication link. Claim 15 An electronic device comprising: a communication module; a memory; and a processor operatively connected to the communication module or the memory, wherein the processor is configured to be connected to a first external electronic device via a first communication link through the communication module, and to instruct the first external electronic device to record upon receiving a recording request from a user, and to be connected to a second external electronic device via a second communication link through the communication module, and to receive first audio data obtained from the first external electronic device or second audio data obtained from the second external electronic device connected to the first external electronic device, and to synchronize the first audio data and the second audio data, and to be connected to a third external electronic device via a third communication link through the communication module. Claim 16 In paragraph 15, the processor is an electronic device configured to receive the second audio data from a second external electronic device that sniffs the first communication link. Claim 17 In paragraph 15, the processor is an electronic device configured to synchronize the first audio data and the second audio data based on an index number included in each audio data. Claim 18 delete Claim 19 In paragraph 15, the processor is an electronic device configured to receive the second audio data from the second external electronic device through the second communication link and to receive the third audio data from the third external electronic device through the third communication link. Claim 20 In paragraph 19, the processor is an electronic device configured to synchronize the first audio data to the third audio data.

Images