Multipoint wireless communication-based audio data transmission / reception device and operation method thereof

Abstract

The present disclosure provides an electronic device. The electronic device comprises: a communication module comprising a communication circuit for supporting simultaneous wireless connection with multiple external electronic devices; a memory; and one or more processors comprising a processing circuit, wherein the memory comprises instructions. The one or more processors may be individually or collectively executed to enable the electronic device to: identify at least one external electronic device wirelessly connected to the electronic device in response to a playback request for first audio data for a first external electronic device wirelessly connected to the electronic device; determine a first bitrate for transmitting the first audio data, on the basis of a remaining bandwidth range excluding a bandwidth used to maintain the wireless connection with the identified at least one external electronic device; in response to determining that the current bitrate is less than or equal to the first bitrate, encode the first audio data on the basis of the current bitrate, and thus generate a first audio packet; and transmit the first audio packet to the first external electronic device through the communication module.

Description

Audio data transmission and reception device based on multi-point wireless communication and its operation method

[0001] The present disclosure relates to an audio data transmitting and receiving device and an operating method thereof.

[0002] Audio streaming technology between heterogeneous devices using wireless network connections is widespread. For example, user terminals such as smartphones can connect to output devices such as wireless headphones or speakers via Bluetooth wireless connection, and music can be output through these wireless headphones or speakers.

[0003] An electronic device according to one embodiment of the present disclosure includes a communication module including a communication circuit configured to support simultaneous wireless connection with a plurality of external electronic devices, at least one processor including a memory and a processing circuit, wherein the memory stores instructions, and the at least one processor individually and / or collectively executes the instructions, such that the electronic device can perform the following: in response to a request for reproduction of first audio data for a first external electronic device wirelessly connected to the electronic device, identify at least one external electronic device wirelessly connected to the electronic device, determine a first bitrate for transmitting the first audio data based on a bandwidth range remaining excluding a bandwidth used for maintaining a wireless connection with the identified at least one external electronic device, and in response to determining that a current bitrate is less than or equal to the first bitrate, encode the first audio data based on the current bitrate to generate a first audio packet, and transmit the first audio packet to the first external electronic device via the communication module.

[0004] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: maintain a wireless connection between the electronic device and the at least one external electronic device based on a Bluetooth multipoint connection via the communication module while transmitting the first audio packet to the first external electronic device.

[0005] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: cause the at least one external electronic device to be connected to the electronic device, respectively, based on a first protocol.

[0006] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: transmit a data signal for checking a network connection status to a first external electronic device among at least one external electronic device that is wirelessly connected to the electronic device at a first cycle specified through the communication module; and in response to receiving a response signal from the first external electronic device within a specified time, maintain a Bluetooth multipoint-based wireless connection between the electronic device and the first external electronic device.

[0007] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: in response to determining that the current bitrate is greater than the first bitrate, change the current bitrate to be less than the first bitrate.

[0008] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: compress the first audio data to a lower quality than the current quality and then encode the first audio data at the changed current bitrate in response to determining that a difference between the current bitrate and the first bitrate is greater than a first reference.

[0009] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: in response to determining that the first bitrate is less than a predetermined threshold, cause the electronic device to disconnect from at least one of the at least one external electronic device that is wirelessly connected to the electronic device.

[0010] According to one embodiment, the electronic device further comprises a display, and at least one processor may individually and / or collectively cause the electronic device to: display a screen including at least one of information about at least one external electronic device that is concurrently connected with the electronic device or a message related to the disconnection action.

[0011] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: change the current bitrate in response to receiving a request to change the bitrate at which the first audio packet was received from the first external electronic device.

[0012] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: in response to a distance from a first external electronic device of the at least one external electronic device being outside a communicable range, disconnect the wireless connection with the first external electronic device.

[0013] According to another embodiment of the present disclosure, an electronic device includes a speaker, a communication module including a communication circuit configured to support simultaneous wireless connection with a plurality of external electronic devices, at least one processor including a memory and a processing circuit, wherein the memory stores instructions, and the at least one processor individually and / or collectively executes the instructions, and the electronic device can perform the following: receive a first audio packet from a first external electronic device among at least one external electronic device wirelessly connected to the electronic device through the communication module, and in response to determining that a bitrate applied to the first audio packet is greater than a reception buffer control bitrate, increase a size of the reception buffer, and output audio data decoded from the first audio packet through the speaker.

[0014] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: maintain a wireless connection between the electronic device and the at least one external electronic device based on a Bluetooth multipoint connection via the communication module while receiving the first audio packet.

[0015] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: cause the at least one external electronic device to be connected to the electronic device, respectively, based on a first protocol.

[0016] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: transmit a data signal for checking a network connection status to a first external electronic device among at least one external electronic device that is wirelessly connected to the electronic device at a first cycle specified through the communication module; and in response to receiving a response signal from the first external electronic device within a specified time, maintain a Bluetooth multipoint-based wireless connection between the electronic device and the first external electronic device.

[0017] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: determine a receive buffer control bitrate for storing or processing the received first audio packet based on an unused portion of a receive buffer of the electronic device, excluding a portion used for maintaining a wireless connection with at least one external electronic device with which the electronic device is wirelessly connected.

[0018] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: perform upsampling on the decoded audio data in response to determining that a bitrate applied to the first audio packet is less than a first threshold.

[0019] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: perform upsampling on the decoded audio data in response to determining that the decoded audio data is of a lower quality than the original quality of the first audio packet.

[0020] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: in response to determining that the size of the receive buffer is greater than a first reference size, cause the electronic device to disconnect from at least one of the at least one external electronic device that is wirelessly connected to the electronic device.

[0021] According to one embodiment, at least one processor may individually and / or collectively cause the electronic device to: transmit a request for a change in the applied bitrate of the first audio packet to the first external electronic device in response to determining that the size of the receive buffer is greater than a first reference size.

[0022] In one embodiment, the electronic device may be a wearable true wireless stereo device.

[0023] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0024] FIG. 1 is a block diagram illustrating an exemplary electronic device within a network environment according to one or more embodiments.

[0025] FIG. 2 is a block diagram illustrating an exemplary configuration of a wirelessly connected data transmission device and data reception device according to one or more embodiments.

[0026] FIG. 3 is a diagram illustrating a plurality of electronic devices within a wireless connection network environment according to one or more embodiments.

[0027] FIG. 4 is a signal flow diagram illustrating an exemplary audio data transmission and reception method of Bluetooth multi-point connected electronic devices according to one or more embodiments.

[0028] FIG. 5 is a flowchart illustrating an exemplary operation of an electronic device transmitting data to a wirelessly connected external playback device according to one or more embodiments.

[0029] FIG. 6 is a diagram illustrating an example of bandwidth usage information according to a multi-point connection, according to one or more embodiments.

[0030] FIG. 7 is a flowchart illustrating an exemplary operation of a playback device receiving and playing data from a wirelessly connected electronic device according to one or more embodiments.

[0031] FIG. 8 is a diagram illustrating an example of a data receiving device changing a data receiving buffer size according to one or more embodiments.

[0032] FIG. 9 is a diagram illustrating an example of bandwidth usage by a wirelessly connected data transmitting device and a data receiving device according to one or more embodiments.

[0033] FIG. 10 is a diagram illustrating an example of a multi-point connection situation between a plurality of electronic devices according to one or more embodiments.

[0034] FIG. 11 is a diagram illustrating an example of a Bluetooth connection alarm screen of an electronic device according to one or more embodiments.

[0035] Hereinafter, various embodiments of the present disclosure will be described in detail with reference to the drawings. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0036] FIG. 1 is a block diagram illustrating an exemplary electronic device within a network environment according to one or more embodiments.

[0037] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0038] The processor (120) may include various processing circuits and / or multiple processors. For example, the term "processor" as used herein, including in the claims, may include various processing circuits including at least one processor, wherein one or more of the at least one processor may be configured to individually and / or collectively perform the various functions described herein in a distributed manner. When "one processor," "at least one processor," and "one or more processors" are described herein as being configured to perform multiple functions, these terms include, but are not limited to, situations where one processor performs some of the recited functions and other processor(s) perform other parts of the recited functions, and situations where a single processor may perform all of the recited functions. Furthermore, the at least one processor may include a combination of processors that perform the various recited / disclosed functions, for example, in a distributed manner. The at least one processor may execute program instructions to achieve or perform various functions. The processor (120) may control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., program (140)), and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store result data in non-volatile memory (134).According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0039] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0040] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0041] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0042] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0043] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0044] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0045] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0046] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0047] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0048] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0049] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0050] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0051] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0052] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0053] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a communication module (192) (e.g., a cellular communication module, a short-range communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0054] The communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The communication module (192) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The communication module (192) may support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0055] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0056] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0057] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface).

[0058] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0059] FIG. 2 is a block diagram illustrating an exemplary configuration of a wirelessly connected data transmission device and data reception device according to one or more embodiments.

[0060] According to one embodiment, the electronic device (101) may utilize a wirelessly connected playback device (201) (or, electronic device (201)) for audio output. In various embodiments of the present disclosure, for convenience of explanation, the electronic device (101) that transmits audio data may be referred to as a data transmission device or a data provision device, and the electronic device (201) that receives audio data and outputs it through a speaker may be referred to as a data reception device or a playback device. The electronic device (101) and the playback device (201) may be the same electronic device, or may be different types of electronic devices. In addition, the electronic device (101) and the playback device (201) may include at least some of the components of the electronic device (101) of FIG. 1.

[0061] According to one embodiment, an electronic device (101) may include a processor (120) (e.g., including a processing circuit), a memory (130), and a communication module (190) (e.g., including a communication circuit). The communication module (190) may include various communication circuits, including a Bluetooth communication module (1901) that supports a Bluetooth wireless connection, an encoder (1902) that encodes audio data, and a transmission buffer (1903) for transmitting encoded audio packets. Some components of the communication module (190) may be operated by the processor (120) or a separate component.

[0062] According to one embodiment, a playback device (201) may include a processor (220) (e.g., including a processing circuit), a memory (230), a communication module (240) (e.g., including a communication circuit), and a speaker (250). The communication module (240) may include various communication circuits, including a receiving buffer (2401) for receiving audio packets, a decoder (2402) for decoding audio packets, an upscaler (2403) for upscaling decoded audio data, and a Bluetooth communication module (2404) for supporting Bluetooth wireless connection. Some components of the communication module (240) may be operated by the processor (220) or by separate components.

[0063] The Bluetooth communication module (1901) can support various profiles (e.g., A2DP or HFP) for performing various functions (e.g., audio transmission or voice call management). A2DP (advanced audio distribution profile) is a profile used for transmitting high-quality stereo audio, such as for playing songs. HFP (hands-free profile) is a profile used for voice communication, such as for phone calls.

[0064] For example, electronic device A can transmit and receive audio signals to and from electronic device B that supports Bluetooth through a first profile (e.g., A2DP) and transmit and receive data for a phone call through a second profile (e.g., HFP). Electronic device A can receive a phone call from electronic device B (or electronic device C) through the second profile while receiving an audio signal from electronic device B through the first profile. However, if electronic device A receives an audio signal from electronic device C through the same first profile while receiving an audio signal from electronic device B through the first profile, the Bluetooth connection with electronic device A may be terminated, and separate settings may be required for a new Bluetooth connection with device B.

[0065] An electronic device (101) and a playback device (2010) according to one embodiment of the present disclosure can support Bluetooth multi-point wireless connection that can communicate data with multiple devices through the same protocol. In Bluetooth wireless communication, for example, a multi-point connection is a function in which one device is connected to multiple Bluetooth devices simultaneously. For example, a playback device (201) capable of Bluetooth multi-point connection can be connected to a first electronic device (101) and a second electronic device (not shown) simultaneously, and when receiving an audio signal from the second electronic device (not shown) while receiving an audio signal from the first electronic device (101), there is no need to establish a separate Bluetooth connection.

[0066] The electronic device (101) and the playback device (201) may include Bluetooth communication modules (1901 and 2401), each including various Bluetooth circuits that support multi-point connections, and may be wirelessly connected to each other through multi-point connections. The electronic device (101) may be simultaneously connected to other Bluetooth devices in addition to the playback device (201). The playback device (201) may also be simultaneously connected to other Bluetooth devices in addition to the electronic device (101).

[0067] An electronic device according to one embodiment includes a communication module including a communication circuit to support simultaneous wireless connection with a plurality of external electronic devices, a memory, and at least one processor including a processing circuit, wherein the memory includes instructions, and the at least one processor (120) is configured to be executed individually and / or collectively, and may cause the electronic device to execute (or control) the following: in response to a request for reproduction of first audio data for a first external electronic device wirelessly connected to the electronic device, identify at least one external electronic device wirelessly connected to the electronic device, determine a first bitrate for transmitting the first audio data based on a bandwidth range remaining excluding a bandwidth used for maintaining a wireless connection with the identified at least one external electronic device, and in response to determining that a current bitrate is less than or equal to the first bitrate, encode the first audio data based on the current bitrate to generate a first audio packet, and transmit the first audio packet to the first external electronic device through the communication module. An embodiment of determining a first bitrate may correspond to determining a target bitrate in an embodiment described in more detail with reference to FIG. 5.

[0068] According to one embodiment, the electronic device (101) may maintain a wireless connection between the electronic device (101) and at least one external electronic device based on a Bluetooth multi-point connection through the communication module (190) while transmitting the first audio packet to the first external electronic device (201).

[0069] According to one embodiment, the electronic device (101) can be connected to at least one external electronic device based on a first protocol (e.g., A2DP) with the electronic device (101).

[0070] According to one embodiment, the electronic device (101) transmits a data signal at a predetermined (e.g., designated) first period (e.g., wireless connection confirmation period) through the communication module (190), thereby checking a network connection status of a first external electronic device among at least one external electronic device wirelessly connected to the electronic device (101), and receiving a response signal from the first external electronic device within a predetermined (e.g., designated) time, thereby maintaining a Bluetooth multi-point-based wireless connection between the electronic device (101) and the first external electronic device.

[0071] In response to determining that the current bitrate is greater than the first bitrate, the electronic device (101) according to one embodiment may change the current bitrate to be less than the first bitrate.

[0072] In response to determining that a difference between the current bitrate and the first bitrate is greater than a first reference, the electronic device (101) according to one embodiment may compress the first audio data to a lower sound quality than the current sound quality and then encode the first audio data to the changed current bitrate.

[0073] In response to determining that the first bitrate is less than a predetermined threshold, the electronic device (101) according to one embodiment may disconnect at least one of the external electronic devices that are wirelessly connected to the electronic device.

[0074] An electronic device (101) according to one embodiment further includes a display, and can display (e.g., output or display) a screen including at least one of information about at least one external electronic device that is simultaneously connected to the electronic device (101) or a message related to the disconnection operation through the display.

[0075] An electronic device (101) according to one embodiment may change the current bitrate in response to receiving a request for a change in the bitrate at which the first audio packet is received from the first external electronic device (201).

[0076] An electronic device (101) according to one embodiment may, in response to a distance from a first external electronic device among the at least one external electronic device being outside a communicable range, disconnect a Bluetooth multi-point based wireless connection with the first external electronic device.

[0077] According to one embodiment, a playback device (or electronic device) comprises a speaker, a communication module including a communication circuit to support simultaneous wireless connection with a plurality of external electronic devices, a memory, and at least one processor including a processing circuit, wherein the memory includes instructions, and the at least one processor is configured to be individually and / or collectively executed, and the electronic device can perform (or control) the following: receive a first audio packet from a first external electronic device among at least one external electronic device wirelessly connected to the electronic device through the communication module, and in response to determining that a bitrate applied to the first audio packet is greater than a reception buffer control bitrate, increase a size of the reception buffer, and output audio data decoded from the first audio packet through the speaker.

[0078] According to one embodiment, the electronic device (201) can maintain a wireless connection between the electronic device (201) and the at least one external electronic device based on a Bluetooth multi-point connection through the communication module (240) while receiving the first audio packet.

[0079] According to one embodiment, the electronic device (201) can be connected to at least one external electronic device based on a first protocol (e.g., A2DP) with the electronic device (201).

[0080] According to one embodiment, an electronic device (201) transmits a data signal for checking a network connection status to a first external electronic device among at least one external electronic device that is wirelessly connected to the electronic device (201) at a predetermined (for example, designated) first period through the communication module (240), and receives a response signal from the first external electronic device within a designated time, thereby maintaining a Bluetooth multi-point-based wireless connection between the electronic device and the first external electronic device.

[0081] An electronic device (201) according to one embodiment may determine a reception buffer control bitrate to store or process the received first audio packet based on an unused portion of a reception buffer of the electronic device (201) excluding a portion used to maintain a wireless connection with at least one external electronic device that is wirelessly connected to the electronic device (201).

[0082] An electronic device (201) according to one embodiment may perform upsampling on the decoded audio data in response to determining that a bitrate applied to the first audio packet is less than a first threshold value.

[0083] An electronic device (201) according to one embodiment may perform upsampling on the decoded audio data in response to determining that the decoded audio data is of lower quality than the original quality of the first audio packet.

[0084] In one embodiment, the electronic device (201) may, in response to determining that the size of the receiving buffer is greater than the first reference size, disconnect at least one external electronic device among at least one external electronic device that is wirelessly connected to the electronic device (201).

[0085] In response to determining that the size of the receiving buffer is greater than the first reference size, the electronic device (201) according to one embodiment may transmit a request for a change in the bitrate applied to the first audio packet to the first external electronic device (101).

[0086] According to one embodiment, the electronic device (201) may be a wearable, true wireless stereo device.

[0087] The embodiments of FIG. 2 may be combined with the embodiments of FIG. 1 or the embodiments of FIGS. 3 to 11. The configurations of the electronic device (101) and the playback device (201) of FIG. 2 may be partially or completely identical to the configuration of the electronic device (101) of FIG. 1. The configuration of the electronic device (101) of FIG. 2 may perform part or all of the operations of the electronic device (101) of FIG. 5. The configuration of the playback device (201) of FIG. 2 may perform part or all of the operations of the electronic device (201) of FIG. 7.

[0088] FIG. 3 is a diagram illustrating a plurality of electronic devices within a wireless connection network environment according to one or more embodiments.

[0089] According to one embodiment, a plurality of electronic devices within a wireless connection network environment (300) may be simultaneously connected to each other based on (for example, using) a Bluetooth multi-point connection. The plurality of electronic devices may include a data transmission device for reproducing audio data, and a data reception device (or playback device) for receiving and outputting audio data. For convenience of explanation, the description is made as a data transmission device and a data reception device, but the components of the electronic devices are not limited, and each electronic device may be capable of both data transmission and data reception, and may output data (for example, audio signals) through various output devices (for example, speakers).

[0090] Referring to FIG. 3, a mobile electronic device (e.g., a first electronic device (101a), a second electronic device (101b)) (e.g., the electronic device (101) of FIG. 2) can transmit an audio signal to a playback device (201a, 201b, 201c) (e.g., the playback device (201) of FIG. 2) for audio playback. The playback device (201a, 201b, 201c) can output the received audio signal through a speaker of the playback device (201a, 201b, 201c).

[0091] For example, Bluetooth wireless communication is a short-range wireless communication, and wireless connection is possible only within a (for example, limited) range in which communication is possible. In FIG. 3, the first electronic device (101a) can be simultaneously connected to the first playback device (201a), the second playback device (201b), and the third playback device (201c), which are located within a first range (310) in which Bluetooth wireless communication is possible, and are indicated by distances (d1), (d2), and (d3), respectively. The first distance (d1) between the first electronic device (101a) and the second playback device (201b), the second distance (d2) between the first electronic device (101a) and the first playback device (201a), and the third distance (d3) between the first electronic device (101a) and the third playback device (201c) are included in the first range (310) in which Bluetooth wireless communication is possible with the first electronic device (101a). The first electronic device (101a) can transmit and receive data to and from at least one of the first playback device (201a), the second playback device (201b), or the third playback device (201c) at any time without separate (e.g., additional) communication settings while being simultaneously connected to the first playback device (201a), the second playback device (201b), and the third playback device (201c).

[0092] The second playback device (201b) can simultaneously establish a Bluetooth wireless connection with the first electronic device (101a) and the second electronic device (101b), which are included within the second range (320) within which Bluetooth wireless communication is possible, as indicated by the distance (d1) and the distance (d4). Since the distance (d5) between the second electronic device (101b) and the third playback device (201c) is outside the range within which Bluetooth wireless communication is possible, the two electronic devices may not be connected. The Bluetooth wireless connection is maintained while the two devices are in close proximity, is disconnected when the distance between the two devices increases, and may be automatically reconnected when the distance between the two devices decreases again. For example, if the first playback device (201a) connected to the first electronic device (101a) moves out of the first range (310) within which communication is possible, the connection between the first electronic device (101a) and the first playback device (201a) may be disconnected. Alternatively, if the second electronic device (101b) moves close enough to the third playback device (201c) to enable Bluetooth wireless communication, the two devices may be automatically connected.

[0093] FIG. 4 is a signal flow diagram illustrating an exemplary audio data transmission and reception method of Bluetooth multi-point connected electronic devices according to one or more embodiments.

[0094] According to one embodiment, the playback device (201b) may be connected to the first electronic device (101a) based on a first protocol (e.g., A2DP) in operation 401. According to one embodiment, the playback device (201b) may be connected to the second electronic device (101b) based on the first protocol (e.g., A2DP) in operation 402. According to one embodiment, the playback device (201b) may be simultaneously connected to the first electronic device (101a) and the second electronic device (101b) based on the first protocol. For example, the playback device (201b) may be a wearable device (e.g., TWS (true wireless stereo)) that can be worn on a user's ear. The first electronic device (101a) may be a mobile device (e.g., a smartphone), and the second electronic device (101b) may be a tablet device. Operation 401 may be performed after operation 402, and operations 401 and 402 may be performed simultaneously. The order disclosed in FIG. 4 is merely an example, and the playback device (201b) may independently perform wireless connection with the first electronic device (101a) and the second electronic device (101b). The playback device (201b) may transmit and receive data with the first electronic device (101a) or the second electronic device (101b) at any time while being wirelessly connected to the first electronic device (101a) and the second electronic device (101b) simultaneously. In various embodiments, the playback device (201b) may first receive data from the second electronic device (101b) and then receive data from the first electronic device (101a).

[0095] In operation 403, the first electronic device (101a) may receive an audio playback request upon execution of an application (e.g., a music player). In operation 404, the first electronic device (101a) may transmit a first audio packet encoded with audio source data to a playback device (201b) for streaming. In operation 404, the playback device (201b) may decode the first audio packet received from the first electronic device (101a) and output it through a speaker in operation 405.

[0096] In operation 406, the second electronic device (101b) may receive an audio playback request according to the execution of an application (e.g., a multimedia file). In operation 407, the second electronic device (101b) may transmit a second audio packet containing encoded audio data to the playback device (201b) for streaming.

[0097] In operation 407, the playback device (201b) may receive a second audio packet from the second electronic device (101b) while being wirelessly connected to the first electronic device (101a). In operation 408, the playback device (201b) may stop streaming (e.g., playing) the first audio packet received from the first electronic device (101a) and decode the received second audio packet and output it through a speaker. In operation 409, the playback device (201b) may notify the first electronic device (101a) that it is streaming audio with another electronic device. In operation 410, the first electronic device (101a) may, in response to receiving the alarm, display (or notify) through an output device (e.g., a display) that the playback device (201b) is connected to and operating with the other electronic device (e.g., audio streaming playback has been stopped). At this time, the playback device (201b) and the first electronic device (101a) can maintain a Bluetooth multi-point connection regardless of whether streaming is performed. Similarly, the wireless connection between the playback device (201b) and the second electronic device (101b) can also be maintained.

[0098] FIG. 5 is a flowchart illustrating an exemplary operation of an electronic device transmitting data to a wirelessly connected external playback device according to one or more embodiments.

[0099] An electronic device (101) according to one embodiment can be simultaneously connected to multiple devices, including external playback devices, based on a Bluetooth multi-point connection. In a Bluetooth environment, connection relationships with multiple devices can change in real time depending on various factors.

[0100] In operation 510, according to one embodiment, an electronic device (101) (e.g., the electronic device (101) of FIG. 2) may be requested to play audio upon execution of an application (e.g., a music player or a multimedia file). The electronic device (101) may play audio through an audio output module (155) of the electronic device (101) or an external playback device (e.g., a wirelessly connected wearable electronic device). The electronic device (101) may set a default output device in the initial settings. For example, the electronic device (101) may set a wearable electronic device (e.g., the playback device (201) of FIG. 2) as a default output device while the wirelessly connected wearable electronic device is worn by a user. The electronic device (101) may check the output device in response to the audio playback request, and if the set default output device is a wirelessly connected external playback device (e.g., the playback device (201) of FIG. 2), the electronic device may perform the following operations for transmitting an audio signal.

[0101] In operation 520, the electronic device (101) can determine whether it is in a Bluetooth multipoint wireless connection state. The electronic device (101) can be simultaneously connected to multiple external electronic devices (e.g., at least two) based on the Bluetooth multipoint wireless connection. The electronic device (101) can determine whether it is using the Bluetooth multipoint wireless connection by checking the status of the communication module (190). If the electronic device (101) is not in a Bluetooth multipoint wireless connection state, for example, if it is in a Bluetooth connection with one external electronic device, the electronic device (101) can perform operation 570.

[0102] In operation 530, the electronic device (101), when in a Bluetooth multi-point wireless connection state, may identify (or confirm) a device connected to the multi-point. The electronic device (101) may perform wireless communication at regular intervals (e.g., a wireless connection confirmation cycle) to maintain a connection with an external electronic device connected to the multi-point. In one embodiment, the wireless connection confirmation cycle may be adaptively determined according to a Bluetooth communication environment. The wireless connection confirmation cycle may be a cycle arbitrarily set within a maximum period during which Bluetooth communication between two devices (e.g., an electronic device and an external electronic device) can be maintained. For example, the electronic device (101) may transmit a signal (e.g., a Ping) to test a connection status with an external electronic device being wirelessly connected at each wireless connection confirmation cycle, and may receive an ACK (acknowledgement signal) from the external electronic device. In one embodiment, the electronic device (101) may determine the number of external electronic devices being simultaneously connected based on the number of ACKs received during the wireless connection confirmation cycle. If the electronic device (101) receives three ACKs during a wireless connection confirmation cycle, it can confirm that it is simultaneously connected wirelessly to three external electronic devices. The electronic device (101) can continuously use some bandwidth to maintain a Bluetooth connection with the three external electronic devices.

[0103] In operation 540, the electronic device (101) may determine the available bandwidth and target bitrate. The electronic device (101) may determine the available bandwidth based on information about external electronic devices that are being connected in a multi-point manner. While the electronic device (101) is simultaneously connected to multiple external electronic devices, a portion of the bandwidth may be used (or allocated) as necessary (or sufficient) for performing network communication with each of the multiple external electronic devices according to a network confirmation cycle. The electronic device (101) may determine the remainder of the total bandwidth, excluding the bandwidth used for network confirmation with external electronic devices that are being connected in a multi-point manner, as the available bandwidth. As the number of external electronic devices that are being connected in a Bluetooth multi-point wireless connection increases, the portion of the total bandwidth occupied (used) for maintaining a wireless connection may increase. In one embodiment, the electronic device (101) may use a bandwidth determined according to a Bluetooth communication standard as the total bandwidth. For example, if the bandwidth defined in the Bluetooth communication standard is 3 Mbps, the electronic device (101) can perform Bluetooth communication within 3 Mbps.

[0104] Since the total bandwidth of the electronic device (101) is a limited resource, it can be divided into a portion used for network communication confirmation to maintain a multi-point connection and a portion used for data transmission and reception. As the number of external electronic devices connected to the multi-point increases, the bandwidth range used for network communication confirmation also increases, and correspondingly, the bandwidth range used for data transmission and reception decreases. For example, if the total bandwidth is 100, and the bandwidth used for maintaining a multi-point connection is n, the bandwidth available for data transmission and reception can be 100-n. Maintaining a multi-point connection increases user convenience by making it easy to switch between multiple devices, but may be a trade-off with the data transmission and reception aspect.

[0105] The electronic device (101) can determine the target bitrate based on the available bandwidth. The electronic device (101) can determine the target bitrate based on the multipoint connection status (e.g., the number of external electronic devices connected via multipoint). For example, the electronic device (101) can determine the highest bitrate within the available bandwidth as the target bitrate.

[0106] If there are no external electronic devices connected to the multipoint, the electronic device (101) can use the entire bandwidth to transmit data to the external electronic devices, thereby transmitting audio data at a high bit rate. If there are multiple external electronic devices connected to the multipoint, the electronic device (101) has no choice but to use a portion of the entire bandwidth for the multipoint connection and determine a target bit rate based on the remaining bandwidth, excluding a portion of the entire bandwidth. If the target bit rate is low, the electronic device (101) may not be able to reach the level required to transmit audio data. In one embodiment, if the portion of the bandwidth used for the multipoint connection is large, the real-time streaming quality of the audio data may be degraded if the electronic device (101) transmits audio data at a target bit rate determined based on the available bandwidth.

[0107] In operation 550, the electronic device (101) may determine whether the current bitrate is greater than the target bitrate. In one embodiment, the current bitrate may be the bitrate used to transmit and receive current data. When transmitting and receiving data for the first time, the current bitrate may be determined based on the current network environment and / or data properties (e.g., compression sampling rate). For example, the electronic device (101) may preset a default bitrate (e.g., 584 kbps) for transmitting and receiving high-quality audio data, and may regard the current bitrate as the default bitrate (e.g., 584 kbps) upon an initial audio data transmission request.

[0108] The electronic device (101) may change the current bitrate if, in operation 560, the current bitrate is greater than the target bitrate. If the current bitrate is greater than the target bitrate, data transmission at the current bitrate may be difficult within the currently available bandwidth. The electronic device (101) may change the current bitrate to a level usable within the currently available bandwidth.

[0109] In operation 560, the electronic device (101) may change the current bitrate to a lower bitrate. In one embodiment, the electronic device (101) may change the current bitrate to a target bitrate or a bitrate lower than the target bitrate. The electronic device (101) may change the current bitrate within a range lower than the target bitrate, taking into account the degree required for transmitting audio data. For example, when the current bitrate is 584 kbps and the target bitrate is 500 kbps, the electronic device (101) may change the current bitrate to a first bitrate (e.g., 291 kbps) or a target bitrate (e.g., 500 kbps) preset for transmitting audio data.

[0110] According to one embodiment, the electronic device (101) may compress high-quality original audio data to normal or low-quality audio data and then transmit the data at a bit rate lower than the target bit rate. For example, the electronic device (101) may compress the audio data to high-quality audio data of 96 kHz and 24 bits and then transmit the data at 291 kbps, or compress the audio data to normal audio data of 48 kHz and 16 bits and then transmit the data at 291 kbps. When the electronic device (101) compresses high-quality audio data to normal or low-quality audio data and transmits the compressed audio data to an external playback device (e.g., the playback device (201) of FIG. 2) and the external playback device (201) outputs the compressed audio data as is through a speaker, the audio quality may deteriorate. Even if the electronic device (101) transmits the original audio data as is to an external playback device (201) when the original audio data is of normal or low quality, if the external playback device (201) outputs the data as is through a speaker, the audio quality may deteriorate.

[0111] The electronic device (101) can maintain the current bit rate by enabling data transmission according to the current bit rate with the currently available bandwidth in response to determining that the current bit rate is not greater than the target bit rate in operation 570.

[0112] In operation 580, the electronic device (101) may encode audio data according to the current bit rate and transmit the encoded audio data to an external playback device. When transmitting the audio data, the electronic device (101) may include information about the audio data. The information about the audio data may include information about the applied bit rate, the sampling rate for the original audio, and / or the file size.

[0113] An electronic device (101) according to one embodiment may repeat operations 530 to 580 during streaming in response to an audio playback request. The electronic device (101) may adaptively change a bitrate even while streaming audio data in response to changes in multi-point connectivity (e.g., changes in the number of wirelessly connected external electronic devices).

[0114] FIG. 6 is a diagram illustrating an example of bandwidth usage information according to a multi-point connection, according to one or more embodiments.

[0115] According to one embodiment, an electronic device (101) can transmit and receive data within a predetermined bandwidth (e.g., the entire bandwidth). When multiple electronic devices are connected to each other based on a Bluetooth multipoint connection, each electronic device can use a portion (e.g., a certain amount) of bandwidth to maintain the multipoint connection. FIG. 6 assumes the entire bandwidth to be 10 and only illustrates the classification according to bandwidth usage as an example in percentage form. However, the method of distinguishing bandwidth may vary in various embodiments.

[0116] Referring to FIG. 6, for example, if only one external electronic device is connected based on a multi-point connection, the electronic device (101) can transmit audio streaming using the entire bandwidth (1 to 10) to communicate data with the external electronic device (610). Since only one external electronic device is connected, there is no need to use a network to maintain a wireless connection with other electronic devices.

[0117] When an electronic device (101) is connected to two external electronic devices (e.g., a first external device and a second external device) and communicates data with one of the electronic devices (e.g., the second external device), a portion (1, 2) of the total bandwidth is used to maintain a wireless connection with the first external device, and the remaining bandwidth (3 to 10) can be used to transmit audio streaming to the second external device (620). Since the first external device and the second external device are connected to the electronic device (101) simultaneously, the electronic device (101) can receive data from the first external device or the second external device, or transmit data to the first external device or the second external device at any time. In 620 of FIG. 6, when the electronic device (101) transmits and receives data with the first external device, the first connection portion may increase (e.g., using 1 to 8), and the connection portion with the second external device may decrease (e.g., using 9, 10).

[0118] When an electronic device (101) is connected to three external electronic devices (e.g., a first external device, a second external device, and a third external device) and communicates data with one of the electronic devices (e.g., the third external device), a portion (1 to 4) of the total bandwidth is used to maintain a wireless connection with the first external device and the second external device, and the remaining bandwidth (5 to 10) can be used to transmit audio streaming to the third external device (630).

[0119] As shown in the example of Fig. 6, the range of available bandwidth among the total bandwidth may vary depending on the number of external electronic devices connected to the multipoint. Multiple multipoint-connected electronic devices may be disconnected or reconnected depending on the distance between the electronic devices, and may also be disconnected or reconnected depending on the power on / off status of the electronic devices. The number of external electronic devices connected to the electronic device and the multipoint-connected electronic devices may vary depending on various circumstances. The electronic device (101) may transmit and receive data by considering the status of the external electronic devices connected to the multipoint in real time.

[0120] FIG. 7 is a flowchart illustrating an exemplary operation of a playback device receiving and playing data from a wirelessly connected electronic device according to one or more embodiments.

[0121] According to one embodiment, a playback device (201) can be simultaneously connected to multiple devices including an electronic device (e.g., electronic device (101)) based on a Bluetooth multi-point connection. In one embodiment, the electronic device (101) can be a data transmission device or a data provision device. For example, the electronic device (101) can be a mobile device (e.g., a smartphone), and the playback device (201) can be a wearable TWS. In a Bluetooth environment, connection relationships with multiple devices can change in real time due to various factors.

[0122] In operation 710, the playback device (201) may receive an audio packet from an external electronic device (101), which is one of one or more external electronic devices connected based on Bluetooth multipoint.

[0123] In operation 720, the playback device (201) can decode the received audio packet and check the bit rate (hereinafter, “received bit rate”) for the received audio packet. If the electronic device (101) encodes and transmits audio data at a first bit rate (e.g., 584 kbps), the playback device (201) can decode the received audio packet and check the first bit rate.

[0124] In operation 730, the playback device (201) can determine whether the reception bitrate is greater than the buffer control bitrate. If the reception bitrate is greater than the buffer control bitrate, the playback device (201) can change the reception buffer size in operation 740.

[0125] The buffer control bitrate refers to the speed or size of processing the receiving buffer. The buffer control bitrate can be determined based on the size of the receiving buffer, and the size of the receiving buffer can vary depending on the number of external electronic devices wirelessly connected to the playback device (201). For example, if the number of external electronic devices wirelessly connected to the playback device (201) is large, the remaining size except for the size of the receiving buffer used to maintain the multi-point wireless connection can be used for data transmission and reception. Therefore, as the number of external electronic devices wirelessly connected increases, the buffer control bitrate of the playback device (201) can decrease. If the receiving bitrate is greater than the buffer control bitrate, the processing speed or size of the receiving buffer may be small to handle the audio packet rate or amount in the playback device (201), which may cause overflow. In this case, the playback device (201) may increase the receiving buffer size based on the receiving bitrate to facilitate audio packet reception.

[0126] The playback device (201) can perform network communication at regular intervals to maintain wireless communication with one or more external electronic devices simultaneously connected based on Bluetooth multipoint. A portion of the reception buffer may be used for network communication with one or more external electronic devices wirelessly connected to the playback device (201). The buffer control bitrate may be determined based on the overall usage of the reception buffer.

[0127] The playback device (201), in response to determining that the bitrate of the received audio packet is greater than the buffer control bitrate in operation 740, may change the size of the reception buffer according to the reception bitrate. For example, the playback device (201) may increase the reception buffer size by 150% to 200%. The playback device (201) may determine the reception buffer size to be added in proportion to the difference between the reception bitrate and the buffer control bitrate.

[0128] The playback device (201), in operation 750, can maintain the current reception buffer size if the reception bitrate is less than or equal to the buffer control bitrate. If the reception bitrate in the playback device (201) is less than or equal to the buffer control bitrate, the size of the current reception buffer of the playback device (201) may be sufficient to store or process the received audio packets.

[0129] In operation 760, the playback device (201) may determine whether the bitrate of the received audio packet is lower than a first threshold value. In one embodiment, the playback device (201) may convert or improve the audio signal to a higher sampling rate using an upscaler (e.g., the upscaler (2402) of FIG. 2). If the electronic device (101) transmits at a low bitrate, audio data having a lower quality than that of the original audio signal may be transmitted. If the playback device (201) decodes the received audio data and outputs it as is, an audio signal having a lower quality than the original sound quality may be reproduced. The playback device (201) may upscale to restore the sound quality level of an audio packet encoded and transmitted at a bitrate lower than the bitrate according to the sampling rate of the original audio data. In one embodiment, the first threshold value may be predefined according to a bitrate corresponding to a high quality level supported by the playback device (201). The playback device (201) can decode the audio packet and determine a first threshold for determining whether to upscale based on information about the audio data. In operation 770, the playback device (201) can perform upscaling on the received audio data if the bitrate of the received audio packet is less than the first threshold. The playback device (201) can not apply the upscaler if the bitrate of the received audio packet is greater than or equal to the first threshold.

[0130] The electronic device (201) may, at operation 770, upscale the decoded audio data. The electronic device (101) may compress the original audio data to a low quality according to the limited bandwidth usage and then transmit it at a low bit rate. The playback device (201) may restore the original audio quality using the upscaler (2402) when the bit rate of the received audio packet falls below the first threshold. The upscaler (2402) of the playback device (201) may be included in the communication module (240). In some embodiments, it may operate in the processor (220) of the playback device (201).

[0131] The playback device (201) can, in operation 780, play back the decoded audio data or the audio data upscaled after decoding through the speaker (250) of the playback device (201).

[0132] FIG. 8 is a diagram illustrating an example of changing a data reception buffer size of a data reception device according to one or more embodiments.

[0133] According to one embodiment, the data receiving device (201) (or the playback device (201)) can receive data from a first external electronic device among a plurality of external electronic devices that are simultaneously connected based on Bluetooth multipoint using a receiving buffer (e.g., the receiving buffer (2404) of FIG. 2). In addition, the playback device (201) can perform network communication at regular intervals using the receiving buffer (2404) to maintain wireless communication with one or more external electronic devices that are simultaneously connected based on Bluetooth multipoint. Referring to FIG. 8, the playback device (201) can perform wireless connection with a plurality of external electronic devices simultaneously using the receiving buffer (810) of the first state and perform data from the first external electronic device. For example, the playback device (201) can transmit a signal (e.g., Ping) to test a connection status with an external electronic device that is being wirelessly connected at every wireless connection confirmation cycle, and receive an ACK from the external electronic device. Conversely, the playback device (201) may transmit an ACK in response to receiving a Ping at a regular interval from an external electronic device to which it is wirelessly connected. Accordingly, a portion of the reception buffer (810) in the first state may be used for network communication between the playback device (201) and one or more external electronic devices to which it is wirelessly connected. Since exchanging Ping / ACK is data transmission and reception only for checking the network communication status, a minimum bandwidth and reception buffer (810) may be used. However, when the number of wirelessly connected external electronic devices increases, the proportion of bandwidth and reception buffer (810) used for maintaining the wireless connection may increase. In one embodiment, the playback device (201) may not be able to allocate sufficient bandwidth and reception buffer size for data transmission and reception depending on the amount of bandwidth and reception buffer (810) used for maintaining a wireless connection based on a Bluetooth multipoint with a plurality of external electronic devices.

[0134] According to one embodiment, the playback device (201) may increase the capacity of the reception buffer (810) when the bit rate according to data reception is greater than the bit rate currently controlling the reception buffer (810). Alternatively, the playback device (201) may increase the capacity of the reception buffer (810) in the first state to the same extent as the reception buffer (820) in the second state as the number of external electronic devices that are being connected based on Bluetooth multi-point increases. Furthermore, even when the capacity of the reception buffer (820) in the second state is increased, if a problem such as a delay in processing speed or a buffer overflow occurs according to data transmission and reception, the playback device (201) may request the electronic device transmitting data based on the wireless connection to transmit data at a lower transmission speed, or may disconnect from other electronic devices that are being simultaneously connected according to the multi-point connection without transmitting and receiving data.

[0135] The receiving buffer (2404, 810, or 820) of the playback device (201) may be included within the communication module (240). Alternatively, depending on the embodiment, the receiving buffer (2404, 810, or 820) of the playback device (201) may exist as separate hardware from the communication module (240). In another embodiment, the receiving buffer (2404, 810, or 820) may also be implemented by allocating some of the addresses of the memory (230). Depending on the embodiment, the playback device (201) may change the size of the receiving buffer (2404, 810, or 820) in various ways.

[0136] In one embodiment, the playback device (201) may reduce the size of the receiving buffer (2404, 810, or 820) due to various factors, such as a decrease in the number of wireless connection devices based on Bluetooth multipoint, or a decrease in the bit rate of data received from an external electronic device.

[0137] FIG. 9 is a diagram illustrating an example of bandwidth usage by a wirelessly connected data transmitting device and a data receiving device according to one or more embodiments.

[0138] According to one embodiment, a data transmission device (101) (e.g., an electronic device (101) of FIG. 2) and a data reception electronic device (201) (e.g., a playback device (201) of FIG. 2) may be wirelessly connected based on a Bluetooth multi-point connection. The data transmission device (101) and the data reception electronic device (201) may each be simultaneously connected to other electronic devices based on multi-point. For example, referring to FIG. 9, the data transmission device (101) is wirelessly connected simultaneously to an electronic device A, an electronic device B, and a data reception device (201). The data reception device (201) is wirelessly connected simultaneously to an electronic device C and the data transmission device (101).

[0139] In one embodiment, the data transmission device (101) can transmit or receive data to any one of the wirelessly connected electronic device A, electronic device B, or data reception device (201). In one embodiment, the data reception device (201) can receive or transmit data from the wirelessly connected electronic device C or data transmission device (101).

[0140] The data transmission device (101) and the data reception electronic device (201) may each have different available bandwidths and / or different sizes of transmission (reception) buffers depending on the multi-point connection. As in the embodiment of FIG. 5, the data transmission device (101) may adaptively change the bit rate based on its own multi-point connection status to transmit data. As in the embodiment of FIG. 7, the data reception device (201) may change the size of the reception buffer depending on the bit rate of the received audio packet, or may restore the sound quality of the received data using an upscaler. Referring to FIG. 9, the data transmission device (101) and the data reception device (201) may each influence the number of other electronic devices that are simultaneously connected based on the multi-point connection.

[0141] In one embodiment, the data transmission device (101) may increase the available bandwidth range and target bitrate, for example, in response to a wireless connection with electronic device A being released. Accordingly, the data reception device (201) may receive audio packets at the changed bitrate while receiving audio packets from the data transmission device (101), and may adaptively change the reception buffer management and whether or not to apply upscaling.

[0142] In one embodiment, the data receiving device (201) may establish a new wireless connection with another electronic device (e.g., D electronic device (not shown)) while receiving an audio packet from the data transmitting device (101). For example, when the D electronic device, which has registered a wireless communication connection based on a Bluetooth multi-point connection with the data receiving device (201), is turned on, or when the location of the D electronic device approaches the location of the data receiving device (201) within a range where a Bluetooth communication connection is possible, the two devices may automatically establish a wireless connection. Accordingly, an overflow may occur in the receiving buffer of the data receiving device (201) while receiving an audio packet at the same bit rate from the data transmitting device (101). The data receiving device (201) may change the buffer control bit rate and, if necessary, transmit multi-point connection information to the data transmitting device (101) to request that the audio packet be transmitted at a lower bit rate.

[0143] In various embodiments, the data transmission device (101) and the data reception electronic device (201) can share multi-point connection information with each other.

[0144] FIG. 10 is a diagram illustrating an example of a multi-point connection situation between a plurality of electronic devices according to one or more embodiments.

[0145] According to one embodiment, multiple electronic devices within a wireless connection network environment can be simultaneously connected to each other based on a Bluetooth multi-point connection.

[0146] Each of the multiple electronic devices can maintain wireless connections with other electronic devices while transmitting or receiving data to or from a wirelessly connected electronic device. Depending on the embodiment, the electronic device may temporarily or continuously disconnect wirelessly from some electronic devices connected via Bluetooth multipoint to ensure smooth data transmission and reception.

[0147] Referring to FIG. 10, for example, a first electronic device (101a) is simultaneously connected to a first wearable electronic device (201a) of the TWS type, a second wearable electronic device (201b) of the TWS type, and a Bluetooth speaker (201c). The second wearable electronic device (201b) is simultaneously connected to the first electronic device (101a) and the second electronic device (101b).

[0148] In one embodiment, a first electronic device (101a) may transmit audio streaming to a second wearable electronic device (201b). To transmit high-quality audio streaming smoothly without sound interruption, the first electronic device (101a) and the second wearable electronic device (201b) may change the bit rate, increase or decrease the size of the transmission / reception buffer, or upscale audio data received at low quality. For example, the first electronic device (101a) may transmit audio packets at a lower quality and / or bit rate than the quality and / or bit rate required by the original audio, taking into account some of the bandwidth being used to maintain a multi-point connection with the second wearable electronic device (201b) and the Bluetooth speaker (201c). The second wearable electronic device (201b) can receive an audio packet transmitted with a lower quality and / or bitrate than the quality and / or bitrate of the original audio, and restore the quality of the audio signal by adjusting the reception buffer size or using an upscaler.

[0149] In one embodiment, the first electronic device (101a) and / or the second wearable electronic device (201b) can control a multi-point connection situation. The first electronic device (101a) can disconnect from at least one of the devices being multi-point connected. For example, in operation 1010, the first electronic device (101a) can disconnect from a first wearable electronic device (201a) of the same type as the second wearable electronic device (201b) that is currently transmitting and receiving data. Alternatively, the first electronic device (101a) can disconnect from a wearable electronic device that is not being worn among the devices being wirelessly connected. The first electronic device (101a) can disconnect from a wirelessly connected electronic device that has been unused for the longest period of time. The second wearable electronic device (201b) can disconnect from the second electronic device (101b) that is being connected to it in operation 1020.

[0150] In one embodiment, the electronic device (101a) and / or the second wearable electronic device (201b) may predefine settings for disconnection and configure the screen to allow the settings to be added, changed, or deleted by user input.

[0151] FIG. 11 is a diagram illustrating an example of a Bluetooth connection alarm screen of an electronic device according to one or more embodiments.

[0152] According to one embodiment, the electronic device (101) (or electronic device (201)) can be simultaneously connected to multiple external electronic devices based on a Bluetooth multi-point connection. In one embodiment, the electronic device (101) can provide a screen to the user according to the multi-point connection status. For example, in the situation of FIG. 10, a Bluetooth connection alarm screen can be displayed on the first electronic device (101a) or the second electronic device (101b).

[0153] The first electronic device (101a) may display a first screen (1110) that displays information about a Bluetooth connection being connected in a multi-point manner. The first screen (1110) may include an alarm requesting disconnection from another device being connected in a multi-point manner in relation to data transmission and reception between the first electronic device (101a) and the connected playback device. For example, the first screen (1110) may display a guidance message such as "Do you want to disconnect from TV1 for smooth music playback with Buds1?" along with a Yes / No icon and receive user input. For example, Buds1 may be a second wearable electronic device (201b), and TV1 may be another electronic device being wirelessly connected to the first electronic device (101a).

[0154] For another example, the first electronic device (101a) may display a second screen (1120) including a list of connected devices. The second screen (1120) may include an alarm requesting disconnection of at least one or more other devices in a multi-point connection in relation to data transmission and reception between the first electronic device (101a) and the playback device connected thereto. For example, the second screen (1120) may display a guidance message such as "For smooth music playback with Buds 1, would you like to disconnect from other devices?", along with a list of connected devices and an icon that allows the user to check whether to disconnect from the devices.

[0155] For another example, the second electronic device (101b) may include an alarm requesting disconnection with respect to data transmission and reception between the second wearable electronic device (201b) (e.g., Buds 1) that is being wirelessly connected and the first electronic device (101a) during the wireless connection. The second wearable electronic device (201b) may improve the audio streaming environment by disconnecting from other electronic devices in addition to the electronic device that is transmitting and receiving data. The second electronic device (101b) may display a third screen (1130) at the request of the second wearable electronic device (201b). For example, the third screen (1130) may display a yes / no icon along with a guidance message such as "Buds 1 is being used by another device. Do you want to disconnect Buds 1?" and receive a user input.

[0156] In various embodiments, the electronic device (101) (or electronic device (201)) may display a screen for prompting information and / or user input related to a multi-point connection. The electronic device (101) (or electronic device (201)) may control a multi-point connection situation by user input.

[0157] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0158] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, or any combination thereof, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0159] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0160] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0161] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0162] While this disclosure has been illustrated and described with reference to various exemplary embodiments, it is to be understood that the various exemplary embodiments are intended to be illustrative, not restrictive. Those skilled in the art will appreciate that various changes in form and detail may be made without departing from the true spirit and scope of the present disclosure, including the appended claims and their equivalents. Furthermore, it is to be understood that any embodiment described herein may be used in conjunction with any other embodiment described herein.

Claims

1. In electronic devices, A communication module comprising a communication circuit that supports simultaneous wireless connection with multiple external electronic devices; memory; and At least one processor comprising a processing circuit; The memory contains instructions, and the at least one processor individually or collectively executes instructions to cause the electronic device to: In response to a request for playback of first audio data for a first external electronic device wirelessly connected to the electronic device, identifying at least one external electronic device wirelessly connected to the electronic device; Determine a first bitrate for transmitting the first audio data based on a remaining bandwidth range excluding a bandwidth used for maintaining a wireless connection with at least one external electronic device identified above, In response to determining that the current bitrate is less than or equal to the first bitrate, encoding the first audio data based on the current bitrate to generate a first audio packet, and An electronic device that transmits the first audio packet to the first external electronic device through the communication module.

2. In paragraph 1, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device that, while transmitting the first audio packet to the first external electronic device, maintains a wireless connection between the electronic device and at least one external electronic device based on a Bluetooth multi-point connection through the communication module.

3. In paragraph 2, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device, wherein at least one external electronic device is connected to the electronic device based on a first protocol.

4. In paragraph 1, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device that transmits a data signal for checking a network connection status to a first external electronic device among at least one external electronic device that is wirelessly connected to the electronic device at a predetermined first cycle through the communication module, and in response to receiving a response signal from the first external electronic device within a predetermined time, maintains a Bluetooth multi-point based wireless connection between the electronic device and the first external electronic device.

5. In paragraph 4, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device that, in response to determining that the current bitrate is greater than the first bitrate, changes the current bitrate to be less than the first bitrate.

6. In paragraph 5, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device that, in response to determining that the difference between the current bitrate and the first bitrate is greater than a first reference, compresses the first audio data to a lower quality than the current quality and then encodes the first audio data with the changed current bitrate.

7. In paragraph 1, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device, in response to determining that the first bitrate is less than a predetermined threshold, to disconnect at least one of the at least one external electronic device that is wirelessly connected to the electronic device.

8. In paragraph 7, Including more displays, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device that displays a screen including at least one of information about at least one external electronic device that is simultaneously connected to the electronic device or a message related to the disconnection operation through the display.

9. In paragraph 1, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device, in response to receiving a request for changing the bitrate of the first audio packet received from the first external electronic device, for changing the current bitrate.

10. In paragraph 1, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device, in response to a distance from a first external electronic device among the at least one external electronic device being outside a communicable range, to disconnect a Bluetooth multi-point based wireless connection with the first external electronic device.

11. In electronic devices, speaker; A communication module comprising a communication circuit that supports simultaneous wireless connection with multiple external electronic devices; memory; and At least one processor comprising a processing circuit: The memory contains instructions, and the at least one processor individually or collectively executes instructions to cause the electronic device to: Receiving a first audio packet from a first external electronic device among at least one external electronic device wirelessly connected to the electronic device through the communication module; In response to determining that the bitrate applied to the first audio packet is greater than the receive buffer control bitrate, the size of the receive buffer is increased, and An electronic device that outputs audio data decoded from the first audio packet through the speaker.

12. In paragraph 11, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device that, while receiving the first audio packet, maintains a wireless connection between the electronic device and at least one external electronic device based on a Bluetooth multi-point connection through the communication module.

13. In paragraph 12, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device, wherein at least one external electronic device is connected to the electronic device based on a first protocol.

14. In paragraph 11, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device that transmits a data signal for checking a network connection status to a first external electronic device among at least one external electronic device that is wirelessly connected to the electronic device at a predetermined first cycle through the communication module, and in response to receiving a response signal from the first external electronic device within a predetermined time, maintains a Bluetooth multi-point based wireless connection between the electronic device and the first external electronic device.

15. In paragraph 11, The at least one processor is individually or collectively executed to cause the electronic device to: An electronic device that determines the receiving buffer control bitrate for storing or processing the received first audio packet based on a portion of the receiving buffer of the electronic device other than a portion used for maintaining a wireless connection with at least one external electronic device that is wirelessly connected to the electronic device.

Images