Electronic device for translating audio and storage medium therefor

Abstract

This electronic device may comprise a communication circuit, one or more processors, and a memory for storing instructions. The instructions, when executed by the one or more processors, may instruct the electronic device to: receive synchronization information related to reception of a BIS service from a source electronic device; transmit the synchronization information to an external electronic device such that the external electronic device receives audio data broadcasted from the source electronic device; receive first audio data for the BIS service broadcasted from the source electronic device; on the basis of identifying that the first audio data is expressed in a first language and that the first language is different from a designated second language, translate the first audio data into second audio data expressed in the second language; and transmit the second audio data to the external electronic device such that the external electronic device outputs the second audio data.

Description

Electronic device for translating audio and its storage medium

[0001] Certain exemplary embodiments of the present disclosure relate to an electronic device for translating audio and / or a storage medium thereof.

[0002] Bluetooth communication technology can provide a short-range wireless communication technology that allows electronic devices to connect to each other for the exchange of data or information. Bluetooth communication technology can include Bluetooth Legacy (or Bluetooth Classic) communication technology or Bluetooth Low Energy (BLE) communication technology, and can have various connection topologies, such as a piconet or scatternet.

[0003] Recently, electronic devices utilizing Bluetooth communication technology have become widely used. For example, a pair of earbuds, each worn on a user's ear, are widely used as ear-wearable devices. Ear-wearable devices can provide various functions. For example, ear-wearable devices can include a microphone to identify the user's voice and transmit data about the user's voice to an electronic device (e.g., a smartphone). Furthermore, ear-wearable devices can include a speaker to output audio data received from an electronic device (e.g., a smartphone) through the speaker.

[0004] The wearable device may include a primary earbud (e.g., a right earbud) and a secondary earbud (e.g., a left earbud) that can be connected to an electronic device (e.g., a smartphone). The primary earbud can transmit audio data to the electronic device through a connection with the electronic device, and the electronic device can transmit audio data (or audio content) to the primary earbud. The primary earbud can receive audio data (or audio content) from the electronic device through wireless communication and output the audio data through a speaker. The secondary earbud can be synchronized with the primary earbud and output audio data received from the electronic device through the speaker.

[0005] Wireless audio output devices, such as wearable devices or Bluetooth speakers, can connect to external electronic devices via Bluetooth communication to perform the above-described operations. To this end, the wireless audio output devices can perform inquiries, inquiry scans, pages, and page scans based on Bluetooth Classic, and / or BLE advertising and BLE scans based on BLE.

[0006] BLE advertising may refer to the action of periodically broadcasting advertising data on an advertising physical channel, and BLE scanning may refer to the action of monitoring the reception of advertising data.

[0007] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0008] Certain exemplary embodiments of the present disclosure may provide an electronic device for translating audio and a storage medium thereof.

[0009] Certain exemplary embodiments of the present disclosure may provide an electronic device and storage medium thereof for receiving and translating broadcast audio.

[0010] Certain exemplary embodiments of the present disclosure may provide an electronic device and a storage medium thereof for transmitting translated audio to a wearable device.

[0011] Certain exemplary embodiments of the present disclosure may provide an electronic device and its storage medium that provide text data and related information related to translated audio.

[0012] Certain exemplary embodiments of the present disclosure may provide an electronic device and a storage medium thereof for rebroadcasting translated audio.

[0013] An electronic device according to an exemplary embodiment may include at least one processor including a communication circuit configured to support Bluetooth communication, a memory storing instructions, and a processing circuit functionally, directly or indirectly, connected to the communication circuit and the memory. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to: receive synchronization information related to reception of a broadcast isochronous stream (BIS) service from a source electronic device through the communication circuit. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to: transmit the synchronization information to an external electronic device through the communication circuit, such that the external electronic device may receive audio data broadcast from the source electronic device by synchronizing with the source electronic device based on the synchronization information. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to: receive, via the communication circuitry, first audio data for the BIS service broadcast from the source electronic device. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to: translate the first audio data into second audio data expressed in the second language based on identifying that the first audio data is expressed in a first language and that the first language is different from a designated second language. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to: transmit the second audio data to the external electronic device via the communication circuitry, such that the external electronic device outputs the second audio data.

[0014] In accordance with an exemplary embodiment, a non-transitory computer-readable storage medium storing one or more programs may include instructions that, when individually and / or collectively executed by at least one processor, cause an electronic device to: receive synchronization information related to reception of a broadcast isochronous stream (BIS) service from a source electronic device; transmit the synchronization information to an external electronic device, such that the external electronic device can receive audio data broadcast from the source electronic device by synchronizing with the source electronic device based on the synchronization information; receive first audio data for the BIS service broadcast from the source electronic device; translate the first audio data into second audio data expressed in the second language based on identifying that the first audio data is expressed in a first language and that the first language is different from a designated second language; and transmit the second audio data to the external electronic device, such that the external electronic device outputs the second audio data.

[0015] The tasks are not limited to those mentioned above, and other technical tasks not mentioned will be clearly understood by those of ordinary skill in the art from the description below.

[0016] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0017] FIG. 2 is a diagram illustrating a connection between electronic devices based on short-range wireless communication according to an exemplary embodiment.

[0018] FIG. 3 is a drawing for explaining the configuration of an electronic device supporting short-range wireless communication according to an exemplary embodiment.

[0019] FIG. 4 is a diagram illustrating the role of a BIS assistant according to an exemplary embodiment.

[0020] FIG. 5 is a diagram for explaining Bluetooth LE (BLE) advertising according to an exemplary embodiment.

[0021] FIG. 6 is a diagram for explaining BIG information including BIG parameters according to an exemplary embodiment.

[0022] FIG. 7 is a diagram illustrating a BIG event and a BIS event according to an exemplary embodiment.

[0023] FIGS. 8, 9 and 10 are diagrams illustrating transmission of BIS data packets according to exemplary embodiments.

[0024] FIG. 11 is a drawing for explaining an example of a connection between Bluetooth devices according to an exemplary embodiment.

[0025] FIG. 12 is a signal flow diagram illustrating an example of a procedure for establishing a CIS link according to an exemplary embodiment.

[0026] Fig. 13 is a diagram showing a system structure for providing a translation service according to an exemplary embodiment.

[0027] Figure 14 is a flowchart illustrating a procedure for providing a translation service according to an exemplary embodiment.

[0028] Figure 15 is a flowchart illustrating a procedure for providing a translation service based on language identification according to an exemplary embodiment.

[0029] Fig. 16 is a diagram illustrating an AI translation algorithm according to an exemplary embodiment.

[0030] Fig. 17 is a diagram illustrating a translation service selection UI according to an exemplary embodiment.

[0031] FIG. 18 is a diagram illustrating an operation of displaying translated text according to an exemplary embodiment.

[0032] FIG. 19 is a diagram illustrating a procedure for broadcasting translated audio according to an exemplary embodiment.

[0033] FIG. 20 is a diagram illustrating broadcasting of translated audio according to an exemplary embodiment.

[0034] FIGS. 21a, 21b, and 21c are diagrams illustrating a UI for selecting a translation service through Bluetooth settings according to an exemplary embodiment.

[0035] FIGS. 22a, 22b, and 22c are diagrams illustrating a UI for selecting a translation service through device settings according to an exemplary embodiment.

[0036] Figure 23 is a flowchart illustrating a procedure for providing a translation service based on caching of translated data according to an exemplary embodiment.

[0037] FIGS. 24a and 24b are diagrams illustrating a UI of a translation service utilizing cached data according to one embodiment of the present disclosure.

[0038] Hereinafter, specific exemplary embodiments will be described in detail with reference to the attached drawings. In describing the exemplary embodiments, detailed descriptions of related known functions or configurations will be omitted if they are deemed to unnecessarily obscure the gist of the present disclosure. Furthermore, the terms described below are terms designated based on the functions of the exemplary embodiments and may vary depending on the intent or custom of the user or operator. Therefore, these terms should be reviewed based on the overall content of the present disclosure.

[0039] It should be noted that the technical terms used in this disclosure are merely used to describe one embodiment and are not intended to limit the scope of the exemplary embodiments. Alternatively, unless specifically defined otherwise in this disclosure, the technical terms used in this disclosure should be interpreted as having a meaning generally understood by those skilled in the art to which the exemplary embodiments pertain, and should not be interpreted in an excessively broad or narrow sense. Alternatively, the technical terms used in this disclosure may be understood and replaced with other technical terms that are understandable to those skilled in the art. General terms used in the embodiments of this disclosure should be interpreted as defined in the dictionary or according to the context, and should not be interpreted in an excessively narrow sense.

[0040] As used herein, singular expressions may include plural expressions unless the context clearly dictates otherwise. In this disclosure, terms such as "consisting of" or "comprising" should not necessarily be construed to include all components or operations described in the specification, and should be construed to mean that some of the components or operations may not be included, or that additional components or operations may be included.

[0041] While terms including ordinal numbers, such as "first" or "second," used herein may be used to describe various components, the components should not be limited by these terms. These terms may only be used to distinguish one component from another. For example, without departing from the scope of the present disclosure, a first component could be referred to as a second component, and similarly, a second component could also be referred to as a first component.

[0042] When a component is referred to as being "connected" or "connected" to another component, it may be directly connected or connected to that other component, but there may also be other components intervening. Conversely, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there are no other intervening components. Thus, for example, the term "connected" as used herein encompasses both direct and indirect connections.

[0043] Hereinafter, exemplary embodiments will be described with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components will be given the same reference numbers and redundant descriptions thereof will be omitted. In describing the embodiments of the present disclosure, if a detailed description of a related known technology is determined to obscure the gist of the present disclosure, the detailed description thereof will be omitted. It should be noted that the attached drawings are only intended to facilitate easy understanding of the exemplary embodiments and should not be construed as limiting the present disclosure by the attached drawings. The present disclosure should be construed to extend to all modifications, equivalents, and substitutes other than the attached drawings.

[0044] In the present disclosure, embodiments will be described using an electronic device as an example, but the electronic device may also be referred to as a terminal, a mobile station, mobile equipment (ME), user equipment (UE), user terminal (UT), subscriber station (SS), wireless device, handheld device, or access terminal (AT). In exemplary embodiments, the electronic device may be a device having communication capabilities, such as a mobile phone, a personal digital assistant (PDA), a smart phone, a wireless MODEM, or a laptop.

[0045] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0046] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0047] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0048] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0049] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0050] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0051] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0052] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0053] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0054] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0055] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0056] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0057] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0058] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0059] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0060] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0061] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0062] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0063] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0064] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0065] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0066] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0067] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0068] FIG. 2 is a diagram illustrating a connection between electronic devices based on short-range wireless communication according to an exemplary embodiment.

[0069] Referring to FIG. 2, an electronic device (200) (e.g., electronic device (101)) can be wirelessly connected to an external electronic device (102) (e.g., an ear-wearable device). The electronic device (200) is illustrated as a smart phone, but is not limited to what is described and / or illustrated, and may be implemented as various types of devices (e.g., a notebook computer including a standard notebook, an ultrabook, a netbook, and a tabbook, a laptop computer, a tablet computer, or a desktop computer). In one embodiment, the electronic device (200) can be implemented as illustrated in FIG. 1, and thus can include at least some of the components (e.g., various modules) illustrated in FIG. 1, and thus, a redundant description thereof will be omitted.

[0070] In one embodiment, the external electronic device (102) is a true wireless stereo (TWS) device, such as a dual-ear wearable device, and may include at least one of a first electronic device (202) (e.g., a right earbud) and a second electronic device (204) (e.g., a left earbud). The electronic devices (202, 204) may be implemented as wireless earbuds, but may also be implemented as various types of devices (e.g., a smart watch, a head-mounted display device, or devices for measuring biosignals (e.g., an electrocardiogram patch)) that support audio services described below without being limited to those described and / or illustrated. According to one embodiment, when the electronic devices (202, 204) are wireless earbuds, the first electronic device (202) and the second electronic device (204) may be a pair of devices (e.g., a right earbud and a left earbud). According to one embodiment, the first electronic device (202) and the second electronic device (204) may be implemented to include identical or similar configurations.

[0071] In one embodiment, the first electronic device (202) and the second electronic device (204) are illustrated as a pair of earbuds, but the first electronic device (202) and the second electronic device (204) may include not only earbuds but also devices that can operate as a pair or electronic devices that can operate as a combination (e.g., a multi-channel speaker device). According to one embodiment, the first electronic device (202) and the second electronic device (204) may be implemented to include identical or similar components.

[0072] According to one embodiment, the electronic device (200) may establish at least one of a first communication link and a second communication link with at least one of a first electronic device (202) and a second electronic device (204), and may transmit and / or receive data (e.g., audio and / or control information) to and from each other via at least one of the first communication link and the second communication link. In one embodiment, the first communication link and / or the second communication link may include a Bluetooth-based asynchronous connection-less (ACL) link.

[0073] In one embodiment, the electronic device (200) may establish at least one communication link (e.g., the first communication link or the second communication link) with at least one of the first electronic device (202) and the second electronic device (204) based on a short-range wireless communication technology such as at least one of Wi-Fi, Wi-Fi direct, Bluetooth (e.g., Bluetooth classic or Bluetooth low energy (BLE)), or ultra wideband (UWB), but the manner in which the electronic device (200) establishes the communication link with the first electronic device (202) and the second electronic device (204) is not limited to at least one of Wi-Fi, Bluetooth, or UWB.

[0074] In one embodiment, each of the electronic devices (202, 204) may establish a communication connection with the electronic device (200) using D2D (device to device) communication such as Wi-Fi direct or Bluetooth (e.g., using a communication circuit (e.g., communication circuit (320)) that supports the corresponding communication method), but is not limited thereto and may communicate with each other using various types of communication (e.g., at least one of Wi-Fi communication using an access point (AP), cellular communication using a base station, or wired communication).

[0075] In one embodiment, the electronic device (200) may establish a communication link with only one of the first electronic device (202) or the second electronic device (204), or may establish separate communication links (e.g., a first communication link and a second communication link) with each of the first electronic device (202) and the second electronic device (204).

[0076] In one embodiment, the electronic device (200) may operate in a central role, and an external electronic device (102) (e.g., at least one of the first electronic device (202) or the second electronic device (204)) may operate in a peripheral role. For audio services, the electronic device (200) operating as a central device may be a source electronic device, and the external electronic device (102) operating as a peripheral device (e.g., the first electronic device (202) or the second electronic device (204)) may be a sink electronic device.

[0077] In one embodiment, the first electronic device (202) and the second electronic device (204) may establish a communication link (e.g., a bridge communication link) between each other based on at least one of, for example, Wi-Fi, Bluetooth, or UWB, although the manner in which the first electronic device (202) and the second electronic device (204) establish the communication link is not limited to at least one of Wi-Fi, Bluetooth, or UWB.

[0078] In one embodiment, one of the first electronic device (202) and the second electronic device (204) can operate as a primary device, and the other can operate as a secondary device. The electronic device operating as a primary (e.g., the first electronic device (202)) can transmit data (e.g., a reception acknowledgement signal or relay data) to the electronic device operating as a secondary (e.g., the second electronic device (204)). For example, when the first electronic device (202) and the second electronic device (204) establish a communication link with each other, one of the first electronic device (202) and the second electronic device (204) can be selected as a primary, and the other can be selected as a secondary.

[0079] In one embodiment, when a first electronic device (202) and a second electronic device (204) establish a communication connection with each other, a device that detects human body wearing (e.g., a value indicating wearing is detected using a sensor for detecting wearing (e.g., a proximity sensor, a touch sensor, a 6-axis tilt sensor, or a 9-axis sensor)) may be selected as a primary device, and the remaining devices may be selected as secondary devices.

[0080] In one embodiment, a primary device (e.g., a first electronic device (202)) can transmit data received from an external electronic device (e.g., an electronic device (200)) to a secondary device (e.g., a second electronic device (204)). For example, the first electronic device (202), which is a primary device, can output audio to a speaker (354) based on audio data received from the electronic device (200), and can also transmit the audio data or control data (e.g., connection information) related to the audio data to the second electronic device (204), which is a secondary device. In one embodiment, the second electronic device (204), which is a secondary device, can receive audio data transmitted from the electronic device (200) to the primary device (e.g., the first electronic device (202)) based on connection information provided from the primary device (e.g., the first electronic device (202)).

[0081] In one embodiment, the electronic device (200), the first electronic device (202), and / or the second electronic device (204) may communicate directly or indirectly with an external electronic device (250). In one embodiment, the external electronic device (250) may be an ear buds case device or a cradle device that stores and charges the first electronic device (202) and the second electronic device (204). In one embodiment, the external electronic device (250) may include at least one input means (e.g., a touch panel) and / or at least one output means (e.g., a light emitting diode (LED) and / or a display) that may be used to control an operation (e.g., a pairing operation) of the external electronic device (250), or the TWS electronic devices (202, 204).

[0082] According to one embodiment, the external electronic device (250) can establish a connection (e.g., a communication link) with at least one of the electronic device (200), the first electronic device (202), or the second electronic device (204), and transmit and / or receive data therebetween. For example, the external electronic device (250) can communicate with at least one of the electronic device (200), the first electronic device (202), or the second electronic device (204) based on at least one of a power-line communication (PLC) wireless connection, Wi-Fi, Bluetooth (e.g., Bluetooth classic or Bluetooth low energy (BLE)), or UWB, but the manner in which the external electronic device (250) communicates with the electronic device (200), the first electronic device (202), or the second electronic device (204) is not limited to at least one of a PLC wireless connection, Wi-Fi, Bluetooth, or UWB.

[0083] In one embodiment, the first electronic device (202) and / or the second electronic device (204) may multicast or broadcast an advertising signal to allow a nearby electronic device (e.g., the electronic device (200)) to discover the first electronic device (202) and / or the second electronic device (204). The advertising signal may include a signal for connecting to an unspecified nearby electronic device (e.g., the electronic device (200)) or transmitting account-related information using a wireless communication technology (e.g., BLE). For example, the first electronic device (202) and / or the second electronic device (204) may be stored in a case (e.g., the external electronic device (250)) and configured to generate the advertising signal when the case is detected to be opened while the first electronic device (202) and / or the second electronic device (204) are stored in the case.

[0084] In one embodiment, the advertising signal may include at least one of device identification information, user account information, information regarding whether the first electronic device (202) and / or the second electronic device (204) is currently paired with another device (not shown) (e.g., current pairing information), a list of previously paired devices (e.g., pairing list), information regarding devices that can be paired simultaneously (e.g., simultaneous pairing information), transmission power information, information regarding a detection area or remaining battery level (e.g., battery status information), or audio channel role (e.g., left or right) information.

[0085] The first electronic device (202) and / or the second electronic device (204) may generate an advertising signal based on a specified condition. In one embodiment, the first electronic device (202) and / or the second electronic device (204) may begin transmitting the advertising signal based on at least one of power supply, a specified time period, a user input, or a case opening.

[0086] When the electronic device (200) discovers the first electronic device (202) and / or the second electronic device (204) based on an advertising signal from the first electronic device (202) and / or the second electronic device (204), the electronic device (200) may output (e.g., display) a user interface for connection with the first electronic device (202) and / or the second electronic device (204). The electronic device (200) may output the user interface based on discovery of the first electronic device (202) and / or the second electronic device (204). For example, the user interface may include a device image corresponding to the discovered external electronic device (e.g., the first electronic device (202) and / or the second electronic device (204)). The electronic device (200) may establish a connection (e.g., a communication link) with the first electronic device (202) and / or the second electronic device (204) based on a user input through the user interface.

[0087] FIG. 3 is a drawing for explaining the configuration of an electronic device supporting short-range wireless communication according to an exemplary embodiment.

[0088] Referring to FIG. 3, the first electronic device (202) may include components identical to or similar to at least one of the components (e.g., modules) of the electronic device (101) illustrated in FIG. 1. The first electronic device (202) includes a processor (310) (e.g., the processor (120) of FIG. 1), a communication circuit (320) (e.g., the communication module (190) of FIG. 1), an input device (330) (e.g., the input module (150) of FIG. 1), a sensor (340) (e.g., the sensor module (176) of FIG. 1), an audio processing module (350) (e.g., the audio module (170) of FIG. 1), a microphone (352) (e.g., the input module (150) of FIG. 1), a speaker (354) (e.g., the sound output module (155) of FIG. 1), a power management module (360) (e.g., the power management module (188) of FIG. 1), a battery (370) (e.g., the battery (189) of FIG. 1), an interface (380) (e.g., the interface (177) of FIG. 1), or a memory (390) (e.g., the It may include at least one of the memory (130)).

[0089] The communication circuit (320) may include at least one of a wireless communication module (e.g., a Bluetooth communication module, a cellular communication module, a wireless-fidelity (Wi-Fi) communication module, a near field communication (NFC) communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (e.g., a local area network (LAN) communication module, or a power line communication (PLC) communication module). The Bluetooth communication module may support at least one communication connection (e.g., a communication link) by, for example, Bluetooth legacy communication (e.g., Bluetooth Classic) and / or Bluetooth Low Energy (BLE) communication.

[0090] The communication circuit (320) can communicate directly or indirectly with at least one of an electronic device (200) (e.g., a smart phone), an external electronic device (250) (e.g., a charging device such as a cradle), or a second electronic device (204) (e.g., a secondary earbud) through a first network (e.g., the first network (198) of FIG. 1) using at least one communication module included therein. The second electronic device (204) can be configured as a pair with the first electronic device (202). The communication circuit (320) can include a transmitting circuit and a receiving circuit configured to support communication with the electronic device (200) and / or the external electronic device (250). The communication circuit (320) can operate independently of the processor (310) and can include one or more communication processors that support wired or wireless communication.

[0091] The communication circuit (320) may be directly or indirectly connected to one or more antennas capable of transmitting or receiving signals or information to or from another electronic device (e.g., the electronic device (200), the second electronic device (204), or the external electronic device (250)). In one embodiment, at least one antenna suitable for a communication method used in a communication network, such as a first network (e.g., the first network (198) of FIG. 1) or a second network (e.g., the second network (199) of FIG. 2), may be selected from the plurality of antennas, for example, by the communication circuit (320). The signal or information may be transmitted or received between the communication circuit (320) and the other electronic device via the selected at least one antenna.

[0092] The input device (330) may be configured to generate various input signals that may be used in the operation of the first electronic device (202). The input device (330) may include at least one of a touch pad, a touch panel, or a button.

[0093] The input device (330) can generate a user input regarding turning the first electronic device (202) on or off. In one embodiment, the input device (330) can receive a user input for a communication connection between the first electronic device (202) and the second electronic device (204). In one embodiment, the input device (330) can receive a user input associated with audio data (or audio content). For example, the user input can be associated with a function of starting playback, pausing playback, stopping playback, adjusting playback speed, adjusting playback volume, or muting audio data.

[0094] The sensor (340) can measure or confirm the position or operating status of the first electronic device (202). The sensor (340) can convert the measured or confirmed information into an electrical signal and provide it to the processor (310). The sensor (340) can include, for example, at least one of a magnetic sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, a proximity sensor, a gesture sensor, a grip sensor, a biometric sensor, or an optical sensor.

[0095] The processor (310) can detect data (e.g., audio data) from data packets (e.g., data PDUs (protocol data units)) received from the electronic device (200), process the detected data through the audio processing module (350), and output the data to the speaker (354). The audio processing module (350) can support an audio data collection function and play the collected audio data.

[0096] The audio processing module (350) may include an audio decoder (not shown) and a D / A (digital to analog) converter (not shown). The audio decoder may convert audio data stored in the memory (390) or received from the electronic device (200) through the communication circuit (320) into a digital audio signal. The D / A converter may convert the digital audio signal converted by the audio decoder into an analog audio signal. The audio decoder may convert audio data received from the electronic device (200) through the communication circuit (320) and stored in the memory (390) into a digital audio signal. The speaker (354) may output the analog audio signal converted by the D / A converter.

[0097] The audio processing module (350) may include an analog to digital (A / D) converter (not shown). The A / D converter may convert an analog voice signal transmitted through a microphone (352) (hereinafter referred to as a microphone) into a digital voice signal. The microphone (352) may include at least one air conduction microphone and / or at least one bone conduction microphone for detecting voice and / or sound.

[0098] The audio processing module (350) can reproduce various audio data set in the operating operation of the first electronic device (202). For example, the processor (310) can be designed to detect, through a sensor (340), that the first electronic device (202) is connected to or separated from the user's ear, and reproduce audio data related to sound effects or guidance sounds through the audio processing module (350). The output of sound effects or guidance sounds can be omitted depending on user settings or the designer's intention.

[0099] The memory (390) may store various data used by at least one component (e.g., the processor (310) or the sensor (340)) of the first electronic device (202). The data may include, for example, software, instructions executable by the processor (310), and input data or output data related thereto. In one embodiment, the memory (390) may include volatile memory and / or non-volatile memory.

[0100] The power management module (360) can manage power supplied to the first electronic device (202). According to one embodiment, the power management module (360) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC). According to one embodiment, the power management module (360) can include a battery charging module. According to one embodiment, when another electronic device (e.g., an external electronic device (250)) is electrically connected (wirelessly or by wire) to the first electronic device (202), the power management module (360) can receive power from the other electronic device and charge the battery (370).

[0101] The battery (370) can power at least one component of the first electronic device (202). The battery (370) can include, for example, a rechargeable battery. In one embodiment, when the first electronic device (202) is mounted within a cradle device (e.g., an external electronic device (250)), the first electronic device (202) can charge the battery (370) to a specified charge level and then turn on the power of the first electronic device (202) or turn on at least a portion of the communication circuit (320).

[0102] The interface (380) may support one or more designated protocols that may be used to directly (e.g., wired) connect the first electronic device (202) to the electronic device (200), the second electronic device (204), the external electronic device (250), or another external electronic device. The interface (380) may include, for example, at least one of a high definition multimedia interface (HDMI), a USB interface, an SD card interface, a power line communication (PLC) interface, or an audio interface. In one embodiment, the interface (380) may include at least one connection port for establishing a physical connection with a cradle device (e.g., the external electronic device (250)).

[0103] The processor (310) may execute instructions and / or software to control at least one other component (e.g., a hardware or software component) of the first electronic device (202) directly or indirectly connected to the processor (310), and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (310) may load instructions or data received from another component (e.g., a sensor (340) or a communication circuit (320)) into a memory (390) (e.g., a volatile memory), process the instructions or data stored in the memory (390) (e.g., a volatile memory), and store resultant data in the memory (390) (e.g., a non-volatile memory).

[0104] The processor (310) can receive data (e.g., broadcast audio data) from the electronic device (200) and / or an external electronic device (not shown) (e.g., the source electronic device (400) of FIG. 4) via the communication circuit (320). The processor (310) can output data received from the electronic device (200) via the communication circuit (320) to the speaker (354) via the audio processing module (350). The processor (310) can transmit data received from the electronic device (200) via the communication circuit (320) to the second electronic device (204) via the communication circuit (320). The processor (310) can perform operations of the first electronic device (202) according to exemplary embodiments. The processor (310) can include a physical layer, a link layer, a host, and an application layer for performing Bluetooth communication.

[0105] The memory (390) may store instructions that, when executed by the processor (310), cause the first electronic device (202) to operate according to exemplary embodiments. The memory (390) may store control information and / or data necessary for the operation of the first electronic device (202) under the control of the processor (310).

[0106] According to exemplary embodiments, the first electronic device (202) may further include various circuits and / or modules depending on its provision form. While variations are numerous and cannot be fully enumerated in accordance with the convergence trend of digital devices, components equivalent to the aforementioned components may be additionally included in the first electronic device (202). Furthermore, the first electronic device (202) according to various embodiments may, of course, exclude certain components from the aforementioned components or be replaced with other components depending on its provision form. This will be readily understood by those skilled in the art.

[0107] According to one embodiment, a second electronic device (204) configured as a pair with a first electronic device (202) may include components identical to or similar to those included in the first electronic device (202) and may perform all or part of the operations of the first electronic device (202) described in the drawings described below.

[0108] A BLE communication link may include at least one of a plurality of LE physical channels, each of which may be optimized for different purposes, such as an LE piconet physical channel, an LE advertising physical channel, an advertising periodic physical channel, or an LE isochronous physical channel. The LE piconet physical channel is used for communication between connected devices and may be associated with a specific piconet. The LE advertising physical channel may be used to broadcast advertisements to Bluetooth devices. The advertisements may be used to discover, connect, or send user data to a counterpart electronic device. The advertising periodic physical channel may be used to transmit user data to a counterpart electronic device at a specific interval via periodic advertisements. The LE isochronous physical channel may be used to transfer isochronous data between Bluetooth devices within an LE piconet, or to transfer isochronous data between unconnected Bluetooth devices.

[0109] An electronic device (e.g., electronic device (200), first electronic device (202), or second electronic device (204)) with Bluetooth core version 5.2 or higher can support audio services through a connected isochronous stream (CIS) method and / or a broadcast isochronous stream (BIS) based on Bluetooth communication technology.

[0110] CIS can refer to a logical transport that enables Bluetooth devices (e.g., electronic device (200), first electronic device (202), or second electronic device (204)) to transmit isochronous data in any direction. CIS can carry fixed or variable size data (e.g., CIS data packets), and each CIS link can be associated with an asynchronous connection-less (ACL) link. A CIS link can support transmission of variable size packets and one or more packets in each isochronous event, and can support various data rates. Data traffic over a CIS link can be unidirectional or bidirectional, and an acknowledgement protocol can be used to improve the reliability of data transmission over a CIS link.

[0111] A BIS may refer to a logical transmission used to transmit one or more isochronous data streams to all devices for a BIS within a specified range (e.g., an electronic device (200), a first electronic device (202), or a second electronic device (204)). A BIS may include one or more subevents for transmitting isochronous data packets (e.g., BIS data packets). A BIS may support transmitting multiple new isochronous data packets in all BIS events. A BIS does not include an acknowledgment protocol and may be transmitted unidirectionally from a broadcasting device (e.g., a source electronic device (400) of FIG. 4).

[0112] To improve the reliability of BIS logical transmission, isochronous data packets can be unconditionally retransmitted by increasing the number of sub-events within each event. In addition, transmission reliability can be improved by transmitting the isochronous data packets at an interval earlier than the interval associated with the isochronous data packets. This is called pre-transmission. The BIS can be identified by a unique access address and timing information. The access address and timing information can be provided via advertising data (e.g., the AUX_SYNC_IND packet (506) of FIG. 5) transmitted using a corresponding periodic advertising broadcast logical transmission.

[0113] A scanning device (e.g., a sink device) that supports a synchronized receiver role (e.g., a sink role) can receive isochronous data (e.g., isochronous data packets) from the BIS after synchronizing to the BIS using the timing information obtained from the periodic advertising data (e.g., AUX_SYNC_IND packet (506)). In one embodiment, at least one of the electronic device (200), the first electronic device (202), or the second electronic device (204) can operate as a sink role with respect to a source electronic device (e.g., the source electronic device (400) of FIG. 4).

[0114] Each BIS may be part of a broadcast isochronous group (BIG). A BIG may include one or more BISs having the same isochronous interval (e.g., ISO_Interval (710) of FIG. 7). BISs within a BIG have a common timing reference based on a source electronic device (e.g., source electronic device (400) of FIG. 4) and may be temporally synchronized with each other. The maximum number of BISs within a BIG may have a specified value (e.g., 31). A BIG may also include control sub-events.

[0115] FIG. 4 is a diagram illustrating the role of a BIS assistant according to an exemplary embodiment.

[0116] Referring to FIG. 4, the electronic device (200) may connect a communication link (e.g., a first communication link and / or a second communication link) with an external electronic device (e.g., a first electronic device (202) and / or a second electronic device (204)) that acts as a BIS sink for a source electronic device (400) that provides a BIS service. In one embodiment, the electronic device (200) may use a wireless communication technology (e.g., BLE, Wi-Fi, and / or UWB) to discover the presence of the first electronic device (202) and / or the second electronic device (204), and connect a communication link with the first electronic device (202) and / or the second electronic device (204).

[0117] In one embodiment, the source electronic device (400) may generate a BIG including one or more BISs and broadcast advertising data (402) (e.g., at least one advertising packet) associated with the BIG. For BIS synchronization, at least one of the electronic device (200), the first electronic device (202), or the second electronic device (204) may initiate a BLE scan. In one embodiment, the BLE scan may include monitoring for the reception of at least one BLE-based advertising packet.

[0118] In one embodiment, advertising data (402) broadcast by the source electronic device (400) may include extended advertising (EA) data and / or periodic advertising (PA) data. In one embodiment, the EA data may include an ADV_EXT_IND packet (e.g., ADV_EXT_IND (502) of FIG. 5) and / or an AUX_ADV_IND packet (e.g., AUX_ADV_IND (504) of FIG. 5). In one embodiment, the AUX_ADV_IND packet (504) may include audio control information (e.g., BIG parameters) necessary to receive PA data. The PA data may include an AUX_SYNC_IND packet (e.g., AUX_SYNC_IND (506) of FIG. 5) and / or at least one AUX_CHAIN_IND packet (e.g., AUX_CHAIN_IND (508) of FIG. 5). In one embodiment, the AUX_SYNC_IND packet may include BIG parameters (e.g., BIG information (600) of FIG. 6) within, for example, an ACAD (additional controller advertising data) field. The BIG parameters may be used by a sink device (e.g., the first electronic device (202) or the second electronic device (204)) to synchronize to a BIG (e.g., at least one BIS) provided by a source electronic device (400) and receive BIS audio data (406).

[0119] In one embodiment, the electronic device (200) may act as a BIS assistant role for the first electronic device (202) or the second electronic device (204) and may transmit audio control information (e.g., BIG parameters), which is at least a portion of the advertising data (402) received from the source electronic device (400), to the first electronic device (202) or the second electronic device (204), respectively, via the first communication link or the second communication link.

[0120] In one embodiment, the electronic device (200) may receive advertising data (402) (e.g., EA data and / or PA data necessary to receive BIG parameters) from a source electronic device (400) via a BLE scan (e.g., a BIS scan). In one embodiment, the electronic device (202) may display a search result user interface (UI) indicating that BIS synchronization is possible for the source electronic device (400) based on receiving the EA data, and may receive a user input requesting to start receiving the BIS service via the search result UI. The electronic device (202) may transmit BIG synchronization information (404) including at least some parameters necessary for BIG synchronization among the audio control information (e.g., BIG parameters) obtained from the EA data based on the user input, to the first electronic device (202) and / or the second electronic device (204) via the first communication link and / or the second communication link. In one embodiment, the electronic device (200) may perform a PA scan based on EA data received from a source electronic device (400) to receive PA data and display broadcast service information obtained from the PA data.

[0121] In one embodiment, the first electronic device (202) or the second electronic device (204) may receive BIS audio data (406) broadcast from the source electronic device (400) based on BIG synchronization information (404) received from the electronic device (200) acting as a BIS assistant, instead of performing a BLE scan (e.g., a BIS scan). In one embodiment, the first electronic device (202) or the second electronic device (204) may directly receive advertising data (402) from the source electronic device (400) via a BLE scan and obtain information for synchronization of the BIS service (e.g., BIG synchronization information (404)) from the advertising data (402). In one embodiment, the first electronic device (202) or the second electronic device (204) can receive PA data from the source electronic device (400) based on the BIG synchronization information (404) and obtain BIG parameters (e.g., BIG information (600)) from the PA data.

[0122] In one embodiment, the first electronic device (202) or the second electronic device (204) may synchronize to a BIG (e.g., at least one BIS) of a source electronic device (400) based on the BIG parameters. In one embodiment, the BIG synchronization operation performed by the sink device may include calculating an access address and timing information at which BIS audio data (406) is transmitted using the BIG parameters. In one embodiment, the timing information may indicate channel information (e.g., a channel map) associated with the BIG and transmission points of audio data.

[0123] In one embodiment, the first electronic device (202) or the second electronic device (204) can receive BIS audio data (406) (e.g., BIS data packets) broadcast by the source electronic device (400) via the at least one synchronized BIS. The first electronic device (202) or the second electronic device (204) can continue to receive BIS audio data (406) broadcast by the source electronic device (400) while being synchronized to the at least one BIS.

[0124] FIG. 5 is a diagram for explaining Bluetooth LE (BLE) advertising according to an exemplary embodiment.

[0125] Referring to FIG. 5, a periodic advertising train (500) can be used for transmission of extended advertising (EA) data, such as an ADV_EXT_IND packet (502) and / or an AUX_ADV_IND packet (504), and periodic advertising (PA) data, such as an AUX_SYNC_IND packet (506) and / or at least one AUX_CHAIN_IND packet (508).

[0126] The ADV_EXT_IND packet (502) is transmitted over common channels (e.g., advertising channel index Adv_idx=37, 38, and 39) and may include information (e.g., AuxPtr field) indicating a transmission point and channel map of the AUX_ADV_IND packet (504). The AUX_ADV_IND packet (504) is transmitted according to a specific channel map identified by the ADV_EXT_IND packet (502) (e.g., secondary advertising channel index SAdv_idx=x) and may include information (e.g., BIG synchronization information (404)) indicating a location of the AUX_SYNC_IND packet (506). In one embodiment, the AUX_ADV_IND packet (504) may include at least one of an access address, a channel map, an advertising interval (e.g., a periodic advertising interval (510)), clock accuracy, or a time offset from the AUX_ADV_IND packet (504) to the AUX_SYNC_IND packet (506) associated with the AUX_SYNC_IND packet (506).

[0127] In one embodiment, based on the BIG synchronization information (404) included in the AUX_ADV_IND packet (504), the electronic device (e.g., the electronic device (202), the first electronic device (202), or the second electronic device (204)) may receive an AUX_SYNC_IND packet (506). The AUX_SYNC_IND packet (506) may begin to be transmitted over the channels indicated by SAdv_idx (e.g., SAdv_idx=y, y+1, y+2) at the beginning of each periodic advertising interval (510). During the periodic advertising interval (510), the AUX_SYNC_IND packet (506) and at least one AUX_CHAIN_IND packet (508) may be transmitted.

[0128] In one embodiment, the AUX_SYNC_IND packet (506) may include BIG parameter information (e.g., BIG information (600) of FIG. 6) related to a broadcast audio service (e.g., a BIS service). In one embodiment, the AUX_SYNC_IND packet (506) may include, in an AdvData field, broadcast service information (e.g., broadcast service name, codec information, audio information, and / or appearance information) of a currently streaming BIS. A sink device (e.g., electronic device (200), first electronic device (202), or second electronic device (204)) that obtains the AUX_SYNC_IND packet (506) may display at least a portion of the broadcast service information.

[0129] In one embodiment, a sink device (e.g., electronic device (200), first electronic device (202), or second electronic device (204)) can obtain BIG_Offset from BIG parameter information (e.g., BIG information (600) of FIG. 6) included in an AUX_SYNC_IND packet (506). BIG_Offset can indicate the time from the start of the AUX_SYNC_IND packet (506) including the BIG information (600) to the next BIG anchor point. The sink device (e.g., electronic device (200), first electronic device (202), or second electronic device (204)) can receive BIS audio data (e.g., BIS data packets) via a BIG event (e.g., BIG event x (705) of FIG. 7) starting from the BIG anchor point.

[0130] FIG. 6 is a diagram for explaining BIG information including BIG parameters according to an exemplary embodiment.

[0131] Referring to FIG. 6, BIG information (600) may include BIG parameters such as at least one of BIG_Offset, BIG_Offset_units, ISO_Interval, Num_BIS, NSE (number of subevent), BN (burst number), Sub_Interval, PTO (pre-transmission offset), BIS_Spacing, IRC (immediate repetition count), Max_PDU, RFU (reserved for future use), SeedAccessAddress, SDU_Interval, Max_SDU, BaseCRCInit, ChM (channel map), PHY (physical), bisPayloadCount, Framing, GIV (group initialization vector), or GSKD (group session key derivation). In one embodiment, the length of BIG information (600) may be 33 octets when not encrypted and 57 octets when encrypted.

[0132] The BIG parameters that can be included in BIG information (600) are described below.

[0133] Num_BIS represents the number of BISs within a BIG. Each BIS within a BIG can be assigned a different BIS_Number, from 1 to Num_BIS.

[0134] ISO_Interval can represent the time in 1.25ms units between two adjacent BIG anchor points (e.g., 5ms to 4s).

[0135] BIS_Spacing can represent the time between the start time of sub-events in adjacent BISs within a BIG and the start time of the first sub-event in the last BIS.

[0136] Sub_Interval can represent the time between the start times of two consecutive sub-events of each BIS.

[0137] Max_PDU is the maximum number of data octets that can be transmitted in each BIS data packet within the BIG, which can indicate the maximum duration of the packet (e.g., 1 to 251 octets).

[0138] Max_SDU can indicate the maximum size (e.g., maximum duration) of an SDU (service data unit) within a BIG (e.g., 1 to 4095 octets).

[0139] BN, PTO, and IRC can contain values ​​to control which data is transmitted in each BIG event. The sub-events of each BIS event can be divided into groups (e.g., sub-event groups) containing BN sub-events. Therefore, the group count (GC) is NSE / BN. IRC can specify the number of groups carrying data related to the current BIS event. The remaining groups can carry data related to future BIS events specified by PTO.

[0140] IRC may be greater than 0 and not greater than GC. If IRC = GC, PTO may be ignored, otherwise PTO may be greater than 0. Groups of sub-events may be numbered sequentially from 0 to GC - 1 (e.g., group index g). If g < IRC, group g may contain data related to the current BIS event. If g >= IRC, group g may contain data related to a future BIS event after the current BIS event (e.g., PTO × (g - IRC + 1)th BIS event).

[0141] NSE represents the maximum number of sub-events within each BIG event.

[0142] The Framing field can indicate whether the BIG is carrying framed data or unframed data.

[0143] BIG_Offset may indicate the time from the start of a packet containing BIG information (600) (e.g., AUX_SYNC_IND of operation 516) to the next BIG anchor point. The value of BIG_Offset may be indicated by the unit indicated by the bits of BIG_Offset_Units. The time offset is determined by multiplying the value of BIG_Offset by the unit indicated by BIG_Offset_Units. The time offset may be greater than 600 μs (microseconds). If the bit of BIG_Offset_Units is set, the unit is 300 μs, otherwise it is 30 μs. The bit of BIG_Offset_Units may not be set if the time offset is less than 491,460 μs. The BIG anchor point may be between the time offset and the time offset plus 1 unit after the start time of the packet (e.g., AUX_SYNC_IND).

[0144] The above parameters included in the BIG information (600) may not be changed during the lifetime of the BIG.

[0145] The source electronic device (400) can transmit (e.g., broadcast) BIS audio data (e.g., BIS data packets) according to the above parameters included in the BIG information (600).

[0146] FIG. 7 is a diagram illustrating a BIG event and a BIS event according to an exemplary embodiment.

[0147] Referring to FIG. 7, a BIG event (e.g., BIG event x(705)) may be composed of one or more BIS data packets (e.g., PDUs). A source electronic device (e.g., source electronic device (400)) may transmit BIS data packets (e.g., right audio data packets and left audio data packets) in each BIG event (e.g., BIG event x(705)). Each BIG event (e.g., BIG event x(705)) may be split into Num_BIS BIS events and, if present, one control sub-event. Each BIS event may be split into NSE sub-events.

[0148] Each BIS event may start at a BIS anchor point (e.g., BIS anchor point (700)) and end after the last sub-event. Each BIG event (e.g., BIG event x (705)) may start at the BIG anchor point and end after the controlling sub-event, if any, or end at the last constituent BIS event, if no. The BIG anchor points may be regularly spaced apart by an ISO_Interval (710). The BIS anchor points for BIS n of a BIG may be after (n - 1) Х BIS_Spacing from the BIG anchor points and may be regularly spaced apart by an ISO_Interval (710). The sub-events of each BIS may be spaced apart by a Sub_Interval. A source electronic device (e.g., source electronic device (400)) can terminate a current BIG event (e.g., BIG event x (705)) at least by T_IFS (time for inter frame space) (e.g., 150 μs) before a BIG anchor point of a next BIG event. The time interval between two consecutive packets on the same channel may be referred to as T_IFS. T_IFS may be the time from the end point of the last bit of a previous packet to the start point of the first bit of a subsequent packet.

[0149] BISs within a BIG can be arranged sequentially or interleaved, depending on Sub_Interval and BIS_Spacing. In the case of sequential arrangement, BIS_Spacing is greater than or equal to NSE Х Sub_Interval, and all sub-events of a BIS event can occur together. In the case of interleaved arrangement, Sub_Interval is Num_BIS Х BIS_Spacing, the first sub-events of all BISs are adjacent, and the second sub-events of all subsequent BISs can be adjacent.

[0150] The maximum possible length of the data portion of a BIG event (excluding control subevents) may be indicated by BIG_Sync_Delay. The value of BIG_Sync_Delay may be equal to the time from the BIS anchor point to the BIG synchronization point, which is the end of the packet containing the payload of Max_PDU octets transmitted in the last subevent. (BIG_Sync_Delay = (Num_BIS - 1) x BIS_Spacing + (NSE - 1) x Sub_Interval + MPT)

[0151] A BIS sub-event is an opportunity for a source electronic device (400) to transmit BIS data packets and for a sink electronic device (e.g., electronic device (200), first electronic device (202), or second electronic device (204)) acting as a sink to receive the BIS data packets. The source electronic device (400) may transmit one BIS data packet at the start of each BIS sub-event of a BIS event, and may transmit at least one BIS packet within, for example, six consecutive BIS events.

[0152] For each BIS event, the source electronic device (400) may provide a data burst consisting of BN payloads. Each payload may include a single fragment or one or more SDU segments. A data burst is associated with a given BIS event, but may be transmitted in earlier events.

[0153] FIGS. 8, 9 and 10 are diagrams illustrating transmission of BIS data packets according to exemplary embodiments.

[0154] Referring to FIG. 8, within a BIS having BN=2, IRC=2, PTO=0, and NSE=4, payloads can be assigned to BIS sub-events within each BIS event. One BIS event corresponding to ISO_Interval(810) can include at most NSE(=4) BIS sub-events. Within each BIS event (e.g., BIS event x or BIS event x+1), BIS data packets (e.g., P0, P1 or P2, P3) each including two payloads can be assigned to two preceding BIS sub-events, and the remaining sub-events can be used for retransmission of the same BIS data packets (e.g., P0, P1 or P2, P3).

[0155] Referring to FIG. 9, within a BIS having BN=1, IRC=3, PTO=2, and NSE=5, payloads may be assigned to BIS sub-events within each BIS event. One BIS event (e.g., BIS event x) corresponding to an ISO_Interval (910) may include at most NSE(=5) BIS sub-events. Within a BIS event x, a BIS data packet p0 may be transmitted in three preceding BIS sub-events, a BIS data packet p2 for BIS event x+2 may be transmitted in the fourth BIS sub-event, and a BIS data packet p4 for BIS event x+4 may be transmitted in the last BIS sub-event. Accordingly, a BIS data packet p2 may be repeatedly transmitted in BIS event x and BIS event x+2, and a BIS data packet p4 may be repeatedly transmitted in BIS event x and BIS event x+4.

[0156] Referring to Fig. 10, within a BIS having BN=2, IRC=2, PTO=4, and NSE=6, payloads can be assigned to BIS sub-events within each BIS event. One BIS event (e.g., BIS event x) corresponding to ISO_Interval(1010) can include at most NSE(=6) BIS sub-events. Within BIS event x, BIS data packets p0, p1 can be transmitted in the four preceding BIS sub-events, and BIS data packets p8, p9 for BIS event x+4 can be transmitted in the last two BIS sub-events. Accordingly, BIS data packets p8, p9 can be repeatedly transmitted in BIS event x and BIS event x+4.

[0157] Among various Bluetooth topologies, a first electronic device (202) and a second electronic device (204) included in an ear wearable device such as a TWS (e.g., an electronic device (102)) can receive audio data of different channels (e.g., a left channel and a right channel) of the same audio service. For example, the second electronic device (204) can receive, from the first electronic device (202), at least a portion of the audio data that the first electronic device (202) receives from an external electronic device (e.g., an electronic device (200) of FIG. 2). For example, in a BLE audio topology, the first electronic device (202) and the second electronic device (204) can use an audio service from an external electronic device (e.g., an electronic device (200) or a source electronic device (400)).

[0158] In one embodiment, the first electronic device (202) and the second electronic device (204) may communicate with each other for various purposes such as exchanging status and / or changing operating parameters between each other, and such communication may be referred to as bridge communication. For example, in an ear wearable device such as a TWS, each of the first electronic device (202) corresponding to the left channel and the second electronic device (204) corresponding to the right channel may obtain information about the status of the other electronic device (e.g., communication degradation status, whether the device is worn, whether the device is stored in a case, and / or battery status) through bridge communication (e.g., TWS-to-TWS communication). In one embodiment, the first electronic device (202) and the second electronic device (204) may use a fixedly limited communication time (e.g., TWS-to-TWS communication time) on the communication link for bridge communication while using an audio service with an external electronic device (e.g., the electronic device (200) of FIG. 2) in a connection-based or connectionless-based manner.

[0159] In one embodiment, a source electronic device (e.g., source electronic device (400)) providing an audio service can transmit audio data to one or more surrounding sink electronic devices (e.g., first electronic device (202) and / or second electronic device (204)) using at least one BIS, and the sink electronic devices can output the audio data simultaneously. The source electronic device (400) can provide a broadcast audio service (e.g., BIS service) to surrounding sink electronic devices (e.g., first electronic device (202) and / or second electronic device (204)) using the same parameters (e.g., BIG information (600) of FIG. 6) and timing.

[0160] FIG. 11 is a drawing for explaining an example of a connection between Bluetooth devices according to an exemplary embodiment.

[0161] Referring to FIG. 11, an electronic device (200) can detect the presence of a first electronic device (202) and establish a first ACL (asynchronous connection-less) link (1102) (hereinafter referred to as ACL1 or LE ACL1) based on BLE between the two devices. The electronic device (200) can detect the presence of a second electronic device (204) and establish a second ACL link (1104) (hereinafter referred to as ACL2 or LE ACL2) based on BLE between the two devices. In one embodiment, the electronic device (200) can establish the second ACL link (1104) with the help of the first electronic device (202).

[0162] In one embodiment, the first electronic device (202) or the second electronic device (204) may begin broadcasting an advertising signal based on a specified condition (e.g., detecting that the case (e.g., the external electronic device (250)) has been opened while the first electronic device (202) and / or the second electronic device (204) is stored in the case, or that the first electronic device (202) and / or the second electronic device (204) has been removed from the case (e.g., the external electronic device (250)).

[0163] In one embodiment, the electronic device (200) can discover the first electronic device (202) by receiving an advertising signal broadcast from the first electronic device (202) and establish a first ACL link (1102) with the first electronic device (202). In one embodiment, the electronic device (200) can discover the second electronic device (204) by receiving an advertising signal broadcast from the second electronic device (204) and establish a second ACL link (1104) with the second electronic device (204).

[0164] In one embodiment, the electronic device (200) can establish a first connected isochronous stream (CIS) link (1106) (hereinafter referred to as CIS1) using an isochronous physical channel using a first ACL link (1102), and exchange isochronous data (e.g., audio data) with a first external electronic device (202) via the first CIS link (1106). In one embodiment, the electronic device (200) can establish the first CIS link (1106) with the first external electronic device (202) using the procedure of FIG. 12. Similarly, the electronic device (200) can establish a second CIS link (1108) (hereinafter referred to as CIS2) using a second ACL link (1104), and exchange isochronous data (e.g., audio data) with the second external electronic device (204) via the second CIS link (1108). In one embodiment, the electronic device (200) may establish a second CIS link (1108) with a second external electronic device (204) using the procedure of FIG. 12. The first CIS link (1106) and the second CIS link (1108) may be included in one CIS group (CIG) (1110).

[0165] In one embodiment, the first ACL link (1102) may be a logical transport used to exchange information necessary to establish or control the first CIS link (1106) between the electronic device (200) and the first external electronic device (202). The first CIS link (1106) may be used to communicate audio data between the electronic device (200) and the first external electronic device (202). In one embodiment, the electronic device (200) and the first external electronic device (202) may establish the first CIS link (1106) based on information (e.g., communication parameters) obtained via the first ACL link (1102). In one embodiment, the electronic device (200) and the first external electronic device (202) may exchange information (e.g., supported feature information and / or PHY change policy) to be applied to control the first CIS link (1106) via the first ACL link (1102).

[0166] In one embodiment, the second external electronic device (204) may establish a second ACL link (1104) and a second CIS link (1108) with the electronic device (200), and perform operations identical to or similar to those of the first external electronic device (202). In one embodiment, the second external electronic device (204) may communicate with the electronic device (200) under the control of the first external electronic device (202).

[0167] In one embodiment, the first CIS link (1106) and / or the second CIS link (1108) may be maintained until the use of the first external electronic device (202) and / or the second external electronic device (204) is terminated, or until the audio output related service (e.g., music / movie / game application) being used by the electronic device (200) is terminated. In one embodiment, when the first external electronic device (202) and / or the second external electronic device (204) is a speaker device supporting LE Audio connected to a power source, the electronic device (200) may maintain the first CIS link (1106) and / or the second CIS link (1108) since there is no restriction on current consumption. On the other hand, if the first external electronic device (202) and / or the second external electronic device (204) are wireless devices, the electronic device (200) can save power consumption of the first external electronic device (202) and / or the second external electronic device (204) by disconnecting the first CIS link (1106) and / or the second CIS link (1108) while maintaining only the first ACL link (1102) and / or the second ACL link (1104) while there is no audio output. When audio transmission (e.g., a translation service according to an exemplary embodiment) is required, the electronic device (200) can reconnect the first CIS link (1106) and / or the second CIS link (1108) using the first ACL link (1102) and / or the second ACL link (1104).

[0168] FIG. 12 is a signal flow diagram illustrating an example of a procedure for establishing a CIS link according to an exemplary embodiment. While the CIS link establishment between an electronic device (200) and a first external electronic device (202) will be described herein, the operations described below may also be performed between an electronic device (200) and a second external electronic device (204).

[0169] Referring to FIG. 12, at operation 1202, an electronic device (e.g., electronic device (200)) may have a BLE connection (e.g., a first ACL link (1102)) with an external electronic device (e.g., a first external electronic device (202)). At operation 1204, the electronic device (200) may transmit a link layer (LL) CIS request message (e.g., an LL_CIS_REQ packet) to the first external electronic device (202) including control data (e.g., control data (800) of FIG. 8) for establishing a CIS link (e.g., the first CIS link (506)). When a link layer CIS response message (e.g., an LL_CIS_RSP packet) is received from the first external electronic device (202) in operation 1206, the electronic device (200) may transmit a link layer CIS indication message (e.g., an LL_CIS_IND packet) to the first external electronic device (202) in operation 1208.

[0170] In operations 1210, 1212, and 1214, the electronic device (200) and the first external electronic device (202) can confirm the establishment of a CIS link by exchanging one or more CIS null packets (e.g., protocol data units (PDUs)). In operation 1216, the electronic device (200) and the first external electronic device (202) can communicate CIS data PDUs over the CIS link.

[0171] BIS services utilizing LE Audio are primarily used by electronic devices (such as TVs or broadcast transmitters) that can be accessed by multiple users, and can be used to provide audio services to an unspecified number of users over an extended period of time. Recently, electronic devices such as TVs and mobile phones are being developed to support BIS services, with the goal of allowing a small group of users, rather than an unspecified number of users, to simultaneously receive audio services. However, the audio services provided by the source electronic devices of the BIS service may have limitations in providing desired information to all users due to their unidirectional nature.

[0172] As an example, the BIS service basically provides auditory information, and audio data for the BIS service may transmit information in a specific language to a BIS assistant device (e.g., electronic device (200)) or a sink device (e.g., first external electronic device (202) and / or second external electronic device (204)). If the BIS service provides audio in a language other than the user's native language, the user may have difficulty understanding the received audio.

[0173] For example, a TV (e.g., source electronic device (400)) located in a public place may broadcast BIS audio data expressed in Korean via the BIS service. An American or Japanese person who does not know Korean may not understand the BIS audio data even if he or she receives the BIS audio data through his or her sink device (e.g., first external electronic device (202) and / or second external electronic device (204)).

[0174] For example, if a BIS service for in-flight announcements is broadcast in a designated language, such as Korean, English, Japanese, or Chinese, on an airplane where public network access is not possible, users of other languages ​​may not only have difficulty understanding the audio data of the BIS service, but may also miss important safety information because they cannot use translation services based on public network access.

[0175] Certain exemplary embodiments may provide a translation service for BIS audio data expressed in a language other than a language desired by a user. Certain exemplary embodiments may translate BIS audio data broadcast from a source electronic device acting as a BIS source (e.g., the source electronic device (400) of FIG. 4) into another language by an electronic device acting as a BIS assistant (e.g., the electronic device (200)). The electronic device (200) according to exemplary embodiments may transmit audio data translated into a language desired by the user to an external electronic device acting as a sink (e.g., a first external electronic device (202) and / or a second external electronic device (204)) connected to the electronic device (200) via a wireless communication link (e.g., a first CIS link (1106) and / or a second CIS link (1108)).

[0176] Fig. 13 is a diagram showing a system structure for providing a translation service according to an exemplary embodiment.

[0177] Referring to FIG. 13, a source electronic device (400) configured to act as a BIS source in operations 1302 and 1304 may broadcast advertising (ADV) data and BIS audio data for a BIS service. In one embodiment, the advertising data may include EA data (e.g., ADV_EXT_IND (502) and / or AUX_ADV_IND (504) of FIG. 5) and PA data (e.g., AUX_SYNC_IND (506) of FIG. 5 and / or AUX_CHAIN_IND (508) of FIG. 5) related to the BIS audio data.

[0178] In operation 1306, the electronic device (200) can discover the source electronic device (400) by detecting the advertising data (e.g., ADV_EXT_IND (502) of FIG. 5) broadcast from the source electronic device (400) via a BLE scan. In operations 1306a and 1306b, the electronic device (200) can act as a BIS assistant to transmit BIG synchronization information (e.g., at least a part of AUX_ADV_IND (504) and / or BIG information (600)), which is at least a part of the advertising data, to an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)), so that the external electronic device can receive BIS audio data from the source electronic device (400) based on the BIG synchronization information. In one embodiment, the external electronic device may be earbuds (e.g., the first external electronic device (202) and the second external electronic device (204)), smart glasses, a smart headset, or non-display smart glasses.

[0179] In operation 1308, the electronic device (200) may decide to provide translation services for the external electronic devices (e.g., the first external electronic device (202) and the second external electronic device (204)) and may start receiving the BIS audio data based on advertising data (e.g., PA data or AUX_SYNC_IND packet (506)) received from the source electronic device (400) to act as a BIS sink.

[0180] In one embodiment, the advertising data may be received by the electronic device (200) based on BIG synchronization information provided by the first external electronic device (202) and / or the second external electronic device (204) in operation 1306a and / or operation 1306b, and the electronic device (200) may start receiving the BIS audio data based on the AUX_SYNC_IND packet (506). In one embodiment, the electronic device (200) may receive PA data (e.g., AUX_SYNC_IND (506)) using the AUX_ADV_IND (504), obtain BIG information (600) included in the AUX_SYNC_IND (506), and start receiving the BIS audio data using the BIG information (600).

[0181] In one embodiment, the electronic device (200) can identify that the BIS audio data is expressed in a first language. In one embodiment, the BIS audio can include audio data of the same content expressed in one or more languages ​​(e.g., airport announcements provided in English, Chinese, and Japanese), and the electronic device (200) can select and receive audio data expressed in a designated language (e.g., the first language). In one embodiment, the electronic device (200) can identify a subgroup including audio data of the first language based on the user setting of the electronic device (200) and BIG information acquired in operation 1302, and receive audio data of the first language through the subgroup.

[0182] In operation 1310, the electronic device (200) may translate the BIS audio data into audio data expressed in the second language. In one embodiment, the electronic device (200) may determine to provide the translation service based on identifying that the BIS audio data is expressed in a first language and that the first language is different from a second language designated for the translation service (e.g., a set default language of the electronic device (200) or a language selected by a user). In one embodiment, the electronic device (200) may determine to provide the translation service based on a user input requesting the translation service.

[0183] In operation 1312, the electronic device (200) may establish a wireless communication link (e.g., a CIG including the first CIS link (1106) and the second CIS link (1108)) for audio transmission with the first external electronic device (202) and the second external electronic device (204). In one embodiment, the electronic device (200) may establish the wireless communication link at the time the first external electronic device (202) and the second external electronic device (204) are discovered before starting to receive the BIS audio data. In one embodiment, the electronic device (200) may establish the wireless communication link based on identifying that the electronic device (200) is not connected for audio transmission with the first external electronic device (202) and the second external electronic device (204) after determining to provide a translation service for the first external electronic device (202) and the second external electronic device (204).

[0184] In one embodiment, the first external electronic device (202) and / or the second external electronic device (204) may generate an advertising signal according to a specified condition. For example, the first external electronic device (202) and / or the second external electronic device (204) may begin broadcasting the advertising signal when powered on, according to a specified time period, or in response to at least one user input. The electronic device (200) may receive the advertising signal and, based on information included in the advertising signal, perform operations such as outputting specified information (e.g., sound or audio) or generating an LE link (e.g., the first ACL link (1102) or the second ACL link (1104)) according to various conditions. The electronic device (200) can establish a wireless communication link (e.g., a first CIS link (1106) and a second CIS link (1108)) for audio transmission with a first external electronic device (202) and / or a second external electronic device (204) using the LE link.

[0185] In operation 1314, the electronic device (200) may act as a CIS source to transmit the translated audio data to the first external electronic device (202) and / or the second external electronic device (204) via the wireless communication link (e.g., the first CIS link (1106) and / or the second CIS link (1108)). In one embodiment, the electronic device (200) may generate one or more CIS data packets including the translated audio data, and transmit the CIS data packets to the first external electronic device (202) and / or the second external electronic device (204) via the wireless communication link (e.g., the first CIS link (1106) and / or the second CIS link (1108)).

[0186] In one embodiment, the CIS data packets transmitted to the first CIS link (1106) may include audio data of a right channel translated from BIS audio data. The CIS data packets transmitted to the second CIS link (1108) may include audio data of a left channel translated from the BIS audio data. In one embodiment, the electronic device (200) may mix the audio data of the right channel and the audio data of the left channel translated from the BIS audio data, and transmit the mixed data to the first external electronic device (202) and the second external electronic device (204) identically through the first CIS link (1106) and the second CIS link (1108).

[0187] In one embodiment, the electronic device (200) can transmit audio data in different languages ​​to a first external electronic device (202) and a second external electronic device (204) via a first CIS link (1106) and a second CIS link (1108). In one embodiment, the electronic device (200) can transmit audio data expressed in a first language to the first external electronic device (202) via the first CIS link (1106) and transmit audio data translated into a second language to the second external electronic device (204) via the second CIS link (1108). In one embodiment, the electronic device (200) can receive audio data expressed in a first language from a source electronic device (400) and translate the audio data in the first language into audio data in the second language and audio data in the third language. In one embodiment, the electronic device (200) may transmit audio data translated into a second language to a first external electronic device (202) via a first CIS link (1106) and audio data translated into a third language to a second external electronic device (204) via a second CIS link (1108).

[0188] In one embodiment, the electronic device (200) can mix BIS audio data and translated audio data corresponding to the BIS audio data, and transmit the mixed data to the first external electronic device (202) and the second external electronic device (204) identically via the first CIS link (1106) and the second CIS link (1108). In one embodiment, the first external electronic device (202) and the second external electronic device (204) can stop receiving audio data from the source electronic device (400) and output (e.g., play back) the mixed data received via the first CIS link (1106) and the second CIS link (1108).

[0189] In operation 1316, the first external electronic device (202) and the second external electronic device (204) may output the translated audio data through a speaker (e.g., speaker (354)). In one embodiment, the first external electronic device (202) and the second external electronic device (204) may output BIS audio data directly received from the source electronic device (400) through the speaker (354) while simultaneously outputting the translated audio data in synchronization with the BIS audio data. In one embodiment, at least one of the translated audio data or the BIS audio data may be volume down before being output.

[0190] In one embodiment, the source electronic device (400) may be a medium capable of outputting audio (e.g., a radio broadcasting device). In one embodiment, the source electronic device (400) may be a medium capable of simultaneously outputting video and audio (e.g., a TV), and may broadcast BIS audio data to be synchronized with the video played on the source electronic device (400). As an example, the BIS audio data may include at least one of biased sports broadcasting, airport guidance, art gallery docent guidance, subway guidance, indoor navigation, audio guidance in public places, conference audio, seminars, or lectures. In one embodiment, the source electronic device (400) may display the video of a video conference on a screen while broadcasting the audio of a presenter coming from the screen. A user participating in the video conference may watch a video played on the screen of the source electronic device (400) and directly receive audio broadcast from the source electronic device (400) through an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)), or may receive translated audio transmitted from the electronic device (200) through an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)).

[0191] FIG. 14 is a flowchart illustrating a procedure for providing a translation service according to an exemplary embodiment. According to embodiments, at least one of the operations described below may be omitted, modified, or executed in a different order. In one embodiment, at least one of the operations described below may be executed by a processor (e.g., processor 120 of FIG. 1 ) of an electronic device (200) (e.g., electronic device 101 of FIG. 1 ). In one embodiment, a memory (e.g., memory 130 of FIG. 1 ) of the electronic device (200) may store instructions that cause the electronic device (200) to operate according to at least one of the operations described below.

[0192] Referring to FIG. 14, in operation 1402, an electronic device (200) (e.g., a processor (120)) may establish at least one wireless communication link with an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) that provides an audio output function. In one embodiment, the external electronic device may be an earbud, a smart glass, or a smart headset. In one embodiment, the at least one wireless communication link may include at least one LE link (e.g., a first ACL link (1102), a second ACL link (1104), a first CIS link (1106), and / or a second CIS link (1108)).

[0193] In one embodiment, the wireless communication link may include at least one CIS for audio transmission (e.g., a first CIS link (1106) and / or a second CIS link (1108)). In one embodiment, the electronic device (200) (e.g., the processor (120)) may generate a CIG including the first CIS link (1106) and / or the second CIS link (1108).

[0194] In one embodiment, the at least one CIS (e.g., the first CIS link (1106) and / or the second CIS link (1108)) may be generated based on the electronic device (200) discovering the first external electronic device (202) and / or the second external electronic device (204), or based on the electronic device (200) deciding to transmit audio to the first external electronic device (202) and / or the second external electronic device (204), or based on the electronic device (200) deciding to provide a translation service related to a BIS service for the first external electronic device (202) and / or the second external electronic device (204).

[0195] As an example, although in FIG. 14, operation 1402 is illustrated as being performed prior to operation 1404, in one embodiment, operation 1402 of establishing the wireless communication link may be performed at any point prior to operation 1410. In one embodiment, the electronic device (200) (e.g., processor (120)) may reconnect the first CIS link (1106) and / or the second CIS link (1108) based on a decision to start the translation service according to the exemplary embodiment while the first CIS link (1106) and / or the second CIS link (1108) is released. In one embodiment, the first CIS link (1106) and / or the second CIS link (1108) may be established by exchanging messages related to service connectivity (e.g., LL_CIS_REQ, LL_CIS_RSP, and / or CIS_IND of FIG. 12) over the first ACL link (1102) and / or the second ACL link (1104).

[0196] In operation 1404, the electronic device (200) (e.g., the processor (120)) may receive synchronization information (e.g., at least a portion of an AUX_ADV_IND packet (504) or BIG information (600)) related to reception of the BIS service broadcast from a source electronic device (400) providing the BIS service, and transmit the synchronization information to an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)). In one embodiment, the synchronization information may be transmitted via a wireless communication link (e.g., a first ACL link (1102) or a second ACL link (1104)) connected between the electronic device (200) and the external electronic device.

[0197] In one embodiment, an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) can receive audio data (e.g., BIS data packets) broadcast from a source electronic device (400) and output (e.g., play) the audio data by synchronizing to a BIS service from the source electronic device (400) based on the synchronization information. In one embodiment, the external electronic device can receive PA data (e.g., AUX_SYNC_IND packet (506)) based on the synchronization information, and receive the audio data from the source electronic device (400) using BIG information (e.g., BIG information (600) of FIG. 6) obtained from the PA data.

[0198] In one embodiment, the electronic device (200) (e.g., processor (120)) may discover the source electronic device (400) by receiving EA data (e.g., ADV_EXT_IND packet (502) and / or AUX_ADV_IND packet (504)) broadcast from the source electronic device (400) based on which the electronic device determines to act as an assistant for the BIS service, receive PA data (e.g., AUX_SYNC_IND packet (506)) from the source electronic device (400) based on the EA data, and display brief information (e.g., device name and / or broadcast service name) related to the BIS service provided by the source electronic device (400) based on the PA data. After displaying the above information, based on receiving a user input to select to receive the BIS service, the electronic device (200) (e.g., processor (120)) may transmit the synchronization information to an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)).

[0199] In operation 1406, the electronic device (200) (e.g., processor (120)) may synchronize to a BIS service from the source electronic device and receive first audio data (e.g., BIS data packets) broadcast from the source electronic device. In one embodiment, the electronic device (200) (e.g., processor (120)) may receive the first audio data by synchronizing to the BIS service from the source electronic device (400) based on the synchronization information. In one embodiment, the electronic device (200) (e.g., processor (120)) may start receiving the first audio data based on a determination to start a translation service related to the BIS service. In one embodiment, the electronic device (200) (e.g., the processor (120)) may determine to start the translation service based on a user input via a UI (e.g., a translation service selection UI (1702) of FIG. 17, a translation listening UI (2130) of FIG. 21c, or a translation language selection UI (2230) of FIG. 22c). In one embodiment, the electronic device (200) (e.g., the processor (120)) may determine to start the translation service based on a first language expressing the first audio data being different from a specified second language (e.g., a default language set in the electronic device (200) or a language selected by the user).

[0200] In one embodiment, the electronic device (200) (e.g., the processor (120)) may receive PA data (e.g., the AUX_SYNC_IND packet (506)) related to a BIS service broadcast from a source electronic device (400) based on the synchronization information, and may receive the first audio data broadcast from the source electronic device (400) using BIG information (e.g., the BIG information (600) of FIG. 6) obtained from the PA data.

[0201] In one embodiment, the electronic device (200) (e.g., the processor (120)) can identify that the first audio data is expressed in a first language (e.g., that the first audio data may include spoken words of the first language, or that the first audio data is associated with the first language). In one embodiment, the electronic device (200) (e.g., the processor (120)) can automatically detect that the first audio data is expressed in the first language through a language identification (LID) result for the first audio data. In one embodiment, the electronic device (200) (e.g., the processor (120)) can identify that the first audio data is expressed in the first language based on language information included in BIS-related information (e.g., at least one of PA data, AUX_SYNC_IND (506), or BIG information (600)) associated with the first audio data.

[0202] In operation 1408, the electronic device (200) (e.g., the processor (120)) may translate the first audio data into second audio data expressed in the second language. In one embodiment, the second language may be, for example, a default language set in the electronic device (200) or a language selected by the user. In one embodiment, the electronic device (200) (e.g., the processor (120)) may display a translation language selection user interface (UI) (e.g., translation language selection UI (2230)) indicating at least one translatable language to start a translation service, and may receive a user input for selecting a second language through the language selection UI. In one embodiment, the electronic device (200) (e.g., processor (120)) can translate the first audio data into the second audio data using a cloud-based artificial intelligence (AI) algorithm (e.g., cloud-based AI translation algorithm (1610) of FIG. 16) or an on-device AI algorithm (e.g., on-device AI translation algorithm (1620) of FIG. 16).

[0203] In operation 1410, the electronic device (200) (e.g., the processor (120)) may transmit second audio data to an external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)). In one embodiment, the electronic device (200) (e.g., the processor (120)) may transmit the second audio data to the external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)) via the at least one wireless communication link (e.g., the first CIS link (1106) and / or the second CIS link (1108)) established in operation 1402. In one embodiment, the electronic device (200) (e.g., the processor (120)) may generate a BIG including at least one BIS for transmitting the second audio data, and broadcast the second audio data via the at least one BIS.

[0204] In one embodiment, an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) can receive the second audio data (e.g., CIS data packets) via the wireless communication link (e.g., a first CIS link (1106) and / or a second CIS link (1108)). In one embodiment, the external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) can synchronize to the BIG from the electronic device (200) and receive the second audio data broadcast via the BIG. In one embodiment, the external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) can output the second audio data via a speaker (e.g., a speaker (354).

[0205] In one embodiment, the external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)) may output the second audio data together with (e.g., mixed with) audio data received directly from the source electronic device (400), or may output the second audio data instead of the audio data received directly from the source electronic device (400). In one embodiment, the external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)) may reduce the volume of the audio data received directly from the source electronic device (400) and output the second audio data louder.

[0206] In one embodiment, the external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)) may stop synchronization with the BIS service from the source electronic device (400) and output only the second audio data while receiving the second audio data from the electronic device (200). In one embodiment, the external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)) may stop direct reception of the BIS audio data while maintaining synchronization with the BIS service. In one embodiment, the external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)) may maintain BIS synchronization based on PA data from the source electronic device (400) even when it stops direct reception of audio data from the source electronic device (400), thereby allowing it to quickly resume reception of the BIS audio data from the source electronic device (400).

[0207] In one embodiment, the electronic device (200) (e.g., the processor (120)) may transmit control information indicating a method of outputting the second audio data to an external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)) together with the second audio data or prior to transmitting the second audio data. In one embodiment, the control information may instruct the external electronic device to output the second audio data together with audio data received directly from the source electronic device (400), or to output the second audio data instead of audio data received directly from the source electronic device (400).

[0208] In one embodiment, the control information may include latency information based on BIG information received by the electronic device (200) from the source electronic device (400). In one embodiment, the latency information may include at least one of a start time of BIS audio data (e.g., BIS audio data (1304)), a latency with respect to a video played by the source electronic device (400), or a start offset for translation support. In one embodiment, the electronic device (200) may determine the latency information by additionally considering the time taken to translate first audio data into second audio data.

[0209] In one embodiment, an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) can synchronize a time at which the electronic device (200) plays back image data from the source electronic device (400) and a time at which the electronic device (200) plays back translated audio data by using the latency information. In one embodiment, the electronic device (200) can display translated text corresponding to the BIS audio data (e.g., the BIS audio data (1304)) so as to be synchronized with the BIS audio data based on the latency information.

[0210] FIG. 15 is a flowchart illustrating a procedure for providing a translation service based on language identification according to an exemplary embodiment. According to embodiments, at least one of the operations described below may be omitted, modified, or executed in a different order. In one embodiment, at least one of the operations described below may be executed by a processor (e.g., processor 120 of FIG. 1 ) of an electronic device (200) (e.g., electronic device 101 of FIG. 1 ). In one embodiment, a memory (e.g., memory 130 of FIG. 1 ) of the electronic device (200) may store instructions that cause the electronic device (200) to operate according to at least one of the operations described below.

[0211] Referring to FIG. 15, in operation 1502, the electronic device (200) (e.g., the processor (120)) may identify the presence of a BIS service provided by the source electronic device (400) by receiving advertising data (e.g., EA data and / or PA data) broadcast from the source electronic device (400). In one embodiment, the electronic device (200) (e.g., the processor (120)) may select at least one BIS service from among at least one BIS service that can be provided by the source electronic device (400) based on the advertising data, with which an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) is to synchronize. In one embodiment, the electronic device (200) (e.g., the processor (120)) may transmit synchronization information related to the selected BIS service to the external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)), thereby causing the external electronic device to synchronize to the BIS service based on the synchronization information.

[0212] In operation 1504, the electronic device (200) (e.g., processor (120)) may detect a BIS audio language associated with the BIS service. In one embodiment, the electronic device (200) (e.g., processor (120)) may identify that the BIS audio language is a first language (e.g., English) based on language information included in PA data (e.g., AUX_SYNC_IND (506)) associated with the BIS service. In one embodiment, the electronic device (200) (e.g., processor (120)) may identify that the BIS audio language is a first language (e.g., English) based on a language identification result for BIS audio data received based on the PA data.

[0213] At step 1506, the electronic device (200) (e.g., processor (120)) may determine whether the first language is the same as the user's language (e.g., second language). In one embodiment, the user's language may be a default language set in the electronic device (200). If the electronic device (200) (e.g., processor (120)) determines that the first language is different from the user's language, the electronic device (200) (e.g., processor (120)) may proceed to step 1508. If the first language is the same as the user's language, the electronic device (200) (e.g., processor (120)) may terminate the procedure. In one embodiment, the electronic device (200) (e.g., processor (120)) may determine to start the translation service by receiving a user input requesting to start the translation service instead of performing step 1506.

[0214] In operation 1508, the electronic device (200) (e.g., processor (120)) may receive a user input for selecting a language to be translated (e.g., a second language) through a translation language selection UI (e.g., translation language selection UI (2230)) indicating at least one language for which a translation service can be provided.

[0215] In operation 1510, the electronic device (200) (e.g., the processor (120)) may execute a translation algorithm to translate the first language into the second language. In one embodiment, operation 1510 may include at least one of operation 1512, operation 1514, or operation 1516. In operation 1512, the electronic device (200) (e.g., the processor (120)) may determine whether the electronic device (200) will perform a network-based translation service. If the electronic device (200) performs a network-based translation service, in operation 1514, the electronic device (200) (e.g., the processor (120)) may execute a cloud-based AI translation algorithm (e.g., the cloud-based AI translation algorithm (1610) of FIG. 16). When not performing a network-based translation service, the electronic device (200) (e.g., processor (120)) in operation 1516 may execute an on-device AI translation algorithm (e.g., the on-device AI translation algorithm (1620) of FIG. 16).

[0216] In operation 1518, the electronic device (200) (e.g., processor (120)) receives BIS audio data related to the BIS service by synchronizing to the BIS service from the source electronic device (400) based on the advertising data (e.g., EA data and / or PA data) received in operation 1502, and translates the BIS audio data into a user-selected language (e.g., a second language) through the cloud-based AI translation algorithm or the on-device AI translation algorithm.

[0217] In operation 1520, the electronic device (200) (e.g., the processor (120)) may transmit the translated audio data. In one embodiment, the electronic device (200) (e.g., the processor (120)) may transmit the translated audio data via at least one wireless communication link for audio transmission (e.g., the first CIS link (1106) and / or the second CIS link (1108)). In one embodiment, the electronic device (200) (e.g., the processor (120)) may generate a BIG including at least one BIS for transmission of the translated audio data, and broadcast the translated audio data via the at least one BIS, thereby allowing an external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)) to receive the broadcasted translated audio data.

[0218] In one embodiment, the electronic device (200) (e.g., the processor (120)) may generate data packets (e.g., CIS data packets or BIS data packets) including the translated audio data. In one embodiment, the data packets may include, together with the translated audio data, control information for causing an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) to output the translated audio data. The first external electronic device (202) and / or the second external electronic device (204) may output the translated audio data based on the control information so as to be synchronized with audio data received directly from the source electronic device (400).

[0219] In one embodiment, when the translated audio data is transmitted through at least one CIS link, the electronic device (200) can receive an ACK for the audio data (e.g., CIS data packet) transmitted for each CIS link as a response, and can determine whether the CIS data packet was normally received through the ACK. The electronic device (200) can retransmit an unacknowledged CIS data packet at a flush point calculated by combining CIS parameters (e.g., BN (burst number), NSE (number of subevents), and FT (flushing time)) determined in a procedure for establishing a CIS link (e.g., the procedure of FIG. 12). When an anchor point toggle is set, the electronic device (200) can toggle the anchor point based on a specified unit time interval and transmit CIS audio data (e.g., CIS data packets) at the toggled anchor point. An external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) can receive CIS data packets containing translated audio from the electronic device (200) based on CIS parameters determined through a procedure for establishing a CIS link (e.g., the procedure of FIG. 12).

[0220] In one embodiment, an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) may receive CIS data packets containing translated audio from the electronic device (200) via a first CIS link (1106) and / or a second CIS link (1108), and may transmit an acknowledgement for the CIS data packets via the first CIS link (1106) and / or the second CIS link (1108).

[0221] In one embodiment, the electronic device (200) may act as a BIS source that receives and translates BIS audio data broadcast by a source electronic device (400) and broadcasts the translated audio data. In one embodiment, the electronic device (200) may broadcast BIS data packets including the translated audio data according to BIG information (e.g., BIG information (600) of FIG. 6) broadcast by the source electronic device (400) according to the procedure of FIG. 19.

[0222] Fig. 16 is a diagram illustrating an AI translation algorithm according to an exemplary embodiment.

[0223] Referring to FIG. 16, the electronic device (200) may receive BIS audio data (1602) expressed in a first language from a source electronic device (400), and may translate the BIS audio data (1602) into audio data (1604) expressed in a second language using a cloud-based AI translation algorithm (1610) or an on-device AI translation algorithm (1620). In one embodiment, the electronic device (200) may configure the cloud-based AI translation algorithm (1610) or the on-device AI translation algorithm (1620) to operate in a second language selected by a user.

[0224] In one embodiment, the electronic device (200) can identify a first language expressing the BIS audio data (1602) from language information included in BIS-related information (e.g., BIS information (600)) related to the BIS audio data (1602) or based on a language identification result for the BIS audio data (1602). In one embodiment, the electronic device (200) can identify a second language to be translated based on user setting information, or can identify the second language to be translated based on user input received directly from the user. In one embodiment, the second language can be a default language set in the electronic device (200).

[0225] In one embodiment, the electronic device (200) may execute either a cloud-based AI translation algorithm (1610) or an on-device AI translation algorithm (1620) depending on whether network-based translation is available. In one embodiment, the electronic device (200) may execute the cloud-based AI translation algorithm (1610) if the use of a data network is permitted, and execute the on-device AI translation algorithm (1620) if the use of a data network is not permitted.

[0226] In one embodiment, a cloud-based AI translation algorithm (1610) may include a decoder (1612) that may translate BIS audio data (1602) into audio data (1604) expressed in a second language using an acoustic model (1614a), a vocabulary pronunciation model (1614b), and / or a language model (1614c) that may be learned by a cloud server (1600). In one embodiment, the decoder (1612) may generate audio data (1604) expressed in the second language and text data (1606) expressed in the second language, translated from the BIS audio data (1602).

[0227] In one embodiment, a cloud-based AI translation algorithm (1620) may include a decoder (1622) that may translate BIS audio data (1602) into audio data (1604) expressed in a second language using an acoustic model (1624a), a vocabulary pronunciation model (1624b), and / or a language model (1624c) that may be learned within the electronic device (200). In one embodiment, the decoder (1622) may generate audio data (1604) expressed in the second language and text data (1606) expressed in the second language, translated from the BIS audio data (1602).

[0228] Fig. 17 is a diagram illustrating a translation service selection UI according to an exemplary embodiment.

[0229] Referring to FIG. 17, the electronic device (200) may discover a source electronic device (400) providing a BIS service and display a translation service selection UI (1702) to inquire whether to perform a translation service for the BIS service. In one embodiment, the electronic device (200) may identify a first language (e.g., English) expressing the BIS service from PA data related to the BIS service, and display the translation service selection UI (1702) based on the first language being different from a second language (e.g., Korean) set by the electronic device (200). Based on receiving a user input requesting to perform a translation service through the translation service selection UI (1702), the electronic device (200) may receive BIS audio data broadcast from the source electronic device (400) and translate the received BIS audio data.

[0230] FIG. 18 is a diagram illustrating an operation of displaying translated text according to an exemplary embodiment.

[0231] Referring to FIG. 18, the electronic device (200) can translate BIS audio data (1802) of a first language (e.g., Korean) received from a source electronic device (400) into audio data of a second language (e.g., English), and simultaneously generate first text data expressed in the first language (e.g., Korean text (1804a)) and second text data expressed in the second language (e.g., translated English text (1804b)).

[0232] In one embodiment, the electronic device (200) may generate Korean text (1804a) corresponding to the BIS audio data (1802) through speech recognition on the BIS audio data (1802). In one embodiment, the electronic device (200) may execute a translation algorithm (e.g., a cloud-based AI translation algorithm (1610) or an on-device AI translation algorithm (1620)) using the BIS audio data (1802) as input to generate translated English text (1804b) (e.g., text data (1606)) corresponding to the BIS audio data (1802). In one embodiment, the translated English text (1804b) may include text having the same content as the BIS audio data (1802) or may include text having the content summarized by the AI ​​algorithm.

[0233] In one embodiment, the electronic device (200) can display at least one of Korean text (1804a) or translated English text (1804b) through a display (e.g., display module (160)). The electronic device (200) can transmit translated audio data (1806) to an external electronic device (e.g., first external electronic device (202) and / or second external electronic device (204)), and display at least one of the Korean text (1804a) or translated English text (1804b) so as to be synchronized with the translated audio data (1806) output by the external electronic device. A user can listen to the translated audio through the external electronic device while simultaneously recognizing the Korean text (1804a) and / or translated English text (1804b) through the display (e.g., display module (160)) of the electronic device (200). In one embodiment, the electronic device (200) may display at least one of Korean text (1804a) or translated English text (1804b) without transmitting the translated audio data (1806).

[0234] In one embodiment, the electronic device (200) may display first text data (e.g., Korean text (1804a)) expressed in a first language corresponding to BIS audio data (1802) of a first language (e.g., Korean) received from a source electronic device (400), while displaying second text data (e.g., translated English text (1804b)) expressed in a second language at a later time than the first text data. In one embodiment, when the electronic device (200) displays the second text data, the electronic device (200) may display by emphasizing (e.g., highlighting or coloring) a corresponding portion of the first text data that matches the second text data. In one embodiment, the electronic device (200) may display by emphasizing (e.g., highlighting or coloring) portions corresponding to the same content of the first text data and the second text data.

[0235] In one embodiment, while transmitting the translated audio to an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)), the electronic device (200) may begin displaying text (e.g., translated English text (1804b)) corresponding to the translated audio based on a change in an audio output property of the external electronic device (e.g., adjusting the audio volume down and / or setting it to silent) due to a user input. In one embodiment, the electronic device (200) may receive the user input via an input device (e.g., a touchscreen) of the electronic device (200) or via an input device (330) of the external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)).

[0236] In one embodiment, the electronic device (200) can display translated text (e.g., translated English text (1804b)) and at least a portion of information related to the translated text in synchronization with the translated audio (1806) output from an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)). In one embodiment, the information related to the translated text can include at least one of an image, a video, or text information generated or searched based on the translated text. For example, the information related to the translated text can include information related to a singer of a song provided as BIS audio data (1802), information related to a movie provided as BIS audio data (1802), or information related to a player and / or team related to a sports broadcast provided as BIS audio data (1802). In one embodiment, the electronic device (200) can execute a specified application based on identifying that a specified keyword is included in the BIS audio data (1802). In one embodiment, the BIS audio data (1802) may include airport audio guidance, and the electronic device (200) may execute an indoor navigation application based on the airport audio guidance including phrases guiding movement in a particular direction.

[0237] FIG. 19 is a diagram illustrating a procedure for broadcasting translated audio according to an exemplary embodiment. According to embodiments, at least one of the operations described below may be omitted, modified, or executed in a different order. In one embodiment, at least one of the operations described below may be executed by a processor (e.g., processor 120 of FIG. 1 ) of an electronic device (200) (e.g., electronic device 101 of FIG. 1 ). In one embodiment, a memory (e.g., memory 130 of FIG. 1 ) of the electronic device (200) may store instructions that cause the electronic device (200) to operate according to at least one of the operations described below.

[0238] Referring to FIG. 19, at operation 1902, the electronic device (200) (e.g., processor (120)) may determine whether to start a BIS service with translated audio (e.g., audio data (1604) translated into a second language) obtained through at least one of the embodiments described above. In one embodiment, the electronic device (200) (e.g., processor (120)) may determine to start the BIS service based on a user input requesting the start of the BIS service.

[0239] In one embodiment, the electronic device (200) (e.g., processor (120)) may determine to initiate the BIS service based on a user option specifying to initiate the BIS service upon initiation of a translation service. In one embodiment, the electronic device (200) (e.g., processor (120)) may determine to initiate the BIS service based on a number of external electronic devices (e.g., first external electronic device (202), second external electronic device (204), and / or third external electronic device (2000)) receiving translated audio via CIS exceeding a specified threshold. In one embodiment, the electronic device (200) (e.g., processor (120)) may determine to initiate the BIS service based on identifying that a lack of communication resources (e.g., communication circuits or frequency resources) makes it difficult to create a new CIS.

[0240] If the BIS service is not started, the electronic device (200) (e.g., processor (120)) may terminate the procedure. If it is determined to start the BIS service, the electronic device (200) (e.g., processor (120)) may proceed to operation 1904.

[0241] In operation 1904, the electronic device (200) may generate first BIG information (e.g., BIG information (600)) including BIG parameters related to the BIG to generate a BIG including at least one subgroup for a BIS service. In one embodiment, the electronic device (200) may refer to second BIG information (e.g., BIG information acquired in operation 1302) related to the BIS service transmitted by the source electronic device (400) to determine an anchor point, which is a starting point of BIS data transmission, to be the same as the anchor point of the BIS service transmitted by the source electronic device (400). Information related to the determined anchor point (e.g., BIG_Offset) may be included in the BIG information.

[0242] In one embodiment, the electronic device (200) can add a subgroup for translated audio within the BIG provided by the source electronic device (400) and transmit BIS data packets including the translated audio via a BIG / BIS event of the added subgroup. The additional subgroup for the translated audio can be transmitted temporally synchronized (e.g., at the same anchor point) with the subgroup associated with the first audio data within the BIG by using a common timing reference. In one embodiment, the electronic device (200) can add a subgroup for translated audio within the BIG provided by the source electronic device (400) and transmit BIS data packets including first audio data received from the source electronic device (400) and second audio data including the translated audio.

[0243] In operation 1906, the electronic device (200) may broadcast advertising data (e.g., PA data, or an AUX_SYNC_IND packet (506)) including the first BIG information. In one embodiment, the first BIG information (e.g., the AUX_SYNC_IND packet (506)) may include language information indicating a language (e.g., a second language) in which the translated audio transmitted by the electronic device (200) is expressed.

[0244] In operation 1908, the electronic device (200) may start transmitting BIS data packets including translated audio based on the first BIG information. At least one external electronic device (e.g., a third external electronic device (2000)) located in the vicinity of the electronic device (200) may discover the electronic device (200) acting as a BIS source based on advertising data broadcast by the electronic device (200) and receive BIS data packets including translated audio broadcast from the electronic device (200). In one embodiment, the BIS data packets may include translated audio data corresponding to BIS audio data received by the electronic device (200) from the source electronic device (400) and / or translated text data corresponding to the BIS audio data. In one embodiment, the third external electronic device (2000) may be an electronic device including a display (e.g., smart glasses) and may display the translated text data.

[0245] In one embodiment, the electronic device (200) may provide a BIS service including audio data expressed in one or more languages. The electronic device (200) may include language information for a plurality of languages ​​(e.g., "BIS1_Korean") in the first BIG information, and transmit BIS audio data including translated audio according to a specified condition (e.g., a language selected by the user), thereby providing a translation service desired by the user.

[0246] FIG. 20 is a diagram illustrating broadcasting of translated audio according to an exemplary embodiment.

[0247] Referring to FIG. 20, the electronic device (200) may receive BIS audio data (2004) in a first language (e.g., English) broadcast from the source electronic device (400) based on advertising data (2002) received from the source electronic device (400). The electronic device (200) may transmit audio data translated from the BIS audio data (2004) to an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) via at least one wireless communication link. In one embodiment, the electronic device (200) may generate CIS audio data (2006) (e.g., CIS data packets) including the translated audio data, and transmit the CIS audio data (2006) to a first external electronic device (202) and / or a second external electronic device (204) via at least one CIS link (e.g., a first CIS link (1106) and / or a second CIS link (1108)).

[0248] In one embodiment, the electronic device (200) may broadcast BIS data packets (2014) including advertising data (2012) related to the BIS service and translated audio data (e.g., Korean audio data) based on a decision to initiate a BIS service of translated audio. The advertising data (2012) may include synchronization information for synchronizing the translated audio data with the BIS audio data (2004) transmitted by the source electronic device (400). In one embodiment, the advertising data (2012) may indicate a BIS channel name (e.g., “BIS1_Korean”) including a language in which the translated audio data is expressed. In one embodiment, the advertising data (2012) may include at least a portion of translated text data (e.g., Korean text data) corresponding to the BIS audio data (2004) in a first language (e.g., English).

[0249] In one embodiment, an external electronic device (e.g., a third external electronic device (2000)) can discover an electronic device (200) acting as a BIS source based on receiving advertising data (2012) and can receive BIS data packets (2014) containing translated audio data from the electronic device (200) based on the advertising data (2012). The third external electronic device (2000) can output the translated audio data included in the BIS data packets (2014) through a speaker (e.g., a speaker (354)). In one embodiment, the third external electronic device (2000) may output the translated audio data in synchronization with audio output from the first external electronic device (202) and / or the second external electronic device (204) (e.g., BIS audio data (2004) received by the first external electronic device (202) and / or the second external electronic device (204) from the source electronic device (400) and / or CIS audio data (2006) received by the first external electronic device (202) and / or the second external electronic device (204) from the electronic device (200)).

[0250] In one embodiment, the third external electronic device (2000) may be an electronic device including a display, and the electronic device (200) may broadcast BIS data packets (2014) including translated text data (e.g., Korean text data) together with advertising data (2012) and translated audio data related to the BIS service. In one embodiment, the third external electronic device (2000) may display the translated text data so as to be synchronized with audio output from the first external electronic device (202) and / or the second external electronic device (204).

[0251] In one embodiment, an external electronic device (e.g., a first external electronic device (202), a second external electronic device (204), or a third external electronic device (200)) may, while receiving BIS audio data (2004) broadcast from a source electronic device (400), detect whether there is an additional BIS transmitting a translated audio stream related to the BIS audio data (2004). In one embodiment, the external electronic device, while directly receiving BIS audio data (2004) broadcast from the source electronic device (400), may receive advertising data (2012) broadcast from the electronic device (200) and, based on the advertising data, identify that the BIS audio data (2014) broadcast from the electronic device (200) includes translated audio related to the BIS audio data (2004) broadcast from the source electronic device (400). In one embodiment, an external electronic device may receive BIS audio data (2014) broadcast from an electronic device (200) based on advertising data (2012).

[0252] Exemplary embodiments allow a user to utilize a translated audio service via an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)). Exemplary embodiments allow the translation service to be provided by utilizing the processing resources of the electronic device (200).

[0253] In one embodiment, the electronic device (200) may display translation setting UIs (e.g., the translation listening UI (2130) of FIG. 21c or the automatic translation setting UI (2220) and translation language selection UI (2230) of FIG. 22b) for setting up a translation service according to exemplary embodiments. In one embodiment, the electronic device (200) may provide the translation setting UIs through a pop-up menu, a notification bar, and / or a toast message.

[0254] FIGS. 21a, 21b, and 21c are diagrams illustrating a UI for selecting a translation service through Bluetooth settings according to an exemplary embodiment.

[0255] Referring to FIG. 21a, the electronic device (200) can display a Bluetooth setting UI (2110) for an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)) among the Bluetooth devices that can be connected to the electronic device (200).

[0256] Referring to FIG. 21b, the electronic device (200) may display a broadcast listening UI (2120) (e.g., “Listen to Oracast Broadcast”) for selecting the start of a broadcast service based on a user input (e.g., a touch) to the Bluetooth setting UI (2110).

[0257] Referring to FIG. 21c, the electronic device (200) may display a translation listening UI (2130) (e.g., “listen to translated broadcast”) for selecting a translation service based on a user input (e.g., a touch) to the broadcast listening UI (2120). The electronic device (200) may determine to start a translation service according to exemplary embodiments based on the user input (e.g., a touch) to the translation listening UI (2130).

[0258] FIGS. 22a, 22b, and 22c are diagrams illustrating a UI for selecting a translation service through device settings according to one embodiment of the present disclosure.

[0259] Referring to FIG. 22a, the electronic device (200) can display a peripheral broadcast translation setting UI (2210) by executing a dedicated application for an external electronic device (e.g., a first external electronic device (202) and / or a second external electronic device (204)).

[0260] Referring to FIG. 22B, the electronic device (200) may display an automatic translation setting UI (2220) (e.g., "Use translation after detecting Oracast broadcast") based on a user input (e.g., a touch) to the ambient broadcast translation setting UI (2210). In one embodiment, the electronic device (200) may display a broadcast setting UI (2222) of translated audio (e.g., "Broadcast as translated audio") together with the automatic translation setting UI (2220). In one embodiment, the electronic device (200) may display or activate the broadcast setting UI (2222) of translated audio based on the activation of "Use translation after detecting Oracast broadcast" through the automatic translation setting UI (2220).

[0261] Referring to FIG. 22C, the electronic device (200) may display a translation language selection UI (2230) based on a user input (e.g., a touch) to an automatic translation setting UI (2220). The translation language selection UI (2230) may include input objects (e.g., “English, Japanese, and / or Chinese”) representing target languages ​​that the electronic device (200) can translate into. The electronic device (200) may determine to automatically provide a translation service related to the BIS service based on receiving a user input for selecting a translation target language (e.g., a second language) through any one of the input objects. In one embodiment, the electronic device (200) may automatically broadcast (e.g., BIS generation and broadcast) translated audio generated through the translation service while providing the translation service based on a user input (e.g., a touch) to a broadcast setting UI (2222) of the translated audio.

[0262] FIG. 23 is a flowchart illustrating a procedure for providing a translation service based on caching translated data according to an exemplary embodiment. According to embodiments, at least one of the operations described below may be omitted, modified, or executed in a different order. In one embodiment, at least one of the operations described below may be executed by a processor (e.g., processor 120 of FIG. 1 ) of an electronic device (200) (e.g., electronic device 101 of FIG. 1 ). In one embodiment, a memory (e.g., memory 130 of FIG. 1 ) of the electronic device (200) may store instructions that cause the electronic device (200) to operate according to at least one of the operations described below.

[0263] Referring to FIG. 23, in operation 2302, the electronic device (200) (e.g., the processor (120)) may identify the presence of a BIS service provided by the source electronic device (400) by receiving advertising data (e.g., EA data and / or PA data) broadcast from the source electronic device (400). In one embodiment, the electronic device (200) (e.g., the processor (120)) may receive broadcast information (e.g., BIG information (600) of FIG. 6) related to the identified BIS service, and may synchronize with the BIS service (e.g., BIG) based on the BIG information, and then receive BIS audio data (e.g., a BIS audio data stream) through the BIS service.

[0264] In operation 2304, the electronic device (200) (e.g., processor (120)) may detect a BIS audio language associated with the BIS service. In one embodiment, the electronic device (200) (e.g., processor (120)) may identify that the BIS audio language is a first language (e.g., English) based on language information included in PA data (e.g., AUX_SYNC_IND (506)) associated with the BIS service. In one embodiment, the electronic device (200) (e.g., processor (120)) may identify that the BIS audio language is a first language (e.g., English) based on a language identification result for BIS audio data received based on the PA data.

[0265] At step 2306, the electronic device (200) (e.g., processor (120)) may determine whether the first language is the same as the user's language (e.g., second language). In one embodiment, the user's language may be a default language set in the electronic device (200). If the electronic device (200) (e.g., processor (120)) determines that the first language is different from the user's language, the electronic device (200) (e.g., processor (120)) may proceed to step 152308. If the first language is the same as the user's language, the electronic device (200) (e.g., processor (120)) may terminate the procedure. In one embodiment, the electronic device (200) (e.g., processor (120)) may determine to start the translation service by receiving a user input requesting to start the translation service instead of performing step 2306.

[0266] In operation 2308, the electronic device (200) (e.g., processor (120)) may receive a user input for selecting a language to be translated (e.g., a second language) through a translation language selection UI (e.g., translation language selection UI (2230)) indicating at least one language for which a translation service can be provided.

[0267] In operation 2310, the electronic device (200) (e.g., the processor (120)) receives BIS audio data related to the BIS service, and may translate the BIS audio data into a user-selected language (e.g., a second language) through a cloud-based AI translation algorithm (e.g., the cloud-based AI translation algorithm (1610) of FIG. 16) or an on-device AI translation algorithm (1620) of FIG. 16). In one embodiment, operation 2310 may correspond to operation 1510.

[0268] In operation 2312, the electronic device (200) (e.g., the processor (120)) may determine whether to cache the BIS audio data (e.g., the raw audio data) and the translated audio data before translation in a memory (e.g., the memory (130) of FIG. 1). In one embodiment, the electronic device (200) may enable or disable a cache function for the raw audio data and the translated audio data based on a user setting. If the cache function is disabled, the electronic device (200) may proceed to operation 2316. If the cache function is enabled, the electronic device (200) may proceed to operation 2314.

[0269] In operation 2314, the electronic device (200) (e.g., processor (120)) may leverage the cached data (e.g., BIS audio data prior to translation and translated audio data) by an AI platform (e.g., an AI algorithm). In one embodiment, the cached data may be utilized and processed for various purposes according to a user request. In one embodiment, operation 2314 may include displaying the UI of FIG. 24a and / or FIG. 24b.

[0270] In operation 2316, the electronic device (200) (e.g., the processor (120)) may transmit the translated audio data. In one embodiment, the electronic device (200) (e.g., the processor (120)) may transmit the translated audio data via at least one wireless communication link for audio transmission (e.g., the first CIS link (1106) and / or the second CIS link (1108)). In one embodiment, the electronic device (200) (e.g., the processor (120)) may generate a BIG including at least one BIS for transmission of the translated audio data, and broadcast the translated audio data via the at least one BIS, thereby allowing an external electronic device (e.g., the first external electronic device (202) and / or the second external electronic device (204)) to receive the broadcasted translated audio data. In one embodiment, operation 2316 may correspond to operation 1520.

[0271] In one embodiment, when a translation algorithm (e.g., a cloud-based AI translation algorithm (1610) or an on-device AI translation algorithm (1610)) is completed, the electronic device (200) may store BIS audio data prior to translation (e.g., raw audio data) and translated audio data in a memory (130) (e.g., cache memory) so that the BIS audio data can be utilized according to the user's intention. In one embodiment, the electronic device (200) may store the raw audio data and translated audio data for a specified time period in a cache memory so that the user can utilize information that the user missed or previously received audio data according to the user's intention.

[0272] In one embodiment, the electronic device (200) may cache the original audio data and the translated audio data in a situation where the audio service is being used in a background operation, rather than in a foreground operation. In one embodiment, the foreground operation may refer to a situation where the screen of the electronic device (200) is turned on or outputting audio while receiving the audio service, and the background operation may refer to a situation where the screen of the electronic device (200) is turned off or not outputting audio while receiving the audio service. In one embodiment, data cached during the foreground operation (e.g., original data and translated data) and data cached during the background operation (e.g., original data and translated data) may be distinguished by a designated flag. In one embodiment, data cached during the foreground operation may be stored with the flag set to a first value, and data cached during the background operation may be stored with the flag set to a second value.

[0273] In one embodiment, the electronic device (200) may provide the cached data (e.g., original data and translated data cached during foreground operation and / or background operation) to the user through an AI platform (e.g., cloud-based AI or on-device AI). In one embodiment, the electronic device (200) may select data suitable for the user's intention based on the AI ​​platform among the cached data and display the selected data. In one embodiment, the cached data may include original data directly selected and received by the user (e.g., audio data received during foreground operation) and its translated data, and original data received at a time not intended by the user (e.g., audio data received during background operation) and its translated data.

[0274] FIGS. 24a and 24b are diagrams illustrating a UI of a translation service utilizing cached data according to one embodiment of the present disclosure.

[0275] Referring to FIG. 24A, the electronic device (200) may receive an audio service related to English content and display English text data (2410) corresponding to original audio data received through the audio service. In one embodiment, the electronic device (200) may receive the audio service from beginning to end through a foreground operation, and may cache original audio data and translated audio data (e.g., Korean audio data) corresponding to the audio service, as well as the corresponding text data.

[0276] Referring to FIG. 24B, after receiving the audio service to the end, the electronic device (200) may obtain the original audio data and the translated audio data from the cache memory based on a user input requesting a summary of English content related to the audio service or based on identifying the end of the audio service, process the original audio data and the translated audio data by an AI platform to generate summarized data (e.g., English summary text (2420) and / or Korean summary text (2422)), and display the summarized data. In one embodiment, the summarized data may take various forms, such as at least one of text, audio, or sign language, and may be in a pre-designated or user-selected format.

[0277] In one embodiment, the electronic device (200) may receive original audio data corresponding to at least a portion (e.g., the first portion) of the audio service through a background operation, and cache the original audio data and the corresponding translated audio data, and may receive original audio data corresponding to the remaining portion (e.g., the last portion) of the audio service through a foreground operation, and cache the original audio data and the corresponding translated audio data. In one embodiment, the electronic device (200) may provide (e.g., display) summary data corresponding to the cached original audio data and the translated audio data corresponding to the background operation to a user while receiving the audio service (e.g., the last portion) or after the audio service is terminated. In one embodiment, the original audio data and / or the translated audio data may be displayed together with or instead of the summary data. In one embodiment, the electronic device (200) may read the cached original audio data and the translated audio data corresponding to the background operation based on a flag among data stored in the cache memory, and process the read audio data by an AI platform to generate the summary data.

[0278] According to an exemplary embodiment, a method for controlling an electronic device (e.g., a host device or a portable terminal) may include an operation in which the electronic device connects a wireless communication link with a wearable device, receives a first audio control signal broadcast from an external electronic device, configures a screen for audio selection using at least a part of the first audio control signal and displays the screen on a display, selects one audio from the at least one audio based on a first input of a user, and transmits a second audio control signal related to the selected audio to the connected wearable device through the wireless communication link, so that the wearable device receives and plays the selected audio broadcast from the external device, and provides content related to the selected audio to the user.

[0279] In one embodiment, the operation of providing the user with content related to the selected audio may further include an operation of the electronic device detecting that a setting language of the selected audio is different from a setting language of the electronic device and displaying a translation-related user selection screen on the display, and an operation of receiving the selected audio broadcast from the external electronic device in response to a second input of the user, translating the selected audio to generate translated audio, and transmitting the translated audio to the wearable device via the wireless communication link.

[0280] In one embodiment, the method may further include controlling, by the electronic device, the wearable device to play the selected audio broadcast from the external electronic device and the translated audio in synchronization.

[0281] In one embodiment, the operation of the electronic device detecting that the setting language of the selected audio is different from the setting language of the electronic device may include the operation of checking information related to the setting language of the selected audio from at least one audio-related control signal received by the electronic device and comparing the checked information with the setting language of the electronic device.

[0282] In one embodiment, the operation of the electronic device detecting that the setting language of the selected audio is different from the setting language of the electronic device may be performed based on a control-related signal received by the electronic device from the wearable device.

[0283] In one embodiment, the operation of the electronic device detecting that the setting language of the selected audio is different from the setting language of the electronic device may include the operation of the electronic device receiving the selected audio broadcast from the external electronic device, confirming the language of the received audio, and comparing the confirmed language with the setting language of the electronic device.

[0284] In one embodiment, the method may further include broadcasting the translated audio so that it can be received by a third electronic device.

[0285] In one embodiment, the broadcasting operation may include transmitting the translated audio by having the electronic device act as a BIS source.

[0286] In one embodiment, the method may further include generating text corresponding to the translation audio based on a change in audio output properties by a third input of the user while the translation audio is being played in synchronization, and displaying the generated text on at least a portion of the display.

[0287] In one embodiment, changing the audio output properties may include adjusting the size of the audio volume.

[0288] In one embodiment, changing the audio output properties may include activating a mute setting.

[0289] In one embodiment, the translation-related user selection screen may be displayed together with the audio selection screen.

[0290] In one embodiment, the wireless communication link may be a Bluetooth (BT) based link.

[0291] In one embodiment, the audio-related control signal may include at least some of the information associated with the BIS, or EA / PA information.

[0292] In one embodiment, the information associated with the BIS may include information for BIS synchronization.

[0293] In one embodiment, the audio-related control signal may include audio content-related information.

[0294] In one embodiment, the audio content related information may include language information.

[0295] In one embodiment, the operation of providing the user with content related to the selected audio may include an operation in which the electronic device detects that a setting language of the selected audio is different from a setting language of the electronic device, and displays a translation-related user selection screen on the display, and may further include an operation in which the electronic device receives the selected audio broadcast from the external electronic device in response to a second input of the user, generates a translation text by translating the selected audio, and displays the translation text and at least a part of information related to the translation text on at least a part of the display in synchronization with the selected audio played on the wearable device.

[0296] In one embodiment, the information related to the translated text may include at least one of additional image, video, or text information generated or retrieved based on the translated text.

[0297] An electronic device (200) according to one embodiment may include at least one processor (120) including a communication circuit (192) configured to support Bluetooth communication, a memory (130) for storing instructions, and a processing circuit functionally, directly or indirectly, connected to the communication circuit and the memory. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: receive synchronization information related to reception of a broadcast isochronous stream (BIS) service from a source electronic device (400) through the communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: transmit the synchronization information to an external electronic device (202, 204) through the communication circuit, such that the external electronic device may receive audio data broadcast from the source electronic device by synchronizing with the source electronic device based on the synchronization information. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: receive first audio data for the BIS service broadcast from the source electronic device via the communication circuitry. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: translate the first audio data into second audio data expressed in the second language based on identifying that the first audio data is expressed in a first language and that the first language is different from a designated second language. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: establish a wireless communication link for audio transmission with the external electronic device via the communication circuitry.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: transmit second audio data to the external electronic device via the wireless communication link, thereby causing the external electronic device to output the second audio data.

[0298] In one embodiment, the instructions may cause the electronic device to identify that the first audio data is expressed in the first language based on at least one of broadcast isochronous stream (BIS) related information received at a time indicated by the synchronization information or a language identification (LID) result for the first audio data, and to compare the first language with the second language, which is a set default language of the electronic device or a language selected by a first user input, and to determine that the first language is different from the second language.

[0299] In one embodiment, the instructions may cause the electronic device to generate text data expressed in the second language corresponding to the second audio data, and to display the text data through a display (160) of the electronic device so as to be synchronized with the second audio data output from the external electronic device.

[0300] In one embodiment, the instructions may cause the electronic device to generate the text data based on receiving a second user input that changes an audio output setting associated with the external electronic device, wherein the change in the audio output setting comprises at least one of adjusting audio volume or activating a mute setting.

[0301] In one embodiment, the instructions may cause the electronic device to display information related to the text data together with the text data. The information related to the text data may include at least one of an image, a video, or a character generated or searched based on the text data. In an example, the instructions may cause the electronic device to transmit control information to the external electronic device, the control information instructing the external electronic device to output the second audio data together with audio data directly received from the source electronic device, or to output the second audio data instead of audio data directly received from the source electronic device.

[0302] In one embodiment, the instructions may cause the electronic device to display a translation language selection user interface (UI) for selecting a translation into the second language based on identifying that the first language is different from the second language.

[0303] In one embodiment, the synchronization information may include at least one of control information, extend advertising (EA) information, and periodic advertising (PA) information related to at least one broadcast isochronous stream (BIS) through which the first audio data is broadcast.

[0304] In one embodiment, the wireless communication link may include at least one connected isochronous stream (CIS). In one embodiment, the instructions may cause the electronic device to generate CIS data packets including control information and the second audio data for use in synchronizing the second audio data with the first audio data, and transmit the CIS data packets to the external electronic device via the at least one CIS.

[0305] In one embodiment, the instructions may cause the electronic device to act as a BIS source to broadcast BIS data packets containing the second audio data, such that at least one first external electronic device (2000) receives the BIS data packets.

[0306] In one embodiment, the instructions may cause the electronic device to translate the first audio data into the second audio data via a cloud-based AI translation algorithm or an on-device AI translation algorithm.

[0307] In one embodiment, a non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs, when individually or collectively executed by at least one processor (120), cause an electronic device (200) to: receive synchronization information related to reception of a BIS (broadcast isochronous stream) service from a source electronic device (400), transmit the synchronization information to an external electronic device (202, 204), so that the external electronic device can receive audio data broadcast from the source electronic device by synchronizing with the source electronic device based on the synchronization information; receive first audio data for the BIS service broadcast from the source electronic device, identify that the first audio data is expressed in a first language, and translate the first audio data into second audio data expressed in the second language based on identifying that the first language is different from a designated second language; establish a wireless communication link for audio transmission with the external electronic device, and transmit second audio data to the external electronic device via the wireless communication link, so that the external electronic device can receive the second audio data. It may contain instructions that cause data to be output.

[0308] In one embodiment, the instructions may cause the electronic device to identify that the first audio data is expressed in the first language based on at least one of broadcast isochronous stream (BIS) related information received at a time indicated by the synchronization information or a language identification (LID) result for the first audio data, and to compare the first language with the second language, which is a set default language of the electronic device or a language selected by a first user input, and to determine that the first language is different from the second language.

[0309] In one embodiment, the instructions may cause the electronic device to generate text data expressed in the second language corresponding to the second audio data, and to display the text data through a display (160) of the electronic device so as to be synchronized with the second audio data output from the external electronic device.

[0310] In one embodiment, the instructions may cause the electronic device to generate the text data based on receiving a second user input that changes an audio output setting associated with the external electronic device, wherein the change in the audio output setting may include at least one of adjusting audio volume or activating a mute setting.

[0311] In an embodiment, the instructions may cause the electronic device to display information related to the text data together with the text data, wherein the information related to the text data may include at least one of an image, a video, or a character generated or searched based on the text data.

[0312] In one embodiment, the instructions may cause the electronic device to transmit control information to the external electronic device that instructs the external electronic device to output the second audio data together with audio data received directly from the source electronic device, or to output the second audio data instead of audio data received directly from the source electronic device.

[0313] In one embodiment, the instructions may cause the electronic device to display a translation language selection UI for selecting a translation into the second language based on identifying that the first language is different from the second language.

[0314] In one embodiment, the synchronization information may include at least one of control information, extend advertising (EA) information, and periodic advertising (PA) information related to at least one broadcast isochronous stream (BIS) through which the first audio data is broadcast.

[0315] In one embodiment, the wireless communication link may include at least one connected isochronous stream (CIS). In one embodiment, the instructions may cause the electronic device to generate CIS data packets including control information and the second audio data for use in synchronizing the second audio data with the first audio data, and transmit the CIS data packets to the external electronic device via the at least one CIS.

[0316] In one embodiment, the instructions may cause the electronic device to act as a BIS source to broadcast BIS data packets containing the second audio data, such that at least one first external electronic device (2000) receives the BIS data packets.

[0317] Electronic devices according to exemplary embodiments may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to exemplary embodiments are not limited to the aforementioned devices.

[0318] The exemplary embodiments and terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to encompass various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly dictates otherwise. In this document, each of the phrases "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or via a third component. Thus, for example, "connected" as used herein can include both direct and indirect connections.

[0319] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC). Therefore, each "module" herein may include a circuit.

[0320] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0321] According to exemplary embodiments, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0322] Each embodiment of the present disclosure may be used in combination with any other embodiment(s) described herein.

[0323] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (200), A communication circuit (192) configured to support Bluetooth communication; Memory (130) for storing instructions; and At least one processor (120) including a processing circuit functionally connected to the communication circuit and the memory, wherein the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Receive synchronization information related to reception of a BIS (broadcast isochronous stream) service from a source electronic device (400) through the communication circuit, By transmitting the synchronization information to an external electronic device (202, 204) through the communication circuit, the external electronic device can receive audio data broadcast from the source electronic device by synchronizing with the source electronic device based on the synchronization information, Receiving first audio data for the BIS service broadcast from the source electronic device through the communication circuit, The first audio data is expressed in a first language, and the first language is translated into second audio data expressed in the second language based on identifying that the first language is different from a specified second language, An electronic device that transmits the second audio data to the external electronic device through the communication circuit, thereby enabling the external electronic device to output the second audio data.

2. In the first paragraph, the instructions cause the electronic device to: Identifying that the first audio data is expressed in the first language based on at least one of BIS (broadcast isochronous stream) related information received at a time indicated by the synchronization information or a language identification (LID) result for the first audio data, An electronic device that compares the first language with the second language, which is a default language set by the electronic device and / or a language selected by a first user input, and determines that the first language is different from the second language.

3. In the first or second paragraph, the instructions cause the electronic device to: Generating text data expressed in the second language corresponding to the second audio data based on receiving at least one of a specified user setting, a user input requesting a text service, or a second user input changing an audio output setting associated with the external electronic device; Display the text data through the display (160) of the electronic device so as to be synchronized with the second audio data output from the external electronic device, An electronic device wherein changing the above audio output settings comprises at least one of adjusting the audio volume or activating the mute setting.

4. In the third paragraph, the instructions cause the electronic device to: Display information related to the above text data together with the above text data, An electronic device comprising information related to the text data, at least one of an image, a video, and / or a character generated or searched based on the text data.

5. In any one of paragraphs 1 to 4, the instructions cause the electronic device to: Cache the first audio data and the second audio data corresponding to a specified time interval, Generating summary data corresponding to the cached data based on an AI algorithm, wherein the summary data includes audio data and / or text data expressed in the first language and / or the second language, An electronic device that provides the user with the above summary data based on specified user settings or user input.

6. In any one of paragraphs 1 to 5, the instructions cause the electronic device to: An electronic device that transmits control information to the external electronic device to instruct the external electronic device to output the second audio data together with audio data received directly from the source electronic device, and / or to output the second audio data instead of audio data received directly from the source electronic device.

7. In any one of paragraphs 1 to 6, the instructions cause the electronic device to: An electronic device that displays a translation language selection UI (user interface) for selecting a translation into the second language based on identifying that the first language is different from the second language.

8. In any one of paragraphs 1 to 7, the synchronization information is: An electronic device comprising at least one of control information, extend advertising (EA) information, and / or periodic advertising (PA) information related to at least one broadcast isochronous stream (BIS) in which the first audio data is broadcast.

9. In any one of paragraphs 1 to 8, the instructions cause the electronic device to: Establishing at least one CIS (connected isochronous stream) for audio transmission with the external electronic device through the communication circuit, Generating CIS data packets including control information used to synchronize the second audio data with the first audio data and the second audio data, An electronic device that transmits the CIS data packets to the external electronic device via the at least one CIS.

10. In any one of paragraphs 1 to 9, the instructions cause the electronic device to: An electronic device that acts as a BIS source, thereby broadcasting BIS data packets containing the second audio data, so that at least one first external electronic device (2000) can receive the BIS data packets.

11. In any one of paragraphs 1 to 10, the instructions cause the electronic device to: An electronic device that translates said first audio data into said second audio data using at least a cloud-based AI translation algorithm and / or an on-device AI translation algorithm.

12. In a non-transitory computer-readable storage medium storing one or more programs, the one or more programs, when individually or collectively executed by at least one processor (120), cause an electronic device (200) to: Receive synchronization information related to reception of a BIS (broadcast isochronous stream) service from a source electronic device (400), By transmitting the above synchronization information to an external electronic device (202, 204), the external electronic device can receive audio data broadcast from the source electronic device by synchronizing with the source electronic device based on the synchronization information, Receive first audio data for the BIS service broadcast from the source electronic device, The first audio data is expressed in a first language, and the first language is translated into second audio data expressed in the second language based on identifying that the first language is different from a specified second language, A storage medium including instructions for transmitting the second audio data to the external electronic device, thereby enabling the external electronic device to output the second audio data.

13. In the 12th paragraph, the instructions cause the electronic device to: Identifying that the first audio data is expressed in the first language based on at least one of BIS (broadcast isochronous stream) related information received at a time indicated by the synchronization information or a language identification (LID) result for the first audio data, A storage medium that compares the first language with the second language, which is a default language set by the electronic device and / or a language selected by a first user input, and determines that the first language is different from the second language.

14. In the 12th or 13th paragraph, the instructions cause the electronic device to: Generating text data in the second language corresponding to the second audio data based on receiving at least one of a specified user setting, a user input requesting a text service, or a second user input changing an audio output setting associated with the external electronic device; A storage medium that displays the text data through a display (160) of the electronic device so as to be synchronized with the second audio data output from the external electronic device, and wherein changing the audio output setting includes at least one of adjusting the audio volume or activating the mute setting.

15. In any one of paragraphs 12 to 14, the instructions cause the electronic device to: A storage medium that displays information related to the text data together with the text data, wherein the information related to the text data includes at least one of an image, a video, and / or a character generated or searched based on the text data.

Images