Electronic device and method for switching audio path

Abstract

This electronic device may comprise: a memory that stores instructions; a first communication circuit; a second communication circuit that is different from the first communication circuit; and at least one processor. The instructions may, when executed individually or collectively by the at least one processor, cause the electronic device to: establish a first connection, via the first communication circuit, with a wearable device that receives audio information; in the state in which the first connection is established, establish a second connection, via the second communication circuit, with an external electronic device identified from among one or more external electronic devices for screen mirroring; transmit, to the external electronic device, a message including address information of the wearable device used in the first connection, on the basis of identifying that the wearable device is worn by a user; and receive, from the external electronic device, a message including information indicating that a third connection between the external electronic device and the wearable device is established.

Description

Electronic device and method for switching audio paths

[0001] The descriptions below relate to electronic devices and methods for switching audio paths.

[0002] An electronic device may be connected to other electronic devices. For example, the electronic device may be connected to a wearable device that outputs audio information. For example, the audio information may be provided from the electronic device. Furthermore, the electronic device may be connected to an external electronic device to share a screen displayed on the electronic device. For example, information regarding the screen may be provided from the electronic device to the external electronic device.

[0003] An electronic device may include a first communication circuit. The electronic device may include a memory that stores instructions and includes one or more storage media. The electronic device may include a second communication circuit that is different from the first communication circuit. The electronic device may include at least one processor that includes a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to establish a first connection with a wearable device that receives audio information through the first communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to establish a second connection with an external electronic device identified among one or more external electronic devices for screen mirroring, through the second communication circuit, while the first connection is established. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to transmit, to the external electronic device, a message comprising address information of the wearable device used in the first connection based on identifying that the wearable device is worn by a user. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive, from the external electronic device, a message comprising information indicating that a third connection is established between the external electronic device and the wearable device.

[0004] A method performed by an electronic device may include establishing a first connection through a first communication circuit of a wearable device that receives audio information. The method may include establishing a second connection through a second communication circuit of the electronic device with an external electronic device identified from among one or more external electronic devices for screen mirroring while the first connection is established. The method may include transmitting a message including address information of the wearable device used in the first connection to the external electronic device based on identifying that the wearable device is worn by a user. The method may include receiving a message including information indicating that a third connection is established between the external electronic device and the wearable device from the external electronic device.

[0005] A non-transitory computer-readable storage medium may store one or more programs, which when individually or collectively executed by at least one processor of an electronic device including a first communication circuit and a second communication circuit different from the first communication circuit, include instructions that cause the electronic device to establish a first connection with a wearable device that receives audio information through the first communication circuit. The non-transitory computer-readable storage medium may store one or more programs, which when individually or collectively executed by the at least one processor, include instructions that cause the electronic device to establish a second connection with an external electronic device identified among one or more external electronic devices for screen mirroring through the second communication circuit, while the first connection is established. The non-transitory computer-readable storage medium may store one or more programs comprising instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to transmit, to the external electronic device, a message comprising address information of the wearable device used in the first connection based on identifying that the wearable device is worn by a user. The non-transitory computer-readable storage medium may store one or more programs comprising instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to receive, from the external electronic device, a message comprising information indicating that a third connection is established between the external electronic device and the wearable device.

[0006] An electronic device may include a first communication circuit. The electronic device may include a memory that stores instructions and includes one or more storage media. The electronic device may include a second communication circuit that is different from the first communication circuit. The electronic device may include at least one processor that includes a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to establish a first connection with an external electronic device for screen mirroring through the first communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive, from the external electronic device through the first communication circuit, a message that includes address information used in a second connection between a wearable device worn by a user and the external electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to establish a second connection with the wearable device identified based on the message including the address information, via the second communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to transmit, to the external electronic device, a message including information indicating that the second connection is established.

[0007] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0008] FIGS. 2A and 2B illustrate examples of an electronic device connected to a wearable device outputting audio information establishing a connection with an external electronic device for screen mirroring.

[0009] FIG. 3 illustrates an example block diagram of the functional configuration of each of an electronic device, a wearable device, and an external electronic device.

[0010] Figure 4 illustrates an example of how to switch audio paths in conjunction with screen mirroring.

[0011] Figure 5 illustrates an example of an operational flow for how an electronic device switches an audio path in conjunction with screen mirroring.

[0012] Figure 6 illustrates an example of how to perform control over media while screen mirroring is performed.

[0013] FIG. 7 illustrates an example of an operational flow for how an electronic device performs control over media while screen mirroring is performed.

[0014] FIG. 8A illustrates an example of how an electronic device connects to a wearable device in response to a pause in screen mirroring.

[0015] FIG. 8B illustrates an example of an operational flow for how an electronic device connects to a wearable device in response to a pause in screen mirroring.

[0016] FIG. 9A illustrates an example of how an electronic device connects to a wearable device in response to identifying an incoming voice call.

[0017] FIG. 9B illustrates an example of an operational flow for a method in which an electronic device connects with a wearable device in response to identifying an incoming voice call.

[0018] FIG. 10 illustrates an example of an operational flow for how an electronic device establishes a connection for screen mirroring and switches an audio path in conjunction with screen mirroring.

[0019] The terms used in this disclosure are used only to describe specific embodiments and may not be intended to limit the scope of other embodiments. The singular expression may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by those of ordinary skill in the art described in this disclosure. Terms defined in general dictionaries among the terms used in this disclosure may be interpreted as having the same or similar meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined in this disclosure. In some cases, even if a term is defined in this disclosure, it cannot be interpreted to exclude embodiments of the present disclosure.

[0020] The various embodiments of the present disclosure described below illustrate a hardware-based approach as an example. However, since the various embodiments of the present disclosure include techniques utilizing both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

[0021] In addition, in the present disclosure, expressions such as "more than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled. However, this is merely a description for expressing an example and does not exclude descriptions such as "more than" or "less than." Conditions described as "more than" may be replaced with "more than," conditions described as "less than," and conditions described as "more than and less than" may be replaced with "more than and less than." In addition, hereinafter, "A" to "B" mean at least one of the elements from A (including A) to B (including B).

[0022] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0023] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0024] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0025] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0026] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0027] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0028] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0029] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0030] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0031] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0032] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0033] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0034] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0035] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0036] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0037] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0038] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0039] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, Wi-Fi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0040] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0041] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0042] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0043] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0044] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0045] FIGS. 2A and 2B illustrate examples of an electronic device connected to a wearable device outputting audio information establishing a connection with an external electronic device for screen mirroring.

[0046] FIG. 2A illustrates an example of establishing a connection with an external electronic device (105) for screen mirroring while an electronic device (101) is connected to a wearable device (103) that outputs audio information. For example, the wearable device (103) can receive the audio information and output the received audio information.

[0047] Referring to FIG. 2A, the electronic device (101) can establish a connection (220) with a wearable device (103) that outputs the audio information. For example, the electronic device (101) can establish a connection (220) with the wearable device (103) based on a first communication circuit included in the electronic device (101). For example, the first communication circuit can include a module that provides a first communication scheme. For example, the first communication scheme can include short-range wireless communication including BT (Bluetooth) or BLE (Bluetooth low energy). Hereinafter, the first communication scheme may be referred to as a BT connection scheme. However, the embodiments of the present disclosure are not limited thereto.

[0048] For example, the electronic device (101) may provide the audio information to the wearable device (103) within a state in which a connection (220) is established. Accordingly, the wearable device (103) may output the audio information through an output device. For example, the wearable device (103) may include an electronic device that can be worn on a body part of the user (200). For example, the body part may include a head part or an ear. However, the embodiments of the present disclosure are not limited thereto. In addition, the wearable device (103) may include an electronic device that outputs the audio information. For example, the wearable device (103) may include a TWS (true wireless stereo) or XR (extended reality) device. Hereinafter, the wearable device (103) may be referred to as an audio output device, a pairing device, or a second external electronic device.

[0049] For example, the electronic device (101) can play media while a connection (220) is established. For example, the media can include a moving picture including video information and audio information. While playing the media, the electronic device (101) can provide audio information about the media through a wearable device (103) with which the connection (220) is established. The wearable device (103) can provide the audio information to the user (200).

[0050] Referring to FIG. 2A, the electronic device (101) can establish a connection (210) with an external electronic device (105) for screen mirroring while the connection (220) is established. For example, the electronic device (101) can establish a connection (210) with the external electronic device (105) based on a second communication circuit included in the electronic device (101). For example, the second communication circuit may be different from the first communication circuit. For example, the second communication circuit may include a module that provides a second communication technique different from the first communication technique. For example, the second communication technique may include short-range wireless communication including Wi-Fi (wireless fidelity) or Wi-Fi direct. Hereinafter, the second communication technique may be referred to as a Wi-Fi connection technique. However, the embodiments of the present disclosure are not limited thereto. The above screen mirroring may refer to a technology of providing the media played on the electronic device (101) to an external electronic device (105). For example, the above screen mirroring may be referred to as real-time streaming, miracast, mirroring, mirroring mode, mirroring function, wireless screen sharing, screen sharing, or screen sharing mode.

[0051] For example, the electronic device (101) may provide data for performing the screen mirroring to the external electronic device (105) within a state in which the connection (210) is established. For example, the data may include the video information and the audio information of the media. Accordingly, the external electronic device (105) may provide the media through the display and output devices of the external electronic device (105). For example, the external electronic device (105) may include the display for displaying the video information of the media and the output device for outputting the audio information of the media. However, the embodiments of the present disclosure are not limited thereto. For example, the external electronic device (105) may also include the display among the display and the output device.

[0052] As described above, the electronic device (101) may establish a connection (210) with an external electronic device (105) for screen mirroring while a connection (220) is established with a wearable device (103) worn by a user (200). At this time, in response to the establishment of the connection (210), the audio information of the media may be output through the external electronic device (105) rather than through the wearable device (103). This is because the audio output policy of the electronic device (101) is set to output the audio information through the electronic device (e.g., the external electronic device (105)) to which the electronic device (101) was last connected. Since the connection (210) for screen mirroring is performed later than the connection (220), the external electronic device (105), not the wearable device (103), may output the audio information. That is, while the user (200) is receiving the audio information through the wearable device (103), the user (200) may not be provided with the audio information through the wearable device (103) as the connection (210) is established. In order to receive the audio information through the wearable device (103) according to the audio output policy, the user (200) may re-establish the connection (220) between the electronic device (101) and the wearable device (103) after the connection (210) is established. However, in this case, the synchronization (i.e., asynchronous) between the audio information played through the wearable device (103) and the video information played through the external electronic device (105) may be misaligned due to the processing time (or latency) required for the external electronic device (105) to play the media.

[0053] In one example, the user (200) can perform control on the electronic device (101) based on a gesture (e.g., tap, press) made to the wearable device (103) within a state in which a connection (220) is established. For example, the control can include playing, pausing, playing next / previous, or adjusting the volume of media. However, after the connection (220) is established, within the state in which the connection (210) is established, the user (200) can establish a connection between the external electronic device (105) and the wearable device (103) to listen to the audio information through the wearable device (103). However, in this case, the subject providing the media is an electronic device (101), and the target to which the wearable device (103) is connected is an external electronic device (105), so control of the electronic device (101) (or the media) based on the gesture for the wearable device (103) may not be performed.

[0054] FIG. 2b illustrates an example in which a connection is established between a wearable device (103) and an external electronic device (105) after the electronic device (101) establishes a connection with the external electronic device (105) for screen mirroring.

[0055] Referring to FIG. 2b, an example is shown in which, after a connection (210) for screen mirroring is established, a connection (230) is performed through information provided by the electronic device (101) during the connection (210) process (e.g., address information of a wearable device (103) used in the connection (220).

[0056] According to one embodiment, the electronic device (101) may provide the information to an external electronic device (105) while establishing a connection (210). The external electronic device (105) can identify the wearable device (103) based on the above information (e.g., address information of the wearable device (103), device information of the wearable device (103), etc.) and establish a connection (230). The electronic device (101) can disconnect the connection (220) based on identifying that the connection (230) is established. While performing the screen mirroring, the electronic device (101) can provide data for media (the video information and audio information) to the external electronic device (105). In addition, the external electronic device (105) can provide audio information to the wearable device (103). The external electronic device (105) can display a screen based on the video information, and the wearable device (103) can output audio information.

[0057] Hereinafter, the electronic device and method according to the embodiments of the present disclosure can provide an automatic connection between the wearable device (103) and the external electronic device (105) to maintain the user experience of the user (200) when attempting screen mirroring while the wearable device (103) is connected to the electronic device (101). Accordingly, the user (200) can continuously listen to audio information through the wearable device (103) being worn, and can watch video information through the external electronic device (105) having a relatively wide screen. In addition, based on the connection, the user (200) can perform control on the electronic device (101) (or the media) using the gesture for the wearable device (103). Accordingly, even if the connection target of the wearable device (103) is switched from the electronic device (101) to the external electronic device (105), the user (200) can be provided with the same user experience. In addition, the electronic device and method according to embodiments of the present disclosure can provide an automatic connection between the electronic device (101) and the wearable device (103) when a specific event occurs while performing the screen mirroring using the connection between the wearable device (103) and the external electronic device (105). According to one embodiment, the specific event can include a pause (or stop) of the screen mirroring or receiving a voice call. Accordingly, the user (200) can be provided with a continuous user experience as if the connection between the electronic device (101) and the wearable device (103) is ongoing. For example, the automatic connection can indicate switching for an audio path. For example, the switching for the audio path can be referred to as pair switching, paired device switching, or audio path switching.

[0058] FIG. 3 illustrates an example block diagram of the functional configuration of each of an electronic device, a wearable device, and an external electronic device.

[0059] FIG. 3 illustrates an example of an electronic device (101), a wearable device (103) connected to the electronic device (101), and an external electronic device (105). FIG. 3 illustrates a case where the electronic device (101), the wearable device (103), and the external electronic device (105) are connected, but the embodiments of the present disclosure are not limited thereto. For example, the electronic device (101) may be connected to multiple wearable devices. Alternatively, for example, the external electronic device (105) may be connected to other electronic devices. The electronic device (101) of FIG. 3 may represent an example of the electronic device (101) of FIG. 1.

[0060] Referring to FIG. 3, an exemplary situation is illustrated in which an electronic device (101), a wearable device (103), and an external electronic device (105) are connected to each other based on a wired network and / or a wireless network. For example, the wired network may include a network such as the Internet, a local area network (LAN), a wide area network (WAN), or a combination thereof. For example, the wireless network may include a network such as long term evolution (LTE), 5g new radio (NR), wireless fidelity (Wi-Fi), Zigbee, near field communication (NFC), Bluetooth, Bluetooth low-energy (BLE), or a combination thereof. Although the electronic device (101), the wearable device (103), and the external electronic device (105) are illustrated as being directly connected, the electronic device (101), the wearable device (103), and the external electronic device (105) may be indirectly connected via one or more routers and / or access points (APs). In other words, the electronic device (101) is exemplified as being directly connected to the second communication circuit (355) of the external electronic device (105) via the second communication circuit (315), but the embodiments of the present disclosure are not limited thereto.

[0061] Referring to FIG. 3, according to one embodiment, an electronic device (101) may include at least one of a processor (311), a first communication circuit (313), a second communication circuit (315), or a memory (317). According to one embodiment, the processor (311), the first communication circuit (313), the second communication circuit (315), and the memory (317) may be electrically and / or operably coupled with each other by a communication bus. Hereinafter, operably coupled hardware components may mean that a direct connection or an indirect connection is established between the hardware components, either wired or wireless, such that a second hardware component is controlled by a first hardware component among the hardware components. Although illustrated based on different blocks, the embodiment is not limited thereto, and some of the hardware components illustrated in FIG. 3 (at least a portion of the processor (311), the first communication circuit (313), the second communication circuit (315), and the memory (317)) may be included in a single integrated circuit such as a system on a chip (SoC). The type and / or number of hardware components included in the electronic device (101) is not limited to those illustrated in FIG. 3. For example, the electronic device (101) may include only some of the hardware components illustrated in FIG. 3.

[0062] According to one embodiment, the processor (311) of the electronic device (101) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), and a field programmable gate array (FPGA). As an example, the hardware component for processing data may include a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing (DSP), and / or a neural processing unit (NPU). The number of processors (311) may be one or more. For example, the processor (311) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core. The processor (311) of FIG. 3 may include at least a part of the processor (120) of FIG. 1.

[0063] For example, the processor (311) may include various processing circuits and / or multiple processors. For example, the term "processor" as used herein, including in the claims, may include various processing circuits including at least one processor, one or more of which may be configured to individually and / or collectively perform the various functions described below in a distributed manner. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform various functions, these terms encompass, for example, and without limitation, situations where one processor performs some of the recited functions and other processor(s) perform other parts of the recited functions, and also situations where one processor may perform all of the recited functions. Additionally, the at least one processor may include a combination of processors that perform the various functions enumerated / disclosed, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform the various functions.

[0064] According to one embodiment, the first communication circuit (313) of the electronic device (101) may include hardware for supporting transmission and / or reception of electrical signals between the electronic device (101) and the wearable device (103). In addition, the second communication circuit (315) of the electronic device (101) may include hardware for supporting transmission and / or reception of electrical signals between the electronic device (101) and an external electronic device (105). For example, the first communication circuit (313) (or the second communication circuit (315)) may include at least one of a modem, an antenna, and an optical / electronic (O / E) converter, for example. For example, the first communication circuit (313) (or the second communication circuit (315)) may support transmission and / or reception of electrical signals based on various types of communication means, such as Ethernet, Bluetooth (BT), Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), 5G new radio (NR), and wireless-fidelity (Wi-Fi). The first communication circuit (313) (or the second communication circuit (315)) of FIG. 3 may include at least a portion of the communication module (190) and / or the antenna module (197) of FIG. 1.

[0065] In one embodiment, the first communication circuit (313) and the second communication circuit (315) may provide different communication techniques. For example, the first communication circuit (313) may include a module providing a first communication scheme. For example, the first communication scheme may include short-range wireless communication including BT (Bluetooth) or BLE (Bluetooth low energy). Hereinafter, the first communication scheme may be referred to as a BT connection technique. For example, the second communication circuit (315) may be different from the first communication circuit (313). For example, the second communication circuit (315) may include a module providing a second communication scheme different from the first communication scheme. For example, the second communication scheme may include short-range wireless communication including Wi-Fi (wireless fidelity) or Wi-Fi direct. Hereinafter, the second communication technique may be referred to as a Wi-Fi connection technique.

[0066] According to one embodiment, the memory (317) of the electronic device (101) may include a hardware component for storing data and / or instructions input to and / or output from the processor (311). The memory (317) may include, for example, a volatile memory such as a random-access memory (RAM), and / or a non-volatile memory such as a read-only memory (ROM). The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disc, and an embedded multimedia card (eMMC). The memory (317) of FIG. 3 may include at least a portion of the memory (130) of FIG. 1.

[0067] Although not illustrated in FIG. 3, the electronic device (101) according to one embodiment may include at least one sensor. For example, the electronic device (101) may include the at least one sensor for identifying a designated event, another designated event, and a user input. For example, the at least one sensor may include an IMU (or IMU sensor), a bio sensor, an image sensor (or a camera), an acoustic sensor (or a microphone (or mic)), a gyro sensor, a gravity sensor, and / or an acceleration sensor. In addition, although not illustrated in FIG. 3, the electronic device (101) according to one embodiment may include an output means for outputting information in a form other than a visualized form. For example, the electronic device (101) may include a speaker for outputting an acoustic signal. For example, the electronic device (101) may include a motor for providing haptic feedback based on vibration.

[0068] Referring to FIG. 3, according to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by a processor (311) of the electronic device (101) may be stored in the memory (317) of the electronic device (101). A set of one or more instructions may be referred to as a program, firmware, an operating system, a process, a routine, a sub-routine, and / or an application. Hereinafter, when an application is installed in the electronic device (e.g., the electronic device (101)), it may mean that one or more instructions provided in the form of an application are stored in the memory (317), and that the one or more applications are stored in a format executable by the processor of the electronic device (e.g., a file having an extension designated by the operating system of the electronic device (101)). According to one embodiment, the electronic device (101) may perform the operations of FIGS. 5, 7, 8b, 9b, and 10 by executing one or more instructions stored in the memory (317).

[0069] Referring to FIG. 3, programs installed in the electronic device (101) may be classified into one of different layers, including an application layer, a framework layer, and / or a hardware abstraction layer (HAL), based on the target. For example, programs designed to target the hardware of the electronic device (101) (e.g., the first communication circuit (313)) may be classified within the hardware abstraction layer. For example, within the framework layer, programs designed to target at least one of the hardware abstraction layer and / or the application layer (e.g., a switching manager) may be classified. Programs classified into the framework layer may provide an executable application programming interface (API) based on other programs. The switching manager may be referred to as an audio path switching manager, a pair switching manager, a paired device switching manager, a switching controller, or a switching control unit. In the above example, an example in which the switching manager is configured as a software program is described, but the embodiments of the present disclosure are not limited thereto. For example, the switching manager may be configured as a combination of hardware and software.

[0070] Referring to FIG. 3, based on the execution of the switching manager, the processor (311) can identify whether the function for switching the audio path of the external electronic device (105) is supported (or capability information). For example, the processor (311) can identify whether the function (e.g., audio path switching function) is supported through the capability information included in the message obtained from the external electronic device (105) and store the capability information in the memory (317). Thereafter, the processor (311) can perform (or request) the audio path switching based on the capability information, based on the execution of the switching manager.

[0071] In addition, for example, based on the execution of the switching manager, the processor (311) can identify the connection status and the wearing status of the wearable device (103). For example, the processor (311) can identify whether the wearable device (103) is connected to the electronic device (101). In addition, for example, based on the execution of the switching manager, the processor (311) can identify whether the wearable device (103) is worn on a body part (e.g., an ear) of the user. According to one embodiment, the wearable device (103) can identify whether the user is wearing the wearable device (103) based on sensing information identified through at least one sensor included in the wearable device (103). For example, the at least one sensor may include a sensor (e.g., a proximity sensor, an acceleration sensor) for identifying the wearing status of the wearable device (103). For example, the processor (311) may identify whether the wearable device (103) is worn on the user's body part based on the sensing information. For example, the worn state may be referred to as a first state. Alternatively, a state in which the wearable device (103) is not worn may be referred to as a second state. For example, the second state may include a case in which the wearable device (103) is located within a case for storing the wearable device (103) with the case open, a case in which the wearable device (103) is located within the case with the case closed, a case in which the wearable device (103) is located outside the case, or a case in which it is not possible to identify whether the wearable device (103) is worn (or an unknown state). The first state and the second state may be defined as values ​​identified based on the execution of the switching manager. The values ​​defining the first state and the second state can be exemplified as shown in the table below.

[0072] [Tag]STATE_WEARING_L =0x0206;STATE_WEARING_R =0x0207;[Value]VALUE_PLACEMENT_UNKNOWN =0x00;VALUE_PLACEMENT_IN_EAR =0x01;VALUE_PLACEMENT_OUTSIDE =0x02;VALUE_PLACEMENT_IN_OPEN_CASE =0x03;VALUE_PLACEMENT_IN_CLOSE_CASE =0x04;

[0073] The tag in the above table may indicate identification information of a plurality of devices included in the wearable device (103). For example, if the tag is L, it may indicate a first device worn on the left ear among the plurality of devices, and if the tag is R, it may indicate a second device worn on the right ear among the plurality of devices. However, the embodiment of the present disclosure is not limited thereto, and if the wearable device (103) is an integrated device (e.g., a headset) worn on both the left and right ears at the same time, the tag may have one value or no value. The value in the above table may indicate a value according to the first state or the second state. The processor (311) may identify the connection state and the wearing state by identifying the tag and the value based on the execution of the switching manager. According to one embodiment, the processor (311) may perform (or request) the audio path switching when the wearable device (103) includes the plurality of devices and at least one of the plurality of devices is in the first state.

[0074] Additionally, for example, based on the execution of the switching manager, the processor (311) may identify a pause (or stop) of screen mirroring. For example, the processor (311) may identify the pause based on at least a portion of the input to the electronic device (101). Furthermore, the processor (311) may identify a resumption of the stopped screen mirroring. Accordingly, the processor (311) may perform (or request) the audio path switching based on the pause or the resumption. Specific details related thereto are described below in FIGS. 8A and 8B.

[0075] In addition, for example, based on the execution of the switching manager, the processor (311) can identify the reception of a voice call. For example, the processor (311) can identify the voice call received through a communication circuit (not shown) of the electronic device (101). For example, the communication circuit may be different from the first communication circuit (313) and the second communication circuit (315). For example, the communication circuit may be used for connection between the electronic device (101) and an external network or base station related to reception of the voice call. The processor (311) can perform reception (or transmission) of the voice call based on the communication circuit. In addition, for example, the processor (311) can identify the termination or rejection of the received voice call. Accordingly, the processor (311) can perform (or request) the audio path switching based on the reception, termination, or rejection of the voice call. Specific details related to this are described in FIGS. 9a and 9b below.

[0076] Additionally, for example, based on the execution of the switching manager, the processor (311) can identify whether the wearable device (103) is connected to the electronic device (101) while the screen mirroring is being performed. For example, the processor (311) can perform (or request) the audio path switching for the wearable device (103) based on identifying that a connection is established between the wearable device (103) and the electronic device (101) while the screen mirroring is being performed.

[0077] In addition, for example, based on the execution of the switching manager, the processor (311) can identify control information and execute a function accordingly. For example, the processor (311) can identify the control information transmitted from the wearable device (103) and execute a function accordingly. For example, the control information may be transmitted directly from the wearable device (103) or transmitted through an external electronic device (105). In addition, for example, the processor (311) may provide a message to the external electronic device (105) for requesting the function identified based on the control information. In addition, in one embodiment, when the control information is transmitted through the external electronic device (105), at least a portion of the control information may not be provided to the processor (311) but may be used to execute a specified function within the external electronic device (105).

[0078] For example, the control information may be generated based on a designated gesture. The designated gesture may include a single tap, a double tap, a triple tap, a press, a long press, etc. The function according to the designated gesture may be set for each device (e.g., electronic device (101) or external electronic device (105)) and each software application within the device. For example, the function according to the designated gesture may include volume control, media control, call control, or execution of a voice recognition mode.

[0079] For example, when the electronic device (101) establishes a first connection (321) with the wearable device (103), and a second connection (322) for screen mirroring is established with the external electronic device (105), audio information is output through the external electronic device (105). However, the electronic device (101) according to embodiments of the present disclosure can perform (or request) the audio path switching (e.g., switching from the external electronic device (105) to the wearable device (103)) by controlling through the switching manager, even if the second connection (322) is established within the state in which the first connection (321) is established. Accordingly, the electronic device (101) can cause (or induce) the wearable device (103) to output the audio information.

[0080] According to one embodiment, the wearable device (103) may include at least one of a processor (331), a communication circuit (333), an output device (335), and a memory (337). According to one embodiment, the processor (331), the communication circuit (333), the output device (335), or the memory (337) may be operatively, functionally, and / or electrically connected by an electronic component, such as a communication bus. The type and / or number of hardware components included in the wearable device (103) is not limited to those illustrated in FIG. 3. For example, the wearable device (103) may include only some of the hardware components illustrated in FIG. 3. For example, the processor (331) may correspond to the processor (311) of the electronic device (101). For example, the communication circuit (333) may correspond to the first communication circuit (313) of the electronic device (101). For example, the memory (337) may correspond to the memory (317) of the electronic device (101). To reduce repetition of explanation, redundant descriptions may be omitted. According to one embodiment, the output device (335) may include a device for outputting audio information provided from an external source. For example, the output device (335) may include a speaker that outputs the audio information. For example, the wearable device (103) may include an electronic device that can be worn on a body part of a user. For example, the body part may include a head part or an ear. However, the embodiments of the present disclosure are not limited thereto. In addition, the wearable device (103) may include an electronic device that outputs the audio information.For example, the wearable device (103) may include a TWS (true wireless stereo) or XR (extended reality) device. Hereinafter, the wearable device (103) may be referred to as an audio output device, a pairing device, or a second external electronic device.

[0081] According to one embodiment, the external electronic device (105) may include at least one of a processor (351), a first communication circuit (353), a second communication circuit (355), a display (357), and a memory (339). According to one embodiment, the processor (351), the first communication circuit (353), the second communication circuit (355), the display (357), or the memory (339) may be operatively, functionally, and / or electrically connected to each other by an electronic component such as a communication bus. The type and / or number of hardware components included in the external electronic device (105) is not limited to those illustrated in FIG. 3. For example, the external electronic device (105) may include only some of the hardware components illustrated in FIG. 3. For example, the processor (351) may correspond to the processor (311) of the electronic device (101). For example, the first communication circuit (353) may correspond to the first communication circuit (313) of the electronic device (101). For example, the second communication circuit (355) may correspond to the second communication circuit (315) of the electronic device (101). For example, the memory (359) may correspond to the memory (317) of the electronic device (101). To reduce repetition of description, redundant descriptions may be omitted. According to one embodiment, the display (357) may include a device for outputting video information provided from an external source. For example, the video information may be provided from the electronic device (101). For example, the electronic device (101) may provide data including video information and audio information of media to the external electronic device (105). For example, the electronic device (101) may generate the data by performing encoding on the video information and the audio information of the media.The electronic device (101) can provide the encoded data to the external electronic device (105). For example, the external electronic device (105) can obtain the video information and the audio information by receiving the encoded data from the electronic device (101) and decoding the received encoded data. For example, the external electronic device (105) can display a screen (or visual information) rendered based on the video information through the display (357). Although not illustrated in FIG. 3, the external electronic device (105) can include an output device. For example, the output device can include a device for outputting the audio information. For example, the output device can include a speaker that outputs the audio information.

[0082] Referring to FIG. 3, the electronic device (101) can establish a first connection (321) with the wearable device (103). For example, the electronic device (101) can establish the first connection (321) with the wearable device (103) based on the first communication circuit (313). The first connection (321) can be used to provide audio information from the electronic device (101) to the wearable device (103). For example, the electronic device (101) can provide the audio information through the first connection (321). The audio information can represent audio information of media played by the electronic device (101).

[0083] In addition, the electronic device (101) can establish a second connection (322) with the external electronic device (105). For example, the electronic device (101) can establish a second connection (322) with the external electronic device (105) based on the second communication circuit (315). The second connection (322) can be used to perform screen mirroring. It can represent a technology for providing the media played on the electronic device (101) from the external electronic device (105). For example, the electronic device (101) can provide data for performing the screen mirroring to the external electronic device (105) through the second connection (322). For example, the data can include the video information and the audio information of the media.

[0084] According to one embodiment, based on performing the audio path switching, a third connection (323) may be established. For example, the third connection (323) may represent a connection between an external electronic device (105) and a wearable device (103). For example, the external electronic device (105) may establish the third connection (323) with the wearable device (103) via the first communication circuit (353). At this time, the external electronic device (105) may identify the wearable device (103) and establish the third connection (323) based on address information of the wearable device (103) received while establishing the second connection (322). For example, the address information may include address information of the wearable device used by the wearable device to establish the first connection (321). For example, the address information may include a MAC (media access control) address of the wearable device (103) for the first connection (321) between the electronic device (101) and the wearable device. The address information may be referred to as a BT MAC address, a BT address, address information, or BT identification information. Specific details related thereto are described below in FIG. 4.

[0085] With respect to the second connection (322) of FIG. 3, the electronic device (101) may be referred to as a source or server providing the media, and the external electronic device (105) may be referred to as a sync, client, or player playing the media.

[0086] With respect to the first connection (321) and the third connection (323) of FIG. 3, the wearable device (103) may be referred to as a slave that outputs the audio information, and the electronic device (101) or the external electronic device (105) may be referred to as a master. In the present disclosure, the audio path switching for the wearable device (103) may include changing the master from the electronic device (101) to the external electronic device (105).

[0087] Figure 4 illustrates an example of how to switch audio paths in conjunction with screen mirroring.

[0088] The electronic device (101) of FIG. 4 may include the electronic device (101) of FIG. 3. The wearable device (103) of FIG. 4 may include the wearable device (103) of FIG. 3. The external electronic device (105) of FIG. 4 may include the external electronic device (105) of FIG. 3.

[0089] Referring to FIG. 4, in operation (400), a first connection (e.g., the first connection (321) of FIG. 3) between an electronic device (101) and a wearable device (103) may be established. For example, the electronic device (101) may establish the first connection with the wearable device (103) through the first communication circuit (313). For example, the electronic device (101) may broadcast a packet for searching for connectable peripheral devices through the first communication circuit (313). The electronic device (101) may establish the first connection by authenticating the wearable device (103) found based on the packet.

[0090] According to one embodiment, the electronic device (101) may broadcast a packet for searching for the connectable peripheral devices through the first communication circuit (313). For example, when the electronic device (101) attempts the first connection based on the first communication technique (e.g., BT), the electronic device (101) may periodically transmit the packet advertising the electronic device (101) to the peripheral devices. For example, the electronic device (101) may perform the first connection by broadcasting the packet of a specified size (e.g., 31 bytes or less) and receiving a response packet from at least some of the peripheral devices.

[0091] In operation (405), according to one embodiment, the electronic device (101) may identify a target of screen mirroring. For example, the electronic device (101) may identify one or more external electronic devices for screen mirroring. For example, the electronic device (101) may perform discovery based on a signal transmitted through the second communication circuit (313). For example, the discovery may indicate an operation for establishing a second connection (e.g., the second connection (322) of FIG. 3) with the electronic device (101). For example, the electronic device (101) may identify the one or more external electronic devices based on the discovery.

[0092] According to one embodiment, the electronic device (101) may perform the discovery to establish the second connection with the external electronic device (105) via the second communication circuit (313). For example, the second communication circuit (313) may include Wi-Fi Direct, WebRTC (real-time communication), Wi-Fi, or NFC. For example, the electronic device (101) may perform the discovery when using the Wi-Fi Direct technique via the second communication circuit (313). For example, the electronic device (101) may exchange information about the electronic device (101) and information about the one or more external electronic devices when performing the discovery.

[0093] In operation (410), the electronic device (101) and the external electronic device (105) may establish the second connection. For example, the electronic device (101) may establish the second connection with the external electronic device (105) through the second communication circuit (315). For example, the electronic device (101) may identify the external electronic device (105) based on an input from among the one or more external electronic devices. For example, the input may include an input to a portion corresponding to the external electronic device (105) among a screen displaying information about the one or more external electronic devices. For example, the screen may be displayed through a display of the electronic device (101). However, the embodiments of the present disclosure are not limited thereto. For example, the electronic device (101) can identify the most recently (or last) connected external electronic device (105) among the one or more external electronic devices, and establish the second connection with the external electronic device (105).

[0094] Although not illustrated in FIG. 4, the electronic device (101) may perform signaling with an external electronic device (105) after establishing the second connection. For example, the signaling may include an OPTIONS request for the server to return an accept type, a DESCRIBE request including a uniform resource locator (URL), and a SETUP request including information about a transmission point.

[0095] In operation (415), the electronic device (101) may transmit a request for capability information to an external electronic device (105). For example, the electronic device (101) may transmit a message requesting the capability information to the external electronic device (105). For example, the message requesting the capability information may be referred to as an M3 request message or an M3 message. The M3 request message may be included in an RTSP (real-time streaming protocol) message. For example, the M3 message may be used to retrieve (or retrieve) parameter values ​​of a presentation or stream specified based on a uniform resource identifier (URI).

[0096] According to one embodiment, the capability information may include whether the external electronic device (105) supports a function for switching audio paths. The function for switching audio paths may be referred to as an audio path switching function, a pair switching function, a paired device switching function, or a switching function.

[0097] According to one embodiment, the external electronic device (105) can identify whether it supports the switching function. For example, if the switching function is implemented in the external electronic device (105), the external electronic device (105) can identify that it supports the switching function. For example, if it supports the function, the external electronic device (105) can decode the video information and audio information acquired from the electronic device (101) and then provide the re-encoded audio information to the wearable device (103). At this time, the external electronic device (105) may be in a state where a third connection (e.g., the third connection (323) of FIG. 3) has been established with the wearable device (103). Specific examples related to this are described in operations (435) to (455) below.

[0098] In operation (420), the electronic device (101) may receive the capability information from an external electronic device (105). For example, the electronic device (101) may receive a message including the capability information from the external electronic device (105). For example, the message including the capability information may be referred to as an M3 response message or an M3 message. The M3 response message may be included in an RTSP message.

[0099] For example, if the switching function is supported, the capability information may include a specified value (e.g., 1 (enable)). Conversely, if the switching function is not supported, the capability information may include a value different from the specified value (e.g., 0 (disable)).

[0100] In operation (425), the electronic device (101) can identify the wearing state of the wearable device (103). For example, the electronic device (101) can identify whether the wearable device (103) is in a first state or a second state different from the first state. For example, the first state may indicate a state in which the wearable device (103) is worn by the user, and the second state may indicate another state in which the wearable device (103) is not worn by the user.

[0101] According to one embodiment, the electronic device (101) may obtain sensing information from the wearable device (103). For example, the electronic device (101) may receive the sensing information from the wearable device (103) based on the first connection. For example, the sensing information may include a value indicating the first state or the second state identified by the wearable device (103) based on at least one sensor. For specific details related thereto, reference may be made to the contents of Table 1 described above.

[0102] In operation (430), the electronic device (101) may transmit address information to the external electronic device (105). For example, the electronic device (101) may transmit the address information to the external electronic device (105) based on identifying the first state in which the wearable device (103) is worn in operation (425). For example, the electronic device (101) may transmit a message including the address information to the external electronic device (105). For example, the message including the address information may be referred to as an M4 request message or an M4 message. The M4 request message may be included in an RTSP message. For example, the M4 message may be used to request a setting of a parameter value of a presentation or stream specified based on a uniform resource identifier (URI).

[0103] According to one embodiment, the electronic device (101) may transmit the message including the address information and request information for setting the parameter value to the external electronic device (105) based on identifying the first state. Alternatively, the electronic device (101) may transmit the message including the request information for setting the parameter value among the address information and request information for setting the parameter value to the external electronic device (105) based on identifying the second state.

[0104] According to one embodiment, the address information may include address information of the wearable device (103) used by the wearable device (103) to establish the first connection. For example, the address information may include a MAC (media access control) address of the wearable device (103) for the first connection. The address information may be referenced as a BT MAC address, a BT address, address information, or BT identification information. For example, the address information may also include device information of the wearable device (103) (e.g., device name, identifier of the wearable device (103)).

[0105] According to one embodiment, the message including the address information may include multiple pieces of address information. For example, the message may include the address information and other address information. For example, the other address information may include address information of another wearable device paired with the electronic device (101) and worn by the user. For example, the other address information may include, like the address information, the MAC address of the other wearable device for BT connection.

[0106] In operation (435), a third connection (e.g., the third connection (323) of FIG. 3) between the external electronic device (105) and the wearable device (103) may be established. For example, the external electronic device (105) may identify the wearable device (103) based on the address information. The external electronic device (105) may establish the third connection with the identified wearable device (103).

[0107] According to one embodiment, the external electronic device (105) can identify a record or history of being connected (or paired) with the wearable device (103). For example, if there is no history of being connected with the wearable device (103), the external electronic device (105) can display a pop-up for performing pairing with the wearable device (103). The pop-up can be referred to as a user interface. The external electronic device (105) can establish the third connection with the wearable device (103) based on an input to the pop-up. Alternatively, if there is a history of being connected with the wearable device (103), the external electronic device (105) can omit displaying the pop-up and establish the third connection with the wearable device (103).

[0108] In operation (440), the electronic device (101) may disconnect (or release) the first connection. For example, the electronic device (101) may identify the disconnection of the first connection by the wearable device (103) as the third connection between the wearable device (103) and the external electronic device (105) is established.

[0109] According to one embodiment, when the first connection is disconnected, a path (or audio path) for outputting audio information may be switched. For example, before the first connection is disconnected, the audio information may be output through a first audio path connected in the order of the electronic device (101) and the wearable device (103). Conversely, when the first connection is disconnected and the third connection is established, the audio information may be output through a second audio path connected in the order of the electronic device (101), the external electronic device (105), and the wearable device (103). In other words, switching may be performed for the audio path.

[0110] In operation (445), the electronic device (101) may receive connection success information from the external electronic device (105). For example, the external electronic device (105) may transmit a message including the connection success information to the electronic device (101). For example, the message including the connection success information may be included in an RTSP message. For example, the connection success information may include information indicating that the third connection is established.

[0111] According to one embodiment, the electronic device (101) may receive connection failure information from an external electronic device (105). For example, the connection failure information may include information indicating that a connection different from the third connection has been established or that the establishment of the third connection has failed.

[0112] In operation (450), the electronic device (101) may transmit video information and audio information to an external electronic device (105). For example, after receiving the message including the connection success information, the electronic device (101) may perform screen mirroring with the external electronic device (105). For example, while performing the screen mirroring, the electronic device (101) may transmit a message including the video information and the audio information to the external electronic device (105). For example, the electronic device (101) may generate the message including the video information and the audio information by performing encoding on the video information and the audio information of the media. The message including the video information and the audio information may be included in an RTP (real-time transport protocol) message. For example, the RTP message may be used to transmit data including the video information and the audio information. For example, the electronic device (101) can transmit the message including the encoded data to an external electronic device (105).

[0113] In operation (455), the external electronic device (105) can transmit the audio information to the wearable device (103). For example, the external electronic device (105) can transmit the audio information to the wearable device (103) through the third connection while performing the screen mirroring.

[0114] According to one embodiment, the external electronic device (105) can decode the message received from the electronic device (101). For example, the external electronic device (105) can obtain the video information and the audio information based on the decoded message. For example, the external electronic device (101) can transmit a signal including the obtained audio information to the wearable device (103). For example, the signal can be encoded according to a protocol used within the third connection. Alternatively, according to one embodiment, the external electronic device (105) can forward the audio information within the message received from the electronic device (101) to the wearable device (103).

[0115] In operation (460), the electronic device (101) may re-establish the first connection. For example, the electronic device (101) may re-establish the first connection based on identifying a disruption event of the screen mirroring. For example, the disruption event may include a pause (or stop) of the screen mirroring or the reception of a voice call. For example, the electronic device (101) may re-establish the first connection based on identifying the disruption event while the second connection is maintained. At this time, the electronic device (101) may not transmit a message including video and audio information to the external electronic device (105). The operation according to the disruption event is described in detail in FIGS. 8A to 9B below.

[0116] Although not illustrated in FIG. 4, the electronic device (101) may receive a message including connection termination information from the external electronic device (105). For example, the message including the connection termination information may be included in an RTSP message. For example, the connection termination information may include information indicating that the established third connection is terminated. According to one embodiment, the electronic device (101) may attempt to establish the first connection with the wearable device (103) based on receiving the message including the connection termination information. Alternatively, according to one embodiment, when the electronic device (101) disconnects the second connection for screen mirroring with the external electronic device (105), the electronic device (101) may attempt to establish the first connection with the wearable device (103).

[0117] Figure 5 illustrates an example of an operational flow for how an electronic device switches an audio path in conjunction with screen mirroring.

[0118] At least some of the methods of FIG. 5 may be performed by the electronic device (101) of FIG. 3. For example, at least some of the methods may be controlled by the processor (311) of the electronic device (101). In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0119] In operation (500), according to one embodiment, the electronic device (101) can identify one or more external electronic devices for screen mirroring. For example, the electronic device (101) can identify one or more external electronic devices capable of performing screen mirroring.

[0120] In operation (505), according to one embodiment, the electronic device (101) may establish a connection with an external electronic device (e.g., external electronic device (105)) identified based on the input. For example, the electronic device (101) may establish a connection with an external electronic device identified based on the input among one or more external electronic devices. For example, the connection may include a second connection (e.g., second connection (322) of FIG. 3) between the electronic device (101) and a secondary electronic device established via a second communication circuit (315) of the electronic device (101).

[0121] In operation (510), according to one embodiment, the electronic device (101) can identify whether the external electronic device supports a function of switching an audio path.

[0122] According to one embodiment, the electronic device (101) may transmit a request for capability information to the external electronic device. For example, the electronic device (101) may transmit a message requesting the capability information to the external electronic device. For example, the message requesting the capability information may be referred to as an M3 request message or an M3 message. The M3 request message may be included in an RTSP (real-time streaming protocol) message. For example, the M3 message may be used to obtain parameter values ​​of a presentation or stream specified based on a uniform resource identifier (URI).

[0123] In one embodiment, the capability information may include whether the external electronic device supports a function for switching audio paths. The function for switching audio paths may be referred to as an audio path switching function, a pair switching function, a paired device switching function, or a switching function.

[0124] According to one embodiment, the electronic device (101) may receive the capability information from the external electronic device. For example, the electronic device (101) may receive a message including the capability information from the external electronic device. For example, the message including the capability information may be referred to as an M3 response message or an M3 message. The M3 response message may be included in an RTSP message.

[0125] According to one embodiment, the electronic device (101) can identify whether the external electronic device supports the switching function based on a message including capability information. For example, if the switching function is supported, the capability information may include a specified value (e.g., 1 (enable)). Conversely, if the switching function is not supported, the capability information may include a value different from the specified value (e.g., 0 (disable)).

[0126] If the external electronic device supports the switching function in operation (510), the electronic device (101) can perform operation (515). Conversely, if the external electronic device does not support the switching function in operation (510), the electronic device (101) can perform operation (525).

[0127] In operation (515), the electronic device (101) can identify whether it is connected to a wearable device (e.g., wearable device (103)). For example, the electronic device (101) can identify whether the connection between the electronic device (101) and the wearable device is established. In other words, the electronic device (101) can identify whether the wearable device is in a paired state. For example, the connection between the electronic device (101) and the wearable device can include the first connection (e.g., the first connection (321) of FIG. 3) between the electronic device (101) and the wearable device established through the first communication circuit (313) of the electronic device (101).

[0128] If the first connection is established with the wearable device in operation (515), the electronic device (101) can perform operation (520). Conversely, if the first connection is not established with the wearable device in operation (515), the electronic device (101) can perform operation (525).

[0129] In operation (520), the electronic device (101) may identify whether the wearable device is in a first state. For example, the first state may include a state in which the wearable device is worn by a user. Alternatively, another state in which the wearable device is not worn by a user may be referred to as a second state. For example, the second state may include a case in which the wearable device is located within a case for storing the wearable device with the case open, a case in which the wearable device is located within the case with the case closed, a case in which the wearable device is located outside the case, or a case in which it is not possible to identify whether the wearable device is being worn (or an unknown state).

[0130] In operation (520), if the wearable device is in the first state, the electronic device (101) can perform operation (530). Conversely, in operation (520), if the wearable device is in the second state, the electronic device (101) can perform operation (525).

[0131] In operation (525), the electronic device (101) may perform the screen mirroring. For example, if the external electronic device does not support the function in operation (510), the electronic device (101) may perform the screen mirroring. Alternatively, for example, if the electronic device (101) is not connected to the wearable device in operation (520), the electronic device (101) may perform the screen mirroring. Alternatively, for example, the electronic device (101) may transmit a message to the external electronic device, the message including request information for setting parameter values ​​of a presentation or stream specified based on a uniform resource identifier (URI), based on identifying the second state. For example, the message may be referred to as an M4 request message or an M4 message. The M4 request message may be included in an RTSP message.

[0132] For example, the electronic device (101) can obtain information (e.g., setting of the parameter value) for performing screen mirroring with the external electronic device based on the message. Accordingly, the electronic device (101) can perform the screen mirroring with the external electronic device. In this case, the video information and audio information provided from the electronic device (101) to the external electronic device can be output by the external electronic device. For example, the external electronic device can output the video information and the audio information through a display (e.g., the display (357) of FIG. 3) and an output device.

[0133] In operation (530), the electronic device (101) may transmit address information of the wearable device (e.g., device information of the wearable device, or MAC address information). For example, the electronic device (101) may transmit the address information to the external electronic device based on identifying the first state in which the wearable device is worn. For example, the electronic device (101) may transmit a message including the address information to the external electronic device. For example, the message including the address information may be referred to as an M4 request message or an M4 message. The M4 request message may be included in an RTSP message. For example, the M4 message may be used to request setting of parameter values ​​of a presentation or stream specified based on a uniform resource identifier (URI).

[0134] According to one embodiment, the electronic device (101) may transmit the message including the address information and request information for setting the parameter value to the external electronic device based on identifying the first state. According to one embodiment, the address information may include address information of the wearable device used by the wearable device to establish the first connection. For example, the address information may include a MAC (media access control) address of the wearable device (103) for the connection between the electronic device (101) and the wearable device. The address information may be referenced as a BT MAC address, a BT address, address information, or BT identification information. For example, the address information may also include device information of the wearable device (103) (e.g., device name, identifier of the wearable device (103).

[0135] According to one embodiment, the message including the address information may include multiple pieces of address information. For example, the message may include the address information and other address information. For example, the other address information may include address information of another wearable device paired with the electronic device (101) and worn by the user. For example, the other address information may include, like the address information, the MAC address of the other wearable device for BT connection.

[0136] In operation (535), the electronic device (101) may perform the screen mirroring using the connection between the wearable device and the external electronic device. For example, the connection between the external electronic device and the wearable device may include the third connection (e.g., the third connection (323) of FIG. 3) between the external electronic device and the wearable device, which is established through a communication circuit of the external electronic device (e.g., the first communication circuit (353) of FIG. 3).

[0137] In one embodiment, the third connection may be established based on the address information. For example, the external electronic device may identify the wearable device based on the address information. The external electronic device may establish the third connection with the identified wearable device.

[0138] According to one embodiment, the electronic device (101) may disconnect (or release) the first connection between the electronic device (101) and the wearable device. For example, the electronic device (101) may identify the disconnection of the first connection by the wearable device as the third connection is established.

[0139] According to one embodiment, when the first connection is disconnected, a path (or audio path) for outputting audio information may be switched. For example, before the first connection is disconnected, the audio information may be output through a first audio path that is connected in the order of the electronic device (101) and the wearable device. Conversely, when the first connection is disconnected and the third connection is established, the audio information may be output through a second audio path that is connected in the order of the electronic device (101), the external electronic device, and the wearable device. In other words, switching of the audio path may be performed.

[0140] According to one embodiment, the electronic device (101) may receive connection success information from the external electronic device. For example, the external electronic device may transmit a message including the connection success information to the electronic device (101). For example, the message including the connection success information may be included in an RTSP message. For example, the connection success information may include information indicating that the third connection has been established.

[0141] According to one embodiment, the electronic device (101) may receive connection failure information from the external electronic device. For example, the connection failure information may include information indicating that a connection other than the connection between the wearable device and the external electronic device has been established, or that the establishment of the connection between the wearable device and the external electronic device has failed.

[0142] According to one embodiment, the electronic device (101) can transmit video information and audio information to the external electronic device. For example, after receiving the message including the connection success information, the electronic device (101) can perform screen mirroring with the external electronic device. For example, while performing the screen mirroring, the electronic device (101) can transmit a message including the video information and the audio information to the external electronic device. The message including the video information and the audio information can be included in an RTP (real-time transport protocol) message. For example, the RTP message can be used to transmit data including the video information and the audio information. For example, the electronic device (101) can transmit, to the external electronic device, the message including the encoded data.

[0143] In one embodiment, the audio information may be provided to the wearable device. For example, the audio information may be provided from the external electronic device to the wearable device via the third connection while performing the screen mirroring.

[0144] In operation (540), the electronic device (101) may identify a stop event of the screen mirroring. For example, the stop event may include a pause (or stop) of the screen mirroring or the reception of a voice call.

[0145] If the interruption event is identified in operation (540), the electronic device (101) may perform operation (545). Conversely, if the interruption event is not identified in operation (540), the electronic device (101) may perform operation (535). In other words, the electronic device (101) may continue performing the screen mirroring using the third connection.

[0146] In operation (545), the electronic device (101) may re-establish the first connection between the electronic device (101) and the wearable device. For example, the electronic device (101) may re-establish the first connection while maintaining the second connection based on identifying the interruption event. At this time, the electronic device (101) may not transmit a message including video and audio information to the external electronic device (105). The operation according to the interruption event is described in detail in FIGS. 8A to 9B .

[0147] Figure 6 illustrates an example of how to perform control over media while screen mirroring is performed.

[0148] The electronic device (101) of FIG. 6 may include the electronic device (101) of FIG. 3. The wearable device (103) of FIG. 6 may include the wearable device (103) of FIG. 3. The external electronic device (105) of FIG. 6 may include the external electronic device (105) of FIG. 3.

[0149] In operation (600), a second connection may be established between the electronic device (101) and the external electronic device (105). For example, the electronic device (101) may establish the second connection with the external electronic device (105) via the second communication circuit (315). For specific details related thereto, operation (410) of FIG. 4 may be applied substantially identically.

[0150] In operation (605), a third connection may be established between the external electronic device (105) and the wearable device (103). For example, the external electronic device (105) may identify the wearable device (103) based on address information of the wearable device (103). The external electronic device (105) may establish the third connection with the identified wearable device (103).

[0151] According to one embodiment, the address information may include address information of the wearable device (103) used by the wearable device (103) to establish a first connection. The first connection may indicate a connection established between the electronic device (101) and the wearable device (103) before the third connection is established. For example, the address information may include a MAC (media access control) address of the wearable device (103) for the first connection. The address information may be referred to as a BT MAC address, a BT address, address information, and BT identification information.

[0152] According to operations (600) and (605), the electronic device (101) can perform screen mirroring using the third connection. In other words, operations (600) and (605) may represent an example of operations between operations (400) and (455) of FIG. 4.

[0153] In operation (610), the wearable device (103) can identify a user's input. For example, the wearable device (103) can identify the gesture for generating control information. For example, the wearable device (103) can identify the touch input for generating the control information.

[0154] For example, the control information may be generated based on a designated gesture. The designated gesture may include a single tap, a double tap, a triple tap, a press, a long press, etc. The function according to the designated gesture may be set for each device (e.g., electronic device (101) or external electronic device (105)) and each software application within the device. For example, the function according to the designated gesture may include volume control, media control, call control, or execution of a voice recognition mode.

[0155] In operation (615), the wearable device (103) can transmit the control information to an external electronic device (105). For example, the wearable device (103) can transmit a signal including the control information to the external electronic device (105) through the communication circuit (333) of the wearable device (103).

[0156] According to one embodiment, the wearable device (103) may directly transmit the control information to the electronic device (101) when a specified condition is satisfied. For example, the specified condition may include a case where a connection is established that allows direct transmission of the control information to the electronic device (101), or a case where transmission of an emergency signal (e.g., an emergency call) is involved.

[0157] In operation (620), the external electronic device (105) can identify a designated function. For example, the external electronic device (105) can identify whether the control information included in the signal received from the wearable device (103) corresponds to the designated function. The fact that the control information corresponds to the designated function may indicate that the control information triggers (or causes) the designated function. For example, the designated function may include a function that the external electronic device (105) can directly process based on the control information (e.g., volume control of the external electronic device (105). Accordingly, the electronic device (101) can identify the designated function based on the control information. However, the embodiments of the present disclosure are not limited thereto. For example, operation (620) may be omitted.

[0158] In operation (625), the external electronic device (105) may transmit a message including the control information to the electronic device (101). For example, the message including the control information may be included in an RTSP message.

[0159] According to one embodiment, the external electronic device (105) may obtain the control information from the signal received from the wearable device (103) and forward the message including the control information to the electronic device (101) without confirming the control information. Alternatively, according to one embodiment, the external electronic device (105) may, after identifying whether the control information corresponds to the specified function in operation (620), transmit the message including the control information to the electronic device (101) if the control information does not correspond to the specified function.

[0160] In operation (630), according to one embodiment, the electronic device (101) may transmit a message for executing a function to an external electronic device (105). For example, after receiving the message including the control information, the electronic device (101) may identify the function based on the control information. For example, the function may indicate a function triggered (or caused) by the control information. For example, the electronic device (101) may transmit the message for instructing execution of the identified function to the external electronic device (105). For example, the message for instructing execution of the function may be included in an RTSP message.

[0161] In operation (635), the external electronic device (105) may execute the function. For example, after receiving the message for instructing execution of the function, the external electronic device (105) may execute the function instructed based on the message. Alternatively, for example, the external electronic device (105) may execute the designated function identified in operation (620).

[0162] FIG. 7 illustrates an example of an operational flow for how an electronic device performs control over media while screen mirroring is performed.

[0163] At least some of the methods of FIG. 7 may be performed by the electronic device (101) of FIG. 3. For example, at least some of the methods may be controlled by the processor (311) of the electronic device (101). In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0164] In operation (700), according to one embodiment, the electronic device (101) may perform screen mirroring using a connection (e.g., the third connection (323) of FIG. 3) between an external electronic device (e.g., the external electronic device (105) of FIG. 3) and a wearable device (e.g., the wearable device (103) of FIG. 3). For example, the electronic device (101) may transmit a message including the address information of the wearable device to the external electronic device based on identifying that the wearable device is connected and worn by the user. For example, the external electronic device may establish the third connection based on the address information. Thereafter, the electronic device (101) may disconnect the first connection between the wearable device and the electronic device (101) and perform the screen mirroring. The above screen mirroring may be performed based on a second connection (e.g., the second connection (322) of FIG. 3) between the electronic device (101) and the external electronic device. For example, the electronic device (101) may transmit video information and audio information for media playback to the external electronic device while performing the screen mirroring.

[0165] In operation (705), the electronic device (101) may receive a message including control information via the external electronic device. For example, while performing the screen mirroring, the electronic device (101) may receive the message including the control information from the external electronic device. For example, the message including the control information may be included in an RTSP message.

[0166] According to one embodiment, the control information may be transmitted from the wearable device. For example, the wearable device (103) may identify a designated gesture for generating the control information. For example, the control information may be generated based on the designated gesture. The designated gesture may include a single tap, a double tap, a triple tap, a press, a long press, etc. The function according to the designated gesture may be set for each device (e.g., electronic device (101) or external electronic device (105)) and each software application within the device. For example, the function according to the designated gesture may include volume control, media control, call control, or execution of a voice recognition mode.

[0167] According to one embodiment, the control information may be forwarded to the electronic device (101) through the external electronic device. Alternatively, according to one embodiment, the control information, after being transmitted to the external electronic device, may be used to identify whether it corresponds to a function specified by the external electronic device. Thereafter, the external electronic device may transmit the control information that does not correspond to the specified function to the electronic device (101). If the control information corresponds to the specified function, the external electronic device may not transmit the control information to the electronic device (101).

[0168] In operation (710), the electronic device (101) may transmit a message to the external electronic device for executing a function identified based on the message. For example, after receiving the message including the control information, the electronic device (101) may identify the function based on the control information. For example, the function may represent a function triggered (or caused) by the control information. For example, the electronic device (101) may transmit the message for instructing execution of the identified function to the external electronic device. For example, the message for instructing execution of the function may be included in an RTSP message.

[0169] In one embodiment, the external electronic device may execute the function. For example, after receiving the message instructing execution of the function, the external electronic device may execute the function instructed based on the message. Alternatively, for example, the external electronic device may execute the designated function identified by the external electronic device.

[0170] FIG. 8A illustrates an example of how an electronic device connects to a wearable device in response to a pause in screen mirroring.

[0171] FIG. 8A illustrates an example (800) in which an electronic device (101) re-establishes a connection (820) with a wearable device (103) based on identifying a stop event indicating a stop of screen mirroring while the electronic device (101) is performing the screen mirroring in the connected state (e.g., connection (210) and connection (230)) of FIG. 2B, according to one embodiment.

[0172] The electronic device (101) of the example (800) may include the electronic device (101) of FIG. 3. The wearable device (103) of the example (800) may include the wearable device (103) of FIG. 3. The external electronic device (105) of the example (800) may include the external electronic device (105) of FIG. 3.

[0173] Although not shown in example (800), referring to FIG. 2B, the electronic device (101) can establish a connection (210) with an external electronic device (105), and the external electronic device (105) can establish a connection (230) with a wearable device (103). Accordingly, the electronic device (101) can disconnect the connection (220) with the wearable device (103). According to one embodiment, the electronic device (101) can perform the screen mirroring using the connection (230). While performing the screen mirroring, the electronic device (101) can provide data for the media (the video information and audio information) to the external electronic device (105). In addition, the external electronic device (105) can provide the audio information to the wearable device (103). An external electronic device (105) can display a screen based on the video information, and a wearable device (103) can output the audio information.

[0174] Referring to example (800), according to one embodiment, the electronic device (101) may identify the stop of the screen mirroring while performing the screen mirroring using the connection (230). For example, the electronic device (101) may obtain an input (805) for stopping the screen mirroring. For example, the electronic device (101) may identify the stop of the screen mirroring based on obtaining the input (805). The stop of the screen mirroring may be included in the stop event of the screen mirroring.

[0175] According to one embodiment, the electronic device (101) may re-establish a connection (820) based on identifying the interruption event. For example, the electronic device (101) may re-establish a connection (820) with the wearable device (103) after identifying the interruption event. Accordingly, the connection (230) between the wearable device (103) and the external electronic device (105) may be disconnected. At this time, the connection (210) between the electronic device (101) and the external electronic device (105) is not disconnected, but the electronic device (101) may not provide data for playing media (e.g., a video) to the external electronic device (105). Accordingly, the electronic device (101) may be playing the media, but the external electronic device (105) may display a standby screen. For example, the standby screen may include a screen that displays nothing (i.e., a black screen).

[0176] According to one embodiment, the electronic device (101) can provide audio information included in the data to the wearable device (103) via the re-established connection (820). The wearable device (103) can output the audio information. Accordingly, the user (200) can receive the audio information via the wearable device (103).

[0177] FIG. 8B illustrates an example of an operational flow for how an electronic device connects to a wearable device in response to a pause in screen mirroring.

[0178] At least some of the methods of FIG. 8B may be performed by the electronic device (101) of FIG. 3. For example, at least some of the methods may be controlled by the processor (311) of the electronic device (101). In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0179] In operation (850), the electronic device (101) can perform screen mirroring using a connection (e.g., the third connection (323) of FIG. 3) between an external electronic device (e.g., the external electronic device (105) of FIG. 3) and a wearable device (e.g., the wearable device (103) of FIG. 3).

[0180] In operation (855), the electronic device (101) can identify the stop of the screen mirroring. For example, the electronic device (101) can obtain an input for stopping the screen mirroring. The electronic device (101) can perform the stop based on the obtained input. For example, the electronic device (101) can provide a message including information for the stop to the external electronic device. The message can be included in an RTSP message. Based on the message, the external electronic device can disconnect the third connection between the wearable device and the external electronic device.

[0181] According to one embodiment, the electronic device (101) may maintain a second connection between the external electronic device and the electronic device (101). For example, the electronic device (101) may maintain the second connection even if the third connection is disconnected by transmitting the message including the information for the suspension. This may be to perform a more rapid resumption when resuming the screen mirroring is identified thereafter. However, even if the electronic device (101) maintains the second connection, it may not transmit data for playing media to the external electronic device.

[0182] In operation (860), the electronic device (101) may re-establish the connection with the wearable device. For example, the electronic device (101) may re-establish the first connection based on identifying the stop. For example, the first connection may be established through the first communication circuit (313) of the electronic device (101).

[0183] In operation (865), the electronic device (101) may provide audio information to the wearable device. For example, the electronic device (101) may transmit the audio information to the wearable device via the re-established first connection. For example, the audio information may represent audio information of the media played by the electronic device (101).

[0184] In operation (870), the electronic device (101) may identify the resumption of the screen mirroring. For example, the electronic device (101) may obtain another input for the resumption of the screen mirroring. The electronic device (101) may perform the resumption based on the obtained other input.

[0185] In operation (875), the electronic device (101) may transmit a message requesting the re-establishment of the connection between the wearable device and the external electronic device. For example, the electronic device (101) may transmit the message requesting the re-establishment of the third connection to the external electronic device. The message requesting the re-establishment of the third connection may be transmitted via the second connection.

[0186] In one embodiment, the message requesting the re-establishment of the third connection may include address information of the wearable device. For example, the message including the address information may be referred to as an M4 request message or M4 message. The M4 request message may be included in an RTSP message. For example, the M4 message may be used to request the setting of parameter values ​​of a presentation or stream designated based on a uniform resource identifier (URI). For specific details related thereto, operations (430) to (435) of FIG. 4 may be applied substantially identically.

[0187] In operation (880), the electronic device (101) may disconnect the connection with the re-established wearable device. For example, the electronic device (101) may disconnect the re-established first connection based on the re-establishment of the third connection between the wearable device and the external electronic device based on the message including the address information.

[0188] Accordingly, when the electronic device (101) transmits the data for playing the media to the external electronic device while performing the screen mirroring, the video information of the data can be displayed through the display of the external electronic device, and the audio information of the data can be output through the output device of the wearable device.

[0189] FIG. 9A illustrates an example of how an electronic device connects to a wearable device in response to identifying an incoming voice call.

[0190] FIG. 9a illustrates an example (900) in which the electronic device (101) re-establishes a connection (920) with the wearable device (103) based on identifying a stop event indicating a stop of the screen mirroring while the electronic device (101) is performing the screen mirroring in the connection state (connection (210) and connection (230)) of FIG. 2b.

[0191] The electronic device (101) of the example (900) may include the electronic device (101) of FIG. 3. The wearable device (103) of the example (900) may include the wearable device (103) of FIG. 3. The external electronic device (105) of the example (900) may include the external electronic device (105) of FIG. 3.

[0192] Although not illustrated in example (900), referring to FIG. 2B, the electronic device (101) can establish a connection (210) with an external electronic device (105), and the external electronic device (105) can establish a connection (230) with a wearable device (103). Accordingly, the electronic device (101) can disconnect the connection (220) with the wearable device (103). According to one embodiment, the electronic device (101) can perform the screen mirroring using the connection (230). While performing the screen mirroring, the electronic device (101) can provide data for the media (the video information and audio information) to the external electronic device (105). In addition, the external electronic device (105) can provide the audio information to the wearable device (103). An external electronic device (105) can display a screen based on the video information, and a wearable device (103) can output the audio information.

[0193] Referring to example (900), the electronic device (101) can identify the reception of a voice call while performing the screen mirroring using the connection (230). For example, the reception of the voice call can be included in the event of the screen mirroring being stopped.

[0194] According to one embodiment, the electronic device (101) may re-establish a connection (920) based on identifying the interruption event. For example, the electronic device (101) may re-establish a connection (920) with the wearable device (103) after identifying the interruption event. Accordingly, the connection (230) between the wearable device (103) and the external electronic device (105) may be disconnected. At this time, the connection (210) between the electronic device (101) and the external electronic device (105) is not disconnected, but the electronic device (101) may not provide data for playing media (e.g., a video) to the external electronic device (105). Accordingly, the electronic device (101) may play a visual object notifying the reception of the voice call, but the external electronic device (105) may display a standby screen. For example, the waiting screen may include a screen that displays nothing (i.e., a black screen).

[0195] According to one embodiment, the electronic device (101) can provide audio information included in the data to the wearable device (103) via the re-established connection (920). The wearable device (103) can output the audio information. Accordingly, the user (200) can receive the audio information via the wearable device (103).

[0196] FIG. 9B illustrates an example of an operational flow for a method in which an electronic device connects with a wearable device in response to identifying an incoming voice call.

[0197] At least some of the methods of FIG. 9B may be performed by the electronic device (101) of FIG. 3. For example, at least some of the methods may be controlled by the processor (311) of the electronic device (101). In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0198] In operation (950), the electronic device (101) can perform screen mirroring using a connection (e.g., the third connection (323) of FIG. 3) between an external electronic device (e.g., the external electronic device (105) of FIG. 3) and a wearable device (e.g., the wearable device (103) of FIG. 3).

[0199] In operation (955), the electronic device (101) may identify the reception of a voice call. For example, the electronic device (101) may receive a signal requesting connection of the voice call to the electronic device (101) from another electronic device through a communication circuit. Accordingly, the electronic device (101) may identify the reception of the voice call. Based on identifying the reception of the voice call, the electronic device (101) may perform the suspension of the screen mirroring. For example, the electronic device (101) may provide a message including information for the suspension to the external electronic device. The message may be included in an RTSP message. Based on the message, the external electronic device may disconnect the third connection between the wearable device and the external electronic device.

[0200] According to one embodiment, the electronic device (101) may maintain a second connection between the external electronic device and the electronic device (101). For example, the electronic device (101) may maintain the second connection even if the third connection is disconnected by transmitting the message including the information for the suspension. This may be to perform a more rapid resumption when resuming the screen mirroring is identified thereafter. However, even if the electronic device (101) maintains the second connection, it may not transmit data for playing media to the external electronic device.

[0201] In operation (960), the electronic device (101) may re-establish a connection with the wearable device. For example, the electronic device (101) may re-establish the first connection based on identifying the stop. For example, the first connection may be established via the first communication circuit (313) of the electronic device (101).

[0202] In one embodiment, the re-established first connection between the wearable device and the electronic device (101) may be utilized through a specific mode of the wearable device. For example, the specific mode may be referred to as a headset mode. The wearable device may perform the re-established first connection based on the headset mode, based on identifying that the re-established first connection is for a voice call rather than for media playback. This may be to shorten the connection time of the re-established first connection. For example, the first connection for media playback may be utilized through another mode of the wearable device. For example, the other mode may be referred to as an advanced audio distribution profile (A2DP) mode.

[0203] In operation (965), the electronic device (101) may provide audio information to the wearable device. For example, the electronic device (101) may transmit the audio information to the wearable device via the re-established first connection. For example, the audio information may represent audio information of the media played by the electronic device (101).

[0204] In operation (970), the electronic device (101) may identify the resumption of the screen mirroring. For example, the electronic device (101) may identify that the voice call has been rejected or that the voice call has ended. The electronic device (101) may perform the resumption based on the identification of the rejection of the voice call or the termination of the voice call.

[0205] In operation (975), the electronic device (101) may transmit a message requesting the re-establishment of the connection between the wearable device and the external electronic device. For example, the electronic device (101) may transmit the message requesting the re-establishment of the third connection to the external electronic device. The message requesting the re-establishment of the third connection may be transmitted via the second connection.

[0206] In one embodiment, the message requesting the re-establishment of the third connection may include address information of the wearable device. For example, the message including the address information may be referred to as an M4 request message or M4 message. The M4 request message may be included in an RTSP message. For example, the M4 message may be used to request the setting of parameter values ​​of a presentation or stream designated based on a uniform resource identifier (URI). For specific details related thereto, operations (430) to (435) of FIG. 4 may be applied substantially identically.

[0207] In operation (980), the electronic device (101) may disconnect the connection with the re-established wearable device. For example, the electronic device (101) may disconnect the re-established first connection with the wearable device based on the re-establishment of the third connection between the wearable device and the external electronic device based on the message including the address information.

[0208] Accordingly, when the electronic device (101) transmits the data for playing the media to the external electronic device while performing the screen mirroring, the video information of the data can be displayed through the display of the external electronic device, and the audio information of the data can be output through the output device of the wearable device.

[0209] Referring to FIGS. 8A to 9B , an example is described in which the electronic device (101) identifies a screen mirroring interruption event and re-establishes a connection with the wearable device based on the event. However, the embodiments of the present disclosure are not limited thereto. For example, the embodiments of the present disclosure may include a case in which the electronic device (101) performs the screen mirroring in a state in which the connection with the wearable device has not been established, and then establishes a connection with the wearable device. For example, the electronic device (101) may establish a connection with the external electronic device in order to perform the screen mirroring. In a state in which the connection between the external electronic device and the electronic device (101) is established, the electronic device (101) may identify a connection request with the wearable device. For example, the connection request may include the user wearing the wearable device. The electronic device (101) may, based on identifying a connection request with the wearable device, transmit a message including address information of the wearable device to the external electronic device. The message including the address information of the wearable device may be used to establish a connection between the external electronic device and the wearable device.

[0210] FIG. 10 illustrates an example of an operational flow for how an electronic device establishes a connection for screen mirroring and switches an audio path in conjunction with screen mirroring.

[0211] At least some of the methods of FIG. 10 may be performed by the electronic device (101) of FIG. 3. For example, at least some of the methods may be controlled by the processor (311) of the electronic device (101). In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0212] In operation (1000), the electronic device (101) may establish a first connection with a wearable device that outputs audio information through a first communication circuit. For example, the wearable device may include the wearable device (103) of FIG. 3. For example, the first communication circuit may include the first communication circuit (313) of FIG. 3. For example, the wearable device may receive the audio information and output the received audio information.

[0213] According to one embodiment, the electronic device (101) may establish the first connection with the wearable device via the first communication circuit. For example, the first communication circuit may include a module providing a first communication scheme. For example, the first communication scheme may include short-range wireless communication including BT (Bluetooth) or BLE (Bluetooth low energy). The first communication scheme may be referred to as a BT connection scheme.

[0214] In operation (1010), the electronic device (101) can establish a second connection with an external electronic device identified among one or more external electronic devices for screen mirroring through a second communication circuit while the first connection is established.

[0215] According to one embodiment, the electronic device (101) can identify one or more external electronic devices for screen mirroring. For example, the electronic device (101) can perform discovery based on a signal transmitted through the second communication circuit. For example, the discovery can indicate an operation for establishing a second connection (e.g., the second connection (322) of FIG. 3) with the electronic device (101). For example, the electronic device (101) can identify the one or more external electronic devices based on the discovery.

[0216] For example, the electronic device (101) may identify an external electronic device among the one or more external electronic devices based on an input. For example, the input may include an input to a portion of a screen displaying information about the one or more external electronic devices corresponding to the external electronic device. For example, the screen may be displayed through a display of the electronic device (101). However, the embodiments of the present disclosure are not limited thereto. For example, the electronic device (101) may identify an external electronic device that was recently (or last) connected among the one or more external electronic devices.

[0217] For example, the electronic device (101) may establish the second connection with the external electronic device based on the second communication circuit included in the electronic device (101). For example, the second communication circuit may be different from the first communication circuit. For example, the second communication circuit may include a module that provides a second communication technique different from the first communication technique. For example, the second communication technique may include short-range wireless communication including wireless fidelity (Wi-Fi) or Wi-Fi direct. The second communication technique may be referred to as a Wi-Fi connection technique.

[0218] In operation (1020), the electronic device (101) may transmit a message including address information of the wearable device used in the first connection to the external electronic device based on identifying that the wearable device is worn by the user.

[0219] According to one embodiment, the electronic device (101) can identify the wearing state of the wearable device. For example, the electronic device (101) can identify whether the wearable device is in a first state or a second state different from the first state. For example, the first state may indicate a state in which the wearable device is worn by the user, and the second state may indicate a state in which the wearable device is not worn by the user.

[0220] According to one embodiment, the electronic device (101) may transmit the address information to the external electronic device. For example, the electronic device (101) may transmit the address information to the external electronic device based on identifying the first state in which the wearable device is worn. For example, the electronic device (101) may transmit a message including the address information to the external electronic device. For example, the message including the address information may be referred to as an M4 request message or an M4 message. The M4 request message may be included in an RTSP message. For example, the M4 message may be used to request setting of parameter values ​​of a presentation or stream specified based on a uniform resource identifier (URI).

[0221] According to one embodiment, the electronic device (101) may transmit the message including the address information and request information for setting the parameter value to the external electronic device based on identifying the first state. Alternatively, the electronic device (101) may transmit the message including the request information for setting the parameter value among the address information and request information for setting the parameter value to the external electronic device based on identifying the second state.

[0222] In one embodiment, the address information may include address information of the wearable device used by the wearable device to establish the first connection. For example, the address information may include the MAC (media access control) address of the wearable device for the first connection. The address information may be referred to as a BT MAC address, a BT address, address information, or BT identification information.

[0223] According to one embodiment, the message including the address information may include multiple pieces of address information. For example, the message may include the address information and other address information. For example, the other address information may include address information of another wearable device paired with the electronic device (101) and worn by the user. For example, the other address information may include, like the address information, the MAC address of the other wearable device for BT connection.

[0224] Although not illustrated in FIG. 10, according to one embodiment, before transmitting the message including the address information, the electronic device (101) may transmit a request for capability information to the external electronic device. For example, the electronic device (101) may transmit a message requesting the capability information to the external electronic device. For example, the message requesting the capability information may be referred to as an M3 request message or an M3 message. The M3 request message may be included in an RTSP (real-time streaming protocol) message. For example, the M3 message may be used to obtain parameter values ​​of a presentation or stream specified based on a uniform resource identifier (URI).

[0225] In one embodiment, the capability information may include whether the external electronic device supports a function for switching audio paths. The function for switching audio paths may be referred to as an audio path switching function, a pair switching function, a paired device switching function, or a switching function.

[0226] In one embodiment, the external electronic device can identify whether it supports the switching function. For example, if the switching function is implemented in the external electronic device, the external electronic device can be identified as supporting the switching function.

[0227] According to one embodiment, the electronic device (101) may receive the capability information from the external electronic device. For example, the electronic device (101) may receive a message including the capability information from the external electronic device. For example, the message including the capability information may be referred to as an M3 response message or an M3 message. The M3 response message may be included in an RTSP message. For example, when the switching function is supported, the capability information may include a specified value (e.g., 1 (enable)). Conversely, when the switching function is not supported, the capability information may include a value different from the specified value (e.g., 0 (disable)).

[0228] In operation (1030), the electronic device (101) may receive a message from the external electronic device, the message including information indicating that the third connection between the external electronic device and the wearable device is established.

[0229] In one embodiment, the third connection may be established between the external electronic device and the wearable device. For example, the external electronic device may identify the wearable device based on the address information. The external electronic device may establish the third connection with the identified wearable device.

[0230] In one embodiment, the electronic device (101) may disconnect (or release) the first connection. For example, the electronic device (101) may identify the disconnection of the first connection by the wearable device when the third connection between the wearable device and the external electronic device is established.

[0231] According to one embodiment, the electronic device (101) may receive connection success information from the external electronic device. For example, the external electronic device may transmit a message including the connection success information to the electronic device (101). For example, the message including the connection success information may be included in an RTSP message. For example, the connection success information may include information indicating that the third connection has been established.

[0232] According to one embodiment, the electronic device (101) may receive connection failure information from the external electronic device. For example, the connection failure information may include information indicating that a connection different from the third connection has been established, or that the establishment of the third connection has failed.

[0233] According to one embodiment, the electronic device (101) can transmit video information and audio information to the external electronic device. For example, after receiving the message including the connection success information, the electronic device (101) can perform screen mirroring with the external electronic device. For example, while performing the screen mirroring, the electronic device (101) can transmit a message including the video information and the audio information to the external electronic device. The message including the video information and the audio information can be included in a real-time transport protocol (RTP) message. For example, the RTP message can be used to transmit data including the video information and the audio information. For example, the electronic device (101) can transmit to the external electronic device through the message including the encoded data.

[0234] In one embodiment, the external electronic device may transmit the audio information to the wearable device. For example, the external electronic device may transmit the audio information to the wearable device via the third connection while performing the screen mirroring.

[0235] According to one embodiment, the external electronic device can decode the message received from the electronic device (101). For example, the external electronic device can obtain the video information and the audio information based on the decoded message. For example, the external electronic device (101) can transmit a signal including the obtained audio information to the wearable device. For example, the signal can be encoded according to a protocol used within the third connection. Alternatively, according to one embodiment, the external electronic device can forward the audio information within the message received from the electronic device (101) to the wearable device.

[0236] According to one embodiment, the electronic device (101) may re-establish the first connection. For example, the electronic device (101) may re-establish the first connection based on identifying a disruption event of the screen mirroring. For example, the disruption event may include a pause (or stop) of the screen mirroring or the reception of a voice call. For example, the electronic device (101) may re-establish the first connection based on identifying the disruption event while the second connection is maintained. At this time, the electronic device (101) may not transmit a message including video and audio information to the external electronic device. Specific details related thereto may be substantially identically applied to the contents of FIGS. 8A to 9B.

[0237] According to one embodiment, the electronic device (101) may receive a message including connection termination information from the external electronic device. For example, the message including the connection termination information may be included in an RTSP message. For example, the connection termination information may include information indicating that the established third connection has been terminated.

[0238] Referring to FIGS. 1 to 10 , an electronic device and method according to embodiments of the present disclosure can seamlessly provide audio information of media played on an electronic device (e.g., an electronic device (101) of FIG. 3) through an external electronic device (e.g., an external electronic device (105) of FIG. 3) while a user is wearing a wearable device (e.g., a wearable device (103) of FIG. 3)) through the wearable device. In other words, a connection between the wearable device and the external electronic device can be automatically established without the user having to perform additional settings and connection operations for the wearable device.

[0239] In addition, the electronic device and method according to embodiments of the present disclosure can more effectively synchronize audio information and video information of the media by connecting the wearable device and the external electronic device in the screen mirroring in which the media provided from the electronic device is output from the external electronic device. For example, when a user listens to the audio information of the media through the wearable device by reconnecting the wearable device to the electronic device while the screen mirroring is being performed, a difference in processing time (e.g., encoding time and decoding time) between the video information and the audio information of the media may occur. In this case, the difference may be referred to as latency. However, the electronic device and method according to embodiments of the present disclosure can reduce the synchronization mismatch by connecting the external electronic device and the wearable device during the connection process of the electronic device and the external electronic device.

[0240] In addition, the electronic device and method according to embodiments of the present disclosure can also be applied when performing the screen mirroring for the external electronic device that supports DLNA (digital living network alliance). The DLNA is a function that transmits media of the electronic device to the external electronic device and plays the media on the electronic device, and the electronic device may not play the media. When the electronic device and the external electronic device perform the screen mirroring based on the DLNA, the wearable device cannot output audio information even if it is connected to the electronic device. This is because only the external electronic device plays the media including the audio information and video information. However, in the electronic device and method according to embodiments of the present disclosure, while performing the screen mirroring based on the DLNA, the external electronic device and the wearable device are connected, so the user can receive the audio information through the wearable device.

[0241] Furthermore, the electronic device and method according to embodiments of the present disclosure can control the electronic device (or media played by the electronic device) even while performing screen mirroring through a designated gesture on the wearable device. Accordingly, the electronic device and method according to embodiments of the present disclosure can provide a more convenient user experience to the user.

[0242] As described above, the electronic device (101) may include a first communication circuit (313). The electronic device (101) may include a memory (317) that stores instructions and includes one or more storage media. The electronic device (101) may include a second communication circuit (315) that is different from the first communication circuit (313). The electronic device (101) may include at least one processor (311) that includes a processing circuit. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to establish a first connection with a wearable device (103) that receives audio information through the first communication circuit (313). The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to establish a second connection with an external electronic device (105) identified among one or more external electronic devices for screen mirroring, through the second communication circuit (315), while the first connection is established. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to transmit a message including address information of the wearable device (103) used in the first connection to the external electronic device (105) based on identifying that the wearable device (103) is worn by a user.The above instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to receive, from the external electronic device (105), a message including information indicating that a third connection between the external electronic device (105) and the wearable device (103) is established.

[0243] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to perform discovery of the one or more external electronic devices based on the second communication circuit (315). The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to establish the second connection with the external electronic device (105) identified among the discovered one or more external electronic devices based on at least a portion of the user's input. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to transmit, to the external electronic device (105), a message requesting capability information regarding a function of switching an audio path while the second connection is established. The above instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to receive, from the external electronic device (105), a message including information indicating whether the function is supported, in response to the message requesting the capability information.

[0244] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to identify whether the wearable device (103) is in a first state worn by the user based on identifying that the external electronic device (105) supports the function based on the message including information indicating whether the external electronic device (105) supports the function. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to transmit, to the external electronic device (105), the message including request information for setting a parameter based on a uniform resource identifier (URI) and the address information, based on identifying the first state. The above instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to transmit a message including the request information for setting the parameter and the address information to the external electronic device (105) based on identifying a second state different from the first state.

[0245] According to one embodiment, the message including the address information may include the address information and another address information. The other address information may include address information of another wearable device (103) paired with the electronic device (101) and worn by the user.

[0246] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to perform screen mirroring with the external electronic device (105) after receiving the message including information indicating that the third connection is established. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to transmit a message including audio information and video information to the external electronic device (105) while performing the screen mirroring. The audio information may be provided to the wearable device (103) by the external electronic device via the third connection.

[0247] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to identify a pause in the screen mirroring based on an input from the user while performing the screen mirroring. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to, in response to identifying the pause, reestablish the first connection with the wearable device (103) within the state in which the second connection is established. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to transmit the audio information to the wearable device (103) based on the re-established first connection.

[0248] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to transmit, to the external electronic device (105), a message including the address information for the first connection and requesting re-establishment of the third connection based on identifying a resumption of the stopped screen mirroring. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to disconnect the re-established first connection based on receiving a message including information indicating that the third connection is re-established.

[0249] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to identify the reception of a voice call while performing the screen mirroring. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to, in response to identifying the reception of the voice call, reestablish the first connection with the wearable device (103) within the state in which the second connection is established. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to transmit the audio information to the wearable device (103) based on the re-established first connection.

[0250] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to transmit, to the external electronic device (105), a message including the address information for the first connection and requesting re-establishment of the third connection based on refusing the reception of the voice call or identifying that the voice call has been terminated. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to disconnect the re-established first connection based on receiving a message including information indicating that the third connection has been re-established.

[0251] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to perform screen mirroring with the external electronic device (105) after receiving the message including information indicating that the third connection is established. The instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to receive, through the external electronic device (105), a message including control information transmitted from the wearable device (103) while performing the screen mirroring. The control information may be associated with a designated gesture of the user with respect to the wearable device (103).

[0252] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to transmit, to the external electronic device (105), a message requesting execution of a function corresponding to the control information, based on receiving the message including the control information.

[0253] According to one embodiment, each of the first connection and the third connection may be established based on a BT (Bluetooth) connection technique. The second connection may be established based on a Wi-Fi connection technique. The address information may include a MAC (media access control) address used in the BT connection technique.

[0254] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (311), may cause the electronic device (101) to disconnect the first connection based on identifying that the third connection between the external electronic device (105) and the wearable device (103) is established.

[0255] As described above, a method performed by an electronic device (101) may include an operation of establishing a first connection with a wearable device (103) that receives audio information and a first communication circuit (313) of the electronic device. The method may include an operation of establishing a second connection with an external electronic device (105) identified among one or more external electronic devices for screen mirroring and a second communication circuit (315) of the electronic device, within a state in which the first connection is established. The method may include an operation of transmitting a message including address information of the wearable device (103) used in the first connection to the external electronic device (105) based on identifying that the wearable device (103) is worn by a user. The method may include an action of receiving, from the external electronic device (105), a message including information indicating that a third connection between the external electronic device (105) and the wearable device (103) is established.

[0256] As described above, a non-transitory computer-readable storage medium can store one or more programs that, when individually or collectively executed by at least one processor (311) of an electronic device (101) including a first communication circuit (313) and a second communication circuit (315) different from the first communication circuit (313), cause the electronic device (101) to establish a first connection with a wearable device (103) that receives audio information through the first communication circuit (313). The non-transitory computer-readable storage medium may store one or more programs including instructions that, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to establish a second connection with an external electronic device (105) identified among one or more external electronic devices for screen mirroring through the second communication circuit (315) within the state in which the first connection is established. The non-transitory computer-readable storage medium may store one or more programs including instructions that, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to transmit a message including address information of the wearable device (103) used in the first connection to the external electronic device (105) based on identifying that the wearable device (103) is worn by a user.The non-transitory computer-readable storage medium may store one or more programs including instructions that, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to receive, from the external electronic device (105), a message including information indicating that a third connection between the external electronic device (105) and the wearable device (103) is established.

[0257] As described above, the electronic device (105) may include a first communication circuit (353). The electronic device (105) may include a memory (359) that stores instructions and includes one or more storage media. The electronic device (105) may include a second communication circuit (355) that is different from the first communication circuit (353). The electronic device (105) may include at least one processor (351) that includes a processing circuit. The instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to establish a first connection with an external electronic device (101) for screen mirroring through the first communication circuit (313). The instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to receive, from the external electronic device (101) via the first communication circuit (353), a message including address information used in a second connection between a wearable device (103) worn by a user and the external electronic device (101). The instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to establish, via the second communication circuit (355), a second connection with the wearable device (103) identified based on the message including the address information.The above instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to transmit a message to the external electronic device (101) that includes information indicating that the second connection is established.

[0258] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to receive, from the external electronic device (101), a message requesting capability information regarding a function of switching an audio path within the state in which the first connection is established. The instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to transmit, to the external electronic device (101), a message including information indicating whether the function is supported, in response to the message requesting the capability information.

[0259] According to one embodiment, the message including the address information may include request information for setting a parameter based on a uniform resource identifier (URI).

[0260] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to perform the screen mirroring with the external electronic device (101) after transmitting the message including information indicating that the second connection is established. The instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to receive, from the external electronic device (101), a message including the audio information and the video information while performing the screen mirroring. The instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to transmit a signal including the audio information to the wearable device (103).

[0261] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to receive a signal including control information from the wearable device (103) while performing the screen mirroring. The instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to transmit a message including the received control information to the external electronic device (101). The instructions, when individually or collectively executed by the at least one processor (351), may cause the electronic device (105) to execute a function based on receiving a message from the external electronic device (101) requesting execution of a function corresponding to the control information. The control information may be associated with a designated gesture of the user with respect to the wearable device (103).

[0262] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0263] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0264] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0265] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0266] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0267] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), A memory (317) storing instructions and including one or more storage media; First communication circuit (313); A second communication circuit (315) different from the first communication circuit (313); and At least one processor (311) comprising a processing circuit, The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: A wearable device (103) that receives audio information and establishes a first connection through the first communication circuit (313); In the state where the first connection is established, a second connection is established through the second communication circuit (315) with an external electronic device (105) identified among one or more external electronic devices for screen mirroring; Based on identifying that the wearable device (103) is worn by the user, a message including address information of the wearable device (103) used in the first connection is transmitted to the external electronic device (105); and Causing to receive, from the external electronic device (105), a message including information indicating that a third connection between the external electronic device (105) and the wearable device (103) is established; Electronic devices (101).

2. In claim 1; The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: Based on the second communication circuit (315), discovery of one or more external electronic devices is performed; Establishing the second connection with the external electronic device (105) identified based on at least a portion of the user's input among the discovered one or more external electronic devices; In the state where the second connection is established, a message for requesting capability information for a function of switching an audio path is transmitted to the external electronic device (105); and In response to the message requesting the capability information, causing a message to be received from the external electronic device (105) containing information indicating whether the function is supported. Electronic devices (101).

3. In claim 2; The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: Based on the message including information indicating whether the said function is supported, identifying whether the said external electronic device (105) supports the said function, identifying whether the said wearable device (103) is in a first state worn by the user; Based on identifying the first state, transmitting the message including the request information for setting the parameter based on the uniform resource identifier (URI) and the address information to the external electronic device (105); and Based on identifying a second state different from the first state, a message including the request information for setting the parameter and the address information is transmitted to the external electronic device (105). Electronic devices (101).

4. In claim 1, The message including the above address information includes the above address information and another address information, and The above other address information includes address information of another wearable device (103) that is paired with the electronic device (101) and worn by the user. Electronic devices (101).

5. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: After receiving the message including information indicating that the third connection is established, performing screen mirroring with the external electronic device (105); and While performing the above screen mirroring, causing a message including the audio information and video information to be transmitted to the external electronic device (105). The above audio information is provided to the wearable device (103) by the external electronic device through the third connection. Electronic devices (101).

6. In claim 5, The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: While performing the above screen mirroring, identify a pause of the screen mirroring based on an input of the user; In response to identifying the above stop, reestablishing the first connection with the wearable device (103) within the state in which the second connection is established; and Based on the above re-established first connection, causing the wearable device (103) to transmit the audio information, Electronic devices (101).

7. In claim 6, The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: Based on identifying the resumption of the above-mentioned stopped screen mirroring, transmitting a message including the address information for the first connection and requesting the re-establishment of the third connection to the external electronic device (105); and Based on receiving a message including information indicating that the third connection is re-established, causing the re-established first connection to be disconnected, Electronic devices (101).

8. In claim 5, The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: While performing the above screen mirroring, identify the incoming voice call; In response to identifying said reception of said voice call, reestablishing said first connection with said wearable device (103) within said established second connection state; and Based on the above re-established first connection, causing the wearable device (103) to transmit the audio information, Electronic devices (101).

9. In claim 8, The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: Based on the rejection of the reception of the voice call or identification that the voice call is terminated, transmitting a message including the address information for the first connection and requesting re-establishment of the third connection to the external electronic device (105); and Based on receiving a message including information indicating that the third connection is re-established, causing the re-established first connection to be disconnected, Electronic devices (101).

10. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: After receiving the message including information indicating that the third connection is established, performing screen mirroring with the external electronic device (105); and While performing the above screen mirroring, a message including control information transmitted from the wearable device (103) is caused to be received through the external electronic device (105). The above control information is associated with a specified gesture of the user for the wearable device (103). Electronic devices (101).

11. In claim 10, The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: Based on receiving the message including the control information, causing the external electronic device (105) to transmit a message requesting execution of a function corresponding to the control information. Electronic devices (101).

12. In claim 1, Each of the above first connection and the above third connection is established based on the BT (Bluetooth) connection technique, The above second connection is established based on a Wi-Fi connection technique, and The above address information includes the MAC (media access control) address used in the BT connection technique. Electronic devices (101).

13. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (311), cause the electronic device (101) to: Based on identifying that the third connection between the external electronic device (105) and the wearable device (103) is established, causing the first connection to be disconnected. Electronic devices (101).

14. In a method performed by an electronic device (101), The above method: An operation of establishing a first connection through a wearable device (103) receiving audio information and a first communication circuit (313) of the electronic device; An operation of establishing a second connection through an external electronic device (105) identified among one or more external electronic devices for screen mirroring and a second communication circuit (315) of the electronic device, within the state where the first connection is established; An operation of transmitting a message including address information of the wearable device (103) used in the first connection to the external electronic device (105) based on identifying that the wearable device (103) is worn by the user; and An operation including receiving, from the external electronic device (105), a message including information indicating that a third connection between the external electronic device (105) and the wearable device (103) is established. method.

15. A non-transitory computer-readable storage medium, when individually or collectively executed by at least one processor (311) of an electronic device (101) including a first communication circuit (313) and a second communication circuit (315) different from the first communication circuit (313), causes the electronic device (101) to: A wearable device (103) that receives audio information and establishes a first connection through the first communication circuit (313); In the state where the first connection is established, a second connection is established through the second communication circuit (315) with an external electronic device (105) identified among one or more external electronic devices for screen mirroring; Based on identifying that the wearable device (103) is worn by the user, a message including address information of the wearable device (103) used in the first connection is transmitted to the external electronic device (105); and storing one or more programs including instructions causing a message to be received from the external electronic device (105), the message including information indicating that a third connection between the external electronic device (105) and the wearable device (103) is established; A non-transitory computer-readable storage medium.

Images