Electronic device for providing mirroring and operation method therefor
The electronic device's dual communication capabilities and adaptive switching mechanism enhance mirroring performance by reducing delays and maintaining service quality through dynamic channel adjustments, addressing the issues of communication disruptions and data synchronization.
Patent Information
- Application Number
- PCT/KR2024/009795
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-07-25
- Filing Date
- 2024-07-09
- Publication Date
- 2025-01-23
AI Technical Summary
Mirroring between electronic devices often results in decreased service quality due to communication delays and disruptions, leading to differences in displayed information and temporary losses of data.
An electronic device equipped with both Bluetooth and wireless LAN communication circuits, which establishes multiple communication connections and switches between them based on mirroring status information to adapt to changes in the communication environment, ensuring stable data transmission.
This approach reduces delays in multimedia information transmission and maintains service quality by dynamically adjusting communication channels according to the mirroring status, preventing data loss and ensuring synchronized output across devices.
Smart Images

Figure KR2024009795_23012025_PF_FP_ABST
Abstract
Description
Electronic device for providing mirroring and method of operation thereof
[0001] An embodiment of the present invention relates to a device and method for performing mirroring with an external electronic device in an electronic device.
[0002] Mirroring can refer to a communication technology in which multiple electronic devices share multimedia information (or data) with each other.
[0003] An electronic device can control the display of the electronic device to output information through mirroring to an external electronic device's display. For example, when performing mirroring with an external electronic device, the electronic device can encode information (e.g., an image) being output through the electronic device's display and transmit it to the external electronic device. The external electronic device can then decode the encoded data received from the electronic device and output it through the external electronic device's display.
[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.
[0005] An electronic device can create a communication channel based on a designated communication method (e.g., Bluetooth or wireless LAN) with an external electronic device to perform mirroring. The electronic device can transmit multimedia information (or data) to the external electronic device through the communication channel of the designated communication method. The external electronic device can output multimedia information received from the electronic device to an external device through the communication channel of the designated communication method.
[0006] Mirroring electronic devices and external electronic devices may result in degraded service quality due to poor communication quality between the electronic device and the external electronic device. For example, information displayed on the electronic device's display at a given time may differ from that displayed on the external electronic device's display due to wireless communication delays. For example, information displayed on the external electronic device's display may be temporarily interrupted or stopped due to poor communication quality.
[0007] An embodiment of the present invention discloses a device and method for performing mirroring with an external electronic device in an electronic device.
[0008] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.
[0009] According to one embodiment, an electronic device may include a first communication circuit supporting Bluetooth communication, a second communication circuit supporting wireless LAN communication, and at least one processor and memory operatively connected to the first communication circuit and the second communication circuit. According to one embodiment, the memory may store instructions that, when executed by the at least one processor, cause the electronic device to perform a first communication connection with an external electronic device related to mirroring through the first communication circuit and a second communication connection with the external electronic device related to mirroring through the second communication circuit based on activation of mirroring. According to one embodiment, the memory may store instructions that, when executed by the at least one processor, cause the electronic device to perform mirroring with the external electronic device through the first communication connection if the first communication connection is established before the second communication connection. According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to switch mirroring with the external electronic device to a second communication connection when a communication method switching condition related to the second communication method is satisfied. According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to transmit data for performing mirroring to the external electronic device through the second communication connection based on the switching to the second communication method.
[0010] According to one embodiment, a method of operating an electronic device may include an operation of performing a first communication connection with an external electronic device related to mirroring based on a Bluetooth method and a second communication connection with the external electronic device related to mirroring based on a wireless LAN method based on activation of mirroring. According to one embodiment, the method of operating an electronic device may include an operation of performing mirroring with the external electronic device through the first communication connection when the first communication connection is established before the second communication connection. According to one embodiment, the method of operating an electronic device may include an operation of switching mirroring with the external electronic device to the second communication connection when a condition for switching a communication method related to the second communication method is satisfied. According to one embodiment, the method of operating an electronic device may include an operation of transmitting data for performing mirroring to the external electronic device through the second communication connection based on switching to the second communication method.
[0011] According to one embodiment, a non-transitory computer-readable storage medium (or a computer program product) storing one or more programs may be described. According to one embodiment, the one or more programs may include instructions that, when executed by a processor of an electronic device, include the following operations: performing a first communication connection with an external electronic device related to mirroring based on a Bluetooth method and a second communication connection with the external electronic device related to mirroring based on a wireless LAN method based on activation of mirroring; performing mirroring with the external electronic device through the first communication connection when the first communication connection is established before the second communication connection; switching mirroring with the external electronic device to the second communication connection when a condition for switching a communication method related to the second communication method is satisfied; and transmitting data for performing mirroring to the external electronic device through the second communication connection based on the switching to the second communication method.
[0012] According to an embodiment of the present invention, when performing mirroring with an external electronic device in an electronic device, a plurality of communication connections (or communication channels) based on a plurality of communication methods are performed with the external electronic device, and the communication connection is switched based on mirroring status information with the external electronic device, thereby reducing the delay of multimedia information transmitted to the external electronic device.
[0013] According to one embodiment, when performing mirroring with an external electronic device in an electronic device, mirroring can be performed adaptively to changes in the communication environment with the external electronic device by selectively performing buffer input control, bit rate adjustment, or change of communication connection (or communication channel) of the electronic device based on mirroring status information with the external electronic device.
[0014] In addition, various effects may be provided, either directly or indirectly, through this document.
[0015] The effects that can be obtained from the embodiments of the present invention are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the embodiments of the present invention belong from the description below.
[0016] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.
[0017] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.
[0018] FIG. 2 is a block diagram of an electronic device for performing mirroring with an external electronic device according to one embodiment.
[0019] FIG. 3 is a flowchart for switching a communication channel for mirroring in an electronic device according to one embodiment.
[0020] FIG. 4 is an example for activating a mirroring function via Bluetooth communication in an electronic device according to one embodiment.
[0021] FIG. 5 is an example for activating a mirroring function through BLE communication in an electronic device according to one embodiment.
[0022] FIG. 6 is an example for activating a mirroring function via wireless LAN communication in an electronic device according to one embodiment.
[0023] FIG. 7 is an example of a communication connection with an external electronic device related to a mirroring function via Bluetooth communication in an electronic device according to one embodiment.
[0024] FIG. 8 is an example of a communication connection with an external electronic device related to a mirroring function via wireless LAN communication in an electronic device according to one embodiment.
[0025] FIG. 9 is a flowchart for switching a communication channel for mirroring with an external electronic device in an electronic device according to one embodiment.
[0026] FIG. 10 is an example for mirroring with an external electronic device in an electronic device according to one embodiment.
[0027] FIG. 11 is a flowchart for providing mirroring with an external electronic device based on communication quality in an electronic device according to one embodiment.
[0028] FIG. 12 is a flowchart for providing mirroring with an external electronic device based on communication quality in an electronic device according to one embodiment.
[0029] The following examples are described in detail with reference to the attached drawings.
[0030] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0031] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0032] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of, but is not limited to, a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more thereof. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may also include a software structure.
[0033] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0034] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0035] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0036] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0037] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by a touch.
[0038] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0039] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0040] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0041] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0042] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0043] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0044] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).
[0045] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0046] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, Wi-Fi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0047] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, for example, new radio access technology (NR). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimizing terminal power and connecting multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate (or throughput). The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL) each, or 1 ms or less for round trip) for URLLC realization.According to one embodiment, the subscriber identification module (196) may include multiple subscriber identification modules. For example, the multiple subscriber identification modules may store different subscriber identification information.
[0048] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0049] In one embodiment, the antenna module (197) may form a high-frequency (e.g., mmWave) antenna module. In one embodiment, the high-frequency (e.g., mmWave) antenna module may include a printed circuit board, an RFIC positioned on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) positioned on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band. For example, the plurality of antennas may include patch array antennas and / or dipole array antennas.
[0050] At least some of the components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)).
[0051] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0052] An electronic device according to an embodiment disclosed in this document may take various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to an embodiment of this document is not limited to the aforementioned devices.
[0053] It should be understood that the embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to a specific embodiment, but include various modifications, equivalents, or substitutes of the embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the item, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0054] The term "module" used in one embodiment of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0055] An embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0056] The method according to one embodiment disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0057] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0058] FIG. 2 is a block diagram of an electronic device for performing mirroring with an external electronic device according to one embodiment. For example, the electronic device (101) of FIG. 2 may be at least partially similar to the electronic device (101) of FIG. 1 or may further include other embodiments of the electronic device.
[0059] According to one embodiment referring to FIG. 2, the electronic device (101) may include at least one of a processor (200), a first communication circuit (210), a second communication circuit (220), or a memory (230). According to one embodiment, the processor (200) may be substantially the same as the processor (120) of FIG. 1 or may be included in the processor (120). At least one of the first communication circuit (210) or the second communication circuit (220) may be substantially the same as the wireless communication module (192) of FIG. 1 or may be included in the wireless communication module (192). The memory (230) may be substantially the same as the memory (130) of FIG. 1 or may be included in the memory (130).
[0060] According to one embodiment, the processor (200) may control at least one of a first communication circuit (210), a second communication circuit (220), or a memory (230) that is operatively, functionally, and / or electrically connected. According to one embodiment, the processor (200) may include at least one of an application processor (AP) (e.g., the main processor (121) of FIG. 1) or a communication processor (CP) (e.g., the auxiliary processor (123) of FIG. 1 or the communication module (190) of FIG. 1). For example, the processor (200) may include at least one processor that includes a processing circuit.
[0061] According to one embodiment, the processor (200) may activate a mirroring function with an external electronic device (e.g., a smartwatch). For example, when a Bluetooth communication connection is established with the external electronic device, the processor (200) may activate the mirroring function based on request information related to the mirroring function received from the external electronic device via the first communication circuit (210). For example, the request information related to the mirroring function may be received from the external electronic device via a common channel of Bluetooth communication established with the external electronic device. For example, the mirroring function may include a function in which a plurality of electronic devices share multimedia information (or data) with each other through direct communication.
[0062] For example, the processor (200) may activate the mirroring function based on request information related to the mirroring function received from an external electronic device via BLE (Bluetooth low energy) communication based on the first communication circuit (210). For example, the request information related to the mirroring function may be included in a broadcast (advertise) message of the BLE communication and received from the external electronic device. For example, the broadcast message of the BLE communication may include information related to a communication method to which the external electronic device can connect.
[0063] For example, the processor (200) may activate the mirroring function based on request information related to the mirroring function received via a LAN from an external electronic device connected to the same local area network (LAN) as the electronic device (101).
[0064] For example, the processor (200) may activate the mirroring function based on the occurrence of an activation event related to the mirroring function. For example, the activation event related to the mirroring function may be generated based on at least one of a user input related to the mirroring function (e.g., a touch input or a voice input), the receipt of a control signal, a gesture input, or the execution of an application program or function related to the mirroring function (e.g., a menu related to mirroring).
[0065] For example, the processor (200) may activate the mirroring function based on request information related to the mirroring function of an external electronic device received from a server (e.g., server (108) of FIG. 1).
[0066] For example, when the mirroring function is activated, the processor (200) may execute an application program related to mirroring. When the application program related to mirroring is running, the processor (200) may also omit execution of the application program related to mirroring. For example, the application program related to mirroring may include an application program related to a camera.
[0067] For example, when the processor (200) activates the mirroring function, it can control the first communication circuit (210) or the second communication circuit (220) so that the first communication circuit (210) or the second communication circuit (220) in the inactive state is activated.
[0068] According to one embodiment, the processor (200) may control the first communication circuit (210) and the second communication circuit (220) to perform a communication connection with an external electronic device related to mirroring based on the activation of the mirroring function. For example, the processor (200) may control the first communication circuit (210) to perform a first communication connection with the external electronic device related to mirroring using a first communication method based on the activation of the mirroring function. The processor (200) may control the second communication circuit (220) to perform a second communication connection with the external electronic device related to mirroring using a second communication method based on the activation of the mirroring function. For example, the first communication method may be a short-range communication method that supports mirroring with the external electronic device, and may include at least one of Bluetooth communication and BLE communication. For example, the second communication method may be a short-range communication method different from the first communication method, and may include wireless LAN communication (e.g., Wi-Fi).
[0069] According to one embodiment, the processor (200) may control the first communication circuit (210) or the second communication circuit (220) to perform mirroring with the external electronic device through a communication connection that is preferentially completed (or established) with the external electronic device among the first communication connection or the second communication connection with the external electronic device. For example, when the first communication connection with the external electronic device is preferentially completed over the second communication connection, the processor (200) may control the first communication circuit (210) to perform mirroring with the external electronic device through the first communication connection. When the processor (200) performs mirroring with the external electronic device through the first communication connection, the processor (200) may control the second communication circuit (220) to operate in a low power mode. For example, the second communication circuit (220) may operate in a low power mode after completing (or establishing) the second communication connection with the external electronic device based on the control of the processor (200). For example, a second communication connection with an external electronic device may be maintained even in a low power mode of the second communication circuit (220).
[0070] For example, if a second communication connection with an external electronic device is completed with priority over the first communication connection, the processor (200) may control the second communication circuit (220) to perform mirroring with the external electronic device through the second communication connection. If mirroring with the external electronic device is performed through the second communication connection, the processor (200) may control the first communication circuit (210) to operate in a low power mode. For example, the first communication circuit (210) may operate in a low power mode after completing (or establishing) the first communication connection with the external electronic device based on the control of the processor (200). For example, the first communication connection with the external electronic device may be maintained even in the low power mode of the first communication circuit (210).
[0071] For example, the processor (200) may encode multimedia information that is being output, is being output, or will be output through an output device (not shown) (e.g., a display) of the electronic device (101) based on a specified coding method. The processor (200) may control the first communication circuit (210) or the second communication circuit (220) to transmit the encoded data to an external electronic device.
[0072] According to one embodiment, when performing mirroring with an external electronic device, the processor (200) may determine whether a specified switching condition related to a communication method is satisfied. For example, the processor (200) may determine whether a specified switching condition related to a communication method is satisfied based on at least one of: whether a communication connection of a communication method (e.g., a first communication method or a second communication method) that is not used for mirroring with an external electronic device is completed; user setting information related to mirroring; user usage history (or usage pattern) related to mirroring; power mode related to mirroring or the electronic device (101); shooting mode (e.g., photo taking or video taking); remaining battery level of the electronic device (101); connection information with an external power source; or quality of service (e.g., QoS) related to mirroring. For example, connection information with an external power source may indicate whether the electronic device (101) is connected to an external power source and is supplied with power (or current) from the external power source. For example, the quality of service related to mirroring may indicate the quality of service (or minimum quality of service) required for mirroring of the electronic device and the external electronic device. For example, the shooting mode may be considered in determining whether to switch the communication method based on the size (or quantity) of the image acquired based on the shooting mode of the electronic device (101). For example, the designated switching condition may include a designated first switching condition for determining whether to switch to a second communication connection while performing mirroring through a first communication connection with the external electronic device, and a designated second switching condition for determining whether to switch to the first communication connection while performing mirroring through a second communication connection with the external electronic device.
[0073] For example, when the processor (200) is performing mirroring through a first communication connection of a first communication method with an external electronic device, it can check whether a second communication connection of a second communication method is completed (or established). When the second communication connection based on the second communication method with the external electronic device is completed (or established), the processor (200) can determine whether a mirroring function can be provided based on the second communication method with the external electronic device. For example, a state that satisfies a specified first switching condition may include a state in which the second communication connection of the second communication method is completed and the mirroring function can be provided based on the second communication method with the external electronic device. For example, a state in which the specified first switching condition is not satisfied may include a state in which the second communication connection of the second communication method is not completed or a state in which the mirroring function cannot be provided based on the second communication method with the external electronic device.
[0074] For example, whether or not to provide a mirroring function based on the second communication method may be determined based on at least one of a power mode related to mirroring or the electronic device (101), a remaining battery level of the electronic device (101), a user's setting information related to mirroring, a user's usage history (or usage pattern) related to mirroring, connection information with an external power source, or a service quality related to mirroring. For example, if the processor (200) does not provide a low-power mode related to mirroring, it may determine that mirroring can be performed based on the second communication method with an external electronic device. For example, if the processor (200) provides a low-power mode related to mirroring, it may determine that mirroring cannot be performed based on the second communication method with an external electronic device.
[0075] For example, the processor (200) may not provide a low-power mode related to mirroring, and may determine that mirroring can be performed based on a second communication method with an external electronic device when the remaining battery level exceeds a specified remaining level. For example, the processor (200) may provide a low-power mode related to mirroring, but may determine that mirroring can be performed based on a second communication method with an external electronic device when the remaining battery level exceeds a specified remaining level. For example, the processor (200) may provide a low-power mode related to mirroring, or may determine that mirroring cannot be performed based on a second communication method with an external electronic device when the remaining battery level is below a specified remaining level.
[0076] For example, the processor (200) may determine that mirroring can be performed based on a second communication method with the external electronic device when the electronic device (101) is connected to an external power source, without providing a low-power mode related to mirroring. For example, the processor (200) may determine that mirroring can be performed based on a second communication method with the external electronic device when the electronic device (101) is connected to an external power source, without providing a low-power mode related to mirroring. For example, the processor (200) may determine that mirroring cannot be performed based on a second communication method with the external electronic device when the electronic device (101) is not connected to an external power source.
[0077] For example, the processor (200) may determine that mirroring can be performed based on a second communication method with an external electronic device if the quality of service related to mirroring exceeds a specified reference quality. For example, the processor (200) may not provide a low-power mode related to mirroring, and may determine that mirroring can be performed based on a second communication method with an external electronic device if the quality of service related to mirroring exceeds a specified reference quality. For example, the processor (200) may provide a low-power mode related to mirroring, or may determine that mirroring cannot be performed based on a second communication method with an external electronic device if the quality of service related to mirroring is below a specified reference quality.
[0078] For example, when the processor (200) is performing mirroring through a second communication connection of a second communication method with an external electronic device, it can check whether the first communication connection of the first communication method is completed (or established). When the first communication connection based on the first communication method with the external electronic device is completed (or established), the processor (200) can determine whether the mirroring function can be provided based on the second communication method with the external electronic device. For example, a state that satisfies a designated second transition condition may include a state in which the first communication connection of the first communication method is completed and the mirroring function cannot be provided based on the second communication method with the external electronic device. For example, a state in which the designated second transition condition is not satisfied may include a state in which the first communication connection of the first communication method is not completed or a state in which the mirroring function can be provided based on the second communication method with the external electronic device.
[0079] According to one embodiment, when the processor (200) determines that a specified switching condition (or a specified change condition) related to a communication method is satisfied while performing mirroring with an external electronic device, the processor (200) may control at least one of the first communication circuit (210) and the second communication circuit (220) to switch the communication method for mirroring with the external electronic device. For example, when the processor (200) determines that a specified first switching condition is satisfied while performing mirroring with the external electronic device through a first communication connection of the first communication method, the processor (200) may control at least one of the first communication circuit (210) and the second communication circuit (220) to switch the communication method for mirroring with the external electronic device to the second communication method. For example, if the processor (200) determines that a specified second switching condition is satisfied while performing mirroring through a second communication connection of a second communication method with an external electronic device, the processor (200) may control at least one of the first communication circuit (210) or the second communication circuit (220) to switch the communication method for mirroring with the external electronic device to the first communication method.
[0080] According to one embodiment, the processor (200) may control the first communication circuit (210) or the second communication circuit (220) to transmit data related to the first type of mirroring without inter-frame dependency to the external electronic device based on a switching of a communication method for mirroring with the external electronic device. For example, the processor (200) may control the first communication circuit (210) or the second communication circuit (220) to transmit data related to the first type of mirroring to the external electronic device for the first time after switching the communication method for mirroring with the external electronic device. After transmitting the first type of data to the external electronic device, the processor (200) may control the first communication circuit (210) or the second communication circuit (220) to transmit data related to the first type or a second type of mirroring different from the first type to the external electronic device. For example, the first type of data may include a frame without inter-frame dependency (e.g., an I (intra)-frame). For example, the second type of data may include a frame (e.g., a P(prediction)-frame) that includes difference information between frames. For example, data related to mirroring may include image data or video data, which is data for performing mirroring between the electronic device (101) and an external electronic device. For example, switching the communication method for mirroring may include switching (or changing) from the first communication method (or the first communication connection) to the second communication method (or the second communication connection) or switching (or changing) from the second communication method (or the second communication connection) to the first communication method (or the eleventh communication connection).
[0081] According to one embodiment, when the processor (200) performs mirroring with an external electronic device based on the first communication method or the second communication method, the processor (200) may collect status information related to mirroring with the external electronic device. For example, the status information related to mirroring with the external electronic device may be acquired (or received) from the external electronic device based on a specified first cycle. For example, the status information related to mirroring with the external electronic device may include at least one of a change in the quality (e.g., image quality) of data related to mirroring, a change in a power mode related to mirroring or the electronic device (101) (e.g., whether a low-power mode is used), a change in a communication quality related to mirroring, a remaining battery level of at least one of the electronic device (101) or the external electronic device, connection information with an external power source of the electronic device (101) or the external electronic device, an amount of data to be transmitted to the external electronic device (or a remaining amount of data), a time difference value of data with the external electronic device, or a quality of service (e.g., QoS) related to mirroring. For example, the amount of data to be transmitted to an external electronic device may indicate the size of the remaining data that the electronic device (101) was unable to transmit to the external electronic device through mirroring. For example, the amount of data to be transmitted to the external electronic device may be confirmed based on the difference value between the size of data registered (or stored) in the buffer related to mirroring with the electronic device (101) from a specified point in time and the size of data received by the external electronic device from the electronic device (101). For example, the amount of data to be transmitted to the external electronic device may be indicated by the amount of data stored in the buffer related to mirroring or the available capacity of the buffer related to mirroring. For example, the time difference value of data with the external electronic device may be confirmed based on the difference between the PTS (presentation time stamp) of data most recently encoded by the electronic device (101) and the PTS of data most recently decoded by the external electronic device.For example, the designated point in time may include the point in time at which the electronic device (101) receives status information related to mirroring from an external electronic device. For example, a change in the communication quality related to mirroring may occur based on an additional communication connection with another external electronic device based on the communication method used for mirroring with the external electronic device.
[0082] According to one embodiment, the processor (200) may control a mirroring operation according to changes in the communication environment based on status information related to mirroring while performing mirroring with an external electronic device based on the first communication method or the second communication method. For example, the control of the mirroring operation may include at least one of input control of a buffer related to mirroring, bit rate (e.g., codec bit rate) control, or switching of a communication method.
[0083] For example, the processor (200) may determine whether a control condition related to buffer input is satisfied based on state information related to mirroring while performing mirroring with an external electronic device based on the first communication method or the second communication method. If the processor (200) determines that the control condition related to buffer input is satisfied, the processor (200) may control the memory (230) to stop input of a buffer related to mirroring. For example, a state in which the control condition related to buffer input is satisfied may include a case in which the size of data to be transmitted to the external electronic device exceeds a specified second reference size. For example, a state in which the control condition related to buffer input is satisfied may include a case in which the size of data to be transmitted to the external electronic device exceeds a specified second reference size and the time for which input of the buffer is stopped is less than a specified reference time. For example, in a state in which buffer input is stopped, data output through an output device (e.g., a display) of the electronic device (101) may be restricted from being transmitted to the external electronic device through mirroring.
[0084] For example, the processor (200) may resume buffer input when the size of data to be transmitted to an external electronic device is less than a specified first reference size while buffer input is suspended. For example, the specified first reference size may be set to a value smaller than a specified second reference size as a reference size for determining whether to resume buffer input.
[0085] For example, the processor (200) can check whether the switching conditions of the communication method related to mirroring are satisfied when the size of data to be transmitted to an external electronic device exceeds a specified second reference size and the buffer input is interrupted for a specified reference time or longer.
[0086] For example, the processor (200) can check whether a condition related to bitrate adjustment is satisfied based on status information related to mirroring while performing mirroring with an external electronic device based on the first communication method or the second communication method.
[0087] For example, the processor (200) may determine whether a condition related to bitrate adjustment is satisfied based on state information related to mirroring while performing mirroring with an external electronic device based on the first communication method or the second communication method. If the processor (200) determines that the condition related to bitrate adjustment is satisfied, the processor may control the first communication circuit (210) or the second communication circuit (220) to reduce the bitrate of data related to mirroring to be transmitted to the external electronic device. For example, a state of satisfying a condition related to bitrate adjustment may include a case where a time difference value of data with the external electronic device exceeds a specified first reference time value. For example, a state of satisfying a condition related to bitrate adjustment may include a case where a time difference value of data with the external electronic device exceeds a specified first reference time value and a bitrate with the external electronic device exceeds a specified bitrate (e.g., a minimum bitrate).
[0088] For example, if the time difference value of data with the external electronic device is less than or equal to a first reference time value, the processor (200) may maintain the bitrate associated with mirroring with the external electronic device the same. For example, if the time difference value of data with the external electronic device is less than or equal to a first reference time value, the processor (200) may increase the bitrate associated with mirroring with the external electronic device by a specified reference value.
[0089] For example, adjusting the bitrate associated with mirroring may include a series of operations that adjust the size of data (e.g., encoded data) associated with mirroring for transmission by the electronic device (101) to an external electronic device.
[0090] For example, the processor (200) can check whether a switching condition of a communication method related to mirroring is satisfied when a time difference value of data with an external electronic device exceeds a specified first reference time value and a bit rate with the external electronic device is less than or equal to a specified bit rate (e.g., a minimum bit rate).
[0091] For example, the processor (200) may determine whether a switching condition of a communication method related to mirroring is satisfied based on state information related to mirroring while performing mirroring with an external electronic device based on a first communication method or a second communication method. For example, a state of satisfying a switching condition of a communication method related to mirroring may include a state in which the electronic device determines that the mirroring function can be provided based on a second communication method with the external electronic device when performing mirroring with the external electronic device based on the first communication method. For example, a state of satisfying a switching condition of a communication method related to mirroring may include a state in which the electronic device determines that the mirroring function cannot be provided based on a second communication method with the external electronic device when performing mirroring with the external electronic device based on the second communication method.
[0092] According to one embodiment, the first communication circuit (210) can transmit and / or receive signals and / or data with an external electronic device (e.g., electronic device (102 or 104) of FIG. 1) based on the first communication method.
[0093] According to one embodiment, the second communication circuit (220) can transmit and / or receive signals and / or data with an external electronic device (e.g., electronic device (102 or 104) of FIG. 1) based on the second communication method.
[0094] According to one embodiment, the memory (230) may at least temporarily store various data used by at least one component of the electronic device (101) (e.g., the processor (200), the first communication circuit (210), or the second communication circuit (220)). For example, the memory (230) may include a buffer related to mirroring with an external electronic device. According to one embodiment, the memory (230) may store various instructions that may be individually or collectively executed by the processor (200).
[0095] According to one embodiment, the external electronic device may output data related to mirroring received from the electronic device (101) to the outside. For example, the external electronic device may decode encoded data received from the electronic device (101) and output (e.g., display) the data through an output device (e.g., display) of the external electronic device. For example, the external electronic device may receive a first type of data related to mirroring from the electronic device (101) based on a change in a communication method for mirroring with the electronic device (101). The external electronic device may decode the first type of data and output (e.g., display) restored image data through an output device (e.g., display) of the external electronic device. For example, the external electronic device may receive a second type of data related to mirroring from the electronic device (101). The external electronic device may restore image data corresponding to the second type of data based on image data being output (e.g., displayed) through the output device (e.g., display) and decoding information of the second type of data. The external electronic device can output (e.g., display) image data corresponding to the second type of data through an output device (e.g., display) of the external electronic device.
[0096] According to one embodiment, an electronic device (e.g., an electronic device (101) of FIG. 1 or FIG. 2) may include a first communication circuit supporting Bluetooth communication (e.g., a wireless communication module (192) of FIG. 1 or a first communication circuit (210) of FIG. 2) and a second communication circuit supporting wireless LAN communication (e.g., a wireless communication module (192) of FIG. 1 or a second communication circuit (220) of FIG. 2), and at least one processor (e.g., a processor (120) of FIG. 1 or a processor (200) of FIG. 2)) and a memory (e.g., a memory (130) of FIG. 1 or a memory (230) of FIG. 2)) operatively connected to the first communication circuit and the second communication circuit. According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to perform a first communication connection with an external electronic device associated with the mirroring function through a first communication circuit and a second communication connection with the external electronic device associated with the mirroring function through a second communication circuit when the mirroring function is activated. According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to perform mirroring with the external electronic device through the first communication connection when the first communication connection is established before the second communication connection. According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to switch (or change) the mirroring function with the external electronic device to the second communication connection when a switching condition of a communication method associated with the second communication method is satisfied. According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to transmit data related to mirroring to an external electronic device via a second communication connection based on a switch to the second communication method.
[0097] According to one embodiment, the instructions may include instructions that, when executed by at least one processor, cause the electronic device to transmit data associated with a first type of mirroring without inter-frame dependency to an external electronic device via a second communication connection based on a switch to a second communication method. According to one embodiment, the instructions may include instructions that, when executed by at least one processor, cause the electronic device to transmit data associated with a second type of mirroring, different from the first type, to the external electronic device based on the transmission of the data associated with the first type of mirroring.
[0098] According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to collect state information related to a mirroring function with the external electronic device based on a specified period when the electronic device performs a mirroring function with the external electronic device through the first communication connection or the second communication connection.
[0099] According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to stop input of the buffer if the electronic device determines that a control condition related to input of the buffer is satisfied based on an amount of data (or remaining amount of data) to be transmitted to an external electronic device.
[0100] According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to determine whether a bitrate change condition is satisfied based on a time difference value of data with respect to an external electronic device if the electronic device determines that a control condition related to input of a buffer is not satisfied. According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to reduce a bitrate related to mirroring with the external electronic device if the electronic device determines that the bitrate change condition is satisfied.
[0101] According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to determine whether a condition for switching a communication method is satisfied based on state information related to mirroring if the electronic device determines that a control condition related to input of a buffer is not satisfied and a condition for changing a bitrate is not satisfied. According to one embodiment, the memory may store instructions that, when executed by at least one processor, cause the electronic device to switch a communication connection for mirroring with an external electronic device to a first communication connection or a second communication connection if the electronic device determines that a condition for switching a communication method is satisfied.
[0102] FIG. 3 is a flowchart (300) for switching a communication channel for mirroring in an electronic device according to one embodiment. In the following embodiments, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. For example, the electronic device of FIG. 3 may be the electronic device (101) of FIG. 1 or FIG. 2 .
[0103] According to one embodiment referring to FIG. 3, an electronic device (e.g., processor (120) of FIG. 1 or processor (200) of FIG. 2) may activate a mirroring function with an external electronic device in operation 301. For example, the processor (200) may activate the mirroring function based on request information related to the mirroring function received from the external electronic device. For example, the request information related to the mirroring function may be received from the external electronic device through a common channel (e.g., asynchronous connectionless (ACL)) of Bluetooth communication established with the external electronic device. For example, the request information related to the mirroring function may be included in an advertise message of Bluetooth low energy (BLE) communication and received from the external electronic device. For example, the request information related to the mirroring function may be received from the external electronic device through a local area network (LAN) to which the electronic device (101) and the external electronic device are connected. For example, the processor (200) may activate the mirroring function based on the occurrence of an activation event related to the mirroring function. For example, an activation event related to the mirroring function may be generated based on at least one of a user input related to the mirroring function (e.g., a touch input or a voice input), the receipt of a control signal, a gesture input, or the execution of an application program or function related to the mirroring function (e.g., a menu related to mirroring). For example, the processor (200) may activate the mirroring function based on request information related to the mirroring function of an external electronic device received from a server (e.g., the server (108) of FIG. 1).
[0104] According to one embodiment, the electronic device (e.g., the processor (120 or 200)) may perform a communication connection with an external electronic device related to mirroring through a first communication method and a second communication method based on activation of the mirroring function in operation 303. For example, the processor (200) may control the first communication circuit (210) to perform a first communication connection with the external electronic device related to mirroring through the first communication method based on activation of the mirroring function. The processor (200) may control the second communication circuit (220) to perform a second communication connection with the external electronic device related to mirroring through the second communication method based on activation of the mirroring function. For example, the first communication method is a short-range communication method that supports mirroring with the external electronic device, and may include at least one of Bluetooth communication and BLE communication. For example, the second communication method may be a short-range communication method different from the first communication method, and may include wireless LAN communication (e.g., Wi-Fi, Wi-Fi direct, NAN (neighbor awareness networking)).
[0105] According to one embodiment, the electronic device (e.g., the processor (120 or 200)) may perform mirroring with the external electronic device through a communication method in which the communication connection with the external electronic device is completed with priority among the first communication method and the second communication method, in operation 305. For example, if the first communication connection with the external electronic device is completed with priority over the second communication connection, the processor (200) may control the first communication circuit (210) to perform mirroring with the external electronic device through the first communication connection. If the processor (200) performs mirroring with the external electronic device through the first communication connection, the processor (200) may control the second communication circuit (220) to operate in a low power mode. For example, the second communication circuit (220) may operate in a low power mode after completing (or establishing) the second communication connection with the external electronic device based on the control of the processor (200). For example, a second communication connection with an external electronic device may be maintained even in a low power mode of the second communication circuit (220).
[0106] For example, if a second communication connection with an external electronic device is completed with priority over the first communication connection, the processor (200) may control the second communication circuit (220) to perform mirroring with the external electronic device through the second communication connection. If mirroring with the external electronic device is performed through the second communication connection, the processor (200) may control the first communication circuit (210) to operate in a low power mode. For example, the first communication circuit (210) may operate in a low power mode after completing (or establishing) the first communication connection with the external electronic device based on the control of the processor (200). For example, the first communication connection with the external electronic device may be maintained even in the low power mode of the first communication circuit (210).
[0107] For example, mirroring with an external electronic device may include a series of operations for encoding multimedia information being output, being output, or to be output through an output device (not shown) (e.g., a display) of the electronic device (101) based on a specified coding method and transmitting the encoded information to the external electronic device.
[0108] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may, in operation 307, determine whether a specified transition condition related to a communication method is satisfied while performing mirroring with an external electronic device. For example, the processor (200) may determine whether a specified transition condition related to a communication method is satisfied based on at least one of: whether a communication connection of a communication method (e.g., a first communication method or a second communication method) that is not used for mirroring with the external electronic device is completed; user setting information related to mirroring; user usage history (or usage pattern) related to mirroring; power mode related to mirroring or the electronic device (101); remaining battery level of the electronic device (101); connection information with an external power source; or quality of service (e.g., QoS) related to mirroring. For example, connection information with an external power source may indicate whether the electronic device (101) is connected to an external power source and is supplied with power (or current) from the external power source. For example, the quality of service associated with mirroring may indicate the quality of service (or minimum quality of service) required for mirroring of an electronic device and an external electronic device. For example, the designated switching conditions may include a designated first switching condition for determining whether to switch to a second communication connection while performing mirroring via a first communication connection with an external electronic device, and a designated second switching condition for determining whether to switch to the first communication connection while performing mirroring via a second communication connection with an external electronic device.
[0109] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may maintain mirroring with the external electronic device if a specified transition condition related to the communication method is not satisfied (e.g., 'No' in operation 307). For example, the processor (200) may determine to maintain the communication method being used for mirroring with the external electronic device if the specified transition condition related to the communication method is not satisfied. The processor (200) may control the first communication circuit (210) or the second communication circuit (220) to continuously or periodically transmit data related to mirroring to the external electronic device via the communication method being used for mirroring with the external electronic device.
[0110] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may change (or switch) the communication method for mirroring with an external electronic device in operation 309 if a specified switching condition related to a communication method is satisfied (e.g., 'Yes' in operation 307). For example, if the processor (200) determines that the specified first switching condition is satisfied while performing mirroring with the external electronic device through a first communication connection of a first communication method, the processor may control at least one of the first communication circuit (210) or the second communication circuit (220) to switch the communication method for mirroring with the external electronic device to a second communication method. For example, if the processor (200) determines that the specified second switching condition is satisfied while performing mirroring with the external electronic device through a second communication connection of a second communication method, the processor may control at least one of the first communication circuit (210) or the second communication circuit (220) to switch the communication method for mirroring with the external electronic device to the first communication method.
[0111] According to one embodiment, the electronic device (e.g., the processor (120 or 200)) may perform mirroring with the external electronic device through the changed (or switched) communication method based on the change in the communication method for mirroring with the external electronic device at operation 311. For example, the processor (200) may control the first communication circuit (210) or the second communication circuit (220) to transmit data related to the first type of mirroring to the external electronic device for the first time after switching the communication method for mirroring with the external electronic device. After transmitting the first type of data to the external electronic device, the processor (200) may control the first communication circuit (210) or the second communication circuit (220) to transmit data related to the first type or a second type of mirroring different from the first type to the external electronic device. For example, the first type of data may include a frame without inter-frame dependency (e.g., an I (intra)-frame). For example, the second type of data may include a frame containing difference information between frames (e.g., a P(prediction)-frame).
[0112] FIG. 4 is an example for activating a mirroring function via Bluetooth communication in an electronic device according to one embodiment.
[0113] According to one embodiment referring to FIG. 4, the electronic device (101) can establish communication with an external electronic device (400) via Bluetooth communication (operation 411). For example, the electronic device (101) can create a shared channel with the external electronic device (400) via Bluetooth communication.
[0114] According to one embodiment, the external electronic device (400) may detect an active event related to a mirroring function with the electronic device (101) (operation 413). For example, the active event related to the mirroring function may be generated based on at least one of a user input related to the mirroring function with the electronic device (101) (e.g., a touch input or a voice input), the receipt of a control signal, a gesture input, or the execution of an application program or function related to the mirroring function (e.g., a menu related to mirroring or a camera function related to the electronic device (101). For example, the application program related to the mirroring function may include an application program related to a camera. For example, the external electronic device (400) may determine that an active event related to the mirroring function with the electronic device (101) has occurred when an application program related to a camera is executed based on a user input.
[0115] According to one embodiment, the external electronic device (400) may transmit a request packet related to the mirroring function to the electronic device (101) through a common channel based on detection of an active event related to the mirroring function with the electronic device (101) (operation 415). For example, the external electronic device (400) may activate the mirroring function with the electronic device (101) based on detection of an active event related to the mirroring function or transmission of a request packet related to the mirroring function. For example, when the external electronic device (400) recognizes the occurrence of an active event related to the mirroring function based on execution of an application program related to a camera, the external electronic device (400) may transmit a request packet related to the mirroring function and information related to the execution of the application program related to the camera to the electronic device (101).
[0116] According to one embodiment, the electronic device (101) may activate a mirroring function with the external electronic device (400) based on receiving a request packet related to the mirroring function through a common channel with the external electronic device (400) (operation 417). For example, the electronic device (101) may execute a camera-related application program based on information related to the execution of the camera-related application program received through the common channel with the external electronic device (400).
[0117] According to one embodiment, the electronic device (101) and the external electronic device (400) can perform a first communication connection of a first communication method for mirroring and a second communication connection of a second communication method based on activation of the mirroring function. For example, when at least one of the electronic device (101) or the external electronic device (400) activates the mirroring function, it can activate at least one of a communication circuit of the first communication method (e.g., the first communication circuit (210)) or a communication circuit of the second communication method (e.g., the second communication circuit (220)) that is in an inactive state. The electronic device (101) and the external electronic device (400) can perform the first communication connection of the first communication method and the second communication connection of the second communication method through the communication circuits that are in an active state.
[0118] According to one embodiment, the electronic device (101) may transmit information related to an image (e.g., a preview image) acquired through a camera (not shown) of the electronic device (101) to the external electronic device (400) via a first communication connection or a second communication connection selected for mirroring with the external electronic device (400). For example, the electronic device (101) may continuously or periodically transmit information related to an image (e.g., a preview image) acquired through a camera (not shown) to the external electronic device (400). For example, selection of the first communication connection or the second communication connection may be performed based on FIG. 3, FIG. 9, or FIG. 11.
[0119] According to one embodiment, the external electronic device (400) may output (e.g., display) information (or an image) corresponding to an image (e.g., a preview image) acquired by the electronic device (101) through a camera through an output device (e.g., a display) of the external electronic device (400) based on information related to an image (e.g., a preview image) received from the electronic device (101) via a first communication connection or a second communication connection. The external electronic device (400) may transmit information related to image acquisition to the electronic device (101) via the first communication connection or the second communication connection based on reception (or acquisition) of an input related to image acquisition (e.g., photographing).
[0120] According to one embodiment, the electronic device (101) may perform a photographing operation on an image (e.g., a still image or a video) based on information related to image acquisition obtained from an external electronic device (400) via a first communication connection or a second communication connection. For example, the electronic device (101) may transmit information related to a photographed image (e.g., a still image or a video) to the external electronic device (400) via the first communication connection or the second communication connection.
[0121] According to one embodiment, the external electronic device (400) may output (e.g., display) information (or a captured image) corresponding to an image (e.g., a still image or a moving image) captured by the electronic device (101) through an output device (e.g., a display) of the external electronic device (400) based on information related to the captured image (e.g., a still image or a moving image) received from the electronic device (101) via the first communication connection or the second communication connection.
[0122] According to one embodiment, the electronic device (101) can activate the mirroring function based on the occurrence of an active event related to the mirroring function. When the electronic device (101) activates the mirroring function based on the occurrence of an active event related to the mirroring function, the electronic device (101) can transmit a request packet related to the mirroring function to the external electronic device (400) through a common channel with the external electronic device (400). The external electronic device can activate the mirroring function with the electronic device (101) based on the request packet related to the mirroring function received through the common channel with the electronic device (101).
[0123] FIG. 5 is an example for activating a mirroring function through BLE communication in an electronic device according to one embodiment.
[0124] According to one embodiment referring to FIG. 5, the electronic device (101) may wait for reception of a BLE packet based on the BLE communication method (e.g., scan operation) (operation 511). According to one embodiment, the external electronic device (400) may also wait for reception of a BLE packet based on the BLE communication method (operation 513). For example, the operation of waiting for reception of a BLE packet in the external electronic device (400) (e.g., scan operation) may be omitted.
[0125] In one embodiment, the external electronic device (400) may detect an active event related to a mirroring function with the electronic device (101) (operation 515). For example, the active event related to the mirroring function may be generated based on at least one of a user input (e.g., a touch input or a voice input), reception of a control signal, a gesture input, or execution of an application program or function related to the mirroring function with the electronic device (101).
[0126] According to one embodiment, the external electronic device (400) may transmit a request packet related to the mirroring function to the electronic device (101) via a broadcast (advertise) message of BLE communication based on detection of an active event related to the mirroring function with the electronic device (101) (operation 517). For example, the external electronic device (400) may activate the mirroring function with the electronic device (101) based on detection of an active event related to the mirroring function or transmission of a request packet related to the mirroring function. For example, the broadcast message of BLE communication may include information related to a communication method to which the external electronic device (400) is connectable.
[0127] According to one embodiment, the electronic device (101) can activate a mirroring function with an external electronic device (400) based on reception of a request packet related to the mirroring function via a broadcast message of BLE communication (operation 519).
[0128] According to one embodiment, the electronic device (101) and the external electronic device (400) can perform a first communication connection using a first communication method for mirroring and a second communication connection using a second communication method based on the activation of the mirroring function. For example, the electronic device (101) can perform a first communication connection using a first communication method for mirroring and a second communication connection using a second communication method with the external electronic device (400) based on information related to a communication method to which the external electronic device (400) can connect, as confirmed in a broadcast message of BLE communication.
[0129] According to one embodiment, the electronic device (101) can activate the mirroring function based on the occurrence of an active event related to the mirroring function. When the electronic device (101) activates the mirroring function based on the occurrence of an active event related to the mirroring function, the electronic device (101) can transmit a request packet related to the mirroring function to an external electronic device (400) via a broadcast message of BLE communication. The external electronic device can activate the mirroring function with the electronic device (101) based on the request packet related to the mirroring function received from the electronic device (101) via the broadcast message of BLE communication.
[0130] FIG. 6 is an example for activating a mirroring function via wireless LAN communication in an electronic device according to one embodiment.
[0131] According to one embodiment referring to FIG. 6, the electronic device (101) and the external electronic device (400) may be connected to the same local area network (LAN) (e.g., access point (AP)) (operation 611). For example, the electronic device (101) may transmit (or broadcast) a request signal related to connection confirmation through the LAN (e.g., AP) to which the electronic device (101) is connected. The electronic device (101) may determine that the external electronic device (400) is connected to the same LAN (e.g., AP) as the electronic device (101) based on a response signal to the request signal related to connection confirmation.
[0132] According to one embodiment, when the electronic device (101) and the external electronic device (400) are connected to the same LAN (e.g., AP) (operation 611), they may wait for reception of a discovery packet through the LAN (e.g., AP) (operations 613 and 615).
[0133] In one embodiment, the external electronic device (400) may detect an active event related to a mirroring function with the electronic device (101) (operation 515). For example, the active event related to the mirroring function may be generated based on at least one of a user input (e.g., a touch input), receipt of a control signal, a gesture input, or execution of an application program or function related to the mirroring function with the electronic device (101).
[0134] According to one embodiment, the external electronic device (400) may transmit (or broadcast) an Internet Protocol (IP) discovery packet containing request information related to the mirroring function to the electronic device (101) via a LAN (e.g., an AP) based on detection of an active event related to the mirroring function with the electronic device (101) (operation 619).
[0135] According to one embodiment, the electronic device (101) may activate a mirroring function with an external electronic device (400) based on receipt of a request packet related to the mirroring function through a LAN to which the electronic device (101) is connected (operation 621).
[0136] According to one embodiment, the electronic device (101) may transmit (or broadcast) an IP discovery packet containing response information related to the mirroring function to an external electronic device (400) (operation 623).
[0137] According to one embodiment, the external electronic device (400) may activate a mirroring function with the electronic device (101) based on receiving a response packet related to the mirroring function through a LAN to which the electronic device (101) is connected (operation 625).
[0138] According to one embodiment, the electronic device (101) and the external electronic device (400) can perform a first communication connection of a first communication method for mirroring and a second communication connection of a second communication method based on activation of the mirroring function. For example, when at least one of the electronic device (101) or the external electronic device (400) activates the mirroring function, it can activate at least one of a communication circuit of the first communication method (e.g., the first communication circuit (210)) or a communication circuit of the second communication method (e.g., the second communication circuit (220)) that is in an inactive state. The electronic device (101) and the external electronic device (400) can perform the first communication connection of the first communication method and the second communication connection of the second communication method through the communication circuits that are in an active state.
[0139] According to one embodiment, the electronic device (101) can activate the mirroring function based on the occurrence of an active event related to the mirroring function. When the electronic device (101) activates the mirroring function based on the occurrence of an active event related to the mirroring function, the electronic device (101) can transmit an Internet protocol (IP) discovery packet including request information related to the mirroring function to an external electronic device (400) via a LAN (e.g., an AP). The external electronic device can activate the mirroring function with the electronic device (101) based on the reception of a request packet related to the mirroring function via a LAN (e.g., an AP) to which the external electronic device is connected.
[0140] FIG. 7 is an example of a communication connection with an external electronic device related to a mirroring function via Bluetooth communication in an electronic device according to one embodiment.
[0141] According to one embodiment referring to FIG. 7, the electronic device (101) may transmit a request signal related to a serial port profile (SPP) connection to the external electronic device (400) for a first communication connection of a first communication method related to mirroring based on activation of a mirroring function with the external electronic device (400) (operation 713).
[0142] According to one embodiment, the external electronic device (400) may operate in an SPP standby state based on the activation of the mirroring function with the electronic device (101) (operation 711). When the external electronic device (400) receives a request signal related to an SPP connection from the electronic device (101) in the SPP standby state (operation 713), the external electronic device (400) may determine whether to accept the request related to the SPP connection.
[0143] According to one embodiment, the electronic device (101) and the external electronic device (400) may create a communication channel for mirroring based on the first communication method when the external electronic device (400) accepts a request related to an SPP connection of the electronic device (101) (operation 715).
[0144] FIG. 8 is an example of a communication connection with an external electronic device related to a mirroring function via wireless LAN communication in an electronic device according to one embodiment.
[0145] According to one embodiment referring to FIG. 8, the external electronic device (400) can activate the mirroring function with the electronic device (101) (operation 811). For example, the external electronic device (400) can activate the mirroring function with the electronic device (101) based on the detection of an active event related to the mirroring function or the transmission of a request packet related to the mirroring function, as shown in FIG. 4 or FIG. 5. For example, the external electronic device (400) can activate the mirroring function with the electronic device (101) based on the reception of a response packet related to the mirroring function from the electronic device (101) via Bluetooth or BLE communication. For example, the external electronic device (400) can activate the mirroring function with the electronic device (101) based on the reception of a response packet related to the mirroring function via a LAN to which the electronic device (101) is connected, as shown in FIG. 6.
[0146] According to one embodiment, the external electronic device (400) may transmit a network connection request message related to a wireless LAN to the electronic device (101) based on the activation of a mirroring function with the electronic device (101) (operation 813). For example, the network connection request message related to a wireless LAN may include connection request information for direct communication related to a wireless LAN between the electronic device (101) and the external electronic device (400).
[0147] According to one embodiment, when the electronic device (101) receives a network connection request message related to a wireless LAN from the external electronic device (400) while the mirroring function with the external electronic device (400) is activated, the electronic device (101) can determine whether to accept the network connection request related to the wireless LAN of the external electronic device (400) (operation 815).
[0148] According to one embodiment, the electronic device (101) and the external electronic device (400) may create a communication channel for mirroring based on the second communication method (operation 817) when the electronic device (101) accepts a network connection request related to a wireless LAN (operation 815).
[0149] FIG. 9 is a flowchart (900) for switching a communication channel for mirroring with an external electronic device in an electronic device according to one embodiment. For example, at least a portion of FIG. 9 may include detailed operations of operations 305 to 309 of FIG. 3 . In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. For example, the electronic device of FIG. 9 may be the electronic device (101) of FIG. 1 or FIG. 2 .
[0150] According to one embodiment referring to FIG. 9, when an electronic device (e.g., a processor (120) of FIG. 1 or a processor (200) of FIG. 2) performs a communication connection with an external electronic device related to mirroring through a first communication method and a second communication method based on activation of a mirroring function (e.g., operation 303 of FIG. 3), in operation 901, it can be confirmed whether the communication connection with the external electronic device based on the first communication method is completed with priority over the second communication method.
[0151] According to one embodiment, if a communication connection with an external electronic device based on a first communication method is preferentially completed (e.g., 'Yes' in operation 901), the electronic device (e.g., processor (120 or 200)) may perform mirroring with the external electronic device through the first communication connection of the first communication method in operation 903. For example, the processor (200) may encode multimedia information output through an output device (not shown) (e.g., a display) of the electronic device (101) based on a specified coding method. The processor (200) may control the first communication circuit (210) to transmit the encoded data to the external electronic device.
[0152] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may, at operation 905, determine whether a second communication connection of a second communication method with the external electronic device is completed while performing mirroring with the external electronic device through the first communication connection.
[0153] According to one embodiment, when a communication connection with an external electronic device based on a second communication method is completed (e.g., 'Yes' in operation 905), the electronic device (e.g., the processor (200)) may determine whether mirroring with the external electronic device based on the second communication method can be performed in operation 907. For example, the processor (200) may determine whether mirroring based on the second communication method can be performed based on at least one of a power mode related to mirroring or the electronic device (101), a remaining battery level of the electronic device (101), user setting information related to mirroring, user usage history (or usage pattern) related to mirroring, connection information with an external power source, or service quality related to mirroring. For example, when the processor (200) does not provide a low power mode related to mirroring, the processor (200) may determine that mirroring can be performed with the external electronic device based on the second communication method. For example, if the processor (200) provides a low power mode related to mirroring, it may determine that mirroring cannot be performed based on a second communication method with an external electronic device.
[0154] For example, the processor (200) may not provide a low-power mode related to mirroring, and may determine that mirroring can be performed based on a second communication method with an external electronic device when the remaining battery level exceeds a specified remaining level. For example, the processor (200) may provide a low-power mode related to mirroring, but may determine that mirroring can be performed based on a second communication method with an external electronic device when the remaining battery level exceeds a specified remaining level. For example, the processor (200) may provide a low-power mode related to mirroring, or may determine that mirroring cannot be performed based on a second communication method with an external electronic device when the remaining battery level is below a specified remaining level.
[0155] For example, the processor (200) may determine that mirroring can be performed based on a second communication method with the external electronic device when the electronic device (101) is connected to an external power source, without providing a low-power mode related to mirroring. For example, the processor (200) may determine that mirroring can be performed based on a second communication method with the external electronic device when the electronic device (101) is connected to an external power source, without providing a low-power mode related to mirroring. For example, the processor (200) may determine that mirroring cannot be performed based on a second communication method with the external electronic device when the electronic device (101) is not connected to an external power source.
[0156] For example, the processor (200) may determine that mirroring can be performed based on a second communication method with an external electronic device if the quality of service related to mirroring exceeds a specified reference quality. For example, the processor (200) may not provide a low-power mode related to mirroring, and may determine that mirroring can be performed based on a second communication method with an external electronic device if the quality of service related to mirroring exceeds a specified reference quality. For example, the processor (200) may provide a low-power mode related to mirroring, or may determine that mirroring cannot be performed based on a second communication method with an external electronic device if the quality of service related to mirroring is below a specified reference quality.
[0157] According to one embodiment, when the electronic device (e.g., processor (120 or 200)) determines that mirroring with an external electronic device based on the second communication method can be performed (e.g., 'Yes' in operation 907), in operation 909, the electronic device may switch the communication method for mirroring with the external electronic device to the second communication method. For example, after switching to the second communication method for mirroring with the external electronic device, the processor (200) may control the second communication circuit (220) to transmit data related to the first type of mirroring to the external electronic device for the first time. After transmitting the first type of data to the external electronic device, the processor (200) may control the second communication circuit (220) to transmit data related to the first type or a second type of mirroring different from the first type to the external electronic device.
[0158] According to one embodiment, if the electronic device (e.g., processor (120 or 200)) determines that the communication connection with the external electronic device based on the second communication method is not completed (e.g., 'No' in operation 905) or that mirroring with the external electronic device based on the second communication method cannot be performed (e.g., 'No' in operation 907), then in operation 911, the electronic device can maintain mirroring with the external electronic device by the first communication connection of the first communication method.
[0159] According to one embodiment, if a communication connection with an external electronic device based on a second communication method is preferentially completed (e.g., 'No' in operation 901), the electronic device (e.g., processor (120 or 200)) may perform mirroring with the external electronic device through the second communication connection of the second communication method in operation 913. For example, the processor (200) may encode multimedia information output through an output device (not shown) (e.g., a display) of the electronic device (101) based on a specified coding method. The processor (200) may control the second communication circuit (220) to transmit the encoded data to the external electronic device.
[0160] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may, at operation 915, determine whether a first communication connection of a first communication method with the external electronic device is completed while performing mirroring with the external electronic device via a second communication connection.
[0161] According to one embodiment, when a communication connection with an external electronic device based on a first communication method is completed (e.g., 'Yes' in operation 915), the electronic device (e.g., processor (120 or 200)) may determine whether mirroring with an external electronic device based on a second communication method can be performed in operation 917. For example, the processor (200) may determine whether mirroring based on the second communication method can be performed based on at least one of a power mode related to mirroring or the electronic device (101), a remaining battery level of the electronic device (101), connection information with an external power source, or a service quality related to mirroring.
[0162] According to one embodiment, when the electronic device (e.g., processor (120 or 200)) determines that mirroring with an external electronic device based on the second communication method cannot be performed (e.g., 'NO' in operation 917), in operation 919, the electronic device may switch the communication method for mirroring with the external electronic device to the first communication method. For example, after switching to the first communication method for mirroring with the external electronic device, the processor (200) may control the first communication circuit (210) to transmit data related to the first type of mirroring to the external electronic device for the first time. After transmitting the first type of data to the external electronic device, the processor (200) may control the first communication circuit (210) to transmit data related to the first type or a second type of mirroring different from the first type to the external electronic device.
[0163] According to one embodiment, if the electronic device (e.g., processor (120 or 200)) determines that the communication connection with the external electronic device based on the first communication method is not completed (e.g., 'No' in operation 915) or that mirroring with the external electronic device based on the second communication method can be performed (e.g., 'Yes' in operation 917), then in operation 911, the electronic device can maintain the mirroring with the external electronic device by the second communication connection of the second communication method.
[0164] FIG. 10 is an example for mirroring with an external electronic device in an electronic device according to one embodiment.
[0165] According to one embodiment referring to FIG. 10, when performing mirroring with an external electronic device (400), the electronic device (101) may generate image data (or multimedia information) for mirroring with the external electronic device (400) (operation 1011). For example, the electronic device (101) may encode multimedia data that is being output (e.g., displayed) through an output device (e.g., a display) of the electronic device (101), is being output, or is to be output, based on a specified coding method.
[0166] According to one embodiment, the electronic device (101) can transmit image data to an external electronic device (400) via a first communication connection of a first communication method or a second communication connection of a second communication method (operation 1013).
[0167] According to one embodiment, the external electronic device (400) may output (e.g., display) image data received from the electronic device (101) through an output device (e.g., display) of the external electronic device (400) (operation 1015). For example, the external electronic device (400) may decode encoded data received from the electronic device (101) based on a specified coding method. The external electronic device (400) may output (e.g., display) the decoded image data through an output device (e.g., display) of the external electronic device (400).
[0168] According to one embodiment, the electronic device (101) and the external electronic device (400) may perform mirroring on image data based on a specified second cycle (operations 1017 to 1019). For example, when a specified cycle related to mirroring with the external electronic device (400) arrives, the electronic device (101) may generate image data (or multimedia information) for mirroring with the external electronic device (400) (operation 1017). The electronic device (101) may transmit the image data to the external electronic device (400) via a first communication connection of a first communication method or a second communication connection of a second communication method (operation 1019). The external electronic device (400) may output (e.g., display) the image data received from the electronic device (101) via an output device (e.g., display) of the external electronic device (400) (operation 1021).
[0169] According to one embodiment, when performing mirroring with the electronic device (101), the external electronic device (400) may transmit status information related to mirroring to the electronic device (101) based on a designated first cycle (operation 1023). For example, the designated first cycle may be a cycle at which the external electronic device (400) transmits status information related to mirroring to the electronic device (101), and may be set through consultation with the electronic device (101). For example, the designated first cycle may be set to be the same as or longer than a designated second cycle. For example, the status information related to mirroring may include at least one of: a remaining battery capacity of the external electronic device (400), connection information of the external electronic device (400) with an external power source, information related to the size of data received by the external electronic device (400) from the electronic device (101) from a designated point in time, or information related to a PTS of data most recently decoded by the external electronic device (400).
[0170] FIG. 11 is a flowchart (1100) for providing mirroring with an external electronic device based on communication quality in an electronic device according to one embodiment. In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. For example, the electronic device of FIG. 11 may be the electronic device (101) of FIG. 1 or FIG. 2.
[0171] According to one embodiment referring to FIG. 11, an electronic device (e.g., a processor (120) of FIG. 1 or a processor (200) of FIG. 2) may perform mirroring with an external electronic device through a first communication connection of a first communication method or a second communication connection of a second communication method in operation 1101. For example, the processor (200) may encode multimedia information output through an output device (not shown) (e.g., a display) of the electronic device (101) based on a specified coding method. The processor (200) may control the first communication circuit (210) or the second communication circuit (220) to transmit the encoded data to the external electronic device.
[0172] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may collect status information related to mirroring while performing mirroring with an external electronic device in operation 1103. For example, the status information related to mirroring may include status information of the electronic device (101) related to mirroring with the external electronic device and status information of the external electronic device related to mirroring with the electronic device (101). For example, the status information related to mirroring may include at least one of a change in the quality (e.g., image quality) of data related to mirroring, a change in a power mode related to mirroring or the electronic device (101) (e.g., whether a low power mode is used), a change in a communication quality related to mirroring, a remaining battery level of at least one of the electronic device (101) or the external electronic device, connection information of the electronic device (101) or the external electronic device with an external power source, an amount of data to be transmitted to the external electronic device (or a remaining amount of data), a time difference value of data with the external electronic device, or a quality of service (e.g., QoS) related to mirroring.
[0173] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may, at operation 1105, determine whether a specified condition related to buffer input is satisfied based on state information related to mirroring while performing mirroring with an external electronic device. For example, the processor (200) may determine whether a specified condition related to buffer input is satisfied based on the amount of data to be transmitted to the external electronic device. For example, the amount of data to be transmitted to the external electronic device may be determined based on a difference value between the size of data registered (or stored) in the buffer related to mirroring between the electronic device (101) and the buffer related to mirroring from a specified point in time and the size of data received by the external electronic device from the electronic device (101). For example, the amount of data to be transmitted to the external electronic device may also be represented by the amount of data stored in the buffer related to mirroring or the available capacity of the buffer related to mirroring.
[0174] According to one embodiment, when the electronic device (e.g., processor (120 or 200)) determines that a specified condition related to buffer input is satisfied (e.g., 'Yes' in operation 1105), in operation 1107, the electronic device may stop inputting a buffer related to mirroring with an external electronic device. For example, the processor (200) may store (or register) data related to mirroring for transmission to the external electronic device through mirroring in the buffer. When the buffer input is stopped, the processor (200) may stop at least one of the generation of data related to mirroring for transmission to the external electronic device or the inputting of the buffer. For example, when the buffer input is stopped, data output through an output device (e.g., a display) of the electronic device (101) may be restricted from being transmitted to the external electronic device through mirroring. For example, a state in which a control condition related to buffer input is satisfied may include a case in which the size of data for transmission to the external electronic device exceeds a specified second reference size. For example, a state that satisfies a control condition related to buffer input may include a case where the size of data to be transmitted to an external electronic device exceeds a specified second reference size, and the time for which input to the buffer was stopped is less than a specified reference time.
[0175] According to one embodiment, when the electronic device (e.g., processor (120 or 200)) determines that a specified condition related to buffer input is not satisfied (e.g., 'No' in operation 1105), in operation 1109, the processor (200) may determine whether a specified condition related to bitrate adjustment is satisfied based on state information related to mirroring. For example, the processor (200) may determine whether a specified condition related to bitrate adjustment is satisfied based on a time difference value of data with respect to an external electronic device. For example, the time difference value of data with respect to the external electronic device may be determined based on a difference between a presentation time stamp (PTS) of data most recently encoded by the electronic device (101) and a PTS of data most recently decoded by the external electronic device. For example, a state in which a control condition related to buffer input is not satisfied may include a case in which a size of data to be transmitted to the external electronic device is less than or equal to a specified second reference size or a case in which a time for which input of the buffer is stopped exceeds a specified reference time.
[0176] According to one embodiment, when the electronic device (e.g., processor (120 or 200)) determines that a specified condition related to bitrate adjustment is satisfied (e.g., 'Yes' in operation 1109), in operation 1111, the electronic device may adjust a bitrate of data related to mirroring to be transmitted to the external electronic device. For example, adjusting the bitrate related to mirroring may include a series of operations in which the electronic device (101) adjusts a size of data related to mirroring (e.g., encoded data) to be transmitted to the external electronic device. As an example, a state in which the condition related to bitrate adjustment is satisfied may include a case in which a time difference value of data with the external electronic device exceeds a specified first reference time value. As an example, a state in which the condition related to bitrate adjustment is satisfied may include a case in which a time difference value of data with the external electronic device exceeds a specified first reference time value, and a bitrate with the external electronic device exceeds a specified bitrate (e.g., a minimum bitrate).
[0177] According to one embodiment, when the electronic device (e.g., processor (120 or 200)) determines that a specified condition related to bitrate control is not satisfied (e.g., 'No' in operation 1109), in operation 1113, the processor (200) may determine whether a condition for switching a communication method related to mirroring is satisfied based on state information related to mirroring. For example, the processor (200) may determine whether a condition for switching a communication method related to mirroring is satisfied based on at least one of a power mode related to mirroring or the electronic device (101), a remaining battery level of the electronic device (101), connection information with an external power source, or a service quality related to mirroring.
[0178] According to one embodiment, when the electronic device (e.g., processor (120 or 200)) determines that a condition for switching a communication method related to mirroring is satisfied (e.g., 'Yes' in operation 1113), in operation 1115, the electronic device may switch the communication method for mirroring with the external electronic device. For example, when the processor (200) determines that the mirroring function can be provided based on a second communication method based on state information related to mirroring while performing mirroring with the external electronic device through a first communication connection of a first communication method, the processor may determine to switch the communication method for mirroring with the external electronic device to the second communication method. For example, when the processor (200) determines that the mirroring function cannot be provided based on the second communication method based on state information related to mirroring while performing mirroring with the external electronic device through a second communication connection of a second communication method, the processor may determine to switch the communication method for mirroring with the external electronic device to the first communication method.
[0179] According to one embodiment, when the electronic device (101) switches the communication method for mirroring while performing mirroring with an external electronic device, the electronic device may transmit data related to the first type of mirroring to the external electronic device to prevent a deterioration in the quality of mirroring.
[0180] FIG. 12 is a flowchart (1200) for providing mirroring with an external electronic device based on communication quality in an electronic device according to one embodiment. For example, at least a portion of FIG. 12 may include detailed operations of operations 1105 to 1111 of FIG. 11. In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. For example, the electronic device of FIG. 12 may be the electronic device (101) of FIG. 1 or FIG. 2.
[0181] According to one embodiment referring to FIG. 12, when an electronic device (e.g., processor (120) of FIG. 1 or processor (200) of FIG. 2) collects status information related to mirroring while performing mirroring with an external electronic device (e.g., operation 1103 of FIG. 11), in operation 1201, it may determine whether the amount of data to be transmitted to the external electronic device is smaller than a specified first reference size. For example, the specified first reference size may include a reference value set for determining whether to resume buffer input.
[0182] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may determine whether buffer input is stopped in operation 1203 when the amount of data to be transmitted to the external electronic device is less than a specified first reference size (e.g., 'Yes' in operation 1201). For example, the processor (200) may determine that the quality of the communication connection for mirroring with the external electronic device satisfies the quality of service of mirroring when the amount of data to be transmitted to the external electronic device is less than the specified first reference size.
[0183] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may resume buffer input related to mirroring in operation 1205 when buffer input is in a suspended state (e.g., 'yes' in operation 1203). For example, the processor (200) may store (or register) data related to mirroring from the point in time when buffer input related to mirroring is resumed in the buffer. As an example, the data related to mirroring may include multimedia information (or data) output (e.g., displayed) through an output device (e.g., a display) of the electronic device (101).
[0184] In one embodiment, an electronic device (e.g., processor (120 or 200)) may terminate an embodiment for providing mirroring with an external electronic device based on communication quality if the buffer input is not in a suspended state (e.g., 'No' in operation 1203).
[0185] According to one embodiment, if the amount of data to be transmitted to the external electronic device (e.g., processor (120 or 200)) is greater than or equal to a specified first reference size (e.g., 'No' in operation 1201), in operation 1207, the electronic device may determine whether the amount of data to be transmitted to the external electronic device exceeds a specified second reference size. For example, the specified second reference size may include a value greater than the specified first reference size, which is a reference value set for determining whether to stop buffer input.
[0186] According to one embodiment, if the amount of data to be transmitted to the external electronic device (e.g., processor (120 or 200)) exceeds a specified second reference size (e.g., 'Yes' in operation 1207), in operation 1209, the electronic device may determine whether an input interruption time of a buffer associated with mirroring has been maintained for a specified time (e.g., about 5 seconds).
[0187] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may, in operation 1211, stop the buffer input associated with mirroring or maintain the stopped state of the buffer input if the input stop time of the buffer associated with mirroring is not maintained for a specified time (e.g., about 5 seconds) (e.g., 'No' in operation 1209).
[0188] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may terminate an embodiment for providing mirroring with an external electronic device based on communication quality if the input interruption time of a buffer related to mirroring is maintained for a specified period of time (e.g., about 5 seconds) (e.g., 'Yes' in operation 1209). For example, if the input interruption time of a buffer related to mirroring is maintained for a specified period of time (e.g., about 5 seconds), but the amount of data to be transmitted to the external electronic device (or the remaining amount of data) exceeds a specified second reference size, the processor (200) may determine that the quality of the communication connection for mirroring with the external electronic device does not satisfy the service quality of mirroring. The processor (200) may determine whether to switch the communication method for mirroring with the external electronic device based on the determination that the quality of the communication connection for mirroring with the external electronic device does not satisfy the service quality of mirroring.
[0189] According to one embodiment, if the amount of data to be transmitted to the external electronic device (e.g., processor (120 or 200)) is less than or equal to a specified second reference size (e.g., 'No' in operation 1207), in operation 1213, the electronic device may determine whether a time difference value of the data with the external electronic device exceeds a specified first reference time value (e.g., about 200 ms). As an example, the specified first reference time value may include a reference value for determining whether a bitrate associated with mirroring with the external electronic device is reduced.
[0190] According to one embodiment, the electronic device (e.g., processor (120 or 200)) may increase a bitrate associated with mirroring with the external electronic device by the specified reference value if the time difference value of data with the external electronic device is less than or equal to a first reference time value (e.g., 'No' in operation 1213), in operation 1215. For example, the processor (200) may keep the bitrate associated with mirroring with the external electronic device the same if the time difference value of data with the external electronic device is less than or equal to the first reference time value.
[0191] According to one embodiment, when a time difference value of data with an external electronic device exceeds a specified first reference time value (e.g., 'Yes' in operation 1213), in operation 1217, the electronic device (e.g., processor (120 or 200)) may determine whether a bitrate associated with mirroring with the external electronic device satisfies a specified bitrate (e.g., a minimum bitrate). For example, a state of satisfying the specified bitrate (e.g., the minimum bitrate) may include a state where the bitrate associated with mirroring with the external electronic device is less than or equal to the minimum bitrate. For example, a state of not satisfying the specified bitrate (e.g., the minimum bitrate) may include a state where the bitrate associated with mirroring with the external electronic device exceeds the minimum bitrate.
[0192] According to one embodiment, when the electronic device (e.g., processor (120 or 200)) determines that the bitrate associated with mirroring with the external electronic device satisfies a specified bitrate (e.g., minimum bitrate) (e.g., 'Yes' in operation 1217), the electronic device may terminate an embodiment for providing mirroring with the external electronic device based on communication quality. For example, when the bitrate associated with mirroring with the external electronic device is less than or equal to the specified bitrate (e.g., minimum bitrate), the processor (200) may determine that the quality of the communication connection for mirroring with the external electronic device does not satisfy the service quality of mirroring. The processor (200) may determine whether to switch the communication method for mirroring with the external electronic device based on the determination that the quality of the communication connection for mirroring with the external electronic device does not satisfy the service quality of mirroring.
[0193] According to one embodiment, if the electronic device (e.g., processor (120 or 200)) determines that a bitrate associated with mirroring with an external electronic device does not satisfy a specified bitrate (e.g., a minimum bitrate) (e.g., 'No' in operation 1217), then in operation 1219, the electronic device may reduce the bitrate of data associated with mirroring to be transmitted to the external electronic device. For example, reducing the bitrate associated with mirroring may include a series of operations in which the electronic device (101) reduces the size of data associated with mirroring to be transmitted to the external electronic device (e.g., encoded data) by a specified size.
[0194] According to one embodiment, a method of operating an electronic device (e.g., the electronic device (101) of FIG. 1 or 2) may include, when a mirroring function is activated, an operation of performing a first communication connection with an external electronic device related to a mirroring function based on a Bluetooth method and a second communication connection with an external electronic device related to a mirroring function based on a wireless LAN method. According to one embodiment, the method of operating the electronic device may include, when the first communication connection is established before the second communication connection, an operation of performing mirroring with the external electronic device through the first communication connection. According to one embodiment, the method of operating the electronic device may include, when a switching condition of a communication method related to the second communication method is satisfied, an operation of switching the mirroring function with the external electronic device to the second communication connection. According to one embodiment, the method of operating the electronic device may include, based on the switching to the second communication method, an operation of transmitting data related to mirroring to the external electronic device through the second communication connection.
[0195] According to one embodiment, the operation of transmitting to the external electronic device may include an operation of transmitting data related to a first type of mirroring that has no inter-frame dependency to the external electronic device through a second communication connection based on a switch to a second communication method, and an operation of transmitting data related to a second type of mirroring that is different from the first type to the external electronic device based on the transmission of the data related to the first type of mirroring.
[0196] According to one embodiment, a method of operating an electronic device may include an operation of collecting status information related to a mirroring function with an external electronic device based on a specified period when performing a mirroring function with an external electronic device through a first communication connection or a second communication connection.
[0197] According to one embodiment, a method of operating an electronic device may include an operation of stopping input of a buffer when it is determined that a control condition related to input of a buffer is satisfied based on an amount of data to be transmitted to an external electronic device.
[0198] According to one embodiment, the operating method of the electronic device may include an operation of checking whether a condition for changing a bitrate is satisfied based on a time difference value of data with respect to an external electronic device when it is determined that a control condition related to input of a buffer is not satisfied, and an operation of reducing a bitrate related to mirroring with the external electronic device when it is determined that the condition for changing the bitrate is satisfied.
[0199] According to one embodiment, an operating method of an electronic device may include an operation of checking whether a switching condition of a communication method is satisfied based on state information related to mirroring when it is determined that a control condition related to input of a buffer is not satisfied and a bitrate change condition is not satisfied, and an operation of switching a communication connection for mirroring with an external electronic device to a first communication connection or a second communication connection when it is determined that the switching condition of the communication method is satisfied.
[0200] The embodiments of the present invention disclosed in this specification and drawings are merely specific examples presented to easily explain the technical contents according to the embodiments of the present invention and to help understand the embodiments of the present invention, and are not intended to limit the scope of the embodiments of the present invention. Therefore, the scope of one embodiment of the present invention should be interpreted as including all changes or modified forms derived based on the technical idea of one embodiment of the present invention, in addition to the embodiments disclosed herein, within the scope of one embodiment of the present invention.
Claims
1. In an electronic device (101), A first communication circuit (210) supporting Bluetooth communication; A second communication circuit (220) supporting wireless LAN communication; At least one processor (200) operatively connected to the first communication circuit and the second communication circuit; and When executed by at least one processor, the electronic device: Based on the activation of mirroring, a first communication connection with an external electronic device related to the mirroring is performed through the first communication circuit, and a second communication connection with the external electronic device related to the mirroring is performed through the second communication circuit. If the first communication connection is established before the second communication connection, mirroring with the external electronic device is performed through the first communication connection, When the switching condition of the communication method related to the second communication method is satisfied, mirroring with the external electronic device is switched to the second communication connection, An electronic device including a memory (230) storing instructions for transmitting data for performing mirroring to the external electronic device through the second communication connection based on the switching to the second communication method.
2. In paragraph 1, An electronic device including instructions which, when executed by the at least one processor, cause the electronic device to determine whether a condition for switching a communication method related to the second communication method is satisfied based on at least one of: whether the second communication connection is established, a power mode related to mirroring, user setting information related to mirroring, user usage history related to mirroring, remaining battery capacity of the electronic device, connection information with an external power source, or service quality related to mirroring.
3. In any one of paragraphs 1 and 2, The memory, when executed by the at least one processor, transmits data to the external electronic device for performing a first type of mirroring without inter-frame dependency through the second communication connection based on the switching to the second communication method, An electronic device storing instructions for transmitting data for performing a second type of mirroring, different from the first type, to the external electronic device based on transmission of data for performing the first type of mirroring.
4. In any one of paragraphs 1 to 3, An electronic device wherein the memory stores instructions that, when executed by the at least one processor, cause the electronic device to collect status information related to mirroring with the external electronic device based on a specified period when performing mirroring with the external electronic device through the first communication connection or the second communication connection.
5. In any one of paragraphs 1 to 4, An electronic device comprising at least one of the following status information related to the mirroring: a change in the quality of data for performing mirroring, a change in the power mode related to mirroring, a change in the communication quality related to mirroring, a remaining battery level of at least one of the electronic device or the external electronic device, connection information with an external power source of at least one of the electronic device or the external electronic device, an amount of data to be transmitted to the external electronic device, a time difference value of data with the external electronic device, or a service quality related to mirroring.
6. In paragraph 5, The above memory, when executed by the at least one processor, causes the electronic device to: Verify that the control conditions related to the input of the buffer are satisfied based on the amount of data to be transmitted to the external electronic device. An electronic device storing instructions for stopping input of the buffer when it is determined that a control condition related to input of the buffer is satisfied.
7. In paragraph 6, The above memory, when executed by the at least one processor, causes the electronic device to: If it is determined that the control condition related to the input of the above buffer is not satisfied, it is checked whether the condition for changing the bit rate is satisfied based on the time difference value of the data with the external electronic device, An electronic device storing instructions for reducing a bitrate associated with mirroring with an external electronic device when it is determined that the above bitrate change condition is satisfied.
8. In paragraph 7, The above memory, when executed by the at least one processor, causes the electronic device to: If it is determined that the control condition related to the input of the above buffer is not satisfied and the condition for changing the bit rate is not satisfied, it is checked whether the condition for switching the communication method is satisfied based on the status information related to the above mirroring, An electronic device storing instructions for switching a communication connection for mirroring with the external electronic device to the first communication connection or the second communication connection when it is determined that the switching condition of the above communication method is satisfied.
9. In paragraph 8, An electronic device wherein the memory stores instructions that, when executed by the at least one processor, cause the electronic device to determine whether a switching condition of the communication method is satisfied based on at least one of a power mode related to the mirroring, a remaining battery level of the electronic device, connection information with the external power source, or a quality of service related to the mirroring.
10. In the method of operating an electronic device, An operation of performing a first communication connection with an external electronic device related to said mirroring based on a Bluetooth method and a second communication connection with the external electronic device related to said mirroring based on a wireless LAN method based on activation of mirroring; An operation of performing mirroring with the external electronic device through the first communication connection when the first communication connection is established before the second communication connection; When the switching condition of the communication method related to the second communication method is satisfied, an operation of switching mirroring with the external electronic device to the second communication connection, and A method comprising the action of transmitting data for performing mirroring to the external electronic device via the second communication connection based on the switching to the second communication method.
11. In paragraph 10, A method further comprising an operation of determining whether a condition for switching a communication method related to the second communication method is satisfied based on at least one of: whether the second communication connection is established, a power mode related to mirroring, a user's setting information related to mirroring, a user's usage history related to mirroring, a battery level of the electronic device, connection information with an external power source, or a service quality related to mirroring.
12. In any one of paragraphs 10 to 11, The operation of transmitting to the above external electronic device is: An operation of transmitting data for performing a first type of mirroring without inter-frame dependency to the external electronic device through the second communication connection based on the switching to the second communication method, and A method comprising an operation of transmitting data for performing a second type of mirroring different from the first type to the external electronic device based on the transmission of data for performing the first type of mirroring.
13. In any one of paragraphs 10 to 12, A method further comprising an action of collecting status information related to mirroring with the external electronic device based on a specified period when performing mirroring with the external electronic device through the first communication connection or the second communication connection.
14. In any one of paragraphs 10 to 13, A method according to claim 1, wherein the status information related to the mirroring includes at least one of a change in the quality of data for performing mirroring, a change in a power mode related to mirroring, a change in a communication quality related to mirroring, a remaining battery level of at least one of the electronic device or the external electronic device, connection information with an external power source of at least one of the electronic device or the external electronic device, an amount of data to be transmitted to the external electronic device, a time difference value of data with the external electronic device, or a service quality related to mirroring.
15. In paragraph 14, An operation for checking whether a control condition related to the input of a buffer is satisfied based on the amount of data to be transmitted to the external electronic device, and A method further comprising an action of stopping input of the buffer when it is determined that a control condition related to input of the buffer is satisfied.
Citation Information
Patent Citations
Method for playing content, terminal thereof, and system thereof
KR1020150022532A
Method for connecting wireless network and electronic device thereof
KR1020160071826A
Display device and display system including the same
KR1020170122571A
Spraying apparatus for pesticide
KR102624719B1
Systems and methods for mirroring and transcoding media content
US20220086520A1