Electronic device and operation method thereof

Abstract

This disclosed electronic device displays a guest OS screen corresponding to a guest application executed in a guest OS on at least a part of a host OS screen of a host OS, receives a screen sharing request via the guest application, captures the host OS screen including the guest OS screen in response to the screen sharing request, and transmits the captured host OS screen to a server.

Description

Electronic device and method of operation thereof

[0001] Various embodiments relate to an electronic device and a method of operating the same, and more specifically, to an electronic device including a host system and a guest system and a method of operating the same.

[0002] Electronic devices equipped with heterogeneous operating systems are being developed and released. While most electronic devices run on a single OS, devices equipped with multiple OSs are also being released to gain technical or business advantages. For example, Samsung Smart TV / Monitor is based on Tizen OS, but has developed an AoT (Android on Tizen) Platform where Tizen OS and Android OS coexist to run Android applications.

[0003] With the development of wired and wireless communication networks and communication technologies, the use of video conferencing services between electronic devices is increasing. Specifically, video conferencing services between electronic devices are widely used to enable remote users to communicate with each other without face-to-face interaction.

[0004] Specifically, for a video call service, one electronic device and another electronic device may be interconnected via a wired or wireless communication network. Here, the electronic device may be any electronic device that includes a display to provide a video conference screen and can communicate with another electronic device located at a remote location by connecting to a wired or wireless communication network. Examples of electronic devices include portable computers such as laptops, netbooks, or tablet PCs, portable terminals such as smartphones or PDAs, TVs, digital TVs, etc.

[0005] When a video conference is performed between multiple electronic devices, for example, a first electronic device and a second electronic device, the first electronic device acquires an image of a first user and transmits the acquired image to the second electronic device. Additionally, the second electronic device acquires an image of a second user and transmits the acquired image to the first electronic device. Accordingly, the first electronic device and the second electronic device each display a video conference screen containing images of the first user and the second user. Then, the first user and the second user can each have a conversation while viewing images of the other party from a remote location.

[0006] During such a video conference, the first user may use a function to share the screen displayed on their first electronic device with the conference participants. However, if the first electronic device is equipped with a heterogeneous OS including a host OS and a guest OS, and the video conferencing application runs based on the guest OS, the operation of sharing the screen of the first electronic device may not be smooth.

[0007] Various embodiments aim to provide an electronic device and a method of operation thereof that enable sharing a host screen in response to a screen sharing request from a guest application in an electronic device comprising a host system and a guest system.

[0008] According to one embodiment, the electronic device may include a memory for storing one or more instructions and at least one processor for executing said one or more instructions.

[0009] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may display a guest OS screen corresponding to a guest application running in the guest OS on at least a portion of the host OS screen of the host OS.

[0010] According to one embodiment, when one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may receive a screen sharing request through the guest application.

[0011] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may, in response to the screen sharing request, capture the host OS screen including the guest OS screen and transmit the captured host OS screen to a server.

[0012] According to one embodiment, a method for operating an electronic device may include an operation of displaying a guest OS screen corresponding to a guest application running in a guest OS on at least a part of a host OS screen of a host OS.

[0013] According to one embodiment, a method for operating an electronic device may include receiving a screen sharing request through the guest application.

[0014] According to one embodiment, a method for operating an electronic device may include capturing the host OS screen including the guest OS screen in response to the screen sharing request, and transmitting the captured host OS screen to a server.

[0015] According to one embodiment, in a non-transient computer-readable recording medium storing one or more instructions, when the one or more instructions are executed by at least one processor of an electronic device, the electronic device displays a guest OS screen corresponding to a guest application running in a guest OS on at least a portion of a host OS screen of a host OS, receives a screen sharing request through the guest application, captures the host OS screen including the guest OS screen in accordance with the screen sharing request, and transmits the captured host OS screen to a server.

[0016] The above and other aspects, features, and advantages of specific embodiments of the present disclosure will become more apparent from the following description, which is referenced together with the accompanying drawings.

[0017] FIG. 1 is a reference diagram for explaining the environment in which the disclosed embodiments operate.

[0018] FIG. 2 illustrates an example of a system including an electronic device, a server, and a counterpart electronic device according to one embodiment.

[0019] FIG. 3 shows an example of an electronic device including a host system and a guest system according to one embodiment.

[0020] FIG. 4 shows an example of a host system and a guest system according to one embodiment.

[0021] FIG. 5 shows an example of a flowchart of a method for operating an electronic device according to one embodiment.

[0022] FIG. 6 is a flowchart illustrating the process of a method for running a guest OS-based application in an electronic device including a guest OS and a host OS according to one embodiment.

[0023] FIG. 7 shows an example of a guest OS screen and a host OS screen according to one embodiment.

[0024] FIG. 8 shows an example of a screen in which a video conferencing application is executed as a guest application of a guest system of an electronic device according to one embodiment.

[0025] FIG. 9 is a reference diagram for explaining the operation of processing a screen sharing request received from a guest application of a guest system of an electronic device according to one embodiment.

[0026] FIG. 10 is an example of a flowchart of an operation for processing a screen sharing request received from a guest application of a guest system of an electronic device according to one embodiment.

[0027] FIG. 11 is a reference diagram for explaining the operation of processing a screen sharing request received from a guest application of a guest system of an electronic device according to one embodiment.

[0028] FIG. 12 is an example of a flowchart of an operation for processing a screen sharing request received from a guest application of a guest system of an electronic device according to one embodiment.

[0029] FIG. 13 is a reference diagram for explaining the operation of an electronic device receiving and displaying a guest OS screen from an external device using screen mirroring according to one embodiment.

[0030] FIG. 14 is a reference diagram for explaining the operation when a screen sharing menu is selected on a guest OS screen displayed using screen mirroring in an electronic device according to one embodiment.

[0031] FIG. 15 is an example of a flowchart showing the operation when a screen sharing menu is selected on a guest OS screen displayed using screen mirroring in an electronic device according to one embodiment.

[0032] FIG. 16 is a reference diagram for explaining the operation when an external device selects a screen sharing menu while an external device provides a guest OS screen to an electronic device using screen mirroring according to one embodiment.

[0033] FIG. 17 is an example of a flowchart showing the operation when a screen sharing menu is selected on a guest OS screen displayed using screen mirroring in an electronic device according to one embodiment.

[0034] FIG. 18 shows an example of a detailed block diagram of an electronic device according to one embodiment.

[0035] The terms used in this specification will be briefly explained, and the invention will be described in detail.

[0036] The terms used in this invention have been selected based on currently widely used general terms, taking into account their functions within the invention; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the relevant description of the invention. Therefore, the terms used in this invention should be defined not merely by their names, but based on their meanings and the overall content of the invention.

[0037] When a part of a specification is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part" or "module" as used in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware or software, or as a combination of hardware and software.

[0038] In the present disclosure, the expression “at least one of a, b, or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b, and c all”, or variations thereof.

[0039] The following describes embodiments with reference to the attached drawings so that those skilled in the art can easily implement the present invention. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present invention in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0040] In the embodiments of this specification, the term "user" refers to a person who controls the function or operation of a computing device or electronic device using a control device, and may include a viewer, an administrator, or an installation technician.

[0041] Computers include general-purpose CPUs or processors designed to execute a set of system instructions. Processors execute instructions unique to the processor, and the set of instructions that a processor can execute is called the processor's instruction set. The uniqueness of processors between computer systems typically results in incompatibility regarding the hardware architectures of computer systems. Generally, computer manufacturers want more applications to run on their processor families. Therefore, to increase the number of operating systems and application programs that can run on a computer system, a host computer with a CPU of one type called the host may employ virtual machine technology that enables it to emulate instructions for a different type of CPU called the guest.

[0042] FIG. 1 is a reference diagram for explaining the environment in which the disclosed embodiments operate.

[0043] Referring to FIG. 1, the environment may include an electronic device 100, a server 200, and a counterpart electronic device 400.

[0044] Two display devices, an electronic device 100, and a counterpart electronic device 400 can provide video conferencing services using a video conferencing application. An application may refer to a program or processor that performs a service, function, or specific operation. Specifically, an application may be formed by at least one instruction that performs a service, function, or specific operation. In the disclosed embodiment, an application that performs video conferencing services, functions, or operations may be referred to as a video conferencing application.

[0045] In the disclosed embodiments, video conferencing refers to a conversation in which multiple users located at mutually remote locations each communicate using voice and / or video through multiple electronic devices. Furthermore, the term "video conferencing" as used in the disclosed embodiments can be applied to all fields where users located at remote locations communicate while receiving voice and / or video from each other, such as video calls, non-face-to-face communication, and non-face-to-face education, and can refer to any case where multiple users located at mutually remote locations communicate while listening to the other party's voice. Here, the images included in the video conferencing screen do not necessarily have to be the faces of the users utilizing the video conferencing; they may be images representing the environment in which the users utilizing the video conferencing are located, or images provided by the users. Generally, video conferencing can be performed between two or more different electronic devices by two or more users located at mutually remote locations.

[0046] Referring to FIG. 1, a video conference can be performed between electronic devices located at a remote location, namely, the electronic device 100 of User 101 and the counterpart electronic device 400 of the counterpart User 401. Additionally, the video conference can be performed by transmitting and receiving data necessary for the video conference using a communication network such as 3G, 4G, or 5G. Alternatively, the video conference can be performed through a telecommunications carrier's call service. Furthermore, the video conference can be performed through a specific application (e.g., a video call application, a non-face-to-face communication application, a video education application, a video conferencing application, etc.) provided through a service provider's server.

[0047] Including FIG. 1, the user's electronic device is referred to as electronic device 100 below, and the electronic device of the counterpart user who wishes to hold a video conference with the user is referred to as counterpart electronic device 400. Alternatively, the user's electronic device may simply be referred to as the first display device and the counterpart user's electronic device as the second display device. Furthermore, the user of electronic device 100 is referred to simply as the user, and the counterpart who wishes to hold a video conference with the user is referred to as the counterpart user. Additionally, the user and the counterpart may be referred to as the first user and the second user, respectively. Furthermore, although display devices were used as examples for the user's electronic device and the counterpart's electronic device in FIG. 1, they may take the form of various electronic devices, such as smartphones.

[0048] Referring to FIG. 1, an electronic device 100 can perform a video call with a counterparty electronic device 400, which is a counterparty electronic device located at a remote location. The electronic device 100 can perform a video conference by executing its own call function or an application for non-face-to-face communication. When the video conference begins, the electronic device 100 performing the video conference and the counterparty electronic device 400 can display a video conference screen. For example, the user's electronic device 100 can display a video conference screen that includes an image of the user or an image of the counterparty user. Additionally, the video conference screen may further include menus for controlling the video conference. The menus for controlling the video conference may include, for example, a screen sharing function. The screen sharing function may represent a function that allows a user to share their screen with other participants in the video conference. For example, the screen sharing function can be used when one of the video conference participants wants to explain or converse based on a document file opened on their electronic device, allowing other participants to view the file as well.

[0049] Meanwhile, the electronic device 100 may include heterogeneous OSs, namely a host OS and a guest OS. Depending on the host OS, one or more applications based on the host OS may be executed, and depending on the guest OS, one or more applications based on the guest OS may be executed. For example, a device based on Samsung Electronics’ Tizen system may include Tizen OS as a host OS and Android OS as a guest OS. A device based on the Tizen system can execute Tizen OS-based applications using Tizen OS and execute Android OS-based applications using Android OS.

[0050] A video conferencing application that a user of electronic device 100 runs on electronic device 100 for video conferencing with other participants may be an application that runs based on a guest OS. Referring to FIG. 1, electronic device 100 can display a video conferencing application screen by running a video conferencing application based on a guest OS. Hereinafter, the application screen based on a guest OS will be referred to as a guest OS screen 10. Electronic device 100 can display this guest OS screen 10 on at least a portion of the screen displayed by running an application based on a host OS. Hereinafter, the application screen based on a host OS will be referred to as a host OS screen 20.

[0051] In this way, when a user selects the screen sharing function while the guest OS screen 10 is displayed on the electronic device 100, the user can expect to share the entire screen state displayed on the display of the electronic device 100, that is, the host OS screen 20 containing the guest OS screen 10, as shown in the expected shared screen 60 in FIG. 1. However, since the video conferencing application that triggered the screen sharing function is based on the guest OS, it only knows the window based on the guest OS, i.e., the guest OS screen 10, and does not know about the host OS screen 20. Therefore, in this situation, when the user selects the screen sharing function, the electronic device 100 can only transmit the guest OS screen 10 to the server 200 for screen sharing, and thus the actual shared screen 70 as shown in FIG. 1 can be shared. Consequently, it may be difficult to screen share the entire screen representing the host OS screen 20 containing the guest OS screen 10 of the electronic device 100.

[0052] Considering these circumstances, the embodiments of the present disclosure aim to provide an electronic device and a method of operation thereof that enable the entire host OS screen to be provided even for screen sharing operations performed by an application running on a guest OS.

[0053] According to one embodiment, an electronic device displays a guest OS screen corresponding to a guest application running on a guest OS on at least a portion of a host OS screen of a host OS, receives a screen sharing request through the guest application, captures the host OS screen including the guest OS screen in accordance with the screen sharing request, and transmits the captured host OS screen to a server.

[0054] According to one embodiment, the electronic device transmits the screen sharing request to the host OS through the guest OS, and in accordance with the screen sharing request received by the host OS, captures the host OS screen including the guest OS screen by the host OS, transmits the captured host OS screen to the guest OS, and transmits the captured host OS screen to the server through the guest application.

[0055] According to one embodiment, the electronic device transmits server identification information for identifying the server to the host OS by the guest OS and the screen sharing request, and based on the reception of the screen sharing request by the host OS, the captured host OS screen can be transmitted to the server through the host OS using the server identification information.

[0056] According to one embodiment, the electronic device may designate a window of the host OS for the guest application upon execution of the guest application, and display the guest OS screen in the designated window.

[0057] According to one embodiment, the electronic device can receive and display the guest OS screen corresponding to the guest application executed on the external device through screen mirroring, wherein the guest application is executed through an external device.

[0058] According to one embodiment, the electronic device can transmit the captured host OS screen to the server in response to a screen sharing request through the guest OS screen displayed based on the screen mirroring.

[0059] According to one embodiment, the electronic device receives a screen sharing input through the guest OS screen displayed based on the screen mirroring, receives a screen sharing request for the host OS screen from the external device as it transmits the screen sharing input to the external device, and can output the captured host OS screen in accordance with the screen sharing request for the host OS screen.

[0060] According to one embodiment, the electronic device may transmit the captured host OS screen to the external device or transmit the captured host OS screen to the server using server identification information.

[0061] According to one embodiment, the host OS and the guest OS may be configured to communicate through at least one virtual network interface or by forwarding a port from the host OS to the guest OS.

[0062] According to one embodiment, server identification information may include the Uniform Resource Identified (URI) of the server.

[0063] FIG. 2 illustrates an example of a system including an electronic device, a server, and a counterpart electronic device according to one embodiment.

[0064] Referring to FIG. 2, an electronic device 100, a server 200, and a counterpart electronic device 400 are connected to a communication network, and the electronic device 100 and the counterpart electronic device 400 can communicate through the server 200.

[0065] The electronic device 100 is a device capable of displaying images or data and may include a communication unit (or communication interface) 110, a display 120, a memory 130, and a processor 140.

[0066] The communication unit 110 may include various communication circuits for performing communication with at least one external device. Here, 'communication' may mean the operation of transmitting and / or receiving data, signals, requests, and / or commands, etc. In the following description, at least one external device is described using a server 200 as an example.

[0067] The communication unit 110 can perform wired or wireless communication with an external device.

[0068] For example, the communication unit 110 may include at least one of a communication module, a communication circuit, a communication device, an input / output port, and an input / output plug for performing wired communication with an external device.

[0069] For example, the communication unit 110 may include at least one wireless communication module, wireless communication circuit, or wireless communication device that performs wireless communication with an external device.

[0070] For example, the communication unit 110 may include a short-range communication module capable of receiving control commands from a remote controller located at a short distance, for example, an input device, for example, an IR (infrared) communication module, etc. In this case, the communication unit 110 may receive a control signal from the remote controller.

[0071] For example, the communication unit 110 may include at least one communication module that performs communication according to wireless communication standards such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, or ZIGBEE. Alternatively, the communication unit 110 may further include a communication module that performs communication with a server to support long-distance communication according to long-distance communication standards. For example, the communication unit 110 may include a communication module that performs communication through a network for internet communication. Additionally, the communication unit 110 may include a communication module that performs communication through a communication network according to communication standards such as 3G, 4G, 5G and / or 6G.

[0072] For example, the communication unit 110 may include at least one port for connecting to an external device via a wired cable in order to communicate with an external device via a wired connection. For example, the communication unit 110 may include at least one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, a DisplayPort, and a USB port. Accordingly, the communication unit 110 can communicate with an electronic device 100 connected via a wired connection through at least one port. Here, a port may refer to a physical device configuration capable of connecting or inserting a cable, a communication line, or a plug, etc.

[0073] As described above, the communication unit 110 may include at least one support element for supporting communication between the electronic device 100 and an external device. Here, the support element may include the aforementioned communication module, communication circuit, communication device, port (for input / output of data), cable port (for input / output of data), plug (for input / output of data), etc. For example, at least one support element included in the communication interface 110 may be an Ethernet communication module, a Wi-Fi communication module, a Bluetooth communication module, an IR communication module, a USB port, a tuner (or broadcast receiver), an HDMI port, a DP (display port), a DVI (digital visual interface) port, etc.

[0074] Display 120 can output images or data processed by electronic device 100.

[0075] Memory 130 can store programs for processing and controlling processor 140, and can store data input to or output from electronic device 100. In addition, memory 130 can store data necessary for the operation of electronic device 100.

[0076] Memory 130 may include at least one type of storage medium among flash memory type, hard disk type, multimedia card micro type, card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, and optical disk.

[0077] Processor 140 controls the overall operation of electronic device 100. For example, processor 140 can perform the functions of electronic device 100 described in this disclosure by executing one or more instructions stored in memory 130.

[0078] Processor 140 may include various processing circuits and / or multiple processors. For example, the term "processor" as used herein, including in the claims, may include at least one processor and various processing circuits. In the at least one processor, one or more processors may be configured to perform the various functions described herein in a distributed manner, individually and / or collectively. As used herein, "processor," "at least one processor," and "one or more processors" may be configured to perform various functions. However, these terms cover, for example but without limitation, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor can perform all functions. Additionally, at least one processor may include a combination of processors performing various functions of the disclosed functions in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions.

[0079] In an embodiment of the present disclosure, the processor 140 stores one or more instructions in an internally provided memory and can control the operation of a display device to be performed by executing one or more instructions stored in the internally provided memory. That is, the processor 140 can perform a predetermined operation by executing at least one instruction or program stored in an internal memory or memory 130 provided within the processor 140.

[0080] According to one embodiment, the processor 140 can perform the operation of the electronic device 100 disclosed in the present disclosure by executing one or more instructions stored in memory 130.

[0081] According to one embodiment, at least one processor 140 can display a guest OS screen corresponding to a guest application running in a guest OS on at least a part of a host OS screen of a host OS by executing one or more instructions stored in memory 130.

[0082] According to one embodiment, at least one processor 140 can receive a screen sharing request through the guest application by executing one or more instructions stored in memory 130.

[0083] According to one embodiment, at least one processor 140 can capture the host OS screen including the guest OS screen in response to the screen sharing request by executing one or more instructions stored in memory 130, and transmit the captured host OS screen to a server.

[0084] According to one embodiment, at least one processor 140 can transmit the screen sharing request to the host OS through the guest OS by executing one or more instructions stored in memory 130.

[0085] According to one embodiment, at least one processor 140 can capture the host OS screen including the guest OS screen by the host OS in response to the screen sharing request received by the host OS by executing one or more instructions stored in memory 130, and transmit the captured host OS screen to the guest OS.

[0086] According to one embodiment, at least one processor 140 can transmit the captured host OS screen to the server through the guest application by executing one or more instructions stored in memory 130.

[0087] According to one embodiment, at least one processor 140 can transmit server identification information for identifying the server to the host OS by the guest OS and the screen sharing request by executing one or more instructions stored in memory 130.

[0088] According to one embodiment, at least one processor 140 can transmit the captured host OS screen to the server through the host OS using the server identification information by executing one or more instructions stored in memory 130, based on the reception of the screen sharing request by the host OS.

[0089] According to one embodiment, at least one processor 140 can specify a window of the host OS for the guest application according to the execution of the guest application by executing one or more instructions stored in memory 130, and display the guest OS screen in the specified window.

[0090] According to one embodiment, at least one processor 140 can receive and display the guest OS screen corresponding to the guest application running on the external device through screen mirroring by executing one or more instructions stored in memory 130.

[0091] According to one embodiment, at least one processor 140 can transmit the captured host OS screen to the server in response to a screen sharing request through the guest OS screen displayed based on the screen mirroring by executing one or more instructions stored in memory 130.

[0092] According to one embodiment, at least one processor 140 can receive screen sharing input through the guest OS screen displayed based on the screen mirroring by executing one or more instructions stored in memory 130.

[0093] According to one embodiment, at least one processor 140 can receive a screen sharing request of the host OS screen from the external device by transmitting the screen sharing input to the external device by executing one or more instructions stored in memory 130.

[0094] According to one embodiment, at least one processor 140 can output the captured host OS screen in response to a screen sharing request of the host OS screen by executing one or more instructions stored in memory 130.

[0095] According to one embodiment, at least one processor 140 can transmit the captured host OS screen to the external device or transmit the captured host OS screen to the server using server identification information by executing one or more instructions stored in memory 130.

[0096] According to one embodiment, the host OS and the guest OS may be configured to communicate through at least one virtual network interface or by forwarding a port from the host OS to the guest OS.

[0097] According to one embodiment, server identification information may include the Uniform Resource Identified (URI) of the server.

[0098] The electronic device 100 may be any type of device that performs functions including a processor and memory. The electronic device 100 may be a stationary or portable device. For example, the electronic device 100 may represent a device equipped with a display capable of displaying image content, video content, game content, graphic content, etc. The electronic device 100 may include various types of electronic devices capable of receiving and outputting content, such as televisions like network TV, smart TV, internet TV, web TV, and IPTV; computers like desktops, laptops, and tablets; smartphones, cellular phones; game players, music players, video players; medical equipment; home appliances, etc.

[0099] The block diagram of the electronic device 100 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the actual implemented electronic device 100. For example, as needed, two or more components may be combined into a single component, or a single component may be subdivided into two or more components. Furthermore, the functions performed in each block are intended to explain the embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0100] Server 200 may include a communication unit 210, memory 220, and a processor 230.

[0101] The communication unit 210 may include various communication circuits for communicating with electronic device 100 and other electronic device 400 through a communication network.

[0102] Memory 220 can store programs for processing and controlling processor 230, and can store data received from server 200 or data output from server 200. In addition, memory 220 can store data necessary for the operation of server 200.

[0103] Processor 230 controls the overall operation of Server 200. For example, Processor 230 can perform the functions of Server 200 described in this disclosure by executing one or more instructions stored in Memory 220.

[0104] According to one example, server 200 can mediate a video conference operation between electronic device 100 and the other electronic device 400. For example, server 200 can transmit images or voices of users participating in the video conference to electronic device 100 and the other electronic device 400 for the video conference operation between electronic device 100 and the other electronic device 400, and can also transmit images or voices of users received from electronic device 100 and the other electronic device 400 to the devices of other users participating in the video conference.

[0105] The counterpart electronic device 400 is a device capable of displaying images or data and may include a communication unit 410, a display 420, a memory 430, and a processor 440.

[0106] The communication unit 410 may include various communication circuits for communicating with server 200 through a communication network.

[0107] Display 420 can output images or data processed by the other electronic device 400.

[0108] Memory 430 can store a program for processing and controlling processor 440, and can store data received from counterpart electronic device 400 or data output from counterpart electronic device 400. In addition, memory 430 can store data necessary for the operation of counterpart electronic device 400.

[0109] Processor 440 controls the overall operation of the counterpart electronic device 400. For example, processor 440 can perform the functions of the counterpart electronic device 400 described in this disclosure by executing one or more instructions stored in memory 430.

[0110] According to one example, the counterparty electronic device 400 can perform video conferencing operations through server 200. For example, the counterparty electronic device 400 can transmit the image or voice of the counterparty user of the counterparty electronic device 400 to server 200 to deliver it to other users participating in the video conference. Additionally, the counterparty electronic device 400 can receive the image or voice of other users participating in the video conference through server 200.

[0111] In FIG. 2, the counterpart electronic device 400 participating in the video conference operation is shown as one, but it will be understood that if there are multiple users participating in the video conference operation, there may be two or more counterpart electronic devices 400.

[0112] FIG. 3 illustrates an example of an electronic device including a host system and a guest system according to one embodiment. The electronic device 100 illustrated in FIG. 3 shows a structure in terms of software and hardware.

[0113] Referring to FIG. 3, the electronic device 100 may include a host system 310, a guest system 320, a window system 330, a kernel 340, and a hardware platform 350.

[0114] The electronic device 100 may represent a computer that supports the execution of an operating system and one or more application programs. The electronic device 100 may be a general purpose computer or a display device. The electronic device may include various forms of electronic devices capable of receiving and outputting content, such as, for example, network TV, smart TV, internet TV, web TV, IPTV, PC, etc.

[0115] The host system 310 provides an operating system platform for running processes on the electronic device 100. The host system 310 controls all hardware devices within the electronic device 100 and manages system resources for all applications running internally.

[0116] The host system 310 may include a host application 311 and a host OS framework 312.

[0117] Host application 311 may represent an application that can be executed based on a host operating system. Host application 311 may include, for example, a home application that is executed first when electronic device 100 is booted.

[0118] Host OS Framework 312 can be composed of various different components, such as support programs, compilers, code libraries, APIs, and classes, that implement the standard structure of application programs for the host operating system.

[0119] Guest System 320 is a software implementation of a physical computing device and implements a computing platform that supports the execution of software applications under the control of a guest operating system. The guest system may include, for example, well-known commercial operating systems, such as Google’s Android®, Microsoft’s Windows®, Linux® operating systems, Apple’s MacOS®, etc.

[0120] Guest system 320 may include guest application 321 and guest OS framework 322.

[0121] Guest application 321 may represent one or more applications that can be executed based on the guest operating system. For example, guest application 321 may include a video conferencing application.

[0122] The Guest OS Framework 322 can be composed of various different components, such as support programs, compilers, code libraries, APIs, and classes, that implement the standard structure of application programs for the guest operating system.

[0123] Windows System 330 is software that manages different parts of a display screen individually. Windows System 330 is a type of graphical user interface that implements windows, icons, menus, and pointers for the user interface. Each currently running application is allocated a resizable rectangular surface, or window, to display a graphical user interface to the user. These windows can overlap each other.

[0124] Kernel 340 serves as a link between the host system 310, guest system 320, and the physical hardware platform 350 of electronic device 100. Kernel 340 runs directly on the host as a central operating system component. Kernel 340 allocates memory, schedules access to the physical CPU, and schedules access to the physical hardware devices connected to electronic device 100.

[0125] A hardware platform 350 may include one or more physical CPUs 351, one or more memory 352, and one or more physical hardware devices 353. The memory may include random access memory that stores programs currently running and data used by these programs. The hardware platform may also include channels, adapters, etc.

[0126] FIG. 4 shows an example of a host system and a guest system according to one embodiment.

[0127] Referring to FIG. 4, the host system 310 may include a host application 311 and a host OS framework 312.

[0128] The host OS framework 312 may include a host application manager 313, a host window manager 314, and a host screen manager 315.

[0129] Host Application Manager 313 can manage host applications. For example, Host Application Manager 313 can manage the installation, removal, and update of host applications, control permissions for host applications to access cameras or microphones, monitor the performance and status of host applications, and manage data files generated by host applications.

[0130] Host Window Manager 314 can manage the placement, resizing, movement, and display of windows in a window system that provides a graphical user interface on a host system.

[0131] Host Screen Manager 315 can handle various screen-related settings and management on the host system.

[0132] Guest system 320 may include guest application 321 and guest OS framework 322.

[0133] Guest OS Framework 322 may include Guest Application Manager 323, Guest Window Manager 324, and Guest Screen Manager 325.

[0134] Guest Application Manager 323 can manage guest applications. For example, Guest Application Manager 323 can manage the installation, removal, and update of host applications, control permissions for host applications to access cameras or microphones, monitor the performance and status of host applications, and manage data files generated by host applications.

[0135] Guest Window Manager 324 can manage the placement, resizing, movement, and display of windows in a window system that provides a graphical user interface in a guest system.

[0136] Guest Screen Manager 325 can handle various screen-related settings and management on the guest system.

[0137] FIG. 5 shows an example of a flowchart of a method for operating an electronic device according to one embodiment.

[0138] Referring to FIG. 5, in operation 510, the electronic device 100 can display a guest OS screen corresponding to a guest OS-based application on at least a portion of a host OS screen based on a host OS according to the execution of a guest application based on a guest OS.

[0139] The electronic device 100 can display a host OS screen by running one or more host applications based on the host OS. In addition, when one or more guest applications are run based on the guest OS, a guest OS screen corresponding to the guest applications can be displayed on the host OS screen.

[0140] In operation 520, electronic device 100 can receive a screen sharing request through a guest application. For example, electronic device 100 can receive user input corresponding to the screen sharing request through a guest application. For example, electronic device 100 can receive a screen sharing request according to user input selecting a screen sharing menu provided on a guest OS screen corresponding to the guest application.

[0141] In operation 530, the electronic device 100 can transmit a host OS screen including a guest OS screen to a server for screen sharing in response to a screen sharing request.

[0142] According to one embodiment, an electronic device 100 can transmit a screen sharing request from a guest OS to a host OS in response to a screen sharing request from a guest application.

[0143] According to one embodiment, an electronic device 100 can capture a host OS screen by a host OS and transmit the captured host OS screen to a guest application through a guest OS.

[0144] According to one embodiment, the electronic device 100 can transmit a host OS screen to a server by a guest application.

[0145] FIG. 6 is a flowchart illustrating the process of a method for running a guest OS-based application in an electronic device including a guest OS and a host OS according to one embodiment.

[0146] Referring to FIG. 6, in operation 601, when there is a request to execute an application from an electronic device 100 including a guest OS and a host OS, the host application manager 313 of the host system 310 determines whether the requested application is based on the host OS or the guest OS, and can recognize that the requested application is an application based on the guest OS. The electronic device 100 can receive the request to execute an application based on user input that executes the application. For example, when the electronic device 100 receives user input to execute a certain application, the host application manager 313 of the electronic device 100 can determine whether the requested application is based on the host OS or the guest OS based on the user input.

[0147] In operation 602, the host application manager 313 can send a request to execute a guest application to the guest application manager 323 of the guest system 320 upon receiving a request to execute a guest application.

[0148] In operation 603, the guest application manager 323 can control the execution of guest application 321.

[0149] In operation 604, the guest application manager 323 can notify the guest window manager 324 of the start of execution of a guest application.

[0150] In operation 605, the guest window manager 324 can send a request to create a window for a guest application to the host window manager 314. That is, because the host system has the authority over the window drawn on the display screen of electronic device 100, the guest window manager 324 can send a request to create a window to the host window manager 314.

[0151] In operation 606, the host window manager 314 can allocate a window for a guest application. That is, the host window manager 314 can determine information about the window area where the result screen resulting from the execution of the guest application will be displayed. Information about the window area for the guest application may include location information where the window will be displayed on the display screen and size information of the window.

[0152] In operation 607, the host window manager 314 can transmit information about the window area allocated for the guest application to the guest window manager 324.

[0153] In operation 608, the guest window manager 324 can receive the execution screen of the guest application as the guest application runs.

[0154] In operation 609, the guest window manager 324 can create a guest OS screen by placing the guest application execution screen in the window area allocated for the guest application received from the host window manager 314.

[0155] In operation 610, the guest window manager 324 can pass the guest OS screen to the host window manager 314.

[0156] In operation 611, the host window manager 314 can receive the host application execution screen.

[0157] In operation 612, the host window manager 314 can create a host OS screen based on the host application execution screen and combine the guest OS screen received from the guest window manager 324 with the host OS screen to create and display the entire host OS screen.

[0158] FIG. 7 shows an example of a guest OS screen and a host OS screen according to one embodiment.

[0159] Referring to FIG. 7, the host OS screen is a screen obtained by running a host application and can be generated by the host window manager. The guest OS screen is a screen obtained by running a guest application and can be generated by the guest window manager.

[0160] The host window manager can obtain the entire host OS screen by combining the guest OS screen with the host OS screen. In other words, since the guest system generates the guest OS screen and provides it to the host system, the guest system cannot know the host OS screen. However, because the host system receives the guest OS screen from the guest system and generates the screen ultimately displayed on the screen, it can know both the host OS screen and the guest OS screen.

[0161] For example, let us assume a case where the host OS is Tizen OS and the guest OS is Android OS. If the Tizen Home application is running on the Tizen OS and the video conferencing application is running on the Android OS, then the host OS screen will be the Tizen Home screen, and the guest OS screen will be the video conferencing screen. The host OS can combine the video conferencing screen onto the Tizen Home screen to obtain the entire screen and display it.

[0162] The host system may allocate a window area to display the guest OS screen and arrange the guest OS screen 10 on a part of the host OS screen 20 to display it on the display of the electronic device 100. Therefore, for the convenience of explanation, the screen managed by the guest system will be referred to as the guest OS screen 10, and the screen managed by the host system will be referred to as the host OS screen 20 containing the guest OS screen 10.

[0163] FIG. 8 shows an example of a screen in which a video conferencing application is executed as a guest application of a guest system of an electronic device according to one embodiment.

[0164] Referring to FIG. 8, an electronic device 100 can execute a video conferencing application as a type of guest application 321 of a guest system 320. The electronic device 100 can display a video conferencing screen 800 in accordance with the execution of the video conferencing application. That is, the video conferencing screen 800 can be an example of a guest OS screen 10. The video conferencing screen 800 may include a portion 810 that displays an image of at least one of the user of the electronic device 100 and the counterpart user participating in the video conference, and a menu window 820 for controlling the video conference. The menu window 820 may include one or more menus for controlling the video conference. The menu window 820 may include, for example, a mute menu 821 that can control muting a user of the electronic device 100, a video stop menu 822 that can control stopping the video output of a user of the electronic device 100, an invite menu 823 that can invite a new user, a participant menu 824 that can manage video conference participants, a screen sharing menu 825 that can share the screen displayed on the electronic device 100 with other participants, a chat menu 826 that enables chatting with other participants, an exit meeting menu 827 that enables leaving the video conference, etc.

[0165] In addition, electronic device 100 can execute a writing and drawing application as an example of a host application of the host system, allowing the user to perform functions such as writing or drawing on document 850 displayed on the display screen of electronic device 100 using an electronic pen according to the input content. Also, the user may want to share the host screen according to the execution of the host application provided by the host system of electronic device 100 during a video conference.

[0166] When the electronic device 100 receives input from a user selecting a screen sharing menu 825 on a video conferencing screen 800 displayed on the electronic device 100, it may be desirable for the electronic device 100 to provide a host screen even if the screen sharing request was received through a guest application.

[0167] FIG. 9 is a reference diagram for explaining the operation of processing a screen sharing request received from a guest application of a guest system of an electronic device according to one embodiment.

[0168] Referring to FIG. 9, when electronic device 100 receives a screen sharing request through a guest application 321 running on a guest system 320, the guest application 321 can forward the screen sharing request to a guest OS framework 322. The guest OS framework 322 can forward the screen sharing request to a host OS framework 312.

[0169] The host OS framework 312, upon receiving a screen sharing request from the guest OS framework 322, can capture the host OS screen displayed on the electronic device 100 via the window system 330. The host OS framework 312 can transmit the captured host OS screen to the guest OS framework 322. The guest OS framework 322 can transmit the received host OS screen to the guest application 321. Then, the guest application 321 can transmit the received host OS screen to the server 200. In this way, instead of the guest application directly processing the screen sharing request received from the guest application, the electronic device 100 requests the host system to receive the host OS screen, thereby enabling the electronic device 100 to transmit the OS host screen, rather than the guest OS screen, to the server 200. Such a host OS screen may include the guest OS screen.

[0170] FIG. 10 is an example of a flowchart of an operation for processing a screen sharing request received from a guest application of a guest system of an electronic device according to one embodiment.

[0171] Referring to FIG. 10, in operation 1001, a guest application 321 of a guest system 320 of an electronic device 100 can receive an input selecting a screen sharing request. For example, the electronic device 100 can receive an input selecting a screen sharing request by receiving an input selecting a screen sharing menu 825 on a video conferencing screen 800 as shown in FIG. 8. For example, if the electronic device 100 is implemented with a touch-sensitive display, the electronic device 100 can receive an input selecting a screen sharing request based on an input touching the display. For example, the electronic device 100 can receive an input selecting a screen sharing request by receiving a control signal from an external input device.

[0172] In operation 1002, the guest application 321 can forward a screen sharing request to the guest screen manager 325 depending on the input selecting the screen sharing request.

[0173] In operation 1003, the guest screen manager 325 can forward a screen sharing request to the host screen manager 315. Communication between the guest OS and the host OS can be established in various ways, such as by configuring a virtual network interface to allow the guest OS and the host OS to communicate with each other over a network, or by forwarding a specific port from the host OS to the guest OS.

[0174] In operation 1004, the host screen manager 315 can capture the host OS screen through the window system 330. The host screen manager 315 can periodically capture the host OS screen. The host OS screen captured by the host screen manager 315 through the window system can represent the entire host OS screen, including the guest OS screen.

[0175] In operation 1005, the host screen manager 315 can pass the captured host OS screen to the guest screen manager 325.

[0176] In operation 1006, the guest screen manager 325 can pass the host OS screen to the guest application 321.

[0177] In operation 1007, guest application 321 can transmit the received host OS screen to the server.

[0178] FIG. 11 is a reference diagram for explaining the operation of processing a screen sharing request received from a guest application of a guest system of an electronic device according to one embodiment.

[0179] Referring to FIG. 11, when an electronic device 100 receives a screen sharing request through a guest application 321 running on a guest system 320, the guest application 321 can forward the screen sharing request to a guest OS framework 322. At this time, the guest application 321 can forward server identification information along with the screen sharing request. Server identification information is information for the guest application to identify the server to which the screen will be transmitted for screen sharing, and may be referred to as server access information or server address information. Server identification information may include, for example, a server URI (Uniform Resource Identifier). The guest OS framework 322 can forward the server identification information along with the screen sharing request to a host OS framework 312.

[0180] A host OS framework 312, having received a screen sharing request and server identification information from a guest OS framework 322, can capture a host OS screen displayed on an electronic device 100 through a window system 330. The host OS framework 312 can transmit the captured host OS screen to a server 200 using server identification information received from a guest system 320. In this way, in the example illustrated in FIG. 11, the guest application does not directly process the screen sharing request received from the guest application, but rather requests it from the host system. The host system 310 then transmits the captured host OS screen directly to the server 200 using server identification information, thereby transmitting it directly to the server 200 without passing through the guest system 320, thus providing the host OS screen to the server 200 with less delay.

[0181] FIG. 12 is an example of a flowchart of an operation for processing a screen sharing request received from a guest application of a guest system of an electronic device according to one embodiment.

[0182] Referring to FIG. 12, in operation 1201, a guest application 321 of a guest system 320 of an electronic device 100 can receive an input selecting a screen sharing request. For example, the electronic device 100 can receive an input selecting a screen sharing request by receiving an input selecting a screen sharing menu 825 on a video conferencing screen 800 as shown in FIG. 8. For example, if the electronic device 100 has a display implemented as a touch-sensitive display, the electronic device 100 can receive an input selecting a screen sharing request based on an input touching the display. For example, the electronic device 100 can receive an input selecting a screen sharing request by receiving a control signal from an external input device.

[0183] In operation 1202, guest application 321 may forward a screen sharing request to guest screen manager 325 depending on the input selecting a screen sharing request. At this time, guest application 321 may forward the screen sharing request along with a server URI as identification information for the server to which the screen to be shared will be transmitted. The server URI is address information for identifying the server to which the screen to be shared will be transmitted in accordance with the screen sharing request.

[0184] In operation 1203, the guest screen manager 325 can forward a screen sharing request and a server URI to the host screen manager 315. Communication between the guest OS and the host OS can be established in various ways, such as by configuring a virtual network interface to allow the guest OS and the host OS to communicate with each other over a network, or by forwarding a specific port from the host OS to the guest OS.

[0185] In operation 1204, the host screen manager 315 can capture the host OS screen through the window system.

[0186] In operation 1205, the host screen manager 315 can send the host OS screen directly to the server using the server URI. Since the host screen manager 315 has received the server URI from the guest system, it can send the captured host OS screen directly to the server using the server URI without needing to send it back to the guest system.

[0187] According to one embodiment, an electronic device 100 can receive and display a guest OS screen from an external device using screen mirroring. Screen mirroring is a technology that replicates and displays the screen of a smartphone, tablet, computer, etc., exactly as it is on another electronic device, such as a TV or monitor. Screen mirroring enables a user to view content, for example, that is being viewed on a small device, on a larger screen. Since the screen of the original device is transmitted to another device in real time via screen mirroring, all operations performed on the original device can immediately appear identically on the mirrored device. Screen mirroring can be performed using wireless communication such as Wi-Fi or Bluetooth, or wired communication such as an HDMI cable. The external device can execute a guest application based on the guest OS and provide the guest OS screen to the electronic device 100 according to the execution of the guest application. When a screen sharing request input is received through this guest OS screen, only the guest OS screen can be shared, or the host OS screen displayed on the electronic device 100 can be shared.

[0188] FIG. 13 is a reference diagram for explaining the operation of an electronic device receiving and displaying a guest OS screen from an external device using screen mirroring according to one embodiment.

[0189] Referring to FIG. 13, an external device 1300 can run a guest application based on a guest OS. The guest application may include a video conferencing application or a video call application. For example, when the external device 1300 runs a video conferencing application, the external device 1300 can perform a video conference or video call by transmitting the voice or image of the user of the external device 1300 through a server 200 and receiving and outputting the voice or image of the user of the other electronic device 400 from the server 200.

[0190] In addition, the external device 1300 transmits the guest OS screen of the external device 1300 to the electronic device 100 using screen mirroring, and the electronic device 100 can display the guest OS screen received from the external device 1300 using screen mirroring on a display on a host OS screen based on its own host OS.

[0191] Here, if a screen sharing function is provided on a menu displayed on the guest OS screen, the user may select the screen sharing function menu on the guest OS screen displayed on their external device 1300, or select the screen menu sharing menu on the guest OS screen displayed using screen mirroring on the electronic device 100.

[0192] FIG. 14 is a reference diagram for explaining the operation when a screen sharing menu is selected on a guest OS screen displayed using screen mirroring in an electronic device according to one embodiment.

[0193] Referring to FIG. 14, when an input is received in which a screen sharing menu 1410 is selected from a guest OS screen 1400 received from an external device 1300 using screen mirroring in electronic device 100, this can be understood as the user wishing to share the screen displayed on the display of electronic device 100. The screen displayed on the display of electronic device 100 may include an entire host OS screen including a host OS screen based on the host OS of electronic device 100 and a guest OS screen received using screen mirroring.

[0194] In such a situation, to perform the operation of sharing the entire host OS screen displayed on the electronic device 100, the electronic device 100 first informs the external device 1300 that the screen sharing menu has been selected on the guest OS screen, and the external device 1300 can then request the electronic device 100 to share the entire host screen of the electronic device 100 accordingly. The electronic device 100 may transmit the entire host screen to the external device 1300 in response to the screen sharing request from the external device 1300, or, if it receives server URI information from the external device 1300, it may directly transmit the entire host screen to the server using the server URI information.

[0195] FIG. 15 is an example of a flowchart showing the operation when a screen sharing menu is selected on a guest OS screen displayed using screen mirroring in an electronic device according to one embodiment.

[0196] Referring to FIG. 15, in operation 1501, a guest application 321 of an external device 1300 can receive a screen mirroring request. For example, the external device 1300 can receive a screen mirroring request while displaying a guest OS screen by running a video conferencing application as an example of a guest application. The screen mirroring request may include user input requesting screen mirroring.

[0197] In operation 1502, the guest application 321 can forward a screen mirroring request to the guest screen manager 323.

[0198] In operation 1503, the guest screen manager 323 can capture the guest OS screen output to the display of the external device 1300 upon receiving a screen mirroring request and transmit it to the guest OS connection manager 327.

[0199] In operation 1504, the guest OS connection manager 327 can transmit the received guest OS screen to the host OS connection manager 317 of the electronic device 100. The guest OS connection manager 327 and the host OS connection manager 317 can control the transmission and reception of the guest OS screen through various wired communication technologies or wireless communication technologies.

[0200] In operation 1505, the host OS connection manager 317 can pass the guest OS screen to the host window manager 314.

[0201] Host window manager 314 can control the placement of a guest OS screen in at least a portion of the host OS screen displayed based on the host OS of electronic device 100 so that it is displayed on the display.

[0202] In this way, the electronic device 100 can display the guest OS screen received from the external device 1300 using screen mirroring on the host OS screen of the electronic device 100.

[0203] In operation 1507, the host input manager 316 of the electronic device 100 can receive a screen sharing request input. For example, the electronic device 100 as illustrated in FIG. 14 can receive an input selecting a screen sharing menu 1410 provided on a guest OS screen 1400 displayed on the display of the electronic device 100. The input selecting the screen sharing menu 1410 in this manner can be received by the host input manager 316. For example, the electronic device 100 can receive an input selecting the screen sharing menu 1410 via a remote controller or touch input, and the input selecting the screen sharing menu 1410 in this manner can be transmitted to the host input manager 316.

[0204] In operation 1508, the host input manager 316 can forward the screen sharing request input to the host OS connection manager 317.

[0205] In operation 1509, the host OS connection manager 317 can pass the screen sharing request input to the guest OS connection manager 327.

[0206] In operation 1510, the guest OS connection manager 327 can pass the screen sharing request input to the guest virtual input manager 326.

[0207] In operation 1511, the guest virtual input manager 326 can forward a screen sharing request input to the guest application 321. The guest virtual input manager 326 can forward the screen sharing request input to the guest application 321 with the same operation as if it had received the screen sharing request input from the external device 1300.

[0208] In operation 1512, the guest application 321 can forward a screen sharing request to the guest screen manager 323 based on the screen sharing request input received from the guest virtual input manager 326.

[0209] In operation 1513, the guest screen manager 323 receives a screen sharing request from the guest application 321 and can confirm that the screen sharing request was received from an electronic device connected via mirroring. The screen sharing request received by the guest screen manager 323 includes information indicating that the request was received from the electronic device 100, so the guest screen manager 323 can confirm that the screen sharing request was received from the electronic device. Alternatively, the guest screen manager 323 can confirm that the screen sharing request was received from the electronic device by confirming that the screen sharing request was received through the guest OS connection manager 327.

[0210] In operation 1514, the guest screen manager 323 can forward the screen sharing request to the guest OS connection manager 327 for sharing the host OS screen as it confirms that such a screen sharing request was received from an electronic device connected via mirroring.

[0211] In operation 1515, the guest OS connection manager 327 can forward a screen sharing request received from the guest screen manager 323 to the host OS connection manager 317.

[0212] In operation 1516, the host OS connection manager 317 can forward the screen sharing request to the host screen manager 313.

[0213] In operation 1517, the host screen manager 313 can capture the host OS screen through the window system. For example, the host screen manager 313 can capture the host OS screen 1420, which includes the guest OS screen 1400.

[0214] In operation 1518, the host screen manager 313 can transfer the captured host OS screen to the host OS connection manager 317.

[0215] In operation 1519, the host OS connection manager 317 can transmit the host OS screen to the guest OS connection manager 327.

[0216] In operation 1520, the guest OS connection manager 327 can pass the host OS screen to the guest screen manager 323.

[0217] In operation 1521, the guest screen manager 323 can pass the host OS screen to the guest application 321.

[0218] In operation 1522, guest application 321 can transmit the host OS screen to server 200.

[0219] In the example illustrated in FIG. 15, the operation of sharing a host OS screen captured from the host system of electronic device 100 by transmitting it to an external device 1300 based on a guest OS for screen sharing and sharing it with a server was described. However, this operation is not necessarily limited to this. If the external device 1300 provides a server URI along with a screen sharing request to electronic device 100, the host screen manager 313 can directly transmit the captured host OS screen to the server using the server URI provided by the external device 1300.

[0220] FIG. 16 is a reference diagram for explaining the operation when an external device selects a screen sharing menu while an external device provides a guest OS screen to an electronic device using screen mirroring according to one embodiment.

[0221] Referring to FIG. 16, when an external device 1300 transmits a guest OS screen to the external device 1300 using screen mirroring to display the guest OS screen on the electronic device 100, if an input is received selecting a screen sharing menu provided on the guest OS screen displayed on the external device 1300, this can be understood as the user wishing to share the screen displayed on the external device 1300's display. In such a situation, since it is understood that the screen the user wishes to share has little relevance to the host OS screen, the external device 1300 can perform the operation of sharing the guest OS screen displayed on its own display.

[0222] FIG. 17 is an example of a flowchart showing the operation when a screen sharing menu is selected on a guest OS screen displayed using screen mirroring in an electronic device according to one embodiment.

[0223] Referring to FIG. 17, operations 1701 through 1706 relate to displaying a guest OS screen on the display of electronic device 100 using screen mirroring, and since this is identical to operations 1501 through 1506 shown in FIG. 15, further explanation is omitted.

[0224] While electronic device 100 displays a guest OS screen received from external device 1300 using screen mirroring on the host OS screen of electronic device 100, in operation 1707, the guest touch manager 328 of external device 1300 can receive a screen sharing request input. For example, in a situation as illustrated in FIG. 16, external device 1300 can receive an input selecting a screen sharing menu 1310 provided on a guest OS screen 1320 displayed on the display of external device 1300. Thus, the input selecting the screen sharing menu 1310 can be received by the guest touch manager 328.

[0225] In operation 1708, the guest touch manager 328 can pass a screen sharing request input to the guest application 321.

[0226] In operation 1709, the guest application 321 can forward a screen sharing request to the guest screen manager 323 based on the screen sharing request input received from the guest touch manager 328.

[0227] In operation 1710, the guest screen manager 323 receives a screen sharing request from the guest application 321 and can capture the guest OS screen.

[0228] In operation 1711, the guest screen manager 323 can pass the guest OS screen to the guest application 321.

[0229] In operation 1712, guest application 321 can transmit the guest OS screen to the server.

[0230] FIG. 18 shows an example of a detailed block diagram of an electronic device according to one embodiment.

[0231] Referring to FIG. 18, the electronic device 100 may further include a video processing unit 150, an audio processing unit 160, an audio output unit 170, a receiver unit 180, and a detection unit 190 in addition to a communication unit 110, a display 120, a memory 130, and a processor 140.

[0232] The communication unit 110 may include various communication circuits included in one or more modules that enable wireless communication between the electronic device 100 and a wireless communication system or between the electronic device 100 and a network where another electronic device is located. For example, the communication unit 110 may include a mobile communication module 111, a wireless internet module 112, and a short-range communication module 113.

[0233] A mobile communication module 111 transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signals may include various forms of data such as voice call signals, video call call signals, or text / multimedia message transmission and reception.

[0234] Wireless Internet Module 112 refers to a module for wireless internet access, which can be embedded in or externally mounted on a device. Wireless Internet technologies that may be used include WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), WiMAX (World Interoperability for Microwave Access), and HSDPA (High Speed ​​Downlink Packet Access). Through the wireless Internet Module 112, the device can establish a Wi-Fi P2P (Peer to Peer) connection with another device.

[0235] A short-range communication module 113 refers to a module for short-range communication. Short-range communication technologies that can be used include Bluetooth, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra Wideband), and ZigBee.

[0236] The display 120 can display a video signal received from the video processing unit 150 on the screen.

[0237] Memory 130 can store programs related to the operation of electronic device 100 and various data generated during the operation of electronic device 100. Memory 130 may include a host system 310 and a guest system 320 as shown in FIG. 3.

[0238] The video processing unit 150 can process a video signal received from the receiving unit 180 or the communication unit 110 under the control of the processor 140 and output it to the display 120.

[0239] The audio processing unit 160 can convert an audio signal received from the receiving unit 180 or the communication unit 110 into an analog audio signal and output it to the audio output unit 170 under the control of the processor 140.

[0240] The audio output unit 170 can output the received analog audio signal through a speaker.

[0241] The receiver 180 can receive video (e.g., video, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from outside the electronic device 100 under the control of the processor 140. The receiver 180 may include one of an HDMI port (High-Definition Multimedia Interface port, 181), a component jack (182), a PC port (183), and a USB port (184), or one or more combinations thereof. In addition to the HDMI port, the receiver 180 may further include a DisplayPort (DP), Thunderbolt, and MHL (Mobile High-Definition Link).

[0242] The detection unit 190 detects the user's voice, the user's image, or the user's interaction and may include a microphone, a camera unit, and an optical receiver. The microphone receives the user's uttered voice. The microphone may convert the received voice into an electrical signal and output it to the processor 140. The camera unit may receive images (e.g., consecutive frames) corresponding to the user's motion, including gestures, within the camera recognition range. The optical receiver receives an optical signal (including a control signal) received from a remote control device. The optical receiver may receive an optical signal corresponding to user input (e.g., touch, press, touch gesture, voice, or motion) from the remote control device.

[0243] According to one embodiment, the electronic device includes a memory for storing one or more instructions and at least one processor for executing said one or more instructions.

[0244] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may display a guest OS screen corresponding to a guest application running in the guest OS on at least a portion of the host OS screen of the host OS.

[0245] According to one embodiment, when one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may receive a screen sharing request through the guest application.

[0246] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may, in response to the screen sharing request, capture the host OS screen including the guest OS screen and transmit the captured host OS screen to a server.

[0247] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may transmit the screen sharing request to the host OS through the guest OS.

[0248] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may capture the host OS screen, including the guest OS screen, by the host OS in response to the screen sharing request received by the host OS, and transmit the captured host OS screen to the guest OS.

[0249] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device can transmit the captured host OS screen to the server through the guest application.

[0250] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may transmit server identification information for identifying the server to the host OS by the guest OS and the screen sharing request.

[0251] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may transmit the captured host OS screen to the server through the host OS using the server identification information based on the screen sharing request being received by the host OS.

[0252] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may specify a window of the host OS for the guest application according to the execution of the guest application and display the guest OS screen in the specified window.

[0253] According to one embodiment, the guest application is executed through an external device, and when one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device can receive and display the guest OS screen corresponding to the guest application executed on the external device through screen mirroring.

[0254] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may transmit the captured host OS screen to the server in response to a screen sharing request through the guest OS screen displayed based on the screen mirroring.

[0255] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device can receive screen sharing input through the guest OS screen displayed based on the screen mirroring.

[0256] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may receive a screen sharing request for the host OS screen from the external device as it transmits the screen sharing input to the external device.

[0257] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may output the captured host OS screen in response to a screen sharing request of the host OS screen.

[0258] According to one embodiment, when the one or more instructions are executed individually and / or collectively by the at least one processor, the electronic device may transmit the captured host OS screen to the external device or transmit the captured host OS screen to the server using server identification information.

[0259] According to one embodiment, the host OS and the guest OS may be configured to communicate through at least one virtual network interface or by forwarding a port from the host OS to the guest OS.

[0260] According to one embodiment, server identification information may include the Uniform Resource Identified (URI) of the server.

[0261] According to one embodiment, a method for operating an electronic device may include an operation of displaying a guest OS screen corresponding to a guest application running in a guest OS on at least a part of a host OS screen of a host OS.

[0262] According to one embodiment, a method for operating an electronic device may include receiving a screen sharing request through the guest application 321.

[0263] According to one embodiment, a method for operating an electronic device may include capturing the host OS screen including the guest OS screen in response to the screen sharing request, and transmitting the captured host OS screen to a server 200.

[0264] According to one embodiment, a method for operating an electronic device may include the operation of transmitting the screen sharing request to the host OS through the guest OS.

[0265] According to one embodiment, a method for operating an electronic device may include, in response to a screen sharing request received by the host OS, capturing the host OS screen including the guest OS screen by the host OS, and transmitting the captured host OS screen to the guest OS.

[0266] According to one embodiment, a method for operating an electronic device may include the operation of transmitting the captured host OS screen to the server through the guest application.

[0267] According to one embodiment, a method for operating an electronic device may include the operation of transmitting server identification information for identifying the server to the host OS by the guest OS and the screen sharing request.

[0268] A method for operating an electronic device according to one embodiment may include the operation of transmitting the captured host OS screen to the server through the host OS using the server identification information, based on the screen sharing request being received by the host OS.

[0269] According to one embodiment, a method for operating an electronic device may include specifying a window of the host OS for the guest application according to the execution of the guest application, and displaying the guest OS screen in the specified window.

[0270] According to one embodiment, a method for operating an electronic device may include the operation of receiving and displaying a guest OS screen corresponding to the guest application executed on the external device through screen mirroring, wherein the guest application is executed through an external device.

[0271] According to one embodiment, a method for operating an electronic device may include the operation of transmitting the captured host OS screen to the server in response to a screen sharing request through the guest OS screen displayed based on the screen mirroring.

[0272] According to one embodiment, a method for operating an electronic device may include receiving a screen sharing input through the guest OS screen displayed based on the screen mirroring.

[0273] According to one embodiment, a method for operating an electronic device may include the operation of receiving a screen sharing request for the host OS screen from the external device as the screen sharing input is transmitted to the external device.

[0274] According to one embodiment, a method for operating an electronic device may include an operation of outputting the captured host OS screen in response to a screen sharing request of the host OS screen.

[0275] According to one embodiment, a method for operating an electronic device may include transmitting the captured host OS screen to the external device or transmitting the captured host OS screen to the server using server identification information.

[0276] According to one embodiment, the host OS and the guest OS may be configured to communicate through at least one virtual network interface or by forwarding a port from the host OS to the guest OS.

[0277] According to one embodiment, server identification information may include the Uniform Resource Identified (URI) of the server.

[0278] According to one embodiment, in a non-transient computer-readable recording medium storing one or more instructions, when the one or more instructions are executed by at least one processor of an electronic device, the electronic device displays a guest OS screen corresponding to a guest application running in a guest OS on at least a portion of a host OS screen of a host OS, receives a screen sharing request through the guest application, captures the host OS screen including the guest OS screen in accordance with the screen sharing request, and transmits the captured host OS screen to a server.

[0279] Some embodiments may also be implemented in the form of a recording medium containing computer-executable instructions, such as program modules executed by a computer. A computer-readable medium may be any available medium accessible by a computer and includes both volatile and non-volatile media, and both removable and non-removable media. Additionally, a computer-readable medium may include a computer storage medium. A computer storage medium includes both volatile and non-volatile, removable and non-removable media implemented by any method or technique for storing information, such as computer-readable instructions, data structures, program modules, or other data.

[0280] The disclosed embodiments may be implemented as a software program comprising instructions stored on a computer-readable storage media.

[0281] A computer is a device capable of calling instructions stored from a storage medium and performing operations according to the disclosed embodiments according to the called instructions, and may include an electronic device according to the disclosed embodiments.

[0282] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, 'non-transitory' means merely that the storage medium does not contain a signal and is tangible, without distinguishing whether data is stored semi-permanently or temporarily on the storage medium.

[0283] In addition, the control method according to the disclosed embodiments may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product.

[0284] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable app) that is electronically distributed through a device manufacturer or an electronic market (e.g., Google Play Store, App Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the manufacturer, a server of the electronic market, or a storage medium of a relay server that temporarily stores the software program.

[0285] A computer program product may include a storage medium of a server or a storage medium of a device in a system composed of a server and a device. Alternatively, if there is a third device (e.g., a smartphone) that is connected to the server or device in communication, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include the S / W program itself that is transmitted from the server to the device or the third device, or transmitted from the third device to the device.

[0286] In this case, one of the server, the device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, the device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments in a distributed manner.

[0287] For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) can execute a computer program product stored on the server to control a device connected to the server in communication to perform a method according to the disclosed embodiments.

[0288] As another example, the third device may execute a computer program product to control a device connected to the third device in communication to perform a method according to the disclosed embodiment. When the third device executes the computer program product, the third device may download the computer program product from a server and execute the downloaded computer program product. Alternatively, the third device may execute a computer program product provided in a preloaded state to perform a method according to the disclosed embodiments.

[0289] Additionally, in this specification, "part" may be a hardware component, such as a processor or circuit, and / or a software component executed by a hardware component, such as a processor.

[0290] The foregoing description of the present disclosure is for illustrative purposes only, and those skilled in the art will understand that other specific forms can be easily modified without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single unit may be implemented in a distributed manner, and components described as distributed may likewise be implemented in a combined form.

[0291] The scope of the present disclosure is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts thereof should be interpreted as being included within the scope of the present disclosure.

Claims

1. In electronic device 100, Memory 130 for storing one or more instructions, and It includes at least one processor 140 that executes one or more of the above instructions, and When the above one or more instructions are executed individually and / or collectively by the above at least one processor, the electronic device, A guest OS screen corresponding to a guest application running in the guest OS is displayed on at least a part of the host OS screen of the host OS, and A screen sharing request is received through the above guest application 321, and An electronic device that, in response to the above screen sharing request, captures the host OS screen including the guest OS screen and transmits the captured host OS screen to server 200.

2. In Paragraph 1, When the above one or more instructions are executed individually and / or collectively by the above at least one processor, the electronic device 100, The screen sharing request is transmitted to the host OS through the guest OS, and In accordance with the screen sharing request received by the host OS, the host OS captures the host OS screen including the guest OS screen, and transmits the captured host OS screen to the guest OS. An electronic device that transmits the captured host OS screen to the server through the above guest application.

3. In Paragraph 1 or 2, When the above one or more instructions are executed individually and / or collectively by the above at least one processor, the electronic device 100, The above guest OS transmits server identification information for identifying the server to the above host OS and the above screen sharing request, and An electronic device that transmits the captured host OS screen to the server via the host OS using the server identification information, based on the reception of the screen sharing request by the host OS.

4. In any one of paragraphs 1 through 3, When the above one or more instructions are executed individually and / or collectively by the above at least one processor, the electronic device, An electronic device that designates a window of the host OS for the guest application according to the execution of the guest application, and displays the guest OS screen in the designated window.

5. In any one of paragraphs 1 through 4, The above guest application is executed through an external device, and When the above one or more instructions are executed individually and / or collectively by the above at least one processor, the electronic device 100, An electronic device that receives and displays the guest OS screen corresponding to the guest application running on the external device through screen mirroring.

6. In Paragraph 5, When the above one or more instructions are executed individually and / or collectively by the above at least one processor, the electronic device 100, An electronic device that transmits the captured host OS screen to the server in response to a screen sharing request through the guest OS screen displayed based on the screen mirroring.

7. In Paragraph 6, When the above one or more instructions are executed individually and / or collectively by the above at least one processor, the electronic device 100, Receive screen sharing input through the guest OS screen displayed based on the above screen mirroring, and As the above screen sharing input is transmitted to the external device, a screen sharing request for the host OS screen is received from the external device, and An electronic device that outputs the captured host OS screen in response to a screen sharing request of the host OS screen.

8. In Paragraph 6, When the above one or more instructions are executed individually and / or collectively by the above at least one processor, the electronic device 100, An electronic device that transmits the captured host OS screen to the external device or transmits the captured host OS screen to the server using server identification information.

9. A method for operating an electronic device 100, An operation of displaying a guest OS screen corresponding to a guest application running in the guest OS on at least a part of the host OS screen of the host OS, The operation of receiving a screen sharing request through the above guest application 321, and A method comprising the operation of capturing the host OS screen including the guest OS screen in accordance with the screen sharing request, and transmitting the captured host OS screen to server 200.

10. In Paragraph 9, The operation of transmitting the screen sharing request to the host OS through the guest OS, An operation of capturing the host OS screen including the guest OS screen by the host OS in accordance with the screen sharing request received by the host OS, and transmitting the captured host OS screen to the guest OS; and A method comprising the operation of transmitting the captured host OS screen to the server through the above guest application.

11. In Paragraph 9 or 10, An operation of transmitting server identification information for identifying the server to the host OS by the guest OS and the screen sharing request, and A method comprising the operation of transmitting the captured host OS screen to the server via the host OS using the server identification information, based on the reception of the screen sharing request by the host OS.

12. In any one of paragraphs 9 through 11, A method comprising the operation of specifying a window of the host OS for the guest application according to the execution of the guest application, and displaying the guest OS screen in the specified window.

13. In any one of paragraphs 9 through 12, The above guest application is executed through an external device, and A method comprising receiving and displaying the guest OS screen corresponding to the guest application running on the external device through screen mirroring.

14. In Paragraph 13, A method comprising the operation of transmitting the captured host OS screen to the server in response to a screen sharing request through the guest OS screen displayed based on the screen mirroring.

15. In a non-transient computer-readable recording medium storing one or more instructions, when said one or more instructions are executed by at least one processor 140 of an electronic device 100, said electronic device 100, A guest OS screen corresponding to a guest application running in the guest OS is displayed on at least a part of the host OS screen of the host OS, and A screen sharing request is received through the above guest application 321, and A non-transient computer-readable recording medium that captures the host OS screen including the guest OS screen in accordance with the screen sharing request and transmits the captured host OS screen to server 200.

Images