Display device and operating method thereof

Abstract

A display device according to one embodiment may include a display, a communication interface including circuitry configured to transmit and / or receive data to and from a plurality of electronic devices, a memory storing one or more instructions, and at least one processor, the processor is configured to execute one or more instructions to divide a screen of the display equipment into a plurality of areas and obtain a plurality of pieces of display information corresponding to the plurality of areas respectively, and a controller configured to control the communication interface to transmit first display information corresponding to a first region of the plurality of regions to a first electronic device corresponding to the first region of the plurality of electronic devices, receive a first image obtained based on the first display information from the first electronic device, and control the display to display the first image in the first region.

Description

Technical Field

[0001] The present disclosure relates to a display device for sharing screens of a plurality of electronic devices and an operating method of the display device, and an electronic device for sharing a screen on a display device and an operating method of the electronic device. Background Art

[0002] Using a short-range wired / wireless communication network, the function of sharing the screen of a personal electronic device (source device) on a display device such as a large screen can be utilized. The screen sharing function allows each of multiple source devices to share all or part of its screen on the display device at the same time. Screen sharing between multiple source devices and display devices can be performed through a direct communication connection between each of the source devices and the display device, without the need for a separate server.

[0003] Typically, the display device sends native resolution information to the source device, and the source devices each send an image to be shared to the display device based on the native resolution of the display device. The display device displays the image received from the source device. In this case, the image data received from each source device may be image data having the native resolution of the display device, regardless of the state of the area where the image data is actually displayed on the display device. Summary of the invention

[0004] Technical solutions to the problem

[0005] An embodiment of the present disclosure provides a display device that can share screens of multiple electronic devices.

[0006] According to an example embodiment of the present disclosure, a display device may include: a display, a communication interface including circuits configured to send data to and receive data from multiple electronic devices, a memory storing one or more instructions, and at least one processor configured to execute the one or more instructions.

[0007] The at least one processor may be configured to execute one or more instructions to: divide a screen of the display device into a plurality of regions, and obtain a plurality of pieces of display information respectively corresponding to the plurality of regions.

[0008] The at least one processor may be configured to execute one or more instructions to: control the communication interface to transmit first display information corresponding to a first area among the plurality of areas to a first electronic device corresponding to the first area among the plurality of electronic devices.

[0009] The at least one processor may be configured to execute one or more instructions to: control the communication interface to transmit second display information corresponding to a second area among the plurality of areas to a second electronic device corresponding to the second area among the plurality of electronic devices.

[0010] At least one processor may be configured to execute one or more instructions to: control the communication interface to receive a first image obtained based on the first display information from the first electronic device, and to receive a second image obtained based on the second display information from the second electronic device.

[0011] At least one processor may be configured to execute one or more instructions to: control the display to display a first image in a first area and to display a second image in a second area.

[0012] An embodiment of the present disclosure may provide an electronic device according to which a screen thereof may be shared on a display device.

[0013] According to an example embodiment of the present disclosure, an electronic device may include: a display, a communication interface including a circuit configured to send data to and receive data from the display device, a memory storing one or more instructions, and at least one processor configured to execute the one or more instructions.

[0014] The at least one processor may be configured to execute one or more instructions to: control the communication interface to receive first display information from the display device.

[0015] The at least one processor may be configured to execute one or more instructions to: scale an image in a target area to be shared on a screen displayed on the display based on the first display information.

[0016] The at least one processor may be configured to execute one or more instructions to: control the communication interface to send the scaled image to the display device.

[0017] The at least one processor may be configured to execute one or more instructions to: control the display to display a notification message based on that the first display information is different from the second display information about the target area to be shared.

[0018] An embodiment of the present disclosure may provide a method of operating a display device to share screens of a plurality of electronic devices, which method may include dividing the screen of the display device into a plurality of areas.

[0019] According to an example embodiment of the present disclosure, a method of operating a display device may include obtaining a plurality of pieces of display information respectively corresponding to a plurality of regions.

[0020] According to an example embodiment of the present disclosure, a method of operating a display device may include transmitting first display information corresponding to a first area among a plurality of areas to a first electronic device corresponding to the first area among a plurality of electronic devices.

[0021] According to an example embodiment of the present disclosure, a method of operating a display device may include transmitting second display information corresponding to a second area among a plurality of areas to a second electronic device corresponding to the second area among a plurality of electronic devices.

[0022] According to an example embodiment of the present disclosure, a method of operating a display device may include receiving a first image obtained based on first display information from a first electronic device.

[0023] According to an example embodiment of the present disclosure, a method of operating a display device may include receiving a second image obtained based on second display information from a second electronic device.

[0024] According to an example embodiment of the present disclosure, a method of operating a display device may include displaying a first image in a first area and displaying a second image in a second area.

[0025] According to an example embodiment, a method of operating an electronic device to share its screen on a display device may include receiving first display information from the display device.

[0026] According to an exemplary embodiment of the present disclosure, a method of operating an electronic device may include scaling an image in a target area to be shared on a screen displayed on a display based on first display information.

[0027] According to an example embodiment of the present disclosure, a method of operating an electronic device may include transmitting a scaled image to a display device.

[0028] According to an exemplary embodiment of the present disclosure, a method of operating an electronic device may include displaying a notification message based on that first display information is different from second display information regarding a target area to be shared. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent through the following detailed description in conjunction with the accompanying drawings, in which:

[0030] Figure 1 is a diagram illustrating an example screen sharing system according to various embodiments;

[0031] Figure 2 is a signal flow diagram illustrating an example method performed by a display device and a plurality of electronic devices to perform screen sharing therebetween according to various embodiments;

[0032] Figure 3is a diagram showing an example in which a display device displays a list of external electronic devices connected thereto according to various embodiments;

[0033] Figure 4 is a diagram showing an example of a menu screen through which a layout of a shared screen can be set according to various embodiments;

[0034] Figure 5 is a diagram illustrating an example method of sharing a screen with a first electronic device and a second electronic device, performed by a display device according to various embodiments;

[0035] Figure 6 is a flowchart illustrating an example method performed by a display device to perform screen sharing with multiple electronic devices according to various embodiments;

[0036] Figure 7 is a diagram illustrating an example method of sharing a screen with an electronic device when a layout of a screen of the display device is changed, performed by a display device according to various embodiments;

[0037] Figure 8 , Fig. 9 and Fig.10 is a diagram illustrating an example method of sharing a screen with an electronic device when its screen is changed by a shared electronic device, performed by a display device according to various embodiments;

[0038] Fig.11 is a diagram illustrating an example of adjusting a shared screen displayed on an electronic device when the electronic device shares its screen with a display device according to various embodiments;

[0039] Fig.12 is a block diagram showing example configurations of a display device and an electronic device according to various embodiments; and

[0040] Fig.13 is a block diagram illustrating an example configuration of a display device according to various embodiments. DETAILED DESCRIPTION

[0041] Throughout the present disclosure, the expression "at least one of a, b, or c" indicates only a; only b; only c; both a and b; both a and c; both b and c; all of a, b, and c or variations thereof. The terms used in the present disclosure will now be briefly described, and then the present disclosure will be described in more detail.

[0042] As the terms used herein, currently widely used general terms are selected by considering the functions according to the present disclosure, but the terms may be changed according to the intention of ordinary technicians in the field, precedent situations, the emergence of new technologies, etc. In addition, various terms may be arbitrarily selected, and in this case, the meaning of the selected terms will be described in detail in the detailed description of the present disclosure. Therefore, the terms used herein should not be defined by their simple titles, but are defined based on the meaning of the terms and the overall description of the present disclosure.

[0043] Throughout this disclosure, when a component "includes" or "contains" an element, unless there is a specific description to the contrary, it should be understood that the component may also include other elements, and other elements are not excluded. In addition, terms such as "part", "module", etc. described in this disclosure refer to a unit for processing at least one function or operation, and can be implemented as hardware or software, or a combination of hardware and software.

[0044] Embodiments of the present disclosure will be described more fully below with reference to the accompanying drawings. However, embodiments of the present disclosure may have different forms and should not be construed as being limited to the various example embodiments thereof set forth herein. In addition, components not related to the description of the present disclosure may be omitted in the accompanying drawings to clearly explain embodiments of the present disclosure, and the same reference numerals always represent the same elements.

[0045] In an embodiment of the present disclosure, the term “user” may refer to a person who controls a system, function, or operation, and may include a developer, an administrator, or an installation technician.

[0046] In addition, in the embodiments of the present disclosure, an “image” or a “picture” may refer to a still image, a moving picture including a plurality of consecutive still images (or frames), or a video.

[0047] Figure 1 is a diagram illustrating an example screen sharing system in accordance with various embodiments.

[0048] refer to Figure 1 , a screen sharing system according to an embodiment of the present disclosure may include a display device 100 and a plurality of electronic devices 200 .

[0049] The plurality of electronic devices 200 according to an embodiment of the present disclosure may transmit data to and / or receive data from the display device 100 using a wired or wireless communication method. For example, the plurality of electronic devices 200 may each perform communication for sharing their screens on the display device 100. In addition, the display device 100 may perform communication for sharing the screens of the plurality of electronic devices 200 on the display device 100.

[0050] According to an embodiment of the present disclosure, the display device 100 may be communicatively connected to each of the plurality of electronic devices 200 via a wired or wireless communication interface. For example, the wired communication interface may include a high-definition multimedia interface (HDMI), a universal serial bus (USB), an optical interface, a D-sub (D-sub), a digital video interface (DVI), a display port, etc. Also, the wireless communication interface may include a WiFi module, a Bluetooth module, etc.

[0051] In addition, the display device 100 according to an embodiment of the present disclosure may use a Web (network) real-time communication (RTC) scheme to share data with each of the multiple electronic devices 200. For example, Web RTC may refer to a peer-to-peer (P2P) communication scheme that implements direct data transmission without a central server, which allows real-time sharing of audio, video, data, etc. on the web without the need for separate plug-ins or software. However, the present disclosure is not limited thereto, and the display device 100 may communicate with each of the multiple electronic devices 200 using various wired or wireless communication methods.

[0052] According to an embodiment of the present disclosure, the display device 100 and the plurality of electronic devices 200 may be implemented in various forms, such as a TV including a display, a smart monitor, a mobile phone, a tablet PC, a digital camera, a video camera, a laptop computer, a desktop computer, an e-book terminal, a digital broadcast terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, an MP3 player, a wearable device, etc. In addition, the display device 100 and the plurality of electronic devices 200 may be fixed electronic devices placed at a fixed position or mobile electronic devices having a portable form, and may be a digital broadcast receiver capable of receiving digital broadcasting. However, the present disclosure is not limited thereto.

[0053] According to an embodiment of the present disclosure, the plurality of electronic devices 200 may share the entire screen or a portion of the screen displayed on the plurality of electronic devices 200 on the display device 100 .

[0054] According to an embodiment of the present disclosure, the display device 100 may divide its screen into a plurality of regions, and display the shared screens received from the plurality of electronic devices 200 in the plurality of regions, respectively. For example, the display device 100 may divide its screen into four regions based on the number of the plurality of electronic devices 200 connected to share their screens. The display device 100 may display the shared screen received from the first electronic device 201 of the plurality of electronic devices 200 in the first region 101, the shared screen received from the second electronic device 202 in the second region 102, the shared screen received from the third electronic device 203 in the third region 103, and the shared screen received from the fourth electronic device 204 in the fourth region 104.

[0055] In this case, when the display device 100 sends the native resolution of the display device 100 to multiple electronic devices 200 without considering the size of the area where the shared screen is actually played, the multiple electronic devices 200 send an image stream (shared screen) with the native resolution of the display device 100 to the display device 100.

[0056] Because the display device 100 plays four shared screens on the screen at the same time, each of the four shared screens is displayed at one quarter (1 / 4) of the native resolution of the display device 100. Therefore, the display device 100 decodes the video streams received from the multiple electronic devices 200 and reduces the decoded image streams to 1 / 4 of the resolution of the decoded image streams, thereby displaying the resulting images on the first to fourth areas 101, 102, 103 and 104, respectively. As a result, because the resolution of the image streams sent by the multiple electronic devices 200 to the display device 100 is four times the resolution of the image streams actually displayed, network traffic is unnecessarily wasted. In addition, in order for the display device 100 to decode the image streams received from the multiple electronic devices 200 and reduce the resolution to 1 / 4, high-performance computing is required, which may prevent the display device 100 from performing other functions.

[0057] According to an embodiment of the present disclosure, the display device 100 may send a plurality of pieces of display information about the area where the shared screen is displayed to a plurality of electronic devices 200 respectively corresponding to the areas. For example, the display device 100 may send display information about the first area 101 to the first electronic device 201, display information about the second area 102 to the second electronic device 202, display information about the third area 103 to the third electronic device 203, and display information about the fourth area 104 to the fourth electronic device 204.

[0058] Therefore, each of the plurality of electronic devices 200 can scale the image to be shared based on the display information received from the display device 100 and send the scaled image to the display device 100. As a result, waste of unnecessary network traffic can be prevented and / or reduced, and the amount of calculation required for screen sharing on the display device 100 can be reduced.

[0059] A method of sharing a screen between a display device 100 and each of a plurality of electronic devices 200 according to an embodiment of the present disclosure is described in detail below with reference to the accompanying drawings.

[0060] Figure 2 is a signal flow diagram illustrating an example method of performing screen sharing performed by a display device and a plurality of electronic devices according to various embodiments.

[0061] refer to Figure 2According to an embodiment of the present disclosure, the display device 100 may perform a communication connection for screen sharing with the first electronic device 201 and the second electronic device 202 (S210 and S220).

[0062] For example, the first electronic device 201 and the second electronic device 202 may each request a communication connection for screen sharing from the display device 100. The first electronic device 201 and the second electronic device 202 may each execute an application for screen sharing. The first electronic device 201 and the second electronic device 202 may each search for the display device 100 using the application for screen sharing, and request a communication connection for screen sharing from the found display device 100.

[0063] The display device 100 may search for the first electronic device 201 and the second electronic device 202 using the application for screen sharing, and request a communication connection for screen sharing from the found first electronic device 201 and the second electronic device 202, respectively. However, the present disclosure is not limited thereto.

[0064] According to an embodiment of the present disclosure, the display device 100 may receive connection requests from the first electronic device 201 and the second electronic device 202, respectively, and perform communication connection with the first electronic device 201 and the second electronic device 202. When the communication connection between the display device 100 and the first electronic device 201 is completed, a message indicating that screen sharing is possible may be output to the first electronic device 201. In addition, when the communication connection between the display device 100 and the second electronic device 202 is completed, a message indicating that screen sharing is possible may be output to the second electronic device 202. In addition, the display device 100 may display a list of connected devices including the first electronic device 201 and the second electronic device 202 that have completed the communication connection with the display device 100. However, the present disclosure is not limited thereto.

[0065] According to an embodiment of the present disclosure, the display device 100 may share screens of a plurality of electronic devices connected thereto.

[0066] The display device 100 may divide its screen into a plurality of regions based on the layout of the screen, and obtain a plurality of pieces of display information respectively corresponding to the plurality of regions ( S230 ).

[0067] The display device 100 may transmit a plurality of display information corresponding to the plurality of regions to a plurality of electronic devices corresponding to the plurality of regions. For example, the display device 100 may transmit first display information corresponding to a first region among the plurality of regions to a first electronic device 201 corresponding to the first region (S250).

[0068] According to an embodiment of the present disclosure, the display information about the region may include at least one of the size, resolution, or aspect ratio of the corresponding region. However, the present disclosure is not limited thereto.

[0069] In addition, when the first electronic device 201 corresponds to the first area, it can be understood that the shared image received from the first electronic device 201 is displayed in the first area.

[0070] The display device 100 may transmit second display information corresponding to a second area among the multiple areas to the first electronic device 202 corresponding to the second area (S255). When the second electronic device 202 corresponds to the second area, it can be understood that the shared image received from the second electronic device 202 is displayed in the second area.

[0071] According to an embodiment of the present disclosure, the first electronic device 201 and the second electronic device 202 may respectively set target areas to be shared on the display device 100 on their screens ( S240 and S245 ).

[0072] For example, the first electronic device 201 and the second electronic device 202 may each set their entire display screen as the target area to be shared. Alternatively, the first electronic device 201 and the second electronic device 202 may each set a portion of the display screen as the target area to be shared. For example, the first electronic device 201 and the second electronic device 202 may each set the execution window of a specific application displayed on its display screen as the target area to be shared. In this case, the size of the execution window of the application may be changed based on user input, and therefore, the size of the target area to be shared may also be changed.

[0073] According to an embodiment of the present disclosure, the first electronic device 201 may adjust display information about the first image in the target area set in operation S240 based on the first display information received from the display device 100 ( S260 ).

[0074] For example, the first electronic device 201 may adjust at least one of the size, resolution, or aspect ratio of the first image displayed in the first area set as the target area to be shared based on the first display information. When the first display information includes a first resolution (e.g., 1920×1080) and the resolution of the first image is a second resolution (e.g., 1280×720), the first electronic device 201 may scale the first image to have the first resolution. Alternatively, when the first display information includes a first aspect ratio (e.g., 16:9) and the aspect ratio of the first image is a second aspect ratio (e.g., 4:3), the first electronic device 201 may scale the first image to have the first aspect ratio. However, the present disclosure is not limited thereto.

[0075] The electronic device 201 may transmit the first image whose display information has been adjusted to the display device 100 ( S270 ).

[0076] In addition, according to an embodiment of the present disclosure, the second electronic device 202 may adjust display information about the second image in the target area set in operation S245 based on the second display information received from the display device 100 ( S265 ).

[0077] For example, the second electronic device 202 may adjust at least one of the size, resolution, or aspect ratio of the second image displayed in the second area set as the target area to be shared based on the second display information. When the second display information includes a third resolution (e.g., 1280×720) and the resolution of the second image is a fourth resolution (e.g., 1920×1080), the second electronic device 202 may scale the second image to have the third resolution. Alternatively, when the second display information includes a third aspect ratio (e.g., 4:3) and the aspect ratio of the second image is a fourth aspect ratio (e.g., 16:9), the second electronic device 202 may scale the second image to have the third aspect ratio. However, the present disclosure is not limited thereto.

[0078] The second electronic device 202 may transmit the second image whose display information has been adjusted to the display device 100 ( S275 ).

[0079] According to an embodiment of the present disclosure, the display device 100 may display a first image received from the first electronic device 201 in the first region, and display a second image received from the second electronic device 202 in the second region (S280).

[0080] Figure 3 is a diagram illustrating an example in which a display device displays a list of external electronic devices connected thereto according to various embodiments.

[0081] refer to Figure 3 According to an embodiment of the present disclosure, the display device 100 may execute an application for screen sharing based on a user input. For example, the display device 100 may receive a control signal, a control command, etc. corresponding to the user input from a control device. The control device may include a remote controller, a keyboard, a mouse, etc., and may exchange data, information, signals, etc. with the display device 100 through wired or wireless communication. However, the present disclosure is not limited thereto.

[0082] When the application for screen sharing is executed, the display device 100 may display a list 310 on the display device 100 indicating external electronic devices whose screens can be shared when the communication connection with the display device 100 is completed. For example, the list 310 may include, but is not limited to, a device type, a model name, identification information, etc. of each of the external electronic devices.

[0083] The display device 100 may receive a user input for selecting at least one electronic device whose screen is to be shared from the list 310 and selecting the screen sharing item 320. Based on the user input, the display device 100 may determine at least one electronic device whose screen is to be shared, and perform screen sharing with the determined at least one electronic device. For example, the display device 100 may perform screen sharing with the electronic device 1 and the electronic device 3 selected from the list 310.

[0084] Alternatively, the display device 100 may add a new electronic device for screen sharing based on a user input for selecting the device addition item 330. For example, the display device 100 may search for a new electronic device not included in the list 310, and add the found new electronic device to the list 310 when a communication connection with the new electronic device is completed.

[0085] Figure 4 is a diagram illustrating an example of a menu screen through which a layout of a shared screen may be set according to various embodiments.

[0086] According to an embodiment of the present disclosure, the display device 100 may determine the layout of a shared screen based on the number of a plurality of electronic devices sharing the screen.

[0087] According to an embodiment of the present disclosure, when a plurality of electronic devices for screen sharing are selected, the display device 100 may set a layout of a shared screen.

[0088] refer to Figure 4 According to an embodiment of the present disclosure, the display device 100 may display a menu 410 for setting a layout of a shared screen. The display device 100 may obtain a candidate for a layout of a shared screen based on the number of multiple electronic devices sharing a screen. For example, Figure 4 As shown, when there are two electronic devices sharing a screen, the display device 100 can obtain a layout for dividing its screen into two areas as a candidate layout. The display device 100 can display the candidate layouts on the menu 410.

[0089] The display device 100 may determine the layout of the shared screen based on a user input for selecting one of the candidate layouts included in the menu 410. For example, the display device 100 may determine the second layout 420 among the candidate layouts as the layout of the shared screen.

[0090] Alternatively, the display device 100 may provide a menu that allows the user to arbitrarily set the layout of the shared screen based on a user input for selecting the user setting item 430 included in the menu 410. However, the present disclosure is not limited thereto.

[0091] Figure 5 is a diagram illustrating an example method of sharing a screen with a first electronic device and a second electronic device, performed by a display device according to various embodiments.

[0092] refer to Figure 5 According to an embodiment of the present disclosure, the display device 100 may divide its screen into a plurality of regions according to the layout of the screen. For example, the display device 100 may divide the screen into a first region 510 and a second region 520.

[0093] According to an embodiment of the present disclosure, the display device 100 may obtain a plurality of pieces of display information respectively corresponding to the first area 510 and the second area 520. For example, the display device 100 may obtain first display information including at least one of the size, resolution, or aspect ratio of the first area 510. Alternatively, the display device 100 may obtain second display information including at least one of the size, resolution, or aspect ratio of the second area 520.

[0094] In this case, the first display information and the second display information may be information pre-stored in the display device 100. For example, when Figure 5 When the illustrated layout of the screen of the display device 100 is a layout preset in the display device 100, pieces of display information regarding a plurality of regions included in the layout may be pre-stored in the display device 100 together with the layout. However, the present disclosure is not limited thereto.

[0095] According to an embodiment of the present disclosure, the display device 100 may send multiple pieces of display information about multiple regions to electronic devices corresponding to the multiple regions, respectively. According to an embodiment of the present disclosure, the display device 100 may determine or change the electronic device corresponding to each of the multiple regions in the screen based on user input.

[0096] According to an embodiment of the present disclosure, the display device 100 may identify the first electronic device 201 corresponding to the first area 510 and the second electronic device 202 corresponding to the second area 520. The display device 100 may transmit the first display information to the first electronic device 201 and transmit the second display information to the second electronic device 202.

[0097] refer to Figure 5, the first electronic device 201 can set a target area to be shared on the display device 100. The first electronic device 201 can set the entire screen or a portion of the screen as the target area to be shared. For example, the first electronic device 201 can execute multiple applications and display multiple windows corresponding to the multiple applications on the screen. The first electronic device 201 can receive a user input for selecting a specific application or a specific window, and set a window corresponding to the selected specific application or the selected specific window as the target area 530 to be shared based on the user input.

[0098] The first electronic device 201 may adjust the display information about the first image 540 in the target area 530 to be shared based on the first display information received from the display device 100. For example, the first electronic device 201 may adjust at least one of the size, resolution, or aspect ratio of the first image 540 to at least one of the corresponding size, resolution, or aspect ratio included in the first display information. The first electronic device 201 may scale the resolution of the first image 540 to the first resolution included in the first display information.

[0099] The first electronic device 201 may transmit the scaled first image 545 to the display device 100. However, the present disclosure is not limited thereto.

[0100] Alternatively, the second electronic device 202 may set the entire screen or a portion of the screen as the target area to be shared. For example, the second electronic device 202 may execute multiple applications and display multiple windows corresponding to the multiple applications on the screen. The second electronic device 202 may receive a user input for selecting a specific application or a specific window, and based on the user input, set a window corresponding to the selected specific application or the selected specific window as the target area 550 to be shared.

[0101] The second electronic device 202 may adjust the display information about the second image 560 in the target area 550 to be shared based on the second display information received from the display device 100. For example, the second electronic device 202 may adjust at least one of the size, resolution, or aspect ratio of the second image 560 to at least one of the corresponding size, resolution, or aspect ratio included in the second display information. The second electronic device 202 may scale the resolution of the second image 560 to the second resolution included in the second display information.

[0102] The second electronic device 202 may transmit the scaled second image 565 to the display device 100. However, the present disclosure is not limited thereto.

[0103] The display device 100 may display the scaled first image 545 in the first area 510 , and display the scaled second image 565 in the second area 520 .

[0104] Figure 6 is a flowchart illustrating an example method of performing screen sharing with a plurality of electronic devices, performed by a display device, according to various embodiments.

[0105] refer to Figure 6 According to an embodiment of the present disclosure, the display device 100 may divide its screen into a first area and a second area according to the first layout, and display a first image received from the first electronic device 201 in the first area and a second image received from the second electronic device 202 in the second area (S610). Figure 2 and Figure 5 This has been described in detail, so its detailed description may not be repeated here.

[0106] According to an embodiment of the present disclosure, the display device 100 may detect a change in the screen layout (S620). For example, the display device 100 may change the layout of the screen based on a user input. Alternatively, when an electronic device whose screen is to be shared on the display device 100 is added, or when an electronic device whose screen has been shared on the display device 100 is disconnected, the display device 100 may change the layout of the screen. However, the present disclosure is not limited thereto.

[0107] For example, the layout of the screen may be changed from a first layout to a second layout.

[0108] When a layout change of the screen is detected, according to an embodiment of the present disclosure, the display device 100 may transmit a plurality of pieces of display information respectively regarding changes of a plurality of regions included in the screen to electronic devices respectively corresponding to the plurality of regions ( S630 ).

[0109] For example, when the layout of the screen is changed to the second layout, the display device 100 may change the number or size of the regions included in the screen according to the second layout. When the number or size of the plurality of regions included in the screen changes, the plurality of pieces of display information respectively related to the plurality of regions also change. The display device 100 may send the plurality of pieces of display information respectively related to the changes of the plurality of regions included in the screen to the electronic devices respectively corresponding to the regions.

[0110] According to an embodiment of the present disclosure, the display device 100 may receive an image to be shared from at least one electronic device ( S640 ), and display the received at least one image in a corresponding area ( S650 ).

[0111] Reference below Figure 7 , Figure 8 , Fig. 9 and Fig.10 Describe in more detail Figure 6 Screen sharing method.

[0112] Figure 7 is a diagram illustrating an example method of sharing a screen with an electronic device, performed by a display device when a layout of a screen of the display device is changed according to various embodiments.

[0113] refer to Figure 7 According to an embodiment of the present disclosure, the display device 100 may divide the screen into a first area 701 having a first size and a second area 702 having a second size according to the first layout 710, and display a first image received from the first electronic device 201 in the first area 701 and display a second image received from the second electronic device 202 in the second area 702. In this case, the first image may be an image scaled based on the first display information, and the second image may be an image scaled based on the second display information. For example, the received first image may have a first resolution included in the first display information, and the second image may have a second resolution included in the second display information.

[0114] According to an embodiment of the present disclosure, the display device 100 may change the layout of the screen from the first layout 710 to the second layout 720 based on user input. The display device 100 may adjust the size of the first area 701 from the first size to the third size and the size of the second area 702 from the second size to the fourth size according to the second layout 720.

[0115] As the sizes of the first area 701 and the second area 702 change, the first display information about the first area 701 and the second display information about the second area 702 may also change. For example, at least one of the size, resolution, or aspect ratio included in the first display information may be changed. For example, the resolution included in the first display information may be changed from the first resolution to the third resolution. However, the present disclosure is not limited thereto.

[0116] In addition, at least one of the size, resolution, or aspect ratio included in the second display information may be changed. For example, the resolution included in the second display information may be changed from the second resolution to the fourth resolution. However, the present disclosure is not limited thereto.

[0117] The display device 100 may transmit the changed first display information to the first electronic device 201. Therefore, the first electronic device 201 may scale the first image 740 to the third resolution based on the changed first display information and transmit the scaled first image 745 to the display device 100.

[0118] In addition, the display device 100 may transmit the changed second display information to the second electronic device 202. Therefore, the second electronic device 202 may scale the second image 750 to the fourth resolution based on the changed second display information and transmit the scaled second image 755 to the display device 100.

[0119] The display device 100 may receive a scaled first image 745 obtained by scaling to a third resolution to display it in a first area 701 having a third size, and receive a scaled second image 755 obtained by scaling to a fourth resolution to display it in a second area 702 having a fourth size.

[0120] Figure 8 , Fig. 9 and Fig.10 is a diagram illustrating an example method of sharing a screen with an electronic device when a screen thereof is changed by a shared electronic device, performed by a display device according to various embodiments.

[0121] refer to Figure 8 According to an embodiment of the present disclosure, the display device 100 may divide the screen into a first area 801 having a first size and a second area 802 having a second size according to the first layout 810, and display a first image received from the first electronic device 201 in the first area 801 and display a second image received from the second electronic device 202 in the second area 802. In this case, the first image may be an image scaled based on the first display information, and the second image may be an image scaled based on the second display information. For example, the received first image may have a first resolution included in the first display information, and the second image may have a second resolution included in the second display information.

[0122] Because it has been referenced Figure 5 This has been described in detail, so its detailed description may not be repeated here.

[0123] According to an embodiment of the present disclosure, the display device 100 can add an electronic device that shares a screen. Figure 8 As shown, the display device 100 may display a shared screen addition item 820 .

[0124] The display device 100 may display a list 310 indicating external electronic devices whose screens can be shared when the communication connection with the display device 100 is completed based on a user input for selecting the share screen addition item 820, as shown in FIG. Figure 3 The display device 100 may add an electronic device whose screen is to be shared based on a user input for selecting at least one electronic device whose screen is to be shared from the list 310 .

[0125] Alternatively, based on the user input for selecting the shared screen addition item 820, the display device 100 may search for a new electronic device and perform a communication connection between the found new electronic device and the display device 100, thereby adding the new electronic device as an electronic device whose screen is to be shared. However, the present disclosure is not limited thereto.

[0126] According to an embodiment of the present disclosure, when an electronic device whose screen is to be shared is added, the display device 100 may change the layout of the screen. Fig. 9 As shown, when the third electronic device 203 is added as an electronic device whose screen is to be shared, the display device 100 may change the layout of the screen from the first layout 810 to the third layout 840 .

[0127] The display device 100 may adjust the size of the first region 801 from the first size to the fifth size and the size of the second region 802 from the second size to the sixth size according to the third layout 840 , and generate the third region 803 .

[0128] As the size of the first area 801 and the size of the second area 802 are changed, the first display information about the first area 801 and the second display information about the second area 802 may also be changed. At least one of the size, resolution, or aspect ratio included in the first display information may be changed. For example, the resolution included in the first display information may be changed from the first resolution to the fifth resolution.

[0129] In addition, at least one of the size, resolution, or aspect ratio included in the second display information may be changed. For example, the resolution included in the second display information may be changed from the second resolution to the sixth resolution.

[0130] The display device 100 may transmit the changed first display information to the first electronic device 201. Therefore, the first electronic device 201 may scale the first image 740 to the fifth resolution based on the changed first display information and transmit the scaled first image 915 to the display device 100.

[0131] In addition, the display device 100 may transmit the changed second display information to the second electronic device 202. Therefore, the second electronic device 202 may scale the second image 750 to the sixth resolution based on the changed second display information and transmit the scaled second image 925 to the display device 100.

[0132] The display device 100 may obtain third display information about the third area 803, and send the third display information to the third electronic device 203 corresponding to the third area 803. The third display information may include at least one of the size, resolution, or aspect ratio of the third area 803. Therefore, the third electronic device 203 may adjust the image (e.g., the third image 930) in the target area to be shared based on the third display information. For example, the third electronic device 203 may adjust at least one of the size, resolution, or aspect ratio of the third image 930 to at least one of the corresponding size, resolution, or aspect ratio included in the third display information. The third electronic device 203 may scale the resolution of the third image 930 to the seventh resolution, and send the scaled third image 935 to the display device 100. However, the present disclosure is not limited thereto.

[0133] The display device 100 can receive a scaled first image 915 obtained by scaling to a fifth resolution to display it in a first area 801 having a fifth size, receive a scaled second image 925 obtained by scaling to a sixth resolution to display it in a second area 802 having a sixth size, and receive a scaled third image 935 obtained by scaling to a seventh resolution to display it in a third area 803.

[0134] According to an embodiment of the present disclosure, the display device 100 may disconnect at least one of the electronic devices whose screens are shared on the display device 100. Figure 8 As shown, the display device 100 may display a sharing end item 830 to end the screen sharing.

[0135] The display device 100 may end the screen sharing based on a user input for selecting the sharing end item 830 .

[0136] According to an embodiment of the present disclosure, when the sharing of at least one of the shared screens ends, the display device 100 may change the layout of the screen. Fig.10 As shown, when sharing of the screen of the second electronic device 202 displayed in the second area 802 ends, the display device 100 can change the layout of the screen from the first layout 810 to the fourth layout 1010. The display device 100 can integrate the first area and the second area into a single area according to the fourth layout 1010.

[0137] When the first area and the second area are integrated into one area, the first display information about the first area can be changed. As the first area is changed to the entire area of ​​the screen, at least one of the size, resolution, or aspect ratio included in the first display information can be changed. For example, the resolution included in the first display information can be changed to the native resolution of the display device 100.

[0138] The display device 100 may send the changed first display information to the first electronic device 201. Therefore, the first electronic device 201 may scale the first image 740 to the native resolution of the display device 100 based on the changed first display information, and send the scaled first image 1015 to the display device 100.

[0139] In addition, when the sharing of the screen of the second electronic device 202 displayed in the second area ends, the display device 100 may not receive the second image from the second electronic device 202 .

[0140] The display device 100 may receive the scaled first image 1015 obtained by scaling to a native resolution of the display device 100 , and display it on a full screen of the display device 100 .

[0141] Fig.11 is a diagram illustrating an example of adjusting a shared screen displayed on an electronic device when the electronic device shares its screen with a display device according to various embodiments.

[0142] refer to Fig.11 According to an embodiment of the present disclosure, the display device 100 may share screens of a plurality of electronic devices including the second electronic device 202 .

[0143] The display device 100 may divide its screen into a plurality of regions according to the layout of the screen. The display device 100 may send first display information corresponding to the second region 1110 to the second electronic device 202 .

[0144] The second electronic device 202 may set a target area 1130 to be shared. The second electronic device 202 may scale the image in the target area 1130 to be shared based on the first display information. The second electronic device 202 may send the scaled image to the display device 100. The display device 100 may display the image received from the second electronic device 202 in the second area 1110 of the plurality of areas.

[0145] According to an embodiment of the present disclosure, the second electronic device 202 may identify whether the second display information about the target area 1130 to be shared is different from the first display information corresponding to the second area 1110 received from the display device 100. For example, the second electronic device 202 may identify whether at least one of a size, a resolution, or an aspect ratio included in the first display information is different from at least one of a corresponding size, a resolution, or an aspect ratio included in the second display information.

[0146] like Fig.11As shown, when the first display information is different from the second display information, the second electronic device 202 may display a message 1120 notifying that the first display information is different from the second display information. In addition, the second electronic device 202 may display the first display information (e.g., optimal resolution: 1280×720 and aspect ratio: 16:9). By referring to the displayed first display information, the user of the second electronic device 202 may adjust the size or aspect ratio of the target area 1130 to be shared so that the target area 1130 has the size or aspect ratio included in the first display information.

[0147] In addition, according to an embodiment of the present disclosure, the second electronic device 202 may display the screen automatic adjustment item 1140 together with the message 1120. When receiving a user input for selecting the screen automatic adjustment item 1140, the second electronic device 202 may adjust the size or aspect ratio of the target area 1130 based on the first display information. Therefore, the image shared in the second area 1110 of the display device 100 may have the same display information as the image displayed in the target area 1130 of the second electronic device 202.

[0148] Fig.12 is a block diagram illustrating example configurations of a display device and an electronic device according to various embodiments.

[0149] refer to Fig.12 , a display device 100 according to an embodiment of the present disclosure may include a communication interface (eg, including a communication circuit) 110 , a processor (eg, including a processing circuit) 120 , a memory 130 , and a display 140 .

[0150] According to an embodiment of the present disclosure, the communication interface 110 may include various communication circuits, and send data or signals to an external device (e.g., electronic device 1200) or a server and / or receive data or signals from an external device (e.g., electronic device 1200) or a server. For example, the communication interface 110 may include various communication circuits included in various modules, such as, for example but not limited to, a Wi-Fi module, a Bluetooth module, an infrared (IR) communication module, a wireless communication module, a local area network (LAN) module, an Ethernet module, a wired communication module, etc. In this case, each communication module may be implemented in the form of at least one hardware chip.

[0151] The Wi-Fi module and the Bluetooth module perform communication according to the Wi-Fi method and the Bluetooth method, respectively. When using the Wi-Fi module or the Bluetooth module, various types of connection information such as a service set identifier (SSID) and a session key can be first sent and received, the connection information can be used to establish a communication connection, and then various types of information can be sent and received. The wireless communication module may include at least one communication chip for performing communication according to various communication standards, such as ZigBee, third generation (3G), third generation partnership project (3GPP), long term evolution (LTE), advanced LTE (LTE-A), fourth generation (4G), fifth generation (5G), etc.

[0152] According to an embodiment of the present disclosure, the communication interface 110 may perform communication for screen sharing with the electronic device 1200 according to an embodiment of the present disclosure. For example, the communication interface 110 may share data with the electronic device 1200 using a Web RTC scheme. However, the present disclosure is not limited thereto.

[0153] Furthermore, the communication interface 110 may transmit display information about an area corresponding to the electronic device 1200 to the electronic device 1200. In addition, the communication interface 110 may receive image data (image stream) to be shared on the screen of the display device 100 from the electronic device 1200.

[0154] According to an embodiment of the present disclosure, the communication interface 110 may receive a control signal, a control command, etc. from an external control device. For example, the communication interface 110 may include an IR module that can send and receive signals to and from an external control device according to an IR communication standard. Specifically, the communication interface 110 may receive a control signal or a control command corresponding to a user input (e.g., a key or button input on a control device, etc.) from a control device.

[0155] According to an embodiment of the present disclosure, the processor 120 may include various processing circuits, and control all operations of the display device 100 and signal flows between internal components of the display device 100 , and perform a function of processing data.

[0156] The processor 120 may include a single core, a dual core, a triple core, a quad core, or multiple cores equal to the multiple thereof. In addition, the processor 120 may include multiple processors. For example, the processor 120 may be implemented as a main processor (not shown) and an auxiliary processor (not shown) operating in a sleep mode.

[0157] In addition, the processor 120 may include at least one of a central processing unit (CPU), a graphics processing unit (GPU), or a video processing unit (VPU). Alternatively, according to an embodiment of the present disclosure, the processor 120 may be implemented as a system on a chip (SOC) integrating at least one of a CPU, a GPU, or a VPU. Alternatively, the processor 120 may also include a neural processing unit (NPU).

[0158] According to an embodiment of the present disclosure, the memory 130 may store various pieces of data, programs, or applications for driving and controlling the display device 100 .

[0159] In addition, the program stored in the memory 130 may include one or more instructions. The program (one or more instructions) or application stored in the memory 130 may be executed by the processor 120.

[0160] According to an embodiment of the present disclosure, the processor 120 may execute an application for screen sharing based on user input. The processor 120 may search for an electronic device 1200 using the application for screen sharing, and request a communication connection for screen sharing from the found electronic device 1200.

[0161] The processor 120 may determine a plurality of electronic devices whose screens are to be shared. For example, the processor 120 may control the display 140 to display a list indicating external electronic devices whose screens can be shared when the communication connection with the display device 100 is completed. The processor 120 may determine a plurality of electronic devices whose screens are to be shared based on a user input for selecting a plurality of electronic devices from the list.

[0162] When a plurality of electronic devices whose screens are to be shared are determined, the processor 120 may determine a layout of the screens based on the number of the plurality of electronic devices.

[0163] The processor 120 may divide the screen into a plurality of regions according to the layout of the screen, and obtain a plurality of display information corresponding to the plurality of regions, respectively. For example, the processor 120 may obtain at least one of the size, resolution, or aspect ratio of each of the plurality of regions.

[0164] The processor 120 may control the communication interface 110 to send a plurality of display information about a plurality of regions to electronic devices corresponding to the plurality of regions. For example, the processor 120 may identify a first electronic device corresponding to a first region, and identify a second electronic device corresponding to a second region. The processor 120 may control the communication interface 110 to send first display information corresponding to the first region to the first electronic device, and to send second display information corresponding to the second region to the second electronic device.

[0165] In addition, when multiple images are received from multiple electronic devices, the processor 120 can control the display 140 to display the multiple images in the regions obtained by dividing the screen, respectively. For example, when a first image is received from a first electronic device and a second image is received from a second electronic device, the processor 120 can control the display 140 to display the first image in the first region and the second image in the second region.

[0166] According to an embodiment of the present disclosure, the processor 120 may detect a change in the screen layout. For example, when the layout of the screen is changed based on a user input, an electronic device whose screen is to be shared on the display device 100 is added, or an electronic device whose screen is already shared on the display device 100 is disconnected, the processor 120 may detect a change in the layout of the screen. However, the present disclosure is not limited thereto.

[0167] When a layout change of the screen is detected, the processor 120 may transmit a plurality of pieces of display information respectively regarding changes of a plurality of regions included in the screen to electronic devices respectively corresponding to the plurality of regions.

[0168] For example, when the layout of the screen is changed from the first layout to the second layout, the processor 110 may change the number or size of the areas included in the screen according to the second layout. When the number or size of the multiple areas included in the screen changes, the multiple pieces of display information respectively related to the multiple areas also change. The processor 120 may control the communication interface 110 to send the changed multiple pieces of display information respectively related to the multiple areas included in the screen to the electronic devices respectively corresponding to the areas.

[0169] According to an embodiment of the present disclosure, the display 140 generates a driving signal by converting an image signal, a data signal, an on-screen display (OSD) signal, a control signal, etc. processed by the processor 120. The display 140 may be implemented as a plasma display panel (PDP), a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a flexible display, etc., and may also be implemented as a three-dimensional (3D) display. In addition, the display 140 may be formed as a touch screen to be used as an input device as well as an output device.

[0170] For example, the display 140 may display images received from a plurality of electronic devices in regions obtained through division, respectively.

[0171] The electronic device 1200 according to an embodiment of the present disclosure may be a reference Figure 1 Any of the plurality of electronic devices 200 shown and described, and may be referenced Figure 2 and Figures 5 to 11 Any one of the first to third electronic devices 201, 202, and 203 is shown and described. However, the present disclosure is not limited thereto.

[0172] According to an embodiment of the present disclosure, the electronic device 1200 may include a communication interface (e.g., including a communication circuit) 1210, a processor (e.g., including a processing circuit) 1220, a memory 1230, and a display 1240. The communication interface 1210 may include various communication circuits and communicate with the display device 100. For example, the communication interface 1210 may include various communication circuits included in various modules, such as, for example, but not limited to, a Wi-Fi module, a Bluetooth module, an IR communication module, a wireless communication module, a local area network (LAN) module, an Ethernet module, a wired communication module, etc. In this case, each communication module may be implemented in the form of at least one hardware chip.

[0173] According to an embodiment of the present disclosure, the communication interface 1210 may perform communication for screen sharing with the display device 100 according to an embodiment of the present disclosure. For example, the communication interface 1210 may share data with the display device 100 using a Web RTC scheme. For example, the communication interface 1210 may receive display information from the display device 100 and send image data (image stream) to be shared to the display device 100. However, the present disclosure is not limited thereto.

[0174] According to an embodiment of the present disclosure, the processor 1220 may include various processing circuits, and control all operations of the electronic device 1200 and signal flows between internal components of the electronic device 1200 , and perform a function of processing data.

[0175] The processor 1220 may include a single core, a dual core, a triple core, a quad core, or multiple cores equal to the multiple thereof. In addition, the processor 1220 may include multiple processors. For example, the processor 1220 may be implemented as a main processor (not shown) and an auxiliary processor (not shown) operating in a sleep mode.

[0176] In addition, the processor 1220 may include at least one of a CPU, a GPU, or a VPU. Alternatively, according to an embodiment of the present disclosure, the processor 1220 may be implemented as a SOC integrating at least one of a CPU, a GPU, or a VPU. Alternatively, the processor 1220 may also include an NPU.

[0177] According to an embodiment of the present disclosure, the memory 1230 may store various pieces of data, programs, or applications for driving and controlling the electronic device 1200 .

[0178] In addition, the program stored in the memory 1230 may include one or more instructions. The program (one or more instructions) or application stored in the memory 1230 may be executed by the processor 1220.

[0179] According to an embodiment of the present disclosure, the processor 1220 may execute an application for screen sharing based on user input. The processor 1220 may search for the display device 100 using the application for screen sharing, and request a communication connection for screen sharing from the found display device 1200. When the communication connection with the display device 100 is completed, screen sharing may be initiated.

[0180] The processor 1220 may set a target area to be shared on the display device 100 based on a user input. When the target area to be shared is set, the processor 1220 may scale the image in the target area based on the display information received from the display device 100. For example, the processor 1220 may scale the image in the target area based on at least one of a size, a resolution, or an aspect ratio included in the received display information. The processor 1220 may control the communication interface 1210 to send the scaled image to the display device 100.

[0181] In addition, when the display information about the target area to be shared (eg, first display information) is different from the display information received from the display device 100 (eg, second display information), the processor 1220 may control the display 1240 to display a notification message.

[0182] In addition, the processor 1220 may adjust the size or aspect ratio of the target area to be shared so that the target area has the size or aspect ratio included in the second display information.

[0183] According to an embodiment of the present disclosure, the display 1240 generates a driving signal by converting an image signal, a data signal, an OSD signal, a control signal, etc. processed by the processor 1220. The display 1240 may be implemented as a PDP, an LCD, an OLED display, a flexible display, etc., and may also be implemented as a 3D display. In addition, the display 1240 may be formed as a touch screen to be used as an input device as well as an output device.

[0184] Fig.13 is a block diagram illustrating an example configuration of a display device according to various embodiments.

[0185] refer to Fig.13 , Fig.13 The display device 1300 may be a reference Figures 1 to 12 An embodiment of a display device 100 is described.

[0186] refer to Fig.13According to an embodiment of the present disclosure, a display device 1300 may include a tuner 1340, a processor (e.g., including a processing circuit) 1310, a display 1320, a communication interface (e.g., including a communication circuit) 1350, a detector (e.g., including various detection circuits) 1330, an input / output (I / O) interface (e.g., including an input / output circuit) 1370, a video processor (e.g., including a video processing circuit) 1380, an audio processor (e.g., including an audio processing circuit) 1385, an audio output interface (e.g., including an audio output circuit) 1360, a memory 1390, and a power supply 1395.

[0187] Fig.13 The communication interface 1350 corresponds to Fig.12 The communication interface 110, Fig.13 The processor 1310 corresponds to Fig.12 The processor 120, Fig.13 The memory 1390 corresponds to Fig.12 The memory 130, and Fig.13 The display 1320 corresponds to Fig.12 Therefore, it is not necessary to repeat the above description of Fig.12 Provide a description.

[0188] According to an embodiment of the present disclosure, the tuner 1340 can tune and then select only the frequency of a channel that the display device 100 desires to receive from among many radio wave components by performing amplification, mixing, resonance, etc. on a broadcast signal received in a wired or wireless manner. The broadcast signal includes audio, video, and additional information (e.g., an electronic program guide (EPG)).

[0189] The tuner 1340 may receive broadcast signals from various sources such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, Internet broadcasting, etc. The tuner 1340 may receive broadcast signals from sources such as analog broadcasting, digital broadcasting, etc.

[0190] The detector 1330 may include various detection circuits and detect a user's voice, image, or interaction, and may include a microphone 1331 , a camera 1332 , and a light receiver 1333 .

[0191] The microphone 1331 may receive a voice spoken by a user. The microphone 1331 may convert the received voice into an electrical signal and output the electrical signal to the processor 1310. The user's voice may include, for example, a voice corresponding to a menu or function of the display device 1300.

[0192] The camera 1332 may receive images (e.g., continuous frames) corresponding to the user's motion including his or her gestures performed within the recognition range of the camera 1332. The processor 1310 may select a menu displayed on the display device 1300 based on the received motion recognition result, or perform control corresponding to the motion recognition result.

[0193] The optical receiver 1333 receives an optical signal (including a control signal) from an external control device via an optical window (not shown) on the frame of the display 1320. The optical receiver 1333 can receive an optical signal corresponding to a user input (e.g., touch, press, touch gesture, voice, or motion) from the control device. The control signal can be extracted from the received optical signal according to the control of the processor 1310.

[0194] The I / O interface 1370 may include various I / O circuits and receive video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), additional information (e.g., EPG, etc.), etc. from the outside of the display device 1300. The I / O interface 1370 may include one of an HDMI, a mobile high-definition link (MHL), a USB, a Thunderbolt, a video graphics array (VGA) port, an RGB port, a D-sub, a DVI, a component jack, and a PC port.

[0195] The processor 1310 may include various processing circuits, and controls all operations of the display device 1300 and signal flows between internal components of the display device 1300, and performs functions of processing data. When there is a user's input or a preset and stored condition is met, the processor 1310 may execute an operating system (OS) and various applications stored in the memory 1390.

[0196] The processor 1310 may include a random access memory (RAM) storing a signal or data input from the outside of the display device 1300 or used as a storage area corresponding to various operations performed by the display device 1300, a read only memory (ROM) storing a control program for controlling the display device 1300, and a processor.

[0197] The video processor 1380 may include various video processing circuits and processes video data received by the display device 1300. The video processor 1380 may perform various types of image processing such as decoding, scaling, noise removal, frame rate conversion, resolution conversion, etc. on the video data.

[0198] The audio processor 1385 may include various audio processing circuits and process audio data. The audio processor 1385 may perform various types of processing on the audio data, such as decoding, amplification, noise removal, etc. In addition, the audio processor 1385 may include a plurality of audio processing modules to process audio corresponding to a plurality of pieces of content.

[0199] The audio output interface 1360 may include various audio output circuits, and output audio contained in a broadcast signal received via the tuner 1340 according to the control of the processor 1310. The audio output interface 1360 may output audio (e.g., voice and sound) input via the communication interface 1350 or the I / O interface 1370. In addition, the audio output interface 1360 may output audio stored in the memory 1390 according to the control of the processor 1310. The audio output interface 1360 may include at least one of a speaker, a headphone output terminal, or a Sony / Phillips digital interface (S / PDIF) output terminal.

[0200] The power supply 1395 supplies power input from an external power source to the internal components of the display device 1300 according to the control of the processor 1310. The power supply 1395 may also supply power output from one or more batteries (not shown) located within the display device 1300 to the internal components according to the control of the processor 1310.

[0201] The memory 1390 may store various pieces of data, programs, or applications for driving and controlling the display device 1300 according to the control of the processor 1310. Fig.13 Although not shown, the memory 1390 may include a broadcast receiving module, a channel control module, a volume control module, a communication control module, a voice recognition module, a motion recognition module, a light receiving module, a display control module, an audio control module, an external input control module, a power control module, a power control module for an external device connected wirelessly (e.g., Bluetooth), a voice database (DB), or a motion DB. Figure 3 The modules and DB of the memory 1390 not shown in the figure may be implemented in the form of software to perform a broadcast reception control function, a channel control function, a volume control function, a communication control function, a voice recognition function, a motion recognition function, a light reception control function, a display control function, an audio control function, an external input control function, a power control function, or a power control function of an external device connected wirelessly (e.g., Bluetooth). The processor 1310 may use the software stored in the memory 1390 to perform the corresponding function.

[0202] also, Fig.12 and Fig.13 The block diagrams of the display devices 100 and 1300 are shown in FIG. Fig.12The block diagram of the electronic device 1200 shown in the figure is a block diagram showing various example embodiments of the present disclosure. The components in the block diagram can be integrated, added, or omitted according to the specifications of the display devices 100 and 1300 and the electronic device 1200 that are actually implemented. In other words, two or more components can be combined into a single component, or a single component can be subdivided into two or more components when necessary. In addition, the functions performed in each frame are intended to describe the embodiments of the present disclosure, and the specific operations or devices related to the functions do not limit the scope of the present disclosure.

[0203] The display device according to an embodiment of the present disclosure may share screens of a plurality of electronic devices.

[0204] According to an example embodiment of the present disclosure, a display device may include a display, a communication interface including circuits configured to send data to and / or receive data from multiple electronic devices, a memory storing one or more instructions, and at least one processor configured to execute the one or more instructions.

[0205] The at least one processor may be configured to execute one or more instructions to divide the screen of the display device into a plurality of regions and obtain a plurality of pieces of display information respectively corresponding to the plurality of regions.

[0206] The at least one processor may be configured to execute one or more instructions to control the communication interface to transmit first display information corresponding to a first area among the plurality of areas to a first electronic device corresponding to the first area among the plurality of electronic devices.

[0207] The at least one processor may be configured to execute one or more instructions to control the communication interface to transmit second display information corresponding to a second area among the plurality of areas to a second electronic device corresponding to the second area among the plurality of electronic devices.

[0208] At least one processor may be configured to execute one or more instructions to receive a first image obtained based on first display information from a first electronic device, and to receive a second image obtained based on second display information from a second electronic device.

[0209] At least one processor may be configured to execute one or more instructions to control the display to display a first image in a first area and a second image in a second area.

[0210] The at least one processor may be configured to execute one or more instructions to control the display to display a list including external electronic devices connected to the display device.

[0211] The at least one processor may be configured to execute one or more instructions to determine a plurality of electronic devices based on a user input for selecting at least one external electronic device among the external electronic devices included in the list.

[0212] The at least one processor may be configured to execute one or more instructions to determine a layout of a screen based on the number of the plurality of electronic devices.

[0213] The at least one processor may be configured to execute one or more instructions to divide the screen into a plurality of regions according to a layout.

[0214] At least one processor may be configured to execute one or more instructions to control the display to display a layout list including a plurality of layouts.

[0215] The at least one processor may be configured to execute one or more instructions to determine a layout of the screen based on a user input for selecting a layout included in the layout list.

[0216] The at least one processor may be configured to execute one or more instructions to divide the screen into a plurality of regions according to a layout.

[0217] The first image may include an image obtained by scaling an image in a region to be shared on a screen displayed on the first electronic device based on the first display information.

[0218] The second image may include an image obtained by scaling an image in a region to be shared on a screen displayed on the second electronic device based on the second display information.

[0219] At least one processor may be configured to execute one or more instructions to monitor cessation of screen sharing of the first electronic device and the second electronic device.

[0220] The at least one processor may be configured to execute one or more instructions to change a layout of a screen based on stop of screen sharing of at least one of the first electronic device or the second electronic device.

[0221] The at least one processor may be configured to execute one or more instructions to control the communication interface to transmit a plurality of pieces of display information respectively corresponding to the regions included in the changed layout to the electronic devices respectively corresponding to the regions.

[0222] At least one processor may be configured to execute one or more instructions to monitor the addition of a third electronic device sharing its screen on the display device.

[0223] The at least one processor may be configured to execute one or more instructions to change the layout of the screen based on the addition of the third electronic device.

[0224] The at least one processor may be configured to execute one or more instructions to control the communication interface to transmit a plurality of pieces of display information respectively corresponding to the regions included in the changed layout to the electronic devices respectively corresponding to the regions.

[0225] An electronic device according to an embodiment of the present disclosure may share its screen on a display device.

[0226] According to an example embodiment of the present disclosure, an electronic device may include a display, a communication interface including a circuit configured to send data to the display device and / or receive data from the display device, a memory storing one or more instructions, and at least one processor configured to execute the one or more instructions.

[0227] The at least one processor may be configured to execute one or more instructions to receive first display information from a display device.

[0228] The at least one processor may be configured to execute one or more instructions to scale an image in a target area to be shared on a screen displayed on the display based on the first display information.

[0229] The at least one processor may be configured to execute one or more instructions to control the communication interface to send the scaled image to the display device.

[0230] The at least one processor may be configured to execute one or more instructions to control the display to display a notification message based on that the first display information is different from the second display information regarding the target area to be shared.

[0231] At least one processor may be configured to execute one or more instructions to control the display to display a notification message including first display information.

[0232] The at least one processor may be configured to execute one or more instructions to control the display to change and display a target area to be shared according to the first display information.

[0233] According to an embodiment of the present disclosure, a method of operating a display device to share screens of a plurality of electronic devices may include dividing a screen of the display device into a plurality of areas.

[0234] According to an example embodiment of the present disclosure, a method of operating a display device may include obtaining a plurality of pieces of display information respectively corresponding to a plurality of regions.

[0235] According to an example embodiment of the present disclosure, a method of operating a display device may include transmitting first display information corresponding to a first area among a plurality of areas to a first electronic device corresponding to the first area among a plurality of electronic devices.

[0236] According to an example embodiment of the present disclosure, a method of operating a display device may include transmitting second display information corresponding to a second area among a plurality of areas to a second electronic device corresponding to the second area among a plurality of electronic devices.

[0237] According to an example embodiment of the present disclosure, a method of operating a display device may include receiving a first image obtained based on first display information from a first electronic device.

[0238] According to an example embodiment of the present disclosure, a method of operating a display device may include receiving a second image obtained based on second display information from a second electronic device.

[0239] According to an example embodiment of the present disclosure, a method of operating a display device may include displaying a first image in a first area and displaying a second image in a second area.

[0240] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include displaying a list including external electronic devices connected to the display device.

[0241] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include determining a plurality of electronic devices based on a user input for selecting at least one external electronic device among external electronic devices included in a list.

[0242] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include determining a layout of a screen based on the number of a plurality of electronic devices.

[0243] Dividing the screen into a plurality of regions may include dividing the screen into a plurality of regions according to a layout.

[0244] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include displaying a layout list including a plurality of layouts.

[0245] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include determining a layout of a screen based on a user input for selecting a layout included in a layout list.

[0246] Dividing the screen into a plurality of regions may include dividing the screen into a plurality of regions according to a layout.

[0247] The first image may be an image obtained by scaling an image in a region to be shared on a screen displayed on the first electronic device based on the first display information.

[0248] The second image may be an image obtained by scaling an image in a region to be shared on a screen displayed on the second electronic device based on the second display information.

[0249] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include monitoring stop of screen sharing of a first electronic device and a second electronic device.

[0250] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include changing a layout of a screen based on stop of screen sharing of at least one of a first electronic device or a second electronic device.

[0251] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include transmitting a plurality of pieces of display information respectively corresponding to regions included in a changed layout to electronic devices respectively corresponding to the regions.

[0252] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include monitoring addition of a third electronic device sharing its screen on the display device.

[0253] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include changing a layout of a screen based on addition of a third electronic device.

[0254] According to an exemplary embodiment of the present disclosure, a method of operating a display device may include transmitting a plurality of pieces of display information respectively corresponding to regions included in a changed layout to electronic devices respectively corresponding to the regions.

[0255] According to an example embodiment of the present disclosure, a method of operating an electronic device to share its screen on a display device may include receiving first display information from the display device.

[0256] According to an exemplary embodiment of the present disclosure, a method of operating an electronic device may include scaling an image in a target area to be shared on a screen displayed on a display based on first display information.

[0257] According to an example embodiment of the present disclosure, a method of operating an electronic device may include transmitting a scaled image to a display device.

[0258] According to an exemplary embodiment of the present disclosure, a method of operating an electronic device may include displaying a notification message based on that first display information is different from second display information regarding a target area to be shared.

[0259] The displaying of the notification message may include displaying the notification message including the first display information.

[0260] According to an exemplary embodiment of the present disclosure, a method of operating an electronic device may include changing and displaying a target area to be shared according to first display information.

[0261] At least one of the operating methods of the display device according to the embodiment of the present disclosure or the operating methods of the electronic device according to the embodiment of the present disclosure can be implemented in the form of program commands that can be executed by various types of computers, and can be recorded on a non-transitory computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, etc., alone or in combination. The program commands recorded on the computer-readable recording medium may be specially designed and configured for the present disclosure, or may be known to and usable by technicians in the field of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and tapes, optical media such as compact disk ROMs (CD-ROMs) and digital versatile disks (DVDs), magneto-optical media such as optical magnetic floppy disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, flash memories, etc. Examples of program commands include not only machine codes such as those created by compilers, but also high-level language codes that can be executed by computers using interpreters, etc.

[0262] In addition, at least one of the method of operating a display device or the method of operating an electronic device according to various exemplary embodiments of the present disclosure may be included in a computer program product when provided. The computer program product may be traded between a seller and a buyer as a product.

[0263] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a computer program that is provided by a manufacturer of an electronic device or through an electronic market (e.g., Google Play Store TM and App Store TM ) A product in the form of a software program that is electronically distributed (e.g., a downloadable application). For such electronic distribution, at least a portion of the software program may be stored on a storage medium or may be temporarily generated. In this case, the storage medium may be a storage medium of a manufacturer's server, a server of an electronic marketplace, or a relay server for temporarily storing the software program.

[0264] In a system including a server and a client device, the computer program product may include the storage medium of the server or the storage medium of the client device. Alternatively, in the presence of a third device (e.g., a smart phone) communicatively connected to the server or the client device, the computer program product may include the storage medium of the third device. Alternatively, the computer program product may include the software program itself that is sent from the server to the client device or the third device or from the third device to the client device.

[0265] In this case, one of the server, the client device, and the third device may execute the computer program product to perform the method according to the embodiment of the present disclosure. Alternatively, at least two of the server, the client device, and the third device may execute the computer program product to perform the method according to the embodiment of the present disclosure in a distributed manner.

[0266] For example, a server (e.g., a cloud server, an artificial intelligence server, etc.) may execute a computer program product stored therein to control a client device communicatively connected to the server to perform a method according to an embodiment of the present disclosure.

[0267] Although the embodiments of the present disclosure have been shown and described above with reference to various exemplary embodiments, the exemplary embodiments of the present disclosure should not be construed as limiting the scope of the present disclosure, and various modifications and improvements made by those skilled in the art based on the basic concepts of the present disclosure also fall within the scope of the present disclosure including the attached claims and their equivalents. It will also be understood that any embodiment described herein can be used in combination with any other embodiment described herein.

Claims

1. A display device configured to share screens of a plurality of electronic devices, the display device comprising: Display (140); a communication interface (110) comprising circuitry configured to send data to and / or receive data from the plurality of electronic devices; A memory (130) storing one or more instructions; and At least one processor (120) configured to execute the one or more instructions to: dividing the screen of the display device into a plurality of areas and obtaining a plurality of pieces of display information respectively corresponding to the plurality of areas, controlling the communication interface to send first display information corresponding to a first area among the multiple areas to a first electronic device among the multiple electronic devices corresponding to the first area, and to send second display information corresponding to a second area among the multiple electronic devices to a second electronic device among the multiple electronic devices corresponding to the second area, receiving a first image obtained based on the first display information from the first electronic device, and receiving a second image obtained based on the second display information from the second electronic device, and The display is controlled to display the first image in the first area and the second image in the second area.

2. The display device according to claim 1, wherein: The at least one processor (120) is further configured to execute the one or more instructions to: controlling the display (140) to display a list of external electronic devices connected to the display device, and The plurality of electronic devices are determined based on receiving an input for selecting at least one external electronic device among the external electronic devices included in the list.

3. The display device according to claim 1 or 2, wherein: The at least one processor (120) is further configured to execute the one or more instructions to: determine a layout of the screen based on the number of the plurality of electronic devices, and divide the screen into the plurality of areas according to the layout.

4. The display device according to any one of claims 1 to 3, wherein: The at least one processor (120) is further configured to execute the one or more instructions to: Controlling the display (140) to display a layout list including a plurality of layouts; and The layout of the screen is determined based on receiving an input for selecting a layout included in the layout list, and the screen is divided into the plurality of regions according to the layout.

5. The display device according to any one of claims 1 to 4, wherein: the first image includes an image obtained by scaling an image in an area to be shared on a screen displayed on the first electronic device based on the first display information, and The second image includes an image obtained by scaling an image in a region to be shared on a screen displayed on the second electronic device based on the second display information.

6. The display device according to any one of claims 1 to 5, wherein: The at least one processor (120) is further configured to execute the one or more instructions to: monitoring cessation of screen sharing between the first electronic device and the second electronic device, based on the cessation of the screen sharing of at least one of the first electronic device or the second electronic device, changing the layout of the screen, and The communication interface is controlled to transmit a plurality of pieces of display information respectively corresponding to the areas included in the changed layout to the electronic devices respectively corresponding to the areas.

7. The display device according to any one of claims 1 to 6, wherein: The at least one processor (120) is further configured to execute the one or more instructions to: monitoring the addition of a third electronic device sharing its screen on the display device, Based on the addition of the third electronic device, changing the layout of the screen, and The communication interface is controlled to transmit a plurality of pieces of display information respectively corresponding to the areas included in the changed layout to the electronic devices respectively corresponding to the areas.

8. A method for operating a display device to share screens of a plurality of electronic devices, the method comprising: Dividing the screen of the display device into a plurality of areas; Obtaining a plurality of display information corresponding to the plurality of regions respectively (S230); sending first display information corresponding to a first area among the plurality of areas to a first electronic device corresponding to the first area among the plurality of electronic devices (S250); sending second display information corresponding to a second area among the plurality of areas to a second electronic device corresponding to the second area among the plurality of electronic devices (S255); receiving, from the first electronic device, a first image obtained based on the first display information (S260); receiving, from the second electronic device, a second image obtained based on the second display information (S275); and The first image is displayed in the first area and the second image is displayed in the second area (S280).

9. The method according to claim 8, further comprising: displaying a list including external electronic devices connected to the display device; and The plurality of electronic devices are determined based on receiving an input for selecting at least one external electronic device among the external electronic devices included in the list.

10. The method according to claim 8 or 9, further comprising: determining a layout of the screen based on the number of the plurality of electronic devices, Wherein dividing the screen into the plurality of areas comprises: The screen is divided into the plurality of areas according to the layout.

11. The method according to any one of claims 8 to 10, further comprising: Displaying a layout list including multiple layouts; and determining a layout of the screen based on receiving an input for selecting a layout included in the layout list, Wherein dividing the screen into the plurality of areas comprises: The screen is divided into the plurality of areas according to the layout.

12. The method according to any one of claims 8 to 11, wherein: the first image includes an image obtained by scaling an image in an area to be shared on a screen displayed on the first electronic device based on the first display information, and The second image includes an image obtained by scaling an image in a region to be shared on a screen displayed on the second electronic device based on the second display information.

13. The method according to any one of claims 8 to 12, further comprising: monitoring cessation of screen sharing between the first electronic device and the second electronic device; Based on the cessation of screen sharing of at least one of the first electronic device or the second electronic device, changing the layout of the screen; and A plurality of pieces of display information respectively corresponding to the regions included in the changed layout are transmitted to the electronic devices respectively corresponding to the regions.

14. The method according to any one of claims 8 to 13, further comprising: monitoring the addition of a third electronic device sharing its screen on the display device; Based on the addition of the third electronic device, changing the layout of the screen; and A plurality of pieces of display information respectively corresponding to the regions included in the changed layout are transmitted to the electronic devices respectively corresponding to the regions. 15 . A non-transitory computer-readable recording medium having stored therein a program for executing an operation corresponding to the method of any one of claims 8 to 14 .

Images