Display device and operation method thereof

Abstract

The disclosed display device: receives and displays screen data from a source device providing the screen data among one or more electronic devices connected through wired / wireless communication; transmits input data received from an input device connected through wired / wireless communication to a source device having a screen control right among the one or more source devices; as a request associated with the screen control right is received from the source device having the screen control right in response to a pointer located in a predetermined area of a display screen corresponding to the screen data, the pointer being displayed by the source device having the screen control right to control a display position by using the input data, transmits information for switching the screen control right to the source device having the screen control right; and receives a graphic user interface screen enabling switching of the screen control right, generated on the basis of the information for switching the screen control right, from the source device having the screen control right, and displays the graphic user interface screen.

Description

Display device and method of operation thereof

[0001] Various embodiments relate to a display device and a method of operating the same, and more particularly, to a display device connecting an input device and a source device and a method of operating the same.

[0002] A KVM switch is a device that allows you to control two or more computers with a single keyboard, video monitor, and mouse. Here, KVM stands for Keyboard, Video Monitor, and Mouse. In other words, a KVM switch is a technology that allows you to connect multiple computers to a single keyboard, video monitor, and mouse, allowing you to select and control one of them. Currently, connecting multiple computers with a KVM switch is complicated and requires separate physical equipment.

[0003] According to one embodiment of the present disclosure, there is provided a display device capable of transmitting input data from an input device to a source device connected to the display device without separately providing physical equipment.

[0004] According to one embodiment of the present disclosure, it is an object to provide a display device that can facilitate switching of a source device having screen control and can facilitate switching of screen control from a source device having screen control to a display device.

[0005] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0006] According to one embodiment, a display device may include a display, a communication interface, a memory storing one or more instructions, and a processor executing one or more instructions stored in the memory.

[0007] According to one embodiment, at least one processor may control a display to receive and display screen data from one or more source devices that provide screen data among one or more source devices connected via wired or wireless communication by executing one or more instructions.

[0008] According to one embodiment, at least one processor may transmit input data received from an input device connected via wired or wireless communication to one or more source devices having screen control rights, the source devices having screen control rights indicating authority to control screen data, by executing one or more instructions.

[0009] According to one embodiment, at least one processor may control a communication interface to transmit information for switching screen control to the source device having screen control upon receiving a request related to screen control from the source device having screen control in response to a pointer displayed by the source device having screen control being located in a predetermined area of ​​a display screen output by the source device having screen control by executing one or more instructions to control a display position using input data received from an input device.

[0010] According to one embodiment, at least one processor may control a communication interface to receive, from a source device having screen control, a graphical user interface screen that enables switching of screen control, the graphical user interface screen being generated based on information for switching of screen control, by executing one or more instructions.

[0011] In one embodiment, at least one processor may control a display to display a received graphical user interface screen by executing one or more instructions.

[0012] According to one embodiment, a method of operating a display device may include receiving and displaying screen data from a source device providing screen data among one or more source devices connected via wired or wireless communication.

[0013] According to one embodiment, a method of operating a display device may include transmitting input data received from an input device connected via wired or wireless communication to a source device having screen control rights indicating authority to control screen data among one or more source devices.

[0014] According to one embodiment, a method of operating a display device may include an operation of receiving a request for information for screen control from the source device having screen control when the source device having screen control determines that a pointer displayed to control a display position using input data received from an input device is located in a predetermined area of ​​a display screen on which the screen data is displayed, and transmitting information for switching screen control to the source device having screen control.

[0015] A method of operating a display device according to one embodiment may include receiving, from a source device having screen control, a graphical user interface screen that enables switching of screen control, the graphical user interface screen being generated based on information for switching of screen control.

[0016] A method of operating a display device according to one embodiment may include displaying a received graphical user interface screen.

[0017] In one embodiment, a computer-readable recording medium having recorded thereon one or more programs executed by a processor of a display device for implementing a method of operating a display device may include: receiving and displaying screen data from a source device providing screen data among one or more source devices connected via wired or wireless communication; transmitting input data received from an input device connected via wired or wireless communication to a source device having screen control rights indicating an authority to control the screen data among the one or more source devices; transmitting information for switching the screen control rights to the source device having screen control rights when a pointer displayed by the source device having screen control rights to control a display position using the input data received from the input device is determined to be located in a predetermined area of ​​a display screen on which the screen data is displayed, upon receiving a request for information for the screen control rights from the source device having screen control rights; receiving, from the source device having screen control rights, a graphical user interface screen that enables switching the screen control rights, the graphical user interface screen being generated based on the information for switching the screen control rights, and displaying the received graphical user interface screen.

[0018] According to a display device, method, and non-transitory computer-readable storage medium according to one embodiment, input data of an input device can be transmitted to a source device connected to the display device without the need for separate physical equipment.

[0019] According to a display device, method, and non-transitory computer-readable storage medium according to one embodiment, it is possible to facilitate switching of a source device having screen control and to facilitate switching of screen control from a source device having screen control to a display device.

[0020] The effects that can be obtained from the embodiments disclosed in this disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.

[0021] The above and other aspects, features and advantages of the embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0022] FIG. 1 is a reference diagram for explaining the operation of a display device, a control device, and a source device according to various embodiments.

[0023] FIG. 2 illustrates an example of a display device system according to one embodiment.

[0024] FIG. 3 illustrates an example of a block diagram of a display device according to one embodiment.

[0025] FIG. 4 illustrates an example of a block diagram of a display device according to one embodiment.

[0026] FIG. 5 is a flowchart according to an example of a method of operating a display device according to one embodiment.

[0027] FIG. 6 illustrates an example of information for switching screen control according to one embodiment.

[0028] FIG. 7 illustrates examples of graphical user interface screens that enable switching of screen control and information for switching of screen control, according to one embodiment.

[0029] FIG. 8 illustrates an example flowchart of a method of connecting an input device and a source device to a display device according to one embodiment.

[0030] FIG. 9 is a flowchart illustrating an example of an operation method for connecting a display device and a source device for transmitting and receiving a control signal for switching screen control rights according to one embodiment.

[0031] FIG. 10 illustrates an example of a user interface screen that allows settings related to switching screen control on a source device according to one embodiment.

[0032] FIG. 11 is a flowchart illustrating an example of a method of operating a display device and a source device for switching screen control according to one embodiment.

[0033] FIG. 12 is a drawing showing an example of a predetermined area of ​​a display screen according to one embodiment.

[0034] Figure 13 shows an example of the operating method illustrated in Figure 11.

[0035] Figure 14 shows an example of the operating method illustrated in Figure 11.

[0036] FIG. 15 is a flowchart illustrating an example of a method of operation when selecting an item on a graphical user interface that enables switching of screen control according to one embodiment.

[0037] FIG. 16 is a flowchart illustrating an example of a method of operation when selecting an item on a graphical user interface that enables switching of screen control according to one embodiment.

[0038] Figure 17 shows an example of the operating method described with reference to Figures 15 and 16.

[0039] Figure 18 shows an example of the operating method described with reference to Figures 14 and 15.

[0040] Figure 19 shows an example of the operating method described with reference to Figures 15 and 16.

[0041] Figure 20 shows an example of the operating method described with reference to Figures 15 and 16.

[0042] Figure 21 shows an example of the operating method described with reference to Figures 15 and 16.

[0043] The terms used in this specification will be briefly explained, and the present invention will be described in detail.

[0044] The terms used in this invention have been selected from widely used, current terms, taking into account the functions of the invention. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, in which case their meanings will be described in detail in the relevant description of the invention. Therefore, the terms used in this invention should not be defined simply as names, but rather based on their inherent meanings and the overall content of the invention.

[0045] When a part of the specification is said to "include" a component, this does not mean that it excludes other components, but rather that it may include other components, unless specifically stated otherwise. Furthermore, terms such as "module," "unit," and "part" used in the specification may be physically implemented by analog and / or digital circuits that include one or more of logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, etc.

[0046] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement the present invention. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description have been omitted to clearly explain the present invention, and similar parts have been designated with similar reference numerals throughout the specification.

[0047] In the embodiments of this specification, the term "user" means a person who controls a function or operation of a computing device or electronic device using a control device, and may include a viewer, an administrator, or an installer.

[0048] FIG. 1 is a reference diagram for explaining the operation of a display device, an input device, and a source device according to various embodiments.

[0049] Referring to FIG. 1, the display device 100 can display content received from various sources. For example, the display device 100 can receive content from various sources and display the received content on the display. The display device 100 can be, for example, a television, a monitor, a personal computer, etc. The display device 100 can be connected to one or more source devices 300 that provide content. For example, referring to FIG. 1, the display device 100 can be connected to a first source device 300a and a second source device 300b. The display device 100 can be connected to an input device 200 that provides input data.

[0050] The source device 300 may represent an electronic device that provides content to the display device 100 according to a user input received from the display device 100. The source device 300 may include, for example, an electronic device such as a personal computer, a game console, or a set-top box. The source device 300 may execute a content application according to a user input received from the display device 100, and transmit a result screen according to the execution of the content application to the display device 100 via a communication network. For example, when the source device 300 is a game console, the source device 300 may execute the game application and transmit a result screen or result image rendered according to the execution of the game application to the display device 100 via a communication network upon receiving a user input requesting execution of the game application from the display device 100. The display device 100 can transmit a user input requesting execution of a content application to the source device 300, receive a result screen according to the execution of the content application in response to the user input from the source device 300, and display the received result screen on the display.

[0051] The input device 200 may represent an electronic device that provides input data corresponding to a user input to the display device 100. For example, the input device 200 may be a remote controller, game pad, keyboard, mouse, etc. for controlling a screen displayed on the display of the display device 100.

[0052] Referring to FIG. 1, a display device 100 may be connected to a first source device 300a and a second source device 300b. The display device 100 may display a display screen acquired by the display device 100 itself, display screen data received from the first source device 300a, or display screen data received from the second source device 300b.

[0053] The display device 100 can control a screen displayed on the display of the display device 100 using input data received from the input device 200. For example, in a state where the display device 100 displays screen data received from the first source device 300a, the display device 100 can transmit the input data received from the input device 200 to the first source device 300a. For example, in a state where the display device 100 displays screen data received from the second source device 300b, the display device 100 can transmit the input data received from the input device 200 to the second source device 300b. For example, in a state where the display device 100 displays screen data acquired by the display device itself, the display device 100 can consume the input data received from the input device 200 by the display device 100 itself.

[0054] In one embodiment, when the display device 100 is connected to various source devices and can receive and display screen data from the various source devices, the display device 100 can use the switching circuit 150 to switch and transmit the input data from the input device 200 to an appropriate source so that the input data from one input device 200 can be used to control the display device 100, the first source device 300a, and the second source device 300b. In this way, by arranging the switching circuit for switching and transmitting the input data from the input device 200 within the display device 100, the need for a separate physical device such as a KVM switch can be eliminated.

[0055] According to one embodiment, the display device 100 can receive and display screen data from a source device that provides screen data among one or more source devices connected via wired or wireless communication.

[0056] According to one embodiment, the display device 100 can transmit input data received from an input device to a source device having screen control rights, which represent the authority to control screen data. The source device having screen control rights can use the received input data to control the position of a mouse pointer displayed on a display screen output by the source device, move the position of a specific indicator displayed on the display screen, or move a highlight indicating a currently selected menu item among a plurality of menu items displayed on the display screen.

[0057] According to one embodiment, the display device 100 may transmit information for switching screen control to the source device having screen control in response to a request from the source device having screen control when a pointer corresponding to the movement of the input device is located in a predetermined area of ​​the display screen. According to one embodiment, the source device having screen control may receive input data from the display device 100 and, based on the input data, detect whether a pointer corresponding to the movement of the input device is located in a predetermined area of ​​the display screen.

[0058] According to one embodiment, a source device having screen control can transmit a request for information for switching screen control to a display device 100 through a communication interface when detecting that a pointer corresponding to a movement of an input device is located in a predetermined area of ​​a display screen. The source device having screen control can search for a display device 100 using a short-range communication technology and register the searched display device 100 in advance. The source device having screen control can transmit a request for information for switching screen control to the pre-registered display device 100 through a communication interface based on the short-range communication technology.

[0059] According to one embodiment, the display device 100 may transmit information for switching screen control to the source device having screen control through a communication interface in response to a request from a source device having screen control. According to one embodiment, the information for switching screen control includes information about one or more sources to which the screen control can be switched, and the information about one or more sources to which the screen control can be switched may include at least one of information representing a screen that can be provided by one or more source devices to which the screen control can be switched, information representing an application that can be executed by one or more source devices to which the screen control can be switched, information representing an application that can be executed by the source device having the screen control, information representing a screen that can be provided by the display device, and information representing an application that can be executed by the display device. The screen that can be provided by one or more source devices to which the screen control can be switched may include a home screen or a most recent screen that can be provided by one or more source devices to which the screen control can be switched. According to one embodiment, the information for switching screen control may further include information indicating whether the display screen is a single-view or multi-view. The display device 100 may determine variously what information to include in the information for switching screen control based on the display device 100's policy or user settings.

[0060] According to one embodiment, a source device having screen control can receive information for switching screen control from a display device 100, generate a graphical user interface screen that enables switching of screen control based on the information, and transmit the generated graphical user interface screen to the display device 100.

[0061] According to one embodiment, the display device 100 may receive and output a graphical user interface screen from a source device having screen control. The graphical user interface screen enabling switching of screen control may include one or more items, each corresponding to one or more sources to which screen control can be switched.

[0062] According to one embodiment, the display device 100 may receive input data from an input device for selecting an item representing a source on a graphical user interface screen and transmit the data to a source device having screen control.

[0063] According to one embodiment, the display device 100 can receive and display an execution screen of an application of the source device corresponding to the selected item from the source device upon confirming that the source to which the screen control is to be switched is related to the source device based on the input data.

[0064] According to one embodiment, the display device 100 receives information about a source to which the screen control is to be switched from the source device based on input data, determines whether the source to which the screen control is to be switched is related to the display device, and upon determining that the source to which the screen control is to be switched is related to the display device, determines whether a screen provided by the display is a multi-view, and based on the screen being a multi-view screen, maintains a current multi-view screen of the display device and converts a pointer of the source device into a pointer of the display device and displays it.

[0065] According to one embodiment, the display device 100 receives information about a source to which the screen control is to be switched based on the input data from the source device, determines whether the source to which the screen control is to be switched is related to the display device, and upon determining that the source to which the screen control is to be switched is related to the display device, determines whether a screen provided by the display is a multi-view, and based on the screen being a single-view screen, in response to the information about the source to which the screen control is to be switched, displays one of the most recent screen that can be provided by the display device, a home screen that can be provided by the display device, or a screen that executes an application of the display device.

[0066] By a specific program running on the source device, the display device can be discovered based on the short-range communication and registered in advance with the source device for transmitting and receiving information for the screen control.

[0067] FIG. 2 illustrates an example of a display device system according to one embodiment.

[0068] Referring to FIG. 2, the system may include a display device 100, an input device 200, and a source device 300 connected to a communication network.

[0069] The display device 100 may include a communication interface 110, a display 120, memory 130, and a processor 140. However, the display device 100 may be implemented with more components than those illustrated, and is not limited to the examples described above. For example, the display device 100 may further include a separate image processing unit for image processing of application images running on the display device 100.

[0070] The communication interface 110 may perform communication with at least one external device. Here, 'communication' may mean an operation of transmitting and / or receiving data, signals, requests, and / or commands.

[0071] The communication interface 110 can perform wired or wireless communication with at least one external device. For example, the external device may be a source device capable of providing content, a server, a storage device, etc.

[0072] For example, the communication interface 110 may include at least one of a communication module, a communication circuit, and a communication device for performing wired or wireless communication with at least one external device.

[0073] For example, the communication interface 110 may include at least one wireless communication module, wireless communication circuit, or wireless communication device that performs wireless communication with an external device, for example, a control device.

[0074] The communication interface 110 may include one or more modules that enable wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network in which other devices are located.

[0075] According to one embodiment, the communication interface 110 may perform communication with the display device 100 according to a short-range communication technology. The short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, USB communication, etc. According to one embodiment, the communication interface 110 may include at least one of a Bluetooth communication module that performs communication according to a Bluetooth communication protocol and a Wi-Fi communication module that performs communication according to a Wi-Fi communication protocol.

[0076] The input / output unit 120 can receive video (e.g., moving images), audio (e.g., voice, music, etc.), and additional information from the outside of the display device 100 under the control of the processor 150. The input / output unit 120 may include one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port, or a combination of one or more thereof. In addition to the HDMI port, the input / output unit 120 may further include a DisplayPort (DP), Thunderbolt, and MHL (Mobile High-Definition Link).

[0077] According to one embodiment, the input / output unit 120 may be connected to the source device 300 via an HDMI port. Accordingly, the input / output unit 120 may receive screen data to be displayed on the display of the display device 100 via the HDMI port.

[0078] According to one embodiment, the input / output unit 120 may be connected to the input device 200 via a USB port. Accordingly, the input / output unit 120 may receive input data from the input device 200 via the USB port.

[0079] According to one embodiment, the input / output unit 120 may be connected to the source device 300 via a USB port. Accordingly, the input / output unit 120 may transmit input data from the input device 200 to the source device 300 via the USB port.

[0080] The display 130 can output an image onto the screen under the control of the processor 150. For example, the processor 150 can control the display 130 so that an intended image is output onto the display 130.

[0081] The display 130 outputs images onto a screen. For example, the display 130 may output images corresponding to video data via an internally included display panel so that a user can visually recognize the video data. Specifically, the video data forming the content may include a plurality of frame images, and the display 130 may play the video content by sequentially displaying the plurality of frame images under the control of the processor 150.

[0082] Memory 140 can store a program for processing and controlling the processor 150, and can store data input to or output from the display device 100.

[0083] The memory 140 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0084] Although not shown, the display device 100 may further include a user input interface. The user input interface may be any form of interface means capable of receiving user input. For example, the user input interface may include operation buttons arranged on a portion of the display device 100 capable of receiving user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user voice input, and the like.

[0085] The processor 150 controls the overall operation of the display device 100. For example, the processor 150 may perform the functions of the display device 100 described in the present disclosure by executing one or more instructions stored in the memory 140. The processor 150 may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits, including at least one processor. One or more processors in at least one processor may be configured to individually and / or collectively perform the various functions described herein in a distributed manner. As used herein, “processor,” “at least one processor,” and “one or more processors” may be configured to perform multiple functions. However, these terms encompass, for example and without limitation, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor may perform all of the functions. Furthermore, the at least one processor may include a combination of processors that perform various functions of the disclosed functions in a distributed manner. At least one processor is capable of executing program instructions to accomplish or perform various functions.

[0086] In an embodiment of the present disclosure, the processor 150 can store one or more instructions in an internally provided memory, and control the execution of the one or more instructions stored in the internally provided memory so that the aforementioned operations are performed. That is, the processor 150 can perform a predetermined operation by executing at least one instruction or program stored in the internal memory provided within the processor 150 or the memory 150.

[0087] Now let's describe input device 200.

[0088] The input device 200 may include a communication interface 210, a user input interface 220, memory 230, and a processor 240. However, the input device 200 may be implemented by more components than the illustrated components and is not limited to the examples described above.

[0089] The communication interface 210 may perform communication with at least one external device. Here, 'communication' may mean an operation of transmitting and / or receiving data, signals, requests, and / or commands.

[0090] The communication interface 210 can perform wired or wireless communication with at least one external device. For example, the external device may be a source device capable of providing content, a server, a storage device, etc.

[0091] For example, the communication interface 210 may include at least one of a communication module, a communication circuit, and a communication device for performing wired or wireless communication with at least one external device.

[0092] For example, the communication interface 210 may include at least one wireless communication module, wireless communication circuit, or wireless communication device that performs wireless communication with an external device, for example, a control device.

[0093] The communication interface 210 may include one or more modules that enable wireless communication between the input device 200 and a wireless communication system or between the input device 200 and a network in which other devices are located.

[0094] According to one embodiment, the communication interface 210 may communicate with the display device 100 using a short-range communication technology. The short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, USB communication, etc.

[0095] According to one embodiment, the communication interface 210 may include one or more of a USB communication module that performs communication according to a USB communication protocol, a Bluetooth communication module that performs communication according to a Bluetooth communication protocol, and a WiFi communication module that performs communication according to a WiFi communication protocol.

[0096] The user input interface 220 may be any form of interface means capable of receiving user input. For example, the user input interface 220 may include operation buttons arranged on a portion of the input device 200 capable of receiving user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user voice input, etc.

[0097] If the input device 200 is implemented as a mouse, it may further include one or more sensors for sensing movement of the mouse.

[0098] If the input device 200 is implemented as a keyboard, the user input interface 220 may include one or more keys.

[0099] Memory 230 can store a program for processing and controlling the processor 240, and can store data input to or output from the input device 200.

[0100] The memory 230 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0101] Processor 240 controls the overall operation of input device 200. For example, processor 240 may perform the functions of input device 200 described in the present disclosure by executing one or more instructions stored in memory 220.

[0102] In an embodiment of the present disclosure, the processor 240 can store one or more instructions in an internally provided memory, and control the execution of the one or more instructions stored in the internally provided memory so that the aforementioned operations are performed. That is, the processor 240 can perform a predetermined operation by executing at least one instruction or program stored in an internal memory provided within the processor 240 or in the memory 220.

[0103] According to one embodiment, the processor 240 may perform a communication connection with the display device 100 using a short-range wireless communication technology by executing one or more instructions stored in the memory 220. The short-range wireless communication technology may include Bluetooth communication technology or Wi-Fi Direct technology.

[0104] According to one embodiment, the processor 240 may control the communication interface 210 to transmit a control signal corresponding to a user input received through the user input interface 220 according to an appropriate communication protocol by executing one or more instructions stored in the memory 220.

[0105] The input device 200 may be any type of device that performs a function, including a processor and memory. The input device 200 may include various electronic devices, such as a keyboard, mouse, trackball, or touchscreen.

[0106] Meanwhile, the block diagram of the input device 200 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the input device 200 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0107] Now let's describe the source device 300.

[0108] The source device 300 may include a communication interface 310, memory 320, and a processor 330. However, the source device 300 may be implemented with more components than those illustrated, and is not limited to the examples described above. For example, the source device 300 may further include a separate image processing unit for image processing of application images running on the source device 300.

[0109] The communication interface 310 may perform communication with at least one external device. Here, 'communication' may mean an operation of transmitting and / or receiving data, signals, requests, and / or commands.

[0110] The communication interface 310 can perform wired or wireless communication with at least one external device. For example, the external device may be a source device capable of providing content, a server, a storage device, etc.

[0111] For example, the communication interface 310 may include at least one of a communication module, a communication circuit, and a communication device for performing wired or wireless communication with at least one external device.

[0112] For example, the communication interface 310 may include at least one wireless communication module, wireless communication circuit, or wireless communication device that performs wireless communication with an external device, for example, a control device.

[0113] The communication interface 310 may include one or more modules that enable wireless communication between the source device 300 and a wireless communication system or between the source device 300 and a network in which other devices are located.

[0114] According to one embodiment, the communication interface 310 may perform communication with the display device 100 according to a short-range communication technology. The short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, USB communication, etc. According to one embodiment, the communication interface 310 may include at least one of a Bluetooth communication module that performs communication according to a Bluetooth communication protocol and a Wi-Fi communication module that performs communication according to a Wi-Fi communication protocol.

[0115] The input / output unit 320 can output video (e.g., moving images), audio (e.g., voice, music, etc.), and additional information to the outside of the source device 300 under the control of the processor 340. The input / output unit 320 may include one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port, or a combination of one or more thereof. In addition to the HDMI port, the input / output unit 320 may further include a DisplayPort (DP), Thunderbolt, or MHL (Mobile High-Definition Link). For example, when the source device 300 is implemented as a game console, the source device 300 can provide a result screen of game content executed on the source device 300 to the display device 100 via HDMI, etc.

[0116] According to one embodiment, the input / output unit 320 may be connected to the display device 100 via an HDMI port. Accordingly, the input / output unit 320 may output screen data to be displayed on the display of the display device 100 via the HDMI port.

[0117] According to one embodiment, the input / output unit 320 may be connected to the display device 100 via a USB port. Accordingly, the input / output unit 320 may receive input data from the input device 200 via the USB port from the display device 100.

[0118] The memory 330 can store a program for processing and controlling the processor 340, and can store data input to or output from the source device 300.

[0119] The memory 330 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0120] Although not shown, the source device 300 may further include a user input interface. The user input interface may be any form of interface means capable of receiving user input. For example, the user input interface may include operation buttons arranged on a portion of the source device 300 capable of receiving user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user voice input, and the like.

[0121] The processor 340 controls the overall operation of the source device 300. For example, the processor 340 may perform the functions of the source device 300 described in the present disclosure by executing one or more instructions stored in the memory 330. The processor 340 may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits, including at least one processor. One or more processors in at least one processor may be configured to individually and / or collectively perform the various functions described herein in a distributed manner. As used herein, “processor,” “at least one processor,” and “one or more processors” may be configured to perform multiple functions. However, these terms encompass, for example and without limitation, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor may perform all of the functions. Furthermore, the at least one processor may include a combination of processors that perform various functions of the disclosed functions in a distributed manner. At least one processor is capable of executing program instructions to accomplish or perform various functions.

[0122] In an embodiment of the present disclosure, the processor 340 can store one or more instructions in an internally provided memory, and control the execution of the one or more instructions stored in the internally provided memory so that the aforementioned operations are performed. That is, the processor 340 can perform a predetermined operation by executing at least one instruction or program stored in an internal memory provided within the processor 340 or in the memory 330.

[0123] According to one embodiment, the processor 340 may control the input / output unit 320 to transmit screen data to be displayed on the display of the display device 100 to the display device 100 by executing one or more instructions stored in the memory 330.

[0124] According to one embodiment, the processor 340 may control the input / output unit 320 to receive input data from the input device 200 from the display device 100 by executing one or more instructions stored in the memory 330.

[0125] According to one embodiment, the processor 340 may perform an operation corresponding to input data from the input device 200 by executing one or more instructions stored in the memory 330.

[0126] According to one embodiment, the processor 340 may detect, based on input data from the input device 200, whether a pointer corresponding to movement of the input device is positioned in a predetermined area of ​​the display screen by executing one or more instructions stored in the memory 330.

[0127] According to one embodiment, the processor 340 may control the communication unit 310 to transmit a request to the display device 100 to send information for switching screen control upon detecting that the pointer is located in a predetermined area of ​​the display screen by executing one or more instructions stored in the memory 330.

[0128] According to one embodiment, the processor 340 may control the communication unit 310 to receive information for switching screen control from the display device 100 by executing one or more instructions stored in the memory 330.

[0129] According to one embodiment, the processor 340 may generate a graphical user interface screen that enables switching of screen control based on information for switching of screen control received from the display device 100 by executing one or more instructions stored in the memory 330, and control the input / output unit 320 to transmit the generated graphical user interface screen to the display device 100.

[0130] The block diagram of the source device 300 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the source device 300 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0131] FIG. 3 illustrates an example of a block diagram of a display device according to one embodiment.

[0132] Referring to FIG. 3, the display device 100 is a device that can display images or data according to a user's request, and may include a communication unit 110, an input / output unit 120, a display 130, a memory 140, a processor 150, an image processing unit 135, an audio processing unit 160, an audio output unit 170, a switching circuit 180, and a detection unit 190.

[0133] The communication unit 110 may include one or more modules that enable wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network in which another device is located.

[0134] The communication unit 110 may further include a mobile communication module 111 for transmitting and receiving wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network, a wireless Internet module 112 for wireless Internet access, and a short-range communication module 113. Wireless Internet technologies that may be used include WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed ​​Downlink Packet Access). In addition to the Wi-Fi communication module and the Bluetooth communication module, the short-range communication module 113 may include a communication module that uses short-range communication technologies such as BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra Wideband), and ZigBee.

[0135] The communication unit 110 can transmit and receive requests and responses for information for screen control by being connected to a source device through a short-range communication module 113 under the control of the processor 140.

[0136] The input / output unit 120 can receive video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from the outside of the display device 100 under the control of the processor 150. The input / output unit 120 may include one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port, or a combination of one or more thereof. In addition to the HDMI port, the input / output unit 120 may further include a DisplayPort (DP), Thunderbolt, and MHL (Mobile High-Definition Link).

[0137] The input / output unit 120 can receive screen data from one or more connected source devices by connecting to one or more source devices through one or more HDMI ports.

[0138] The input / output unit 120 can receive input data from an input device by connecting to the input device via a USB port.

[0139] The input / output unit 120 can be connected to one or more source devices via one or more USB ports. Under the control of the processor 150, the input / output unit 120 can transmit input data from the input device 200 to a source device having screen control among the one or more connected source devices.

[0140] Display 130 can output images or data processed in display device 100.

[0141] The image processing unit 135 can process an image signal and output it to the display 130 under the control of the processor 150.

[0142] Memory 140 can store a program for processing and controlling the processor 150, and can store data input to or output from the display device 100. In addition, memory 140 can store data necessary for the operation of the display device 100.

[0143] The memory 140 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0144] The processor 150 controls the overall operation of the display device 100. For example, the processor 150 may perform the functions of the display device 100 described in the present disclosure by executing one or more instructions stored in the memory 140.

[0145] In an embodiment of the present disclosure, the processor 150 can store one or more instructions in an internally provided memory, and control the execution of operations of the display device by executing one or more instructions stored in the internally provided memory. That is, the processor 150 can perform a predetermined operation by executing at least one instruction or program stored in the internal memory or memory 140 provided within the processor 150.

[0146] The processor 150 controls the overall operation of the display device 100 and the signal flow between internal components (not shown) of the display device 100, and performs the function of processing data. When there is a user input or a preset stored condition is satisfied, the processor 150 can execute the OS (Operating System) stored in the memory 140 and various applications.

[0147] The processor 150 may include a graphic processor (Graphic Processing Unit, not shown) for graphic processing corresponding to video. The graphic processing unit (not shown) generates a screen including various objects such as icons, images, and text using a calculation unit (not shown) and a rendering unit (not shown). The calculation unit calculates attribute values ​​such as coordinate values, shape, size, and color to be displayed for each object according to the layout of the screen using user interactions detected by a detection unit (not shown). The rendering unit generates a screen including various layouts of objects based on the attribute values ​​calculated by the calculation unit.

[0148] According to one embodiment, the processor 150 may perform operations of the display device 100 disclosed in the present disclosure by executing one or more instructions stored in the memory 140.

[0149] The audio processing unit 160 can convert an audio signal into an analog audio signal and output it to the audio output unit 170 under the control of the processor 150.

[0150] The audio output unit 170 can output input audio (e.g., voice, sound). In addition, the audio output unit 170 can output audio stored in the memory 140 under the control of the processor 150. The audio output unit 170 can include at least one or a combination of a speaker, a headphone output terminal, or an S / PDIF (Sony / Philips Digital Interface:) output terminal.

[0151] The switching circuit 180 may include hardware and software that performs the role of switching input data received from the input device 200 to provide it to an appropriate source device under the control of the processor 150.

[0152] The detection unit 190 is configured to detect a user's voice, a user's image, or a user's interaction, and may include a camera, a microphone, and an optical receiving unit.

[0153] The camera can receive images (e.g., consecutive frames) corresponding to a user's motion, including a gesture, within the camera's recognition range. The processor 140 can use the recognition results of the received motion to select a menu displayed on the display device 100 or perform a control corresponding to the motion recognition results.

[0154] The microphone receives the user's spoken voice. The microphone can convert the received voice into an electrical signal and output it to the processor 140. The user's voice may include, for example, a voice corresponding to a menu or function of the display device 100.

[0155] The optical receiver receives an optical signal (including a control signal) from an external control device. The optical receiver can receive an optical signal corresponding to a user input (e.g., touch, press, touch gesture, voice, or motion) from the control device. A control signal can be extracted from the received optical signal under the control of the processor 140.

[0156] Although not shown, the display device 100 may further include a user input interface. The user input interface may be any form of interface means capable of receiving user input. For example, the user input interface may include operation buttons arranged on a portion of the display device 100 capable of receiving user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user voice input, and the like.

[0157] The display device 100 may be any type of device that performs a function, including a processor and memory. The display device 100 may be a fixed or portable device. For example, the display device 100 may refer to a device that has a display and can display image content, video content, game content, graphic content, etc. The display device 100 may output or display image or content received from the source device 300. The display device 100 may include various types of electronic devices that can receive and output content, such as televisions such as network TVs, smart TVs, Internet TVs, web TVs, and IPTVs; computers such as desktops, laptops, and tablets; smart phones, cellular phones, game players, music players, video players, medical equipment, and home appliances. The display device 100 may be referred to as a display device in that it receives and displays content, and may also be referred to as a content receiving device, a sink device, an electronic device, a computing device, etc.

[0158] The block diagram of the display device 100 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the display device 100 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0159] FIG. 4 illustrates an example of a block diagram of a display device according to one embodiment.

[0160] Referring to FIG. 4, the display device 100 may include a communication unit 110, a display 120, a memory 130, a processor 140, a switching circuit 150, a first input / output interface 411, a second input / output interface 412, a first source device interface 421, a second source device interface 422, and an input device interface 430.

[0161] The communication unit 110 can communicate with the first source device 300a and the second source device 300b using short-range communication technology. The communication unit 110 can receive a request for information for switching screen control rights under the control of the processor 140 or communicate with the first source device 300a or the second source device 300b to transmit information for switching screen control rights.

[0162] The first input / output interface 411 may serve to connect the first source device 300a to the display device 100. The first input / output interface 411 may be included in the input / output unit 180 illustrated in FIG. 3, and for example, the first input / output interface 411 may include an HDMI port. The first input / output interface 411 may receive screen data transmitted from the first source device 300a under the control of the processor 140.

[0163] The second output interface 412 may serve to connect the second source device 300b to the display device 100. The second input / output interface 412 may be included in the input / output unit 180 illustrated in FIG. 3, and for example, the second input / output interface 412 may include an HDMI port. The second input / output interface 412 may receive screen data transmitted from the second source device 300b under the control of the processor 140.

[0164] The first source device interface 421 may serve to connect the first source device 300a to the display device 100. The first source device interface 421 may be included in the input / output unit 180 illustrated in FIG. 3, and for example, the first source device interface 421 may include a USB port. The first source device interface 421 may transmit input data received from the input device 200 to the first source device 300a under the control of the processor 140.

[0165] The second source device interface 422 may serve to connect the second source device 300b to the display device 100. The second source device interface 422 may be included in the input / output unit 180 illustrated in FIG. 3, and for example, the second input / output interface 422 may include a USB port. The second source device interface 422 may transmit input data received from the input device 200 to the second source device 300b under the control of the processor 140.

[0166] The input device interface 430 may serve to connect the input device 200 to the display device 100. The input device interface 430 may be included in the input / output unit 180 illustrated in FIG. 3, and for example, the input device interface 430 may include a USB port. The input device interface 430 may receive input data from the input device 200 under the control of the processor 140.

[0167] The switching circuit 150 can perform an operation of switching input data received from the input device 200 to an appropriate source under the control of the processor 140. For example, when the source having screen control right is a display device under the control of the processor 140, the switching circuit 150 can provide input data from the input device 200 to the processor 140. For example, when the source having screen control right is switched from the display device to the first source device 300a under the control of the processor 140, the switching circuit 150 can switch the input data from the input device 200 to be transmitted to the first source device interface 421.

[0168] FIG. 5 is a flowchart according to an example of a method of operating a display device according to one embodiment.

[0169] Referring to FIG. 5, in operation 510, the display device 100 may receive and display screen data from one or more source devices among one or more source devices connected via wired or wireless communication.

[0170] According to one embodiment, the display device 100 may receive and display screen data from one or more source devices among one or more source devices connected via wireless communication such as Bluetooth communication or Wi-Fi communication, or may receive and display screen data from one or more source devices among one or more source devices connected via an input / output interface such as HDMI.

[0171] According to one embodiment, the display device 100 may output a single-view screen or a multi-view screen using screen data from one or more source devices. For example, the display device 100 may output screen data received from a source device as a single-view screen or output screen data received from one or more source devices as a multi-view screen.

[0172] In operation 520, the display device 100 may transmit input data received from an input device to a source device having screen control rights among one or more source devices. The screen control rights may indicate the authority to control screen data displayed on the display of the display device 100. For example, since the display device 100 can control the screen data while the display device itself displays screen data acquired by the display device on the display of the display device 100, the display device 100 may have screen control rights. For example, since the first source device can control the screen data while the display device 100 displays screen data received from a first source device, the first source device may have screen control rights. For example, when the display device 100 displays a multi-view screen, there may be one or more source devices that provide screen data to the display device 100. In this case, among the plurality of sub-view screens constituting the multi-view screen, a source device corresponding to a sub-view screen on which a cursor is positioned, i.e., a source device that provides screen data to the sub-view screen on which the cursor is positioned, may have screen control rights.

[0173] In operation 530, the display device 100 can transmit information for switching screen control to the source device having screen control in response to a request from the source device having screen control as a pointer corresponding to the movement of the input device is positioned in a predetermined area of ​​the display screen.

[0174] According to one embodiment, a source device having screen control authority may receive input data of an input device 200 from a display device 100, and may determine based on the input data whether a pointer corresponding to a movement of the input device is located in a predetermined area of ​​the display screen. The source device having screen control authority may detect a position corresponding to the movement of the input device from the input data, and may determine whether this position, i.e., the position of the pointer, belongs to a predetermined area of ​​the display screen. The predetermined area may be determined in various ways, but for example, the predetermined area may indicate an area extending from an edge of the display screen to a predetermined distance.

[0175] According to one embodiment, a source device having screen control may transmit a request to the display device 100 to send information for switching screen control when it is determined that a pointer corresponding to movement of the input device is located in a predetermined area of ​​the display screen.

[0176] According to one embodiment, a source device having screen control may trigger an event in which a pointer corresponding to movement of an input device is detected to be positioned in a predetermined area of ​​a display screen, thereby executing specific software and transmitting a request for information for switching screen control by the specific software.

[0177] According to one embodiment, a source device having screen control can transmit a request for information for switching screen control to a display device 100 using short-range wireless communication technology. For example, a source device having screen control can transmit a request for information for switching screen control to a pre-registered display device 100 using an AP using Wi-Fi communication technology.

[0178] According to one embodiment, the display device 100 may transmit information for switching screen control to the source device having screen control in response to a request from the source device having screen control. The information for switching screen control may include information about one or more sources to which screen control can be switched. The one or more sources to which screen control can be switched may include at least one of information about the source device to which screen control can be switched, information about a function or application that can be executed on the source device to which screen control can be switched, and information about a function or application that can be executed on the source device having screen control. The information for switching screen control will be described in detail with reference to FIG. 6.

[0179] FIG. 6 illustrates an example of information for switching screen control according to one embodiment.

[0180] Referring to FIG. 6, information 600 for switching screen control is information about one or more sources to which screen control can be switched, and may include at least one of information 610 about a source device to which screen control can be switched, information 620 about a function or application that can be executed on the source device to which screen control can be switched, and information 630 about a function or application that can be executed on the source device having screen control. Information 600 for switching screen control may optionally further include information 640 indicating whether it is single view / multi view or information 650 indicating a multi view layout.

[0181] Information 610 about a source device to which screen control can be switched may indicate identification information of one or more other source devices capable of providing screen data to a display device in addition to the source device currently having screen control, or identification information of the display device. For example, in the example of FIG. 4, if the first source device 300a is the source device currently having screen control and the second source device 300b is connected, information 610 about a source device to which screen control can be switched may include at least one of identification information of the second source device and identification information of the display device. Based on the information about the source device to which screen control can be switched, if the source device to which screen control can be switched is subsequently selected, the screen may return to the most recent screen of the selected source device. For example, if the second source device is selected as the source to which screen control can be switched, the screen may return to the most recent screen of the selected second source device. For example, if the display device is selected as the source to which screen control can be switched, the screen may return to the most recent screen of the display device.

[0182] Information 620 about a function or application that can be executed on a source device to which screen control can be switched may indicate identification information of a function or application that can be executed on one or more other source devices capable of providing screen data to a display device in addition to the source device currently having screen control, or identification information of a function or application that can be executed on the display device. For example, the identification information of a function or application that can be executed on one or more other source devices may indicate information about a home screen or content providing application that can be executed on one or more other source devices. For example, if a home screen that can be executed on a second source device is selected as a source to which screen control can be switched, the user may return to the home screen of the selected second source device. For example, if a YouTube application that can be executed on a second source device is selected as a source to which screen control can be switched, the user may return to the YouTube application screen of the selected second source device.

[0183] Information 630 about functions or applications that can be executed on a source device with screen control does not strictly mean switching of sources, but may be included for ease of use. For example, information about functions or applications that can be executed on a source device with screen control may display a screen control settings screen that allows for settings related to screen control that can be executed on the source device with screen control.

[0184] Information 640 indicating whether it is single view / multi view refers to information indicating whether the display screen of the current display device is single view or multi view. For example, information 640 indicating whether it is single view / multi view can be used to switch control. For example, if information 640 indicating whether it is single view / multi view indicates multi view, display device 100 can be implemented to always transfer screen control to source device 300, or if information 640 indicating whether it is single view / multi view indicates single view, display device 100 can operate to output a predetermined graphical user interface. The predetermined graphical user interface can include an item that allows moving to the display device home screen, for example.

[0185] Information 650 indicating a multi-view layout may include information indicating the correspondence between each sub-view that constitutes the multi-view when the display screen of the current display device is a multi-view. The correspondence between each sub-view and the source device corresponding to each sub-view may be expressed in various ways. For example, referring to FIG. 6, as in the first example, the correspondence may be described in text form, such as the upper left being the first source device, the upper right being the second source device, the lower left being the third source device, and the lower right being the fourth source device. Alternatively, the correspondence may be expressed in graphic form, such as in the second example.

[0186] If the display screen of the display device is multi-view, information 600 for switching screen control may include information 640 indicating whether it is single-view / multi-view and information 650 indicating the multi-view layout.

[0187] Returning to FIG. 5 again, at operation 540, the display device 100 may receive a graphical user interface screen that enables switching of screen control, generated based on information for switching of screen control, from a source device having screen control.

[0188] According to one embodiment, a source device having screen control rights that receives information for switching screen control rights from a display device 100 may generate a graphical user interface screen that enables switching of screen control rights based on the information for switching of screen control rights. The graphical user interface screen that enables switching of screen control rights may include items corresponding to one or more sources included in the information for switching of screen control rights.

[0189] FIG. 7 illustrates examples of graphical user interface screens that enable switching of screen control and information for switching of screen control, according to one embodiment.

[0190] Referring to FIG. 7, in the first example, a source device having screen control can receive from the display device information indicating that the screen control is in a single view as information for switching, information indicating the display device home screen, and information indicating the display device. In this case, the source device having screen control can generate a graphical user interface screen including an item indicating the display device home screen and an item indicating the display device. When an item indicating the display device home screen is selected, the display device home screen becomes the source, whereas when an item indicating the display device is selected, the current state of the display device, i.e., the most recent screen, can become the source.

[0191] In a second example, a source device having screen control can receive, from the display device, information indicating that the screen control is single-view as information for switching screen control, information indicating a display device home screen, and a screen control setting screen of the source device having screen control. In this case, the source device having screen control can generate a graphical user interface screen including an item indicating a display device home screen and an item indicating a screen control setting screen of the source device having screen control. When an item indicating a display device home screen is selected, the display device home screen can become the source. When an item indicating a screen control setting screen of the source device having screen control is selected, the screen control setting screen of the source device having screen control can become the source.

[0192] In a third example, a source device having screen control can receive from a display device information indicating that the source device is a multi-view device as information for switching screen control, information indicating a first source device, information indicating a second source device, information indicating a third source device, and information indicating a display device. In this case, the source device having screen control can generate a graphical user interface screen including an item indicating the first source device, an item indicating the second source device, an item indicating the third source device, and an item indicating an application of the fourth source device. If the first source device is the source device currently having screen control and an item indicating the second source device is selected, a cursor can be moved to a second sub-view corresponding to the second source device. The same applies to an item indicating the third source device. If an item indicating an application of the fourth source device is selected, a cursor can be moved to a fourth sub-view corresponding to the fourth source device and the application screen of the fourth source device can be made the source. If an item indicating a display device is selected, since the current screen of the display device is a multi-view screen, the shape of the cursor used by the display device can be displayed on the multi-view screen.

[0193] Returning to FIG. 5 again, at operation 550, the display device 100 may display a graphical user interface screen that enables switching of screen control received from a source device having screen control.

[0194] According to one embodiment, the display device 100 may display a graphical user interface screen that enables switching of screen control in a PIP (Picture In Picture) format or in a pop-up window format.

[0195] As a graphical user interface screen enabling the switching of screen control is displayed on the display device, the user can select the source to which screen control will be switched. The display device 100 can then control the switching of screen control based on this selection input.

[0196] Hereinafter, embodiments are described in detail with reference to FIGS. 8 to 21.

[0197] FIG. 8 illustrates an example flowchart of a method of connecting an input device and a source device to a display device according to one embodiment.

[0198] Referring to FIG. 8, in operation 810, the display device 100 can perform a connection operation with the input device 200.

[0199] According to one embodiment, the display device 100 can connect the display device 100 to an input device 200 that provides input data using wired or wireless communication technology.

[0200] According to one embodiment, the display device 100 can be connected to the input device 200 using one of USB communication, Bluetooth communication, and Wi-Fi communication.

[0201] In one embodiment, when connecting using USB communication, the downstream USB port of the display device 100 can be connected to the upstream USB port of the input device 200 using a USB cable. With this connection, the display device 100 can recognize the input device 200 as an HID. The Universal Serial Bus (USB) is a concept that groups devices with similar data reporting characteristics into device classes and has a single class driver for each group, instead of having separate software drivers for each new computer peripheral. Additionally, devices have the ability to explain to the class driver what control they have and how to report data. An HID (Human Interface Device) device can represent a device that provides services for inputting and outputting human data to and from a host. Examples of HIDs can include a mouse, joystick, gamepad, keyboard, or voltmeter and temperature sensor. The input device 200 and the display device 100 can be connected by plugging in a USB cable connected to the upstream USB port of the input device 200 to the downstream USB port of the display device 100. When the input device 200 and the display device 100 are connected with the USB cable, the display device 100 can recognize that the device, i.e., the input device 200, is plugged in. The display device 100 can request device information from the input device 200. Then, the input device 200 can transmit a device descriptor containing information about the input device to the display device 100. Information about the control device contained in the device descriptor can include a vendor ID, a product ID, and firmware version information of the input device 200.The display device 100 can recognize information about the input device 200 from the device descriptor and load an appropriate HID class driver for the input device 200. The HID class driver can select a configuration for the device, i.e., a configuration for the input device 200, and send a configuration setting request to the input device 200. The input device 200 can be configured according to the configuration setting. This operation enables the display device 100 to recognize the input device 200 connected to its downstream USB port as an HID.

[0202] At operation 820, the display device 100 may perform a connection operation with the source device 300 to receive screen data from the source device 300.

[0203] According to one embodiment, the display device 100 can connect the display device 100 to a source device 300 that provides screen data using wired or wireless communication technology.

[0204] According to one embodiment, the display device 100 can be connected to the source device 300 using an HDMI port.

[0205] At operation 830, the display device 100 may perform a connection operation with the source device 300 to transmit input data to the source device 300.

[0206] According to one embodiment, the display device 100 may be connected to the source device 300 using wired or wireless communication technology to transmit input data received from the input device 200 to the source device 300.

[0207] According to one embodiment, the display device 100 may connect to the source device 300 using one of USB communication, Bluetooth communication, and Wi-Fi communication to transmit input data received from the input device 200 to the source device 300.

[0208] In one embodiment, when connecting using USB communication, the upstream USB port of the display device 100 can be connected to the downstream USB port of the source device 300 using a USB cable.

[0209] In operation 840, the display device 100 may perform a connection operation with the source device 300 to transmit and receive a control signal for switching screen control rights. At this time, an active connection operation may be performed by the source device 300, and the display device 100 may be connected to the source device 300 according to this connection operation.

[0210] According to one embodiment, the display device 100 may perform a connection operation with the source device 300 to transmit and receive control signals for switching screen control rights according to various short-range communication technologies. The various short-range communication technologies may include Bluetooth communication technology, Wi-Fi communication technology, and the like.

[0211] According to one embodiment, the source device 300 can search for display devices connected to the access point to which it is connected and pre-register the searched display devices. In this way, by pre-registering information on display devices connected to the access point (AP), the source device 300 can utilize the information on the pre-registered display devices when transmitting and receiving control signals for switching screen control rights.

[0212] FIG. 9 is a flowchart illustrating an example of an operation method for connecting a display device and a source device for transmitting and receiving a control signal for switching screen control rights according to one embodiment.

[0213] Referring to FIG. 9, in operation 910, the source device 300 can perform a connection operation with the access point 900.

[0214] At operation 920, the display device 100 can perform a connection operation with the access point 900.

[0215] At operation 930, the source device 300 may execute a program for setting screen control switching. The source device 300 may download and store the program for setting screen control switching from a server. Upon execution of the program for setting screen control switching, the source device 300 may perform subsequent operations.

[0216] At operation 940, the source device 300 may transmit a device discovery request from the access point 900 to the access point.

[0217] At operation 950, the source device 300 may receive information about one or more devices connected to the access point from the access point 900. The information about the one or more devices connected to the access point may include information about a display device connected according to operation 920.

[0218] In operation 960, the source device 300 may register one or more pieces of information about one or more devices connected to the access point, received from the access point. At this time, the source device 300 may register the display device 100 as a device connected to the access point.

[0219] FIG. 10 illustrates an example of a user interface screen that allows settings related to switching screen control on a source device according to one embodiment.

[0220] Referring to FIG. 10, a user interface screen 1000 (hereinafter, referred to as a screen control switching setting screen) for setting screen control switching may include a window 1010 showing one or more registered devices, a button 1020 for instructing to search for devices connected to an AP, a button 1030 for allowing manual registration of a device, a checkbox 1060 for selecting whether to use the screen control switching function, a checkbox 1070 for selecting whether to use the screen control switching function in multi-view, a window 1085 for inputting a time for a cursor to remain on the edge of a display screen for screen control switching, and a checkbox 1090 for selecting whether the screen control switching function is to be used with the initial start of a source device.

[0221] Window 1010 showing one or more registered devices can show a device selected by the user from among devices connected to the access point to which the source device is connected.

[0222] Button 1020, which instructs to search for devices connected to the AP, is a button that can instruct to search again for devices connected to the AP. When the user selects this button 1020, the source device 300 can display a window 1040 displaying one or more newly discovered devices. That is, when the button 1020 is selected by the user, the source device 300 transmits a request to the access point to search for devices connected to the access point, and in response, receives information about one or more devices connected to the access point. The source device 300 can display a window 1040 displaying one or more newly discovered devices. Among one or more devices displayed in the window 1040, one or more devices selected by the user can be registered in the source device and displayed in the window 1010.

[0223] Button 1030 to enable manual device registration may represent a button that enables a user to manually enter a device that he or she wishes to register into the source device.

[0224] Checkbox 1060 for selecting whether to use screen control switching function in multiview is to select whether to use the detection of the cursor being located at the edge of the subview screen on which the cursor operates while the display device operates in multiview to trigger the screen control switching function. Upon input setting checkbox 1060 to a selected state, the source device can use it to trigger the screen control switching function when it detects that the cursor is located at the edge of the subview screen on which the cursor operates while the display device operates in multiview. Upon input setting checkbox 1060 to a deselected state, the source device does not detect that the cursor is located at the edge of the subview screen on which the cursor operates while the display device operates in multiview.

[0225] The checkbox 1070 for selecting whether to use the screen control switching function is to enable the display device to detect when the cursor is positioned at the edge of the display screen and use it to trigger the screen control switching function. Upon an input setting the checkbox 1070 to a selected state, the source device can use it to trigger the screen control switching function when it detects that the cursor is positioned at the edge of the display screen. Upon an input setting the checkbox 1070 to a deselected state, the source device does not detect that the cursor is positioned at the edge of the display screen.

[0226] Input window 1080 for entering the time for which the cursor remains on the edge of the display screen for switching screen control represents an input window for setting a time interval for which the cursor must remain on the edge of the display screen for the source device to detect that the cursor is positioned on the edge, when checkbox 1060 or checkbox 1070 is selected. For example, if the user sets 1 second in input window 1080, the source device 300 may determine that the cursor is positioned on the edge of the display screen if it detects that the cursor remains on the edge of the display screen for 1 second, and if the time for which the cursor remains on the edge of the display screen is less than 1 second, the source device may not detect that the cursor is positioned on the edge of the display screen.

[0227] Auto Start Checkbox 1090 represents a checkbox that allows you to select whether this screen control switching feature will be used with the initial startup of the source device.

[0228] FIG. 11 is a flowchart illustrating an example of a method of operating a display device and a source device for switching screen control according to one embodiment.

[0229] Referring to FIG. 11, in operation 1101, the display device 100 may receive screen data from the source device 300. For example, the display device 100 may receive screen data from the source device 300 based on HDMI communication.

[0230] In operation 1102, the display device 100 may display screen data received from the source device 300 on the display.

[0231] In operation 1103, the input device 200 may receive user input for manipulating the input device to control screen data while the display device 100 displays the screen data. For example, if the display device 100 displays a video such as a movie, the input device 200 may receive user input for controlling the volume of the video, controlling the playback speed, or stopping or resuming playback of the video.

[0232] In operation 1104, the input device 200 can transmit input data corresponding to the received user input to the display device 100. For example, if the input device 200 is connected to the display device 100 via a USB interface, the input device 100 can convert the input data into a USB format and transmit the input data in the USB format to the display device 100.

[0233] In operation 1105, the display device 100 can transmit input data received from the input device 200 to the source device, i.e., the source device 300, which has control over the screen currently displayed on the display. For example, if the display device 100 is connected to the source device 300 via a USB interface, the display device 100 can transmit the input data in USB format to the source device 300 as is. If the display device 100 is connected via a different communication method from the source device 300, the display device 100 can convert the input data in USB format into a format according to an appropriate communication method and transmit the input data in the converted format to the source device 300.

[0234] In operation 1106, the source device 300 may detect whether a pointer is positioned in a predetermined area based on input data received from the display device 100. The display device 100 may detect, based on the input data, whether a pointer indicating a position according to movement of the input device 200 remains in the predetermined area for a predetermined period of time. For example, the predetermined area may indicate an edge portion of a display screen.

[0235] FIG. 12 is a drawing showing an example of a predetermined area of ​​a display screen according to one embodiment.

[0236] Referring to FIG. 12, screen 1210 illustrates an example in which the screen of the display device 100 is a single-view screen. The single-view screen displayed on the display of the display device 100 can output screen data received from the source device 300. The source device 300 can receive input data and detect whether the position of the pointer according to the input data is located in a predetermined area. Specifically, the source device 300 can detect whether the position of the pointer according to the input data is located in the predetermined area for a predetermined time. The predetermined area can be determined in various ways from among the areas of the screen. For example, the predetermined area can include the edge area of ​​the screen. The edge area of ​​the screen can indicate an area from the very edge of the screen to a certain distance. The edge area of ​​the screen can include one or more of an area from the left end of the screen to a certain distance d1, an area from the right end of the screen to a certain distance d3, an area from the top end of the screen to a certain distance d2, and an area from the bottom end of the screen to a certain distance d4. Screen 1220 illustrates an example in which the screen of the display device 100 is a multi-view screen. In the case of a multi-view screen, a predetermined area may be determined within the display screen 1230 corresponding to a source device having current screen control. For example, the source device 300 may receive input data and detect whether the position of the pointer according to the input data is located in a predetermined area of ​​the screen 1230 corresponding to the source device 300. Specifically, the source device 300 may detect whether the position of the pointer according to the input data is located in the predetermined area for a predetermined period of time. The predetermined area may be determined in various ways from among the areas of the display screen 1230. For example, the predetermined area may include an edge area of ​​the screen.The edge area of ​​the screen can refer to an area extending from the very edge of the screen to a certain distance. The edge area of ​​the screen can include one or more of the following: an area extending from the left edge of the screen to a certain distance d1, an area extending from the right edge of the screen to a certain distance d3, an area extending from the top edge of the screen to a certain distance d2, and an area extending from the bottom edge of the screen to a certain distance d4.

[0237] The source device 300 can detect whether the position of the pointer according to the input data is positioned in a predetermined area for a predetermined period of time. The predetermined period of time can be determined in various ways, for example, 1 second. The predetermined period of time for which the pointer must remain in the predetermined area for detection can be set by the user using the input window 1080 in the screen control setting screen as described in FIG. 10. Although not illustrated in FIG. 10, depending on the implementation, information regarding the predetermined area can also be set by the user in the screen control setting screen of FIG. 10.

[0238] If the source device 300 does not detect that the position of the pointer according to the input data is located in a predetermined area for a predetermined period of time, the source device 300 may proceed to operation 1107.

[0239] In operation 1107, the source device 300 can obtain result screen data by controlling screen data based on input data. For example, if the screen data is movie content and the input data relates to a control for outputting subtitles, the source device 300 can obtain result screen data in which the subtitles are overlaid on the movie content. For example, if the screen data is game content and the input data relates to controlling the movement of a character in the game content, the source device 300 can obtain result screen data in which the character is moved based on the input data.

[0240] In operation 1108, the source device 300 transmits the acquired result screen data to the display device 100, and in operation 1113, the display device 100 can display the received result screen data.

[0241] In operation 1106, if the source device 300 detects that the position of the pointer according to the input data is located in a predetermined area for a predetermined time, the operation may proceed to operation 1109.

[0242] In operation 1109, the source device 300 may transmit a request to the display device 100 to transmit information for switching screen control. The information for switching screen control may refer to information about one or more sources to which screen control can be switched in order to perform the switching. The sources to which screen control can be switched may include not only the source device but also functions or applications that can be executed on the source device.

[0243] According to one embodiment, the source device 300 may use a different communication method to request information for switching screen control from the communication method that the source device 300 uses to transmit screen data to the display device 100. The communication method that the source device 300 uses to transmit screen data to the display device 100 may use an HDMI interface or the like, and such a method may not be efficient for two-way communication. Therefore, the source device 300 may register a display device in advance for communication according to a short-range communication method, as described above with reference to FIGS. 9 and 10. The source device 300 may transmit a request for information for switching screen control to the pre-registered display device using an AP.

[0244] In operation 1110, the display device 100 may receive a request for information for switching screen control from the source device 300, and in response, transmit information for switching screen control to the source device 300. The information for switching screen control may indicate information about one or more sources to which screen control can be switched. The information for switching screen control may include at least one of information about a source device to which screen control can be switched, information about a function or application that can be executed on the source device to which screen control can be switched, information about a function or application that can be executed on a source device having screen control, information indicating whether it is single view / multi view, and information indicating a multi view layout, as described in detail with reference to FIGS. 6 and 7.

[0245] In operation 1111, the source device 300 may receive information for switching screen control from the display device 100 and generate a graphical user interface that enables switching screen control based on the information. The source device 300 may generate a graphical user interface that includes items corresponding to each source by referring to information about one or more sources to which screen control can be switched, which is included in the information for switching screen control received from the display device 100. For example, if the information for switching screen control includes information about four sources, the graphical user interface generated based thereon may include items corresponding to each of the four sources. For example, if the information for switching screen control includes information indicating that it is a multiview, the graphical user interface generated based thereon may further include information indicating which subview screen among a plurality of subview screens constituting the multiview each source corresponds to.

[0246] At operation 1112, the source device 300 may transmit screen data including the generated graphical user interface to the display device 100.

[0247] In operation 1113, the display device 100 may display screen data including the received graphical user interface screen on the display. Then, the display device may proceed to the next operation ⓐ.

[0248] Figure 13 shows an example of the operating method illustrated in Figure 11.

[0249] Referring to FIG. 13, the display device 100 can be connected to the source device 300 via an HDMI interface or the like, and can receive screen data 1310 provided from the source device 300 and display it on the display. If a user wants to switch screen control, for example, if he wants to switch the screen currently displayed on the display device 100 to the screen of the display device itself rather than the screen data provided from the source device 300, the user can position the input device 200 at the edge of the display screen to use the screen control switching function. According to this operation, the input device 200 can transmit input data corresponding to the user's operation to the display device 100, and the display device 100 can transmit the received input data 1320 to the source device 300 that currently has screen control using USB communication or the like.

[0250] The source device 300 can detect that the pointer 1370 is positioned at the edge of the display screen by receiving input data 1320 and verifying the input data. Based on this detection, the source device 300 can transmit an information request 1330 for switching screen control to the display device 100 using short-range communication technology or the like.

[0251] In response to receiving a request for information 1330 for switching screen control from the source device 300, the display device 100 may transmit information 1340 for switching screen control to the source device 300. The information 1340 for switching screen control may include, for example, information 1341 indicating a display device home screen and information 1342 indicating a screen control settings screen.

[0252] The source device 300 can generate a graphical user interface that enables switching of screen control based on information for switching of screen control received from the display device 100. For example, the source device 300 can obtain an item 1351 representing a display device home screen based on information 1341 representing a display device home screen included in information 1340 for switching of screen control, and an item 1352 representing a screen control setting screen based on information 1342 representing a screen control setting screen, and generate a graphical user interface 1350 including the obtained item 1351 and item 1352.

[0253] The source device 300 can transmit screen data 1360, which includes a graphical user interface 1350 that enables screen control switching, to the display device 100.

[0254] The display device 100 can then display screen data 1360 including a graphical user interface 1350 that enables switching of screen control.

[0255] Figure 14 shows an example of the operating method illustrated in Figure 11.

[0256] Referring to FIG. 14, the display device 100 can receive screen data from a plurality of source devices by connecting them to HDMI interfaces or the like and display multi-views. For example, the multi-view screen 1410 includes a plurality of sub-view screens, and a first sub-view screen displays screen data (e.g., PC1 screen) provided from a first source device 301, a second sub-view screen displays screen data (e.g., PC2 screen) provided from a second source device 302, a third sub-view screen displays screen data (e.g., PC3 screen) provided from a third source device 303, and a fourth sub-view screen can display a screen corresponding to a YouTube application running on the display device (e.g., YouTube screen). In addition, the current screen control right indicates that a cursor 1420 corresponding to the first source device is displayed on the first sub-view screen in the first source device 301.

[0257] If a user wishes to switch screen control, the user may position the input device 200 at the edge of the first sub-view screen to utilize the screen control switching function. Following this action, the input device 200 may transmit input data corresponding to the user's operation to the display device 100, and the display device 100 may transmit the received input data 1430 to the first source device 301, which currently has screen control, using USB communication or the like.

[0258] The first source device 301 can detect that the pointer 1420 is positioned at the edge of the display screen, i.e., the first sub-view screen, by receiving input data 1430 and verifying the input data. Based on this detection, the first source device 301 can transmit an information request 1440 for switching screen control to the display device 100 using short-range communication technology or the like.

[0259] In response to receiving a request for information 1440 for switching screen control from the first source device 301, the display device 100 may transmit information 1450 for switching screen control to the first source device 301. The information 1450 for switching screen control may include, for example, information indicating a screen control setting screen, information indicating a second source device, information indicating a third source device, information indicating a YouTube screen running on the display device, information indicating a current screen of the display device, and information indicating a home screen of the display device.

[0260] The first source device 301 can generate a graphical user interface 1460 that enables switching of screen control based on information for switching of screen control received from the display device 100. For example, the first source device 301 can obtain an item 1461 representing a screen control setting screen based on information representing a screen control setting screen included in the information 1460 for switching of screen control, an item 1462 representing a second source device (e.g., PC 2) based on information representing a second source device, an item 1463 representing a third source device (e.g., PC 3) based on information representing a third source device, an item 1464 representing a YouTube application based on information representing a YouTube screen running on the display device, an item 1465 representing a current screen based on information representing a current screen of the display device, and an item 1466 representing a home screen based on information representing a home screen of the display device, and generate a graphical user interface 1460 including the obtained items 1461 to 1466.

[0261] The first source device 301 can transmit screen data 1470 including a graphical user interface 1460 enabling screen control switching to the display device 100.

[0262] The display device 100 can then display screen data 1470, including a graphical user interface 1460 that enables screen control switching, on the first sub-view screen.

[0263] Now, referring to FIGS. 15 and 16, a method of operation when selecting an item on a graphical user interface that enables switching of screen control will be described.

[0264] FIG. 15 is a flowchart illustrating an example of a method of operation when selecting an item on a graphical user interface that enables switching of screen control according to one embodiment.

[0265] Referring to FIG. 15, in operation 1501, the input device 200 may receive an input for selecting one item from a user. In a state where the display device 100 displays screen data including a graphical user interface that enables switching of screen control, the user may perform an operation for selecting one item from among one or more items included in the graphical user interface that enables switching of screen control, and in response thereto, the input device 200 may receive an input for selecting one item.

[0266] At operation 1502, the input device 200 may transmit input data for selecting one item to the display device 100.

[0267] At operation 1503, the display device 100 may transmit input data for selecting one item received from the input device 200 to the source device 300 having current screen control.

[0268] In operation 1504, the source device 300 can identify a source to switch screen control based on input data received from the display device 100. The source device 300 can identify an item selected by the user based on input data for selecting one item received from the display device 100, and determine a source corresponding to the identified item as the source to switch screen control.

[0269] At operation 1505, the source device 300 may determine whether the identified source relates to an application running on the source device 300. For example, a graphical user interface that enables screen control switching may include an item representing a screen control settings screen running on the source device, and the source device 300 may determine that the identified source relates to the source device itself if the item representing the screen control settings screen is selected as the source.

[0270] If it is determined as a result of the judgment in operation 1505 that the identified source is related to the source device itself, the process may proceed to operation 1506, and if it is determined that the identified source is not related to the source device, the process may proceed to operation 1507.

[0271] In operation 1506, the source device 300 may execute an application of the source device corresponding to the selected item. This operation is not strictly a switching of the source device, but rather the source device is maintained while executing a specific application on the source device. For example, if the application of the source device corresponding to the selected item displays a screen control setting screen of the source device for user convenience, the source device 300 may execute an application for outputting the screen control setting screen, thereby obtaining the screen control setting screen and transmitting it to the display device 100.

[0272] If the identified source is determined to be not related to the source device as a result of the judgment in operation 1505, the process can proceed to operation 1507.

[0273] At operation 1507, the source device 300 may transmit information about the source to which the identified screen control is to be switched to the display device 100 using short-range communication technology.

[0274] In operation 1508, the display device 100 receives information about a source to which screen control is to be switched from the source device 300, and, based on the received information, determines whether the source to which screen control is to be switched is a source related to the display device. The source related to the display device may include at least one of the most recent screen of the display device, the home screen of the display device, or a function or application executable on the display device.

[0275] If, as a result of the judgment of Action 1508, it is determined that the determined source is related to the display device, you can proceed to ⓑ.

[0276] If, as a result of the judgment in operation 1508, it is determined that the determined source is not related to the display device, that is, if it is determined that the determined source is related to a source device other than the display device, the process may proceed to operation 1509.

[0277] At operation 1509, the display device 100 can determine whether the display screen is a multi-view. If the display screen is determined to be a multi-view, the process proceeds to operation 1512. If the display screen is determined not to be a multi-view, the process proceeds to operation 1510.

[0278] In operation 1510, if the display device 100 determines that the display screen is not a multi-view, i.e., a single-view, it can determine the source device to which screen control is to be switched based on information about the source to which screen control is to be switched.

[0279] In operation 1511, the display device 100 may request screen data from the identified source device 301. Here, the screen data request may include at least one of current screen data of the source device 301, home screen data of the source device 301, and application execution screen data of the source device 301, based on information about the source to which screen control is to be switched.

[0280] At operation 1512, display device 100 may receive requested screen data from another source device 301.

[0281] In operation 1513, the display device 100 may display screen data received from another source device 301. The screen data received from the other source device 301 may include a cursor corresponding to the other source device 301.

[0282] In operation 1509, if the display screen is determined to be multi-view, the process can proceed to operation 1514.

[0283] At action 1514, display device 100 can identify the selected source device.

[0284] In operation 1515, the display device 100 may display a cursor corresponding to the selected source device on the sub-view screen corresponding to the selected source device. In this way, the cursor displayed on the sub-view screen corresponding to the source device 300 may disappear and the cursor may be displayed on the sub-view screen corresponding to another source device 301, thereby indicating that screen control has been switched.

[0285] FIG. 16 is a flowchart illustrating an example of a method of operation when selecting an item on a graphical user interface that enables switching of screen control according to one embodiment.

[0286] In operation 1508 of FIG. 15, if the display device 100 determines that the source identified based on the input data is related to the display device, the display device 100 may proceed to operation 1601 of FIG. 16.

[0287] In operation 1601, the display device 100 can determine whether the current display screen of the display device is a multi-view. If the determination result is a multi-view, the process proceeds to operation 1602, and if the determination result is a single-view, the process proceeds to operation 1603.

[0288] In operation 1602, the display device 100 can maintain the display of the current multi-view screen of the display device. While the display screen is in multi-view mode, switching the screen control may mean moving a cursor capable of controlling screen data to a sub-view screen corresponding to the source to which the screen control is to be switched while maintaining the multi-view screen.

[0289] When the display screen is in a multi-view state, switching the screen control means moving the cursor that can control the screen data to the sub-view screen corresponding to the source to which the screen control is to be switched while maintaining the multi-view screen, so that the display device 100 can maintain the display of the current multi-view screen of the display device.

[0290] Action 1603 may be performed if the source selected by the input data is related to a display device and is a single view.

[0291] In operation 1603, the display device 100 may convert and display screen data based on a source related to the display device. The source related to the display device may include at least one of the current screen of the display device, the home screen of the display device, or an application that can be executed on the display device. Accordingly, the display device 100 may display the most recent screen of the display device, the home screen of the display device, or execute an application of the display device and display the execution screen, based on the source related to the display device identified based on the input data.

[0292] In operation 1604, the display device 100 can display a cursor corresponding to the source device displayed on the display screen by converting the cursor to a cursor corresponding to the display device, since the screen control has been switched from the source device to the display device.

[0293] In operation 1605, input device 200 can receive user input while screen control is transferred to the display device.

[0294] At operation 1606, the input device 200 may transmit input data corresponding to the user input to the display device 100.

[0295] In operation 1607, the display device 100 can control screen data displayed on the display based on input data received from the input device 200.

[0296] Figure 17 shows an example of the operating method described with reference to Figures 15 and 16.

[0297] Referring to FIG. 17, the display device 100 can display screen data 1360 including a graphical user interface 1350 that enables switching of screen control upon a user's request while connected to the source device 300 as described in FIG. 13.

[0298] For such screen data 1360, the user can select an item 1351 representing a home screen using the input device 200, and accordingly, the input device 200 can transmit input data indicating selection of the item 1351 representing the home screen to the display device 100. Accordingly, the display device 100 can transmit input data 1710 indicating selection of the home screen to the source device 300 having the current screen control. Then, the source device 300 can check the input data 1710 received from the display device 100, determine whether the source selected according to the input data is related to the source device 300 itself, and if so, output a screen corresponding to the corresponding source itself. If the source selected according to the input data is not related to the source device 300, the source device 300 can transmit information about the source selected according to the input data to the display device 100 using short-range communication technology. In the example illustrated in FIG. 16, the input data 1710 received by the source device 300 indicates a home screen selection, so it can be confirmed that the source is related to the display device 100. Accordingly, the source device 300 can transmit a signal 1720 indicating that a source representing the home screen has been selected to the display device 100 using short-range communication technology.

[0299] The display device 100 receives a signal 1720 indicating that a source representing a home screen has been selected from the source device 300, and can switch the source displayed on the display of the display device 100 to the home screen of the display device. That is, the display device 100 can display the home screen 1730 of the display device on the display without displaying any more screen data from the source device 300. In addition, since the source of the display device 100 is provided by the display device itself, the pointer displayed on the display can be converted into a display device pointer 1740 for controlling the home screen and displayed.

[0300] Figure 18 shows an example of the operating method described with reference to Figures 14 and 15.

[0301] Referring to FIG. 18, the display device 100 can display screen data 1360 including a graphical user interface 1350 that enables switching of screen control upon a user's request while connected to the source device 300 as described in FIG. 13.

[0302] For such screen data 1360, the user can select item 1352 representing a screen control setting screen using the input device 200, and accordingly, the input device 200 can transmit input data indicating selection of item 1352 representing the screen control setting screen to the display device 100. Accordingly, the display device 100 can transmit input data 1810 indicating selection of the screen control setting screen to the source device 300 that currently has screen control. Then, the source device 300 can check the input data 1810 received from the display device 100, determine whether the source selected according to the input data is related to the source device 300 itself, and if it is related to the source device 300 itself, output a screen corresponding to the corresponding source itself. If the source selected according to the input data is not related to the source device 300 itself, the source device 300 can transmit information about the source selected according to the input data to the display device 100 using short-range communication technology. In the example illustrated in FIG. 18, the input data 1810 received by the source device 300 indicates selection of a screen control setting screen, so it can be confirmed that the source is related to the source device 300. Accordingly, the source device 300 can execute an application related to screen control setting and obtain the screen control setting screen 1820.

[0303] The source device 300 can transmit screen data 1730 including the acquired screen setting control screen 1820 to the display device 100.

[0304] The display device 100 can display screen data 1830 including a screen setting control screen received from the source device 300.

[0305] Figure 19 shows an example of the operating method described with reference to Figures 15 and 16.

[0306] Referring to FIG. 19, the display device 100 can display screen data 1470 including a graphical user interface 1460 that enables screen control switching at the user's request while connected to the first source device 301 as described in FIG. 14.

[0307] For such screen data 1470, the user can select an item 1462 representing a second source using the input device 200, and accordingly, the input device 200 can transmit input data indicating selection of the item 1462 representing the second source to the display device 100. Accordingly, the display device 100 can transmit input data 1910 indicating selection of the second source to the first source device 301 having the current screen control authority. Then, the first source device 301 can check the input data 1910 received from the display device 100, determine whether the source selected according to the input data is related to the source device 301 itself, and if it is related to the source device 301 itself, output a screen corresponding to the corresponding source itself. If the source selected according to the input data is not related to the first source device 301, the first source device 301 can transmit information about the source selected according to the input data to the display device 100 using short-range communication technology. In the example illustrated in FIG. 19, it can be confirmed that the input data 1910 received by the source device 300 is not related to the source device 301. Therefore, the first source device 301 can transmit a signal 1920 indicating the selection of the second source to the display device 100.

[0308] The display device 100 may receive a signal 1920 indicating a second source selection and display a pointer corresponding to the second source device 302 on the second source screen so that the second source device may have screen control. Thereafter, the display device 100 may transmit input data received from the input device 100 to the second source device 302.

[0309] Figure 20 shows an example of the operating method described with reference to Figures 15 and 16.

[0310] Referring to FIG. 20, the display device 100 can display screen data 1470 including a graphical user interface 1460 that enables screen control switching at the user's request while connected to the first source device 301 as described in FIG. 14.

[0311] For such screen data 1470, the user can select item 1465 representing the current screen using the input device 200, and accordingly, the input device 200 can transmit input data 2010 indicating selection of item 1465 representing the current screen to the display device 100. Accordingly, the display device 100 can transmit input data 2010 indicating selection of the current screen to the first source device 301 having control of the current screen. Then, the first source device 301 can check the input data 2010 received from the display device 100, determine whether the source selected according to the input data is related to the source device 301 itself, and if it is related to the source device 301 itself, output a screen corresponding to the corresponding source itself. If the source selected according to the input data is not related to the first source device 301 itself, the first source device 301 can transmit information about the source selected according to the input data to the display device 100 using short-range communication technology. In the example illustrated in FIG. 20, it can be confirmed that the input data 2010 received by the source device 300 is not related to the source device 301. Therefore, the first source device 301 can transmit a signal 2020 indicating the current screen selection to the display device 100.

[0312] The display device 100 may receive a signal 2020 indicating a current screen selection and determine that the screen control right is on the current screen of the display device. The current screen of the display device 100 indicates a screen in which the current multi-view is displayed. Therefore, the display device 100 may maintain the current multi-view display and display the pointer 2030 used in the display device 100. In the current screen state of the display device 100, i.e., the multi-view state, the user may select each sub-view screen constituting the multi-view screen by manipulating the pointer 2030, or may control the appearance of a predetermined menu window by pressing a specific button of the input device 300.

[0313] Figure 21 shows an example of the operating method described with reference to Figures 15 and 16.

[0314] Referring to FIG. 21, the display device 100 can display screen data 1470 including a graphical user interface 1460 that enables screen control switching at the user's request while connected to the first source device 301 as described in FIG. 14.

[0315] For such screen data 1470, the user can select item 1465 representing the current screen using the input device 200, and accordingly, the input device 200 can transmit input data 2110 indicating selection of item 1465 representing the home screen to the display device 100. Accordingly, the display device 100 can transmit input data 2110 indicating selection of the home screen to the first source device 301 having the current screen control authority. Then, the first source device 301 can check the input data 2110 received from the display device 100, determine whether the source selected according to the input data is related to the source device 301 itself, and if it is related to the source device 301 itself, output a screen corresponding to the corresponding source itself. If the source selected according to the input data is not related to the first source device 301 itself, the first source device 301 can transmit information about the source selected according to the input data to the display device 100 using short-range communication technology. In the example illustrated in FIG. 21, it can be confirmed that the input data 2110 received by the source device 300 is not related to the source device 301. Accordingly, the first source device 301 can transmit a signal 2120 indicating a home screen selection to the display device 100.

[0316] The display device 100 may receive a signal 2120 indicating a home screen selection and determine that the screen control is on the home screen of the display device. Accordingly, the display device 100 may display the home screen in the fourth sub-view, which displays the YouTube application execution screen currently running on the display device 100. In addition, the display device 100 may display a cursor 2130 corresponding to the display device 100 on the home screen displayed in the fourth sub-view.

[0317] Some embodiments may also be implemented in the form of a recording medium containing computer-executable instructions, such as program modules, executed by a computer. Computer-readable media may be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Computer-readable media may also include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer-readable instructions, data structures, program modules, or other data.

[0318] The disclosed embodiments can be implemented as a S / W program including commands stored in a computer-readable storage media.

[0319] A computer may include an electronic device according to the disclosed embodiments, as a device capable of calling a command stored from a storage medium and performing an operation according to the called command according to the disclosed embodiments.

[0320] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, "non-transitory" simply means that the storage medium does not contain signals and is tangible, but does not distinguish between whether data is stored semi-permanently or temporarily on the storage medium.

[0321] Additionally, the control method according to the disclosed embodiments may be provided as a computer program product. The computer program product may be traded as a product between a seller and a buyer.

[0322] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, the computer program product may include a product in the form of a software program (e.g., a downloadable app) distributed electronically by a device manufacturer or through an electronic marketplace (e.g., Google Play Store, App Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a storage medium of a manufacturer's server, an electronic marketplace server, or a relay server that temporarily stores the software program.

[0323] In a system comprising a server and a device, the computer program product may include a storage medium of the server or a storage medium of the device. Alternatively, if a third device (e.g., a smartphone) exists that is communicatively connected to the server or device, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include a software program itself that is transmitted from the server to the device or the third device, or from the third device to the device.

[0324] In this case, one of the server, the device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, the device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments in a distributed manner.

[0325] For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) may execute a computer program product stored on the server to control a device in communication with the server to perform a method according to the disclosed embodiments.

[0326] As another example, a third device may execute a computer program product to control a device in communication with the third device to perform a method according to the disclosed embodiments. When the third device executes the computer program product, the third device may download the computer program product from a server and execute the downloaded computer program product. Alternatively, the third device may execute a computer program product provided in a preloaded state to perform the method according to the disclosed embodiments.

[0327] Additionally, in this specification, a “part” may be a hardware component such as a processor or circuit, and / or a software component executed by a hardware component such as a processor.

[0328] The above description of the present disclosure is provided for illustrative purposes only, and those skilled in the art will readily appreciate that modifications to other specific forms can be made without altering the technical spirit or essential features of the present disclosure. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, components described as being single may be implemented in a distributed manner, and similarly, components described as being distributed may be implemented in a combined manner.

[0329] The scope of the present disclosure is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present disclosure.

Claims

1. In the display device 100, display, Communication interface 110, Memory 130 storing one or more instructions, and At least one processor 140 for executing one or more instructions stored in the memory, The at least one processor 150 executes the one or more instructions, Controlling the display to receive and display screen data from a source device providing screen data among one or more electronic devices connected via wired or wireless communication, Transmits input data received from an input device connected via wired or wireless communication to a source device having screen control rights indicating authority to control the screen data among one or more source devices, When the source device having the screen control right receives a request related to the screen control right from the source device having the screen control right in response to the pointer displayed by the source device having the screen control right being located in a predetermined area of ​​the display screen corresponding to the screen data, the communication interface is controlled to transmit information for switching the screen control right to the source device having the screen control right. Controlling the communication interface to receive a graphical user interface screen that enables switching of the screen control rights, generated based on information for switching the screen control rights, from a source device having the screen control rights; A display device that controls the display to display the received graphical user interface screen.

2. In paragraph 1, Information for switching the above screen control includes information about one or more sources to which the above screen control can be switched, Information about one or more sources from which the above screen control can be switched, Information representing a screen that can be provided from one or more source devices to which the above screen control can be switched; Information indicating an application that can be run on one or more source devices to which the above screen control can be switched; Information indicating an application that can be run on a source device that has control over the above screen; Information indicating a screen that can be provided on the above display device, and A display device comprising at least one piece of information representing an application that can be executed on said display device.

3. In paragraph 1 or 2, A display device, wherein the screens that can be provided from one or more source devices to which the screen control can be switched include a home screen or a most recent screen that can be provided from one or more source devices to which the screen control can be switched.

4. In any one of paragraphs 1 to 3, Information for switching the above screen control rights is: A display device further comprising information indicating whether the screen provided on the display is a single view or a multi-view.

5. In any one of paragraphs 1 to 4, A graphical user interface screen that enables switching of said screen control includes one or more items, each corresponding to one or more sources to which said screen control can be switched; The at least one processor 150 executes the one or more instructions, Receiving an input from the input device for selecting one of the one or more items; A display device that transmits input data based on an input for selecting one of the above items to the source device.

6. In any one of paragraphs 1 to 5, The at least one processor 150 executes the one or more instructions, A display device that receives and displays an execution screen of an application of the source device corresponding to the selected item from the source device upon confirming that the source to which the screen control is to be switched is related to the source device based on the input data.

7. In any one of paragraphs 1 to 6, A display device, wherein the application of the source device includes an application for setting screen control rights.

8. In any one of paragraphs 1 to 7, The at least one processor 150 executes the one or more instructions, Receive information about the source to which the screen control is to be switched based on the input data from the source device, Check if the source to which the above screen control is to be switched is related to the display device, Upon confirming that the source to which the above screen control is to be switched is related to the above display device, it is determined whether the screen provided by the above display is a multi-view, A display device that maintains the current multi-view screen of the display device based on the above screen being a multi-view screen, and converts the pointer of the source device into the pointer of the display device and displays it.

9. In any one of paragraphs 1 to 8, The at least one processor 150 executes the one or more instructions, Receive information about the source to which the screen control is to be switched based on the input data from the source device, Check if the source to which the above screen control is to be switched is related to the display device, Upon confirming that the source to which the above screen control is to be switched is related to the above display device, it is determined whether the screen provided by the above display is a multi-view, A display device that displays one of the most recent screen that can be provided by the display device, a home screen that can be provided by the display device, or a screen that executes an application of the display device, in response to information about a source to which the screen control is to be switched, based on the above screen being a single-view screen.

10. In any one of paragraphs 1 to 9, A display device, wherein the display device is discovered based on the short-range communication and is pre-registered in the source device for transmitting and receiving information for the screen control by a specific program running on the source device.

11. A method for operating a display device 100, An operation of receiving and displaying screen data from a source device providing screen data among one or more source devices connected via wired or wireless communication; An operation of transmitting input data received from an input device connected via wired or wireless communication to a source device having screen control rights indicating authority to control the screen data among one or more source devices; An operation of transmitting information for switching the screen control to the source device having the screen control right in response to receiving a request related to the screen control right from the source device having the screen control right in response to the pointer displayed by the source device having the screen control right using the input data to control the display position being located in a predetermined area of ​​the display screen corresponding to the screen data, An operation of receiving a graphical user interface screen that enables switching of the screen control rights, generated based on information for switching the screen control rights, from a source device having the screen control rights, and A method comprising the action of displaying the received graphical user interface screen.

12. In paragraph 11, Information for switching the above screen control includes information about one or more sources to which the above screen control can be switched, Information about one or more sources from which the above screen control can be switched, Information representing a screen that can be provided from one or more source devices to which the above screen control can be switched; Information indicating an application that can be run on one or more source devices to which the above screen control can be switched; Information indicating an application that can be run on a source device that has control over the above screen; Information indicating a screen that can be provided on the above display device, and A method comprising at least one piece of information representing an application that can be executed on the display device.

13. In paragraph 11 or 12, A method wherein the screens that can be provided from one or more source devices to which the screen control can be switched include a home screen or a most recent screen that can be provided from one or more source devices to which the screen control can be switched.

14. In any one of paragraphs 11 to 13, Information for switching the above screen control rights is: A method further comprising information indicating whether the screen provided on the display is a single view or a multi-view.

15. A non-transitory computer-readable recording medium having recorded thereon one or more instructions executed by a processor of a display device, wherein the one or more instructions are executed by the processor of the display device, and the display device, Receives and displays screen data from a source device providing screen data among one or more electronic devices connected via wired or wireless communication, Transmits input data received from an input device connected via wired or wireless communication to a source device having screen control rights indicating authority to control the screen data among one or more source devices, When the source device having the screen control right receives a request related to the screen control right from the source device having the screen control right in response to the pointer displayed by the source device having the screen control right being located in a predetermined area of ​​the display screen corresponding to the screen data to control the display position using the input data, information for switching the screen control right is transmitted to the source device having the screen control right, Receiving a graphical user interface screen that enables switching of the screen control rights, generated based on information for switching the screen control rights, from a source device having the screen control rights, A non-transitory computer-readable recording medium displaying the received graphical user interface screen.

Images