Display device and operating method thereof

Abstract

According to an embodiment, a display device and an operating method of the display device are disclosed. The disclosed display apparatus receives first execution result content obtained by executing a content application based on an input signal from a controller from a server apparatus through a communication interface, the controller being connected to the server apparatus so as to provide the input signal; controlling the display such that the first execution result content is displayed; receiving a first input signal from the controller from the server device through the communication interface, the first input signal being sent by the controller to the server device and indicating a specified value; in response to receiving the first input signal indicating the specified value, displaying a user interface screen to control the display device; a second input signal is received from the controller while the user interface screen is displayed, and an operation of the display device is controlled based on the second input signal.

Description

Technical Field

[0001] The present disclosure relates to a display device and a method of operating the display device, and more particularly, to a display device and an operating method thereof using a server device and a controller. Background Art

[0002] Recently, the number of game users has increased, and the demand for enjoying game contents via a large-screen television (TV) for immersive gaming has increased.

[0003] Cloud gaming refers to a gaming service in which main computations such as graphics processing for a game are performed in a cloud server device, operation input from a user is sent from a user device such as a smartphone or a smart TV to a server device, and the user device receives and displays a rendered game screen via Internet Protocol (IP) streaming. Summary of the invention

[0004] Solution to the problem

[0005] According to one aspect of the present disclosure, a display device includes: a communication interface; a display; a memory storing at least one instruction; and at least one processor configured to execute the at least one instruction.

[0006] The at least one processor may also be configured to execute the at least one instruction to: receive, from a server device through the communication interface, first execution result content obtained by executing a content application based on an input signal from a controller, the controller being connected to the server device and configured to provide the input signal to the server device.

[0007] The at least one processor may also be configured to execute the at least one instruction to: control the display to display the first execution result content.

[0008] The at least one processor may also be configured to execute at least one instruction to: based on the controller providing the input signal indicating the designated value to the server device, receive a first input signal indicating the designated value from the server device through the communication interface.

[0009] The at least one processor may also be configured to execute at least one instruction to: display a user interface screen through the display to control the display device based on the first input signal indicating a designated value.

[0010] The at least one processor may also be configured to execute at least one instruction to: receive a second input signal from the controller through the communication interface while the display is displaying the user interface screen, and control the operation of the display device based on the second input signal.

[0011] The at least one processor may also be configured to execute at least one instruction to: receive a second input signal from the controller via the server device through the communication interface, or directly receive the second input signal from the controller through the communication interface.

[0012] The at least one processor may also be configured to execute at least one instruction to: control the display to end display of the user interface screen based on a second input signal indicating end display of the user interface screen; and control the communication interface to send a signal to the server device indicating that the display device is in content reproduction control mode based on the display ending display of the user interface screen.

[0013] The at least one processor may also be configured to execute the at least one instruction to receive, from the server device through the communication interface, second execution result content obtained by executing the content application according to a third input signal from the controller, the third input signal being received after sending a signal indicating that the display device is in the content reproduction control mode.

[0014] The at least one processor may also be configured to execute at least one instruction to: identify whether the type of the content application is a specified type, and based on the type of the content application being the specified type, control the communication interface to send a list including at least one input signal indicating a specified value to the server device.

[0015] The at least one processor may also be configured to execute at least one instruction to: identify whether the type of the content application is a specified type, and based on the type of the content application being the specified type, control the communication interface to send information to the controller allowing the controller to directly connect to the server device and send a command to the server device.

[0016] According to an aspect of the present disclosure, a server device includes: a communication interface; a memory storing at least one instruction; and at least one processor configured to execute the at least one instruction.

[0017] The at least one processor may also be configured to execute at least one instruction to: control the communication interface to send first execution result content obtained by executing the content application to the display device.

[0018] The at least one processor may also be configured to execute the at least one instruction to: receive a first input signal from a controller through the communication interface.

[0019] The at least one processor may be further configured to execute at least one instruction to: based on identifying that the first input signal indicates the specified value, identify whether the first input signal indicates the specified value.

[0020] The at least one processor may also be configured to execute at least one instruction to: control the communication interface to send a first input signal to the display device to allow the display device to output a user interface screen.

[0021] The at least one processor may be further configured to execute at least one instruction to: based on recognizing that the first input signal does not indicate a specified value, control the communication interface to transmit second execution result content obtained by executing the content application according to the first input signal to the display device.

[0022] The at least one processor may be further configured to execute at least one instruction to control the communication interface to transmit a second input signal received from the controller to the display device based on recognizing that the display device is in a menu mode of outputting a user interface screen.

[0023] The at least one processor may also be configured to execute at least one instruction to: while the display device is in the menu mode, receive a signal from the display device through the communication interface indicating that the display device is in the content reproduction control mode, identify that the display device is in the content reproduction control mode based on the signal indicating that the display device is in the content reproduction control mode, and based on identifying that the display device is in the content reproduction control mode, send third execution result content to the display device through the communication interface, the third execution result content being obtained by executing the content application based on the second input signal from the controller.

[0024] The at least one processor may also be configured to execute at least one instruction to: receive a list including at least one input signal indicating a designated value from the display device through the communication interface, and store the list.

[0025] According to one aspect of the present disclosure, a method for operating a display device includes: receiving from a server device first execution result content obtained by executing a content application based on an input signal from a controller, the controller being connected to the server device and configured to provide an input signal to the server device; displaying the first execution result content on a display of the display device; receiving from the server device the first input signal indicating a specified value based on the controller providing the server device with the first input signal indicating the specified value; displaying a user interface screen to control the display device based on receiving the first input signal indicating the specified value; receiving a second input signal from the controller while the display device is displaying the user interface screen; and controlling the operation of the display device based on the second input signal.

[0026] According to one aspect of the present disclosure, a method for operating a server device includes: sending first execution result content obtained by executing a content application to a display device; receiving a first input signal from a controller; identifying whether the first input signal indicates a specified value; based on identifying that the first input signal indicates the specified value, sending the first input signal to the display device to allow the display device to output a user interface screen; and based on identifying that the first input signal does not indicate the specified value, sending second execution result content obtained by executing the content application to the display device according to the first input signal.

[0027] According to one aspect of the present disclosure, a non-transitory computer-readable medium stores computer-readable program code or instructions that can be executed by at least one processor to perform a method for operating a display device, the method comprising: receiving from a server device a first execution result content obtained by executing a content application based on an input signal from a controller, wherein the controller is connected to the server device and is configured to provide an input signal to the server device; displaying the first execution result content; receiving from the server device a first input signal indicating a specified value from the controller; based on receiving the first input signal indicating the specified value, displaying a user interface screen to control the display device; receiving a second input signal from the controller while the display device is displaying the user interface screen; and controlling the operation of the display device based on the second input signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent through the following description in conjunction with the accompanying drawings, in which:

[0029] FIG1 illustrates operations of a server device and a display device according to an embodiment;

[0030] FIG2 shows a system including a display device, a controller, and a server device according to an embodiment;

[0031] FIG3 shows a block diagram of a display device according to an embodiment;

[0032] FIG4 shows a flow chart of an operating method of a display device according to an embodiment;

[0033] 5 shows a conversion table of a controller input signal to a display device control signal according to an embodiment;

[0034] FIG6 illustrates a flow chart of an operation method of a server device according to an embodiment;

[0035] FIG7 illustrates the operation of the display device in the content reproduction control mode according to the embodiment;

[0036] FIG8 illustrates the operation of the display device in the menu mode according to the embodiment;

[0037] 9 illustrates an operation of connecting a server device to a controller by a display device according to an embodiment;

[0038] 10 illustrates an operation of a display device receiving an input signal of a controller via a server device in a menu mode according to an embodiment;

[0039] 11 illustrates an operation of a display device according to an embodiment receiving a controller input signal directly from a controller in a menu mode;

[0040] 12 is a flowchart illustrating an operation method of a controller, a server device, and a display device for connecting a controller to a server device according to execution of content according to an embodiment;

[0041] 13 is a flowchart showing an operation method of a controller, a server device, and a display device according to an embodiment;

[0042] 14 is a flowchart showing an operation method of a controller, a server device, and a display device according to an embodiment;

[0043] 15 is a flowchart showing an operation method of a controller, a server device, and a display device according to an embodiment;

[0044] 16 is a flowchart showing an operation method of a controller, a server device, and a display device according to an embodiment;

[0045] FIG. 17 is a flowchart showing an operation method of a controller, a server device, and a display device according to an embodiment; and

[0046] FIG. 18 is a flowchart illustrating an operation method of a controller, a server device, and a display device according to an embodiment. DETAILED DESCRIPTION

[0047] Terms used in the present disclosure will be briefly defined, and example embodiments of the present disclosure will be described in detail.

[0048] All terms used in this disclosure (including descriptive terms or technical terms) should be interpreted as having meanings that are obvious to those of ordinary skill in the art. However, terms may have different meanings depending on the intention of those of ordinary skill in the art, precedent situations, or the emergence of new technologies. In addition, the applicant may arbitrarily select some terms, and in this case, the meaning of the selected terms will be described in detail in the detailed description of the disclosure. Therefore, the terms used in this disclosure should not be interpreted solely based on their names, but must be defined based on the meaning of the terms and the description throughout the specification.

[0049] Throughout the specification, when a component "includes" or "comprises" an element, unless there is a specific description to the contrary, the component may further include other elements without excluding other elements. As used in the present disclosure, the term "unit" or "module" means an entity for performing at least one function or operation, and can be implemented as hardware, software, or a combination of hardware and software.

[0050] The embodiments of this article and its various features and advantageous details are explained more fully with reference to the non-limiting embodiments shown in the drawings and described in detail in the following description, wherein similar reference numerals always represent corresponding features. The description of known components and processing techniques is omitted so as not to unnecessarily obscure the embodiments of this article. In addition, the various embodiments described herein are not necessarily mutually exclusive, because some embodiments can be combined with one or more other embodiments to form new embodiments. The examples used herein are only intended to facilitate understanding of the manner in which the embodiments of this article can be practiced, and further enable those skilled in the art to practice the embodiments of this article. Therefore, the examples should not be interpreted as limiting the scope of the embodiments of this article.

[0051] As used herein, the term “user” refers to a person who controls a function or operation of a computing device or an electronic device by using a control device, and may include a viewer, a manager, or an installation engineer.

[0052] FIG. 1 illustrates operations of a server device and a display device according to an embodiment.

[0053] 1 , the server device 300 may execute a content application in response to a request from the display device 100, and may transmit a result screen according to the execution of the content application to the display device 100 via the communication network. For example, when the server device 300 receives an execution request of a game application from the display device 100, the server device 300 may execute the game application, and may transmit a result screen or a result image rendered according to the execution of the game application to the display device 100 via the communication network.

[0054] The display apparatus 100 may transmit an execution request for the content application to the server apparatus 300 , may receive a result screen 30 according to the execution of the content application from the server apparatus 300 in response to the execution request, and may display the received result screen 30 on its display.

[0055] The controller 200 may send an operation command for controlling the application execution result content displayed on the display device 100 to the server device 300 via the communication network or directly to the display device 100. Specifically, according to an embodiment, the controller 200 may communicate with the server device 300 by using an Internet network, thereby sending an operation command to the server device 300 according to a user operation input to the controller 200. The user may operate the controller 200 to control the displayed content while viewing the content displayed on the display device 100, and the controller 200 may send the operation command to the server device 300 according to the user operation. The server device 300 may execute the application according to the content operation command received from the controller 200, and may send the application execution result content to the display device 100. In this way, the operation command from the controller 200 is not transmitted to the server device 300 via the display device 100, but is directly sent to the server device 300, so that the control of the content can be further quickly performed.

[0056] In this way, in the case where the controller 200 is directly connected to the server device 300 and transmits an operation command, when a menu for controlling the display device 100 is executed in the display device 100, a problem may occur as to how to control the display device 100. For example, there may be a case where the user desires to control the display device 100 while the user is watching and controlling content by using the display device 100. For example, when the user wants to increase the volume of the display device 100 or adjust the brightness of the screen of the display device 100 while the user is playing game content via the display device 100, the display device 100 may operate in a menu mode to control the display device 100. Here, in an environment where the controller 200 operates to transmit an operation command to the server device 300 and the server device 300 operates to transmit an application execution result corresponding to the operation command to the display device 100, the display device 100 does not directly receive an input signal from the controller 200. Therefore, a scheme may be required by which the display device 100 can receive a control signal for controlling the display device 100 in the menu mode.

[0057] According to an embodiment, the display device 100 may notify the server device 300 of information about an input signal having a specified value among input signals being used by the controller 200, and the server device 300 may identify the input signal having the specified value from the input signal received from the controller 200, and may allow the display device 100 to operate in the menu mode based on the input signal. That is, when it is not an input signal having the specified value, the server device 300 may execute a content application based on the input signal from the controller 200, and may transmit the execution result content to the display device 100. On the other hand, when the server device 300 receives an input signal having the specified value from the controller 200, the server device 300 may transmit the received input signal to the display device 100 as is. Then, based on receiving the input signal having the specified value, the display device 100 may display a user interface screen 50 for controlling the display device 100 to operate in the menu mode on the display.

[0058] According to an embodiment, the display apparatus 100 may receive an input signal from the controller 200 via the server apparatus 300 while displaying the user interface screen 50 (menu mode) for controlling the display apparatus 100 , and may perform control of the display apparatus 100 based on the received input signal.

[0059] According to an embodiment, while displaying the user interface screen 50 (menu mode) for controlling the display device 100, the display device 100 may send a control command to the controller 200 indicating that an input signal is to be sent directly from the controller 200 to the display device 100, and may directly receive an input signal from the controller 200, thereby performing control of the display device 100.

[0060] According to an embodiment, when the display device 100 detects the end of the menu mode (i.e., the end of the user interface screen 50), the display device 100 may send information indicating the end of the menu mode to the server device 300, thereby controlling the server device 300 to execute the content application based on the input signal received from the controller 200, and send the execution result content.

[0061] According to an embodiment, when the display device 100 detects the end of the menu mode (i.e., the end of the user interface screen 50), the display device 100 may send information indicating the end of the menu mode to the controller 200, thereby controlling the controller 200 to send an input signal from the controller 200 to the server device 300.

[0062] FIG. 2 illustrates a system including a display device, a controller, and a server device according to an embodiment.

[0063] 2 , the system may include a display apparatus 100 , a controller 200 , and a server apparatus 300 .

[0064] The display device 100 is a device capable of displaying an image or data in response to a user request, and may include a communication interface 110 , a display 120 , a memory 130 , and a processor 140 .

[0065] The communication interface 110 may include at least one module for allowing wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network where other devices exist. The communication interface 110 according to an embodiment may perform communication with the controller 200 according to a short-range communication technology. The short-range communication technology may include Bluetooth communication, Wi-Fi communication, infrared communication, etc. The communication interface 110 according to an embodiment may perform communication with the server device 300 according to an Internet Protocol (IP).

[0066] The display 120 may output images or data processed by the display device 100 .

[0067] The memory 130 may store programs for processing and control by the processor 140, and may store data input to or output from the display apparatus 100. In addition, the memory 130 may store a plurality of pieces of data requested for the operation of the display apparatus 100.

[0068] The memory 130 may include at least one type of storage medium among a flash memory, a hard disk, a multimedia card micro, a memory card (e.g., a secure digital (SD) or an extreme digital (XD) memory card), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk.

[0069] The processor 140 controls all operations of the display apparatus 100. For example, according to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to perform a function of the display apparatus 100.

[0070] In an embodiment, the processor 140 may store at least one instruction in an internal memory, and may execute at least one instruction stored in the internal memory to control the operation of the display device to be performed. That is, the processor 140 may execute at least one instruction or program stored in the internal memory of the processor 140 or the memory 130 to perform a preset operation.

[0071] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to perform the operation of the display device 100 disclosed herein.

[0072] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to control the communication interface to receive execution result content obtained by executing the content application from the server based on an input signal from a controller connected to the server and configured to provide an input signal.

[0073] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to control the display to display the execution result content.

[0074] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to control the communication interface to receive an input signal indicating a designated value from the controller from the server.

[0075] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to display a user interface screen for controlling the display device based on receiving an input signal indicating the designated value.

[0076] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to receive an input signal from the controller, and perform an operation for controlling the display device based on the input signal while displaying a user interface screen.

[0077] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 while displaying the user interface screen to receive an input signal from the controller via the server, or control the communication interface to directly receive an input signal from the controller.

[0078] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to control the display to end the display of the user interface screen according to an input signal for ending the user interface screen while displaying the user interface screen.

[0079] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to control the communication interface to transmit a signal indicating that the display device operates in the content reproduction control mode to the server according to the end of the user interface screen.

[0080] According to an embodiment, the processor 140 can execute at least one instruction stored in the memory 130 to control the communication interface to receive execution result content obtained by executing the content application from the server based on an input signal received from the controller in response to sending a signal indicating that the display device operates in a content reproduction control mode.

[0081] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to identify whether the type of the content application is a designated type.

[0082] According to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to control the communication interface to send a list including at least one input signal indicating a designated value to the server based on the type of the content application being a designated type.

[0083] According to an embodiment, the processor 140 can execute at least one instruction stored in the memory 130 to identify whether the type of the content application is a specified type, and based on the type of the content application being the specified type, send to the controller information for allowing the controller to directly connect to the server and a command for controlling the connection with the server.

[0084] The display device 100 may be any device including a processor and a memory to perform functions. The display device 100 may be a fixed device or a mobile device. For example, the display device 100 may refer to a device having a display to display image content, video content, game content, graphic content, etc. The display device 100 may output or display an image or content received from the server device 300. The display device 100 may include various types of electronic devices, including a television (TV) that can receive and output content (such as a network TV, smart TV, Internet TV, network TV, or IPTV), a computer (such as a desktop computer, a laptop computer, or a tablet computer), and various smart devices (such as a smart phone, a cellular phone, a game console, a music player, a video player, a medical device, a home appliance, etc.). The display device 100 may be referred to as a display device because the display device 100 receives and displays content, and may also be referred to as a content receiving device, a synchronization device, an electronic device, a computing device, etc.

[0085] According to an embodiment, as shown in FIG. 2 , each element in the block diagram of the display device 100 may be integrated, added, or omitted according to the specifications of the display device 100 actually implemented. For example, two or more elements may be combined into a single component, or a single component may be divided into two or more components when necessary. The functions performed in each block are intended to describe the embodiments of the present disclosure, and specific operations or devices related to the functions do not limit the scope of the present disclosure.

[0086] Hereinafter, the controller 200 will now be described.

[0087] The controller 200 may include a communication interface 210, a user input unit 220, a memory 230, and a processor 240. However, the controller 200 may be embodied with more elements than those shown, and embodiments of the present disclosure are not limited thereto.

[0088] The communication interface 210 may include at least one module for allowing wireless communication between the controller 200 and a wireless communication system or between the controller 200 and a network where other devices exist. The communication interface 210 according to an embodiment may perform communication with the display device 100 according to a short-range communication technology. The short-range communication technology may include Bluetooth communication, Wi-Fi communication, infrared communication, etc. The communication interface 210 according to an embodiment may perform communication with the server device 300 according to an IP.

[0089] The user input unit 220 may be any form of interface component capable of receiving user input. For example, the user input unit 220 may include an operation button provided at a portion of the controller 200 to receive user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user speech utterance, etc.

[0090] The memory 230 may store programs for processing and control by the processor 240 , and may store data input to or output from the controller 200 .

[0091] The memory 230 may include at least one type of storage medium among a flash memory, a hard disk, a multimedia card micro, a memory card (eg, an SD or XD memory card), RAM, SRAM, ROM, EEPROM, PROM, a magnetic memory, a magnetic disk, and an optical disk.

[0092] The processor 240 controls all operations of the controller 200. For example, according to an embodiment, the processor 240 may execute at least one instruction stored in the memory 230 to perform the functions of the controller 200.

[0093] In an embodiment, the processor 240 may store at least one instruction in an internal memory, and may execute at least one instruction stored in the internal memory to control the operation of the display device to be performed. That is, the processor 240 may execute at least one instruction or program stored in the internal memory of the processor 240 or the memory 230 to perform a preset operation.

[0094] According to an embodiment, the processor 240 may execute at least one instruction stored in the memory 230 to perform a communication connection with the display device 100 by using a short-range wireless communication technology. The short-range wireless communication technology may include Bluetooth communication technology or Wi-Fi Direct technology.

[0095] According to an embodiment, the processor 240 may execute at least one instruction stored in the memory 230 to receive information for wireless communication connection from the display device 100, and perform wireless communication connection by using the received information for wireless communication connection to access the access point 70. For example, the information for wireless communication connection is information for access point connection, and may include an access point identification (ID), a password for accessing the access point, and the like.

[0096] According to an embodiment, the processor 240 may execute at least one instruction stored in the memory 230 to receive information for connecting to the server device 300 from the display device 100, and may connect to the server device 300 by using the received information for connecting to the server device 300. For example, the information for connecting to the server device 300 may include a uniform resource locator (URL) for accessing the server device 300, a user ID or password as user account information for connecting to the server device 300, and the like.

[0097] According to an embodiment, the processor 240 may execute at least one instruction stored in the memory 230 to receive a list of at least one input signal indicating a designated value from the display apparatus 100 , and may transmit the received list of at least one input signal to the server apparatus 300 .

[0098] According to an embodiment, the processor 240 may execute at least one instruction stored in the memory 230 to transmit an input signal corresponding to a user input received via the user input unit 220 to the server apparatus 300 or the display apparatus 100 .

[0099] According to an embodiment, the processor 240 may execute at least one instruction stored in the memory 230 to transmit an input signal corresponding to a user input received via the user input unit 220 to the display apparatus 100 based on information indicating a menu mode received from the display apparatus 100 .

[0100] According to an embodiment, the processor 240 may execute at least one instruction stored in the memory 230 to transmit an input signal corresponding to a user input received via the user input unit 220 to the server device 300 based on information indicating the end of the menu mode received from the display device 100 .

[0101] The controller 200 may be any device including a processor and a memory to perform functions. The controller 200 may include various electronic devices such as a remote controller, a game controller, a smart phone, and the like.

[0102] According to an embodiment, as shown in FIG2 , each element in the block diagram of the controller 200 may be integrated, added, or omitted according to the specifications of the controller 200 actually implemented. For example, two or more elements may be combined into a single component, or a single component may be divided into two or more components when necessary. The functions performed in each block are intended to describe the embodiments of the present disclosure, and specific operations or devices related to the functions do not limit the scope of the present disclosure.

[0103] Hereinafter, the server device 300 will now be described.

[0104] The server device 300 may include a communication interface 310, a memory 320, and a processor 330. However, the server device 300 may be embodied with more elements than those shown, and the embodiments of the present disclosure are not limited thereto. For example, the server device 300 may include a separate image processor to perform image processing on an image of an application executed by the server device 300.

[0105] The communication interface 310 may include at least one module for allowing wireless communication between the server device 300 and a wireless communication system or between the server device 300 and a network where other devices exist. The communication interface 310 according to an embodiment may perform communication with the display device 100 according to IP. The communication interface 310 according to an embodiment may perform communication with the controller 200 according to IP.

[0106] The memory 320 may store programs for processing and control by the processor 330 , and may store data input to or output from the server device 300 .

[0107] The memory 320 may include at least one type of storage medium among a flash memory, a hard disk, a multimedia card micro, a memory card (eg, an SD or XD memory card), RAM, SRAM, ROM, EEPROM, PROM, a magnetic storage, a magnetic disk, and an optical disk.

[0108] The processor 330 controls all operations of the server device 300. For example, according to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to perform the functions of the server device 300.

[0109] In an embodiment, the processor 330 may store at least one instruction in an internal memory, and may execute at least one instruction stored in the internal memory to control the operation of the display device to be performed. That is, the processor 330 may execute at least one instruction or program stored in the internal memory of the processor 330 or the memory 320 to perform a preset operation.

[0110] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to receive a request to execute a content application from the display apparatus 100 , and transmit result content to the display apparatus 100 according to the execution of the content application requested to be executed.

[0111] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to receive a list of at least one input signal indicating a designated value from the display apparatus 100 or the controller 200 and store the received list of at least one input signal.

[0112] According to an embodiment, the processor 330 can execute at least one instruction stored in the memory 320 to execute a content application based on an input signal received from the controller 200 according to information indicating a content reproduction control mode of the display device 100 received from the display device 100, and send the execution result content to the display device 100.

[0113] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to transmit the input signal indicating the designated value to the display apparatus 100 unchanged based on the input signal indicating the designated value, which is received from the controller 200 .

[0114] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to transmit the input signal received from the controller 200 to the display device 100 unchanged based on the information indicating the menu mode of the display device 100 received from the display device 100 .

[0115] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to control the communication interface to transmit the execution result content obtained by executing the content application to the display device.

[0116] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to control the communication interface to receive an input signal from the controller.

[0117] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to identify whether the input signal indicates a designated value.

[0118] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to control the communication interface to transmit an input signal for allowing the display device to output a user interface screen to the display device based on recognizing that the input signal indicates a specified value.

[0119] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to control the communication interface to transmit execution result content obtained by executing the content application according to the input signal to the display device based on recognizing that the input signal does not indicate a specified value.

[0120] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to control the communication interface to transmit an input signal received from the controller to the display apparatus while the display apparatus operates in a menu mode outputting a user interface screen.

[0121] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to control the communication interface to receive a signal from the display device indicating that the display device operates in the content reproduction control mode while the display device operates in the menu mode.

[0122] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to recognize that the display device operates in the content reproduction control mode based on receiving the signal.

[0123] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to control the communication interface to send execution result content to the display device based on the identification, where the execution result content is obtained by executing the content application based on the input signal received from the controller.

[0124] According to an embodiment, the processor 330 may execute at least one instruction stored in the memory 320 to receive a list including at least one input signal indicating a designated value from the display apparatus and store the list.

[0125] According to an embodiment, each element in the block diagram of the server device 300 shown in FIG. 2 may be integrated, added, or omitted according to the specifications of the server device 300 actually implemented. For example, two or more elements may be combined into a single component, or a single component may be divided into two or more components when necessary. The functions performed in each block are intended to describe the embodiments of the present disclosure, and specific operations or devices related to the functions do not limit the scope of the present disclosure.

[0126] FIG. 3 shows a block diagram of a display device according to an embodiment.

[0127] 3 , the display device 100 may include an image processor 150 , an audio processor 160 , an audio output unit 170 , a receiver 180 , and a detector 190 , as well as a communication interface 110 , a display 120 , a memory 130 , and a processor 140 .

[0128] The communication interface 110 may include at least one module for allowing wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network where other devices exist. For example, the communication interface 110 may include a mobile communication module 111, a wireless Internet module 112, and a short-range communication module 113.

[0129] The mobile communication module 111 transmits and receives radio signals to and from at least one of a base station, an external terminal or a server on a mobile communication network. The radio signals may include a voice call signal, a video call signal or various types of data according to transmission and reception of text / multimedia messages.

[0130] The wireless Internet module 112 refers to a module for wireless Internet access, and may be embedded in the display device 100 or installed outside the display device 100. As wireless Internet technology, wireless local area network (WLAN including Wi-Fi), wireless broadband (WiBro), world interoperability for microwave access (WiMax), high-speed downlink packet access (HSDPA), etc. may be used. The display device 100 may perform a Wi-Fi peer-to-peer (P2P) connection with other devices via the wireless Internet module 112.

[0131] The short-range communication module 113 refers to a module for short-range communication. As short-range communication technology, Bluetooth, Bluetooth Low Energy (BLE), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. can be used.

[0132] The display 120 may display an image signal received from the server device 300 on a screen.

[0133] The memory 130 may store programs associated with the operation of the display device 100 and various data generated during the operation of the display device 100 .

[0134] The memory 130 may store at least one instruction. In addition, the memory 130 may store at least one instruction executable by the processor 140. In addition, the memory 130 may store at least one program executable by the processor 140. In addition, the memory 130 may store an application for providing a preset service.

[0135] In detail, the memory 130 may include at least one type of storage medium among a flash memory, a hard disk, a multimedia card micro, a memory card (e.g., an SD or XD memory card), a RAM, a SRAM, a ROM, an EEPROM, a PROM, a magnetic storage, a magnetic disk, and an optical disk.

[0136] The processor 140 controls all operations of the display apparatus 100. For example, according to an embodiment, the processor 140 may execute at least one instruction stored in the memory 130 to perform a function of the display apparatus 100.

[0137] In an embodiment, the processor 140 may store at least one instruction in an internal memory, and may execute at least one instruction stored in the internal memory to control the operation of the display device to be performed. That is, the processor 140 may execute at least one instruction or program stored in the internal memory of the processor 140 or the memory 130 to perform a preset operation.

[0138] The image processor 150 may process an image signal received from the receiver 180 or the communication interface 110 , and may output the image signal to the display 120 according to the control of the processor 140 .

[0139] The audio processor 160 may convert an audio signal received from the receiver 180 or the communication interface 110 into an analog audio signal, and may output the analog audio signal to the audio output unit 170 according to the control of the processor 140 .

[0140] The audio output unit 170 may output audio (e.g., voice or sound) input via the communication interface 110 or the receiver 180. In addition, the audio output unit 170 may output audio stored in the memory 130 according to the control of the processor 140. The audio output unit 170 may include at least one of a speaker, a headphone output terminal, or a Sony / Philips Digital Interface (S / PDIF) output terminal, or a combination thereof.

[0141] The receiver 180 can receive video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), additional information (e.g., electronic program guide (EPG), etc.), etc. from the outside of the display device 100 through the control of the processor 140. The receiver 180 may include one of a high-definition multimedia interface (HDMI) port 181, a component jack 182, a personal computer (PC) port 183, and a universal serial bus (USB) port 184, or may include a combination of one or more thereof. The receiver 180 may also include DisplayPort (DP), Thunderbolt, and Mobile High-Definition Link (MHL) as well as the HDMI port 181.

[0142] The detector 190 may detect a user speech, a user image, or a user interaction, and may include a microphone, a camera unit, and a light receiver.

[0143] The microphone receives a voice uttered by the user. The microphone may convert the received voice into an electrical signal and may output the electrical signal to the processor 140. For example, the user voice may include a voice corresponding to a menu or function of the display device 100.

[0144] The camera unit may receive images (eg, continuous frames) corresponding to the user's motion (including gestures) in the camera recognition range. The processor 140 may select a menu displayed on the display device 100 by using the received recognition result of the motion, or may perform control corresponding to the received recognition result of the motion.

[0145] The optical receiver receives an optical signal (including a control signal) received from an external control device. The optical receiver may receive an optical signal corresponding to a user input (e.g., touch, pressure, touch gesture, voice, or motion) from the control device. According to the control of the processor 140, the control signal may be extracted from the received optical signal.

[0146] The memory 130 may store programs associated with the operation of the display device 100 and various data generated during the operation of the display device 100 .

[0147] The processor 140 performs functions of controlling all operations of the display device 100 and signal flows between internal elements of the display device 100 and processing data. When input from a user is provided or preset and stored conditions are met, the processor 140 may execute an operating system (OS) and various applications stored in the memory 130.

[0148] The processor 140 may include a graphics processing unit for graphics processing corresponding to the video. The graphics processing unit generates a screen including various objects such as icons, images, texts, etc. by using a calculator and a renderer. The calculator calculates attribute values ​​of each object to be displayed, such as coordinate values, shapes, sizes, and colors, according to the layout of the screen by using the user interaction detected by the detector 190. The renderer generates screens including various layouts of objects based on the attribute values ​​calculated by the calculator.

[0149] According to an embodiment, the processor 140 may execute at least one instruction to control the communication interface to receive execution result content obtained by executing the content application from the server based on an input signal from a controller connected to the server and configured to provide the input signal.

[0150] According to an embodiment, the processor 140 may execute at least one instruction to control the display to display the execution result content received from the server.

[0151] According to an embodiment, the processor 140 may execute at least one instruction to control the communication interface to receive an input signal indicating a designated value from the controller from the server.

[0152] According to an embodiment, the processor 140 may execute at least one instruction to display a user interface screen for controlling the display device based on receiving an input signal indicating a designated value.

[0153] According to an embodiment, the processor 140 may execute at least one instruction to receive an input signal from the controller while displaying the user interface screen, and perform an operation for controlling the display device based on the input signal.

[0154] According to an embodiment, the processor 140 may execute at least one instruction to receive an input signal from the controller via the server while displaying the user interface screen, or control the communication interface to directly receive an input signal from the controller.

[0155] According to an embodiment, the processor 140 may execute at least one instruction to control the display to end the display of the user interface screen according to an input signal for ending the user interface screen when the user interface screen is displayed.

[0156] According to an embodiment, the processor 140 may execute at least one instruction to control the communication interface to transmit a signal indicating that the display device operates in the content reproduction control mode to the server according to the end of the user interface screen.

[0157] According to an embodiment, the processor 140 may execute at least one instruction to control the communication interface to receive execution result content obtained by executing a content application from a server according to an input signal received from the controller in response to sending a signal indicating that the display device operates in a content reproduction control mode.

[0158] According to an embodiment, the processor 140 may execute at least one instruction to identify whether the type of the content application is a specified type, and based on the type of the content application being the specified type, control the communication interface to send a list including at least one input signal indicating a specified value to the server.

[0159] According to an embodiment, the processor 140 can execute at least one instruction to identify whether the type of the content application is a specified type, and based on the type of the content application being the specified type, send information for allowing the controller to directly connect to the server and a command for controlling the connection to the server to the controller.

[0160] FIG. 4 is a flow chart showing a method for operating a display device according to an embodiment.

[0161] 4 , in operation 410 , the display apparatus 100 may receive, from the server apparatus 300 , content obtained by executing a content application in the server apparatus 300 .

[0162] According to an embodiment, the display device 100 may send an execution request for a content application to the server device 300, and the server device 300 may perform the execution of the content application based on the execution request received from the display device 100. The server device 300 may send the execution result content obtained by executing the content application to the display device 100. The display device 100 may provide information about the content application for requesting the execution of the content application and the item or interface for requesting the execution of the content application. When the user selects the application by controlling the item or interface, the display device 100 may send a request to the server device 300 to execute the content application requested by the user. The server device 300 may execute the content application requested to be executed, and may send an image or screen output as the execution result to the display device 100. For example, when the content is game content, the server device 300 may execute the game application, and may send an image or screen output as the execution result to the display device 100, such as a pre-image initially displayed according to the execution of the game content, an introduction screen, a screen of information about the game content, etc.

[0163] In operation 420 , the display apparatus 100 may receive, from the server apparatus 300 , execution result content obtained by executing a content application based on an input signal from the controller 200 , and may display the received execution result content.

[0164] According to an embodiment, the controller 200 may be connected to the server device 300 via a wireless communication network, and may transmit an input signal to the server device 300 based on a user operation.

[0165] According to an embodiment, when the server device 300 receives an input signal from the controller 200 , the server device 300 may control execution of the content application by using the received input signal, and may transmit the obtained execution result content to the display device 100 .

[0166] According to an embodiment, the display apparatus 100 may display the execution result content of the content application received from the server apparatus 300 .

[0167] For example, while the display device 100 displays the game content received from the server device 300, the user may operate the user input to play the game content by using the controller 200. The controller 200 may perform a user operation with respect to an input signal corresponding to the user input, for example, a user operation for moving a character of the game content, and thus may transmit an input signal corresponding to the movement of the character to the server device 300. Then, the server device 300 may execute a content application by performing a calculation based on the input signal corresponding to the movement of the character to move the character, and may transmit the result content output by executing the content application, for example, a screen in which the character is moved, to the display device 100.

[0168] In operation 430 , when an input signal indicating a designated value from the controller 200 is received from the server device 300 , the display device 100 may display a user interface screen for controlling the display device 100 .

[0169] According to an embodiment, the display device 100 may receive an input signal indicating a designated value from the controller 200 from the server device 300. For example, when the display device 100 receives a signal indicating a designated value (e.g., "aaa1") from the server device 300 among the controller input signals as shown in FIG. 5 , the display device 100 may recognize that the display device 100 has received the input signal indicating the designated value.

[0170] According to an embodiment, in the case where the server device 300 receives an input signal from the controller 200, when the input signal does not indicate a specified value, the server device 300 may execute a content application based on the input signal and may send an execution result screen to the display device 100, however, when the input signal indicates a specified value, the server device 300 may send the input signal indicating the specified value to the display device 100 as is.

[0171] According to an embodiment, when the display apparatus 100 receives an input signal indicating a designated value from the server apparatus 300, the display apparatus 100 may display a user interface screen for controlling the display apparatus 100. The user interface screen for controlling the display apparatus 100 may refer to a menu screen for controlling user-adjustable elements of the display apparatus 100. For example, the menu screen may include at least one item or button for controlling the volume, display brightness, or audio input / output interface of the display apparatus 100.

[0172] In operation 440 , while the user interface screen is displayed, the display apparatus 100 may control the display apparatus 100 based on an input signal from the controller 200 .

[0173] According to an embodiment, the display apparatus may receive an input signal from the controller 200 while displaying a user interface screen, and may control the display apparatus 100 based on the received input signal.

[0174] According to an embodiment, while displaying the user interface screen, the display device 100 may directly receive an input signal of the controller 200 from the controller 200 or may receive an input signal of the controller 200 via the server device 300 .

[0175] For example, the user may increase the volume of the display device 100 by performing an operation of increasing the volume via the user interface screen using the controller 200, and the controller 200 may transmit an input signal corresponding to the operation of increasing the volume directly to the display device 100 or to the server device 300. The server device 300 may transmit the input signal received from the controller 200 to the display device 100. In this manner, the display device 100, which has received the input signal from the server device 300 or the controller 200, may convert the input signal into a display device control signal, and may control the display device 100 by using the display device control signal.

[0176] According to an embodiment, the display device 100 may convert an input signal from the controller 200 by using a controller input signal-display device control signal conversion table.

[0177] FIG. 5 illustrates a conversion table of a controller input signal to a display device control signal according to an embodiment.

[0178] 5 , a conversion table 500 may indicate a mapping table for converting an input signal from the controller 200 into a display apparatus control signal.

[0179] The conversion table 500 for converting an input signal from the controller 200 into a display device control signal for controlling the display device 100 may indicate a mapping table of values ​​of input signals from the controller 200 and values ​​of display device control signals. Referring to FIG5 , values ​​(aaa1, aaa2, aaa3, aaa4, aaa5, and aaa6) of input signals from the controller 200 may be mapped to values ​​(d1, d2, d3, d4, d5, and d6) of display device control signals, respectively.

[0180] In this way, when the display device 100 operates in a menu mode for controlling the display device 100, the display device 100 can control the display device 100 by converting the input signal from the controller 200 into a display device control signal using the conversion table 500 shown in Figure 5, so as to control the display device 100 using the input signal from the controller 200.

[0181] According to an embodiment, an operating method of a display device may include receiving execution result content obtained by executing a content application from a server device based on an input signal from a controller connected to the server device and configured to provide the input signal.

[0182] According to an embodiment, the operating method of the display device may include displaying execution result content.

[0183] According to an embodiment, an operating method of a display apparatus may include receiving, from a server apparatus, an input signal indicating a designated value from a controller.

[0184] According to an embodiment, an operating method of a display device may include displaying a user interface screen for controlling the display device based on receiving an input signal indicating a designated value.

[0185] According to an embodiment, an operating method of a display device may include receiving an input signal from a controller while displaying a user interface screen, and performing an operation for controlling the display device based on the input signal.

[0186] According to an embodiment, the operating method of the display device may include receiving an input signal from a controller via a server device or directly receiving an input signal from the controller while displaying a user interface screen.

[0187] According to an embodiment, an operating method of a display device may include ending display of the user interface screen according to an input signal for ending the user interface screen while the user interface screen is displayed.

[0188] According to an embodiment, the operating method of the display apparatus may include transmitting a signal indicating that the display apparatus operates in the content reproduction control mode to the server apparatus according to an end of the user interface screen.

[0189] According to an embodiment, an operating method of a display apparatus may include receiving execution result content obtained by executing a content application from a server apparatus according to an input signal received from a controller in response to transmission of a signal indicating that the display apparatus operates in a content reproduction control mode.

[0190] According to an embodiment, an operating method of a display apparatus may include identifying whether a type of a content application is a designated type.

[0191] According to an embodiment, the operating method of the display apparatus may include transmitting, to the server apparatus, a list including at least one input signal indicating a designated value, based on the type of the content application being the designated type.

[0192] According to an embodiment, an operating method of a display apparatus may include identifying whether a type of a content application is a designated type.

[0193] According to an embodiment, the operating method of the display apparatus may include transmitting, to the controller, information for allowing the controller to directly connect to the server and a command for controlling the connection with the server, based on that the type of the content application is a designated type.

[0194] FIG. 6 illustrates a flowchart of an operating method of a server device according to an embodiment.

[0195] 6 , in operation 610 , the server apparatus 300 may transmit execution result content obtained by executing a content application to the display apparatus 100 .

[0196] According to an embodiment, the server apparatus 300 may receive an execution request for a content application from the display apparatus 100 , and may transmit execution result content obtained by executing the content application to the display apparatus 100 in response to the execution request.

[0197] In operation 620 , the server device 300 may receive an input signal from the controller 200 , and may identify whether the received input signal indicates a designated value.

[0198] According to an embodiment, the server device 300 may receive and store a list including at least one input signal indicating a specified value from the display device 100, or may receive and store a list including at least one input signal indicating a specified value from the controller 200. For example, in the conversion table 500 shown in FIG. 5 , the server device 300 may receive the controller input signal <aaa1>and store it as a list including at least one input signal indicating a specified value. <aaa1>It may be a value of a signal corresponding to pressing of a home key among at least one key provided at the controller 200 .

[0199] According to an embodiment, when the server device 300 receives an input signal from the controller 200, the server device 300 may identify whether a value of the received input signal indicates a designated value.

[0200] In operation 630 , the server device 300 may determine whether the input signal from the controller 200 indicates a specified value, and when it indicates the specified value, the server device 300 may proceed to operation 640 , and when it does not indicate the specified value, the server device 300 may proceed to operation 650 .

[0201] In operation 640 , when the server device 300 determines that the input signal from the controller 200 indicates a specified value, the server device 300 may transmit an input signal for allowing the display device 100 to operate in the menu mode to the display device 100 .

[0202] According to an embodiment, when the server device 300 determines that the input signal from the controller 200 indicates a specified value, the server device 300 may transmit the input signal received from the controller 200 to the display device 100 as is. Then, the display device 100, which has received the input signal indicating the specified value, may display a user interface screen for controlling the display device 100. A mode for controlling the display device 100 in such a manner that the display device 100 displays a user interface screen may be referred to as a menu mode.

[0203] In operation 650 , when the server device 300 determines that the input signal from the controller 200 does not indicate a designated value, the server device 300 may transmit, to the display device 100 , execution result content obtained by executing the content application using the input signal from the controller 200 .

[0204] According to an embodiment, when the server device 300 determines that the input signal from the controller 200 does not indicate a specified value, the server device 300 may use the input signal from the controller 200 in order to control the execution of the content application. That is, the server device 300 may perform calculations for executing the content application by using the input signal from the controller 200, and may transmit the execution result content obtained by performing the calculations to the display device 100. A mode in which the display device 100 displays the content from the server device 300 and controls the reproduction of the content displayed on the display device 100 based on the input signal from the controller 200 may be referred to as a content reproduction control mode.

[0205] According to an embodiment, an operating method of a server device may include transmitting execution result content obtained by executing a content application to a display device.

[0206] According to an embodiment, an operating method of a server device may include receiving an input signal from a controller.

[0207] According to an embodiment, an operating method of a server device may include identifying whether an input signal indicates a specified value.

[0208] According to an embodiment, the operating method of the server apparatus may include transmitting, to the display apparatus, an input signal for allowing the display apparatus to output a user interface screen based on recognizing that the input signal indicates a specified value.

[0209] According to an embodiment, the operating method of the server device may include transmitting, to the display device, execution result content obtained by executing the content application according to the input signal, based on recognizing that the input signal does not indicate a designated value.

[0210] According to an embodiment, an operating method of a server apparatus may include transmitting an input signal received from a controller to a display apparatus while the display apparatus operates in a menu mode outputting a user interface screen.

[0211] According to an embodiment, an operating method of a server device may include receiving, from a display device, a signal indicating that the display device operates in a content reproduction control mode while the display device operates in a menu mode.

[0212] According to an embodiment, the operating method of the server device may include recognizing that the display device operates in the content reproduction control mode based on receiving the signal.

[0213] According to an embodiment, the operating method of the server device may include transmitting, based on the identification, execution result content to the display device, the execution result content being obtained by executing the content application based on an input signal received from the controller.

[0214] FIG. 7 illustrates an operation of the display apparatus 100 in a content reproduction control mode according to an embodiment.

[0215] 7 , the display device 100 in the content reproduction control mode may receive and display the execution result content from the server device 300 as the result screen 30 of the executed application. When the user desires to control the execution of the content displayed on the display device 100, the user may operate one or more input keys or input buttons provided at the controller 200.

[0216] According to an embodiment, when there is a user operation input, the controller 200 may transmit an input signal corresponding to the user operation input to the server device 300. In this way, during the content reproduction control mode of the display device 100, the server device 300 having received the input signal from the controller 200 may execute the application by using the input signal from the controller 200. According to an embodiment, the server device 300 may receive a signal indicating that the display device 100 is in the content reproduction control mode from the display device 100. When content whose execution can be controlled by the user exists in a foreground layer among at least one layer displayed on the display, the display device 100 may recognize the content reproduction control mode of the display device 100.

[0217] The server device 300 may perform calculation for executing the application by using an input signal from the controller 200 , and may transmit execution result content obtained according to the calculation result to the display device 100 .

[0218] FIG. 8 illustrates an operation of a display device in a menu mode according to an embodiment.

[0219] 8 , when a user plays content whose execution can be controlled by the user via the display device 100, the user may desire to change the settings of the display device 100. For example, a menu screen for changing settings may need to be displayed in order to adjust the sound, adjust the display screen brightness, or change the language of the display device 100. Here, the user may select and press a key corresponding to a designated value via the controller 200 so that an input signal having the designated value may be transmitted to the server device 300.

[0220] When the server device 300 receives an input signal indicating a designated value from the controller 200 , the server device 300 may transmit the input signal to the display device 100 as is, rather than performing calculation for application execution by using the input signal.

[0221] When the display apparatus 100 , which has received the input signal indicating the designated value from the server apparatus 300 , recognizes that the input signal indicates the designated value, the display apparatus 100 may output a user interface screen 50 for controlling settings of the display apparatus 100 .

[0222] In this manner, when the display device 100 switches to a state in which settings of the display device 100 are controllable according to user input as the user interface screen 50 for controlling settings of the display device 100 is output, the display device 100 may recognize its operation mode as the menu mode.

[0223] According to an embodiment, the display device 100 may transmit a signal indicating that the operation mode of the display device 100 is the menu mode to the server device 300. In this case, while the operation mode of the display device 100 is the menu mode, when the server device 300 receives an input signal from the controller 200, the server device 300 may transmit the input signal from the controller 200 to the display device 100 as is.

[0224] According to an embodiment, the display device 100 may transmit a signal indicating that the operation mode of the display device 100 is the menu mode to the controller 200. When the operation mode of the display device 100 is the menu mode and there is a user input, the controller 200 may transmit an input signal corresponding to the user input to the display device 100 instead of to the server device 300.

[0225] FIG. 9 illustrates an operation of a display device connecting a server device with a controller according to an embodiment.

[0226] 9 , the display apparatus 100 may transmit a content application execution request 910 to the server apparatus 300. For example, when a user of the display apparatus 100 selects a specific content application when the user desires to execute the specific content application, the display apparatus 100 may transmit a request to the server apparatus 300 to execute the content application selected by the user.

[0227] The display device 100 may obtain information about the content application requested for execution. The information about the content application requested for execution may be stored internally in the display device 100 or may be received from the server device 300. The information about the content application may include information indicating whether the content application is a server-controller direct connection type.

[0228] According to an embodiment, when it is identified that the content application is a server-controller direct connection type, the display device 100 may perform an operation for allowing the controller 200 and the server device 300 to be directly connected to each other. That is, the display device 100 may send information required for the server connection operation of the controller 200 and a server connection induction control command 920 to the controller 200. The information required for the server connection operation may include access point connection information for the controller 200 to first connect to the wireless Internet and server connection information for accessing the server via the wireless Internet. The access point connection information may include access point ID information and a password for connecting to the access point. The server connection information may include a URL of the server device 300, a password for accessing the server device 300, and the like. The server connection induction control command 920 may indicate a control command for inducing the controller 200 to directly connect to the server device 300 by using the access point connection information and the server connection information.

[0229] According to an embodiment, when the display device 100 recognizes that the content application is a server-controller direct connection type, the display device 100 may transmit a list of at least one input signal indicating a specified value 940 to the server device 300. The reason for transmitting the list of at least one input signal indicating a specified value 940 is that the display device 100 switches from the content reproduction control mode to the menu mode.

[0230] According to an embodiment, the controller 200 may perform an operation of connecting to the server device 300 according to the server connection induction control command 920 received from the display device 100. First, the controller 200 may connect to the wireless Internet by using the access point connection information, and then may perform a connection operation 930 on the server device 300 by using the server connection information.

[0231] According to an embodiment, when the controller 200 receives user input, the controller 200 may send an input signal 950 corresponding to the user input to the server device 300, may execute a content application based on the input signal received from the controller 200, and may send a content application execution result screen 960 to the display device 100.

[0232] According to the operation described with reference to FIG. 9 , the display apparatus 100 may allow the controller 200 to be directly connected to the server apparatus 300 and directly transmit an input signal of the controller 200 to the server apparatus 300 .

[0233] FIG. 10 illustrates an operation of a display device in a menu mode receiving an input signal of a controller via a server device according to an embodiment.

[0234] 10 , the display apparatus 100 may transmit information 1010 indicating that the display apparatus 100 is in a content reproduction control mode to the server apparatus 300 .

[0235] The controller 200 may transmit an input signal 1020 corresponding to the user input to the server device 300 .

[0236] The server device 300 may identify whether the input signal received from the controller 200 indicates a specified value, and when it does not indicate the specified value, the server device 300 may perform calculations for executing the application by using the input signal from the controller 200, and may send a content execution result screen 1030 to the display device 100.

[0237] When the input signal received from the controller 200 indicates a designated value, the server device 300 may transmit the input signal 1040 indicating the designated value to the display device 100 without change.

[0238] When the display apparatus 100 receives an input signal indicating a designated value, the display apparatus 100 may output a user interface screen for controlling the display apparatus 100, or may transmit information 1050 indicating that the display apparatus 100 is in menu mode to the server apparatus 300. The server apparatus 300 may recognize that the display apparatus 100 is in menu mode.

[0239] When the server device 300 receives an input signal from the controller 200 while the display device 100 is in the menu mode, the server device 300 may transmit the input signal 1060 from the controller 200 to the display device 100 as is. The display device 100 may control the display device 100 based on the input signal from the controller 200. That is, the display device 100 may convert the input signal from the controller 200 into a display device control signal, and may perform an operation corresponding to the display device control signal.

[0240] When the user interface screen for controlling the display device 100 ends and then the content application screen is located in the foreground layer of the display device 100, the display device 100 may recognize the end of the menu mode and the start of the content reproduction control mode. In this case, the display device 100 may transmit information indicating the content reproduction control mode to the server device 300.

[0241] In the example shown in FIG. 10 above, it is described that the display device 100 receives a mode controller input signal including a content reproduction control mode or a menu mode via the server device 300. Hereinafter, in FIG. 11 , it is described that in the content reproduction control mode, the controller input signal is received by the display device 100 via the server device 300, but in the menu mode, the controller input signal is directly sent to the display device 100 without passing through the server device 300.

[0242] FIG. 11 illustrates an operation of a display apparatus in a menu mode in which a controller input signal is directly received from a controller according to an embodiment.

[0243] 11 , the display apparatus 100 may transmit information 1110 indicating that the display apparatus 100 is in a content reproduction control mode to the server apparatus 300 .

[0244] The controller 200 may transmit an input signal 1120 corresponding to the user input to the server device 300 .

[0245] The server device 300 may identify whether the input signal received from the controller 200 indicates a specified value, and when it does not indicate the specified value, the server device 300 may perform calculations for executing the application by using the input signal from the controller 200, and may send a content execution result screen 1130 to the display device 100.

[0246] When the input signal received from the controller 200 indicates a designated value, the server device 300 may transmit the input signal 1140 indicating the designated value to the display device 100 as is.

[0247] When the display device 100 receives an input signal indicating a specified value, the display device 100 may output a user interface screen for controlling the display device 100, or may send information 1150 indicating that the display device 100 is in menu mode to the controller 200, and the controller 200 may recognize that the display device 100 is in menu mode.

[0248] When the display apparatus 100 is in the menu mode, the controller 200 may directly transmit an input signal 1160 corresponding to a user input to the display apparatus 100 .

[0249] When the display device 100 receives an input signal of the controller 200 from the controller 200, the display device 100 may control the display device 100 based on the input signal of the controller 200. That is, the display device 100 may convert the input signal from the controller 200 into a display device control signal and may perform operation 1170 corresponding to the display device control signal.

[0250] Thereafter, when the user interface screen disappears according to a user input for ending the user interface screen and the content application screen is displayed, the display device 100 may recognize that the menu mode ends and the content reproduction control mode starts. Then, the display device 100 may transmit information 1180 indicating the end of the menu mode to the controller 200 to notify the end of the menu mode.

[0251] When receiving the information 1180 indicating the end of the menu mode, the controller 200 may transmit an input signal corresponding to the user input to the server device 300 .

[0252] 12 illustrates a flowchart of an operating method of a controller, a server device, and a display device for connecting a controller to a server device according to execution of content according to an embodiment.

[0253] 12 , in operation 1210, the display apparatus 100 may transmit a content application execution request to the server apparatus 300. For example, the display apparatus 100 may display items for starting execution of a content application, and based on receiving a user input selecting an item from the displayed items, the display apparatus 100 may transmit an execution request for a content application corresponding to the selected item to the server apparatus 300.

[0254] In operation 1220, the server apparatus 300 may execute the content application requested for execution according to the content application execution request received from the display apparatus 100. The server apparatus 300 may transmit to the display apparatus 100 a content application screen output as a result of executing the content application.

[0255] In operation 1230 , the display apparatus 100 may obtain property information of the content application requested to be executed.

[0256] According to an embodiment, the display device 100 may store attribute information of the content application requested to be executed. For example, the display device 100 may obtain the attribute information of the content application from the meta information of the content application. For example, the display device 100 may have a field as to whether each application is a server-controller direct connection type as meta information about each application in the application database, and may store a value in the field when each application is installed or updated.

[0257] According to an embodiment, the display apparatus 100 may request the server apparatus 300 for attribute information of the content application, may receive the attribute information from the server apparatus 300, and thus may obtain the attribute information of the content application.

[0258] The attribute information of the content application requested for execution may include information on whether the content application is a server-controller direct connection type. The fact that the content application is a server-controller direct connection type may indicate that an input signal for controlling execution of the content application may be directly transmitted from the controller to the server.

[0259] In operation 1240 , the display apparatus 100 may determine whether the content application requested to be executed is a content application of a designated type.

[0260] According to an embodiment, the display apparatus 100 may determine whether the content application requested to be executed is of a server-controller direct connection type as an example of a specified type.

[0261] According to an embodiment, the display device 100 may obtain information about whether the content application requested for execution is a server-controller direct connection type from the meta information of the content application. The meta information of the content application may be stored when the content application is installed or updated in the display device 100. Here, the application being installed in the display device 100 may indicate that a set of at least one instruction and data item for execution start of the application executable in the server is installed in the display device 100.

[0262] According to an embodiment, the display apparatus 100 may obtain information on whether the content application requested to be executed is of a server-controller direct connection type by requesting and receiving information from the server apparatus 300 .

[0263] In operation 1240 , as a result of determining whether the content application requested to be executed is a content application of a specified type, when the content application requested to be executed is not a content application of a specified type, the operation method may proceed to operation 1290 .

[0264] In operation 1290 , the display apparatus 100 may perform control of execution of the content application by receiving an input signal from the controller 200 and transmitting the input signal of the controller 200 to the server apparatus 300 .

[0265] In operation 1240 , as a result of determining whether the content application requested to be executed is a content application of a specified type, when the content application requested to be executed is a content application of a specified type, the operation method may proceed to operation 1250 .

[0266] In operation 1250 , the display apparatus 100 may transmit the content reproduction control mode information and a list of at least one input signal indicating a designated value.

[0267] According to an embodiment, the display apparatus 100 may transmit content reproduction control mode information indicating that the display apparatus 100 is in the content reproduction control mode to the server apparatus 300 .

[0268] According to an embodiment, the display device 100 may transmit a list of at least one input signal indicating a specified value. The list of at least one input signal may include at least one input signal having a specified value, so that when an input signal having a specified value is received from the controller 200, the server device 300 transmits the input signal having the specified value to the display device 100 unchanged. When it is determined that one input signal has a specified value, the display device 100 may transmit an input signal list including one input signal having the specified value. For example, referring to FIG. 5 , the input signal list may include <aaa1>as an input signal with the specified value.

[0269] In operation 1250, the display apparatus 100 transmits the content reproduction control mode information and a list of at least one input signal indicating a designated value does not indicate that they are always transmitted at the same time, and thus, they may be transmitted at the same time or may be transmitted at different times.

[0270] In operation 1260 , the server apparatus 300 may store the content reproduction control mode information received from the display apparatus 100 and a list of at least one input signal indicating a designated value.

[0271] In operation 1270, according to the determination result in operation 1240, the content application requested to be executed is identified as a content application of a specified type, for example, an application of a server-controller direct connection type, and therefore, in order to facilitate the direct connection between the server and the controller, the display device 100 may send information required for the server connection operation of the controller 200 and a server connection induction control command to the controller 200. The information required for the server connection operation may include access point connection information for the controller 200 to first connect to the wireless Internet and server connection information for accessing the server via the wireless Internet. The access point connection information may include access point ID information and a password for connecting to the access point. The server connection information may include a URL of the server device 300, a password for accessing the server device 300, and the like. The server connection induction control command may indicate a control command for inducing the controller 200 to directly connect to the server device 300 by using the access point connection information and the server connection information.

[0272] In operation 1280 , the controller 200 may perform an operation of connecting to the server device 300 by using information required for the server connection operation received from the display device 100 .

[0273] According to an embodiment, the controller 200 may perform an operation of connecting to the server device 300 according to the server connection induction control command received from the display device 100. First, the controller 200 may connect to the wireless Internet by using the access point connection information, and then may perform a connection operation on the server device 300 by using the server connection information.

[0274] As shown in FIG. 12 , after the server-controller connection is completed for the server-controller direct connection type of the application, the server device 300 may directly receive an input signal from the controller 200 during the content reproduction control mode of the display device 100, and may transmit a result of executing the content application according to the received input signal to the display device 100. In addition, during the menu mode of the display device 100, the display device 100 may receive an input signal for controlling the display device 100 via the server device 300, or may directly receive an input signal from the controller 200. An example in which the display device 100 receives a signal from the server device 300 in both the content reproduction control mode and the menu mode of the display device 100 will be described in conjunction with FIGS. 13 to 15 , and an example in which the display device 100 directly receives an input signal from the controller 200 in the menu mode of the display device 100 will be described in conjunction with FIGS. 16 to 18 .

[0275] FIG. 13 is a flowchart illustrating an operation method of a controller, a server device, and a display device according to an embodiment.

[0276] 13 , in operation 1310, the controller 200 may transmit an input signal to the server device 300 according to a user operation. When the display device 100 displays the application execution result content from the server device 300, the user may operate the controller 200 to control the execution of the content displayed on the display device 100. For example, the user may perform an operation input corresponding to forward movement by using a button, key, or dial provided at the controller 200 in order to manipulate the forward movement of a specific character in the content displayed on the display device 100, and thus, the controller 200 may transmit an input signal corresponding to the operation input to the server device 300.

[0277] In operation 1320, the server device 300 may receive an input signal from the controller 200 and may determine whether the display device 100 is in the content reproduction control mode. The server device 300 may receive and store information indicating whether the display device 100 is in the content reproduction control mode in advance from the display device 100. As a result of the determination, when the display device 100 is not in the content reproduction control mode, the operation method may proceed to As a result of the determination, when the display apparatus 100 is in the content reproduction control mode, the operating method may proceed to operation 1330 .

[0278] In operation 1330, the server device 300 may determine whether the input signal indicates a specified value. The server device 300 may receive and store a list of at least one input signal indicating a specified value from the display device 100. When the input signal indicates a specified value, the operation method may proceed to , and when the input signal does not indicate the specified value, the operation method can proceed to operation 1340.

[0279] In operation 1340 , when the display device 100 is in the content reproduction control mode and the input signal does not indicate a specified value, the server device 300 may execute the content application based on the input signal, and may transmit an execution result screen to the display device 100 .

[0280] At operation 1350, the display device 100 may receive the execution result screen of the content application from the server device 300, and may display the received execution result screen. In the above example, for example, when the user operates the controller 200 to manipulate the forward movement of a specific character in the content displayed on the display device 100, the execution result screen displayed on the display device 100 may include an image in which the forward movement of the specific character has been performed.

[0281] FIG. 14 is a flowchart showing an operation method of a controller, a server device, and a display device according to an embodiment.

[0282] When the display device 100 is not in the content reproduction control mode (eg, "No" at operation 1320) or the input signal indicates a specified value (eg, "Yes" at operation 1340), the operation method may proceed to And continue at operation 1410 in Figure 14.

[0283] 14, in operation 1410, the server device 300 may transmit the input signal of the controller 200 to the display device 100 as is. The operation method may proceed to In two cases, for example, when the display device 100 is not in the content reproduction control mode but in the menu mode, the input signal of the controller 200 is sent to the display device 100 unchanged so as to be used to control the display device 100, and in the case where the input signal indicates a specified value, the input signal of the controller 200 is sent to the display device 100 unchanged so as to allow the display device 100 to enter the menu mode.

[0284] In operation 1420, the display device 100 may determine whether the input signal of the controller 200 received from the server device 300 indicates a specified value. As a result of the determination, when the input signal of the controller 200 does not indicate the specified value, the operation method may proceed to operation 1460, and when the input signal indicates the specified value, the operation method may proceed to operation 1430.

[0285] At operation 1430, when the input signal of the controller 200 indicates a designated value, the display apparatus 100 may output a user interface screen for controlling the display apparatus 100. For example, the user interface screen may include a quick panel or the like.

[0286] In operation 1440 , the display apparatus 100 may transmit information indicating that the operation mode of the display apparatus 100 is the menu mode to the server apparatus 300 .

[0287] In operation 1450 , the server apparatus 300 may receive information from the display apparatus 100 , and may store information indicating that the display apparatus 100 is in the menu mode.

[0288] In operation 1460, the display device 100 may perform a display device control operation based on the input signal. The case where the operation method proceeds to operation 1460 is a case where the input signal of the controller 200 is transmitted unchanged from the server device 300 and the input signal does not indicate a specified value, and the input signal may indicate that it is a signal for controlling the display device 100 in the menu mode. Therefore, the display device 100 may convert the input signal of the controller 200 into a display device control signal, and may perform an operation corresponding to the display device control signal.

[0289] FIG. 15 is a flowchart illustrating an operation method of a controller, a server device, and a display device according to an embodiment.

[0290] 15 , in operation 1510, the display device 100 may detect the end of the menu mode. For example, when a screen for controlling the display device 100 ends, for example, a user interface screen ends in response to a user input, the display device 100 may detect the end of the menu mode. In addition, the end of the menu mode may indicate the start of the content reproduction control mode.

[0291] In operation 1520 , the display apparatus 100 may transmit information indicating that the display apparatus 100 is in the content reproduction control mode to the server apparatus 300 .

[0292] In operation 1530 , the server apparatus 300 may store information indicating that the display apparatus 100 is in the content reproduction control mode, the information being received from the display apparatus 100 .

[0293] In a case where the server device 300 receives an input signal from the controller 200 after the server device 300 stores information indicating the content reproduction control mode of the display device 100 , the server device 300 may operate as shown in FIG. 13 .

[0294] FIG. 16 is a flowchart illustrating an operation method of a controller, a server device, and a display device according to an embodiment.

[0295] 16 , in operation 1610, the controller 200 may transmit an input signal to the server device 300 according to a user operation. When the display device 100 displays content according to an application execution result from the server device 300, the user may operate the controller 200 in order to control the execution of the content displayed on the display device 100. For example, the user may perform an operation input corresponding to forward movement by using a button, a key, or a dial provided at the controller 200 in order to manipulate the forward movement of a specific character in the content displayed on the display device 100, and thus, the controller 200 may transmit an input signal corresponding to the operation input to the server device 300.

[0296] In operation 1620, the server device 300 may determine whether the input signal indicates a specified value. The server device 300 may receive and store a list of at least one input signal indicating a specified value from the display device 100. When the input signal indicates a specified value, the operation method may proceed to , and when the input signal does not indicate the specified value, the operation method can proceed to operation 1630.

[0297] In operation 1630 , when the input signal is not a designated value, the server device 300 may execute the content application based on the input signal, and may transmit an execution result screen to the display device 100 .

[0298] In operation 1640, the display device 100 may receive the execution result screen of the content application from the server device 300, and may display the received execution result screen. In the above example, for example, when the user operates the controller 200 in order to manipulate the forward movement of a specific character in the content displayed on the display device 100, the execution result screen displayed on the display device 100 may include an image in which the forward movement of the specific character has been performed.

[0299] FIG. 17 is a flowchart illustrating an operation method of a controller, a server device, and a display device according to an embodiment.

[0300] When the input signal indicates a specified value (eg, "yes" at operation 1620, "yes" at operation 1850), the operation method may proceed to And continue at operation 1710 in Figure 17.

[0301] 17, in operation 1710, the server device 300 may transmit the input signal of the controller 200 to the display device 100 without change. For example, in the case where the input signal indicates a designated value, the input signal of the controller 200 is transmitted to the display apparatus 100 as is, to allow the display apparatus 100 to enter the menu mode.

[0302] At operation 1720, the display apparatus 100 may output a user interface screen for controlling the display apparatus 100 based on an input signal indicating a designated value of the controller 200. For example, the user interface screen may include a shortcut panel and the like.

[0303] In operation 1730, the display device 100 may transmit a control command to the controller 200 to transmit an input signal to the display device 100. When the display device 100 displays a user interface screen, for example, during a menu mode of the display device 100, the display device 100 may transmit a control command instructing to transmit an input signal to the display device 100 to the controller 200, so as to directly receive an input signal for controlling the display device 100 from the controller 200 during the menu mode of the display device 100. The control command may be transmitted to the controller 200 via Bluetooth communication technology or Wi-Fi communication technology.

[0304] In operation 1740 , the controller 200 may receive a control command instructing to transmit an input signal to the display apparatus 100 , and may transmit the input signal to the display apparatus 100 according to a user input.

[0305] In operation 1750, the display device 100 may receive an input signal for controlling a user interface screen displayed on the display of the display device 100 directly from the controller 200, rather than receiving the input signal via the server device 300. Thereafter, the display device 100 may perform a control operation on the display device 100 based on the input signal.

[0306] FIG. 18 is a flowchart illustrating an operation method of a controller, a server device, and a display device according to an embodiment.

[0307] 18 , in operation 1810, the display device 100 may detect the end of the menu mode. For example, when a screen for controlling the display device 100 ends (e.g., a user interface screen ends), the display device 100 may detect the end of the menu mode. In addition, the end of the menu mode may indicate the start of the content reproduction control mode.

[0308] At operation 1820, the display device 100 may transmit a control command to the controller 200 to transmit an input signal to the server device 300. That is, when the menu mode of the display device 100 ends and the content reproduction control mode starts, the display device 100 allows the controller 200 to transmit an input signal to the server device 300 so as to receive a result screen of the reproduction control according to the content displayed on the display of the display device 100 from the server device 300.

[0309] At operation 1830 , the controller 200 may receive a control command from the display apparatus 100 , and may then receive a user input.

[0310] In operation 1840 , the controller 200 may transmit an input signal to the server device 300 in response to the user input.

[0311] In operation 1850, the server device 300 may determine whether the input signal received from the controller 200 indicates a specified value. When the input signal indicates the specified value, the operation method may proceed to , and when the input signal does not indicate the specified value, the operation method may proceed to operation 1630. The operations thereafter are the same as those in FIG. 16 , and therefore, no further description is provided here.

[0312] Embodiments of the present disclosure may be embodied as computer-readable recording media, for example, program modules to be executed in a computer, which include computer-readable instructions. Computer-readable recording media may include any available media, volatile and non-volatile media, and removable and non-removable media that can be accessed by a computer. In addition, computer-readable recording media may include computer storage media. Computer storage media include all volatile and non-volatile media and removable and non-removable media that are technically implemented to store information including computer-readable instructions, data structures, program modules, or other data.

[0313] The embodiments of the present disclosure may be implemented in a software (S / W) program including instructions stored in a computer-readable storage medium.

[0314] The computer is a device that can call stored instructions from a storage medium and operate according to the embodiments of the present disclosure according to the called instructions, and may include the electronic device according to the embodiments.

[0315] The computer-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory" means that the storage medium is tangible and does not refer to a temporary electrical signal, but does not distinguish whether data is stored semi-permanently or temporarily on the storage medium.

[0316] In addition, the control method according to the embodiment of the present disclosure may be provided in a computer program product. The computer program product may be traded between a seller and a buyer as a commodity.

[0317] The computer program product may include a S / W program and a computer-readable storage medium in which the S / W program is stored. For example, the computer program product may include a product (e.g., a downloadable application) in the S / W program that is electronically distributed by a manufacturer of an electronic device or an electronic market (e.g., Google Play Store and App Store). For electronic distribution, at least a portion of the S / W program may be stored on a storage medium or may be temporarily generated. In this case, the storage medium may be a storage medium of a manufacturer's server, a server of an electronic market, or a relay server for temporarily storing the S / W program.

[0318] In a system including a server and an electronic device, a computer program product may include a storage medium of the server or a storage medium of the electronic device. Alternatively, when there is a third device (e.g., a smart phone) that communicates with the server or the electronic device, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include an S / W program that is transmitted from the server to the electronic device or the third device or from the third device to the electronic device.

[0319] In this case, one of the server, the electronic device, and the third device may execute the method according to the embodiment of the present disclosure by executing the computer program product. Optionally, at least two of the server, the electronic device, and the third device may divide and execute the method according to the embodiment of the present disclosure by executing the computer program product.

[0320] For example, a server (eg, a cloud server, an AI server, etc.) may execute a computer program product stored in the server, thereby controlling an electronic device to execute a method according to an embodiment of the present disclosure, and the electronic device communicates with the server.

[0321] As another example, the third device may execute a computer program product, thereby controlling the electronic device to execute the method according to the embodiment of the present disclosure, and the electronic device communicates with the third device. When the third device executes the computer program product, the third device may download the computer program product from the server and may execute the downloaded computer program product. Alternatively, the third device may execute the method according to the embodiment of the present disclosure by executing a preloaded computer program product.

[0322] Throughout the specification, the term “unit” may indicate a hardware component such as a processor or a circuit, and / or may indicate a software component executed by a hardware configuration such as a processor.

[0323] Although the present disclosure has been specifically shown and described with reference to the accompanying drawings, in which embodiments of the present disclosure are shown, it is obvious to those skilled in the art that the present disclosure can be easily implemented in many different forms without changing the technical concept or basic features of the present disclosure. Therefore, it should be understood that the embodiments described herein should be considered only in a descriptive sense and not for limiting purposes. For example, a configuration element as a singular form can be executed in a distributed manner, and in addition, a distributed configuration element can be combined and then executed.

[0324] Although the exemplary embodiments of the present disclosure have been shown and described, the present disclosure is not limited to the above-mentioned specific embodiments, and it is obvious that various modifications can be made by a person skilled in the art of the present disclosure without departing from the subject matter of the present disclosure as claimed in the attached claims and their equivalents. In addition, it is intended that such modifications are not interpreted independently of the technical ideas or prospects of the present disclosure.

Claims

1. A display device, comprising: Communication interface; monitor; A memory storing at least one instruction; and at least one processor configured to execute the at least one instruction to: receiving, from a server device through the communication interface, first execution result content obtained by executing a content application based on an input signal from a controller connected to the server device and configured to provide the input signal to the server device, controlling the display to display the first execution result content, based on the controller providing the input signal indicating the designated value to the server device, receiving a first input signal indicating the designated value from the server device through the communication interface, displaying a user interface screen through the display to control the display device based on the first input signal indicating the designated value, receiving a second input signal from the controller through the communication interface while the display is displaying the user interface screen, and The operation of the display device is controlled based on the second input signal.

2. The display device according to claim 1, wherein: The at least one processor is further configured to execute the at least one instruction to: receiving the second input signal from the controller via the server device through the communication interface, or The second input signal is received directly from the controller through the communication interface.

3. The display device according to claim 1, wherein: The at least one processor is further configured to execute the at least one instruction to: controlling the display device to end displaying the user interface screen based on the second input signal indicating the end of displaying the user interface screen, Based on the display ending displaying the user interface screen, the communication interface is controlled to transmit a signal indicating that the display device is in a content reproduction control mode to the server device.

4. The display device according to claim 3, wherein: The at least one processor is further configured to execute the at least one instruction to: Second execution result content obtained by executing the content application according to a third input signal from the controller is received from the server device through the communication interface, the third input signal being received after sending a signal indicating that the display device is in the content reproduction control mode.

5. The display device according to claim 1, wherein: The at least one processor is further configured to execute the at least one instruction to: identifying whether the type of the content application is a specified type; and Based on the type of the content application being the designated type, the communication interface is controlled to send a list to the server device, the list including at least one input signal indicating the designated value.

6. The display device according to claim 1, wherein: The at least one processor is further configured to execute the at least one instruction to: identifying whether the type of the content application is a specified type; and Based on the type of the content application being the designated type, the communication interface is controlled to transmit information allowing the controller to directly connect to the server device to the controller, and to transmit a command to the server device.

7. A server device, comprising: Communication interface; A memory storing at least one instruction; and at least one processor configured to execute the at least one instruction to: controlling the communication interface to send a first execution result content obtained by executing the content application to the display device, receiving a first input signal from a controller via the communication interface, identifying whether the first input signal indicates a specified value, based on identifying that the first input signal indicates the specified value, controlling the communication interface to send the first input signal to the display device to allow the display device to output a user interface screen, and Based on recognizing that the first input signal does not indicate the specified value, the communication interface is controlled to transmit second execution result content obtained by executing the content application according to the first input signal to the display device.

8. The server device according to claim 7, wherein: The at least one processor is further configured to execute the at least one instruction to: Based on recognizing that the display device is in a menu mode of outputting the user interface screen, the communication interface is controlled to transmit the second input signal received from the controller to the display device.

9. The server device according to claim 7, wherein: The at least one processor is further configured to execute the at least one instruction to: while the display device is in the menu mode, receiving a signal from the display device through the communication interface indicating that the display device is in the content reproduction control mode, recognizing that the display device is in the content reproduction control mode based on the signal indicating that the display device is in the content reproduction control mode, and Based on recognizing that the display device is in the content reproduction control mode, third execution result content is transmitted to the display device through the communication interface, the third execution result content being obtained by executing the content application based on a second input signal from the controller.

10. The server device according to claim 7, wherein: The at least one processor is further configured to execute the at least one instruction to: receiving, from the display device via the communication interface, a list including at least one input signal indicating the specified value, and The list is stored.

11. A method for operating a display device, the method comprising: receiving, from a server device, first execution result content obtained by executing a content application based on an input signal from a controller connected to the server device and configured to provide the input signal to the server device; Displaying the first execution result content on a display of the display device; receiving, from the server device, a first input signal indicating the designated value based on the controller providing the first input signal indicating the designated value to the server device; displaying a user interface screen to control the display device based on receiving a first input signal indicating a specified value; receiving a second input signal from the controller while the display device displays the user interface screen; and The operation of the display device is controlled based on the second input signal.

12. The method according to claim 11, wherein: Receiving the second input signal from the controller includes: receiving the second input signal from the controller via the server device; or The second input signal is received directly from the controller.

13. The method according to claim 11, further comprising: controlling the display to end displaying the user interface screen based on the second input signal indicating an end to displaying the user interface screen; and Based on the display ending the display of the user interface screen, a signal indicating that the display device is in a content reproduction control mode is sent to the server device.

14. A method of operating a server device, the method comprising: Sending a first execution result content obtained by executing the content application to a display device; receiving a first input signal from a controller; identifying whether the first input signal indicates a specified value; based on identifying that the first input signal indicates the specified value, sending the first input signal to the display device to allow the display device to output a user interface screen; and Based on recognizing that the first input signal does not indicate the specified value, second execution result content obtained by executing the content application according to the first input signal is transmitted to the display device.

15. A non-transitory computer readable medium for storing computer readable program codes or instructions executable by at least one processor to perform a method of operating a display device, the method comprising: receiving, from a server device, first execution result content obtained by executing a content application based on an input signal from a controller, wherein the controller is connected to the server device and configured to provide the input signal to the server device; Display the first execution result content; receiving, from the server device, a first input signal from the controller indicating a specified value; displaying a user interface screen to control the display device based on receiving a first input signal indicating a specified value; receiving a second input signal from the controller while the display device displays the user interface screen; and The operation of the display device is controlled based on the second input signal.

Images