Display device and method of operating the same
The display device efficiently controls operations in menu modes by processing controller inputs directly or via a server, addressing latency issues and improving user interaction in cloud gaming.
Patent Information
- Application Number
- JP2025500166
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-12-05
- Filing Date
- 2023-06-27
- Publication Date
- 2025-09-02
- Estimated Expiration
- 2043-06-27
AI Technical Summary
Existing display devices struggle to efficiently control operations in menu modes when connected to a server device for cloud gaming, as they do not directly receive input signals from controllers, leading to delayed or inefficient control responses.
The display device includes a processor that executes instructions to receive and interpret input signals from a controller, either directly or via a server, to control operations in menu modes, and switch between menu and content playback modes based on signal types.
Enables quick and efficient control of display device operations during cloud gaming, enhancing user interaction and reducing latency by directly processing controller inputs and switching modes as needed.
Smart Images

Figure 2025528661000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a display device and an operating method thereof, and more particularly to a display device using a server device and a controller and an operating method thereof. [Background technology]
[0002] Recently, as the number of game users has increased, there has been an increasing demand for enjoying game content on a large screen TV to enhance game immersion.
[0003] Cloud gaming is a gaming service in which the main calculations required for the game, such as graphics processing, are performed on a cloud server device, and user inputs from user devices such as smartphones and smart TVs are transmitted to the server device, and the rendered game screen is received and displayed on the user device via IP streaming. Summary of the Invention [Means for solving the problem]
[0004] According to one embodiment, a display device may include a communication interface, a memory for storing one or more instructions, and a processor for executing the one or more instructions stored in the memory.
[0005] By executing the one or more instructions, the processor may receive, from the server device via the communication interface, a first execution result content obtained by executing a content application based on the input signal from a controller connected to the server device and providing the input signal.
[0006] The processor may execute the one or more instructions to control the display to display the first execution result content.
[0007] The processor may execute the one or more instructions to receive from the server device via the communications interface a first input signal from the controller indicating a default value communicated by the controller to the server device.
[0008] The processor may execute the one or more instructions to display a user interface screen for controlling the display device upon receiving a first input signal indicating the predetermined value.
[0009] The processor may receive a second input signal from the controller and control operation of the display device based on the second input signal while displaying the user interface screen by executing the one or more instructions.
[0010] The processor, while executing the at least one instruction to display the user interface screen, may receive a second input signal from the controller via the server device via the communication interface, or may receive a second input signal from the controller directly from the controller via the communication interface.
[0011] By executing the at least one instruction, the processor may control the display to end the display of the user interface screen in response to a second input signal for ending the display of the user interface screen while displaying the user interface screen, and may control the communication interface to transmit a signal to the server device indicating that the display device will operate in a content playback control mode upon ending the display of the user interface screen.
[0012] The processor may perform the at least one instruction, and by transmitting a signal indicating that the display device is operating in a content playback control mode, control the communication interface to receive from the server device a second execution result content obtained by performing the content application, according to a third input signal received from the controller.
[0013] By executing the at least one instruction, the processor may identify whether the type of the content application is a default type, and, because the type of the content application is the default type, control the communication interface to transmit to the server device a list including one or more input signals indicating the default value.
[0014] By executing the at least one instruction, the processor can identify whether the type of the content application is a default type, and if the type of the content application is the default type, transmit to the controller information enabling the controller to connect directly to the server device and an instruction to control the controller to connect to the server device.
[0015] According to one embodiment, a server device may include a communications interface, a memory that stores at least one instruction, and a processor that executes the at least one instruction stored in the memory.
[0016] The processor may execute the one or more instructions to control the communication interface to transmit first execution result content obtained by executing a content application to a display device.
[0017] The processor may execute the at least one instruction to control the communication interface to receive a first input signal from a controller.
[0018] The processor may execute the at least one instruction to identify whether the first input signal indicates a predetermined value.
[0019] By executing the at least one instruction, the processor may control the communication interface to transmit the input signal to the display device so that the first input signal is identified as indicating the predetermined value, thereby causing the display device to output a user interface screen.
[0020] By executing the at least one instruction, the processor may control the communication interface to transmit to the display device a second execution result content obtained by executing the content application using the input signal when the first input signal is identified as not indicating the default value.
[0021] The processor may execute the at least one instruction to control the communication interface to transmit a second input signal received from the controller to the display device while the display device operates in a menu mode that outputs the user interface screen.
[0022] By executing the at least one instruction, the processor may control the communication interface to receive a signal from the display device indicating that the display device is to be switched to a content playback control mode while the display device is operating in the menu mode, recognize that the display device is operating in the content playback control mode upon receiving the signal, and, upon the recognition, control the communication interface to transmit to the display device a third execution result content obtained by executing the content application according to an input signal received from the controller.
[0023] The processor may execute the at least one instruction to receive and store a list from the display device that includes one or more input signals that indicate the predetermined value.
[0024] According to one embodiment, a method for operating a display device includes an operation of receiving, from a server device, first execution result content obtained by performing a content application based on an input signal from a controller connected to the server device and providing a first input signal; an operation of displaying the first execution result content; an operation of receiving, from the server device, an input signal from the controller indicating a default value that is transmitted to the server device by the controller; an operation of displaying a user interface screen for controlling the display device upon receiving the first input signal indicating the default value; and an operation of receiving a second input signal from the controller and controlling the display device based on the second input signal while displaying the user interface screen.
[0025] The operating method of the server device includes an operation of transmitting a first execution result content obtained by performing a content application to a display device, an operation of receiving a first input signal from a controller, an operation of identifying whether the first input signal indicates a default value, an operation of transmitting the first input signal to the display device when the first input signal is identified as indicating the default value so that the display device can output a user interface screen, and an operation of transmitting a second execution result content obtained by performing the content application using the input signal to the display device when the first input signal is identified as not indicating the default value.
[0026] A computer-readable recording medium having recorded thereon one or more programs to be executed by a processor of a display device for realizing an operating method of a display device, the operating method of the display device including: receiving, from the server device, first execution result content obtained by performing a content application based on an input signal from the controller connected to the server device and providing a first input signal; displaying the first execution result content; receiving, from the server device, a second input signal from the controller indicating a default value that is transmitted to the server device by the controller; displaying a user interface screen for controlling the display device upon receiving the second input signal indicating the default value; and receiving, while displaying the user interface screen, a second input signal from the controller and controlling the display device based on the second input signal. [Brief explanation of the drawings]
[0027] The present invention will be readily understood from the following detailed description in combination with the accompanying drawings, in which reference numerals refer to structural elements.
[0028] [Figure 1] 1 is a reference diagram illustrating operations of a server device and a display device according to various embodiments; [Figure 2] According to one embodiment, an example of a system including a display device, a controller, and a server device is shown. [Figure 3] 1 is a block diagram illustrating an example of a display device according to an embodiment. [Figure 4] 1 illustrates an example of a flowchart of a method for operating a display device according to an embodiment. [Figure 5] 10 illustrates an example of a table for converting controller input signals into display device control signals according to one embodiment. [Figure 6] 1 illustrates an example of a flowchart of a method for operating a server device according to an embodiment. [Figure 7] 1 is a reference diagram illustrating an operation method of a display apparatus in a content playback control mode according to an embodiment; [Figure 8] 1 is a reference diagram illustrating an operation method of a display device in a menu mode according to an embodiment; [Figure 9] 10 is a reference diagram illustrating an example of a method for connecting a server device and a controller via a display device according to an embodiment. [Figure 10] 10 is a reference diagram for explaining an example of a method for receiving a controller input signal through a server device in a menu mode of a display device according to an embodiment. [Figure 11] 10 is a reference diagram for explaining an example of a method for directly receiving a controller input signal from a controller to a display device in a menu mode of the display device according to an embodiment. [Figure 12] 10 illustrates an example of a flowchart of a method for operating a controller, a server device, and a display device to connect the controller and the server device by executing content, according to an embodiment. [Figure 13] 10 is a flowchart illustrating an example of a method for operating a controller, a server device, and a display device according to an embodiment. [Figure 14] 10 is a flowchart illustrating an example of a method for operating a controller, a server device, and a display device according to an embodiment. [Figure 15] 10 is a flowchart illustrating an example of a method for operating a controller, a server device, and a display device according to an embodiment. [Figure 16] 10 is a flowchart illustrating an example of a method for operating a controller, a server device, and a display device according to an embodiment. [Figure 17] 10 is a flowchart illustrating an example of a method for operating a controller, a server device, and a display device according to an embodiment. [Figure 18] 10 is a flowchart illustrating an example of a method for operating a controller, a server device, and a display device according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0029] The terms used in this specification will be briefly explained below, and the present invention will be described in detail.
[0030] The terms used in this invention are currently commonly used and have been selected as much as possible while taking into consideration the functions of the present invention. However, this may change depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. In addition, in certain cases, the applicant may arbitrarily select terms, and in such cases, the meanings thereof will be described in detail in the description of the invention. Therefore, the terms used in this invention must be defined based on the meanings of the terms and the overall content of the present invention, rather than simply by the names of the terms.
[0031] Throughout the specification, when a part "includes" a certain component, this does not mean that it excludes other components, but that it may further include other components, unless otherwise specified. Furthermore, terms such as "unit" and "module" used in the specification refer to a unit that processes at least one function or operation, and this may be realized by hardware or software, or a combination of hardware and software.
[0032] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily understand and practice the present invention. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts that are not relevant to the description will be omitted, and similar parts will be designated by similar reference numerals throughout the specification.
[0033] In the examples herein, the term "user" refers to a person who controls the function or operation of a computer or electronic device using a control device, and may include a viewer, an administrator, or an installation technician.
[0034] FIG. 1 is a reference diagram for explaining the operation of a server device and a display device according to various embodiments.
[0035] 1, the server device 300 may execute a content application in response to a request from the display device 100 and transmit a result screen resulting from the execution of the content application to the display device 100 via a communication network. For example, when the server device 300 receives a request to execute a game application from the display device 100, the server device 300 may execute the game application and transmit a result screen or result image rendered by the execution of the game application to the display device 100 via the communication network.
[0036] The display device 100 may transmit a request to execute a content application to the server device 300, receive a result screen resulting from the execution of the content application from the server device 300 in response to the execution request, and display the received result screen 30 on a display.
[0037] The controller 200 may transmit an operation command for controlling content resulting from the execution of an application displayed on the display device 100 to the server device 300 via a communication network or directly to the display device 100. In particular, the controller 200 disclosed in the present disclosure may transmit an operation command input by a user to the controller 200 to the server device 300 by communicating with the server device 300 via the Internet. A user may operate the controller 200 to control the displayed content while viewing content displayed on the display device 100, and the controller 200 may transmit the operation command input by the user to the server device 300. The server device 300 may execute an application according to the content operation command received from the controller 200 and transmit content resulting from the execution of the application to the display device 100. By transmitting the operation command from the controller 200 directly to the server device 300 rather than via the display device 100, content control can be performed more quickly.
[0038] In this situation where the controller 200 is directly connected to the server device 300 and transmits an operation command to the server device 300, if a menu for controlling the display device 100 is executed on the display device 100, how to control the display device 100 may be an issue. For example, while a user is viewing and controlling content using the display device 100, a situation may arise in which the user desires to control the display device 100. For example, when a user is playing game content through the display device 100 and desires to increase the volume of the display device 100 or adjust the screen brightness of the display device 100, the display device 100 may operate in a menu mode for controlling the display device 100. In this case, the controller 200 transmits an operation command to the server device 300, and the server device 300 operates to transmit an application execution result corresponding to the operation command to the display device 100. However, the display device 100 does not directly receive an input signal from the controller 200. Therefore, a method is required for the display device 100 to receive a control signal for controlling the display device 100 in such a menu mode.
[0039] According to an embodiment, the display apparatus 100 may notify the server apparatus 300 of information regarding input signals having default values among the input signals used by the controller 200. The server apparatus 300 may identify any input signals having default values among the input signals received from the controller 200 and enable the display apparatus 100 to operate in the menu mode. That is, if the input signal does not have the default value, the server apparatus 300 may perform a content application based on the input signal from the controller 200 and transmit the execution result content to the display apparatus 100. On the other hand, if the server apparatus 300 receives an input signal having the default value from the controller 200, it may transmit the received input signal to the display apparatus 100 as is. If so, the display apparatus 100 may display a user interface screen 50 for controlling the display apparatus 100 on the display so that the display apparatus 100 operates in the menu mode based on the reception of the input signal having the default value.
[0040] According to one embodiment, the display device 100 may receive an input signal from the controller 200 via the server device 300 while a user interface screen for controlling the display device 100 is displayed (menu mode), and may perform control of the display device 100 based on the received input signal.
[0041] In one embodiment, while a user interface screen for controlling the display device 100 is displayed (menu mode), the display device 100 may transmit a control command to the controller 200 instructing the controller 200 to transmit an input signal from the controller 200 directly to the display device 100, and may receive the input signal directly from the controller 200 to control the display device 100.
[0042] In one embodiment, the display device 100 detects the end of the menu mode, i.e., the end of the user interface screen, and transmits information indicating the end of the menu mode to the server device 300. When the server device 300 receives an input signal from the controller 200, the display device 100 can execute a content application based on the input signal and transmit the execution result content.
[0043] In one embodiment, the display device 100 detects the end of the menu mode, i.e., the end of the user interface screen, and transmits information indicating the end of the menu mode to the controller 200, thereby controlling the controller 200 to transmit an input signal from the controller 200 to the server device 300.
[0044] FIG. 2 illustrates an example of a system including a display device, a controller, and a server device according to one embodiment.
[0045] Referring to FIG. 2, the system may include a display device 100, a controller 200, and a server device 300, all of which are connected to a communication network.
[0046] The display device 100 is a device capable of displaying images or data at the request of a user, and may include a communication unit 110, a display 120, a memory 130, and a processor 140.
[0047] The communication unit 110 may include one or more modules that enable wireless communication between the display device 100 and a wireless communication system or between the display device 100 and a network in which a different device is located. According to an embodiment, the communication unit 110 may communicate with the controller 200 using a short-range communication technology. Examples of short-range communication technologies include Bluetooth communication, Wi-Fi communication, and infrared communication. According to an embodiment, the communication unit 110 may communicate with the server device 300 using an Internet Protocol.
[0048] The display 120 may output images and data processed by the display device 100 .
[0049] The memory 130 may store programs for processing and control by the processor 140 and may store data input to or output from the display device 100. The memory 130 may also store data necessary for the operation of the display device 100.
[0050] The memory 130 may include at least one type of recording medium including a flash memory type, a hard disk type, a multimedia card micro type, a card-type memory (e.g., SD or XD memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk.
[0051] The processor 140 controls the overall operation of the display device 100. For example, the processor 140 may execute one or more instructions stored in the memory 130 to perform the functions of the display device 100 described in this disclosure.
[0052] In an embodiment of the present disclosure, processor 140 may store one or more instructions in an internal memory and control the operation of the display device by executing the one or more instructions stored in the internal memory. That is, processor 140 may perform a predetermined operation by executing at least one instruction or program stored in an internal memory provided within processor 140 or memory 130.
[0053] According to one embodiment, the processor 140 may execute one or more instructions stored in the memory 130 to perform the operations of the display device 100 disclosed herein.
[0054] In one embodiment, the processor 140 may execute one or more instructions stored in the memory 130 to control the communication interface to receive execution result content obtained by executing a content application from the server based on an input signal from a controller connected to the server and providing the input signal.
[0055] According to one embodiment, processor 140 may control the display to display the resulting content by executing one or more instructions stored in memory 130 .
[0056] In one embodiment, processor 140 may execute one or more instructions stored in memory 130 to control the communication interface to receive an input signal from the server from the controller indicating a predetermined value.
[0057] In one embodiment, the processor 140 may execute one or more instructions stored in the memory 130 to display a user interface screen for controlling the display device upon receiving an input signal indicating the default value.
[0058] In one embodiment, the processor 140 may execute one or more instructions stored in the memory 130 to receive input signals from the controller and control the display device based on the input signals while displaying the user interface screen.
[0059] In one embodiment, processor 140 may execute one or more instructions stored in memory 130 to control the communication interface to receive input signals from the controller via the server or directly from the controller while displaying the user interface screen.
[0060] In one embodiment, processor 140 may execute one or more instructions stored in memory 130 to control the display to terminate the display of the user interface screen in response to an input signal to terminate the user interface screen while displaying the user interface screen.
[0061] In one embodiment, the processor 140 may execute one or more instructions stored in the memory 130 to control the communication interface to transmit a signal to the server indicating that the display device is to operate in a content playback control mode upon closure of the user interface screen.
[0062] In one embodiment, the processor 140 may execute one or more instructions stored in the memory 130 to control the communication interface to receive execution result content obtained by executing the content application from the server in response to an input signal received from the controller, by transmitting a signal indicating that the display device is operating in a content playback control mode.
[0063] In one embodiment, processor 140 may execute one or more instructions stored in memory 130 to identify whether the content application type is a predefined type.
[0064] In one embodiment, the processor 140 may execute one or more instructions stored in the memory 130 to control the communication interface to transmit to the server a list including one or more input signals indicating the default value because the type of the content application is the default type.
[0065] In one embodiment, the processor 140 executes one or more instructions stored in the memory 130 to identify whether the type of the content application is a predetermined type, and if the type of the content application is the predetermined type, transmits to the controller information enabling the controller to directly connect to the server and an instruction to control the connection to the server.
[0066] The display device 100 may be any type of device that performs functions including a processor and memory. The display device 100 may be a fixed or portable device. For example, the display device 100 may refer to a device that has a display and displays image content, video content, game content, graphic content, etc. The display device 100 may output or display images or content received from the server device 300. The display device 100 may include various types of electronic devices that can receive and output content, such as televisions such as network TVs, smart TVs, Internet TVs, web TVs, and IPTVs; computers such as desktops, laptops, and tablets; and various smart devices such as smartphones, cellular phones, game players, music players, video players, medical equipment, and home appliances. The display device 100 may also be referred to as a display device because it receives and displays content, and may also be referred to as a content receiving device, sink device, electronic device, computer device, etc.
[0067] The display device 100 shown in FIG. 2 is a block diagram of one embodiment. The components of the block diagram may be integrated, added, or omitted depending on the specifications of the display device 100 actually implemented. For example, two or more components may be combined into one component, or one component may be divided into two or more components, as needed. Furthermore, the functions performed by each block are for the purpose of explaining the embodiment, and the specific operations and devices thereof do not limit the scope of the present invention.
[0068] The controller 200 will now be described.
[0069] The controller 200 may include a communication unit 210, a user input unit 220, a memory 230, and a processor 240. However, the controller 200 may be embodied with more components than those shown and is not limited to the above examples.
[0070] The communication unit 210 may include one or more modules that enable wireless communication between the controller 200 and a wireless communication system or between the controller 200 and a network in which a different device is located. According to an embodiment, the communication unit 210 may communicate with the display device 100 using a short-range communication technology. Examples of short-range communication technologies include Bluetooth communication, Wi-Fi communication, and infrared communication. According to an embodiment, the communication unit 210 may communicate with the server device 300 using an Internet Protocol (IP).
[0071] User input unit 220 may be any type of interface means capable of receiving user input, including, for example, operation buttons arranged on a portion of controller 200 for receiving user input, a touch-sensitive display configured to sense touch input, a microphone for receiving user voice input, etc.
[0072] The memory 230 may store programs for processing and control by the processor 240 and may store data input to or output from the controller 200 .
[0073] The memory 230 may include at least one type of recording medium including a flash memory type, a hard disk type, a multimedia card micro type, a card-type memory (e.g., SD or XD memory), a RAM (Random Access Memory), an SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.
[0074] The processor 240 controls the overall operation of the controller 200. For example, the processor 240 may execute one or more instructions stored in the memory 230 to perform the functions of the controller 200 described in this disclosure.
[0075] In an embodiment of the present disclosure, the processor 240 may store one or more instructions in an internal memory and execute the one or more instructions stored in the internal memory to perform the above-described operations. That is, the processor 240 may execute at least one instruction or program stored in an internal memory provided within the processor 240 or in the memory 230 to perform a predetermined operation.
[0076] According to one embodiment, the processor 240 may execute one or more instructions stored in the memory 230 to establish a communication connection with the display device 100 using a short-range wireless communication technology. The short-range wireless communication technology may include Bluetooth® communication technology or Wi-Fi Direct technology.
[0077] According to an embodiment, the processor 240 may execute one or more instructions stored in the memory 230 to receive information for a wireless communication connection from the display device 100 and perform a wireless communication connection using the received information for the wireless communication connection, thereby connecting to the access point 70. For example, the information for the wireless communication connection is information for connecting to the access point, and may include an access point ID and a password for connecting to the access point.
[0078] According to an embodiment, the processor 240 may execute one or more instructions stored in the memory 230 to receive information for connecting to the server device 300 from the display device 100 and connect to the server device 300 using the received information for connecting to the server device 300. For example, the server device 300 connection information may include a URL for accessing the server device 300, a user ID and a password as user account information for connecting to the server device 300, etc.
[0079] In one embodiment, the processor 240 may execute one or more instructions stored in the memory 230 to receive a list of input signals indicating predetermined values from the display device 100 and transmit the received input signal list to the server device 300.
[0080] In one embodiment, the processor 240 may execute one or more instructions stored in the memory 230 to transmit an input signal corresponding to a user input received via the user input unit 220 to the server device 300 or the display device 100.
[0081] In one embodiment, the processor 240 may execute one or more instructions stored in the memory 230 to receive information indicating that the display device 100 is in menu mode, and transmit an input signal corresponding to a user input received via the user input unit 220 to the display device 100.
[0082] In one embodiment, the processor 240 may execute one or more instructions stored in the memory 230 to receive information indicating the end of the menu mode from the display device 100, and transmit an input signal corresponding to the user input received via the user input unit 220 to the server device 300.
[0083] The controller 200 may be any type of device that includes a processor and memory and performs functions, and may include various electronic devices such as a remote controller, a game controller, a smartphone, etc.
[0084] 2 is a block diagram of an embodiment. The components of the block diagram may be integrated, added, or omitted depending on the specifications of the controller 200 actually implemented. For example, two or more components may be integrated into one component, or one component may be divided into two or more components, as needed. Furthermore, the functions performed by each block are provided for purposes of illustrating the embodiment, and the specific operations and devices thereof do not limit the scope of the present invention.
[0085] The server device 300 will be described below.
[0086] The server device 300 may include a communication unit 310, a memory 320, and a processor 330. However, the server device 300 may be implemented with more components than those shown in the figure and is not limited to the above example. For example, the server device 300 may include a separate image processing unit for image processing of application images executed on the server device 300.
[0087] The communication unit 310 may include one or more modules that enable wireless communication between the server device 300 and a wireless communication system or between the server device 300 and a network in which a different device is located. According to an embodiment, the communication unit 310 may communicate with the display device 100 using an Internet Protocol. According to an embodiment, the communication unit 310 may communicate with the controller 200 using an Internet Protocol.
[0088] The memory 320 may store programs for processing and control by the processor 330 and may store data input to or output from the server device 300 .
[0089] The memory 320 may include at least one type of recording medium including a flash memory type, a hard disk type, a multimedia card micro type, a card-type memory (e.g., SD or XD memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk.
[0090] The processor 330 controls the overall operation of the server device 300. For example, the processor 330 may execute one or more instructions stored in the memory 320 to perform the functions of the server device 300 described herein.
[0091] In an embodiment of the present disclosure, the processor 330 may store one or more instructions in an internal memory and execute the one or more instructions stored in the internal memory to perform the above-described operations. That is, the processor 330 may execute at least one instruction or program stored in an internal memory provided within the processor 330 or in the memory 320 to perform a predetermined operation.
[0092] In one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to receive a request to execute a content application from the display device 100, and transmit content to the display device 100 as a result of executing the requested content application.
[0093] In one embodiment, the processor 330 may receive an input signal list indicating a predetermined value from the display device 100 or the controller 200 by executing one or more instructions stored in the memory 320, and store the received input signal list.
[0094] In one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to receive information indicating a content playback control mode of the display device 100 from the display device 100, perform a content application based on an input signal received from the controller 200, and transmit the execution result content to the display device 100.
[0095] In one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to transmit the input signal indicating the default value to the display device 100 as is, when the input signal received from the controller 200 indicates a default value.
[0096] In one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to receive information indicating the menu mode of the display device 100 from the display device 100, and transmit the input signal received from the controller 200 directly to the display device 100.
[0097] In one embodiment, the processor 330 may control the communication interface to execute one or more instructions stored in the memory 320 to transmit execution result content obtained by executing a content application to a display device.
[0098] According to one embodiment, processor 330 may execute one or more instructions stored in memory 320 to control the communication interface to receive input signals from a controller.
[0099] According to one embodiment, processor 330 may execute one or more instructions stored in memory 320 to identify whether the input signal represents a predetermined value.
[0100] In one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to control the communication interface to transmit the input signal to the display device so that the display device can output a user interface screen when the input signal is identified as representing the predetermined value.
[0101] In one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to identify that the input signal does not indicate the default value, and thereby control the communication interface to transmit execution result content obtained by executing the content application according to the input signal to the display device.
[0102] In one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to control the communication interface to transmit input signals received from the controller to the display device while the display device is operating in a menu mode that outputs the user interface screen.
[0103] In one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to control the communication interface to receive a signal from the display device indicating that the display device is operating in a content playback control mode while the display device is operating in the menu mode.
[0104] In one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to recognize that the display device is to operate in the content playback control mode upon receiving the signal.
[0105] In one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to control the communication interface to transmit execution result content obtained by executing the content application to the display device in response to the input signal received from the controller based on the recognition.
[0106] According to one embodiment, the processor 330 may execute one or more instructions stored in the memory 320 to receive and store a list from the display device that includes one or more input signals that indicate the predetermined value.
[0107] The server device 300 shown in FIG. 2 is a block diagram of one embodiment. The components of the block diagram may be integrated, added, or omitted depending on the specifications of the server device 300 actually implemented. For example, two or more components may be integrated into one component, or one component may be divided into two or more components, as needed. Furthermore, the functions performed by each block are for the purpose of explaining the embodiment, and the specific operations and devices thereof do not limit the scope of the present invention.
[0108] FIG. 3 is an example block diagram of a display device according to one embodiment.
[0109] Referring to FIG. 3, the display device 100 may include a communication unit 110, a display 120, a memory 130, a processor 140, an image processing unit 150, an audio processing unit 160, an audio output unit 170, a receiving unit 180, and a sensing unit 190.
[0110] The communication unit 110 may include one or more modules that enable wireless communication between the display device 100 and a wireless communication system, or between the display device 100 and a network in which different electronic devices are located. For example, the communication unit 110 may include a mobile communication module 111, a wireless Internet module 112, and a short-range communication module 113.
[0111] The mobile communication module 111 transmits and receives wireless signals to and from at least one of a base station, an external terminal, and a server over a mobile communication network. The wireless signals may include various types of data such as a voice call signal, a video call signal, or a text / multimedia message signal.
[0112] The wireless internet module 112 is a module for wireless internet connection and may be built into or external to the display apparatus 100. Wireless internet technologies that may be used include Wireless LAN (WLAN) (WiFi), Wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), and High Speed Downlink Packet Access (HSDPA). Through the wireless internet module 112, the display apparatus 100 can be connected to other devices via Wi-Fi P2P (Peer to Peer).
[0113] The short-range communication module 113 is a module for short-range communication. Short-range communication technologies that can be used include Bluetooth (registered trademark), Bluetooth Low Energy (BLE), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), and ZigBee.
[0114] The display 120 can display the video signal received from the server device 300 on the screen.
[0115] The memory 130 may store programs related to the operation of the display device 100 and various data generated during the operation of the display device 100 .
[0116] The memory 130 may store at least one instruction. The memory 130 may also store at least one instruction executed by the processor 140. The memory 130 may also store at least one program executed by the processor 140. The memory 130 may also store an application for providing a predetermined service.
[0117] Specifically, the memory 130 may include at least one type of recording medium among a flash memory type, a hard disk type, a multimedia card micro type, a card-type memory (e.g., SD or XD memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk.
[0118] The processor 140 controls the overall operation of the display device 100. For example, the processor 140 may execute one or more instructions stored in the memory 130 to perform the functions of the display device 100 described in this disclosure.
[0119] In an embodiment of the present disclosure, processor 140 may store one or more instructions in an internal memory and control the operation of the display device by executing the one or more instructions stored in the internal memory. That is, processor 140 may perform a predetermined operation by executing at least one instruction or program stored in an internal memory provided within processor 140 or memory 130.
[0120] The image processing unit 150 may process an image signal received from the receiving unit 180 or the communication unit 110 under the control of the processor 140 and output the processed image signal to the display 120 .
[0121] Under the control of the processor 140 , the audio processing unit 160 can convert an audio signal received from the receiving unit 180 or the communication unit 110 into an analog audio signal and output it to the audio output unit 170 .
[0122] The audio output unit 170 may output audio (e.g., voice, sound) input via the communication unit 110 or the receiving unit 180. The audio output unit 170 may also output audio stored in the memory 130 under the control of the processor 140. The audio output unit 170 may include at least one of a speaker, a headphone output terminal, and an S / PDIF (Sony / Philips Digital Interface) output terminal, or a combination thereof.
[0123] The receiving unit 180 may receive video (e.g., moving images), audio (e.g., voice, music), and additional information (e.g., EPG) from outside the display device 100 under the control of the processor 140. The receiving unit 180 may include one or a combination of one or more of an HDMI (registered trademark) port 181, a component jack 182, a PC port 183, and a USB port 184. In addition to the HDMI (registered trademark) port 181, the receiving unit 180 may further include a Display Port (DP), Thunderbolt, and Mobile High-Definition Link (MHL).
[0124] The sensing unit 190 senses the user's voice, the user's image, or the user's interaction, and may include a microphone, a camera unit, and an optical receiver unit.
[0125] The microphone receives the user's utterance and converts the received voice into an electrical signal, which can be output to the processor 140. The user voice may include, for example, a voice corresponding to a menu or function of the display device 100.
[0126] The camera unit may receive images (e.g., consecutive frames) corresponding to user motions, including gestures, within the camera's recognition range. The processor 140 may use the received motion recognition results to select a menu to be displayed on the display device 100 or perform control corresponding to the motion recognition results.
[0127] The optical receiver receives optical signals (including control signals) from an external control device. The optical receiver may receive optical signals corresponding to user input (e.g., touch, pressure, touch gesture, voice, or motion) from the control device. The control signals may be extracted from the received optical signals under the control of the processor 140.
[0128] The memory 130 may store programs related to the operation of the display device 100 and various data generated during the operation of the display device 100 .
[0129] The processor 140 performs the function of controlling the overall operation of the display device 100 and the flow of signals between internal components (not shown) of the display device 100 and processing data. When there is a user input or when a preset stored condition is satisfied, the processor 140 can execute an operating system (OS) and various applications stored in the memory 130.
[0130] The processor 140 may include a graphics processor (Graphic Processing Unit, not shown) for graphics processing corresponding to video. The graphics processing unit (not shown) generates a screen including various objects such as icons, images, and text using a calculation unit (not shown) and a rendering unit (not shown). The calculation unit calculates attribute values such as coordinates, shape, size, and color at which each object is displayed according to the screen layout using user interaction detected through the sensing unit 190. The rendering unit generates a screen with various layouts including the objects based on the attribute values calculated by the calculation unit.
[0131] In one embodiment, the processor 140 may execute one or more instructions to control the communication interface to receive from the server 200 execution result content obtained by executing a content application based on an input signal from a controller coupled to the server 200 and providing the input signal.
[0132] According to one embodiment, processor 140 may execute one or more instructions to control the display to display the resulting content received from the server.
[0133] According to one embodiment, processor 140 may execute one or more instructions to control the communication interface to receive an input signal from the server from the controller indicating a predetermined value.
[0134] According to one embodiment, processor 140 may execute one or more instructions to display a user interface screen for controlling the display device upon receiving an input signal indicating the predetermined value.
[0135] In one embodiment, the processor 140 may execute one or more instructions to receive input signals from the controller and perform operations to control the display device based on the input signals while displaying the user interface screen.
[0136] In one embodiment, processor 140 may execute one or more instructions to control the communication interface to receive input signals from the controller via the server or directly from the controller while displaying the user interface screen.
[0137] In one embodiment, processor 140 may execute one or more instructions to control the display to terminate the display of the user interface screen upon an input signal to terminate the user interface screen while displaying the user interface screen.
[0138] In one embodiment, the processor 140 may execute one or more instructions to control the communication interface to transmit a signal to the server indicating that the display device is to operate in a content playback control mode upon closure of the user interface screen.
[0139] In one embodiment, the processor 140 may execute one or more instructions to control the communication interface to receive execution result content obtained by executing the content application from the server in response to an input signal received from the controller, by transmitting a signal indicating that the display device is operating in a content playback control mode.
[0140] In one embodiment, the processor 140 may execute one or more instructions to identify whether the type of the content application is a default type, and, because the type of the content application is the default type, control the communication interface to transmit to the server a list including one or more input signals indicating the default value.
[0141] In one embodiment, the processor 140 may execute one or more instructions to identify whether the type of the content application is a predetermined type, and if the type of the content application is the predetermined type, may transmit to the controller information enabling the controller to directly connect to the server and a command to control the connection to the server.
[0142] FIG. 4 illustrates an example flowchart of a method for operating a display device according to one embodiment.
[0143] Referring to FIG. 4, in operation 410, the display device 100 may receive content from the server device 300, the content being obtained by running a content application on the server device 300.
[0144] According to an embodiment, the display apparatus 100 may transmit a request to execute a content application to the server apparatus 300, and the server apparatus 300 may execute the content application in response to the execution request received from the display apparatus 100. The server apparatus 300 may then transmit content resulting from the execution of the content application to the display apparatus 100. The display apparatus 100 may provide information about the content application and an item or interface for requesting the execution of the content application to enable the execution of the content application to be requested. When a user selects the content application by controlling the item or interface, the display apparatus 100 may transmit a request to the server apparatus 300 to execute the content application requested by the user. The server apparatus 300 may execute the requested content application and transmit images or screens resulting from the execution to the display apparatus 100. For example, if the content is game content, the server apparatus 300 may execute the game application and transmit images or screens resulting from the execution, such as a prequel image or intro screen that appears initially when the game content is executed, or an information screen related to the game content, to the display apparatus 100.
[0145] In operation 420, the display device 100 may receive, from the server device 300, the execution result content obtained by executing the content application based on the input signal from the controller 200, and display the received execution result content.
[0146] According to an embodiment, the controller 200 may be connected to the server device 300 via a wireless communication network and transmit an input signal to the server device 300 according to a user operation.
[0147] According to an embodiment, when the server device 300 receives an input signal from the controller 200 , the server device 300 may execute and control a content application using the received input signal, and transmit the resulting execution content to the display device 100 .
[0148] According to an embodiment, the display device 100 may display content resulting from the execution of a content application received from the server device 300 .
[0149] For example, while the display device 100 displays game content received from the server device 300, a user may use the controller 200 to perform a user input to play the game content. The controller 200 may receive an input signal corresponding to the user input, for example, a user operation for moving a character in the game content, and transmit the input signal corresponding to the character movement to the server device 300. The server device 300 may then perform a calculation to move the character based on the input signal corresponding to the character movement, and transmit the resulting content, i.e., a screen on which the character has been moved, to the display device 100.
[0150] In operation 430, the display device 100 may display a user interface screen for controlling the display device 100 by receiving an input signal from the server device 300 from the controller indicating a default value.
[0151] According to an embodiment, the display apparatus 100 may receive a controller input signal indicating a default value from the server apparatus 300. For example, when the display apparatus 100 receives a signal indicating a default value, i.e., “aaa1,” from the server apparatus 300 among the controller input signals as illustrated in FIG. 5, the display apparatus 100 may identify that it has received the input signal indicating the default value.
[0152] In one embodiment, when the server device 300 receives an input signal from the controller 200, if the input signal does not indicate a default value, the server device 300 executes a content application based on the input signal and transmits an execution result screen to the display device 100; however, if the input signal indicates a default value, the server device 300 may transmit the input signal indicating such a default value to the display device 100 as is.
[0153] According to one embodiment, the display device 100 may display a user interface screen for controlling the display device 100 by receiving an input signal indicating a default value from the server device 300. The user interface screen for controlling the display device 100 may, for example, display a menu screen for controlling user-adjustable components of the display device 100. For example, the menu screen may include one or more items or buttons for controlling the volume, display brightness, or audio input / output interface of the display device 100.
[0154] At operation 440, the display device 100 may control the display device 100 based on the input signal from the controller while displaying the user interface screen.
[0155] According to an embodiment, the display device 100 may receive an input signal from a controller and control the display device 100 based on the received input signal while displaying a user interface screen.
[0156] According to an embodiment, the display device 100 may receive an input signal from the controller 200 directly from the controller 200 or may receive the input signal from the controller 200 via the server device 300 while displaying the user interface screen.
[0157] For example, a user may increase the volume of the display device 100 through a user interface screen by performing a volume increase operation on the controller 200, and the controller 200 may transmit an input signal corresponding to the volume increase operation directly to the display device 100 or to the server device 300. The server device 300 may transmit the input signal received from the controller 200 to the display device 100. The display device 100 that receives the input signal from the server device 300 or the controller 200 may convert the input signal into a display device control signal and control the display device 100 using the converted display device control signal.
[0158] According to one embodiment, the display device 100 may convert an input signal from the controller 200 using a controller input signal-display device control signal conversion table.
[0159] FIG. 5 shows an example of a table for converting controller input signals into display device control signals according to one embodiment.
[0160] Referring to FIG. 5, a controller input signal-display device control signal conversion table 500 may represent a mapping table that can convert an input signal from the controller 200 into a display device control signal.
[0161] A controller input signal-display device control signal conversion table 500, which converts an input signal from the controller 200 into a display device control signal used to control a display device, may represent a mapping table of input signal values from the controller 200 and display device control signal values. Referring to Figure 5, each of input signal values aaa1, aaa2, aaa3, aaa4, aaa5, and aaa6 of the controller 200 may be mapped to display device control signal values d1, d2, d3, d4, d5, and d6, respectively.
[0162] In this manner, while the display device 100 is operating in a menu mode for controlling the display device, the display device 100 can control the display device by converting the input signal from the controller 200 into a display device control signal by converting it using the conversion table shown in FIG. 5 so that the input signal can be used to control the display device.
[0163] According to one embodiment, a method for operating a display device may include receiving execution result content obtained by performing a content application from a server based on an input signal from a controller connected to the server and providing the input signal.
[0164] According to an embodiment, a method for operating a display device may include displaying the execution result content.
[0165] According to one embodiment, a method for operating a display device may include receiving an input signal from the server, the input signal being from the controller and indicating a predetermined value.
[0166] According to an embodiment, a method for operating a display device may include displaying a user interface screen for controlling the display device in response to receiving an input signal indicating the predetermined value.
[0167] According to an embodiment, a method for operating a display device may include receiving an input signal from the controller and controlling the display device based on the input signal while displaying the user interface screen.
[0168] According to an embodiment, a method for operating a display device may include, while displaying the user interface screen, receiving an input signal from the controller via the server or directly from the controller. According to an embodiment, a method for operating a display device may include, while displaying the user interface screen, ending display of the user interface screen in response to an input signal for ending the user interface screen.
[0169] According to an embodiment, a method for operating a display device may include transmitting a signal indicating that the display device operates in a content playback control mode to the server upon termination of the user interface screen.
[0170] According to one embodiment, a method for operating a display device may include receiving, from the server, execution result content obtained by performing the content application according to an input signal received from the controller by transmitting a signal indicating that the display device is operating in a content playback control mode.
[0171] According to an embodiment, a method for operating a display device may include an operation of identifying whether the type of the content application is a predetermined type.
[0172] According to an embodiment, a method of operating a display apparatus may include transmitting a list including one or more input signals indicating the default value to the server since the type of the content application is the default type.
[0173] According to an embodiment, a method for operating a display device may include an operation of identifying whether the type of the content application is a predetermined type.
[0174] According to one embodiment, a method of operating a display device may include transmitting to the controller information for enabling the controller to directly connect to the server and a command to control the connection to the server because the type of the content application is the predetermined type.
[0175] FIG. 6 illustrates an example of a flowchart of a method of operating a server device according to an embodiment.
[0176] Referring to FIG. 6, in operation 610, the server device 300 may transmit execution result content obtained by executing the content application to the display device 100.
[0177] According to an embodiment, the server device 300 may receive a request to execute a content application from the display device 100 and transmit execution result content obtained by executing the content application in response to the execution request to the display device 100.
[0178] At operation 620, the server device 300 may receive an input signal from the controller 200 and identify whether the received input signal indicates a predetermined value.
[0179] According to an embodiment, the server device 300 receives and stores a list of input signals indicating default values from the display device 100, or receives and stores a list of input signals indicating default values from the controller 200. For example, in the conversion table illustrated in FIG. 5, the server device 300 receives and stores the list of input signals indicating default values from the device controller input signals. <aaa1>For example, <aaa1>may be a value of a signal corresponding to pressing of the home key among one or more keys provided on the controller 200.
[0180] According to an embodiment, when the server device 300 receives an input signal from the controller 200, the server device 300 may determine whether the value of the received input signal indicates a predetermined value.
[0181] At operation 630, the server device 300 may determine whether the input signal from the controller 200 indicates a default value, and if so, proceed to operation 640; if not, proceed to operation 650.
[0182] In operation 640, if the server device 300 determines that the input signal from the controller 200 indicates a default value, the server device 300 may transmit the input signal to the display device 100 to cause the display device 100 to operate in the menu mode.
[0183] According to an embodiment, when the server device 300 determines that the input signal from the controller 200 indicates a default value, the server device 300 may transmit the input signal received from the controller 200 to the display device 100 as is. If so, the display device 100 that receives the input signal indicating the default value may display a user interface screen for controlling the display device 100. The mode for controlling the display device 100 in which the display device 100 displays the user interface screen in this manner may be referred to as a menu mode.
[0184] At operation 650, if the server device 300 determines that the input signal from the controller 200 does not indicate a default value, it may transmit the execution result content obtained by performing the content application to the display device 100 using the input signal from the controller 200.
[0185] According to an embodiment, when the server device 300 determines that the input signal from the controller 200 does not indicate a predetermined value, the server device 300 may use the input signal from the controller 200 to control the execution of a content application. That is, the server device 300 may perform a calculation for executing the content application using the input signal from the controller 200, and transmit the execution result content obtained by performing the calculation to the display device 100. A mode in which the display device 100 displays content from the server device 300 and the playback of the content displayed on the display device 100 is controlled based on the input signal from the controller 200 may be referred to as a content playback control mode.
[0186] According to an embodiment, a method of operating a server device may include transmitting execution result content obtained by executing a content application to a display device.
[0187] According to one embodiment, a method of operating a server device may include receiving an input signal from a controller.
[0188] According to one embodiment, the method of operating the server device may include an operation of identifying whether the input signal indicates a predetermined value.
[0189] According to one embodiment, a method of operating a server device may include transmitting the input signal to the display device so that the display device can output a user interface screen when the input signal is identified as indicating the predetermined value.
[0190] According to one embodiment, the operating method of the server device may include an operation of transmitting execution result content obtained by performing the content application according to the input signal to the display device when the input signal is identified as not indicating the default value.
[0191] According to an embodiment, a method for operating a server device may include transmitting an input signal received from the controller to the display device while the display device operates in a menu mode to output the user interface screen.
[0192] According to an embodiment, a method for operating a server device may include receiving, from the display device, a signal indicating that the display device operates in a content playback control mode while the display device operates in the menu mode.
[0193] According to an embodiment, the method of operating the server device may include an operation of recognizing that the display device operates in the content playback control mode upon receiving the signal.
[0194] According to an embodiment, the method of operating the server device may include transmitting execution result content obtained by executing the content application according to the input signal received from the controller through the recognition to the display device.
[0195] FIG. 7 is a reference diagram for explaining an operation method of the display apparatus 100 in the content playback control mode according to an embodiment.
[0196] 7, in the content playback control mode, the display apparatus 100 may receive and display execution result content 30 of an application executed from the server apparatus 300. When a user wishes to control the execution of content displayed on the display apparatus 100, the user may operate one or more input keys or buttons provided on the controller 200.
[0197] According to an embodiment, when a user inputs an operation, the controller 200 may transmit an input signal corresponding to the user input to the server device 300. The server device 300, which has received the input signal from the controller 200 in this manner, may execute an application using the input signal from the controller 200 in the content playback control mode of the display device 100. According to an example, the server device 300 may receive a signal from the display device 100 indicating that the display device 100 is in the content playback control mode. For example, when content that can be executed and controlled by the user is in the foreground layer among one or more layers output to the display, the display device 100 may identify the display device as being in the content playback control mode.
[0198] The server device 300 may perform a calculation for executing an application using an input signal from the controller 200 and transmit execution result content based on the calculation result to the display device 100 .
[0199] FIG. 8 is a reference diagram for explaining an operation method of a display device in a menu mode according to an embodiment.
[0200] 8, a user may change settings of the display device 100 while playing user-controllable content through the display device 100. For example, when adjusting the sound of the display device 100, adjusting the brightness of the display screen, or changing the language, a menu screen for changing such settings needs to be displayed. In this case, the user may select and press a key corresponding to a default value through the controller 200, thereby transmitting an input signal having the default value to the server device 300.
[0201] When the server device 300 receives an input signal indicating a predetermined value from the controller 200, the server device 300 may directly transmit the input signal to the display device 100 instead of performing an operation for executing an application using the input signal.
[0202] The display device 100 that receives an input signal indicating a default value from the server device 300 can output a user interface screen 50 for controlling the settings of the display device 100 by identifying that the input signal indicates a default value.
[0203] In this way, the display device 100 outputs a user interface screen 50 for controlling the settings of the display device 100, and the settings of the display device 100 can be controlled by user input, so the operating mode of the display device 100 can be identified as a menu mode.
[0204] According to an embodiment, the display apparatus 100 may transmit a signal indicating that the operation mode of the display apparatus 100 is the menu mode to the server apparatus 300. In this case, if the server apparatus 300 receives an input signal from the controller 200 when the operation mode of the display apparatus 100 is the menu mode, the server apparatus 300 may transmit the input signal from the controller 200 to the display apparatus 100 as is.
[0205] According to one embodiment, the display device 100 may transmit a signal indicating that the operation mode of the display device 100 is the menu mode to the controller 200. When the operation mode of the display device 100 is the menu mode, if there is a user input, the controller 200 may transmit an input signal corresponding to the user input to the display device 100 instead of the server device 300.
[0206] FIG. 9 is a reference diagram for explaining an example of a method for connecting a server device and a controller using a display device according to an embodiment.
[0207] 9, the display apparatus 100 may transmit a content application execution request 910 to the server apparatus 300. For example, if a user of the display apparatus 100 desires and selects execution of a particular content application, the display apparatus 100 may transmit to the server apparatus 300 a request to execute the content application selected by the user.
[0208] The display apparatus 100 may acquire information related to the content application requested to be executed. The information related to the content application requested to be executed may be stored in the display apparatus 100 itself or may be received from the server apparatus 300. The information related to the content application may include information indicating whether the application is of a server controller direct connection type.
[0209] According to an embodiment, when the display apparatus 100 identifies that the content application is of a server-controller direct connection type, the display apparatus 100 may perform an operation for directly connecting the controller 200 and the server 300. That is, the display apparatus 100 may transmit information necessary for the server connection operation of the controller 200 and a server connection guidance control command 920 to the controller 200. The information necessary for the server connection operation may include access point connection information for first connecting the controller 200 to the wireless Internet and server connection information for connecting to the corresponding server via the wireless Internet. The access point connection information may include access point identification information and a password for connecting to the access point. The server connection information may include a URL of the server apparatus 300 and a password for connecting to the server apparatus 300. The server connection guidance control command may indicate a control command for guiding the controller 200 to directly connect to the server apparatus 300 using the access point connection information and the server connection information.
[0210] According to an embodiment, when the display apparatus 100 identifies that the content application is of a server controller direct connection type, the display apparatus 100 may transmit an input signal list 940 indicating default values to the server apparatus 300. The input signal list 940 indicating the default values is transmitted so that the display apparatus 100 can switch from the content playback control mode to the menu mode.
[0211] According to one embodiment, the controller 200 may perform an operation of connecting to the server device 300 in response to a server connection guidance control command received from the display device 100. The controller 200 may first connect to the wireless Internet using the access point connection information, and then perform a connection operation 930 to the server device 300 using the server connection information.
[0212] In one embodiment, when the controller 200 receives a user input, it transmits a corresponding input signal 950 to the server device 300, and the server device 300 performs a content application based on the input signal received from the controller 200 and transmits a content application execution result screen 960 to the display device 100.
[0213] The display apparatus 100 operating as described with reference to FIG. 9 may directly connect the controller 200 to the server apparatus 300, thereby enabling the input signal of the controller 200 to be transmitted directly to the server apparatus 300.
[0214] FIG. 10 is a reference diagram for explaining an example of a method for receiving a controller input signal via a server device in a menu mode of a display device according to an embodiment.
[0215] Referring to FIG. 10, the display apparatus 100 may transmit information 1010 indicating that the display apparatus 100 is in a content playback control mode to the server apparatus 300.
[0216] The controller 200 may transmit an input signal 1020 corresponding to the user input to the server device 300 .
[0217] The server device 300 may identify whether the input signal received from the controller 200 indicates a default value, and if it does not indicate a default value, may perform an operation for executing the application using the input signal from the controller 200 and transmit the content execution result screen 1030 to the display device 100.
[0218] If the input signal received from the controller 200 indicates a default value, the server device 300 may transmit the input signal 1040 indicating the default value to the display device 100 as is.
[0219] When the display device 100 receives an input signal indicating a default value, the display device 100 may output a user interface screen for controlling the display device, and may transmit information 1050 indicating that the display device 100 is in the menu mode to the server device 300. The server device 300 may recognize that the display device 100 is in the menu mode.
[0220] When the server device 300 receives an input signal from the controller 200 while the display device 100 is in the menu mode, the server device 300 may transmit the input signal 1060 from the controller 200 to the display device 100 as is. The display device 100 may control the display device based on the input signal from the controller 200. That is, the display device 100 may convert the input signal from the controller 200 into a display device control signal and perform an operation corresponding to the converted display device control signal.
[0221] When the user interface screen for controlling the display device is terminated and the content application screen is again positioned on the foreground layer of the display device, the display device 100 may determine that the menu mode has ended and the content playback control mode has begun. In this case, the display device 100 may transmit information indicating the content playback control mode to the server device 300.
[0222] 10, an example has been described in which the mode controller input signal is received by the display device 100 via the server device 300 in both the content playback control mode and the menu mode. Hereinafter, an example will be described in FIG. 11 in which the controller input signal is received by the display device 100 via the server device 300 in the content playback control mode, but the controller input signal is transmitted directly to the display device 100 without passing through the server device 300 in the menu mode.
[0223] FIG. 11 is a reference diagram for explaining an example of a method for directly receiving a controller input signal from a controller to a display device in a menu mode of a display device according to an embodiment.
[0224] Referring to FIG. 11, the display apparatus 100 may transmit information 1110 indicating that the display apparatus 100 is in a content playback control mode to the server apparatus 300.
[0225] The controller 200 may transmit an input signal 1120 corresponding to the user input to the server device 300 .
[0226] The server device 300 may identify whether the input signal received from the controller 200 indicates a default value, and if it does not indicate a default value, may perform an operation for executing the application using the input signal from the controller 200 and transmit a content execution result screen 1130 to the display device 100.
[0227] If the input signal received from the controller 200 indicates a default value, the server device 300 may transmit the input signal 1140 indicating the default value to the display device 100 as is.
[0228] When the display device 100 receives an input signal indicating a default value, the display device 100 may output a user interface screen for controlling the display device, and may transmit information 1150 indicating that the display device 100 is in the menu mode to the controller 200. The controller 200 may recognize that the display device 100 is in the menu mode.
[0229] The controller 200 may transmit an input signal 1160 corresponding to a user input directly to the display device 100 while the display device 100 is in the menu mode.
[0230] When the display device 100 receives an input signal of the controller 200 from the controller 200, the display device 100 may control the display device based on the input signal of the controller 200. That is, the display device 100 may convert the input signal of the controller 200 into a display device control signal and perform an operation 1170 corresponding to the converted display device control signal.
[0231] Then, when the user inputs to exit the user interface screen, the user interface screen disappears and the content application screen is displayed, the display device 100 may recognize that the menu mode has ended and the content playback control mode has begun. If so, the display device 100 may transmit information 1180 indicating the end of the menu mode to the controller 100 to notify the end of the menu mode.
[0232] When receiving information indicating the end of the menu mode, the controller 200 may transmit an input signal corresponding to the user input to the server device 300 again.
[0233] FIG. 12 illustrates an example of a flowchart of a method of operating a controller, a server device, and a display device for connecting the controller and the server by executing content according to an embodiment.
[0234] 12, in operation 1210, the display apparatus 100 may transmit a content application execution request to the server apparatus 300. For example, the display apparatus 100 may display items for starting execution of a content application, and when the user receives an input to select one of the displayed items, the display apparatus 100 may transmit a content application execution request corresponding to the selected item to the server apparatus 300.
[0235] In operation 1220, the server device 300 may execute the requested content application in response to the content application execution request received from the display device 100. The server device 300 may transmit a content application screen resulting from the execution of the application to the display device 100.
[0236] In operation 1230, the display device 100 may acquire attribute information of the requested content application.
[0237] According to an embodiment, the display apparatus 100 may also store attribute information of a content application requested to be executed. For example, the display apparatus 100 may acquire the attribute information of the content application from meta information of the application. For example, the display apparatus 100 may create a field in the application database indicating whether the application is a server controller direct connection type as meta information related to each application, and may store a value in the field when each application is installed or updated.
[0238] According to an embodiment, the display apparatus 100 may request attribute information of a content application from the server apparatus 300 and receive the attribute information from the server apparatus 300, thereby acquiring the attribute information of the application.
[0239] The attribute information of the content application requested to be executed may include information indicating whether the content application is a server-controller direct connection type. If the content application is a server-controller direct connection type, it may indicate that an input signal for controlling the execution of the content application is to be directly transmitted from the controller to the server.
[0240] In operation 1240, the display device 100 may determine whether the requested application is a content application of a predetermined type.
[0241] According to an embodiment, the display apparatus 100 may determine whether the requested application is of a server controller direct connection type, which is an example of a predetermined type.
[0242] According to an embodiment, the display device 100 may obtain information regarding whether the requested application is of a server controller direct connection type from meta information of the application. Such meta information of the application may be stored when the application is installed in the display device 100 or when the application is updated. Here, the application installed in the display device 100 may mean that one or more instructions and data sets for starting the execution of the application executed by the server are installed in the display device.
[0243] According to an embodiment, the display apparatus 100 may obtain information on whether the requested application is of a server controller direct connection type by requesting and receiving the information from the server apparatus 300.
[0244] If it is determined in operation 1240 whether the requested application is a content application of a predetermined type, and the requested application is not a content application of a predetermined type, the process proceeds to operation 1290 .
[0245] In operation 1290, the display device 100 may receive an input from the controller 200 and transfer the received input signal of the controller 200 to the server device 300, thereby controlling the execution of the content application.
[0246] If it is determined in operation 1240 whether the requested application is a content application of a predetermined type, the process proceeds to operation 1250 if the requested application is a content application of a predetermined type.
[0247] In operation 1250, the display device 100 may transmit content playback control mode information and an input signal list indicating default values.
[0248] According to an embodiment, the display apparatus 100 may transmit content playback control mode information indicating that the display apparatus is in a content playback control mode to the server apparatus 300.
[0249] According to an embodiment, the display apparatus 100 may transmit an input signal list indicating a default value. The input signal list may include one or more input signals having a default value, so that if the server apparatus 300 receives an input signal having such a default value from the controller 200, the server apparatus 300 may transmit the input signal having the default value to the display apparatus 100 as is. For example, when determining that there is only one input signal having a default value, the display apparatus 100 may transmit an input signal list including one input signal having a default value. For example, referring to FIG. 5, the input signal list may include one input signal having a default value. <aaa1>may include:
[0250] In operation 1250, the fact that the display device 100 transmits the content playback control mode information and the input signal list indicating the default values does not necessarily mean that they are transmitted at the same time, but it goes without saying that they may be transmitted at the same time or at different times.
[0251] In operation 1260, the server device 300 may store the content playback control mode information received from the display device 100 and an input signal list indicating default values.
[0252] In operation 1270, since the requested application is determined to be a predetermined type of content application, i.e., a server-controller direct connection type application, as a result of the determination in operation 1240, the display apparatus 100 may transmit a server connection guidance control command to the controller 200 along with information necessary for the server connection operation to enable a direct connection between the server and the controller. The information necessary for the server connection operation may include access point connection information for first connecting the controller 200 to the wireless Internet and server connection information for connecting to the corresponding server through the wireless Internet. The access point connection information may include access point identification information and a password for connecting to the access point. The server connection information may include a URL of the server apparatus 300 and a password for connecting to the server apparatus 300. The server connection guidance control command may indicate a control command to the controller 200 to directly connect to the server apparatus 300 using the access point connection information and the server connection information.
[0253] In operation 1280, the controller 200 may perform an operation of connecting to the server using information necessary for the server connection operation received from the display device 100.
[0254] According to one embodiment, the controller 200 may perform an operation of connecting to the server device 300 in response to a server connection guidance control command received from the display device 100. The controller 200 may first connect to the wireless Internet using access point connection information, and then perform an operation of connecting to the server device 300 using the server connection information.
[0255] 12, after the server-controller connection is completed for the server-controller direct connection application type, during the content playback control mode of the display apparatus, the server apparatus 300 may directly receive an input signal from the controller 200 and transmit the result of performing the content application according to the received input signal to the display apparatus 100. Also, during the menu mode of the display apparatus, the display apparatus 100 may receive an input signal for controlling the display apparatus via the server apparatus 300 or directly from the controller 200. Examples of the display apparatus 100 receiving a signal from the server 300 in both the content playback control mode and the menu mode of the display apparatus will be described with reference to FIGS. 13 to 15, and examples of the display apparatus 100 receiving an input signal directly from the controller 200 in the menu mode of the display apparatus will be described with reference to FIGS. 16 to 18.
[0256] FIG. 13 is a flowchart illustrating an example of a method of operation of the controller, the server device, and the display device according to an embodiment.
[0257] 13 , in operation 1310, the controller 200 may transmit an input signal corresponding to a user operation to the server device 300. While the display device 100 displays content resulting from the execution of an application from the server device 300, the user may operate the controller 200 to control the execution of the content displayed on the display device 100. For example, to control the forward movement of a specific character in the content displayed on the display device 100, the user may perform an operation input corresponding to the forward movement using a button, key, or dial provided on the controller 200, and the controller 200 may then transmit an input signal corresponding to the user's operation input to the server device 300.
[0258] In operation 1320, the server device 300 may receive an input signal from the controller 200 and determine whether the display device 100 is in the content playback control mode. The server device 300 may receive and store information indicating whether the display device 100 is in the content playback control mode in advance from the display device 100. If the display device 100 is not in the content playback control mode as a result of the determination, If it is determined that the display apparatus 100 is in the content playback control mode, the process may proceed to operation 1330.
[0259] In operation 1330, the server device 300 may determine whether the input signal indicates a default value. The server device 300 may receive and store a list of input signals indicating default values from the display device 100. If the input signal indicates a default value, If the input signal does not indicate the default value, the method may proceed to operation 1340.
[0260] At operation 1340, that is, when the display device 100 is in the content playback control mode and the input signal is not a default value, the server device 300 may execute the content application based on the input signal and transmit the execution result screen to the display device 100.
[0261] In operation 1350, the display device 100 may receive an application execution result screen from the server device 300 and display the received execution result screen. In the above example, for example, if a user operates the controller 200 to control the forward movement of a specific character in content displayed on the display device 100, the execution result screen displayed on the display device 100 may include an image of the specific character performing a forward movement.
[0262] FIG. 14 is a flowchart illustrating an example of a method of operation of the controller, the server device, and the display device according to an embodiment.
[0263] When the display device 100 is not in the content playback control mode or when the input signal indicates a default value, It can proceed to.
[0264] Referring to FIG. 14, in operation 1410, the server device 300 may transmit the input signal of the controller to the display device 100 as is. In two situations, i.e., when the display device 100 is not in the content playback control mode, and when the display device 100 is in the menu mode, the controller input signal is transmitted to the display device 100 as is so that it can be used to control the display device, and when the input signal indicates a default value, the controller input signal is transmitted to the display device 100 as is so that the display device 100 enters the menu mode.
[0265] In operation 1420, the display device 100 may determine whether the input signal of the controller received from the server device 300 indicates a default value. If the controller input signal does not indicate the default value, the display device 100 may proceed to operation 1460, and if the input signal indicates the default value, the display device 100 may proceed to operation 1430.
[0266] In operation 1430, the display device 100 may output a user interface screen for controlling the display device in which the input signal of the controller rotor indicates a default value. For example, the user interface screen may include a quick panel or the like.
[0267] In operation 1440, the display device 100 may transmit information indicating that the operation mode of the display device is the menu mode to the server device 300.
[0268] In operation 1450, the server device 300 may receive the information received from the display device 100 and store the information indicating that the display device is in the menu mode.
[0269] In operation 1460, the display apparatus 100 may perform a display apparatus control operation based on the input signal. If the process proceeds to operation 1460, the controller input signal is directly transmitted from the server apparatus 300 and does not indicate a default value. Therefore, the input signal may indicate that the controller input signal is a signal for controlling the display apparatus in a menu mode. Therefore, the display apparatus 100 may convert the controller input signal into a display apparatus control signal and perform an operation corresponding to the converted display apparatus control signal.
[0270] FIG. 15 is a flowchart illustrating an example of a method of operation of the controller, the server device, and the display device according to an embodiment.
[0271] 15, the display apparatus 100 may detect that the menu mode is ending in operation 1510. For example, when a screen for controlling the display apparatus is ended, such as when a user input ends a user interface screen, the display apparatus 100 may detect that the menu mode is ending. In addition, the end of the menu mode may indicate the start of a content playback control mode.
[0272] In operation 1520, the display device 100 may transmit information indicating that the display device is in the content playback control mode to the server device 300.
[0273] In operation 1530, the server device 300 may store the information received from the display device 100 indicating that the display device is in the content playback control mode.
[0274] After storing the information indicating that the display apparatus 100 is in the content playback control mode, if the server apparatus 300 receives an input signal from the controller 200, it may operate as shown in FIG.
[0275] FIG. 16 is a flowchart illustrating an example of a method of operation of the controller, server device, and display device according to an embodiment.
[0276] 16 , in operation 1610, the controller 200 may transmit an input signal corresponding to a user operation to the server device 300. While the display device 100 displays content resulting from the execution of an application from the server device 300, the user may operate the controller 200 to control the execution of the content displayed on the display device 100. For example, to control the forward movement of a specific character in the content displayed on the display device 100, the user may input an operation corresponding to the forward movement using a button, key, or dial provided on the controller 200. Accordingly, the controller 200 may transmit an input signal corresponding to the user's operation input to the server device 300.
[0277] In operation 1620, the server device 300 may determine whether the input signal indicates a default value. The server device 300 may receive and store a list of input signals indicating default values from the display device 100. If the input signal indicates a default value, If the input signal does not indicate the default value, the method may proceed to operation 1630.
[0278] In operation 1630, if the input signal is not a default value, the server device 300 may execute the content application based on the input signal and transmit an execution result screen to the display device 100.
[0279] In operation 1640, the display device 100 may receive an application execution result screen from the server device 300 and display the received execution result screen. In the above example, for example, if a user operates the controller 200 to control the forward movement of a specific character in content displayed on the display device 100, the execution result screen displayed on the display device 100 may include an image of the specific character performing a forward movement.
[0280] FIG. 17 is a flowchart illustrating an example of a method of operation of the controller, the server device, and the display device according to an embodiment.
[0281] The input signal may show a default value. It can proceed to.
[0282] Referring to FIG. 17, in operation 1710, the server device 300 may transmit the input signal of the controller to the display device 100 as is. In the case where the input signal indicates a default value, the controller input signal is transmitted to the display device 100 as is to cause the display device 100 to enter the menu mode.
[0283] In operation 1720, the display device 100 may output a user interface screen for controlling the display device in which the input signal of the controller rotor indicates a default value. For example, the user interface screen may include a quick panel.
[0284] In operation 1730, the display device 100 may transmit a control command to the controller 200 to transmit an input signal to the display device. While the display device 100 displays a user interface screen, i.e., while in a menu mode of the display device, the display device 100 may transmit a control command to the controller 200 to transmit an input signal to the display device in order to directly receive an input signal for controlling the display device from the controller 200. Such a control command may be transmitted to the controller 200 via Bluetooth communication technology, Wi-Fi communication technology, or the like.
[0285] In operation 1740, the controller 200 may receive a control command to transmit an input signal to the display device, and may transmit the input signal input by the user to the display device 100.
[0286] At operation 1750, the display device 100 may receive an input signal for controlling a user interface screen displayed on the display directly from the controller 200, instead of receiving the input signal via the server device 300. At operation 1760, the display device 100 may perform a control operation of the display device based on the input signal.
[0287] FIG. 18 is a flowchart illustrating an example of a method of operation of the controller, the server device, and the display device according to an embodiment.
[0288] 18, the display apparatus 100 may detect that the menu mode is ending in operation 1810. For example, when a screen for controlling the display apparatus is ended, such as when a user input ends a user interface screen, the display apparatus 100 may detect that the menu mode is ending. In addition, the end of the menu mode may indicate the start of a content playback control mode.
[0289] In operation 1820, the display apparatus 100 may transmit a control command to the controller 200 to transmit an input signal to the server apparatus. That is, when the menu mode of the display apparatus ends and the content playback control mode begins, the display apparatus 100 causes the controller 200 to transmit the input signal to the server apparatus 300 in order to receive from the server apparatus 300 a result screen resulting from content playback control that is to be displayed on the display of the display apparatus.
[0290] In operation 1830, the controller 200 may receive a user input after receiving a control command from the display device 100.
[0291] In operation 1840, the controller 200 may transmit an input signal due to the user input to the server device 300.
[0292] In operation 1850, the server device 300 may determine whether the input signal received from the controller 200 indicates a predetermined value. The following operations are the same as those in Fig. 16, and therefore further description will be omitted.
[0293] Some embodiments may be embodied in the form of a recording medium containing computer-executable instructions, such as program modules, that are executed by a computer. A computer-readable medium is any available medium that can be accessed by a computer, and includes both volatile and nonvolatile media, and separate and non-separate media. Also, a computer-readable medium may include a computer recording medium. A computer recording medium includes both volatile and non-volatile, separate and non-separate media embodied in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data.
[0294] The disclosed embodiments may be implemented by a software program including instructions stored on a computer-readable storage medium.
[0295] The computer is a device that can call instructions stored in a recording medium and operate according to the disclosed embodiments in accordance with the called instructions, and may include an electronic device according to the disclosed embodiments.
[0296] The computer-readable recording medium may be provided in the form of a non-transitory recording medium. Here, "non-transitory" means that the recording medium does not contain a signal and is tangible, and does not distinguish between data being stored semi-permanently or temporarily on the recording medium.
[0297] Furthermore, the control method according to the disclosed embodiments may be provided as a computer program product, which may be traded as a commodity between a seller and a buyer.
[0298] The computer program product may include a software program and a computer-readable recording medium on which the software program is stored. For example, the computer program product may include a product in the form of a software program (e.g., a downloadable app) that is electronically distributed by a device manufacturer or via an online marketplace (e.g., Google Play Store, App Store). For electronic distribution, at least a portion of the software program may be stored on a recording medium or temporarily generated. In this case, the recording medium may be a recording medium on a manufacturer's server, an online marketplace server, or an intermediary server that temporarily stores the software program.
[0299] In a system including a server and a device, the computer program product may include a recording medium of the server or a recording medium of the device. Alternatively, if a third device (e.g., a smartphone) communicatively coupled to the server or the device exists, the computer program product may include a recording medium of the third device. Alternatively, the computer program product may include a software program itself that is transmitted from the server to the device or the third device, or transmitted from the third device to the device.
[0300] In this case, one of the server, the device, and the third apparatus may execute the computer program product to perform the method according to the disclosed embodiments, or two or more of the server, the device, and the third apparatus may execute the computer program product to perform the method according to the disclosed embodiments in a distributed manner.
[0301] For example, a server (e.g., a cloud server or an artificial intelligence server) may execute a computer program product stored on the server and control devices communicatively connected to the server to perform methods according to the disclosed embodiments.
[0302] As yet another example, a third device may execute a computer program product and control a device communicatively coupled to the third device to perform a method according to the disclosed embodiments. When the third device executes the computer program product, the third device may download the computer program product from a server and execute the downloaded computer program product. Alternatively, the third device may execute a computer program product provided in a preloaded state to perform a method according to the disclosed embodiments.
[0303] In this specification, a "unit" may also refer to a hardware component such as a processor or a circuit, and / or a software component executed by a hardware component such as a processor.
[0304] The above description of the present disclosure is for illustrative purposes only, and those skilled in the art will understand that the present disclosure can be easily modified into other specific forms without changing the technical spirit or essential features of the present disclosure. Therefore, the above-described embodiments should be understood to be illustrative in all respects and not limiting. For example, each component described as a single component may be implemented in a distributed form, and similarly, components described as distributed may be implemented in a combined form.
[0305] The scope of the present disclosure is indicated by the claims set forth below rather than by the above detailed description, and all modifications and variations derived from the meaning and scope of the claims and their equivalents should be construed as being included within the scope of the present disclosure. [Explanation of symbols]
[0306] 70 access points 100 Display device 110 Communications Department 111 Mobile communication module 112 Wireless Internet Module 113 Short-Range Communication Module 120 Display 130 memory 140 processors 150 Video Processing Unit 160 Audio Processing Unit 170 Audio output section 180 Receiver 181 HDMI(R) port 182 component jack 183 PC port 184 USB ports 190 Sensing part 200 Controller 210 Communications Department 220 User Input Section 230 memory 240 processors 300 Server device 310 Communications Department 320 memory 330 processor
Claims
1. In a display device, a communication interface; a memory for storing at least one instruction; a processor for executing the at least one instruction stored in the memory; The processor executes the at least one instruction to: receiving, from the server device via the communication interface, first execution result content obtained by executing a content application, based on an input signal from a controller coupled to the server device and providing the input signal; controlling the display to display the first execution result content; receiving a first input signal from the server device via the communication interface, the first input signal being indicative of a predetermined value communicated by the controller to the server device; displaying a user interface screen for controlling the display device in response to receiving a first input signal indicating the predetermined value; a display device that receives a second input signal from the controller while displaying the user interface screen, and controls an operation of the display device based on the second input signal;
2. The processor executes the at least one instruction to:
2. The display device of claim 1, wherein while displaying the user interface screen, a second input signal from the controller is received via the server device via the communication interface, or a second input signal from the controller is received directly from the controller via the communication interface.
3. The processor executes the at least one instruction to: while displaying the user interface screen, controlling the display to terminate the display of the user interface screen in response to a second input signal for terminating the display of the user interface screen; The display device according to claim 1 , wherein the communication interface is controlled so that, upon completion of display of the user interface screen, the display device transmits to the server device a signal indicating that the display device operates in a content playback control mode.
4. The processor executes the at least one instruction to: The display device of claim 3, wherein a third input signal received from the controller controls the communication interface to receive second execution result content obtained by performing the content application from the server device by transmitting a signal indicating that the display device is operating in a content playback control mode.
5. The processor executes the at least one instruction to: Identifying whether the type of the content application is a predetermined type; The display device of claim 1 , wherein the communication interface is controlled to transmit to the server device a list including one or more input signals indicating the default value because the type of the content application is the default type.
6. The processor executes the at least one instruction to: Identifying whether the type of the content application is a predetermined type; The display device of claim 1 , wherein, because the type of the content application is the predetermined type, information for enabling the controller to directly connect to the server device and a command for controlling the controller to connect to the server device are transmitted to the controller.
7. In the server device, a communication interface; a memory for storing at least one instruction; a processor for executing the at least one instruction stored in the memory; The processor executes the at least one instruction to: controlling the communication interface to transmit a first execution result content obtained by executing a content application to a display device; controlling the communication interface to receive a first input signal from a controller; Identifying whether the first input signal indicates a predetermined value; controlling the communication interface to transmit the first input signal to the display device so that the display device can output a user interface screen when the first input signal is identified as representing the predetermined value; A server device that, when the first input signal is identified as not indicating the default value, controls the communication interface to transmit a second execution result content obtained by executing the content application using the first input signal to the display device.
8. The processor executes the at least one instruction to: The server device of claim 7 , further comprising: a controller configured to control the communication interface to transmit a second input signal received from the controller to the display device while the display device operates in a menu mode that outputs the user interface screen.
9. The processor executes the at least one instruction to: controlling the communication interface to receive a signal from the display device indicating that the display device is to be switched to a content playback control mode while the display device is operating in a menu mode; Recognizing that the display device operates in the content playback control mode upon receiving the signal; The server device according to claim 7 , wherein, upon said recognition, an input signal received from said controller controls said communication interface to transmit third execution result content obtained by executing said content application to said display device.
10. The processor executes the at least one instruction to: The server device according to claim 7 , further comprising: a server device configured to receive and store a list including at least one input signal indicating the predetermined value from the display device.
11. 1. A method for operating a display device, comprising: receiving, from the server device, a first execution result content obtained by executing a content application based on a first input signal from a controller connected to the server device and providing the first input signal; an operation of displaying the first execution result content; receiving from the server device an input signal from the controller indicating a predetermined value, the input signal being communicated by the controller to the server device; displaying a user interface screen for controlling the display device in response to receiving a first input signal indicating the predetermined value; receiving a second input signal from the controller and controlling the display device based on the second input signal while displaying the user interface screen.
12. 12. The method for operating a display device according to claim 11, further comprising, while displaying the user interface screen, receiving a second input signal from the controller via the server device via a communication interface, or receiving a second input signal from the controller directly from the controller via the communication interface.
13. while displaying the user interface screen, an operation of terminating the display of the user interface screen in response to a second input signal for terminating the display of the user interface screen; The method of claim 11 , further comprising: transmitting a signal indicating that the display device operates in a content playback control mode to the server device upon termination of the user interface screen.
14. A method for operating a server device, transmitting a first execution result content obtained by executing the content application to a display device; receiving a first input signal from a controller; identifying whether the first input signal indicates a predetermined value; transmitting the first input signal to the display device so that the display device can output a user interface screen when the first input signal is identified as representing the predetermined value; A method for operating a server device, comprising: an operation of transmitting to the display device a second execution result content obtained by performing the content application using the first input signal when the first input signal is identified as not indicating the default value.
15. A computer-readable recording medium having recorded thereon at least one program executed by a processor of a display device for implementing a method for operating a display device, the method for operating a display device comprising: receiving, from the server device, a first execution result content obtained by executing a content application based on a first input signal from a controller connected to the server device and providing the first input signal; an operation of displaying the first execution result content; receiving from the server device a second input signal from the controller indicating a predetermined value communicated by the controller to the server device; displaying a user interface screen for controlling the display device in response to receiving a second input signal indicating the predetermined value; receiving a second input signal from the controller and controlling the display device based on the second input signal while displaying the user interface screen.
Citation Information
Patent Citations
Method, apparatus, and system for controlling and optimizing a playback device.
JP2010512112A
Methods, devices, and systems for interactive cloud gaming
JP2021511919A
System and method for establishing direct communication between a server system and a video game controller
JP2022508060A
Image display device and operation method thereof
JP2022516761A