Method and device for displaying operation information of gamepad

Abstract

According to one embodiment of the present disclosure, a method in which an electronic device displays operation information of a gamepad may include the operations of: obtaining gamepad manufacturer information of the gamepad based on identifying an electrical connection with the gamepad; obtaining game provider information from a cloud server that transmits a game running on the electronic device over a network; displaying a guide screen on a display based on the gamepad manufacturer information if the gamepad manufacturer information is identified as not being associated with the game provider information; and using the guide screen to guide a game action associated with a keystroke on the gamepad.

Description

Technical Field

[0001] The present disclosure relates to a method and apparatus for displaying operation information of a gamepad. Background Art

[0002] A display device may execute a game using a cloud server, such as cloud gaming. Cloud gaming refers to game content received from a cloud server. The display device may wirelessly receive game content from the cloud server and execute the game content. A user may enjoy cloud gaming through the display device. When using cloud gaming through the display device, the user may use a gamepad that is wired or wirelessly connected to the display device. A gamepad is a controller designed for playing games and has a different shape or button configuration from a typical remote control device. The gamepad has unique characteristics for each device manufacturer. For example, a gamepad manufactured by a first device manufacturer and a gamepad manufactured by a second device manufacturer may each have a different shape or key configuration, and the key inputs transmitted from the respective gamepads to the display device may be different. Summary of the Invention

[0003] Solution to the Problem

[0004] According to an aspect of the present disclosure, a method for displaying operation information of a gamepad through an electronic device, the method comprising: obtaining gamepad manufacturer information about the gamepad based on identifying an electrical connection with the gamepad; obtaining game provider information from a cloud server that provides a game operating on the electronic device through a network; controlling a guide screen to be displayed on a display based on the gamepad manufacturer information based on identifying that the gamepad manufacturer information is not associated with the game provider information; and using the guide screen to guide a game operation associated with a key input of the gamepad.

[0005] The gamepad manufacturer information may be identified as associated or not associated with the game provider information based on a compatibility table, and the compatibility table may include information about an association between the gamepad manufacturer information and the game provider information.

[0006] The method may include displaying the guide screen based on the gamepad manufacturer information based on identifying that the gamepad manufacturer information does not correspond to the game provider information.

[0007] The method may include receiving the gamepad manufacturer information from the gamepad based on identifying an electrical connection between the gamepad and the electronic device.

[0008] The method may include: performing a game operation corresponding to one of the key inputs received from the gamepad during game operation, based on identifying that the gamepad manufacturer information is associated with the game provider information; and displaying a guide screen on a display based on failure to receive a control signal from the gamepad within a predetermined time, where the control signal includes one or more of the key inputs.

[0009] The method may include, based on a control signal received from the gamepad: identifying one or more key inputs in the control signal; identifying whether a game operation corresponding to the one or more key inputs is recognized; and based on the game operation corresponding to the one or more key inputs being recognized, incrementing a count value, and based on the count value exceeding a predetermined threshold, displaying a guide screen on the display.

[0010] The method may include, based on failure to obtain the gamepad manufacturer information, receiving a gamepad list from an external server; and displaying the gamepad list on the display.

[0011] The method may include, based on any item in the displayed gamepad list being selected, displaying a guide screen corresponding to the selected item on the display.

[0012] The guide screen may include a first guide screen and a second guide screen, where the first guide screen includes guide information associated with operating the game and the gamepad, where the second guide screen includes guide information associated with the gamepad and not related to operating the game, and where the first guide screen may be configured based on mapping information between the game operation and the gamepad, and the second guide screen may be configured based on default information about the gamepad.

[0013] The mapping information may be received from a cloud server, configured based on at least a part of the game provided from the cloud server, or may be pre-stored in a memory of the electronic device.

[0014] The mapping information includes identification information for identifying the gamepad, a list of key inputs provided for each gamepad, and game operation information mapped to each key input included in the key input list, and where the mapping information may be databaseized based on the types of the gamepad and the game.

[0015] The electronic device may be a display device.

[0016] According to one aspect of the present disclosure, an electronic device includes: a display; at least one processor; at least one memory configured to store at least one instruction; and at least one transceiver, wherein the at least one processor is configured to execute the at least one instruction to: obtain gamepad manufacturer information about the gamepad based on recognizing an electrical connection with the gamepad; obtain game provider information from a cloud server that provides games operating on the electronic device via a network; and based on recognizing that the gamepad manufacturer information is not associated with the game provider information, control the display to display a guidance screen based on the gamepad manufacturer information.

[0017] The at least one processor may also be configured to execute the at least one instruction to: identify the gamepad manufacturer information as being associated or not associated with the game provider information based on a compatibility table, and wherein the compatibility table includes information about the association between the gamepad manufacturer information and the game provider information.

[0018] The at least one processor may also be configured to execute the at least one instruction to control the display to display the guidance screen based on the gamepad manufacturer information based on recognizing that the gamepad manufacturer information does not correspond to the game provider information.

[0019] According to one aspect of the present disclosure, an electronic device includes: a display; at least one transceiver; at least one memory configured to store at least one instruction; and at least one processor configured to execute the at least one instruction to: obtain gamepad manufacturer information about the gamepad based on recognizing an electrical connection with the gamepad; obtain game provider information from a cloud server that provides games operating on the electronic device via a network; based on recognizing that the gamepad manufacturer information is not associated with the game provider information, control the display to display a guidance screen based on the gamepad manufacturer information; and use the guidance screen to guide game operations associated with key inputs of the gamepad.

[0020] The at least one processor may also be configured to execute the at least one instruction to control the at least one transceiver to receive the gamepad manufacturer information from the gamepad based on recognizing an electrical connection between the gamepad and the electronic device.

[0021] The at least one processor may also be configured to execute the at least one instruction to: perform a game operation based on identifying that the gamepad manufacturer information is associated with the game provider information, the game operation corresponding to one of the key inputs received from the gamepad when operating the game; and control a display to display a guidance screen based on a failure to receive a control signal from the gamepad within a predetermined time, wherein the control signal includes one or more of the key inputs.

[0022] The at least one processor may also be configured to execute the at least one instruction to: control the at least one transceiver to receive a gamepad list from an external server based on a failure to obtain the gamepad manufacturer information; and control the display to display the gamepad list.

[0023] The at least one processor may also be configured to, based on any item in the displayed gamepad list being selected, control the display to display a guidance screen corresponding to the selected item. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a block diagram showing a game service system according to one or more embodiments;

[0025] Figure 2 is a block diagram showing an electronic device according to one or more embodiments;

[0026] Figure 3 is a block diagram showing a display device according to one or more embodiments;

[0027] Figure 4 and Figure 5 is a view showing an example of displaying a guidance screen based on a comparison result between gamepad manufacturer information and game provider information according to one or more embodiments;

[0028] Figure 6 is a view showing an example of displaying a guidance screen based on whether a control signal is received according to one or more embodiments;

[0029] Figure 7 and Figure 8 is a view showing an example of processing an abnormal result of a key input received from a gamepad according to one or more embodiments;

[0030] Figure 9 is a flowchart showing a method for displaying a guidance screen for a gamepad according to one or more embodiments; and

[0031] Figure 10 is a reference view showing an example of a guidance screen according to one or more embodiments.

[0032] Reference may be made to the accompanying drawings in the following description, and specific examples that may be practiced are shown within the accompanying drawings as examples. Without departing from the scope of the various examples, other examples may be utilized and structural changes may be made. Detailed Description

[0033] Embodiments of the present disclosure will be described below with reference to the accompanying drawings. However, various changes may be made to the described embodiments such that the present disclosure may be implemented in various other forms and is not limited to the embodiments set forth herein. Throughout the specification and the drawings, the same or similar reference numerals may be used to refer to the same or similar elements. In addition, for the sake of clarity and conciseness, well-known functions and configurations in the accompanying drawings and the related description are not described.

[0034] Figure 1 is a block diagram showing a game service system according to one or more embodiments.

[0035] Referring to Figure 1 , the game service system may include one or more electronic devices. The one or more electronic devices may include a display device 110, game controllers 140 (e.g., 141 and 142), and a cloud server 120.

[0036] The display device 110 is an electronic device including a display (or display module) 115 capable of displaying an image. The display device 110 may include a TV device, a smart phone, a smart watch, smart glasses (e.g., XR glasses or AR glasses), or a head-mounted display (HMD), but various embodiments of the present disclosure are not limited thereto.

[0037] The game controller 140 (e.g., 141 and 142) is a control device for transmitting key inputs associated with game operations to another electronic device (e.g., the display device 110) electrically connected thereto. The game controller 140 (e.g., 141 and 142) may include a plurality of key buttons associated with game operations. Different key codes may be mapped to each of the plurality of key buttons. When a physical input from a user to a key button is received, the game controller 140 (e.g., 141 and 142) may transmit a key input including the key code to another electronic device electrically connected thereto. Another electronic device connected to the game controller 140 (e.g., 141 and 142) may detect the key input and may perform a game operation corresponding to the detected key input. The game operation may include an operation of applying a user input to a virtual button on the game screen 1151, an operation of moving the focus on the virtual button on the game screen 1151, an operation of moving an avatar represented in the game screen 1151, or an operation of controlling the avatar to perform a pre-configured movement, but the game operations according to various embodiments of the present disclosure are not limited to the above examples.

[0038] The cloud server 120 is a server device that can transmit cloud-based games (cloud games) to other electronic devices (e.g., the display device 110). The cloud server 120 can transmit games to other electronic devices connected wired or wirelessly via a network. The cloud server 120 can transmit games to another electronic device based on a streaming method or a download method. If a game is transmitted using the streaming method, the game can be executed by the electronic device that receives the game as long as the connection to the cloud server 120 is maintained. If a game is transmitted using the download method, the electronic device that receives the game must maintain the connection to the cloud server 120 until the download is complete, but thereafter, the game can be executed even after the connection is lost or severed.

[0039] The gamepad 140 (e.g., 141 and 142) may include a plurality of buttons, and each gamepad 140 (e.g., 141 and 142) may include different buttons and / or configurations for each manufacturer. The key buttons constituting the first gamepad 141 may be different from the key buttons constituting the second gamepad 142 in at least one of type, position, and number. Since the key buttons of each gamepad 140 (e.g., 141 and 142) are different, the key inputs that can be configured for each gamepad 140 (e.g., 141 and 142) may also be different. For example, the first gamepad 141 may include a first key button, but the second gamepad 142 may not include the first key button. In this case, the second gamepad 142 will not be able to configure a key input associated with the first key button.

[0040] In response to a physical input to each key button, the gamepad 140 (e.g., 141 and 142) may transmit information and / or instructions associated with the key input to other electronic devices (e.g., the display device 110) electrically connected thereto. The key input may be associated with one or more game operations. The association between the key input and the game operation may be constituted by mapping information. For example, the mapping information may include a plurality of key inputs and the game operations associated with each key input. The game operations may include, for example, a screen switching operation, an avatar operation.

[0041] The cloud game may include mapping information. The mapping information may be associated with at least one game operation and at least one key input. Based on the mapping information, the display device 110 may detect the game operation associated with the key input. For example, the display device 110 may receive a key input from the gamepad 140 (e.g., 141 and 142), detect the game operation corresponding to the key input, and execute the detected game operation. The mapping information may be included as at least a part of the cloud game, but various embodiments of the present disclosure are not limited thereto.

[0042] The mapping information may vary depending on the game provider. The cloud game provided by the first game provider may include the first mapping information, and the cloud game provided by the second game provider may include the second mapping information.

[0043] For example, if substantially the same gamepad 140 (e.g., 141 and 142) is connected to the display device 110 and executes the cloud game provided by the first game provider, the display device 110 may perform game operations based on the first mapping information. If substantially the same gamepad 140 (e.g., 141 and 142) is connected to the display device 110 and executes the cloud game provided by the second game provider, the display device 110 may perform game operations based on the second mapping information. At least a part of the first mapping information and the second mapping information is substantially the same, but the remaining parts may be different. Due to the difference between the first mapping information and the second mapping information, even if a control signal including a key input is received from the same gamepad 140 (e.g., 141 and 142), the game operation associated with the key input may not be recognized.

[0044] The cloud game may include one or more mapping information. If the cloud game includes two or more mapping information, the display device 110 may select any one of the two or more mapping information and perform game operations based on the selected mapping information. The mapping information may be associated with the gamepad manufacturer information, and the display device 110 may use the gamepad manufacturer information to select the mapping information associated with the gamepad 140 (e.g., 141 and 142) connected to the display device 110. After selecting the mapping information, the display device 110 may perform game operations associated with the key input received from the gamepad 140 (e.g., 141 and 142) using the selected mapping information.

[0045] When the cloud game is running, the display device 110 may display the execution screen of the cloud game (i.e., the game screen 1151) on the display 115.

[0046] The game screen 1151 may include various graphical user interface (GUI) elements for performing game operations. When a user input to a GUI element (e.g., a key input to the gamepad 140 (e.g., 141 and 142)) is recognized, the display device 110 may execute a game operation associated with the GUI element for which the user input is recognized. The GUI elements may be mapped to key inputs to the gamepad 140 (e.g., 141 and 142). For example, a first GUI element may be mapped to a first key input to the gamepad 140 (e.g., 141 and 142), and a second GUI element may be mapped to a second key input. When a control signal including the first key input is received from the gamepad 140 (e.g., 141 and 142), the display device 110 may determine that a user input to the first GUI element is recognized. When a control signal including the second key input is received from the gamepad 140 (e.g., 141 and 142), the display device 110 may determine that a user input to the second GUI element is recognized. When a user input to a GUI element is recognized, the display device 110 may execute a game operation associated with the user input. For example, when a user input to a GUI element indicating "start game" is recognized, a game operation for starting the game may be executed. For example, when a user input to a GUI element indicating "select game" is recognized, a game operation for selecting a game may be executed.

[0047] The game screen 1151 may include a game avatar. When a user input (e.g., a key input to the gamepad 140 (e.g., 141 and 142)) is recognized for the game avatar, the display device 110 may execute a game operation (e.g., an avatar operation) associated with the user input. For example, when a key input indicating "walk forward" is recognized, an avatar operation for advancing the avatar may be executed. For example, when a key input indicating "walk backward" is recognized, an avatar operation for moving the avatar backward may be executed. For example, when a key input indicating "sit down" is recognized, an avatar operation for allowing the avatar to sit down may be executed.

[0048] Cloud gaming may include game provider information for identifying a game provider. For example, if cloud gaming is provided by a first game provider, the cloud gaming includes the first game provider information, and if cloud gaming is provided by a second game provider, the cloud gaming includes the second game provider information. In the present disclosure, a game provided by the first game provider may be referred to as a first cloud game, and a game provided by the second game provider may be referred to as a second cloud game. The first cloud game and the second cloud game may be cloud games of substantially the same category, but may include different mapping information. In other words, the first cloud game may include first mapping information, and the second cloud game may include second mapping information.

[0049] The display device 110 may receive a compatibility table from the cloud server 120. The compatibility table may be stored in the memory of the display device 110. The compatibility table may include a plurality of game provider information and a plurality of game controller manufacturer information. The compatibility table may include the relationship (e.g., match or mismatch) between the game provider information and the game controller manufacturer information. For example, the first game provider information may be associated with one or more game controller manufacturer information and included / configured in the compatibility table. For example, the first game controller 141 manufacturer information may be associated with one or more game controller manufacturer information and may be included / configured in the compatibility table.

[0050] The display device 110 may use the compatibility table to identify the relationship (e.g., association) between the game controller 140 (e.g., 141 and 142) and the cloud game being executed (e.g., the ongoing game). The game controller manufacturer information and the game provider information may be configured with a predetermined identification code. In an example, when the identification code of the game controller manufacturer matches the identification code of the game provider information, the display device 110 may determine that the game provider information is associated with the game controller manufacturer information by using the compatibility table between the game controller manufacturer information and the game provider information. In an example, when the identification code of the game controller manufacturer does not match the identification code of the game provider information, the display device 110 may determine that the game provider information is not associated with the game controller manufacturer information by using the compatibility table.

[0051] If it is identified that the game provider information is associated with the game controller manufacturer information, the display device 110 may not display the guide screen 1152. If it is identified that the game provider information is not associated with the game controller manufacturer information, the display device 110 may display the guide screen 1152. The guide screen 1152 may include at least some of the key buttons and key inputs for the user to operate the game controller 140 (e.g., 141 and 142) and the game operations. For example, the guide screen 1152 may include an image of the game controller 140 (e.g., 141 and 142) that shows one or more key buttons. For example, the guide screen 1152 may include an image of a key input, and the key input image may correspond to the key input that can be entered using each key button. The guide screen 1152 may include a game operation description, and the game operation description may include at least one of text or an image that describes the game operation associated with the key input.

[0052] In one or more embodiments of the present disclosure, the display device 110 may display a guide screen 1152 on the display 115 according to a predetermined condition. By displaying the guide screen 1152, a user may understand how to operate the gamepad 140 (e.g., 141 and 142). Even without a separate user manual / guide, the user may learn the functions of key buttons and key inputs related to each game operation of cloud gaming through the guide screen 1152. A method for controlling the display device 110 to automatically display the guide screen 1152 on the display 115 is described below.

[0053] According to an embodiment of the present disclosure, the display device 110 may be replaced with a game console device. The game console device may act as and / or be used as the above-described display device 110. The game console device may be electrically connected to the display device 110. The game console device may transmit a game screen 1151 to the display device 110.

[0054] Figure 2 is a block diagram illustrating an electronic device according to one or more embodiments.

[0055] Reference Figure 2 , according to one or more embodiments of the present disclosure, an electronic device 200 may include a processor 210, a memory 220, and a transceiver 230. The memory 220 and the transceiver 230 may be electrically connected or functionally connected to the processor 210. The processor 210 may be a single processor or multiple processors, and may control components constituting the electronic device 200 by generating and transmitting control commands.

[0056] According to one or more embodiments of the present disclosure, the processor 210 may include a storage and processing circuit unit for supporting the operation of the electronic device 200. The storage and processing circuit unit may include a storage device, such as a non-volatile memory (e.g., flash memory or other electrically programmable ROM configured to form a solid-state drive (SSD)) or a volatile memory (e.g., static or dynamic RAM). The processing circuit unit in the processor 210 may be used to control the operation of the electronic device 200. The processing circuit unit may be based on one or more microprocessors, microcontrollers, digital signal processors, baseband processors, power management parts, audio chips, or application-specific integrated circuits.

[0057] According to one or more embodiments of the present disclosure, the memory 220 may be a single memory or multiple memories, and may include a memory area for one or more processors 210, for storing variables used in the protocols, configurations, controls, and other functions of the electronic device 200, including operations corresponding to or including any one of the methods and / or processes described as examples in the present disclosure. Additionally, the memory 220 may include non-volatile memory, volatile memory, or a combination thereof. Further, the memory 220 may include memory slots that enable insertion and removal of removable memory cards in one or more formats (e.g., SD cards, memory sticks, and compact flash).

[0058] According to one or more embodiments of the present disclosure, the transceiver 230 may include a wireless communication module or a radio frequency (RF) module. The wireless communication module may include Wi-Fi, Bluetooth, Global Positioning System (GPS), or Near Field Communication (NFC). For example, the wireless communication module may provide a wireless communication function using RF. Additionally or alternatively, the wireless communication module may include a network interface or a modem for connecting the electronic device 200 to a network (e.g., the Internet, LAN, WAN, telecommunications network, cellular network, satellite network, POTS, or 5G network). The RF module may be responsible for data transmission / reception, e.g., transmitting and receiving data RF signals or electronic signals for calls. As an example, the RF module may include a power amplifier module (PAM), a frequency filter, or a low noise amplifier (LNA). The RF module may also include components (e.g., conductors or wires) for transmitting radio waves in free space when performing wireless communication.

[0059] Figure 3 is a block diagram showing a display device according to one or more embodiments.

[0060] Reference Figure 3 , according to one or more embodiments of the present disclosure, the display device 300 may include a processor 310, a memory 320, and a transceiver 330. The memory 320 and the transceiver 330 may be electrically connected or functionally connected to the processor 310. The processor 310 may control the components constituting the display device 300 by generating and transmitting control commands. The processor 310, the memory 320, and the transceiver 330 may be respectively substantially the same as the processor 210, the memory 220, and the transceiver 230 of the electronic device 200 described with reference to Figure 2 described Figure 2 .

[0061] In an embodiment, the display device 300 may include a display module 340. The display module 340 may include a panel, a holographic device, or a projector. The panel may be implemented as flexible, transparent, or wearable. The panel and the touch panel may be configured in a single module. The holographic device may create a three-dimensional (3D) image (e.g., a hologram) in the air by using light interference. The projector may display an image by projecting light onto a screen. The screen may be located, for example, inside or outside the display device 300. According to an embodiment, the display module 340 may further include a control circuit for controlling the panel, the holographic device, or the projector.

[0062] In an embodiment, the display device 300 may include an audio module 350. For example, the audio module 350 may convert sound into an electrical signal and vice versa. The audio module 350 may process sound information input or output through, for example, a speaker, a receiver, headphones, or a microphone.

[0063] The display device 300 according to one or more embodiments of the present disclosure may execute or implement the methods, operations, and / or instructions described below. The display device 300 may store a program including instructions related to various operations described below in the memory 320, and may specifically or physically implement each operation by executing the program.

[0064] Hereinafter, Figures 4 to 8 a scenario of a display guidance screen is described. Referring to Figures 4 to 8 the game service system described includes a display device, a gamepad, and a cloud server. The display device is the electronic device described with reference to Figure 2 and may be, for example, the display device described with reference to Figure 3 . The cloud server is an example of the Figure 2 electronic device. The cloud server and the display device may be connected by wire or wirelessly. The gamepad and the display device may be connected by wire or wirelessly.

[0065] Referring to Figures 4 to 8 , the gamepad (440, 540, 640, 740, and / or 840) may include a first gamepad (441, 541, 641, 741, or 841) and a second gamepad (442, 542, 642, 742, or 842). The first gamepad (441, 541, 641, 741, or 841) is manufactured by a first gamepad manufacturer. In addition, the second gamepad (442, 542, 642, 742, or 842) is manufactured by a second gamepad manufacturer.

[0066] Figure 4 and Figure 5It is a view showing an example of displaying a guide screen based on a comparison result between gamepad manufacturer information and game provider information according to one or more embodiments.

[0067] Referring to Figure 4 and Figure 5 ,a display device (410 or 510) may be connected to a first gamepad (441 or 541). The first gamepad (441 or 541) may transmit manufacturer information about the first gamepad (441 or 541) to the display device (410 or 510) based on the connection with the display device (410 or 510).

[0068] The display device (410 or 510) may receive cloud games from a cloud server (420 or 520). The cloud games may be streamed or downloaded. When executing a cloud game, the display device (410 or 510) may perform game operations according to key inputs received from the gamepad. The display device (410 or 510) may display a game screen (4151 or 5151) on a display (415 or 515) when executing the cloud game. A guide screen (4152 or 5152) may overlap at least a partial area of the game screen (4151 or 5151) or be displayed adjacent thereto based on a predetermined condition.

[0069] The cloud games may include game provider information. The game provider information may be transmitted to the display device (410 or 510) together with the cloud games. The game provider information may be transmitted to the display device (410 or 510) as at least a part of the cloud games. The game provider information may be pre-stored in a memory of the display device (410 or 510).

[0070] Referring to Figure 4 ,according to one or more embodiments, the display device 410 may compare the manufacturer information about the first gamepad 441 with the game provider information. If an identification code indicating the manufacturer information about the first gamepad 441 does not match an identification code indicating the game provider information, the display device 410 may determine that the manufacturer information about the first gamepad 441 is not associated with the game provider information. If it is determined that the game provider information is not associated with the manufacturer information about the first gamepad 441, the display device 410 may display a guide screen 4152 on the display 415.

[0071] Referring to Figure 5, according to one or more embodiments, the display device 510 may compare the manufacturer information about the second game controller 542 with the game provider information. If the identification code indicating the manufacturer information about the second game controller 542 matches the identification code indicating the game provider information, the display device 510 may determine that the manufacturer information about the second game controller 542 is associated with the game provider information. If it is determined that the game provider information is associated with the manufacturer information about the second game controller 542, the display device 510 may be configured not to display the guide screen 5152 on the display 515.

[0072] Figure 6 is a view showing an example of displaying a guide screen based on whether a control signal is received according to one or more embodiments.

[0073] Reference Figure 6 , the display device 610 may be connected to the second game controller 642. The second game controller 642 may transmit the second game controller 642 manufacturer information to the display device 610 based on the connection with the display device 610.

[0074] The display device 610 may receive cloud games from the cloud server 620. The cloud games may be streamed or downloaded. While executing the cloud games, the display device 610 may perform game operations according to key inputs received from the game controller. The display device 610 may display the game screen 6151 on the display 615 while executing the cloud games. Based on a predetermined condition, the guide screen 6152 may be displayed to overlap at least a part of the game screen 6151 or next to at least a part of the game screen 6151.

[0075] The cloud games may include game provider information. The game provider information together with the cloud games may be transmitted to the display device 610. The game provider information may be transmitted to the display device 610 as at least a part of the cloud games. The game provider information may be pre-stored in the memory of the display device 610.

[0076] The display device 610 may compare the manufacturer information about the second game controller 642 with the game provider information. Even if it is determined that the manufacturer information about the second game controller 642 is associated with the game provider information, if no signal is received, the display device 610 may also display the guide screen 6152.

[0077] If the display device 610 does not receive a control signal from the gamepad until a predetermined time (threshold time) has elapsed (or exceeded) since the time when the most recent control signal was last received, the display device 610 may display a guidance screen 6152 on the display 615. The control signal may be a control signal including a key input. For example, if a first control signal is received at a first time point, but when measured from the first time point, if a second control signal including a key input is not received until a second time point after the threshold time has passed, the display device 610 may display a guidance screen 6152 on the display 615. If the user does not understand the key input, the user may not manipulate the keys for a certain period of time. According to an embodiment of the present disclosure, the display device 610 may automatically suggest the mapping relationship between the user's key input and the game operation based on the delay of the control signal input, thereby providing the user with an enhanced gaming experience.

[0078] Figure 7 and Figure 8 is a view showing an example of an abnormal result of processing a key input received from a gamepad according to one or more embodiments.

[0079] Referring to Figure 7 and Figure 8 , the display device (710 or 810) may be connected to a second gamepad (742 or 842). The second gamepad (742 or 842) may transmit manufacturer information about the second gamepad (742 or 842) to the display device (710 or 810) based on the connection with the display device (710 or 810).

[0080] The display device (710 or 810) may receive cloud games from a cloud server (720 or 820). The cloud games may be streamed or downloaded. When executing the cloud games, the display device (710 or 810) may perform game operations in response to key inputs received from the gamepad. The display device (710 or 810) may display a game screen (7151 or 8151) on the display (715 or 815) while executing the cloud games. The guidance screen (7152 or 8152) may overlap or be displayed adjacent to at least a part of the area of the game screen (7151 or 8151) based on a predetermined condition.

[0081] The cloud games may include game provider information. The game provider information may be transmitted to the display device (710 or 810) together with the cloud games. The game provider information may be transmitted to the display device (710 or 810) as at least a part of the cloud games. The game provider information may be pre-stored in the memory of the display device (710 or 810).

[0082] The display device (710 or 810) may compare the manufacturer information about the second gamepad (742 or 842) with the game provider information. Even if it is determined that the manufacturer information about the second gamepad (742 or 842) is associated with the game provider information, if no signal is received, the display device (710 or 810) may display a guidance screen (7152 or 8152).

[0083] The display device (710 or 810) may receive a control signal including a key input. The display device (710 or 810) may identify the key input included in the control signal based on mapping information. If the key input is identified, the display device (710 or 810) may perform a game operation corresponding to the key input, which may be referred to as "successful key input identification". If the key input is not identified, the display device (710 or 810) may not perform the game operation corresponding to the key input, which may be referred to as "failed key input identification".

[0084] Reference Figure 7 , the display device 710 may receive a control signal including a key input from the second gamepad 742. If a game operation associated with the key input included in the control signal is identified based on the mapping information, then the display device 710 may perform the associated game operation. In this case, the display device 710 does not display the guidance screen 7152 on the display 715.

[0085] Reference Figure 8 , the display device 810 may receive a control signal including a key input from the second gamepad 842. If a game operation associated with the key input included in the control signal is not identified based on the mapping information, the display device 810 may not perform the associated game operation. In this case, the display device 810 may display the guidance screen 8152 on the display 815.

[0086] Figure 9 is a flowchart showing a method for displaying a guidance screen for a gamepad according to one or more embodiments.

[0087] Reference Figure 9 , the method for displaying the guidance screen may be supported by the gamepad, the display device, and the cloud server described above with reference to Figures 1 to 3 description. For ease of description, Figure 8 each operation is performed by the display device.

[0088] In operation 901, the display device may detect a connection to the gamepad. The display device may receive manufacturer information from the gamepad based on the electrical connection to the gamepad.

[0089] For example, a game controller can transmit game controller manufacturer information to a display device in response to an electrical connection with the display device. The display device can detect a connection with the game controller based on an electrical signal transmitted or received when the display device is connected to the game controller. In an example, the display device can request game controller manufacturer information from the game controller, and the game controller can respond with the game controller manufacturer information. In an example, the game controller can transmit the game controller manufacturer information to the display device based on the formation of the connection.

[0090] In operation 902, when a connection with the game controller is detected, the display device can obtain game controller manufacturer information.

[0091] The display device can detect an electrical (or physical) connection or a wireless connection with the game controller, and can obtain game controller manufacturer information based on the identification of the connection. In an example, the game controller manufacturer information can be transmitted from the game controller to the electronic device based on the identification of the connection between the game controller and the electronic device. Whether to transmit the game controller manufacturer information can be determined by at least one of the display device and / or the game controller. For example, the display device can be configured to request game controller manufacturer information from the game controller based on the detected connection with the game controller. For example, the game controller can be configured to transmit the game controller manufacturer information based on detecting a connection of the game controller with the display device or receiving an electrical signal from the display device.

[0092] In operation 903, the display device can obtain game provider information associated with cloud gaming. The display device can receive cloud games from a cloud server.

[0093] The display device can receive game provider information associated with cloud games from the cloud server. For example, the game provider information is at least a part of the cloud game, and thus, it can be received together with the cloud game as a whole. For example, the game provider information can be received separately from the cloud server from the cloud game. When the game provider information is received as at least a part of the cloud game, the display device can identify the game provider information from the cloud game. The display device can transmit or receive electrical signals to or from the cloud server wired or wirelessly through a network, and can receive cloud games from the cloud server through the network. Although not limited thereto, the display device can receive the game provider information from the cloud server during the reception of the cloud game.

[0094] The following operations 904 to 906 relate to predefined conditions for displaying a guidance screen. At least some of operations 904 to 906 may be omitted. For example, it may be determined whether to display the guidance screen based on the result of operation 904. For example, it may be determined whether to display the guidance screen based on the results of operations 904 and 905. For example, it may be determined whether to display the guidance screen based on the results of operations 904 to 906. For example, it may be determined whether to display the guidance screen based on the results of operations 904 and 906.

[0095] In operation 904, the display device may determine whether the gamepad manufacturer information is associated with the game provider information by comparing the gamepad manufacturer information with the game provider information.

[0096] The gamepad manufacturer information may be obtained earlier in the previous operation 902. The game provider information may be obtained earlier in the previous operation 903. The display device may identify whether the gamepad manufacturer information and the game provider information are associated with each other.

[0097] In an embodiment, the gamepad manufacturer information and the game provider information may be identified as associated or not associated based on a predefined compatibility table. The game provider information may be associated with one or more gamepad manufacturer information. The compatibility table may be configured as an association between the gamepad manufacturer information and the game provider information. Specifically, the display device may compare the gamepad manufacturer information with the game provider information using the compatibility table stored in the memory. The gamepad manufacturer information and the game provider information may be configured in the compatibility table in the form of their respective identification codes. If the identification code indicating the gamepad manufacturer information matches the identification code indicating the game provider information, the display device may determine that the gamepad manufacturer information is associated with the game provider information. In addition, if the identification code indicating the gamepad manufacturer information does not match the identification code indicating the game provider information, the display device may determine that the gamepad manufacturer information is not associated with the game provider information.

[0098] In operation 905, the display device may determine whether a control signal is received from the gamepad.

[0099] In an embodiment, the display device may measure the duration during which no control signal is received from the gamepad. The control signal may be a control signal including one or more key inputs. In an example, when an electrical signal is received from the gamepad, the display device may determine whether a control signal is received by identifying whether the electrical signal is a control signal.

[0100] In operation 906, the display device may determine whether a key input is recognized.

[0101] In an embodiment, the display device may perform a game operation corresponding to a key input received from a gamepad while a game is running. Although not limited thereto, the game operation may be performed by the display device on the condition that the gamepad manufacturer information and the game provider information are recognized as being associated with each other.

[0102] In an embodiment, the key input may be included in a control signal. In an embodiment, if a control signal is received from the gamepad, the display device may recognize the key input included in the control signal. The display device may recognize a game operation corresponding to the key input. When the game operation corresponding to the key input is recognized, the display device may perform the recognized game operation.

[0103] In an embodiment, if a game operation corresponding to the key input is not recognized, the display device may increase a count value. When the count value exceeds a predetermined threshold, the display device may determine that no key input is recognized from the control signal. For example, when a control signal is received from the gamepad three or more times, but no key input is recognized from the received control signal, the display device may obtain a count value of three. If the count value exceeds the predetermined threshold, the display device may determine that the key input is not recognized. The count value may be continuously increased whenever no key input is detected in the received control signal, and when a control signal including a key input is received, the count value may be set back to 0.

[0104] In operation 907, the display device may not display a guide screen.

[0105] In operation 908, the display device may display a guide screen on the display.

[0106] In an embodiment, if it is recognized that the gamepad manufacturer information and the game provider information are not associated with each other, the display device may display a guide screen on the display. Although not limited thereto, the display device may display a guide screen on the display based on recognizing that the gamepad manufacturer information and the game provider information do not match each other.

[0107] In an embodiment, the display device may display a guide screen on the display based on not receiving a control signal from the gamepad within a predetermined time.

[0108] In an embodiment, the display device may display a guide screen on the display based on an unrecognized or unrecognizable key input. For example, when no key input is recognized for N (where N is a natural number) or more consecutive received control signals, the display device may display a guide screen on the display.

[0109] In an embodiment, a guidance screen may be determined based on gamepad manufacturer information. For example, a display device may select any one of guidance screens associated with various gamepads, and the display device may select a guidance screen based on gamepad manufacturer information provided from the gamepad. Guidance screens associated with various gamepads may be pre-stored in a memory of the display device.

[0110] According to an embodiment, the guidance screen may include information for guiding game operations respectively associated with key inputs of the gamepad. Information for guiding game operations associated with key inputs may be configured in the form of text or images.

[0111] The display device may obtain a guidance screen based on gamepad manufacturer information or store a guidance screen associated with gamepad manufacturer information in the memory. When the guidance screen does not exist in the memory, the display device may obtain the guidance screen using the gamepad manufacturer information. However, if it is impossible to identify the type, item name, or product name of the gamepad using the gamepad manufacturer information received from the gamepad, it may be difficult to obtain the guidance screen.

[0112] According to an embodiment, the display device may receive a gamepad list from an external server based on unrecognized or unrecognizable gamepad manufacturer information of a connected gamepad. In addition, the display device may display the gamepad list on a display. The gamepad list may include images or text describing various gamepads. Each item in the gamepad list may correspond to one gamepad.

[0113] A user may select any one of items (i.e., represented gamepads) in the gamepad list using an input device (e.g., a remote control device). When a selection of any one of the items in the gamepad list is received, the display device may receive a guidance screen corresponding to the selected item through a network or read a guidance screen from the memory. The display device may display the guidance screen corresponding to the selected item on the display. In this way, even when the manufacturer of the gamepad cannot be identified, the display device may display a guidance screen required to invite a user input.

[0114] In addition, according to one or more embodiments of the present disclosure, the guidance screen may include a first guidance screen and a second guidance screen. The first guidance screen may include guidance information associated with running a game and a connected gamepad. The second guidance screen may include guidance information associated with the connected gamepad regardless of whether the game is running.

[0115] The first guide screen can be pre-configured based on the mapping information between the running game and the gamepad, and the second guide screen can be configured based on the default information about the gamepad. For example, the first guide screen can include the mapping information between the game operations of the game currently being executed by the display device and the gamepad connected to the display device. For example, the second guide screen can include information for introducing the key buttons of the gamepad connected to the display device, regardless of the game being executed by the display device. The first guide screen can be referred to as a game-adaptive guide screen, and the second guide screen can be referred to as a default guide screen.

[0116] In an embodiment, the mapping information can be received from a cloud server, configured to receive at least a portion of a cloud game from the cloud server, or pre-stored in the memory of the electronic device.

[0117] In an embodiment, the mapping information can include identification information for identifying the gamepad, a list of key inputs provided for each gamepad, and the game operations mapped to each key input that makes up the list of key inputs. In addition, the mapping information can be databaseized based on the type of the gamepad and the cloud game.

[0118] Figure 10 is a reference view showing an example of a guide screen according to one or more embodiments.

[0119] Reference Figure 10 , the guide screen GS can include a gamepad image CNT, a key input representation KIN, and a game operation representation GN. The gamepad image CNT can be located in the central part of the guide screen GS. The key input representation KIN can be connected by a line to the key button representation of the gamepad image CNT. The game operation representation GN can be arranged vertically or horizontally adjacent to the key input representation KIN. Each key input representation KIN can be matched one-to-one with each game operation representation GN.

[0120] In addition, a device according to one or more embodiments of the present disclosure can be described as follows.

[0121] According to an embodiment of the present disclosure, a method for displaying operation information of a gamepad through an electronic device is based on identifying an electrical connection to the gamepad, and can include obtaining gamepad manufacturer information about the gamepad, obtaining game provider information from a cloud server, the cloud server transmitting (or providing) a game running (or operating) on the electronic device through a network, and when it is recognized that the gamepad manufacturer information and the game provider information are not associated with each other, displaying a guide screen on the display based on the gamepad manufacturer information. According to an embodiment, the guide screen can guide the game operations associated with the key inputs of the gamepad.

[0122] In an embodiment, gamepad manufacturer information and game provider information can be identified as associated or not associated based on a predefined compatibility table. The game provider information can be associated with one or more gamepad manufacturer information. The compatibility table can include information about the association between gamepad manufacturer information and game provider information.

[0123] In an embodiment, a guidance screen can be displayed when it is identified that the gamepad manufacturer information and the game provider information do not match each other.

[0124] In an embodiment, the gamepad manufacturer information can be transmitted from the gamepad to the electronic device based on identifying an electrical connection between the gamepad and the electronic device.

[0125] The method according to an embodiment may further include: when it is identified that the gamepad manufacturer information and the game provider information are associated with each other, while the game is running, performing a game operation corresponding to a key input received from the gamepad, and displaying a guidance screen on the display based on not receiving a control signal from the gamepad within a predetermined time. The control signal can include one or more key inputs.

[0126] If the control signal is received from the gamepad, then according to an embodiment, the method may further include: identifying a key input included in the control signal, identifying whether a game operation corresponding to the key input is identified, when the game operation corresponding to the key input is identified, performing the identified game operation, and when the game operation is not identified, increasing a count value, and when the count value exceeds a predetermined threshold, displaying the guidance screen on the display.

[0127] The method according to an embodiment may further include receiving a gamepad list from an external server based on a failure to identify gamepad manufacturer information about a connected gamepad, and displaying the gamepad list on the display.

[0128] The method according to an embodiment may further include: when any item in the displayed gamepad list is selected, displaying a guidance screen corresponding to the selected item on the display.

[0129] In an embodiment, the guidance screen can include a first guidance screen and a second guidance screen. The first guidance screen can include guidance information associated with running the game and the connected gamepad. The second guidance screen can include guidance information associated with the connected gamepad regardless of whether the game is running. The first guidance screen can be configured based on mapping information between the game being executed and the gamepad, and the second guidance screen can be configured based on default information about the gamepad.

[0130] In an embodiment, mapping information may be received from a cloud server, configured to receive at least a part of a game from the cloud server, or pre-stored in a memory of an electronic device.

[0131] In an embodiment, the mapping information may include identification information for identifying a gamepad, a list of key inputs provided for each of the gamepads, and game provider information mapped to each key input constituting the list of key inputs. The mapping information may be databaseized based on the type of the gamepad and the game.

[0132] In an embodiment, the electronic device may be a display device.

[0133] An electronic device according to an embodiment of the present disclosure may include one or more processors; one or more memories; and one or more transceivers. The one or more processors may be configured to obtain gamepad manufacturer information regarding a gamepad based on identifying an electrical connection with the gamepad, obtain game provider information from a cloud server that transmits (or provides) a game running (or operating) on the electronic device through a network, and display a guide screen on a display based on the gamepad manufacturer information when the gamepad manufacturer information and the game provider information are not associated with each other.

[0134] An electronic device according to an embodiment may be one of various types of electronic devices. The electronic device may include, for example, a display device, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to an embodiment is not limited to the above electronic devices.

[0135] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to a particular embodiment, and include various changes, equivalents or substitutions of the corresponding embodiments. As used herein, the singular forms "a", "an" and "the" are also intended to include the plural forms unless the context clearly dictates otherwise. As used herein, the term 'and / or' should be understood to cover any and all possible combinations of one or more of the listed items. As used herein, the terms "comprising", "having" and "including" are used only to specify the presence of the features, components, parts or combinations thereof described herein, but the use of these terms does not preclude the presence or addition of one or more other features, components, parts or combinations thereof. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include all possible combinations of the items listed together in the corresponding phrase. As used herein, terms such as "first" and "second" or "first" and "second" may be used simply to distinguish the corresponding components from another component, and do not limit the components in other respects (e.g., importance or order).

[0136] As used herein, the term "component" or "module" may include a unit implemented in hardware, software or firmware, and may be used interchangeably with other terms (e.g., "logic", "logic block", "component" or "circuit"). A component or module may be a single integrated component adapted to perform one or more functions, or the smallest unit or part thereof. For example, according to an embodiment, the "component" or "module" may be implemented in the form of an application specific integrated circuit (ASIC).

[0137] As used in the various embodiments of the present disclosure, depending on the context, the term "if" may be interpreted as "when", "at the time of", "in response to determining" or "in response to detecting". Similarly, depending on the context, "if it is determined that A" or "if it is detected that A" may be interpreted as "when it is determined that A" or "in response to determining A", or "when it is detected that A" or "in response to detecting A".

[0138] The program executed by the electronic device described herein may be implemented as a hardware component, a software component and / or a combination thereof. The program may be executed by any system capable of executing computer-readable instructions.

[0139] Software may include a computer program, code, instructions, or a combination of one or more thereof, and may configure a processing device when operating as needed, or may independently or jointly direct the processing device. Software may be implemented as a computer program including instructions stored in a computer-readable storage medium. The computer-readable storage medium may include, for example, a magnetic storage medium (e.g., read-only memory (ROM), random access memory (RAM), floppy disk, hard disk, etc.) and an optically readable medium (e.g., CD-ROM or digital versatile disc (DVD)). In addition, the computer-readable storage medium may be distributed to computer systems connected via a network, and the computer-readable code may be stored and executed in a distributed manner. The computer program may be directly distributed (e.g., downloaded or uploaded) between two UEs (e.g., smartphones) or online via an app store (e.g., Play Store TM ). If distributed online, at least a portion of the computer program product may be temporarily generated or at least temporarily stored in a machine-readable storage medium, such as the memory of a manufacturer's server, the server of an app store, or a relay server.

[0140] According to various embodiments, each of the above components (e.g., a module or a program) may include a single entity or multiple entities. Some of the multiple entities may be separately provided in different components. According to various embodiments, one or more of the above components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform one or more functions of each of the multiple components in the same or similar manner as performed by the corresponding one of the multiple components before integration. According to various embodiments, operations performed by a module, a program, or another component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be performed in a different order or omitted, or one or more other operations may be added.

Claims

1. A method for displaying operation information of a game controller through an electronic device, the method comprising: Based on recognizing an electrical connection to the game controller, obtain game controller manufacturer information regarding the game controller; Obtain game provider information from a cloud server that provides games operable on the electronic device via a network; And Based on recognizing that the game controller manufacturer information is not associated with the game provider information, display a guidance screen on the display based on the game controller manufacturer information, wherein the guidance screen guides game operations associated with key inputs of the game controller.

2. The method according to claim 1, wherein the game controller manufacturer information is identified as associated or not associated with the game provider information based on a compatibility table, and wherein the compatibility table includes information on the association between the game controller manufacturer information and the game provider information.

3. The method according to claim 1, wherein displaying the guide screen includes: Based on recognizing that the game controller manufacturer information does not correspond to the game provider information, display the guidance screen based on the game controller manufacturer information.

4. The method according to claim 1, wherein obtaining the game controller manufacturer information includes receiving the game controller manufacturer information from the game controller based on identifying an electrical connection between the game controller and the electronic device.

5. The method according to claim 1, further comprising: Based on recognizing that the game controller manufacturer information is associated with the game provider information, perform game operations corresponding to key inputs received from the game controller during operation of the game; And Based on failing to receive a control signal from the game controller within a predetermined time, display the guidance screen on the display, wherein the control signal includes one or more of the key inputs.

6. The method according to claim 5, further comprising: Based on receiving the control signal from the game controller: Recognize the one or more key inputs in the control signal; Recognize whether game operations corresponding to the one or more key inputs are recognized; Based on the game operations corresponding to the one or more key inputs being recognized, perform the recognized game operations; And Based on the game operations corresponding to the one or more key inputs not being recognized, increment a count value, and based on the count value exceeding a predetermined threshold, display the guidance screen on the display.

7. The method according to claim 1, further comprising: Based on failing to obtain the game controller manufacturer information, receive a game controller list from an external server; And Display the game controller list on the display.

8. The method according to claim 7, further comprising: Based on any item in the displayed game controller list being selected, display a guidance screen corresponding to the selected item on the display.

9. The method according to claim 1, wherein the guide screen includes a first guide screen and a second guide screen, wherein the first guide screen includes guide information associated with operating the game and the game controller, wherein the second guide screen includes guide information associated with the gamepad, which is unrelated to the operation of the game, and wherein the first guide screen is configured based on mapping information between the operation of the game and the gamepad, and the second guide screen is configured based on default information about the gamepad.

10. The method according to claim 9, wherein the mapping information is received from the cloud server, configured based on at least a part of the game provided by the cloud server, or pre-stored in a memory of the electronic device.

11. The method according to claim 10, wherein the mapping information includes identification information for identifying the gamepad, a list of key inputs provided for each gamepad, and game operation information mapped to each key input included in the list of key inputs, and wherein the mapping information is databaseized based on the type of the gamepad and the game.

12. The method according to claim 1, wherein the electronic device is a display device.

13. An electronic device, comprising: A display; At least one processor; At least one memory configured to store at least one instruction; And At least one transceiver, wherein the at least one processor is configured to execute the at least one instruction to: Based on recognizing an electrical connection to a game controller, obtain game controller manufacturer information regarding the game controller; Obtain game provider information from a cloud server that provides games operable on the electronic device via a network; And Based on recognizing that the game controller manufacturer information is not associated with the game provider information, control the display to display a guidance screen based on the game controller manufacturer information.

14. The electronic device according to claim 13, wherein the at least one processor is further configured to execute the at least one instruction to: Identify the gamepad manufacturer information as associated or not associated with the game provider information based on a compatibility table, and wherein the compatibility table includes information about an association between the gamepad manufacturer information and the game provider information.

15. The electronic device according to claim 13, wherein the at least one processor is further configured to execute the at least one instruction to: Based on identifying that the gamepad manufacturer information does not correspond to the game provider information, control the display to display the guide screen based on the gamepad manufacturer information.

Images