Electronic device and operation method thereof

Abstract

Provided are an electronic device and an operation method thereof, which enable a user watching a video to more easily and efficiently execute a game related to corresponding video content. The electronic device comprises: a memory for storing one or more instructions; and at least one processor for executing the one or more instructions stored in the memory. When a predefined event is identified while a video is displayed on a display, the processor searches for a game matching a game corresponding to the video. The processor performs control to output, on the display, a UI including a quick start button enabling execution of the game matching the game corresponding to the video according to the search result.

Description

Electronic device and method of operation thereof

[0001] The present disclosure relates to an electronic device and an operating method thereof, and more particularly, to an electronic device and an operating method thereof for enabling a user watching a video to efficiently play a game.

[0002] With the recent development of the Internet and media, users have access to a wide variety of games through platforms that offer a variety of games, and the number of users interested in games is rapidly increasing.

[0003] Users can play console games by connecting high-performance consoles to smart TVs, and with the advent of cloud gaming services such as NVIDIA's GeForce NOW, Google's Stadia, and Microsoft's Xbox Cloud Gaming, users can now play a variety of PC games provided by PC gaming platforms such as Steam as well as various cloud games on smart TVs without having to have a high-performance PC or console.

[0004] As user interest in and accessibility to games increase, game-related video content is rapidly increasing on various social media platforms like YouTube and Twitch. Many users are increasingly becoming interested in new games through exposure to game-related video content. Thus, games and video content are closely linked.

[0005] Meanwhile, users watching game-related video content may want to play the game they saw in the video. However, users unfamiliar with running games may experience various inconveniences and difficulties in the process, such as connecting a device to play the game, searching for the game, accessing the game launch screen, and then making a payment to play the game after accessing it. This may prevent the user from actually playing the game.

[0006] Therefore, to solve the above-mentioned problems, a scenario is needed that allows users watching videos to more easily and efficiently run games related to the video content.

[0007] An electronic device according to one embodiment of the present disclosure includes a memory storing one or more instructions and at least one processor executing one or more instructions stored in the memory. When a predefined event is identified while an image is displayed on a display, the processor searches for a game matching the image. The processor controls the display to output a user interface (UI) including a quick start button that enables the game matching the image to be executed based on the search results.

[0008] A method of operating an electronic device according to one embodiment of the present disclosure includes a step of searching for a game matching a game corresponding to the image when a predefined event is identified while an image is displayed on a display. The method includes a step of controlling the display to output a user interface (UI) including a quick start button that enables the game matching the image to be executed based on the search results.

[0009] One embodiment of the present disclosure provides a computer-readable recording medium having recorded thereon a program for executing at least one of the embodiments of the disclosed method on a computer as a technical means for achieving the above-described technical task.

[0010] Other technical features will be readily apparent to those skilled in the art from the following drawings, descriptions and claims.

[0011] Figure 1 is a reference diagram for explaining the concept of an electronic device according to one embodiment.

[0012] FIG. 2 is a flowchart illustrating a method for an electronic device according to one embodiment to efficiently execute a game corresponding to an image.

[0013] FIG. 3 is a drawing for explaining a method for an electronic device according to one embodiment to efficiently execute a game corresponding to an image.

[0014] FIGS. 4A to 4D are diagrams illustrating a process for identifying an event requesting a game search by an electronic device according to one embodiment.

[0015] FIG. 5 is a diagram illustrating a process in which an electronic device according to one embodiment searches for a game matching a game corresponding to an image.

[0016] FIG. 6 is a diagram illustrating a process in which an electronic device according to one embodiment searches for a game matching a game corresponding to an image.

[0017] FIG. 7 is a drawing illustrating an example of a UI including a quick start button according to one embodiment.

[0018] FIGS. 8A to 8C are drawings for explaining an example of a method of displaying an image when an electronic device according to one embodiment executes a game matching a game corresponding to an image.

[0019] FIG. 9 is a flowchart illustrating the operation of an electronic device when the electronic device fails to search for a game matching a game corresponding to an image according to one embodiment.

[0020] FIG. 10 is a diagram illustrating an example of a UI including a list of similar game recommendations according to one embodiment.

[0021] FIGS. 11A to 11C are diagrams for explaining a method for an electronic device according to one embodiment to efficiently execute a game corresponding to an image in conjunction with another device.

[0022] Fig. 12 is a block diagram of an electronic device according to one embodiment.

[0023] Fig. 13 is a specific block diagram of an electronic device according to one embodiment.

[0024] The terms used in this disclosure are described as currently used general terms in consideration of the functions mentioned in this disclosure; however, these may mean various other terms depending on the intentions of engineers working in the field, precedents, the emergence of new technologies, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in such cases, the meanings thereof will be described in detail in the description of the relevant embodiments. Therefore, the terms used in this disclosure should not be interpreted solely on the basis of the names of the terms, but should be interpreted based on the meanings of the terms and the overall contents of this disclosure.

[0025] Additionally, the terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the present disclosure.

[0026] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.

[0027] When a part of this specification is said to "include" a component, unless otherwise specifically stated, this does not exclude other components but rather implies the inclusion of other components. Furthermore, terms such as "part," "module," etc., used herein refer to a unit that processes at least one function or operation, which may be implemented in hardware, software, or a combination of hardware and software.

[0028] In addition, each component described below may additionally perform some or all of the functions performed by other components in addition to its own main function, and some of the main functions performed by each component may be performed exclusively by other components.

[0029] The expression “configured to” as used herein can be used interchangeably with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.”

[0030] The term "configured (or set up) to" may not necessarily mean "specifically designed to" hardware. Instead, in some contexts, the phrase "a system configured to" may mean that the system, in conjunction with other devices or components, is "capable of" doing something.

[0031] When a component is referred to herein as being “connected” or “connected” to another component, it should be understood that the component may be directly connected or directly connected to the other component, but may also be connected or connected via another component in between, unless otherwise specifically stated. When a part is referred to herein as being “connected” to another part, this includes not only cases where the parts are “directly connected,” but also cases where the parts are “electrically connected” with another element in between.

[0032] As used herein, and particularly in the claims, the terms "above" and "above" and similar referents may refer to both the singular and the plural. Furthermore, unless the order of steps in a method according to the present disclosure is explicitly specified, the steps described may be performed in any appropriate order. The present disclosure is not limited by the order in which the steps are described.

[0033] The appearances of phrases such as “in some embodiments” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment.

[0034] Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various hardware and / or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a given function. Furthermore, for example, the functional blocks of the present disclosure may be implemented using various programming or scripting languages. The functional blocks may be implemented as algorithms that execute on one or more processors. Furthermore, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and / or data processing.

[0035] In order to clearly explain the present disclosure in the drawings, parts that are not related to the description have been omitted, and similar parts have been designated with similar drawing reference numerals throughout the specification. In addition, the drawing reference numerals used in each drawing are only for the purpose of explaining each drawing, and different drawing reference numerals used in different drawings do not indicate different elements. In addition, the connecting lines or connecting members between components illustrated in the drawings are only examples of functional connections and / or physical or circuit connections. In an actual device, connections between components may be indicated by various functional connections, physical connections, or circuit connections that may be replaced or added.

[0036] In describing embodiments, if it is determined that a specific description of a related known technology may unnecessarily obscure the gist of the present disclosure, the detailed description thereof will be omitted. In addition, in the specification, the expression “at least one of a, b, or c” may refer to “a,” “b,” “c,” “a and b,” “a and c,” “b and c,” “all of a, b, and c,” or variations thereof. The numbers (e.g., first, second, third, etc.) used in the description of the specification are merely identifiers to distinguish one component from another.

[0037] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein.

[0038] In this disclosure, a 'user' means a person who uses an electronic device, and may include a consumer, an evaluator, a viewer, an administrator, or an installer.

[0039] FIG. 1 is a reference diagram for explaining the concept of an electronic device (100) according to one embodiment.

[0040] Referring to FIG. 1, an electronic device (100) according to one embodiment can identify a predefined event while an image (20) is displayed on a display.

[0041] In one embodiment, the predefined event may be a user input requesting a search for a game corresponding to the image (20). The predefined event may be predefined / set in the electronic device (100) as a trigger for initiating the game search function of the electronic device (100).

[0042] In one embodiment, the video (20) may be a game-related video, and may include, but is not limited to, a video showing the process of playing the game directly, a video evaluating and reviewing the game, a video about the development process, design intention, and behind-the-scenes story of the developers who created the game, a video introducing new game news or updates, a tutorial video explaining how to operate the game, etc.

[0043] An electronic device (100) according to one embodiment can trigger a game search function when a predefined event is identified. When the electronic device (100) identifies a predefined event, it can search for a game that matches the game corresponding to the image (20).

[0044] In one embodiment, the electronic device (100) can search for a game that matches the game corresponding to the image (20) based on a game database stored in the electronic device (100).

[0045] For example, if a user (10) is watching a video (20) (e.g., a game broadcast playing Diablo Season 4) and wants to play a game (e.g., Diablo Season 4) related to the video (20), the user may issue a voice command such as “Find a game (e.g., Diablo Season 4)” or may trigger a predefined specific event such as pressing a specific button on a remote control. When the electronic device (100) identifies the user’s voice command such as “Find a game (e.g., Diablo Season 4)”, the electronic device (100) may search for a game matching the game (e.g., Diablo Season 4) based on a game database.

[0046] An electronic device (100) according to one embodiment can control a UI (30) including a quick start button that enables execution of a game matched with a game corresponding to an image (20) to be output on a display when game matching / search is successful.

[0047] For example, if the electronic device (100) determines that a game (e.g. Diablo Season 4) matching the game corresponding to the image (20) (e.g. Diablo Season 4) is in the game database, the electronic device (100) can control the display to output a UI (30) including a quick start button ("Play right now") that allows Diablo Season 4 to be executed immediately.

[0048] Accordingly, a user (10) who was watching a video (20) (e.g., a game broadcast playing Diablo Season 4) can immediately run Diablo Season 4 without the various inconveniences that occur in the process of running the game by clicking the quick start button (“Play right now”) included in the UI (30).

[0049] Previously, users who were not familiar with running games would experience various inconveniences and difficulties in the process of running a game, such as having to connect a device to play the game, search for a game, access a screen to run the game, and then make a payment to run the game after accessing it. This could prevent the user from actually playing the game.

[0050] However, according to one embodiment of the present disclosure, the electronic device (100) can improve the user's service satisfaction by providing a method for enabling a user watching a video to more easily and efficiently run a game related to the video content.

[0051] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through the description below.

[0052] FIG. 2 is a flowchart illustrating a method (200) for efficiently executing a game corresponding to an image by an electronic device (100) according to one embodiment.

[0053] Referring to FIG. 2, in step 210, the electronic device (100) according to one embodiment may, when identifying a predefined event while an image is displayed on the display, search for a game matching the game corresponding to the image.

[0054] In one embodiment, the electronic device (100) can identify a predefined event to trigger the game search function. The predefined event may be a user input requesting a search for a game corresponding to an image. The predefined event may be predefined / set in the electronic device (100) as a trigger for initiating the game search function of the electronic device (100).

[0055] In one embodiment, the predefined event may include at least one of a gamepad connection signal; a specific button press on a remote control; a voice input requesting a game search; or an input that pauses the video. This will be described in detail in FIGS. 4A and 4B .

[0056] In one embodiment, the electronic device (100) can, upon identifying a predefined event, retrieve a game matching the game corresponding to the video by obtaining information about the game corresponding to the video from the server transmitting the video or by using artificial intelligence (AI)-based screen analysis to obtain the title of the game corresponding to the video. This will be described in detail in FIG. 5.

[0057] In one embodiment, the electronic device (100) can search for a game matching the game corresponding to the acquired image by comparing the game title corresponding to the acquired image with a game database. This will be described in detail in FIG. 6.

[0058] In step 220, the electronic device (100) according to one embodiment can control a UI including a quick start button that enables execution of a game matching a game corresponding to an image according to a search result to be output to the display.

[0059] In one embodiment, the electronic device (100) can control the display to output a UI (30) including a quick start button that enables the game corresponding to the image (20) to be executed when the game matching / search is successful.

[0060] In one embodiment, the electronic device (100) can automatically launch a game matching the game corresponding to the image when receiving a user input selecting a quick start button included in the UI.

[0061] In one embodiment, the electronic device (100) can control the display to output the image in at least one of a picture-in-picture (PIP) mode, a split screen mode, or a multi-device mode when executing a game matching the game corresponding to the image. This will be described in detail in FIGS. 8A to 8C .

[0062] In one embodiment, if the electronic device (100) fails to search for a game matching the game corresponding to the image, the electronic device (100) may control the display to output a UI including a list of games similar to the game corresponding to the image. This will be described in detail with reference to FIGS. 9 and 10.

[0063] In one embodiment, the electronic device (100) may trigger the game search function even when a predefined event is identified while the image is being displayed on another device. This will be described in detail in FIGS. 11A through 11C .

[0064] An electronic device (100) according to one embodiment of the present disclosure can improve user satisfaction with services by providing a method for enabling a user watching a video to more easily and efficiently execute a game related to the video content.

[0065] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through the description below.

[0066] FIG. 3 is a diagram illustrating a method for an electronic device (100) according to one embodiment to efficiently execute a game corresponding to an image (20). Contents overlapping with those described in FIG. 2 are referred to in FIG. 2, and description thereof is omitted here.

[0067] Referring to FIG. 3, in step 310, when a user watching a video generates a predefined event, the electronic device (100) can trigger a game search function by identifying the predefined event.

[0068] In step 320, when the game search function is triggered, the electronic device (100) can obtain the title of the game corresponding to the image and search for a game matching the game corresponding to the image based on the game database.

[0069] If a game with the same title as the game corresponding to the image exists in the game database, the electronic device (100) may successfully search for a game matching the image. On the other hand, if a game with the same title as the game corresponding to the image does not exist in the game database, the electronic device (100) may fail to search for a game matching the image.

[0070] In step 330, if the electronic device (100) succeeds in searching for a game matching the game corresponding to the image, the electronic device (100) can control the display to output a UI including a quick start button that allows the game to be immediately executed.

[0071] In step 340, if the electronic device (100) fails to search for a game matching the game corresponding to the image, the electronic device (100) can extract games belonging to the same category / genre as the game corresponding to the image from among the games included in the game database, generate a similar game recommendation list, and control a UI including the similar game recommendation list to be output to the display.

[0072] In this case, the user can select one game from the list of similar game recommendations, and the electronic device (100) can control the display to output a UI including a quick start button that allows the selected game to be immediately executed when an input for selecting one game from the list of similar game recommendations is received.

[0073] In step 350, the user may select the Quick Start button if they wish to immediately launch a game corresponding to the Quick Start button. The game corresponding to the Quick Start button may be a game matching the game corresponding to the video, based on a successful game search in step 320, or a game selected from a list of recommended similar games, based on a failed game search in step 320.

[0074] The electronic device (100) can automatically execute the game when an input for selecting the quick start button is received. At this time, the electronic device (100) can control the game execution screen and the video screen displayed on the display to be output to the display in at least one of PIP (Picture-in-Picture) mode, split screen mode, or multi-device mode.

[0075] At step 360, the electronic device (100) according to one embodiment receives an input for selecting a quick start button, but may require user account login to run a game corresponding to the quick start button. In this case, the electronic device (100) may control the display to output a UI including a game account sign-up button (e.g., "join right now").

[0076] In one embodiment, the electronic device (100) receives an input selecting a quick start button, but a user purchase may be required to run the game corresponding to the quick start button. In this case, the electronic device (100) may control the display to display a UI including a purchase button (e.g., "buy right now").

[0077] For example, if a manufacturer of an electronic device (100) is assumed to have a partnership with a specific cloud game server, PC game server, or console game server, the electronic device (100) can create service value according to various embodiments below.

[0078] For example, if the game corresponding to the quick start button is a game included in a specific cloud gaming server and the user does not subscribe to a service provided by the cloud gaming server, the electronic device (100) can be controlled to output a UI including a purchase button (e.g., “buy right now”) to the display in order to connect to a screen for applying for a subscription to a service provided by the cloud gaming server.

[0079] For example, if the game corresponding to the quick start button is a game included in a specific PC game server and the game is a game that the user has not purchased, the electronic device (100) can be controlled to output a UI including a purchase button (e.g., "buy right now") to the display in order to connect to a screen for purchasing the game provided by the PC game server.

[0080] For example, if the game corresponding to the quick start button is a game included in a specific console game server and the game is a game that the user has not purchased, the electronic device (100) can be controlled to output a UI including a purchase button (e.g., "buy right now") to the display in order to connect to a screen for purchasing the game provided by the console game server.

[0081] When the user has completed the account registration or purchase required to run the game, the electronic device (100) can run the game corresponding to the quick start button.

[0082] At step 370, the user can easily access the game corresponding to the video being watched using the quick start button without any cumbersome process and conveniently play the game.

[0083] An electronic device (100) according to one embodiment of the present disclosure can enhance user satisfaction with a service by providing a method that allows users watching a video to more easily and efficiently play games related to the video content. Furthermore, by coordinating with various game providing servers, the electronic device can create service value by providing a UI that encourages users to purchase games.

[0084] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through the description below.

[0085] FIGS. 4A to 4D are diagrams for explaining a process for identifying an event requesting a game search by an electronic device (100) according to one embodiment.

[0086] Referring to FIG. 4A, in one embodiment, the electronic device (100) may identify a game pad connection signal as a predefined event for triggering a game search function.

[0087] In one embodiment, the game pad (411) may generate a predetermined signal indicating that the game pad (411) is powered on when a user turns on the game pad (411), and transmit the predetermined signal to the electronic device (100). Here, the game pad (411) is an input device used when playing a game, and may include various buttons, a joystick, etc., and may be referred to as a controller.

[0088] In one embodiment, the electronic device (100) may receive a predetermined signal indicating that the game pad (411) is powered on while an image (20) is displayed on the display. When the signal is received, the electronic device (100) may search for a game that matches the game corresponding to the image (20).

[0089] In one embodiment, when the game pad (411) is powered on, if there has been a previous pairing between the game pad (411) and the electronic device (100), a connection via wireless communication (e.g., Bluetooth, Wi-Fi, etc.) is automatically established between the game pad (411) and the electronic device (100), and the two can be paired with each other. In this case, if the electronic device (100) is automatically paired with the game pad (411) while the image (20) is displayed on the display, the electronic device (100) can search for a game matching the game corresponding to the image (20).

[0090] For example, in 410, if a user (10) watching a video (20) wants to play a game corresponding to the video, the user (10) can turn on the game pad (411) to connect the game pad to the electronic device (100). When the game pad (411) is turned on, if the game pad (411) and the electronic device (100) have been paired before, a connection is automatically established between the game pad (411) and the electronic device (100) via wireless communication (e.g., Bluetooth, Wi-Fi, etc.), and the game pad (411) and the electronic device (100) can be paired with each other. The electronic device (100) can recognize that it has been paired with the game pad (411) and can search for a game matching the game corresponding to the video (20) by identifying this as a predefined event.

[0091] Referring to FIG. 4b, in one embodiment, the electronic device (100) may identify an input of pressing a specific button on the remote device as a predefined event for triggering the game search function.

[0092] In one embodiment, the remote device (421) may include a specific button that serves to trigger a game search function of the electronic device (100). When a user presses the specific button once or presses it for a certain period of time or longer, the remote device (421) may operate an electric circuit inside the remote device to generate a predetermined signal and transmit the predetermined signal to the electronic device (100). Here, the remote device (421) is a device used to remotely operate or control the electronic device (100), and may include various buttons, a joystick, etc., and may be referred to as a remote control device or remote control.

[0093] In one embodiment, the electronic device (100) may receive a predetermined signal corresponding to a specific button of the remote device (421) while an image (20) is displayed on the display. When the signal is received, the electronic device (100) may search for a game matching the game corresponding to the image (20).

[0094] For example, in 420, if a user (10) watching a video (20) wants to play a game corresponding to the video, the user (10) can press a specific button on the remote device (421) once or press and hold it for a certain period of time or longer. The electronic device (100) can receive a predetermined signal corresponding to the specific button on the remote device (421) and identify it as a predefined event, thereby searching for a game matching the game corresponding to the video (20).

[0095] Referring to FIG. 4c, in one embodiment, the electronic device (100) may identify a voice input as a predefined event for triggering a game search function.

[0096] In one embodiment, the electronic device (100) may include a microphone. The electronic device (100) may activate the microphone in response to a voice recognition button or by a specific voice command. The electronic device (100) may recognize / detect the user's speech, convert the user's voice into a digital signal through an analog-to-digital converter (ADC), and analyze the digital signal using a voice recognition algorithm to convert it into understandable text, thereby understanding / identifying the user's voice command.

[0097] In one embodiment, the electronic device (100) can search for a game that matches the game corresponding to the image (20) by understanding / identifying a user's voice command, such as "Find a game," while the image (20) is displayed on the display.

[0098] For example, in 430, if a user (10) watching a video (20) wants to play a game corresponding to the video, the user (10) can press the voice recognition button of the remote device (421) and utter a voice command such as "Find a game." The electronic device (100) can recognize / understand the user's voice command and identify it as a predefined event, thereby searching for a game matching the game corresponding to the video (20).

[0099] However, in FIG. 4c, “Find a game” is an example of a specific user voice command that triggers the game search function of the electronic device (100), and is not limited thereto, and various commands may be set as triggers.

[0100] Referring to FIG. 4d, in one embodiment, the electronic device (100) may identify an input that pauses the video as a predefined event for triggering the game search function.

[0101] In one embodiment, the remote device (441) may include a button that performs the function of pausing and resuming a video being played. When a user presses the button, the remote device (441) may generate a signal that instructs an electrical circuit within the remote device to pause the video (20), and transmit the signal to the electronic device (100).

[0102] In one embodiment, the electronic device (100) may receive a signal instructing to pause the image (20) while the image (20) is displayed on the display. Upon receiving the signal, the electronic device (100) may search for a game that matches the game corresponding to the image (20).

[0103] For example, in 420, if a user (10) watching a video (20) wants to play a game corresponding to the video, the user (10) can press a specific button on a remote device (441) that performs a function of pausing the video. The electronic device (100) can receive a signal from the remote device (441) instructing to pause the video (20), and by identifying this as a predefined event, can search for a game matching the game corresponding to the video (20).

[0104] In one embodiment, the electronic device (100) can search for a game matching the game corresponding to the image (20) by understanding / identifying a user's voice command, such as "pause the image", while the image (20) is displayed on the display. A description of the voice recognition function of the electronic device (100) is given in FIG. 4C, and any duplicate description is omitted herein.

[0105] An electronic device (100) according to one embodiment of the present disclosure can enhance user satisfaction with a service by providing a method that allows a user watching a video to more easily and efficiently play a game related to the video content. In particular, the electronic device (100) can enhance user satisfaction with the service by utilizing various predefined events as triggers for a game search function, allowing the user to easily and conveniently access games.

[0106] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through the description below.

[0107] FIG. 5 is a drawing for explaining a process in which an electronic device (100) according to one embodiment searches for a game matching a game corresponding to an image.

[0108] Referring to FIG. 5, at 510, an electronic device (100) according to one embodiment can identify a predefined event to trigger a game search function. In this regard, reference is made to FIGS. 4A and 4B, and a redundant description thereof is omitted herein.

[0109] An electronic device (100) according to one embodiment can, when a predefined event is identified while an image is displayed on a display, obtain information about a game corresponding to the image from a server transmitting the image or use artificial intelligence (AI)-based screen analysis to obtain a title of the game corresponding to the image, thereby searching for a game matching the game corresponding to the image.

[0110] In 520, it can be assumed that the electronic device (100) can obtain information about the game from the server transmitting the video (20). In this case, it can be said that a partnership regarding data provision has been concluded between the manufacturer of the electronic device (100) and the administrator of the server transmitting the video (20).

[0111] In this case, in one embodiment, the electronic device (100) can identify the administrator of the server transmitting the image (20). If the electronic device (100) identifies a predefined event while the image (20) is displayed on the display, the electronic device (100) can request information about a game corresponding to the image (20) from the server transmitting the image (20). The electronic device (100) can obtain information about the game corresponding to the image (20) from the server transmitting the image (20). The information about the game corresponding to the image (20) can include the title of the game. The electronic device (100) can obtain the title of the game corresponding to the image (20) based on the obtained information about the game corresponding to the image (20). The electronic device (100) can search for a game matching the game corresponding to the image (20) based on the title of the game corresponding to the obtained image (20).

[0112] In 530, it can be assumed that the electronic device (100) cannot obtain information about the game from the server transmitting the video (20). This case can be considered to be a case where a partnership regarding data provision has not been established between the manufacturer of the electronic device (100) and the administrator of the server transmitting the video (20). In this case, even if the electronic device (100) identifies a predefined event and requests information about the game from the server transmitting the video (20), the information about the game may not be provided.

[0113] In this case, in one embodiment, the electronic device (100) can obtain the title of the game corresponding to the image (20) using artificial intelligence (AI)-based screen analysis. The electronic device (100) can search for a game matching the game corresponding to the image (20) based on the title of the game corresponding to the obtained image (20).

[0114] Examples of AI-based screen analysis include, but are not limited to, Optical Character Recognition (OCR) or image search.

[0115] For example, when an electronic device (100) identifies a predefined event while an image (20) is displayed on a display, the electronic device (100) can extract frames from the image (20) and apply OCR to each extracted frame to recognize text within the image, thereby obtaining the title of the game corresponding to the image (20). The electronic device (100) can search for a game matching the game corresponding to the image (20) based on the title of the game corresponding to the acquired image (20).

[0116] For example, when the electronic device (100) identifies a predefined event while an image (20) is displayed on the display, the electronic device (100) can extract frames from the image (20), apply an image search to each extracted frame to detect objects in the image or search for similar images, and classify the images into a specific category (e.g., a category by game that has already been classified), thereby obtaining a title of a game corresponding to the image (20). The electronic device (100) can search for a game that matches the game corresponding to the image (20) based on the title of the game corresponding to the acquired image (20).

[0117] An electronic device (100) according to one embodiment of the present disclosure can enhance user satisfaction with a service by providing a method that allows a user watching a video to more easily and efficiently play a game related to the video content. In particular, the electronic device (100) can enhance user satisfaction with the service by securing game titles corresponding to the video being viewed and searching for them through various methods.

[0118] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through the description below.

[0119] FIG. 6 is a drawing for explaining a process in which an electronic device (100) according to one embodiment searches for a game matching a game corresponding to an image.

[0120] Referring to FIG. 6, at 610, an electronic device (100) according to one embodiment can obtain a title of a game corresponding to an image. In this regard, reference is made to FIG. 5, and redundant descriptions thereof are omitted herein.

[0121] At 620, the electronic device (100) according to one embodiment can search for a game matching the game corresponding to the image by comparing the title of the game corresponding to the acquired image with a game database. Based on the title of the game corresponding to the acquired image, the electronic device (100) can search whether a game matching the game corresponding to the image exists in the game database (621).

[0122] In one embodiment, the game database (621) may include at least one of a cloud game list (622), a PC game list (623), or a console game list (624).

[0123] In one embodiment, the cloud game list (622) may mean a list of games provided by a cloud game server.

[0124] Cloud game servers (e.g., NVIDIA, Google, Microsoft, Samsung Electronics, etc.) provide games in a way that the electronic device (100) receives the games streamed from the cloud game server through synchronization with the cloud game server without the user having to download / install the games. Therefore, the user does not need high-performance hardware, and as long as there is an Internet network, the user can play games provided by the cloud game server using the electronic device (100) by subscribing to a service provided by the cloud game server (e.g., NVIDIA's GeForce NOW, Google's Stadia, Microsoft's Xbox Cloud Gaming, Samsung Electronics' Gaming Hub, etc.) by paying a fixed amount every month or by purchasing a specific cloud game provided by the cloud game server.

[0125] In one embodiment, the cloud game list (622) may include titles of games provided by the cloud game server, and may include titles of games that have been previously played using the electronic device (100), as well as titles of games that have been added / updated based on a partnership with the cloud game server, even if the user has not purchased or subscribed.

[0126] In one embodiment, the PC game list (623) may mean a list of games provided by a PC game server.

[0127] PC game servers (e.g., Steam) provide games in a way that allows users to own and play them by purchasing, downloading, and installing them on their personal PCs. By purchasing a specific PC game from a PC game server, users can play the games provided by the PC game server using an electronic device (100) connected to high-performance hardware.

[0128] Additionally, recently, it has become possible to play various PC games provided by PC game servers on electronic devices (100) through cloud gaming services provided by cloud gaming servers. Accordingly, users do not need high-performance hardware, and as long as they have an Internet network, they can log into the cloud gaming service and stream and play PC games already purchased from the PC game server on their electronic devices (100).

[0129] In one embodiment, the PC game list (623) may include titles of games provided by the PC game server, and may include titles of games that have been previously played using the electronic device (100), as well as titles of games that have been added / updated based on a partnership with the PC game server, even if the user has not purchased them.

[0130] In one embodiment, the console game list (624) may mean a list of games provided by a console game server.

[0131] Console game servers (e.g., Sony's PlayStation, Microsoft's Xbox, Nintendo, etc.) provide games through console devices, which are a combination of hardware and software provided by the console game server manufacturer. Users can play games provided by the console game server using an electronic device (100) connected to the console device by purchasing the console device provided by the console game server and purchasing specific console games for the console device.

[0132] In one embodiment, the console game list (624) may include titles of games provided by the console game server, and may include titles of games that have previously been played using the electronic device (100), as well as titles of games that have been newly added / updated based on a partnership with the console game server.

[0133] In general, for console games, unlike games provided based on cloud services, the electronic device (100) could not know the list of console games that it had previously played.

[0134] According to one embodiment of the present disclosure, if the electronic device (100) is a console game that has been previously played using the electronic device (100), the electronic device (100) records the console game screen connected to the electronic device (100), obtains the title of the console game from the recorded screen through artificial intelligence-based screen analysis, generates a console game list (624), and stores it in the electronic device (100). Accordingly, the electronic device (100) can utilize the stored console game list (624) as a game database for a game search function.

[0135] In 630, the electronic device (100) according to one embodiment can successfully search for a game matching the game corresponding to the image if there is a game in the game database that has the same title as the title of the game corresponding to the image.

[0136] If the electronic device (100) successfully searches for a game that matches the game corresponding to the image, the electronic device (100) can control the display to output a UI including a quick start button that allows the game to be immediately executed.

[0137] At 640, the electronic device (100) according to one embodiment may fail to search for a game matching the game corresponding to the image if there is no game in the game database having the same title as the title of the game corresponding to the image.

[0138] If the electronic device (100) fails to search for a game matching the game corresponding to the image, the electronic device (100) can extract games belonging to the same category / genre as the game corresponding to the image from among the games included in the game database, generate a similar game recommendation list, and control a UI including the similar game recommendation list to be output to the display.

[0139] In this case, the user can select one game from the list of similar game recommendations, and the electronic device (100) can control the display to output a UI including a quick start button that allows the selected game to be immediately executed when an input for selecting one game from the list of similar game recommendations is received.

[0140] An electronic device (100) according to one embodiment of the present disclosure can enhance user satisfaction with a service by providing a method that allows a user watching a video to more easily and efficiently play a game related to the video content. In particular, the electronic device (100) can enhance user satisfaction with the service by searching for games based on various game databases, including cloud games, PC games, and console games.

[0141] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through the description below.

[0142] FIG. 7 is a drawing illustrating an example of a UI (700) including a quick start button according to one embodiment.

[0143] Referring to FIG. 7, an electronic device (100) according to one embodiment can control a UI (700) including a quick start button that allows the game to be immediately executed to be output on the display when the electronic device (100) successfully searches for a game matching the game corresponding to the image (20).

[0144] A quick start button may refer to a button that includes a message indicating that the game can be launched immediately, such as "Play right now" in the example of FIG. 7. A UI (700) including a quick start button may further include the title of the game or the logo of the game.

[0145] In one embodiment, the electronic device (100) may automatically run a game matched with a game corresponding to an image (20) based on search results when receiving a user input selecting a quick start button included in the UI (700) (e.g., the “Play right now” button of FIG. 7).

[0146] For example, if a user is watching a video of a game being played and wants to play the game in the video, he or she can trigger the game search function of the electronic device (100) by performing one of the predefined events, and by selecting the quick start button included in the UI (700) displayed on the display according to the search results, the user can immediately run the game without any cumbersome procedures.

[0147] Typically, in the case of console games, unlike games provided based on cloud services, the electronic device (100) cannot automatically run the console game without interaction with the console hardware.

[0148] According to one embodiment of the present disclosure, if the electronic device (100) is a console game that has been previously played using the electronic device (100), the title of the game (e.g., Spider-Man 3), the name of the console game server (e.g., Sonic's PlayStation), the source location of the console game (e.g., HDMI3, etc.), and a series of input signals required to run the game (e.g., pressing the down arrow key once, pressing the right arrow key once, entering the home button, etc.) can be stored in the console game list (624).

[0149] In one embodiment, a series of input signals required to run the game may include a signal to turn on the console device of the console game server, a series of signals input to enter the game's detail page from the console start screen, a signal to select the game's run button, etc.

[0150] According to one embodiment, when an electronic device (100) receives a user input for selecting a quick start button included in a UI (700), if a game matched with a game corresponding to an image (20) according to a search result is a game included in a console game list (624), the electronic device (100) can automatically execute a game matched with a game corresponding to an image (20) based on the name of the corresponding console game server (e.g., Sonic's PlayStation) pre-stored in the console game list (624), the source location of the corresponding console game (e.g., HDMI3, etc.), and a series of input signals required to execute the game (e.g., pressing the down arrow key once, pressing the right arrow key once, entering the home button, etc.).

[0151] For example, when the electronic device (100) receives a user input for selecting a quick start button included in the UI (700), the electronic device (100) automatically turns on the power of the console device of the console game server corresponding to the game based on the console game list (624) using HDMI-CEC or an infrared signal, and automatically inputs a series of signals (e.g., pressing the down arrow key once, pressing the right arrow key once, entering the home button, etc.) necessary to run the game, thereby automatically running the game matched with the game corresponding to the image (20).

[0152] According to one embodiment, an electronic device (100) may receive an input for selecting a quick start button, but may require user account login to run a game corresponding to the quick start button. In this case, the electronic device (100) may control a UI including a game account sign-up button (e.g., "join right now") to be output to the display.

[0153] In one embodiment, the electronic device (100) receives an input selecting a quick start button, but a user purchase may be required to run the game corresponding to the quick start button. In this case, the electronic device (100) may control the display to display a UI including a purchase button (e.g., "buy right now").

[0154] For example, if a manufacturer of an electronic device (100) is assumed to have a partnership with a specific cloud game server, PC game server, or console game server, the electronic device (100) can create service value according to various embodiments below.

[0155] For example, if the game corresponding to the quick start button is a game included in a specific cloud gaming server and the user does not subscribe to a service provided by the cloud gaming server, the electronic device (100) can be controlled to output a UI including a purchase button (e.g., “buy right now”) to the display in order to connect to a screen for applying for a subscription to a service provided by the cloud gaming server.

[0156] For example, if the game corresponding to the quick start button is a game included in a specific PC game server and the game is a game that the user has not purchased, the electronic device (100) can be controlled to output a UI including a purchase button (e.g., "buy right now") to the display in order to connect to a screen for purchasing the game provided by the PC game server.

[0157] For example, if the game corresponding to the quick start button is a game included in a specific console game server and the game is a game that the user has not purchased, the electronic device (100) can be controlled to output a UI including a purchase button (e.g., "buy right now") to the display in order to connect to a screen for purchasing the game provided by the console game server.

[0158] When the user has completed the account registration or purchase required to run the game, the electronic device (100) can run the game corresponding to the quick start button.

[0159] An electronic device (100) according to one embodiment of the present disclosure can improve user satisfaction with a service by providing a method that allows a user watching a video to more easily and efficiently run a game related to the video content. In particular, the electronic device (100) can improve user satisfaction with the service by providing a quick start button that allows the user to immediately run a game corresponding to the video. Furthermore, the electronic device (100) can provide a quick start button that allows the user to immediately run not only cloud games and PC games, but also console games.

[0160] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through the description below.

[0161] FIGS. 8A to 8C are drawings for explaining an example of a method of displaying an image when an electronic device (100) according to one embodiment executes a game matching a game corresponding to an image.

[0162] Referring to FIGS. 8A to 8C, an electronic device (100) according to one embodiment can control the display to output an image in at least one of a PIP (Picture-in-Picture) mode, a split-screen mode, or a multi-device mode when executing a game matched with a game corresponding to an image according to a search result.

[0163] Figure 8a illustrates an example of a PIP (Picture-in-Picture) mode (810). PIP mode is a display mode that displays an additional window in an overlay manner as a miniaturized screen on a certain portion of the display.

[0164] Referring to FIG. 8A, for example, when the electronic device (100) receives an input for selecting a quick start button, the electronic device (100) can control the display of a game execution screen (812) on the entire display and output a video (811, 20) in a small size on the upper left corner of the display in PIP mode. The user can play the searched game on the full screen and simultaneously continue watching the game-related video that was being viewed on the small screen.

[0165] Figure 8b illustrates an example of a split-screen mode (820). Split-screen mode is a display mode that divides a single display into two independent sections, allowing different applications to be viewed simultaneously.

[0166] Referring to FIG. 8B, for example, when the electronic device (100) receives an input for selecting a quick start button, the electronic device (100) can control the entire display to be divided into two independent sections, outputting a game execution screen (822) on the right half of the entire display, and outputting an image (821, 20) on the left half of the entire display. The user can play the game searched for on the right half of the screen, and at the same time continue to watch the game-related image being watched on the left half of the screen.

[0167] Figure 8c illustrates an example of a multi-device mode (830). The multi-device mode is a display mode that allows two or more devices including displays to simultaneously view different applications.

[0168] Referring to FIG. 8C, for example, when the electronic device (100) receives an input for selecting a quick start button, the electronic device (100) can control the game execution screen (832) to be output to the entire display and to continue to output the image (831, 20) on another device connected to the electronic device (100) via wired or wireless communication. To this end, the electronic device (100) can search for peripheral devices to which the electronic device (100) can transmit data regarding the image (831, 20), and can transmit the data regarding the image (831, 20) to the other device via wired or wireless communication. The user can play the searched game in full screen and simultaneously continue to watch the game-related image that was being viewed in full screen on another device.

[0169] An electronic device (100) according to one embodiment of the present disclosure can enhance user satisfaction with a service by providing a method that allows a user watching a video to more easily and efficiently play a game related to the video content. In particular, the electronic device (100) can enhance user satisfaction with the service by providing various screen modes to enable the user to continue watching the video while simultaneously playing a game corresponding to the video.

[0170] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through the description below.

[0171] FIG. 9 is a flowchart for explaining an operation method (900) of an electronic device (100) when the electronic device (100) according to one embodiment fails to search for a game matching a game corresponding to an image.

[0172] Referring to FIG. 9, in step 910, if the electronic device (100) according to one embodiment fails to search for a game matching the game corresponding to the image, the electronic device (100) may extract the category / genre of the game corresponding to the image.

[0173] When the electronic device (100) identifies a predefined event while an image is displayed on the display, it can search for a game matching the image. If, as a result of the search, the electronic device (100) determines that there is no game matching the image in the game database (621), the electronic device (100) may fail to search for a game matching the image.

[0174] In this case, the electronic device (100) can obtain information about the game corresponding to the video from the server transmitting the video or extract the category / genre of the game using artificial intelligence (AI)-based screen analysis.

[0175] For example, game categories / genres may include, but are not limited to, action games, adventure games, role-playing games, simulation games, strategy games, sports games, racing games, puzzle games, arcade games, rhythm games, horror games, MOBA (Multiplayer Online Battle Arena), MMO (Massively Multiplayer Online), etc. For example, each game can be classified into the same category / genre if it has a similar graphic style, play mechanics, and goal, regardless of the type of server providing each game (cloud game server, PC game server, console game server).

[0176] It can be assumed that an electronic device (100) can obtain game-related information from a server transmitting video. In this case, a partnership regarding data provision has been established between the manufacturer of the electronic device (100) and the administrator of the server transmitting the video.

[0177] In this case, in one embodiment, the electronic device (100) can identify the administrator of the server transmitting the video. If the electronic device (100) identifies a predefined event while the video is displayed on the display, the electronic device (100) can request information about the game corresponding to the video from the server transmitting the video. The electronic device (100) can obtain information about the game corresponding to the video from the server transmitting the video. The information about the game corresponding to the video can include the category / genre of the game. The electronic device (100) can extract the category / genre of the game corresponding to the video (20) based on the information about the game corresponding to the acquired video (20).

[0178] It can be assumed that the electronic device (100) cannot obtain game-related information from the server transmitting the video. This case may be due to a lack of a data provision partnership between the manufacturer of the electronic device (100) and the administrator of the server transmitting the video. In this case, even if the electronic device (100) identifies a predefined event and requests game-related information from the server transmitting the video, the electronic device may not be able to receive the game-related information.

[0179] In this case, in one embodiment, the electronic device (100) can extract the category / genre of the game corresponding to the image using artificial intelligence (AI)-based screen analysis.

[0180] Examples of AI-based screen analysis include, but are not limited to, Optical Character Recognition (OCR) or image search.

[0181] For example, the electronic device (100) can extract frames from the image by identifying a predefined event while the image is displayed on the display, and can extract the category / genre of the game corresponding to the image by applying OCR to each extracted frame to recognize text within the image.

[0182] For example, the electronic device (100) can extract frames from the image by identifying a predefined event while the image is displayed on the display, and can extract the category / genre of the game corresponding to the image by applying an image search to each extracted frame to detect objects in the image or searching for similar images to classify the image into a specific category (e.g., a category by game that has already been classified).

[0183] In step 920, the electronic device (100) according to one embodiment may generate a similar game recommendation list including games corresponding to the same category / genre as the game corresponding to the image. The electronic device (100) may generate a similar game recommendation list by selecting games corresponding to the same category / genre as the game corresponding to the image from among the games included in the game database (621). At this time, the electronic device (100) may list the games included in the similar game recommendation list based on priority, and the priority may be set in ascending order of popularity ranking within the same category / genre or games with many contracted advertisements.

[0184] In step 930, the electronic device (100) according to one embodiment can be controlled to output a UI including a generated similar game recommendation list to the display. The user can select one game from among the games included in the similar game recommendation list. When an input for selecting one game from the similar game recommendation list is received, the electronic device (100) can be controlled to output a UI including a quick start button that allows the selected game to be immediately executed on the display. When an input corresponding to the quick start button is received, the electronic device (100) can automatically execute the corresponding game.

[0185] An electronic device (100) according to one embodiment of the present disclosure can enhance user satisfaction with a service by providing a method that allows a user watching a video to more easily and efficiently play a game related to the video content. In particular, the electronic device (100) can enhance user satisfaction with the service and create service value by recommending similar games even if a game matching the video content is not in the game database.

[0186] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through the description below.

[0187] FIG. 10 is a drawing illustrating an example of a UI (1000) including a similar game recommendation list according to one embodiment.

[0188] Referring to FIG. 10, an electronic device (100) according to one embodiment can control a UI (1000) including a list of similar game recommendations to be output to a display when it fails to search for a game matching a game corresponding to an image (20).

[0189] In the example of FIG. 10, the UI (1000) including the similar game recommendation list may include titles or logos of games that fall under the same category / genre as the game corresponding to the video. The UI (1000) including the similar game recommendation list may include quick start buttons (e.g., “Start,” “Play right now,” etc.) that allow the user to immediately launch games that fall under the same category / genre as the game corresponding to the video. In addition, the UI (1000) including the similar game recommendation list may include a button for accessing the cloud game service home page, such as “Browse more,” so that the user can search for games other than those on the list.

[0190] For example, if a user tries to search for a game corresponding to the game in the video he or she was watching but fails, he or she can receive recommendations for similar games to the game through the electronic device (100), and if there is a game he or she wants to play among the similar games, he or she can immediately run the game by selecting the quick start button included in the UI 1000.

[0191] According to one embodiment, when an electronic device (100) receives a user input for selecting a quick start button corresponding to a game included in a UI (1000) when a game included in a similar game recommendation list is a game included in a console game list (624), the electronic device (100) can automatically execute the selected game based on the name of the console game server previously stored in the console game list (e.g., Sonic's PlayStation), the source location of the console game (e.g., HDMI3, etc.), and a series of input signals required to execute the game (e.g., pressing the down arrow key once, pressing the right arrow key once, entering the home button, etc.).

[0192] According to one embodiment, an electronic device (100) receives an input for selecting a quick start button included in a similar game recommendation list of a UI (1000), but a user account login may be required to run a game corresponding to the quick start button. In this case, the electronic device (100) may control a UI including a game account sign-up button (e.g., "join right now") to be output to the display.

[0193] In one embodiment, the electronic device (100) receives an input for selecting a quick start button included in a list of similar game recommendations on the UI (1000), but a user purchase may be required to run the game corresponding to the quick start button. In this case, the electronic device (100) may control the display to output a UI including a purchase button (e.g., "buy right now").

[0194] For example, if a manufacturer of an electronic device (100) is assumed to have a partnership with a specific cloud game server, PC game server, or console game server, the electronic device (100) can create service value according to various embodiments below.

[0195] For example, if the game corresponding to the quick start button is a game included in a specific cloud gaming server and the user does not subscribe to a service provided by the cloud gaming server, the electronic device (100) can be controlled to output a UI including a purchase button (e.g., “buy right now”) to the display in order to connect to a screen for applying for a subscription to a service provided by the cloud gaming server.

[0196] For example, if the game corresponding to the quick start button is a game included in a specific PC game server and the game is a game that the user has not purchased, the electronic device (100) can be controlled to output a UI including a purchase button (e.g., "buy right now") to the display in order to connect to a screen for purchasing the game provided by the PC game server.

[0197] For example, if the game corresponding to the quick start button is a game included in a specific console game server and the game is a game that the user has not purchased, the electronic device (100) can be controlled to output a UI including a purchase button (e.g., "buy right now") to the display in order to connect to a screen for purchasing the game provided by the console game server.

[0198] When the user has completed the account registration or purchase required to run the game, the electronic device (100) can run the game corresponding to the quick start button.

[0199] An electronic device (100) according to one embodiment of the present disclosure can enhance user satisfaction with a service by providing a method that allows a user watching a video to more easily and efficiently play a game related to the video content. In particular, the electronic device (100) can enhance user satisfaction with the service and create service value by recommending similar games even if a game matching the video content is not in the game database.

[0200] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through the description below.

[0201] FIGS. 11A to 11C are drawings for explaining a method for an electronic device (100) according to one embodiment to efficiently execute a game corresponding to an image in conjunction with another device.

[0202] Referring to FIG. 11A, an electronic device (100) according to one embodiment may, when identifying a predefined event while an image (20) is displayed on another device (1100), transmit information about a UI (1110) including a message instructing the other device (1100) to use a game search function of the electronic device (100).

[0203] For convenience of explanation, the following description assumes a smartphone as an example of another device (1100). However, the other device (1100) is not limited to a smartphone, and may include any electronic device capable of viewing videos and communicating with the electronic device (100) via wired or wireless communication.

[0204] For example, if a user (10) is watching a video (20) on a smartphone (1100) and wants to play a game corresponding to the video (20), and there is an electronic device (100) nearby, the user (10) can perform a predefined event, such as “Find a game.” When the electronic device (100) identifies the predefined event, i.e., the user’s voice command “Find a game,” the electronic device (100) can establish wireless communication that supports two-way communication with the smartphone (1100), and can transmit information about a UI (1110) including a message instructing the smartphone (1100) to use a game search function of the electronic device (100), such as “If you want to try the game you are watching, try using the tap view function of the electronic device (100) or a QR code!” The smartphone (1100) can receive information about the UI 1110 from the electronic device (100) and control the display to output the UI 1110.

[0205] According to one embodiment, when a user input is received instructing to use the game search function of the electronic device (100) in response to the UI (1110), the electronic device (100) can receive data regarding an image (20) from another device (1100).

[0206] Examples of user input instructing the use of the game search function of the electronic device (100) may include a tap view or a QR (Quick Response) code.

[0207] Referring to FIG. 11b, for example, a user (10) can use a tab view function (1120b) corresponding to UI 1110. The tab view function refers to a function in which, when a user (10) approaches or touches a smartphone (1100) to a certain range of the side of the electronic device (100), the screen of the smartphone (1100) is automatically mirrored on the electronic device (100).

[0208] When a user (10) brings a smartphone (1100) displaying an image (20) through a tap view function (1120b) corresponding to UI 1110 into contact with a certain range of the side of an electronic device (100), the electronic device (100) can receive data regarding the image (20) from the smartphone (1100).

[0209] Referring to FIG. 11c, for example, a user (10) can use a QR code scanning function (1120c) corresponding to UI 1110. The QR code scanning function refers to a function in which, when a user (10) scans a QR code containing information provided by an electronic device (100) with a smartphone (1100), the software built into the smartphone (1100) decodes the QR code and extracts necessary data.

[0210] The electronic device (100) can control the transmission of information regarding the UI 1110 to the smartphone (1100) and simultaneously generate a QR code and output it on the display. The QR code can be linked to a specific application of the electronic device (100) and include a signal requesting data regarding the image (20) being output from the smartphone (1100).

[0211] When a user (10) scans a QR code containing information provided by an electronic device (100) with a smartphone (1100) that displays an image (20) through a QR code scanning function (1120c) in response to UI 1110, the smartphone (1100) can decode the QR code and transmit data regarding the image (20) to the electronic device (100). The electronic device (100) can receive data regarding the image (20) from the smartphone (1100).

[0212] An electronic device (100) according to one embodiment can search for a game matching a game corresponding to an image (20) based on data regarding the received image (20).

[0213] An electronic device (100) according to one embodiment can control a UI (1130b) including a quick start button that enables execution of a game matching a game corresponding to an image (20) according to a search result to be output to a display, or can transmit information about a UI (1130c) including a quick start button to another device (1100).

[0214] For example, in FIG. 11b, if a user wishes to play a game matching the game corresponding to the image (20), the user may select the quick start button included in UI 1130b. When the electronic device (100) receives an input for selecting the quick start button included in UI 1130b, the electronic device (100) may automatically launch the game corresponding to the quick start button.

[0215] For example, in FIG. 11c, the smartphone (1100) can receive information about UI 1130c including a quick start button from the electronic device (100) and control the display to output the UI 1130c. When the user selects the quick start button included in the UI 1130c, the smartphone (1100) can transmit an input for selecting the quick start button included in the UI 1130c to the electronic device (100), and accordingly, the electronic device (100) can receive an input for selecting the quick start button included in the UI 1130c. When the electronic device (100) receives an input for selecting the quick start button included in the UI 1130c, the electronic device (100) can automatically execute a game corresponding to the quick start button.

[0216] An electronic device (100) according to one embodiment of the present disclosure can enhance user satisfaction with a service by providing a method that allows a user watching a video to more easily and efficiently play a game related to the video content. In particular, the electronic device (100) can enhance user satisfaction with the service and create service value by enabling the user to utilize the game search function of the electronic device even when watching a video using another device.

[0217] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs through other descriptions in this specification.

[0218] FIG. 12 is a block diagram of an electronic device (100) according to one embodiment.

[0219] Referring to FIG. 12, an electronic device (100) according to one embodiment may include a display or various types of devices that can be connected to a display. For example, the electronic device (100) may include a TV, a smart monitor, a tablet PC, a laptop, a digital signage, a large display, a 360-degree projector, etc. that include a display. Alternatively, the electronic device (100) may include a set-top box, a desktop PC, etc. that can be connected to a display, but is not limited thereto.

[0220] An electronic device (100) according to one embodiment may include a memory (120) and at least one processor (130). However, the electronic device (100) may be implemented with more components than those illustrated, and is not limited to the examples described above. The components will be described in turn below.

[0221] The memory (120) can store a program for processing and controlling at least one processor (130), and can store data input to or output from the electronic device (100).

[0222] The memory (120) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0223] A memory (120) according to one embodiment may include one or more instructions that perform a function of searching for a game that matches a game corresponding to an image disclosed in the present disclosure.

[0224] At least one processor (130) controls the overall operation of the electronic device (100). For example, at least one processor (130) may control a display by executing one or more instructions stored in the memory (120), and may perform the functions of the electronic device described in FIGS. 1 to 11C.

[0225] The processor (130) may be composed of one or more processors. In this case, one or more processors may be a general-purpose processor such as a CPU, AP, or DSP (Digital Signal Processor), a graphics-only processor such as a GPU or VPU (Vision Processing Unit), or an artificial intelligence-only processor such as an NPU. For example, if one or more processors are artificial intelligence-only processors, the artificial intelligence-only processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0226] At least one processor (130) may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits, including at least one processor. One or more processors in the at least one processor may be configured to perform various functions described herein, individually and / or collectively, in a distributed fashion. As used herein, “processor,” “at least one processor,” and “one or more processors” may be configured to perform multiple functions. However, these terms encompass, without limitation, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor may perform all of the functions. Furthermore, the at least one processor may include a combination of processors that perform various of the disclosed functions in a distributed manner. The at least one processor may execute program instructions to achieve or perform various functions.

[0227] According to one embodiment, at least one processor (130) may, by executing one or more instructions stored in the memory (120), search for a game matching the game corresponding to the image when a predefined event is identified while the image is displayed on the display. At least one processor (130) may, by executing one or more instructions stored in the memory (120), control the display to output a UI including a quick start button that enables the game matching the game corresponding to the image to be executed based on the search results.

[0228] In one embodiment, the predefined event may include at least one of a gamepad connection signal; a specific button press on a remote device; a voice input requesting a game search; or an input that pauses the video.

[0229] According to one embodiment, at least one processor (130) may, by executing one or more instructions stored in the memory (120), identify a predefined event and obtain information about a game corresponding to the video from a server transmitting the video. At least one processor (130) may, by executing one or more instructions stored in the memory (120), obtain a title of the game corresponding to the video based on the information about the game. At least one processor (130) may, by executing one or more instructions stored in the memory (120), search for a game matching the game corresponding to the video based on the obtained game title.

[0230] According to one embodiment, at least one processor (130) may, by executing one or more instructions stored in the memory (120), identify a predefined event, and, using artificial intelligence (AI)-based screen analysis, obtain a title of a game corresponding to the image. At least one processor (130) may, by executing one or more instructions stored in the memory (120), search for a game matching the game corresponding to the image based on the obtained game title.

[0231] According to one embodiment, at least one processor (130) may search for a game matching the game corresponding to the image by comparing the title of the acquired game with a game database including at least one of a cloud game list, a PC game list, or a console game list by executing one or more instructions stored in the memory (120).

[0232] According to one embodiment, at least one processor (130) may automatically execute a game matched with a game corresponding to an image based on search results when receiving a user input selecting a quick start button included in a UI by executing one or more instructions stored in the memory (120).

[0233] According to one embodiment, the console game list may include the name of a console game server, a source location, and a series of input signals required to execute the game, corresponding to console games previously executed on the electronic device. At least one processor (130) may, by executing one or more instructions stored in the memory (120), automatically execute a game matched with the game corresponding to the image based on the name of the console game server, the source location, and a series of input signals required to execute the game, stored in the console game list, when receiving a user input selecting a quick start button included in the UI.

[0234] According to one embodiment, at least one processor (130) may control the display to output the image in at least one of a PIP (Picture-in-Picture) mode, a split screen mode, or a multi-device mode by executing one or more instructions stored in the memory (120) to execute a game matching the game corresponding to the image according to the search results.

[0235] According to one embodiment, at least one processor (130) may extract a category of a game corresponding to an image if searching for a game matching the game corresponding to the image fails by executing one or more instructions stored in the memory (120). At least one processor (130) may generate a similar game recommendation list including games corresponding to the category of the game corresponding to the image by executing one or more instructions stored in the memory (120). At least one processor (130) may control a UI including the similar game recommendation list to be output to a display by executing one or more instructions stored in the memory (120).

[0236] According to one embodiment, at least one processor (130) may control to output a UI including a message instructing to perform an operation necessary for using a game search function of an electronic device to another device by executing one or more instructions stored in the memory (120), when the predefined event is identified while the image is displayed on the other device. At least one processor (130) may receive data regarding an image from the other device by executing one or more instructions stored in the memory (120), when a user input corresponding to an operation necessary for using the game search function of the electronic device in response to the UI is received through the other device. At least one processor (130) may search for a game matching a game corresponding to the image based on the received data by executing one or more instructions stored in the memory (120). At least one processor (130) can control a UI including a quick start button that enables a game matching a game corresponding to an image to be executed based on search results by executing one or more instructions stored in the memory (120) to be output on a display or other device.

[0237] An electronic device (100) according to one embodiment of the present disclosure can improve user satisfaction with services by providing a method for enabling a user watching a video to more easily and efficiently execute a game related to the video content.

[0238] However, the effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from other descriptions in the specification.

[0239] Figure 13 is a specific block diagram of an electronic device (100) according to one embodiment.

[0240] As illustrated in FIG. 13, the electronic device (100) may further include a video processing unit (180), an audio processing unit (115), an audio output unit (125), a tuner unit (140), a communication unit (150), a detection unit (160), and an input / output unit (170) in addition to a display (110), a memory (120), a processor (130), and a user input unit (190).

[0241] Regarding the memory (120) and processor (130), the same contents as described in FIG. 12 are omitted in FIG. 13.

[0242] The display (110) can display data processed in the electronic device (100). When the display (110) is implemented as a touch screen, the display (110) can be used as an input device in addition to an output device. For example, the display (110) can include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, and an electrophoretic display.

[0243] The tuner unit (140) can select and tune only the frequency of the channel to be received by the electronic device (100b) among many radio wave components through amplification, mixing, resonance, etc. of the broadcast signal received wired or wirelessly. The broadcast signal includes audio, video, and additional information (e.g., EPG (Electronic Program Guide)).

[0244] The communication unit (150) can connect the electronic device (100) to an external device (e.g., an audio device, a mobile device, etc.) under the control of the processor (130). The processor (130) can transmit / receive content to / from an external device connected via the communication unit (150), download an application from the external device, or perform web browsing.

[0245] The communication unit (150) may include one or more modules that enable wireless communication between the electronic device (100) and a wireless communication system or between the electronic device (100) and a network in which another electronic device is located. For example, the communication unit (150) may include a broadcast reception module (151), a mobile communication module (152), a wireless Internet module (153), and a short-range communication module (154). The communication unit (150) may be referred to as a transmission / reception unit.

[0246] The broadcast receiving module (151) receives broadcast signals and / or broadcast-related information from an external broadcast management server via a broadcast channel. The broadcast signals may include TV broadcast signals, radio broadcast signals, and data broadcast signals, as well as broadcast signals in the form of a TV broadcast signal or radio broadcast signal combined with a data broadcast signal.

[0247] A mobile communication module (152) transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signals may include various types of data, such as voice call signals, video call signals, or text / multimedia message transmission and reception.

[0248] The wireless Internet module (153) refers to a module for wireless Internet access, and can be built into or external to the device. Wireless Internet technologies that can be used include WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed ​​Downlink Packet Access). Through the wireless Internet module (153), the device can establish a Wi-Fi connection with other devices. For example, the processor (130) can communicate with one or more APs (300) using the wireless Internet module (153).

[0249] A short-range communication module (154) refers to a module for short-range communication. Short-range communication technologies that can be used include Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA, infrared Data Association), UWB (Ultra Wideband), and ZigBee.

[0250] The detection unit (160) detects the user's voice, the user's image, or the user's interaction, and may include a microphone (161), a camera unit (162), and a light receiving unit (163).

[0251] A microphone (161) receives a user's spoken voice. The microphone (161) can convert the received voice into an electrical signal and output it to a processor (130).

[0252] The camera unit (162) can receive images (e.g., consecutive frames) corresponding to a user's motion including a gesture within the camera recognition range.

[0253] The optical receiver (163) receives an optical signal (including a control signal) from a remote control device. The optical receiver (163) can receive an optical signal corresponding to a user input (e.g., a touch, a press, a touch gesture, a voice, or a motion) from the control device. A control signal can be extracted from the received optical signal under the control of the processor (130).

[0254] The input / output unit (170) receives video (e.g., moving pictures, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from the outside of the electronic device (100) under the control of the processor (130). The input / output unit 170 may include one or a combination of an HDMI port (High-Definition Multimedia Interface port, 171), a component jack (component jack, 172), a PC port (PC port, 173), and a USB port (USB port, 174).

[0255] The video processing unit (180) processes image data to be displayed by the display (110) and can perform various image processing operations such as decoding, rendering, scaling, noise filtering, frame rate conversion, and resolution conversion on the image data.

[0256] The display (110) can display a video included in a broadcast signal received through the tuner unit (140) under the control of the processor (130) on the screen. In addition, the display (110) can display content (e.g., a moving picture) input through the communication unit (150) or the input / output unit (170). The display (110) can output an image stored in the memory (120) under the control of the processor (130).

[0257] Meanwhile, when the display (110) and the touchpad are configured as a touch screen in a layered structure, the display (110) can be used as an input device in addition to an output device. The display (110) can include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, and an electrophoretic display.

[0258] The audio processing unit (115) performs processing on audio data. The audio processing unit (115) can perform various processing such as decoding, amplification, and noise filtering on audio data.

[0259] The audio output unit (125) can output audio included in a broadcast signal received through the tuner unit (140) under the control of the processor (130), audio input through the communication unit (150) or the input / output unit (170), and audio stored in the memory (120). The audio output unit (125) can include at least one of a speaker (126), a headphone output terminal (127), or a S / PDIF (Sony / Philips Digital Interface:) output terminal (128).

[0260] The user input unit (190) refers to a means for a user to input data for controlling the electronic device (100). The user input unit (190) may include a touch input unit that receives a touch input. For example, the user input unit (190) may include, but is not limited to, a key pad, a dome switch, a touch pad (contact electrostatic capacitance type, pressure resistive film type, infrared detection type, surface ultrasonic conduction type, integral tension measurement type, piezo effect type, etc.), a jog wheel, a jog switch, etc.

[0261] According to one embodiment, the memory (120) can store a program for processing and controlling the processor (130) and can store data input to or output from the electronic device (100).

[0262] The processor (130) controls the overall operation of the electronic device (100) and the signal flow between internal components of the electronic device (100), and performs a function of processing data. When there is a user input or a preset stored condition is satisfied, the processor (130) can execute an OS (Operating System) and various applications stored in the memory (120). In addition, according to one embodiment, the processor (130) can execute one or more instructions stored in the memory (120) that implement a function for combining and controlling multiple windows.

[0263] Meanwhile, the block diagram of the electronic device (100) illustrated in FIGS. 12 and 13 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the electronic device (100) actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0264] A specific example for explaining an embodiment according to the present disclosure is only one combination of each criterion, method, detailed method, and operation, and by combining at least two or more of the various techniques described, the electronic device (100) can provide a method for a user watching a video to more easily and efficiently execute a game related to the video content, thereby improving the user's service satisfaction. In addition, at this time, it can be performed according to a method determined through one or a combination of at least two or more of the above-described techniques. For example, it may be possible to perform a part of the operation of one embodiment by combining it with a part of the operation of another embodiment.

[0265] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0266] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0267] According to one embodiment of the present disclosure, an electronic device can enhance user satisfaction with a service by providing a method that allows a user watching a video to more easily and efficiently play a game related to the video content. However, the effects obtained from the present disclosure are not limited to the effects mentioned above, and other effects not mentioned will be readily apparent to those skilled in the art to which the present disclosure pertains.

Claims

1. In an electronic device (100), A memory (120) storing one or more instructions; and At least one processor (130) that executes one or more instructions stored in the memory (120), The above at least one processor (130) executes the one or more instructions, When a predefined event is identified while an image is displayed on the display, a game matching the game corresponding to the image is searched for (210), and An electronic device that controls (220) to output a UI including a quick start button that enables execution of a game matching the game corresponding to the image according to the search results on the display.

2. In the first paragraph, the predefined event is: An electronic device comprising at least one of a gamepad connection signal; a specific button input of a remote device; a voice input requesting a game search; or an input for pausing the video.

3. In the first or second paragraph, the at least one processor executes the one or more instructions, When the above predefined event is identified, information about the game corresponding to the video is obtained from the server transmitting the video, Based on the information about the above game, obtain the title of the game corresponding to the above image, and An electronic device that searches for a game matching the game corresponding to the video based on the title of the game acquired above.

4. In any one of the first to third paragraphs, the at least one processor executes the one or more instructions, When the above predefined event is identified, the title of the game corresponding to the video is obtained using artificial intelligence (AI)-based screen analysis, An electronic device that searches for a game matching the game corresponding to the video based on the title of the game acquired above.

5. In the third or fourth paragraph, the at least one processor executes the one or more instructions, An electronic device that searches for a game matching the game corresponding to the image by comparing the title of the acquired game with a game database including at least one of a cloud game list, a PC game list, or a console game list.

6. In any one of paragraphs 1 to 5, the at least one processor executes the one or more instructions, An electronic device that automatically runs a game matched with a game corresponding to the image according to the search results when receiving a user input selecting the quick start button included in the UI.

7. In either of paragraphs 5 or 6, The above console game list includes the name of the console game server, the source location, and a series of input signals required to run the game, corresponding to console games previously run on the electronic device. The at least one processor executes the one or more instructions, An electronic device that automatically executes a game matching the game corresponding to the image based on the name of the console game server stored in the console game list, the source location, and a series of input signals required to execute the game, when receiving a user input selecting the quick start button included in the UI.

8. In any one of paragraphs 1 to 7, An electronic device that controls the display to output the video in at least one of a PIP (Picture-in-Picture) mode, a split screen mode, or a multi-device mode when a game matching the game corresponding to the video is executed according to the search results.

9. In any one of paragraphs 1 to 8, the at least one processor executes the one or more instructions, If the search for a game matching the game corresponding to the above image fails, the category of the game corresponding to the above image is extracted, Generate a list of similar game recommendations that include games that fall into the above categories, An electronic device that controls a UI including the list of recommended similar games to be output to the display.

10. In any one of paragraphs 1 to 9, the at least one processor executes the one or more instructions, If the above predefined event is identified while the above video is displayed on another device, Controlling the output of a UI to the other device, which includes a message instructing the other device to perform the necessary actions to use the game search function of the electronic device; When a user input corresponding to an action required to use the game search function of the electronic device in response to the UI is received through the other device, data regarding the image is received from the other device, Based on the data received above, search for a game matching the game corresponding to the video, An electronic device that controls the UI, including the quick start button, to be output on the display or the other device so that the game matching the game corresponding to the image can be executed according to the search results.

11. In the operating method (200) of the electronic device (100), When a predefined event is identified while an image is displayed on the display, a step (210) of searching for a game matching the game corresponding to the image; and A method comprising a step (220) of controlling a UI including a quick start button that enables execution of a game matching the game corresponding to the image according to the search result to be output to the display.

12. In the 11th paragraph, the step of searching for a game matching the game corresponding to the image is, When identifying the above predefined event, a step of obtaining information about a game corresponding to the video from a server transmitting the video; A step of obtaining a title of a game corresponding to the image based on information about the game; and A method comprising the step of searching for a game matching the game corresponding to the image based on the title of the game acquired above.

13. In the 11th or 12th paragraph, the step of searching for a game matching the game corresponding to the image is: Upon identifying the above predefined event, a step of obtaining the title of the game corresponding to the image using artificial intelligence (AI)-based screen analysis; and A method comprising the step of searching for a game matching the game corresponding to the image based on the title of the game acquired above.

14. In the 13th paragraph, the step of searching for a game matching the game corresponding to the image is, A method comprising the step of searching for a game matching the game corresponding to the image by comparing the title of the acquired game with a game database including at least one of a cloud game list, a PC game list, or a console game list.

15. A computer-readable recording medium having recorded thereon at least one program for implementing the method described in any one of claims 11 to 14.

Images