Electronic device and method of operating the same

Abstract

The disclosed electronic device, when receiving a user input for streaming a screen corresponding to content displayed on a display during execution of a game application, obtains information corresponding to an output state of the electronic device for displaying the content, and based on the obtained information, transmits data for streaming a screen including at least one of the content and an object displayed on the display, which is different from the content, to a server through a communication interface.

Description

Technical Field

[0001] Various embodiments relate to an electronic device and a method of operating the electronic device, and more specifically, to an electronic device capable of broadcasting game screens and a method of operating the electronic device. Background Technology

[0002] In recent years, the number of game users has been increasing, and the demand for enjoying game content on large-screen TVs to enhance the immersive gaming experience has been growing.

[0003] Cloud gaming is a gaming service with the following structure: the main operations required for the game, such as graphics processing, are performed on cloud servers; user input is sent from user devices such as smartphones or smart TVs to the servers; and the rendered game screen is received by the user devices for display via streaming.

[0004] Recently, due to the emergence of various broadcast servers, it has become increasingly common for users playing games on electronic devices to broadcast the game screen displayed on their electronic devices through broadcast servers. Summary of the Invention

[0005] Solution to the problem

[0006] According to an embodiment, an electronic device may include a communication interface, a memory storing one or more instructions, and at least one processor configured to execute one or more instructions stored in the memory.

[0007] According to an embodiment, when one or more instructions are executed by at least one processor, the electronic device can, during the execution of a game application, respond to receiving user input for streaming a screen corresponding to content displayed on a display, and obtain information corresponding to the output state of the electronic device for displaying the content.

[0008] According to an embodiment, when one or more instructions are executed by at least one processor, the electronic device can, based on the information obtained, control the sending of data for streaming a screen to a server via a communication interface. The screen includes at least one of the content and an object displayed on the display, which is different from the content.

[0009] According to an embodiment, a method of operating an electronic device may include: during the execution of a game application, in response to receiving user input for streaming a screen corresponding to content displayed on a display, obtaining information corresponding to the output state of the electronic device for displaying the content.

[0010] According to an embodiment, a method of operating an electronic device may include: sending data for streaming a screen to a server via a communication interface based on obtained information, the screen including at least one of content and an object displayed on a display, the object being different from the content.

[0011] According to an embodiment, in a non-transitory computer-readable recording medium storing one or more instructions executable by at least one processor of an electronic device, the one or more instructions, when executed by at least one processor of the electronic device, cause the electronic device to perform the following operations: in response to receiving user input for streaming a screen corresponding to content displayed on a display during the execution of a game application, obtaining information corresponding to the output state of the electronic device for displaying the content, and based on the obtained information, controlling the sending of data for streaming the screen to a server via a communication interface, the screen including at least one of the content and an object displayed on the display, the object being different from the content. Attached Figure Description

[0012] This disclosure can be readily understood by taking into account the following detailed description and accompanying drawings, in which reference numerals denote structural elements.

[0013] Figure 1 This is a reference diagram illustrating the operation of an electronic device according to an embodiment.

[0014] Figure 2 An example of a system including an electronic device, an input device, and a broadcast server according to an embodiment is shown.

[0015] Figure 3 This is an example of a block diagram of an electronic device according to an embodiment.

[0016] Figure 4 This is a reference diagram according to an embodiment for describing the operation of selecting a game application in a user interface through which game applications can be selected.

[0017] Figure 5 This is a reference diagram, according to an embodiment, for describing the operation of selecting game content items in a game application user interface.

[0018] Figure 6 An example of a media player pipeline according to an embodiment is shown.

[0019] Figure 7 This is a flowchart illustrating an example of a method for operating an electronic device according to an embodiment.

[0020] Figure 8 An example of a quick panel according to an embodiment is shown.

[0021] Figure 9This is a reference diagram illustrating the operation of linking an electronic device and a broadcast server according to an embodiment.

[0022] Figure 10 An example of an auxiliary screen that can be displayed together with the game screen according to an embodiment is shown.

[0023] Figure 11 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0024] Figure 12 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0025] Figure 13 Examples of images displayed on an electronic device and broadcast images displayed on a viewer's device, according to embodiments, are shown.

[0026] Figure 14 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0027] Figure 15 It is a description based on the embodiments. Figure 14 The reference diagram shows an example of an electronic device screen and a broadcast screen displaying the operation.

[0028] Figure 16 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0029] Figure 17 It is a description based on the embodiments. Figure 16 The reference diagram shows an example of the operation displayed on an electronic device and a broadcast screen.

[0030] Figure 18 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0031] Figure 19 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0032] Figure 20 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0033] Figure 21 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0034] Figure 22 It is a description based on the embodiments. Figure 21 The image shown is a reference diagram of the screen broadcast for the operation. Detailed Implementation

[0035] The terminology used in this specification will be briefly explained, and this disclosure will be described in detail.

[0036] The terminology used in this disclosure has been chosen as far as possible from currently widely used, general terms in consideration of the functions of this disclosure, but this may vary depending on the intent of those skilled in the art, precedent, the emergence of new technologies, etc. Additionally, in certain cases, there are terms that the applicant may arbitrarily choose; in such cases, the meaning of the term will be described in detail in the corresponding descriptive section of this disclosure. Therefore, the terminology used in this disclosure should be defined based on the meaning of the term and the details throughout this disclosure, rather than the simple name of the term.

[0037] Throughout this specification, when a component is referred to as "comprising" a certain element, it means that other components may be included rather than excluded, unless otherwise stated. Furthermore, terms such as "...unit," "module," etc., described in this specification refer to a unit that performs at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software.

[0038] Additionally, the description "at least one of A, B, and C" means that it can be any one of "A", "B", "C", "A and B", "A and C", "B and C", and "A, B, and C".

[0039] In the following description, embodiments will be illustrated with reference to the accompanying drawings, enabling those skilled in the art to readily implement these embodiments. However, this disclosure can be implemented in various different forms and is not limited to the embodiments described herein. For the sake of clear description in the drawings, components unrelated to the description have been omitted, and similar reference numerals are used for similar components throughout this specification.

[0040] In this disclosure, the term "user" refers to a person who uses control devices to control the functions or operation of computing or electronic devices, and may include viewers, administrators, or installation technicians. In this disclosure, a user of an electronic device providing broadcasting can be referred to as a game player, participant, broadcaster, etc., and a user of a device watching broadcasts can be referred to as a viewer, etc.

[0041] In this disclosure, a "game application" is an application capable of playing cloud games, and the user interface of the game application can provide items that allow requests to execute one or more cloud game contents. A game application may primarily include a portion that provides a user interface and processes user input according to the execution of such a game application, as well as a portion that plays audio and video data received from a cloud server in a streaming manner. The game application enables not only cloud gaming but also console gaming.

[0042] In this disclosure, "broadcast" refers to internet broadcasting that transmits audio or video information to subscribers via the internet network. In internet broadcasting, when a user providing the broadcast sends broadcast content to a platform server providing the broadcast service using his or her electronic device, the platform server can send the received broadcast content to the subscriber. The term "broadcast" can also be referred to as streaming.

[0043] Figure 1 This is a reference diagram illustrating the operation of an electronic device according to an embodiment.

[0044] refer to Figure 1 The electronic device 100 according to the embodiment can be an electronic device that receives content from various sources and displays the received content. The electronic device 100 can be implemented in various forms, such as a TV, set-top box, mobile phone, tablet PC, digital camera, camcorder, laptop computer, desktop computer, e-book terminal, digital broadcasting terminal, personal digital assistant (PDA), portable multimedia player (PMP), navigation device, MP3 player, wearable device, etc.

[0045] In addition, the electronic device 100 may be a fixed electronic device set in a fixed location or a portable electronic device in a portable form, and may be a digital broadcast receiver capable of receiving digital broadcasts.

[0046] In addition, the electronic device 100 can be controlled via various types of devices (such as remote controls, mobile phones, or game controllers) using IR (infrared), BT (Bluetooth), Wi-Fi, etc.

[0047] According to an embodiment, electronic device 100 can be coupled to game console 10 via wired or wireless communication technology to receive and display game screens from game console 10. Game console 10 can execute a game application and send the game screens generated by executing the game application to electronic device 100. The game screens can be referred to as the result image of executing the game application, the result screen rendered based on the execution of the game application, or the result screen of the game application execution. Electronic device 100 can then display the game screens received from game console 10. User input for controlling the game screens to play the game can be sent from electronic device 100 to game console 10. Game console 10 can execute the game application based on the user input transmitted from electronic device 100 and send the resulting game screens to electronic device 100.

[0048] According to an embodiment, the electronic device 100 can display game footage received from the game server 20. The game server 20 can execute a game application in response to a request from the electronic device 100 and send game footage rendered according to the execution of the game application to the electronic device 100 via a communication network. For example, when the game server 20 receives a request from the electronic device 100 to execute a game application, the game server 20 can execute the game application and send game footage rendered according to the execution of the game application to the electronic device 100 via a communication network. The electronic device 100 can then display the game footage received from the game server 20 on a display.

[0049] Simultaneously, electronic device 100 can provide a central service for games, namely a game central service. This central service provides functions such as coupling and controlling cloud gaming, game consoles, etc., optimizing image quality or sound settings suitable for games, and driving related applications. Electronic device 100 can provide the game central service by executing game applications corresponding to the game central service. Based on the aforementioned game central service, electronic device 100 can search for and execute games available on cloud gaming and console gaming devices, and execute overall game-related settings, control of external devices, etc. Cloud gaming refers to a game service with the following structure: user input is sent from the user device to a cloud server, and the cloud server streams game screens rendered by a cloud gaming application controlled by performing main operations (such as graphics processing based on user input) to a display device such as a smart TV.

[0050] According to an embodiment, the electronic device 100 can provide various functions based on this game central service when executing a game application. For example, the electronic device 100 can display a game screen 31 executed according to the game content based on the game application. For example, when displaying the game screen 31 based on the game application, the electronic device 100 can display at least one object on the game screen by executing at least one function. For example, the object can represent an additional screen or auxiliary screen in addition to the game screen, such as a camera screen 32 obtained by capturing an image of the user of the electronic device 100, a chat screen 33, a menu screen 34, or an advertising image.

[0051] According to an embodiment, when displaying game screen 31 based on game content in a game application, the electronic device 100 can send the game screen 31 to the broadcast server 300 to broadcast the game screen 31. Then, the broadcast server 300 can send the received game screen 31 to the broadcast viewer device 50, so that the game screen 31 displayed on the electronic device 100 is broadcast.

[0052] However, when broadcasting game screen 31 displayed using a game application, the electronic device 100 can overlay and display various objects on top of and on the game screen 31 in addition to the game screen 31. However, among one or more objects overlaid on the game screen 31 as described above, the user of the electronic device 100 may have objects they wish to broadcast and objects they do not wish to broadcast. For example, a user may want to broadcast chat screen 33 or camera screen 32 displaying their image, but a quick panel screen, which serves as a menu screen 34 for controlling the electronic device 100, is useless content for the broadcast viewer and may instead interfere with viewing the game screen; therefore, broadcasting the quick panel screen may not be necessary. Therefore, in the disclosed embodiments, an electronic device capable of selectively broadcasting objects displayed on a game screen is provided. For example, as... Figure 1 As shown, under the control of electronic device 100, a broadcast can be sent to broadcast viewer device 50. At the same time, among the objects displayed on game screen 31, camera screen 32 and chat screen 33 are displayed, while menu screen 34 is not displayed.

[0053] According to an embodiment, when running a game application, the electronic device 100 can mix game footage and camera footage and provide them to a broadcast server, so that camera footage including user images obtained by taking pictures of the user of the electronic device 100 can be broadcast together with game footage.

[0054] According to an embodiment, when running a game application, the electronic device 100 can mix game visuals and objects and provide them to a broadcast server, so that objects superimposed on the game visuals displayed on the screen of the electronic device 100 can be broadcast along with the game visuals. These objects may correspond to a graphics layer. Accordingly, users of the electronic device 100 can broadcast objects they wish to display to viewers, as well as game visuals.

[0055] According to an embodiment, when running a game application, the electronic device 100 may only provide game footage to the broadcast server, preventing predetermined objects among the objects displayed on the game footage superimposed on the display of the electronic device 100 from being broadcast. These predetermined objects may include quick panel screens. Accordingly, by preventing the broadcast of menu screens (such as quick panel screens) that viewers are not interested in during game broadcasts, the viewer's game broadcast experience can be improved.

[0056] According to an embodiment, when running a game application, the electronic device 100 can mix game footage and graphic image footage and provide them to a broadcast server, so that the graphic image footage can be broadcast on top of the game footage displayed on the screen of the electronic device 100. The graphic image footage may include advertising footage. Accordingly, by providing users with a means to conveniently insert advertising images during their game broadcasts, users can more easily provide advertising.

[0057] According to an embodiment, when a game application is running and the game screen is not displayed on the monitor of the electronic device 100, the electronic device 100 may provide a graphic image screen instead of the game screen to a broadcast server. The graphic image screen broadcast in place of the game screen may include an advertising image screen. Accordingly, by providing users with a means to conveniently insert advertising images during periods when no game screen is being sent, users can more easily submit advertisements.

[0058] Figure 2 An example of a system including an electronic device, an input device, and a broadcast server according to an embodiment is shown.

[0059] refer to Figure 2 The system may include an electronic device 100, an input device 200, and a broadcast server 300 connected via a communication network.

[0060] Electronic device 100 is a device capable of displaying images or data according to a user's request, and may include a communication unit 110, a display 120, a memory 130, and a processor 140.

[0061] The communication unit 110 may include various communication circuits for performing communication with at least one external device. Here, "communication" may refer to the operation of sending and / or receiving data, signals, requests and / or commands.

[0062] The communication unit 110 can perform wired or wireless communication with at least one external device. The external device may be a broadcast server 300, an input device 200, etc.

[0063] For example, the communication unit 110 may include at least one of a communication module, a communication circuit, a communication device, an input / output port, and an input / output plug for performing wired or wireless communication with at least one external device.

[0064] For example, communication unit 110 may include at least one wireless communication module, wireless communication circuit or wireless communication device for performing wireless communication with at least one external device.

[0065] For example, the communication unit 110 may include a short-range communication module, such as an IR (infrared) communication module, capable of receiving control commands from a remote controller (e.g., input device 200) located at a short distance. In this case, the communication unit 110 can receive control signals from the remote controller.

[0066] As another example, communication unit 110 may include at least one communication module that performs communication according to wireless communication standards such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, or ZigBee. Alternatively, communication unit 110 may also include a communication module for performing communication with a server according to long-range communication standards to support long-range communication. For example, communication unit 110 may include a communication module that performs communication over a network to conduct Internet communication. Additionally, communication unit 110 may include a communication module that performs communication over a communication network conforming to communication standards such as 3G, 4G, 5G, and / or 6G.

[0067] As another example, the communication unit 110 may include at least one port for connecting to an external device via a wired cable to communicate with the external device via a wired connection. For example, the communication unit 110 may include at least one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port. Accordingly, the communication unit 110 can perform communication with an external device connected via a wired connection through at least one port. Here, a port may refer to a physical device configuration capable of connecting or inserting cables, communication lines, or plugs.

[0068] As described above, the communication unit 110 may include at least one supporting element for supporting communication between the electronic device 100 and external devices. Here, the supporting element may include the aforementioned communication module, communication circuit, communication device, port (for data input / output), cable port (for data input / output), plug (for data input / output), etc. For example, the at least one supporting element included in the communication unit 110 may include, for example, an Ethernet communication module, a Wi-Fi communication module, a Bluetooth communication module, an IR communication module, a USB port, a tuner (or broadcast receiver), an HDMI port, a DP (display port), a DVI (digital video interface) port, etc.

[0069] The display 120 can output images or data processed in the electronic device 100.

[0070] The memory 130 can store programs for processing and control by the processor 140, and can also store data input to or output from the electronic device 100. Additionally, the memory 130 can store data required for the operation of the electronic device 100.

[0071] The memory 130 may include at least one type of storage medium selected from flash memory, hard disk, multimedia card micro, card memory (e.g., SD or XD memory), RAM (random access memory), SRAM (static random access memory), ROM (read-only memory), EEPROM (electrically erasable programmable read-only memory), PROM (programmable read-only memory), magnetic storage, magnetic disk, and optical disk.

[0072] Processor 140 controls the overall operation of electronic device 100. For example, processor 140 can perform the functions of electronic device 100 described in this disclosure by executing one or more instructions stored in memory 130.

[0073] Processor 140 may include various processing circuitry and / or multiple processors. For example, the term "processor" as used herein (including the claims) may include various processing circuitry comprising at least one processor. One or more of the at least one processor may be configured to perform the various functions described herein individually and / or collaboratively in a distributed manner. As used herein, "processor," "at least one processor," and "one or more processors" may be configured to perform various functions. However, this terminology covers, for example, but not limited to, situations where one processor performs some functions while other processors perform other functions, and situations where a single processor can perform all functions. Additionally, the at least one processor may include a combination of processors performing the various functions among the disclosed functions in a distributed manner. The at least one processor may execute program instructions to implement or perform the various functions.

[0074] In embodiments of this disclosure, the processor 140 may store one or more instructions in an internally configured memory, and control the operation of the display device by executing one or more instructions stored in the internally configured memory. That is, the processor 140 may perform a predetermined operation by executing at least one instruction or program stored in the memory 130 or in the internal memory configured within the processor 140.

[0075] According to an embodiment, the processor 140 can perform the operation of the electronic device 100 disclosed herein by executing one or more instructions stored in the memory 130.

[0076] According to an embodiment, at least one processor 140 can obtain information corresponding to the output state of the electronic device for displaying content by executing one or more instructions stored in memory 130 during the execution of the game application in response to receiving user input for streaming a screen corresponding to content displayed on the display.

[0077] According to an embodiment, at least one processor 140 can control the sending of data for streaming a screen to a server via a communication interface based on the information obtained by executing one or more instructions stored in memory 130. The screen includes at least one of the content and an object displayed on a display, which is different from the content.

[0078] According to an embodiment, at least one processor 140 may be configured to: control a quick panel that includes broadcast items corresponding to streaming screens when executing a game application by executing one or more instructions stored in memory 130; and receive user input that selects broadcast items included in the quick panel.

[0079] Information corresponding to the output status of the electronic device includes at least one of the following: game mode on / off information corresponding to whether the content is being played, camera on / off information corresponding to whether the user is being filmed, application information corresponding to the topmost layer included in the screen, and preset settings information.

[0080] According to an embodiment, at least one processor 140 may be configured to: by executing one or more instructions stored in memory 130, in response to game mode on / off information being game mode on and camera on / off information corresponding to camera on, send data for streaming a screen to a server, in which the content and an object corresponding to the user's image obtained by the camera are output.

[0081] According to an embodiment, at least one processor 140 may be configured to: by executing one or more instructions stored in memory 130, in response to a game mode on / off message indicating that game mode is on and the application corresponding to the topmost window layer is a game application, send data to a server for streaming a screen in which the content and the object are output together.

[0082] According to an embodiment, at least one processor 140 may be configured to: by executing one or more instructions stored in memory 130, in response to a game mode on / off message indicating that game mode is on and the application corresponding to the topmost window layer is not a game application, send data to a server for streaming a screen in which the content is output without the object.

[0083] According to an embodiment, at least one processor 140 may be configured to: by executing one or more instructions stored in memory 130, in response to game mode on / off information being game mode off and predetermined setting information corresponding to streaming an object including a specified graphic image, send data to a server for streaming a screen including an object containing a specified graphic image.

[0084] The specified graphic image can include advertising images.

[0085] According to an embodiment, at least one processor 140 may be configured to: by executing one or more instructions stored in memory 130, in response to game mode on / off information being game mode on and predetermined settings information corresponding to an object including an advertisement in a streaming, send settings information corresponding to the advertisement and the content to an advertising server, and send content received from the advertising server to the server, wherein an advertisement image is inserted into at least a portion of the content.

[0086] Electronic device 100 can be any form of device including a processor and memory and performing functions. Electronic device 100 can be a fixed or portable device. For example, electronic device 100 can refer to a device equipped with a display and capable of displaying image content, video content, game content, graphic content, etc. Electronic device 100 can output or display images or content received from broadcast server 300. Electronic device 100 can include various types of electronic devices capable of receiving and outputting content, such as: televisions, such as network TV, smart TV, internet TV, web TV, or IPTV; computers, such as desktop computers, laptop computers, or tablet computers; smartphones; cellular phones; game players; music players; video players; medical devices; and various smart devices, such as home appliances. In relation to receiving and displaying content, electronic device 100 can be referred to as a display device, and additionally, it can also be referred to as a content receiving device, receiving end device, electronic device, or computing device.

[0087] Figure 2 The block diagram of the electronic device 100 shown is a block diagram of an embodiment. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the actual implemented electronic device 100. For example, two or more components may be combined into one component, or a component may be subdivided into two or more components, as needed. Furthermore, the functions performed by each block are for describing the embodiment, and the specific operations or devices do not limit the scope of this disclosure.

[0088] although Figure 2Electronic device 100 is shown as including a display, but this disclosure is not limited thereto. For example, electronic device 100 may be a device that provides content to an external display device including a display. The content may include, but is not limited to, images, videos, audio, text, games, applications, etc. For example, electronic device 100 may include a set-top box (STB), Blu-ray disc player, digital multifunction disc (DVD) player, gaming device, digital camera, camcorder, streaming device, home theater, etc. In this case, electronic device 100 may be coupled to the external display device via an input / output unit such as an HDMI port and may be configured to send video / audio signals to the external display device. Alternatively, electronic device 100 may be coupled to the external display device via wired communication, wireless local area network (W-LAN), short-range wireless communication (such as Wi-Fi or Bluetooth), or long-range wireless communication.

[0089] Input device 200 will now be described.

[0090] Input device 200 may include communication unit 210, user input unit 220, memory 230, and processor 240. However, input device 200 may be implemented with more components than those shown, and is not limited to the examples described above.

[0091] Communication unit 210 may include various communication circuits included in one or more modules, enabling wireless communication between input device 200 and a wireless communication system or between input device 200 and a network containing another device. According to an embodiment, communication unit 210 may perform communication with electronic device 100 using short-range communication technologies. Short-range communication technologies may include, for example, Bluetooth communication, Wi-Fi communication, infrared communication, etc. Communication unit 210 may include at least one of, for example, a Bluetooth communication module, a Wi-Fi communication module, and an infrared communication module.

[0092] User input unit 220 can be any form of interface device capable of receiving user input. For example, user input unit 220 may include operation buttons for receiving user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user voice input, etc., which can be arranged on a part of input device 200. For example, when the microphone of input device 200 receives a voice signal corresponding to user input, the voice signal can be converted into a digital signal and transmitted to electronic device 100 via Bluetooth communication, Wi-Fi communication, etc.

[0093] The memory 230 can store programs for processing and control of the processor 240, and can store data input to or output from the input device 200.

[0094] The memory 230 may include at least one type of storage medium selected from flash memory, hard disk, multimedia card micro, card memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disk, and optical disk.

[0095] The processor 240 controls the overall operation of the input device 200 and may include various processing circuits. For example, the processor 240 may perform the functions of the input device 200 described in this disclosure by executing one or more instructions stored in the memory 230.

[0096] In embodiments of this disclosure, the processor 240 may store one or more instructions in an internally configured memory, and control the aforementioned operations to be performed by executing one or more instructions stored in the internally configured memory. That is, the processor 240 may perform a predetermined operation by executing at least one instruction or program stored in the memory 230 or in the internal memory configured within the processor 240.

[0097] According to an embodiment, the processor 240 can establish a communication connection with the electronic device 100 using short-range wireless communication technology by executing one or more instructions stored in the memory 230. Short-range wireless communication technology may include Bluetooth communication technology, Wi-Fi Direct technology, etc.

[0098] According to an embodiment, the processor 240 can control the communication unit 210 to establish a communication connection with the electronic device 100 by executing one or more instructions stored in the memory 230.

[0099] According to an embodiment, the processor 240 can send an input signal to the electronic device 100 corresponding to the user input received through the user input unit 220 by executing one or more instructions stored in the memory 230.

[0100] Input device 200 can be any type of device that includes a processor and memory and performs functions. Input device 200 can include various electronic devices, such as remote controls, game controllers, and smartphones. For example, a remote control application can be installed on a smartphone to control electronic device 100 or perform voice recognition functions.

[0101] at the same time, Figure 2The block diagram of the input device 200 shown is a block diagram of an embodiment. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the actual implemented input device 200. For example, two or more components may be combined into one component, or a component may be subdivided into two or more components as needed. Furthermore, the functions performed by each block are for describing the embodiment, and the specific operations or devices do not limit the scope of this disclosure.

[0102] Broadcast server 300 will now be described.

[0103] Broadcast server 300 may include communication unit 310, memory 320, and processor 330. However, broadcast server 300 may be implemented with more components than those shown, and is not limited to the examples above. For example, broadcast server 300 may include a separate image processor for performing image processing on application images executed in broadcast server 300.

[0104] The communication unit 310 may include various communication circuits included in one or more modules, enabling wireless communication between the broadcast server 300 and a wireless communication system or between the broadcast server 300 and a network containing another device. According to an embodiment, the communication unit 310 may communicate with the electronic device 100 according to Internet protocols.

[0105] The memory 320 can store programs for processing and control of the processor 330, and can store data input to or output from the broadcast server 300.

[0106] The memory 320 may include at least one type of storage medium selected from flash memory, hard disk, multimedia card micro, card memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disk, and optical disk.

[0107] Processor 330 includes various processing circuits for controlling the overall operation of broadcast server 300. For example, processor 330 can perform the functions of broadcast server 300 described in this disclosure by executing one or more instructions stored in memory 320.

[0108] In embodiments of this disclosure, the processor 330 may store one or more instructions in an internally configured memory, and control the aforementioned operations to be performed by executing one or more instructions stored in the internally configured memory. That is, the processor 330 may perform a predetermined operation by executing at least one instruction or program stored in the memory 320 or in the internal memory configured within the processor 330.

[0109] According to an embodiment, the processor 330 can receive a video stream corresponding to a game screen from the electronic device 100 by executing one or more instructions stored in the memory 320, and can send the video stream to one or more subscriber devices to broadcast the received video stream.

[0110] Figure 2 The block diagram of the broadcast server 300 shown is a block diagram of an embodiment. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the actual implemented broadcast server 300. For example, two or more components can be combined into one component, or one component can be subdivided into two or more components as needed. In addition, the functions performed by each block are for describing the embodiment, and the specific operations or devices do not limit the scope of this disclosure.

[0111] Figure 3 This is an example of a block diagram of an electronic device according to an embodiment.

[0112] refer to Figure 3 In addition to the communication unit 110, display 120, memory 130 and processor 140, the electronic device 100 may also include an image processor 150, an audio processor 160, an audio output unit 170, a receiver 180 and a detector 190.

[0113] The communication unit 110 may include various communication circuits included in one or more modules, enabling wireless communication between the electronic device 100 and a wireless communication system or between the electronic device 100 and a network containing another electronic device. For example, the communication unit 110 may include a mobile communication module 111, a wireless internet module 112, and a short-range communication module 113.

[0114] Mobile communication module 111 transmits and receives wireless signals from at least one of a base station, an external terminal, or a server on a mobile communication network. The wireless signals may include various types of data transmitted and received based on voice call signals, video call signals, or text / multimedia messages.

[0115] The wireless internet module 112 refers to a module used for wireless internet access, and can be internal or external to the device. Wireless internet technologies that can be used include Wireless Local Area Network (WLAN) (Wi-Fi), Wibro, Global Microwave Access Interoperability (WiMAX), and High-Speed ​​Downlink Packet Access (HSDPA). Through the wireless internet module 112, the device can establish a Wi-Fi peer-to-peer (P2P) connection with another device. The wireless internet module 112 can also be used to communicate with the broadcast server 300.

[0116] The short-range communication module 113 refers to a module used for short-range communication. Short-range communication technologies that can be used include Bluetooth, Bluetooth Low Energy (BLE), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. The short-range communication module 113 can be used to communicate with the input device 200.

[0117] The display 120 can display the image signal received from the broadcast server 300 on the screen.

[0118] The memory 130 can store programs related to the operation of the electronic device 100, as well as various data generated during the operation of the electronic device 100.

[0119] Memory 130 can store at least one instruction. Additionally, memory 130 can store at least one instruction executed by processor 140. Furthermore, memory 130 can store at least one program executed by processor 140. Additionally, memory 130 can store an application for providing predetermined services.

[0120] Specifically, the memory 130 may include at least one type of storage medium selected from flash memory, hard disk, multimedia card micro, card memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disk, and optical disk.

[0121] Processor 140 controls the overall operation of electronic device 100. For example, processor 140 can perform the functions of electronic device 100 described in this disclosure by executing one or more instructions stored in memory 130.

[0122] Processor 140 may include various processing circuitry and / or multiple processors. For example, the term "processor" as used herein (including the claims) may include various processing circuitry comprising at least one processor. One or more of the at least one processor may be configured to perform the various functions described herein individually and / or jointly in a distributed manner. As used herein, "processor," "at least one processor," and "one or more processors" may be configured to perform various functions. However, these terms cover, for example, but not limited to, situations where one processor performs some functions while other processors perform other portions of the functions, and situations where a single processor can perform all the functions. Additionally, at least one processor may include a combination of processors performing the various functions among the disclosed functions in a distributed manner. At least one processor may execute program instructions to implement or perform various functions.

[0123] In embodiments of this disclosure, the processor 140 may store one or more instructions in an internally configured memory, and control the operation of the display device by executing one or more instructions stored in the internally configured memory. That is, the processor 140 may perform a predetermined operation by executing at least one instruction or program stored in the memory 130 or in the internal memory configured within the processor 140.

[0124] The image processor 150, under the control of the processor 140, processes the image signals received from the receiver 180 or the communication unit 110, and outputs the processed image signals to the display 120. The image processor 150 may include various image processing circuits.

[0125] The audio processor 160, under the control of the processor 140, can convert audio signals received from the receiver 180 or the communication unit 110 into analog audio signals, and output the analog audio signals to the audio output unit 170. The audio processor 160 may include various audio processing circuits.

[0126] The audio output unit 170 can output audio (e.g., voice, sound) input via the communication unit 110 or the receiver 180. Additionally, under the control of the processor 140, the audio output unit 170 can output audio stored in the memory 130. The audio output unit 170 may include at least one or a combination of a speaker, a headphone output terminal, and a Sony / Philips digital interface (S / PDIF) output terminal.

[0127] Receiver 180, under the control of processor 140, can receive video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from outside electronic device 100. Receiver 180 may include one or more combinations of a High Definition Multimedia Interface (HDMI) port 181, a component jack 182, a PC port 183, and a USB port 184. In addition to the HDMI port, receiver 180 may also include a DisplayPort (DP), Thunderbolt, and Mobile High Definition Link (MHL).

[0128] The detector 190 detects the user's voice, the user's image, or the user's interaction, and may include a microphone, a camera unit, and a light receiver.

[0129] The microphone receives voice input from the user. The microphone converts the received voice into an electrical signal and outputs that signal to the processor 140. The user's voice may include, for example, voice corresponding to menus or functions of the electronic device 100.

[0130] The camera can receive images (e.g., consecutive frames) corresponding to user movements, including gestures, within its recognition range. The processor 140 can use the received motion recognition results to select menus displayed on the electronic device 100, or to perform controls corresponding to the motion recognition results.

[0131] The optical receiver receives optical signals (including control signals) from an external control device. The optical receiver can receive optical signals from the control device corresponding to user input (e.g., touch, press, touch gesture, voice, or movement). Under the control of the processor 140, the control signals can be extracted from the received optical signals.

[0132] In embodiments of this disclosure, a game application may refer to an application that provides a user interface for executing and setting one or more game contents and for operating a media player that plays video streams corresponding to the game contents. Reference will be made to... Figures 4 to 6 This describes the operation of displaying game screens by executing game content through a game application.

[0133] Figure 4 This is a reference diagram according to an embodiment for describing the operation of selecting a game application in a user interface through which game applications can be selected.

[0134] refer to Figure 4 The electronic device 100 can provide a user interface 400 through which one or more game applications can be selected.

[0135] The user interface 400 may include, for example, an item 410 capable of executing a first game application, an item 420 capable of executing a second game application, and an item 430 capable of selecting a third game application. The first game application may correspond to a first game server. The electronic device 100 may execute the first game application in response to user input selecting item 410 capable of executing the first game application. The second game application may correspond to a second game server. The electronic device 100 may execute the second game application in response to user input selecting item 420 capable of executing the second game application. The third game application may correspond to a third game server. The electronic device 100 may execute the third game application in response to user input selecting item 430 capable of executing the third game application.

[0136] For example, in response to receiving user input from the user to select an item 410 that can execute the first game application, the electronic device 100 can execute the first game application. Furthermore, the electronic device 100 can provide a user interface 500 based on the execution of the first game application. The user interface 500 may include items for selecting one or more game contents provided by the first game server. For example, in Figure 4 In this context, the user interface 500 may include items for selecting game content from game #1 to game #7 that can be provided by the first game server. Additionally, the user interface 500 may include a search window 520 for searching game content.

[0137] Although the user interface 400 only shows the game application corresponding to the game server, this disclosure is not limited thereto. The user interface 400 may include items for executing game content from the game console.

[0138] Figure 5 This is a reference diagram, according to an embodiment, for describing the operation of selecting game content items in a game application user interface.

[0139] refer to Figure 5 In response to receiving user input that selects game #1 item 510 in the game application user interface 500, the electronic device 100 requests the execution of game content corresponding to game #1 (hereinafter referred to as game #1 content) from the first game server, and can receive and display game screen 550 executed according to game #1 content from the first game server.

[0140] In response to a request to execute game content, electronic device 100 can generate a player capable of replaying the game content and use the player to play video / audio data corresponding to the game content. The player can be referred to as a media player.

[0141] When the requested game content is provided by a game server, electronic device 100 can send an execution request for the specific game content to the game server, and the game server can send metadata corresponding to the requested game content to electronic device 100. This is to enable electronic device 100 to prepare in advance to generate a media player for playing the game content. The metadata corresponding to the game content sent to electronic device 100 may include information such as resolution information, frame rate information, and codec type. Electronic device 100 can receive the metadata corresponding to the game content from the game server and use the information included in the received metadata to generate a player. Next, when a stream corresponding to the game screen corresponding to the requested game content is received from the game server, electronic device 100 can use the generated player to play the received stream. If the requested game content is provided by a game console, electronic device 100 can receive the metadata corresponding to the requested game content from the game console. (See reference...) Figure 6 The description describes using a media player to play back video / audio data corresponding to game content.

[0142] Figure 6 An example of a media player pipeline, as an example of a player according to an embodiment, is shown.

[0143] refer to Figure 6 The media player pipeline 600 according to the embodiment may include a file source 610, a demultiplexer 620, a video decoder 630, an audio decoder 640, a video sink 650, and an audio sink 660.

[0144] File source 610 imports data into the pipeline. The file source can import data from video files flowing from a network stream. Demultiplexer 620 demultiplexes interleaved audio and video packets in the media content stream. Video decoder 630 processes video packet data from the stream. Audio decoder 640 processes audio packet data from the stream. Video receiver 650 displays the video on a monitor based on the decoded video data. Audio receiver 660 plays audio based on the decoded audio data.

[0145] The game application controls the media player pipeline via a media session. This media session controls the data stream through the pipeline and handles tasks such as quality control, responding to audio / video synchronization, and format changes. The game application also receives events from the media player pipeline. Therefore, the game application can identify whether the player is in a playback state by monitoring the media player pipeline. That is, when an operation is performed according to the media player pipeline 600, the game application can determine that the player is in a playback state. For example, when at least one of the video decoder 630 or the audio decoder 640 is operating in the media player pipeline 600, the game application can determine that the player is in a playback state. Figure 6 As shown, when a game application is running and the game application user interface is displayed, and the electronic device is not yet in a state of receiving a stream corresponding to the game content from the game server, the player can be identified as not in a playback state.

[0146] When a media player pipeline is generated and operated in this manner, electronic device 100 can determine that actual game play is in progress. For example, electronic device 100 can determine that the aforementioned state of game play is in progress as game mode enabled. Game mode enabled can also be referred to as game state enabled. On the other hand, when the media player pipeline has not yet been generated, or even if it has been generated but the pipeline has not yet started playing video and audio data, it can be determined that game play is not in progress. That is, this state can be determined as a state where game mode has not yet started.

[0147] Figure 7 This is a flowchart illustrating an example of a method for operating an electronic device according to an embodiment.

[0148] refer to Figure 7 In operation 710, the electronic device 100 can receive user input requesting the streaming of game footage displayed on the monitor while running a game application. For example, as referenced above... Figures 4 to 6 The electronic device 100 can receive user input requesting the streaming of game footage displayed on a monitor when executing a game application. Streaming the game footage can also be referred to as broadcasting the game footage. Executing a game application in this manner can include both of the following: Figure 4 The status of the game application user interface 500 shown is displayed, as well as... Figure 5 The selected game content is shown, and the game screen is displayed at 550.

[0149] According to an embodiment, the electronic device 100 can provide a user interface capable of receiving user input requesting the streaming of game screens, and can receive user input requesting the streaming of game screens according to the aforementioned user interface. (Refer to...) Figure 8Describe an example of a user interface that can receive requests to stream game footage.

[0150] Figure 8 An example of a quick panel according to an embodiment is shown.

[0151] During gameplay, the user can press specific buttons to bring up the system user interface for control by the electronic device 100's system, rather than within the game application. This system user interface may include a quick panel 800.

[0152] Users can bring up the quick panel 800 by performing specific pre-defined input actions during gameplay. These pre-defined input actions can include preset input actions. For example, the quick panel 800 can be displayed by performing a long press of a specific button set on the input device 200 as a pre-defined input action. When the electronic device 100 receives an input signal that corresponds to a long press of a specific button as input data from the input device 200, the electronic device 100 can display, for example... Figure 8 The Quick Panel 800 is shown. The application providing Quick Panel 800 can be a system UI application rather than a game application.

[0153] refer to Figure 8 The quick panel 800 may include, for example, items 810 for managing applications, items 820 for playing music, items 830 for broadcasting game screens, items 840 for changing settings, etc.

[0154] The electronic device 100 can display sub-items of item 830 based on the selection of item 830 for broadcasting game screens. As sub-items of item 830, the following can be displayed: user account information display item 831 for broadcasting game screens, broadcast start item 832 for requesting to start broadcasting, camera on / off item 833, chat on / off item 834, game controller button event display item 835, advertisement display on / off item 836, etc.

[0155] The user account information display item 831 in the broadcast server displays user account information in the broadcast server and allows modification of user accounts. Electronic device 100 can be linked to broadcast server 300 to send and broadcast game footage displayed on the monitor. In this way, the account information of users registered in broadcast server 300 can be used to link electronic device 100 and broadcast server 300. (See reference...) Figure 9 Describe the method of linking electronic device 100 and broadcast server 300.

[0156] The broadcast start item 832 can initiate a broadcast operation based on the selection of item 832.

[0157] The camera on / off item 833 refers to the ability to use a camera to capture an image of the user of electronic device 100 while broadcasting game footage, display the image on a monitor, and broadcast the user image captured using the camera. Depending on the selection of the camera on / off item 833, electronic device 100 can display the user image captured using the camera on at least a portion of the monitor.

[0158] Chat enable / disable item 834 represents an item that enables a user of electronic device 100 to chat with another user while broadcasting game footage. Depending on the selection of chat enable / disable item 834, electronic device 100 can display a chat window on at least a portion of the display for outputting chat messages exchanged between the user of electronic device 100 and the user of another device.

[0159] Gamepad button event display item 835 indicates an item that can display gamepad button events indicating that the user has pressed a button on the gamepad to control the game when broadcasting game screen. Depending on the selection of gamepad button event display item 835, electronic device 100 can display a gamepad image on at least a portion of the display to provide visual identification of which gamepad button the user of electronic device 100 has pressed or selected.

[0160] The advertisement display on / off item 836 represents an item capable of displaying an advertisement on at least a portion of the broadcast screen when a user broadcasts. The advertisement display on / off item 836 may include an advertisement display item 836-1 in non-game mode and an advertisement display item 836-2 in game mode as its sub-items. The advertisement display item 836-1 in non-game mode allows the advertisement to be displayed on the broadcast screen when the user is browsing in the game application user interface (which is not in game mode). The advertisement display item 836-2 in game mode allows the advertisement image to be inserted into at least a portion of the broadcast screen when the game screen is displayed as the broadcast screen in game mode (i.e., when the game screen is displayed on the electronic device 100). In the case of displaying an advertisement in game mode, the advertisement image is superimposed on the game screen, so the advertisement image should not interfere with the game screen. Accordingly, the advertisement area setting item 836-3 may be included as a sub-item of the advertisement display item 836-2 in game mode. The advertisement area setting item 836-3 allows the user to set the position or size of the advertisement image to be displayed on the game screen in game mode.

[0161] Figure 9This is a reference diagram illustrating the operation of linking an electronic device and a broadcast server according to an embodiment.

[0162] refer to Figure 9 The quick panel 800 can provide a user interface 900 that can link electronic devices 100 and broadcast server 300.

[0163] The user interface 900 can display authentication information used to link the electronic device 100 to the broadcast server 300. The authentication information may include at least one of a QR code 910 or a device code 920.

[0164] Users can link electronic devices 100 to broadcast server 300 by scanning QR code 910 or entering device code 920 into the broadcast server application on their devices. That is, when a user device uses the broadcast server application in this way to obtain QR code 910 or device code 920, broadcast server 300 can obtain information about electronic devices 100 that will broadcast game footage, and can set the broadcast channel based on this information by communicating with electronic devices 100. When the link between electronic devices 100 and broadcast server 300 is established in this way, electronic devices 100 can send the game footage displayed on their devices to broadcast server 300, and broadcast server 300 can broadcast the game footage through the user's registered account.

[0165] Return to Figure 7 In operation 710, electronic device 100 can use, for example... Figure 8 The quick panel 800 shown is used to receive user input requesting streaming of game footage. For example, user input requesting streaming of game footage may include input selecting the broadcast start 32 of the quick panel 800.

[0166] In operation 720, electronic device 100 can obtain information corresponding to the output state of electronic device used to display content based on user input requesting the streaming of game screens.

[0167] In response to a user input requesting the broadcast of a game screen, the electronic device 100 can verify information corresponding to the output state of the electronic device. This information may include, for example, information indicating the game environment. The information may include at least one of the following: game mode on / off information indicating whether game content is being played; camera on / off information indicating whether an image of the user is being captured by the electronic device; application information corresponding to the top window layer of the display screen; and preset settings information. The preset settings information may represent default settings.

[0168] Game mode on / off information indicates whether game mode is on or off. Electronic device 100 can be based on, for example... Figure 6 The operation of the media player pipeline 600 shown is used to verify whether game mode is on or off. When the media player pipeline 600 is generated and operating, the electronic device 100 can determine that game mode is on. The electronic device 100 can determine whether game mode is on based on, for example... Figure 6 The operation of the media player pipeline 600 shown is used to verify whether the game mode is on or off.

[0169] Camera on / off information can be based on, for example Figure 8 The camera on / off setting 833 in the quick panel 800 shown is used to determine this.

[0170] The application information corresponding to the topmost window layer may include the ID of the application in the topmost layer of the window stack. The electronic device 100 can verify the ID of the application in the topmost layer of the window stack to verify whether the application in the topmost layer is a game application or a non-game application.

[0171] The pre-set settings information can indicate whether it is set to display advertisements.

[0172] In operation 730, electronic device 100 may send data to a broadcast server based on the obtained information for streaming a frame including at least one of content and an object displayed on a display. For example, electronic device 100 may send data to a broadcast server based on the obtained information for streaming a frame including content. For example, electronic device 100 may send data to a broadcast server based on the obtained information for streaming a frame including an object displayed on a display. For example, electronic device 100 may send data to a broadcast server based on the obtained information for streaming a frame including content and an object displayed on a display.

[0173] Electronic device 100 can display one or more objects simultaneously with the game screen. An object refers to a video or graphic image that can be displayed alongside the game screen, and this object can also be referred to as an auxiliary screen. The term "auxiliary screen" is used in the sense of displaying information that plays a supporting role compared to the game screen primarily displayed on the monitor of electronic device 100, and can be referred to as a sub-screen or additional screen. The auxiliary screen can be displayed overlaid on the main game screen. The auxiliary screen is overlaid on the main display screen and may include a graphics layer. (See reference...) Figure 10 Example of describing a supplementary screen.

[0174] Figure 10 An example of an auxiliary screen according to an embodiment is shown, which is an example of an object that can be displayed together with the game screen.

[0175] refer to Figure 10 The electronic device 100 can display one or more auxiliary screens on the display screen along with the game screen 31.

[0176] The auxiliary screen may include camera screen 32. Camera screen 32 may display a user image obtained by taking an image of the user of electronic device 100 using a camera.

[0177] The auxiliary screen may include chat window screen 33. Chat window screen 33 may display chat messages exchanged between users of electronic device 100.

[0178] The auxiliary screen may include a quick panel screen 34. The quick panel screen 34 can output a user interface that is provided for implementing various settings by the system of the electronic device 100.

[0179] Game screen 31 is based on the game application, and quick panel screen 34 is based on the quick panel application. Therefore, displaying quick panel screen 34 while displaying game screen 31 (based on the game application) indicates that the quick panel application is running. Thus, in this case, the most recently executed application is the quick panel application. Accordingly, the application ID at the top of the window stack 1000 becomes the quick panel application ID. The top of the window stack can be referred to as the top window layer, the active window, or the top window.

[0180] Figure 10 The auxiliary screen shown is an example, and many other types of auxiliary screens are possible. For example, an auxiliary screen could include a gamepad button event screen.

[0181] Electronic device 100 determines which of one or more auxiliary screens displayed on the display along with the game screen should be broadcast and which should not be broadcast, based on the gaming environment. The gaming environment can refer to various settings or conditions that enable the auxiliary screens to be displayed together when the game content is played based on a gaming application. It may include whether the game mode is on or off in electronic device 100, whether the camera is on or off, the application on the top layer of the window stack, and whether advertisements are set, etc.

[0182] The system indicates whether the game mode is on or off. Electronic device 100 can be based on, for example... Figure 6 The operation of the media player pipeline 600 shown is used to verify whether the game mode is on or off. When the media player pipeline 600 is generated and operating, the electronic device 100 can determine that the game mode is on. When the media player pipeline 600 is not generated or is generated but not yet operated, the electronic device 100 can determine that the game mode is off.

[0183] Whether the camera is on or off can be based on, for example Figure 8 The camera on / off setting 833 in the quick panel 800 shown is used to determine this.

[0184] The application at the top of the window stack can include the ID of the application at the top of the window stack. The electronic device 100 can verify the ID of the application at the top of the window stack to verify whether the application at the top is a game application or a non-game application.

[0185] Whether to set ads indicates whether to set ads to be displayed.

[0186] Figure 11 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0187] refer to Figure 11 In operation 111, electronic device 100 can execute a game application. The execution of the game application can be based on a reference... Figures 4 to 5 The example described is used for execution.

[0188] In operation 1120, electronic device 100 can receive user input requesting the broadcast of game screens. For example, electronic device 100 can receive selections such as... Figure 8 The input of items such as the Broadcast Start item 832 set in the Quick Panel 800 shown serves as user input for requesting a broadcast of the game screen.

[0189] In operation 1130, the electronic device 100 can identify whether game mode is enabled as a gaming environment. Whether game mode is enabled can be determined based on whether a player has been generated and is currently operating in response to a request to execute game content within a game application. That is, when a player is generated and performing decoding operations, game mode can be determined to be enabled, and when a player has not been generated or has been generated but has not yet started decoding operations, game mode can be determined to be disabled. For example, as... Figure 5 As shown, even if the game application is running, the state of the user browsing the game application's user interface indicates that the game mode is not enabled, and the state of displaying the game screen 550 according to the execution of the game content indicates that the game mode is enabled.

[0190] If it is determined in operation 1130 that the game mode is not enabled, the operation can be terminated. In this case, no further action is taken because the game screen to be broadcast is not ready.

[0191] If the game mode is determined to be enabled in operation 1130, the process can proceed to operation 1140.

[0192] In operation 1140, electronic device 100 can determine whether the camera is turned on. Whether the camera is turned on can be determined, for example, based on what the user has specified. Figure 8 The settings in the camera on / off item 833 of the quick panel 800 shown determine this. When the camera is on, the electronics 100 indicates that the camera is being used to capture user images and is outputting a camera screen 32 that includes the captured user images.

[0193] If it is determined in operation 1140 that the camera is not turned on, the process can proceed to operation 1150.

[0194] In operation 1150, electronic device 100 can generate a video stream that includes game images corresponding to the game screen.

[0195] If it is determined in operation 1140 that the camera is on, the process can proceed to operation 1160.

[0196] In operation 1160, electronic device 100 can generate a video stream in which game images corresponding to game screen 31 and camera images corresponding to camera screen 32 are mixed. Accordingly, electronic device 100 can broadcast camera screen 32 together with game screen 31 displayed on the display of electronic device 100.

[0197] In operation 1170, electronic device 100 can send a video stream to broadcast server 300.

[0198] Figure 12 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0199] refer to Figure 12 In operation 1210, electronic device 100 can execute a game application. The execution of the game application can be based on a reference... Figures 4 to 5 The example described is used for execution.

[0200] In operation 1220, electronic device 100 can receive user input requesting the broadcast of game screens. For example, electronic device 100 can receive selections such as... Figure 8 The input of items such as the Broadcast Start item 832 set in the Quick Panel 800 shown serves as user input for requesting a broadcast of the game screen.

[0201] In operation 1230, the electronic device 100 can identify whether the game mode is enabled as a gaming environment. Whether the game mode is enabled can be determined based on whether the player is generated and in operation in response to a request to execute game content within the game application. That is, when the player is generated and performing decoding operations, it can be determined that the game mode is enabled, and when the player is not generated or is generated but has not yet started decoding operations, it can be determined that the game mode is not enabled. For example, as... Figure 5 As shown, even if the game application is running, the state of the user browsing the game application's user interface indicates that the game mode is not enabled, and the state of displaying the game screen 550 according to the execution of the game content indicates that the game mode is enabled.

[0202] If it is determined in operation 1230 that the game mode is not enabled, this operation can be terminated. In this case, no further operation is performed because the game screen to be broadcast is not ready.

[0203] If the game mode is determined to be enabled in operation 1230, the process can proceed to operation 1240.

[0204] In operation 1240, electronic device 100 can determine whether the game application is in the topmost window layer. Electronic device 100 can determine whether the application ID in the topmost layer of the window stack is the game application ID. When the game application is not the topmost application, this can indicate the status of another system user application running after the game application is executed. And since it is generally not preferable to output system user applications as broadcasts, this needs to be verified and system user applications should be prevented from being streamed.

[0205] If it is determined in operation 1240 that the application corresponding to the topmost window layer is not a game application, the process can proceed to operation 1270.

[0206] In operation 1270, since the application corresponding to the topmost window layer is not a game application, i.e., another system user application is running, this indicates that a system user interface screen is being output. Accordingly, electronic device 100 can generate a video stream including game images corresponding to the game screen without adding auxiliary screens corresponding to the system user interface screen, i.e., excluding the system user interface screen. Accordingly, electronic device 100 can broadcast only the game screen 31, excluding the fast panel screen 34 displayed on the display of electronic device 100 along with the game screen 31.

[0207] If it is determined in operation 1240 that the application opposite to the topmost window layer is a game application, then the process can proceed to operation 1250.

[0208] In operation 1250, electronic device 100 can determine whether a graphics layer exists. The presence of a graphics layer, especially if the application is a game, indicates the presence of an auxiliary screen such as a chat window or a controller button event screen. This auxiliary screen can be one that is expected to be broadcast. Accordingly, electronic device 100 can determine whether the aforementioned graphics layer exists, and if not, proceed to operation 1270 to generate a video stream including game images.

[0209] If it is determined in operation 1250 that a graphics layer exists, the process can proceed to operation 1260.

[0210] In operation 1260, electronic device 100 can generate a video stream by mixing an auxiliary screen corresponding to the graphics layer and a game image corresponding to the game screen. For example, as Figure 13 As shown, when the screen 1310 displayed on the electronic device 100 includes a game screen 31 and a game controller button event screen 35, the electronic device 100 can generate a video stream by mixing an auxiliary screen image corresponding to the game controller button event screen 35 and a game image corresponding to the game screen 31. Correspondingly, the broadcast screen 1320 displayed on the viewer's device can also include the game screen 31 and the game controller button event screen 35, identical to the screen 1310 displayed on the electronic device 100. Additionally, for example, as... Figure 13 As shown, when the screen 1330 displayed on the electronic device 100 includes a game screen 31 and a chat window screen 33, the electronic device 100 can generate a video stream by mixing the auxiliary screen image corresponding to the chat window screen 33 and the game image corresponding to the game screen 31. Accordingly, the broadcast screen 1340 displayed on the viewer's device can also include the game screen 31 and the chat window screen 33, which are the same as the screen 1330 displayed on the electronic device 100.

[0211] In operation 1280, electronic device 100 may send the video stream generated in operation 1260 or operation 1270 to the broadcast server.

[0212] Figure 14 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0213] In operation 1401, electronic device 100 can run game applications.

[0214] The execution of game applications can be based on references Figures 4 to 5 The example described is used for execution.

[0215] In operation 1402, electronic device 100 can open the quick panel. For example, electronic device 100 can execute the quick panel application in response to receiving user input for executing the quick panel. Furthermore, electronic device 100 can display the quick panel on the display based on the execution of the quick panel application. Figure 14 The portion designated as a quick panel can include operations based on quick panel applications.

[0216] In operation 1403, electronic device 100 can receive user input requesting the broadcast of game screens. For example, electronic device 100 can receive selections such as... Figure 8 The input of items such as the Broadcast Start item 832 set in the Quick Panel 800 shown serves as user input for requesting a broadcast of the game screen.

[0217] In operation 1404, electronic device 100 can identify whether the camera is in the on state. For example, based on the camera on / off settings in quick panel 800, electronic device 100 can identify whether the camera is in the on state. In response to the camera not being in the on state, the process can proceed to operation 1411, and in response to the camera being in the on state, the process can proceed to operation 1412.

[0218] Figure 14 The portion designated as Daemon may include operations based on a daemon application. A daemon application may refer to an application that runs in the background to perform operations of the electronic device disclosed in this disclosure.

[0219] In operation 1411 performed in response to the camera not being turned on, electronic device 100 can generate a video stream including game images corresponding to the game screen.

[0220] In operation 1412 performed in response to the camera being turned on, electronic device 100 can generate a video stream by mixing a game image corresponding to the game screen and a camera image corresponding to the camera screen.

[0221] In operation 1413, electronic device 100 can prepare a video stream.

[0222] In operation 1405, electronic device 100 may receive user input requesting the display of a game controller button event. For example, electronic device 100 may receive selections such as... Figure 8 The input of the gamepad button event display item 835 set in the quick panel 800 shown is used as user input to request the broadcast of game screen.

[0223] In operation 1406, electronic device 100 can terminate the display of the quick panel. That is, electronic device 100 can automatically terminate the display of quick panel 800 based on the user's input of selecting game controller button event display item 835 in quick panel 800.

[0224] In operation 1407, electronic device 100 can display the game controller on a graphics layer according to the selection of the game controller button event display item. The graphics layer displaying the game controller can be overlaid on the video layer representing the game screen to be displayed. Then, the operation can proceed to operation 1414.

[0225] In operation 1414, electronic device 100 may add a graphics layer displaying a game controller to the video stream prepared in operation 1413. If no other events occur, in operation 1416, the video stream with the added graphics layer displaying the game controller is streamed for broadcast. That is, electronic device 100 may stream and send the video stream with the added graphics layer to a third-party broadcast partner acting as an independent operator. The third-party broadcast partner may be an example of broadcast server 300.

[0226] In operation 1408, electronic device 100 can open the quick panel. For example, if a user provides input requesting the quick panel to be executed for some reason, electronic device 100 can execute the quick panel application based on that input and display quick panel 800. Then, the process can proceed to operation 1415.

[0227] In operation 1415, electronic device 100 can stop adding a graphics layer to the video stream. That is, although electronic device 100 performed the operation of adding a graphics layer corresponding to the game controller to the video stream in the previous operation 1414, when the quick panel 800 is displayed on the screen according to user input, the quick panel 800 is not an auxiliary screen that the user intends to display to the viewer. Accordingly, electronic device 100 can stop adding the graphics layer, so that the quick panel image is not added to the video stream being streamed for broadcast. In this case, since the graphics layer includes not only the quick panel but also the game controller, the broadcast of the game controller image can also be stopped. When the quick panel is displayed on the monitor, the user can input user input to control items on the quick panel, and button controls on the game controller are not performed, so even if the game controller image is not included in the video stream to be broadcast, it will not have a significant impact on the viewer. Therefore, when the quick panel is displayed, electronic device 100 can send a video stream without a graphics layer to a third-party broadcasting partner for broadcasting.

[0228] Figure 15 It is a description based on the embodiments. Figure 14 The reference diagram shows an example of an electronic device screen and a broadcast screen displaying the operation.

[0229] refer to Figure 15 In response to the display screen 1510 on the electronic device 100 including a game screen 31 and a fast panel screen 34, the electronic device 100 can recognize that the application in the topmost window layer is a fast panel application rather than a game application. Accordingly, in this case, the electronic device 100 can generate and broadcast only the image corresponding to the game screen 31 as a video stream, without mixing the screen corresponding to the graphics layer (i.e., the fast panel screen 34) with the image corresponding to the game screen 31. Accordingly, in the broadcast screen 1520 displayed on the viewer's device, the fast panel screen 34 is not displayed, and only the game screen 41 can be displayed.

[0230] Subsequently, in response to the user of electronic device 100 selecting a gamepad button event display item in the quick panel screen 34, electronic device 100 can display gamepad button event screen 35 and stop displaying quick panel screen 34. Accordingly, the screen 1530 displayed on electronic device 100 may include game screen 31 and gamepad button event screen 35. In this case, electronic device 100 can recognize that the application in the topmost window layer is a game application. Accordingly, in this case, electronic device 100 can generate and broadcast a video stream by mixing the screen corresponding to the graphics layer (i.e., the image corresponding to gamepad button event screen 35) with the image corresponding to game screen 31. Accordingly, the broadcast screen 1540 displayed on the viewer's device may include game screen 31 and gamepad button event screen 35.

[0231] Subsequently, in response to the user of electronic device 100 providing input again for executing the quick panel, electronic device 100 can display both the game controller button event screen 35 and the quick panel screen 34 on the game screen 31. In this case, electronic device 100 can recognize that the application in the topmost window layer is a quick panel application rather than a game application. Accordingly, in this case, electronic device 100 can generate and broadcast only the image corresponding to the game screen 31 as a video stream, without mixing the screen corresponding to the graphics layer (i.e., the quick panel screen 34 and the game controller button event screen 35) with the image corresponding to the game screen 31. Accordingly, in the broadcast screen 1560 displayed on the viewer's device, the quick panel screen 34 and the game controller button event screen 35 are not displayed, and only the game screen 41 can be displayed.

[0232] Figure 16 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0233] refer to Figure 16 In operation 1610, electronic device 100 can execute a game application. The execution of the game application can be based on a reference... Figures 4 to 5 The example described is used for execution.

[0234] In operation 1620, electronic device 100 can receive user input requesting the broadcast of game screens. For example, electronic device 100 can receive selections such as... Figure 8 The input of items such as the Broadcast Start item 832 set in the Quick Panel 800 shown serves as user input for requesting a broadcast of the game screen.

[0235] In operation 1630, the electronic device 100 can identify whether the game mode is enabled as a gaming environment. Whether the game mode is enabled can be determined based on whether the media player pipeline is generated and operated according to a request to execute game content within the game application. That is, in response to the media player pipeline being generated and performing decoding operations, it can be determined that the game mode is enabled, and in response to the media player pipeline not being generated or, even if generated, not having started decoding operations, it can be determined that the game mode is not enabled. For example, as... Figure 5 As shown, even during the execution of the game application, if the user is browsing on the game application user interface, this indicates that the game mode is not enabled, and if the game screen 550 is displayed according to the execution of the game content, this indicates that the game mode is enabled.

[0236] If the result of operation 1630 is that game mode is enabled, then the process can proceed to operation 1660.

[0237] In operation 1660, electronic device 100 can generate a video stream including game images corresponding to the game screen. The process can then proceed to operation 1670 to send the video stream to a broadcast server.

[0238] If the result of operation 1630 is that the game mode is not enabled, then the process can proceed to operation 1640.

[0239] In operation 1640, the electronic device 100 can identify whether there are settings for displaying advertisements. These advertisement display settings can be executed by the electronic device 100's own settings, or they can be executed according to user settings. For example, the user can select, for instance... Figure 8 The quick panel 800 shows the ad display enable item 836, and in its sub-items, the ad display item 836-1 in non-game mode is selected to set the ad display to be performed.

[0240] If the result of operation 1640 is that no advertisement display is set, the process can proceed to operation 1630 and wait until the game mode is enabled.

[0241] If the result of operation 1640 is that the advertisement display has been set, then the process can proceed to operation 1650.

[0242] In operation 1650, electronic device 100 can obtain advertising images. For example, electronic device 100 can obtain advertising images stored internally by accessing a pre-defined advertising inventory server, requesting an advertising image, and receiving the advertising image from the advertising inventory server according to the request.

[0243] In operation 1670, electronic device 100 can generate a video stream that includes advertising images.

[0244] Then, the process can proceed to operation 1680 to send the video stream to the broadcast server.

[0245] exist Figure 16 The illustrated operation uses an advertising image as an example, but this disclosure is not necessarily limited to this. The advertising image can be replaced with any type of graphic image. For example, a user of electronic device 100 can use any other graphic image that the user wants to display for broadcasting instead of the advertising image.

[0246] according to Figure 16 The operation of the illustrated electronic device 100 allows it to broadcast game footage when the game mode is enabled and the game screen is displayed. Furthermore, when the game screen cannot be broadcast due to the user browsing applications or setting tasks, advertising images are broadcast. Accordingly, this allows users of the electronic device 100 to conveniently receive advertisements during game broadcasting tasks.

[0247] Figure 17 It is a description based on the embodiments. Figure 16 The reference diagram shows an example of the operation displayed on an electronic device and a broadcast screen.

[0248] refer to Figure 17 When the electronic device 100 is operating in game mode with the game screen 1710 displayed, the game screen 1710 is broadcast, and the broadcast screen may include the game screen 1710.

[0249] Subsequently, when the electronic device 100 operates with game mode off (e.g., by exiting the game screen to browse the game application UI), the electronic device 100 can display the game application UI screen 1720. In response to detecting that game mode is off, the electronic device 100 can prepare a video stream by acquiring an advertising image and broadcast the video stream including the advertising image, such that the broadcast screen can include the advertising image 1730. Accordingly, viewers watching the broadcast of the game screen can view the advertising image 1730 instead of the screen of the user of the electronic device 100 browsing the game application UI screen 1720.

[0250] Next, in response to the electronic device 100 starting to operate in game mode with the game screen 1710 displayed, the broadcast screen can switch from the advertising image 1730 to the game screen 1710 by broadcasting the game screen 1710.

[0251] Figure 18 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0252] refer to Figure 18 In operation 1801, electronic device 100 can run game applications.

[0253] The execution of game applications can be based on references Figures 4 to 5 The example described is used for execution.

[0254] In operation 1802, electronic device 100 can open the quick panel. For example, electronic device 100 can execute the quick panel application in response to receiving user input for executing the quick panel. Furthermore, electronic device 100 can display the quick panel on the display based on the execution of the quick panel application. Figure 18 The portion designated as a quick panel can include operations based on quick panel applications.

[0255] In operation 1803, electronic device 100 can receive user input requesting the broadcast of game screens. For example, electronic device 100 can receive selections such as... Figure 8 The input of items such as the Broadcast Start item 832 set in the Quick Panel 800 shown serves as user input for requesting a broadcast of the game screen.

[0256] In operation 1804, electronic device 100 can identify whether the camera is in the on state. For example, based on the camera on / off settings in quick panel 800, electronic device 100 can identify whether the camera is in the on state. In response to the camera not being in the on state, the process can proceed to operation 1811, and in response to the camera being in the on state, the process can proceed to operation 1812.

[0257] Figure 18 The portion designated as a daemon process may include operations based on a daemon application. A daemon application may refer to an application that runs in the background to perform operations of the electronic device disclosed in this disclosure.

[0258] In operation 1811 performed in response to the camera not being turned on, electronic device 100 can generate a video stream including game images corresponding to the game screen.

[0259] In operation 1812 performed in response to the camera being turned on, electronic device 100 can generate a video stream by mixing a game image corresponding to the game screen and a camera image corresponding to the camera screen.

[0260] In operation 1813, electronic device 100 can prepare a video stream. Then, in operation 1816, electronic device 100 can send the prepared video stream to a third-party broadcasting partner.

[0261] In operation 1805, electronic device 100 can terminate the game mode and display the game application UI screen. For example, in response to the user entering the game application UI screen by terminating the game they are playing, the process can proceed to operation 1806.

[0262] In operation 1806, when displaying the game application UI screen, the electronic device 100 can request an advertising image from the advertising inventory 1807, receive the advertising image according to the request, and transmit the received advertising image to the daemon application.

[0263] In operation 1814, in response to receiving the aforementioned advertising image, the electronic device 100 can generate a video stream based on the advertising image. Furthermore, the video stream based on the advertising image can be sent to a broadcast server.

[0264] In operation 1808, in response to the electronic device 100 starting operation according to the game mode displayed on the game screen, the process can proceed to operation 1815.

[0265] In operation 1815, electronic device 100 can generate a video stream including game images corresponding to the game screen, depending on whether the game mode is enabled. Next, in operation 1816, electronic device 100 can send the generated video stream to a broadcast server.

[0266] Figure 19 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0267] refer to Figure 19 In operation 1901, electronic device 100 can execute a game application. The execution of the game application can be based on a reference... Figures 4 to 5 The example described is used for execution.

[0268] In operation 1902, electronic device 100 can receive user input requesting the broadcast of game screens. For example, electronic device 100 can receive selections such as... Figure 8 The input of items such as the Broadcast Start item 832 set in the Quick Panel 800 shown serves as user input for requesting a broadcast of the game screen.

[0269] In operation 1903, the electronic device 100 can identify whether the game mode is enabled as a gaming environment. Whether the game mode is enabled can be determined based on whether the media player pipeline is generated and operated according to a request to execute game content within the game application. That is, in response to the media player pipeline being generated and performing decoding operations, it can be determined that the game mode is enabled, and in response to the media player pipeline not being generated or, even if generated, not having started decoding operations, it can be determined that the game mode is not enabled. For example, as... Figure 5As shown, even during the execution of the game application, if the user is browsing on the game application user interface, this indicates that the game mode is not enabled, and if the game screen 550 is displayed according to the execution of the game content, this indicates that the game mode is enabled.

[0270] If the result of operation 1903 is that game mode is not enabled, the electronic device can wait until game mode is enabled.

[0271] If the result of operation 1903 is that the game mode is enabled, then the process can proceed to operation 1904.

[0272] In operation 1904, the electronic device 100 can identify whether a setting for advertising display exists. This advertising display setting can be executed by the electronic device 100's own settings, or it can be executed according to user settings. For example, the user can select, for instance... Figure 8 In the quick panel 800 shown, the ad display enable item 836 is selected, and in its sub-items, the ad display item 836-2 in game mode is selected to set the ad display to be performed.

[0273] If the result of operation 1904 is that there is no setting for displaying the advertisement, the process can proceed to operation 1905.

[0274] In operation 1905, since there is no separate advertising setting information, electronic device 100 can generate a video stream including game screen, and in operation 1906, the video stream is sent to the broadcast server.

[0275] In operation 1907, electronic device 100 can obtain advertising setting information. The advertising setting information may represent information for adding and sending advertising images (such as banner ads) to at least a portion of the game screen during broadcast game screen display. The advertising setting information may include at least one of broadcaster ID, country information, device information, and ad location information. The advertising setting information may include information used by the advertising server to overlay the advertising image onto the game screen. For example, the advertising server can select the advertising image to be added to the corresponding game screen by using at least one of the broadcaster ID, country information, and device information. Furthermore, the advertising server can determine the position or size of the advertising image to be added to the game screen by using the ad location information.

[0276] In operation 1908, electronic device 100 can send advertising settings information along with a video stream including game images to an advertising server.

[0277] In operation 1911, the advertising server can obtain the advertising image based on the advertising setting information received from the electronic device 100. For example, the advertising server can select the advertising image to be added to the corresponding game screen by using at least one of the broadcaster ID, country information, and device information. Furthermore, the advertising server can determine the position or size of the advertising image to be added to the game screen by using advertising location information.

[0278] In operation 1912, the advertising server can generate a video stream by adding an advertising image to the video stream received from the electronic device 100 at a position specified by the advertising settings information.

[0279] In operation 1913, the ad server can send the generated video stream to the broadcast server.

[0280] Figure 20 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0281] refer to Figure 20 In operation 2001, electronic device 100 can run game applications.

[0282] The execution of game applications can be based on references Figures 4 to 5 The example described is used for execution.

[0283] In operation 2002, electronic device 100 can open the quick panel. For example, electronic device 100 can execute the quick panel application in response to receiving user input for executing the quick panel. Furthermore, electronic device 100 can display the quick panel on the display based on the execution of the quick panel application. Figure 20 The portion designated as a quick panel can include operations based on quick panel applications.

[0284] In operation 2003, electronic device 100 can receive user input requesting the broadcast of game screens. For example, electronic device 100 can receive selections such as... Figure 8 The input of items such as the Broadcast Start item 832 set in the Quick Panel 800 shown serves as user input for requesting a broadcast of the game screen.

[0285] In operation 2004, electronic device 100 can identify whether the camera is in the on state. For example, based on the camera on / off settings in quick panel 800, electronic device 100 can identify whether the camera is in the on state. In response to the camera not being in the on state, the process can proceed to operation 2011, and in response to the camera being in the on state, the process can proceed to operation 2012.

[0286] Figure 20The portion designated as a daemon process may include operations based on a daemon application. A daemon application may refer to an application that runs in the background to perform operations of the electronic device disclosed in this disclosure.

[0287] In response to an operation 2011 performed when the camera is not in an on state, the electronic device 100 can generate a video stream including game images corresponding to the game screen.

[0288] In operation 2012 performed in response to the camera being turned on, electronic device 100 can generate a video stream by mixing a game image corresponding to the game screen and a camera image corresponding to the camera screen.

[0289] In operation 2013, electronic device 100 can prepare a video stream.

[0290] In operation 2005, it is determined whether electronic device 100 has obtained advertising setting information, and in response to obtaining the advertising setting information, the advertising setting information can be provided to the daemon application, and this process can proceed to operation 2014. Here, the advertising setting information can be internally set in electronic device 100, or it can be set based on user input. The advertising setting information may include broadcaster ID, country information, device information, advertising location information, etc.

[0291] In operation 2014, electronic device 100 can send the video stream prepared in operation 2013 and the advertising settings information obtained in operation 2005 to advertising server 2030.

[0292] In operation 2021, the advertising server 2030 can insert advertisements into the video stream based on the video stream and advertising settings information received from the electronic device 100.

[0293] In operation 2022, the ad server can send the video stream containing the ad to the broadcast server 2040.

[0294] If the advertising settings information is not obtained in operation 2005, the process proceeds to operation 2014 as is, and in operation 2014, the video stream prepared in operation 2013 can be provided to the broadcast server 2040.

[0295] Figure 21 An example flowchart of a method for operating an electronic device according to an embodiment is shown.

[0296] refer to Figure 21 In operation 2101, electronic device 100 can execute a game application. The execution of the game application can be based on a reference... Figures 4 to 5 The example described is used for execution.

[0297] In operation 2102, electronic device 100 can receive user input requesting the broadcast of game screens. For example, electronic device 100 can receive selections such as... Figure 8 The input of items such as the Broadcast Start item 832 set in the Quick Panel 800 shown serves as user input for requesting a broadcast of the game screen.

[0298] In operation 2103, the electronic device 100 can identify whether the game mode is enabled as a gaming environment. Whether the game mode is enabled can be determined based on whether the media player pipeline is generated and operated according to a request to execute game content within the game application. That is, in response to the media player pipeline being generated and performing decoding operations, it can be determined that the game mode is enabled, and in response to the media player pipeline not being generated or, even if generated, not having started decoding operations, it can be determined that the game mode is not enabled. For example, such as... Figure 5 As shown, even during the execution of the game application, if the user is browsing on the game application user interface, this indicates that the game mode is not enabled, and if the game screen 550 is displayed according to the execution of the game content, this indicates that the game mode is enabled.

[0299] If the result of operation 2103 is that the game mode is not enabled, the electronic device can wait until the game mode is enabled.

[0300] If the result of operation 2103 is that the game mode is enabled, then the process can proceed to operation 2104.

[0301] In operation 2104, electronic device 100 can identify whether a notification message is being output on the display screen. Electronic device 100 can determine whether a notification message is being output on the game screen by analyzing the image being output on the display screen using methods such as image analysis or object detection.

[0302] If, as a result of operation 2104, it is determined that a notification message exists, the process proceeds to operation 2106; otherwise, it is determined that no notification message exists, the process proceeds to operation 2105.

[0303] In operation 2105, since there is no notification message, electronic device 100 can generate a video stream including game footage, and in operation 2108, electronic device 100 can send the video stream to a broadcast server.

[0304] In operation 2106, the electronic device 100 can identify whether the notification message is of a first type or a second type. The first type may include important notification messages such as disaster messages. The second type may include notification messages related to personal matters. Notification messages may be messages related to personal matters of the user of the electronic device 100, such as messages that only notify the user of the arrival of a text message or email. Alternatively, notification messages may be messages used to notify of important disaster states or emergencies. Messages about personal matters have lower broadcast necessity, but messages about disaster states may have broadcast necessity. Accordingly, the electronic device 100 can prevent the broadcast of personal messages of lower importance and allow the broadcast of disaster notification messages, etc., of higher importance, based on the importance of the notification message. The electronic device 100 can detect objects corresponding to the notification message in images displayed on a screen and identify the content of the notification message from the detected notification message through character recognition such as optical character recognition (OCR).

[0305] If it is determined in operation 2106 that the notification message is of the first type, the process proceeds to operation 2107, and if the notification message is of the second type, the process proceeds to operation 2105 to generate a video stream that includes game footage without a notification message.

[0306] In operation 2107, electronic device 100 can generate a video stream by mixing a sub-screen corresponding to a notification message with a game screen. The process then proceeds to operation 2108 to send the video stream to a broadcast server.

[0307] Figure 22 It is a description based on the embodiments. Figure 21 The image shown is a reference diagram of the screen broadcast for the operation.

[0308] refer to Figure 22 The screen 2210 displayed on the electronic device 100 may include a notification message 36 on the game screen 31 indicating that "email has arrived". In this case, since the notification message that the email has arrived involves personal matters and there is little need to broadcast such personal matters, the electronic device 100 may broadcast a video stream corresponding to the game screen that does not include the notification message 36, so the broadcast screen 2220 displayed on the viewer's device may only include the game screen 21.

[0309] The screen 2230 displayed on the electronic device 100 may include a notification message 37 on the game screen 31 indicating that "an earthquake has occurred in the nearby area". In this case, since the notification message announcing the earthquake involves a public and important matter and it is necessary to broadcast such a public matter, the electronic device 100 can provide the notification message 37 by mixing the notification message 37 with the game screen 31 into the video stream. Therefore, in addition to the game screen 31, the broadcast screen 2240 displayed on the viewer's device may also include the notification message 37.

[0310] The method of operating an electronic device according to an embodiment may include: during the execution of a game application, in response to receiving user input for streaming a screen corresponding to content displayed on a display, obtaining information corresponding to the output state of the electronic device for displaying the content.

[0311] A method for operating an electronic device according to an embodiment may include: sending data for streaming a screen to a server via a communication interface based on obtained information, the screen including at least one of content and an object displayed on a display, the object being different from the content.

[0312] A method of operating an electronic device according to an embodiment may include, when executing a game application, controlling an output including a quick panel of broadcast items corresponding to a streaming screen.

[0313] A method of operating an electronic device according to an embodiment may include receiving user input that selects a broadcast item included in a quick panel.

[0314] Information corresponding to the output status of the electronic device includes at least one of the following: game mode on / off information corresponding to whether the content is being played, camera on / off information corresponding to whether the user is being filmed, application information corresponding to the topmost layer included in the screen, and preset settings information.

[0315] A method of operating an electronic device according to an embodiment may include: in response to a game mode on / off message indicating that the game mode is on and a camera on / off message indicating that the camera is on, sending data for streaming a screen to a server, in which the content and an object corresponding to an image of the user obtained by the camera are output together.

[0316] The method of operating an electronic device according to an embodiment may include: in response to a game mode on / off message indicating that game mode is on and the application corresponding to the topmost window layer is a game application, sending data to a server for streaming a screen in which content and objects are output together.

[0317] The method of operating an electronic device according to an embodiment may include: in response to a game mode on / off message indicating that game mode is on and the application corresponding to the topmost window layer is not a game application, sending data for streaming a screen to a server, in which content is output in a state where an object is not included.

[0318] A method for operating an electronic device according to an embodiment may include: in response to game mode on / off information indicating that game mode is off and predetermined settings information corresponds to streaming an object including a specified graphic image, sending data to a server for streaming a screen including the object containing the specified graphic image. The specified graphic image may include an advertising image.

[0319] A method of operating an electronic device according to an embodiment may include: in response to game mode on / off information indicating that game mode is on and predetermined settings information corresponds to an object including an advertisement in a streaming service, sending settings information and content corresponding to the advertisement to an advertising server; and sending content to the server, the content being received from the advertising server, wherein an advertisement image is inserted into at least a portion of the content.

[0320] Some embodiments may also be implemented in the form of a recording medium comprising computer-executable instructions, such as computer-executable program modules. A computer-readable medium can be any available medium accessible by a computer and includes both volatile and non-volatile media, as well as removable and non-removable media. Additionally, a computer-readable medium may include a computer storage medium. A computer storage medium includes both volatile and non-volatile, removable and non-removable media implemented by any method or technology, for storing information such as computer-readable instructions, data structures, program modules, or other data.

[0321] The disclosed embodiments can be implemented as a S / W program including instructions stored in a computer-readable storage medium.

[0322] A computer is a device capable of recalling stored instructions from a storage medium and operating according to the recalled instructions according to a disclosed embodiment, and may include an electronic device according to a disclosed embodiment.

[0323] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, "non-transitory" means only that the storage medium does not include signals and is tangible, and does not distinguish whether the data is stored in the storage medium semi-permanently or temporarily.

[0324] Furthermore, the control method according to the disclosed embodiments may be included in the computer program product to be provided. The computer program product may be traded as a product between a seller and a buyer.

[0325] Computer program products may include a switch program and a computer-readable storage medium storing the switch program. For example, a computer program product may include a product in the form of a switch program (e.g., a downloadable application) electronically distributed through a device manufacturer or an electronic marketplace (e.g., Google Play Store, App Store). For electronic distribution, at least a portion of the switch program may be stored in the storage medium or may be temporarily generated. In this case, the storage medium may be the storage medium of a manufacturer's server, an electronic marketplace server, or a relay server temporarily storing the switch program.

[0326] In a system that includes servers and devices, the computer program product may include the storage media of the server or the storage media of the device. Alternatively, if a third device (e.g., a smartphone) is communicatively coupled to the server or device, the computer program product may include the storage media of the third device. Alternatively, the computer program product may include the S / W program itself, sent from the server to the device or the third device, or sent from the third device to the device.

[0327] In this configuration, one of the server, device, and third device may execute a computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, device, and third device may execute a computer program product to perform the method according to the disclosed embodiments in a distributed manner.

[0328] For example, a server (e.g., a cloud server or an artificial intelligence server) can execute a computer program product stored on the server to control a device communicatively coupled to the server to perform a method according to the disclosed embodiments.

[0329] As another example, a third device may execute a computer program product to control a device communicatively coupled to the third device to perform the method according to the disclosed embodiments. When the third device executes the computer program product, it may download the computer program product from a server and execute the downloaded computer program product. Alternatively, the third device may perform the method according to the disclosed embodiments by executing a computer program product provided in a preloaded state.

[0330] Furthermore, in this specification, "unit" can be a hardware component such as a processor or circuit and / or a software component executed by a hardware component such as a processor.

[0331] The foregoing description of this disclosure is illustrative, and those skilled in the art will understand that this disclosure can be readily modified into other specific forms without altering its technical spirit or essential characteristics. Therefore, it should be understood that the above embodiments are to be considered merely descriptive and not for limiting purposes. For example, each element described as a single type may be distributed, and similarly, elements described as distributed may be combined.

[0332] The scope of this disclosure is not defined by the detailed description herein, but by the appended claims, and all differences within the scope shall be construed as being included in this disclosure.

Claims

1. An electronic device 100, comprising: Communication interface 110; Memory 130 stores one or more instructions; as well as At least one processor 140 is configured to execute one or more instructions stored in the memory. Wherein, when the one or more instructions are executed individually and / or jointly by the at least one processor 140, the electronic device 100: During the execution of the game application, in response to receiving user input for streaming a screen corresponding to the content displayed on the display, information corresponding to the output state of the electronic device for displaying the content is obtained; as well as Based on the obtained information, the communication interface is controlled to send data for streaming a screen to the server. The screen includes at least one of the content and an object displayed on the display, the object being different from the content.

2. The electronic device according to claim 1, in, The at least one processor 140 is further configured to: execute the one or more instructions. When the game application is executed, a control output quick panel is provided, the quick panel including broadcast items corresponding to the streaming of the screen; and Receive user input to select the broadcast item included in the quick panel.

3. The electronic device according to claim 1 or 2, in, The information corresponding to the output state of the electronic device includes at least one of the following: Information on whether the content is being played is game mode on / off, information on whether the camera is being filmed is camera on / off, application information corresponding to the topmost layer in the image, and preset settings.

4. The electronic device according to claim 3, in, The at least one processor 140 is further configured to: by executing the one or more instructions, in response to the game mode on / off information being game mode on and the camera on / off information corresponding to camera on, send data for streaming a screen to the server, in which the content and an object corresponding to the image of the user obtained by the camera are output together.

5. The electronic device according to any one of claims 3 to 4, in, The at least one processor 140 is further configured to: by executing the one or more instructions, in response to the game mode on / off information being that the game mode is on and the application corresponding to the topmost window layer is the game application, send data to the server for streaming the screen, in which the content and the object are output together.

6. The electronic device according to any one of claims 3 to 5, in, The at least one processor 140 is further configured to: execute the one or more instructions. In response to the game mode on / off information indicating that game mode is enabled and the application corresponding to the topmost window layer is not the game application, data for streaming the screen is sent to the server, and the content is output in the screen when the object is not included.

7. The electronic device according to any one of claims 3 to 6, in, The at least one processor 140 is further configured to: execute the one or more instructions, in response to the game mode on / off information being game mode off and the predetermined setting information corresponding to a streaming object containing a specified graphical image. Data for streaming a screen, which includes an object containing the specified graphic image, is sent to the server.

8. The electronic device according to any one of claims 3 to 7, in, The specified graphic image includes advertising images.

9. The electronic device according to any one of claims 3 to 8, in, The at least one processor 140 is further configured to: execute the one or more instructions. In response to the game mode being enabled / disabled information indicating that game mode is enabled and the predetermined settings information corresponds to an object in the streaming service including an advertisement, the system sends the settings information corresponding to the advertisement and the content to the advertising server. Content is sent to the server, in which an advertising image is inserted into at least a portion of the content, and the content is received from the advertising server.

10. A method for operating an electronic device 100, the method comprising: During the execution of the game application, in response to receiving user input for streaming a screen corresponding to the content displayed on the display, information corresponding to the output state of the electronic device for displaying the content is obtained; as well as Based on the obtained information, data for streaming a screen is sent to the server via a communication interface. The screen includes at least one of the content and an object displayed on the display, the object being different from the content.

11. The method of claim 10, comprising: When the game application is executed, a control output quick panel is provided, which includes broadcast items corresponding to the streaming of the screen. as well as Receive user input to select the broadcast item included in the quick panel.

12. The method according to claim 10 or 11, wherein, The information corresponding to the output state of the electronic device includes at least one of the following: game mode on / off information corresponding to whether the content is being played, camera on / off information corresponding to whether the user is being filmed, application information corresponding to the topmost layer included in the screen, and predetermined setting information.

13. The method of claim 12, comprising: In response to the game mode on / off information indicating that the game mode is on and the camera on / off information corresponding to the camera being on, data for streaming the screen is sent to the server, in which the content and objects corresponding to the image of the user obtained by the camera are output together.

14. The method according to any one of claims 12 to 13, comprising: In response to the game mode on / off information, the application that has the game mode enabled and corresponds to the topmost window layer is the game application, which sends data to the server for streaming the screen, in which the content and the object are output together.

15. A non-transitory computer-readable recording medium storing one or more instructions executable by at least one processor of an electronic device, wherein, When the one or more instructions are executed by the at least one processor of the electronic device, the electronic device causes the electronic device to: During the execution of the game application, in response to receiving user input for streaming a screen corresponding to the content displayed on the display, information corresponding to the output state of the electronic device for displaying the content is obtained; as well as Based on the information obtained, the control sends data for streaming a screen to the server via a communication interface. The screen includes at least one of the content and an object displayed on the display, the object being different from the content.

Images