Electronic device and method of operating the same

Abstract

An electronic device detects whether a notification event indicating information intended to be delivered to another user has occurred in a display screen displaying an image, obtains an indication including a visual effect and / or an auditory effect corresponding to the notification event according to detecting that the notification event has occurred, and provides the indication to the user using an information display area and / or an audio output unit.

Description

Technical Field

[0001] Embodiments of this disclosure relate to a display device capable of reproducing content and a method of operating the display device. More specifically, embodiments of this disclosure relate to an electronic device from which notification events related to content reproduction can be efficiently provided, and a method of operating the electronic device. Background Technology

[0002] With the technological advancements in display devices, display devices capable of providing a wide range of functions have been developed. A representative example of a display device is a television (TV). In this field, a TV simply performs the function of receiving broadcast signals and reproducing broadcast content (e.g., news, drama, entertainment programs, etc.).

[0003] Recently, with the technological advancements in display devices, various applications or programs can be stored and installed on TVs to perform various functions. Beyond simply reproducing broadcast content, these applications can also provide a range of functions and services. For example, game applications can be stored and installed on a TV, and game content can be executed through these applications.

[0004] Furthermore, with the development of communication technologies and connectivity capabilities for display devices, display devices can provide various functions or services via wired or wireless communication with external devices. For example, a display device can connect to external devices such as game consoles or game servers that provide game content via wired or wireless communication, and can receive game content from external devices or game servers via wired or wireless communication.

[0005] Game content can include multiplayer game content, where multiple users can form teams and play games with other teams. Here, multiple users forming a team need to cooperate with each other as part of playing the game; therefore, game content or display devices that reproduce game content can provide various means for cooperative operation by multiple users in the same team. Summary of the Invention

[0006] Solution to the problem

[0007] An electronic device capable of outputting game screens that enhance user satisfaction while providing game content, a method for operating the electronic device, and a non-transitory computer-readable recording medium are provided.

[0008] The technical features intended to be implemented in this disclosure are not limited to those described above, and other unstated technical features will be clearly understood by those skilled in the art in light of the following description.

[0009] According to one aspect of this disclosure, an electronic device includes: a memory storing at least one instruction; and at least one processor. According to one aspect of this disclosure, the at least one processor is configured to detect, by executing the at least one instruction, whether a notification event has occurred on a display screen displaying an image, the notification event indicating information that another user is attempting to provide to a user. According to one aspect of this disclosure, the at least one processor is configured to obtain, based on the detection that a notification event has occurred, an indication including at least one of a visual effect or an auditory effect corresponding to the notification event, by executing the at least one instruction. According to one aspect of this disclosure, the at least one processor is configured to provide an indication to a user by executing the at least one instruction using at least one of an information display area or an audio output unit.

[0010] According to one aspect of this disclosure, a method of operating an electronic device includes: detecting whether a notification event has occurred on a display screen displaying an image, the notification event indicating that another user is attempting to provide information to a user. According to one aspect of this disclosure, the method of operating the electronic device includes: based on detecting that a notification event has occurred, obtaining an indication including at least one of a visual effect or an auditory effect corresponding to the notification event. According to one aspect of this disclosure, the method of operating the electronic device includes providing an indication to a user by using at least one of an information display area or an audio output unit.

[0011] According to one aspect of this disclosure, a non-transitory computer-readable storage medium stores one or more computer-executable instructions for causing a computer to perform an operation method of an electronic device, wherein the one or more computer-executable instructions, when executed by at least one processor of the electronic device, cause the electronic device to: detect whether a notification event has occurred on a display screen displaying an image, the notification event indicating information that another user is attempting to provide to a user; based on the detection that the notification event has occurred, obtain an indication including at least one of a visual effect or an auditory effect corresponding to the notification event; and provide the indication to a user by using at least one of an information display area or an audio output unit.

[0012] The electronic device, the method of operating the electronic device, and the non-transitory computer-readable recording medium according to embodiments of the present disclosure can effectively enhance the user experience of playing game content using the electronic device.

[0013] The effects that can be obtained from the embodiments of this disclosure are not limited to those described above, and other unstated effects will be clearly understood by those skilled in the art in light of the following description. Attached Figure Description

[0014] The present disclosure will now be described more fully with reference to the accompanying drawings, in which reference numerals denote structural elements.

[0015] Figure 1 This is a reference diagram illustrating an example of multiple electronic devices displaying game content provided from a server device according to embodiments of the present disclosure.

[0016] Figure 2 An example of a system according to an embodiment of the present disclosure is shown.

[0017] Figure 3 This is a block diagram of an electronic device according to an embodiment of the present disclosure.

[0018] Figure 4 This is a flowchart of an operation method of an electronic device according to an embodiment of the present disclosure.

[0019] Figure 5 This is a flowchart of an operation method of an electronic device according to an embodiment of the present disclosure.

[0020] Figure 6 An example of a graphical user interface for selecting or entering notification events is shown according to an embodiment of this disclosure.

[0021] Figure 7 Examples of electronic devices outputting screens with various aspect ratios according to embodiments of the present disclosure are shown.

[0022] Figure 8 This is a reference diagram used to illustrate an example of sharing a minimap using a minimap sharing function according to embodiments of the present disclosure.

[0023] Figure 9 An example flowchart of a method for an electronic device to detect whether a notification event has occurred, according to an embodiment of the present disclosure, is shown.

[0024] Figure 10 An example of a display screen of an electronic device according to an embodiment of the present disclosure is shown.

[0025] Figure 11 An example of notification event information according to an embodiment of this disclosure is shown.

[0026] Figure 12 An example of notification event information according to an embodiment of this disclosure is shown.

[0027] Figure 13 An example of a black area displaying a visual effect corresponding to a notification event, according to an embodiment of this disclosure, is shown.

[0028] Figure 14This is a reference diagram illustrating an example of an electronic device according to an embodiment of the present disclosure displaying a visual effect corresponding to a notification event on a display screen of a display device communicatively connected to the electronic device.

[0029] Figure 15 An example flowchart of an operation method of an electronic device according to an embodiment of the present disclosure is shown.

[0030] Figure 16 This is a reference diagram used to describe information about notification events that can be set according to user input, based on embodiments of the present disclosure. Detailed Implementation

[0031] The present disclosure will now be described more fully with reference to the accompanying drawings to enable those skilled in the art to perform embodiments of the disclosure effortlessly. However, the disclosure may be implemented in many different forms and should not be construed as limited to the embodiments set forth herein. Furthermore, in the drawings, portions irrelevant to the description have been omitted for clarity, and throughout the specification, the same components are denoted by the same reference numerals. Additionally, throughout the drawings, the same reference numerals denote the same elements.

[0032] Throughout this specification, it will also be understood that when an element is referred to as being "connected to" another element or "combined" with another element, the element may be directly connected to or directly combined with the other element, or the element may be electrically connected to or electrically combined with the other element by having an intermediate element interposed therebetween. Furthermore, when a component "comprises" or "includes" an element, the component may also include other elements without excluding them, unless there is a specific description to the contrary.

[0033] Throughout the specification, the expressions "in some embodiments" or "in embodiments" are used, but these expressions do not necessarily represent the same embodiments.

[0034] Some embodiments of this disclosure can be described based on functional block configurations and various processing steps. Some or all of the functional blocks can be implemented by any number of hardware and / or software configurations configured to perform a specified function. For example, the functional blocks of this disclosure can be implemented by one or more processors or microprocessors, or by circuit configurations for a predetermined function. Additionally, for example, the functional blocks of this disclosure can be implemented using any programming or various scripting languages. The functional blocks can be implemented in algorithms that execute on one or more processors. Furthermore, this disclosure can employ any number of techniques based on related techniques for electronic configuration, signal processing, and / or data processing, etc. The terms "module," "configuration," etc., can be used broadly and are not limited to mechanical or physical embodiments.

[0035] Furthermore, the connecting lines or connectors between the components shown in the accompanying drawings are intended to represent exemplary functional connections and / or physical or circuit connections between the components. It should be noted that many alternative or additional functional connections, physical connections, or circuit connections may exist in actual devices.

[0036] Throughout this disclosure, the expression "at least one of a, b, or c" indicates only a, only b, only c, both a and b, both a and c, both b and c, all of a, b, and c, or variations thereof.

[0037] In embodiments of this disclosure, the electronic device may indicate all electronic devices capable of receiving content from the source device and displaying it on a corresponding screen. As used herein, the content may include game content, lecture content, movie content, home training service content, etc.

[0038] For example, according to embodiments of this disclosure, an electronic device can refer to all electronic devices capable of selectively displaying at least one type of content, and can be implemented in various forms, including televisions (TVs), smart TVs, digital broadcasting terminals, tablet computers, personal computers (PCs), smartphones, mobile phones, computers, laptops, etc. Furthermore, the electronic device can be fixed, or it can be mobile or portable to the user.

[0039] Figure 1 This is a reference diagram illustrating an example of multiple electronic devices displaying game content provided from a server device according to embodiments of the present disclosure.

[0040] refer to Figure 1 The server device 300 can execute a content application according to a request from the electronic device 100, and can send the result screen of the execution of the content application to the electronic device 100 via a communication network. For example, when the server device 300 receives a request from the electronic device 100 to execute a game application, the server device 300 can execute the game application, and can send the result screen or result image presented according to the execution of the game application to the electronic device 100 via a communication network.

[0041] Furthermore, when the game content involves multiple users forming a team to play a game, the server device 300 can execute the content application according to requests from multiple electronic devices, and can send the execution result screen based on the execution of the content application to the multiple electronic devices via a communication network. For example, when the server device 300 receives a request to execute a game application from electronic devices 100 and 800, the server device 300 can execute the game application, and can send the execution result screen or result image presented based on the execution of the game application to electronic devices 100 and 800 via a communication network.

[0042] Electronic device 100 can send a request to server device 300 to execute a content application, receive an execution result screen from server device 300 based on the execution request, and display the received execution result screen on a monitor. A user of electronic device 100 can manipulate input device 10 to control the execution screen displayed on the monitor of electronic device 100. Based on the user's manipulation, input device 10 can send control signals to electronic device 100, and electronic device 100 can send control signals received from input device 10 to server device 300. Server device 300 can execute the content application based on the control signals received from electronic device 100 and can send the execution result screen to electronic device 100. Furthermore, server device 300 can send the execution result screen to electronic device 800 running the same content application.

[0043] Electronic device 800 can send a request to server device 300 to execute a content application, and can receive an execution result screen from server device 300 based on the execution request, and can display the received execution result screen on a monitor. A user of electronic device 800 can manipulate input device 20 to control the execution screen displayed on the monitor of electronic device 800. Based on the user's manipulation, input device 20 can send control signals to electronic device 800, and electronic device 800 can send the control signals received from input device 20 to server device 300. Server device 300 can execute the content application based on the control signals received from electronic device 800, and can send the execution result screen to electronic device 100 and electronic device 800. Furthermore, server device 300 can send the execution result screen to electronic device 100 running the same content application.

[0044] In this way, when electronic devices 100 and 800 are playing the same game content collaboratively, users of electronic devices 100 and 800 can chat with each other to perform collaborative actions or provide notifications to each other. To provide notifications between multiple users playing the game content, the game content can provide means such as a minimap, notification events including ping, etc.

[0045] A minimap is a small map typically placed in the corner of the screen in video games to help players navigate the game world. In other words, the minimap shows the area where the game is played, like a map. Figure 1A minimap is a window that shrinks in size. The elements included in a minimap typically vary depending on the video game genre. A minimap can usually include the location of player characters (including allies and enemies), allied units or buildings, objectives, and surrounding terrain. Additionally, a minimap can provide visual alerts to notify players of various game situations. System-defined warnings (attack notifications, etc.) can be displayed on the minimap, and it can also include the ability for players to directly warn allies. This ability for players to directly warn allies can be referred to as a notification event such as a ping. When there is no time to type chat in an emergency, ping can be used to notify allies via keyboard shortcuts or mouse clicks. A ping can also be described as a notification event where a player transmits information to another player in the game environment.

[0046] exist Figure 1 In the example, electronic devices 100 and 800 can each display a minimap 50 on each display. For instance, when a user of electronic device 800 inputs an item for a notification event to provide a notification to the user of electronic device 100, which is an ally, the input for the notification event by electronic device 800 can be displayed as a notification event 60 in each minimap 50 of electronic devices 100 and 800. By using this method, a user of electronic device 100 can receive notifications provided from electronic device 800, which is an ally.

[0047] The notification event 60 displayed in the minimap 50 can provide a useful means of notification between game users.

[0048] However, even a regular minimap is a small-sized micromap, and the notification events displayed within the minimap are also small. Therefore, in urgent situations where a user is playing a game, it may be difficult for the user to immediately recognize the notification. Therefore, embodiments of this disclosure provide examples of how users can more effectively recognize notification events 60 displayed in the minimap 50.

[0049] According to embodiments of this disclosure, electronic device 100 can be configured to detect the occurrence of a notification event in game content displayed on a monitor, indicating that another player is attempting to convey a message. According to embodiments of this disclosure, electronic device 100 can detect notification events from a minimap. According to embodiments of this disclosure, electronic device 100 can detect the minimap from an area specified based on user input, or it can detect the minimap automatically.

[0050] According to embodiments of this disclosure, electronic device 100 can be configured to identify attributes of detected notification events based on the occurrence of the notification event. According to embodiments of this disclosure, electronic device 100 can store attributes of one or more notification events and can identify the attributes of the detected notification event from the stored attributes. According to embodiments of this disclosure, electronic device 100 can store one or more notification events. The one or more notification events may include notification events set as default by electronic device 100 and notification events specified by the user.

[0051] According to embodiments of this disclosure, electronic device 100 may be configured to receive an indication including at least one of a visual effect or an auditory effect corresponding to an attribute of a notification event recognized by electronic device 100. For example, the visual effect may include various visual effects, including color, flashing, text, etc.

[0052] According to embodiments of this disclosure, electronic device 100 can be configured to provide instructions by using at least one of an information display area or an audio output unit. According to embodiments of this disclosure, electronic device 100 can use a black area on the display screen where no game content is displayed as the information display area. According to embodiments of this disclosure, when displaying a mini-map on an external display device, electronic device 100 can use at least a portion of the display screen of the external display device as the information display area.

[0053] Figure 2 An example of a system according to an embodiment of the present disclosure is shown.

[0054] refer to Figure 2 The system may include an electronic device 100 for displaying content, a display device 200 for sharing at least a portion of the content displayed in the electronic device 100, a server device 300, and an input device 10 for controlling the electronic device 100.

[0055] Electronic device 100 can output or display content received from server device 300. Electronic device 100 can include various forms of electronic devices, including network TV, smart TV, internet TV, web TV, Internet Protocol TV (IPTV), PC, etc., which can receive and output content. Electronic device 100 can be called a display device because it receives and displays content, and can also be called a content receiving device, sink device, computing device, etc.

[0056] Electronic device 100 can be connected to display device 200 via a wired or wireless communication network.

[0057] Electronic device 100 and display device 200 can be connected via wired connection devices for forming a wired network to perform content transmission and reception. For example, the wired connection devices may include cables, and each of electronic device 100 and display device 200 may include one or more ports for cable connection. For example, the one or more ports may include digital input interfaces, including High Definition Multimedia Interface (HDMI) ports, DisplayPorts, Type-C ports, etc.

[0058] Electronic device 100 and display device 200 can be connected via a wireless connectivity device for forming a wireless network to perform content transmission and reception. For example, the wireless connectivity device may include a wireless HDMI communication module, and each of electronic device 100 and display device 200 may include a wireless HDMI communication module. As another example, the wireless connectivity device may include at least one communication module for performing communication according to communication standards including Bluetooth, Wi-Fi, Bluetooth Low Energy (BLE), Near Field Communication (NFC) / Radio Frequency Identification (RFID), Wi-Fi Direct (WFD), Ultra Wideband (UWB), ZigBee, the Internet, 3G, 4G, 5G, and / or 6G, etc.

[0059] Electronic device 100 is a device capable of displaying images or data according to a user's request, and may include a communication interface 110, a display 120, a memory 130, and a processor 140.

[0060] The communication interface 110 can perform communication with at least one external device. Here, "communication" can mean sending and / or receiving data, signals, requests and / or commands.

[0061] The communication interface 110 can perform wired or wireless communication with at least one external device. The at least one external device may be a display device 200, a server device 300, an input device 10, etc.

[0062] The communication interface 110 may include at least one of a communication module, communication circuit, communication device, input / output port, or input / output plug for performing wired or wireless communication with at least one external device.

[0063] For example, communication interface 110 may include at least one wireless communication module, wireless communication circuit, or wireless communication device for performing wireless communication with at least one external device.

[0064] For example, communication interface 110 may include a short-range communication module (e.g., an infrared (IR) communication module) capable of receiving control commands from a remote control, such as an input device 10 located nearby. In this respect, communication interface 110 can receive control signals from a remote control.

[0065] As another example, communication interface 110 may include at least one communication module for performing communication according to communication standards including Bluetooth, Wi-Fi, BLE, NFC / RFID, WFD, UWB, ZigBee, etc. Optionally, communication interface 110 may also include a communication module for performing communication with a server supporting long-distance communication according to long-distance communication standards. For example, communication interface 110 may include a communication module for performing communication via a network for Internet communication. Furthermore, communication interface 110 may include a communication module for performing communication via a communication network conforming to communication standards including 3G, 4G, 5G, and / or 6G.

[0066] As another example, communication interface 110 may include at least one port for connecting to an external device via a wired cable to communicate with the external device in a wired manner. For example, communication interface 110 may include at least one of an HDMI port, a component jack, a PC port, or a Universal Serial Bus (USB) port. Therefore, communication interface 110 can perform communication with an external device wiredly connected via at least one port. Here, "port" may indicate a physical device configuration such as a cable, communication line, plug, etc., that can be connected or inserted.

[0067] As described above, the communication interface 110 may include at least one supporting element for supporting communication between the electronic device 100 and external devices. Here, the supporting element may include a communication module, communication circuit, communication device, port (for data input / output), cable port (for data input / output), plug (for data input / output), etc. For example, at least one supporting element included in the communication interface 110 may include an Ethernet communication module, a Wi-Fi communication module, a Bluetooth communication module, an IR communication module, a USB port, a tuner (or broadcast receiver), an HDMI port, a DisplayPort (DP), a Digital Video Interface (DVI) port, etc.

[0068] The display 120 can output images to the screen under the control of the processor 140. For example, the processor 140 can control the display 120 to output a desired image to the display 120.

[0069] Display 120 outputs images to a screen. For example, display 120 may output images corresponding to video data via an internally included display panel to allow a user to visually recognize the video data. Specifically, the video data forming the content may include multiple frame images, and display 120 may reproduce the video content by sequentially displaying multiple frame images under the control of processor 140. For example, display 120 may output content images corresponding to the video data to a screen under the control of processor 140.

[0070] As shown in the figure, the display 120 is disposed in the electronic device 100, but this disclosure is not limited thereto. The display 120 may be disposed outside the electronic device 100 and may be connected to the electronic device 100 via wired / wireless communication.

[0071] Memory 130 may store at least one instruction, data, information, and / or application. For example, memory 130 may store at least one instruction executable by processor 140. For example, memory 130 may store at least one program executable by processor 140. For example, memory 130 may store an application for providing a specified service.

[0072] The memory 130 may include at least one type of storage medium selected from flash memory, hard disk, micro multimedia card, memory card (e.g., Secure Digital (SD) or Extreme Digital (XD) memory card), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disk, and optical disk.

[0073] The processor 140 can execute at least one instruction to control the desired operation to be performed. Here, the at least one instruction may be stored in the internal memory included in the processor 140, or may be stored separately from the processor 140 in the memory 130 included in the electronic device 100.

[0074] Processor 140 can execute at least one instruction to control one or more configurations included in electronic device 100 to perform a desired operation. Therefore, when describing an example of processor 140 performing a specified operation, the example may instruct processor 140 to control one or more configurations included in electronic device 100 to perform the specified operation.

[0075] Furthermore, although an example of processor 140 being formed as a processor is described and shown, processor 140 may be implemented in the form of including multiple processors.

[0076] For example, processor 140 may include RAM for storing signals or data input from external sources to electronic device 100 or as storage areas corresponding to various tasks performed in electronic device 100, control programs for controlling electronic device 100, applications and / or multiple instructions for providing specified functions or services, and at least one processor. Processor 140 may include a graphics processing unit (GPU) for processing graphics corresponding to video. Processor 140 may be implemented as a system-on-a-chip (SoC) integrating cores and a GPU. Furthermore, processor 140 may include multiple cores on a single core. For example, processor 140 may include dual-core, triple-core, quad-core, hexa-core, octa-core, deca-core, dodecathlon, hexadecimal, etc.

[0077] Processor 140 may include various processing circuitry and / or multiple processors. For example, the term "processor" as used herein, including the claims, may include various processing circuitry comprising at least one processor. One or more of the at least one processor may be configured to perform the various functions described herein individually or collectively in a distributed manner. As used herein, "processor," "at least one processor," and "one or more processors" may be configured to perform various functions. However, the terms cover situations where one processor performs some functions while other processors perform other functions, and situations where one processor can perform all functions. Furthermore, at least one processor may include a combination of processors configured to perform the various disclosed functions in a distributed manner. At least one processor may execute program instructions to implement or perform the various functions.

[0078] According to embodiments of this disclosure, processor 140 may store one or more instructions in its internal memory and may execute one or more instructions stored in its internal memory to control the operation of electronic device 100. That is, processor 140 may execute at least one instruction or program stored in processor 140's internal memory or stored in memory 130 to perform a specified operation.

[0079] According to embodiments of this disclosure, processor 140 can execute one or more instructions stored in memory 130 to control communication interface 110 to send a request to server device 300 to execute content application, and receive an execution result screen obtained by executing content application from server device 300.

[0080] According to embodiments of this disclosure, processor 140 may execute one or more instructions stored in memory 130 to control display 120 to display a screen showing the execution results of a content application received from server device 300.

[0081] According to embodiments of this disclosure, processor 140 may execute one or more instructions stored in memory 130 to detect whether a notification event has occurred on a display screen displaying an image, indicating that another user is attempting to send information.

[0082] According to embodiments of this disclosure, when a notification event has been detected, the processor 140 may execute one or more instructions stored in the memory 130 to obtain an indication including at least one of a visual effect or an auditory effect corresponding to the detected notification event.

[0083] According to embodiments of this disclosure, processor 140 may execute one or more instructions stored in memory 130 to identify a predefined region from an image displayed on a display.

[0084] According to embodiments of this disclosure, processor 140 may execute one or more instructions stored in memory 130 to identify notification events from identified predefined regions.

[0085] According to embodiments of the present disclosure, processor 140 may execute one or more instructions stored in memory 130 to identify a predefined region using setting information based on user input that sets a predefined region, or to automatically detect a predefined region from an image.

[0086] According to embodiments of this disclosure, processor 140 may execute one or more instructions stored in memory 130 to detect a notification event by detecting an item image corresponding to the notification event from a predefined area using one or more notification event information.

[0087] According to embodiments of this disclosure, one or more notification event information may include identification information for each notification event, an item image corresponding to each notification event, and visual or auditory effects corresponding to each notification event.

[0088] According to embodiments of the present disclosure, processor 140 may execute one or more instructions stored in memory 130 to obtain an indication corresponding to an identified notification event by referring to a registration indication corresponding to one or more notification event messages and identification information about each notification event.

[0089] According to embodiments of the present disclosure, processor 140 may execute one or more instructions stored in memory 130 to provide a visual effect by using a predetermined area of ​​an undisplayed image on a display screen.

[0090] According to embodiments of the present disclosure, the information display area may include a predetermined area in the display of an external display device to share and display at least a portion of the display screen displayed on the electronic device, and according to embodiments of the present disclosure, the processor 140 may execute one or more instructions stored in the memory 130 to provide visual effects using the predetermined area in the display of the external display device.

[0091] According to embodiments of this disclosure, at least a portion of the shared screen may include a mini-map area, and a predetermined area in the display of an external display device may include an area other than the area displaying the mini-map area.

[0092] According to embodiments of this disclosure, processor 140 may execute one or more instructions stored in memory 130 to identify the location in the game content where a notification event occurs, and determine the location where an instruction should be provided based on the location where the notification event occurs.

[0093] Electronic device 100 can be any device including a processor and memory and configured to perform functions. Electronic device 100 can be a fixed device or a portable device. For example, electronic device 100 can refer to a device including a display and configured to display image content, video content, game content, graphic content, etc. Electronic device 100 can output or display images or content received from server device 300. Electronic device 100 can include any type of electronic device, such as a TV (e.g., network TV, smart TV, internet TV, web TV, or IP TV), a computer (e.g., desktop computer, laptop computer, or tablet computer), or a smart device (e.g., smartphone, cellular phone, game console, music player, video player, medical device, or home appliance). Electronic device 100 can be referred to as a display device because it can receive and display content, and can also be referred to as a content receiver, receiving device, computing device, etc.

[0094] Figure 2 The block diagram of the electronic device 100 shown is a block diagram of an embodiment of this disclosure. Each element of the block diagram can be combined, added, or omitted according to the actual specifications of the electronic device 100. For example, two or more elements can be combined into one element when needed, or one element can be divided into two or more elements. Furthermore, the functions performed by each block can be used to describe embodiments of this disclosure, and their specific operation or device does not limit the scope of this disclosure.

[0095] Display device 200 will now be described.

[0096] Display device 200 can output or display content received from electronic device 100. Display device 200 can be connected to electronic device 100 using wired / wireless communication technology and can receive and display at least a portion of the content displayed on electronic device 100. For example, display device 200 can receive and display a minimap from electronic device 100 as at least a portion of the results screen of the content displayed on the display of electronic device 100.

[0097] Display device 200 is a device capable of displaying images or data according to user requests, and may include communication interface 210, display 220, memory 230 and processor 240.

[0098] The communication interface 210 may include one or more modules configured to enable wired / wireless communication between the electronic device 100 and the display device 200.

[0099] According to embodiments of this disclosure, the communication interface 210 can receive content to be shared from the electronic device 100 by communicating with the electronic device 100 using wired or wireless communication technologies. Wireless communication technologies may include short-range communication technologies, such as Bluetooth, Wi-Fi, and infrared (IR) communication.

[0100] The display 220 can output images or data processed by the electronic device 100. According to embodiments of this disclosure, the display 220 can receive a mini-map area from the electronic device 100 and can display the mini-map area.

[0101] The memory 230 can store programs for processing and control by the processor 240, and can also store data input to or output from the display device 200. Furthermore, the memory 230 can store multiple pieces of data required for the operation of the display device 200.

[0102] The memory 230 may include at least one type of storage medium selected from flash memory, hard disk, micro multimedia card, memory card (e.g., SD or XD memory card), RAM, SRAM, ROM, EEPROM, PROM, magnetic storage, magnetic disk and optical disk.

[0103] Processor 240 controls all operations of display device 200. For example, processor 240 can execute one or more instructions stored in memory 230 to perform the functions of display device 200 described in this disclosure.

[0104] According to embodiments of this disclosure, processor 240 may store one or more instructions in its internal memory and may execute one or more instructions stored in its internal memory to control the operation of display device 200 to be performed. That is, processor 240 may execute at least one instruction or program stored in processor 240's internal memory or stored in memory 230 to perform a specified operation.

[0105] According to embodiments of the present disclosure, processor 240 may execute one or more instructions stored in memory 230 to perform communication with electronic device 100 via wireless and / or wired communication connection.

[0106] According to embodiments of this disclosure, processor 240 can execute one or more instructions stored in memory 230 to receive at least a portion of a content screen displayed on the display of electronic device 100 and to display the received content screen. For example, the at least portion of the content screen received from electronic device 100 may include a mini-map area displayed in game content.

[0107] According to embodiments of this disclosure, processor 240 may execute one or more instructions stored in memory 230 to provide at least one of a visual or auditory effect corresponding to a notification event on at least a portion of the screen, based on a signal received from electronic device 100, while displaying a minimap area received from display device 200. The at least portion of the screen to which the visual effect corresponding to the notification event is provided may include a black area where the minimap area is not displayed.

[0108] Display device 200 can be any device that includes a processor and memory and is configured to perform functions. Display device 200 can be a fixed device or a portable device. For example, display device 200 can refer to a device that includes a display and is configured to display image content, video content, game content, graphic content, etc. Display device 200 can include any type of electronic device capable of receiving output content, such as a TV (e.g., network TV, smart TV, internet TV, web TV, or IP TV), a computer (e.g., a desktop computer, laptop computer, or tablet computer), or a smart device (e.g., a smartphone, cellular phone, game console, music player, video player, medical device, or home appliance). Display device 200 can be referred to as a display device because it can receive and display content, and can also be referred to as a content receiver, receiving device, electronic device, computing device, etc.

[0109] Figure 2The block diagram of the display device 200 shown is a block diagram of an embodiment of the present invention. Each element of the block diagram can be combined, added, or omitted according to the actual specifications of the display device 200. For example, two or more elements can be combined into one element when needed, or one element can be divided into two or more elements. Furthermore, the functions performed by each block can be used to describe embodiments of the present disclosure, and their specific operation or device does not limit the scope of the present disclosure.

[0110] Server device 300 will now be described.

[0111] Server device 300 can provide content such as video and audio to electronic device 100. Server device 300 may include various types of electronic devices capable of providing content to electronic device 100. Server device 300 may be referred to as a source device because it can provide content, and may also be referred to as a host device, content provider, electronic device, storage device, computing device, server computer, etc.

[0112] Server device 300 may include a communication interface 310, a memory 320, and a processor 330. However, server device 300 may be implemented with more components than those shown, and is not limited thereto. For example, server device 300 may include a separate image processor for performing image processing on images of applications running in server device 300.

[0113] Communication interface 310 may include one or more modules configured to enable wireless communication between server device 300 and electronic device 100. According to embodiments of this disclosure, communication interface 310 may perform communication with electronic device 100 according to Internet Protocol. According to embodiments of this disclosure, communication interface 310 may perform communication with input device 10 according to an internal protocol.

[0114] The memory 320 can store programs for processing and control by the processor 330, and can store data input to or output from the server device 300.

[0115] The memory 320 may include at least one type of storage medium selected from flash memory, hard disk, micro multimedia card, memory card (e.g., SD or XD memory card), RAM, SRAM, ROM, EEPROM, PROM, magnetic storage, magnetic disk and optical disk.

[0116] Processor 330 controls all operations of server device 300. For example, processor 330 can execute one or more instructions stored in memory 320 to perform the functions of server device 300 described in this disclosure.

[0117] According to embodiments of this disclosure, processor 330 may store one or more instructions in its internal memory and may execute one or more instructions stored in its internal memory to control the aforementioned operations to be performed. That is, processor 330 may execute at least one instruction or program stored in processor 330's internal memory or stored in memory 320 to perform a specified operation.

[0118] According to embodiments of this disclosure, processor 330 may execute one or more instructions stored in memory 320 to receive a request from electronic device 100 to execute a content application and send the execution result screen of the executed content application to electronic device 100.

[0119] Figure 2 The block diagram of the server device 300 shown is a block diagram of an embodiment of this disclosure. Each element of the block diagram can be combined, added, or omitted according to the actual specifications of the server device 300. For example, two or more elements can be combined into one element when needed, or one element can be divided into two or more elements. Furthermore, the functions performed by each block can be used to describe embodiments of this disclosure, and their specific operation or device does not limit the scope of this disclosure.

[0120] Input device 10 will now be described. Input device 10 may include a communication interface 11, a user input unit 12, a memory 13, and a processor 14. However, input device 10 may be implemented with more components than those shown, and is not limited thereto.

[0121] The communication interface 11 may include one or more modules configured to enable wired / wireless communication between the input device 10 and the electronic device 100. According to embodiments of this disclosure, the communication interface 11 may perform communication with the electronic device 100 using short-range communication technologies. Short-range communication technologies may include, for example, Bluetooth communication, Wi-Fi communication, IR communication, etc. According to embodiments of this disclosure, the communication interface 11 may perform communication with the server device 300 using the Internet Protocol (IP).

[0122] User input unit 12 can be any interface device capable of receiving user input. For example, user input unit 12 may include manipulation buttons for receiving user input by means of being arranged in a part of input device 10, a touch-sensitive display configured to detect touch input, a microphone for receiving user voice input, etc.

[0123] According to embodiments of this disclosure, the user input unit 12 can receive user input for controlling a screen displaying the execution results of game content on the display of the electronic device 100, based on the control of the processor 14.

[0124] The memory 13 can store programs for processing and control by the processor 14, and can also store data input to or output from the input device 10.

[0125] The memory 13 may include at least one type of storage medium selected from flash memory, hard disk, micro multimedia card, memory card (e.g., SD or XD memory card), RAM, SRAM, ROM, EEPROM, PROM, magnetic storage, magnetic disk and optical disk.

[0126] Processor 14 controls all operations of input device 10. For example, processor 14 may execute one or more instructions stored in memory 13 to perform the functions of input device 10 described in this disclosure.

[0127] According to embodiments of this disclosure, processor 14 may store one or more instructions in its internal memory and may execute one or more instructions stored in its internal memory to control the aforementioned operations to be performed. That is, processor 14 may execute at least one instruction or program stored in processor 14's internal memory or stored in memory 13 to perform a specified operation.

[0128] According to embodiments of this disclosure, processor 14 can execute one or more instructions stored in memory 13 to establish a communication connection with electronic device 100 using short-range wireless communication technology. Short-range wireless communication technology may include Bluetooth communication technology, WFD technology, IR communication technology, etc.

[0129] According to embodiments of the present disclosure, processor 14 may execute one or more instructions stored in memory 13 to control communication interface 11 to send control signals to electronic device 100, the control signals corresponding to user input received via user input unit 12.

[0130] Input device 10 can be any device that includes a processor and memory and is configured to perform functions. Input device 10 can include various electronic devices, such as remote controls, game controllers, smartphones, etc.

[0131] Figure 2 The block diagram of the input device 10 shown is a block diagram of an embodiment of this disclosure. Each element of the block diagram can be combined, added, or omitted according to the actual specifications of the input device 10. For example, two or more elements can be combined into one element when needed, or one element can be divided into two or more elements. Furthermore, the functions performed by each block can be used to describe embodiments of this disclosure, and their specific operation or device does not limit the scope of this disclosure.

[0132] Figure 3This is a block diagram of an electronic device according to an embodiment of the present disclosure.

[0133] refer to Figure 3 The electronic device 100 may include an image processor 150, an audio processor 160, an audio output unit 170, a receiver 180 and a detector 190, as well as a communication interface 110, a display 120, a memory 130 and a processor 140.

[0134] The communication interface 110 may include one or more modules configured to enable wireless communication between the electronic device 100 and a wireless communication system or between the electronic device 100 and a network including other electronic devices. For example, the communication interface 110 may include a mobile communication module 111, a wireless internet module 112, and a short-range communication module 113.

[0135] Mobile communication module 111 transmits wireless signals to at least one of a base station, external terminal, or server in the mobile communication network, and receives wireless signals from at least one of the base station, external terminal, or server in the mobile communication network. The wireless signals may include various types of data based on the transmission and reception of voice call signals, video call signals, or text / multimedia messages.

[0136] The wireless internet module 112 indicates a module for accessing the wireless internet and can be located inside or outside the electronic device 100. Wireless local area networks (WLANs, including Wi-Fi), wireless broadband (WiBro), Global Microwave Access Interoperability (WiMax), High-Speed ​​Downlink Packet Access (HSDPA), etc., can be used as wireless internet technologies. The electronic device 100 can perform Wi-Fi peer-to-peer (P2P) connections to other devices via the wireless internet module 112.

[0137] The short-range communication module 113 indicates a module for short-range communication. Short-range communication technologies that can be used include Bluetooth, BLE, RFID, Infrared Data Association (IrDA), UWB, ZigBee, etc.

[0138] The display 120 can display image signals received from the server device 300 on the screen.

[0139] The memory 130 can store programs related to the operation of the electronic device 100, as well as various data that occur during the operation of the electronic device 100.

[0140] Memory 130 may store at least one instruction. Furthermore, memory 130 may store at least one program to be executed by processor 140. Additionally, memory 130 may store an application for providing a specified service.

[0141] In detail, the memory 130 may include at least one type of storage medium selected from flash memory, hard disk, micro multimedia card, memory card (e.g., SD or XD memory card), RAM, SRAM, ROM, EEPROM, PROM, magnetic storage, magnetic disk and optical disk.

[0142] Processor 140 controls all operations of electronic device 100. For example, processor 140 may execute one or more instructions stored in memory 130 to perform the functions of electronic device 100 described in this disclosure.

[0143] According to embodiments of this disclosure, processor 140 may store one or more instructions in its internal memory and may execute one or more instructions stored in its internal memory to control the operation of electronic device 100. That is, processor 140 may execute at least one instruction or program stored in processor 140's internal memory or stored in memory 130 to perform a specified operation.

[0144] Processor 140 performs all operations of electronic device 100 and the signal flow between internal components (not shown) of electronic device 100, as well as data processing functions. When user input is present or preset and stored conditions are met, processor 140 can execute the operating system (OS) and various applications stored in memory 130.

[0145] Processor 140 may include a graphics processing unit (GPU) for processing graphics corresponding to the video. The GPU generates a screen that includes various objects (such as icons, images, or text) using an arithmetic unit and a renderer. The arithmetic unit calculates attribute values, such as coordinate values, shape, size, and color, of the objects to be displayed based on the screen layout using user interactions detected via detector 190. The renderer generates a screen with various layouts of objects based on the attribute values ​​calculated by the arithmetic unit.

[0146] According to embodiments of the present disclosure, processor 140 may be configured to execute at least one instruction stored in memory 130 to detect whether a notification event has occurred on a display screen displaying an image, indicating that another user is attempting to send information.

[0147] According to embodiments of the present disclosure, processor 140 may be configured to execute at least one instruction stored in memory 130 to obtain an indication including at least one of a visual effect or an auditory effect corresponding to the detected notification event when the occurrence of a notification event is detected.

[0148] According to embodiments of the present disclosure, processor 140 may be configured to execute at least one instruction stored in memory 130 to provide indication by using at least one of an information display area or an audio output unit.

[0149] According to embodiments of the present disclosure, processor 140 may be configured to execute at least one instruction stored in memory 130 to identify a predefined region from an image displayed on a display and to identify a notification event from the identified predefined region.

[0150] According to embodiments of the present disclosure, processor 140 may be configured to execute at least one instruction stored in memory 130 to identify a predefined region using setting information based on user input that sets a predefined region, or to automatically detect a predefined region from an image.

[0151] According to embodiments of this disclosure, processor 140 may be configured to execute at least one instruction stored in memory 130 to detect a notification event by detecting an item image corresponding to the notification event from a predefined area using one or more notification event information. The one or more notification event information may include identification information for each notification event, an item image corresponding to each notification event, and a visual or auditory effect corresponding to each notification event.

[0152] According to embodiments of the present disclosure, processor 140 may be configured to execute at least one instruction stored in memory 130 to obtain an indication corresponding to a detected notification event by referring to a registration indication corresponding to one or more notification event information and identification information about each notification event.

[0153] According to embodiments of the present disclosure, processor 140 may be configured to execute at least one instruction stored in memory 130 to provide a visual effect by using an information display area of ​​a display screen that does not display an image.

[0154] The information display area may include a predetermined area in the display of an external display device to share and display at least a portion of the display screen on the electronic device, and the processor 140 may be configured to provide visual effects by using a predetermined area in the display of the external display device where no image is displayed. At least a portion of the shared screen may include a minimap area, and the predetermined area in the display of the external display device may include areas other than the area displaying the minimap area.

[0155] According to embodiments of the present disclosure, processor 140 may be configured to execute at least one instruction stored in memory 130 to identify the location in game content where a notification event occurs, and determine the location to provide an instruction based on the location where the notification event occurs.

[0156] The image processor 150 can process image signals received from the receiver 180 or the communication interface 110, and can output the image signals to the display 120 based on the control of the processor 140.

[0157] The audio processor 160 can convert audio signals received from the receiver 180 or the communication interface 110 into analog audio signals based on the control of the processor 140, and can output the analog audio signals to the audio output unit 170.

[0158] The audio output unit 170 can output audio (e.g., voice, sound) input via the communication interface 110 or the receiver 180. Furthermore, the audio output unit 170 can output audio stored in the memory 130 based on the control of the processor 140. The audio output unit 170 may include at least one of a speaker, a headphone output terminal, a Sony / Philips digital interface (S / PDIF) terminal, or a combination thereof.

[0159] Receiver 180 can receive video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), and ancillary information (e.g., electronic program guide (EPG)) from an external source of electronic device 100, based on the control of processor 140. Receiver 180 may include one or a combination of a High Definition Multimedia Interface (HDMI) port 181, a component jack 182, a PC port 183, and a USB port 184. Receiver 180 may also include a DisplayPort (DP), Thunderbolt, Mobile High Definition Link (MHL), and HDMI port 181.

[0160] Detector 190 detects the user's voice, the user's image, or the user's interaction, and may include microphone 191, camera 192, and light receiver 193.

[0161] Microphone 191 receives voice input from the user. Microphone 191 can convert the received voice into an electrical signal and output the electrical signal to processor 140. The user's voice may include, for example, voice corresponding to menus or functions of electronic device 100.

[0162] Camera 192 can receive images (e.g., consecutive frames) corresponding to the user's movement (including gestures within the camera's recognition range). Processor 140 can use the received motion recognition results to select menus displayed on electronic device 100, or can perform controls corresponding to the motion recognition results.

[0163] The optical receiver 193 receives optical signals (including control signals) from an external control device. The optical receiver 193 can receive optical signals corresponding to user input (e.g., touch, press, touch gesture, voice, or movement) from the control device. Based on the control of the processor 140, control signals can be extracted from the received optical signals.

[0164] Figure 4 This is a flowchart of an operation method of an electronic device according to an embodiment of the present disclosure.

[0165] refer to Figure 4 In operation 410, the electronic device 100 can detect whether a notification event has occurred on the game execution result screen displayed on the monitor, indicating that other game players are trying to send information.

[0166] According to embodiments of this disclosure, electronic device 100 can send a request to server device 300 to execute a game application, and can receive the request from server device 300 and display a screen showing the execution results obtained by executing the game application on a display.

[0167] According to embodiments of this disclosure, electronic device 100 can analyze an image corresponding to an execution result screen displayed on a monitor, and thus can detect whether a notification event indicating that another player is attempting to send a message has occurred on the game execution result screen displayed on the monitor. The notification event indicating that another player is attempting to send a message may include, for example, a ping displayed on a minimap.

[0168] According to embodiments of this disclosure, the electronic device 100 can identify a predetermined area from an image corresponding to an execution result screen, and can detect whether a notification event has occurred in the identified predetermined area. For example, the predetermined area may include a mini-map area displaying information related to the progress of the game content.

[0169] According to embodiments of this disclosure, electronic device 100 can receive settings for a predetermined area via user input and can identify the predetermined area set according to user input from an image corresponding to the execution result screen.

[0170] According to embodiments of this disclosure, electronic device 100 can automatically identify a predetermined region by performing image analysis on an image corresponding to the execution result screen.

[0171] In operation 420, when a notification event is detected, the electronic device 100 can identify the identification information of the detected notification event.

[0172] According to embodiments of this disclosure, electronic device 100 may store one or more notification event messages.

[0173] According to embodiments of this disclosure, one or more notification event information may include an identifier for each notification event and an indication for each notification event. The indication for each notification event may include at least one of a visual effect or an auditory effect provided in response to each notification event. For example, visual effects may include color, blinking, text, etc.

[0174] In operation 430, the electronic device 100 may receive an instruction including at least one of a visual effect or an auditory effect corresponding to the identification information of the identified notification event.

[0175] In operation 440, electronic device 100 may provide indication by using at least one of an information display area or an audio output unit.

[0176] According to embodiments of this disclosure, the electronic device 100 can provide visual effects included in the instructions by using an information display area, or it can provide auditory effects included in the instructions by using an audio output unit. The information display area may include a black area that is not used when displaying game content in the electronic device 100.

[0177] According to embodiments of this disclosure, electronic device 100 can provide visual effects included in instructions by using the information display area of ​​the display screen of electronic device 100.

[0178] According to embodiments of this disclosure, electronic device 100 can provide visual effects included in instructions by using an information display area of ​​a display screen of a display device communicatively connected to electronic device 100. For example, electronic device 100 may be communicatively connected to display device to share a minimap area, thereby allowing the minimap area to be displayed on display device. In order to provide visual effects included in instructions by using the information display area of ​​display device's display screen, electronic device 100 may send information about the instructions or information about the visual effects to display device. The information display area of ​​display device's display screen may include a black area in which the minimap area is not displayed on the display screen.

[0179] Figure 5 This is a flowchart of an operation method of an electronic device according to an embodiment of the present disclosure.

[0180] refer to Figure 5 In operation 501, the user of electronic device 100 can input a request to execute a game application by using input device 10. Therefore, input device 10 can send the input request to execute the game application to electronic device 100.

[0181] In operation 502, electronic device 100 may send a request to server device to execute a game application received from input device 10.

[0182] In operation 503, the user of electronic device 800 can input a request to execute a game application by using input device 20. Therefore, input device 20 can send the input request to execute the game application to electronic device 800.

[0183] In operation 504, electronic device 800 may send a request to server device 300, received from input device 20, to execute a game application.

[0184] In operation 505, server device 300 can execute a game application requested by electronic device 100. The game application requested by electronic device 100 and the game application requested by electronic device 800 can be the same game application.

[0185] In operation 506, server device 300 can send the screen of game execution results obtained by executing the game application to electronic device 100.

[0186] In operation 507, electronic device 100 can display a screen showing the execution results of the game application received from server device 300.

[0187] In operation 508, server device 300 can send the execution result screen of the game application to electronic device 800.

[0188] In operation 509, electronic device 800 can display a screen showing the execution results of the game application received from server device 300.

[0189] In operation 510, electronic devices 100 and 800 can perform game operations via server device 300. Electronic devices 100 and 800 can play the same game application, and users of electronic devices 100 and 800 can form the same team (e.g., allies).

[0190] In the game operation 510, server device 300 can execute the game application based on input from either input device 10 of electronic device 100 or input device 20 of electronic device 800 for controlling the execution of the game application, and can send the game execution result screen to electronic devices 100 and 800. For example, when input device 10 of electronic device 100 sends input to electronic device 100 for controlling the execution of the game application, electronic device 100 can send a control signal corresponding to the input for controlling execution to server device 300. Server device 300 can execute the game application based on the received control signal and can send the game execution result screen to electronic devices 100 and 800. Then, each of electronic devices 100 and 800 can display the game execution result screen received from server device 300. In this way, when users of electronic devices 100 and 800 form a team and play a game, users of electronic devices 100 and 800 can share information with each other or provide notifications to each other for effective gameplay. For this purpose, notification events can be used.

[0191] In operation 511, a user of electronic device 800 can perform input to select an item for a notification event by using input device 20. For example, electronic device 800 can provide a graphical user interface for inputting items for a notification event, and a user of electronic device 800 can input a notification event by using the graphical user interface.

[0192] Figure 6 An example of a graphical user interface for selecting or entering notification events is shown according to an embodiment of this disclosure.

[0193] refer to Figure 6 The graphical user interface 600 may include five (5) items, namely a first item 610, a second item 620, a third item 630, a fourth item 640, and a fifth item 650. The first item 610 may indicate a message indicating that attention is needed, the second item 620 may indicate a message indicating that assistance is requested, the third item 630 may indicate a message indicating that an attack is imminent, the fourth item 640 may indicate a message indicating that a target exists, and the fifth item 650 may indicate a message indicating that defense is requested.

[0194] To provide warnings or notifications to other players in the same team, an item in the graphical user interface 600 can be selected to provide the notification event. For example, a user of the electronic device 800 can use the input device 20 to select an item in the graphical user interface 600 at a desired location in the game space. The input device 10 can then send the selection of an item for the notification event to the electronic device 800.

[0195] In operation 512, electronic device 800 can send a signal to server device 300 corresponding to the input of an item in the selection notification event, which is received from input device 20.

[0196] In operation 513, server device 300 can display notification events on a minimap based on signals received from electronic device 800, the notification events corresponding to items selected by electronic device 800.

[0197] In operation 514, when server device 300 sends a game screen including a minimap displaying notification events to electronic device 800, in operation 515, electronic device 800 may display the game screen including the minimap displaying notification events.

[0198] In operation 516, when server device 300 sends a game screen including a minimap displaying notification events to electronic device 100, in operation 517, electronic device 100 can display the game screen including the minimap displaying notification events. Electronic device 100 can display game screens with various aspect ratios.

[0199] Figure 7 The image shown is displayed in an electronic device that supports outputs of various aspect ratios.

[0200] Figure 7 Examples of electronic devices outputting screens with various aspect ratios according to embodiments of the present disclosure are shown.

[0201] The electronic device 100 according to embodiments of this disclosure can support the output of screens with various aspect ratios. Here, aspect ratio refers to the ratio of the vertical length of the screen to its horizontal length, and can be expressed as values ​​such as 4:3, 16:9, 16:10, 21:9, 32:9, etc. Furthermore, since aspect ratio indicates the ratio of the horizontal length of the output screen or image to its vertical length, it can be referred to as screen ratio, image ratio, etc. The aspect ratio of the screen can be optimized according to the type of image. For example, an aspect ratio that improves user satisfaction can be selected based on the type of image output via the screen. For example, a 16:9 aspect ratio is the most commonly used screen ratio and can be used in the output of menu screens, work screens, etc.

[0202] As another example, a 21:9 aspect ratio can be used in movie watching, games, etc., to provide more information on the screen in the horizontal direction (or horizontal direction). As another example, a 32:9 aspect ratio can be used for image output to provide or receive a wide field of view. Specifically, a 32:9 aspect ratio can be primarily used in games that provide 360-degree or panoramic images to enhance user experience, including sports games, racing games, fighting games, etc. When displaying images of the same game content, different fields of view can be provided depending on the image's aspect ratio. For example, increasing the image's aspect ratio to extend it in the width direction can provide a wider field of view or a wider viewing angle. For example, a wider field of view or a wider viewing angle can be provided in the order of 32:9, 21:9, and 16:9 aspect ratios.

[0203] refer to Figure 7 When the ratio of the vertical length to the horizontal length of the display (or display panel) included in the electronic device 100 (i.e., the aspect ratio of the display of the electronic device 100) is 16:9, a screen 700A that outputs a game screen image 710 with an aspect ratio of 16:9, a screen 700B that outputs a game screen image 720 with an aspect ratio of 21:9, and a screen 700C that outputs a game screen image 730 with an aspect ratio of 32:9 are provided.

[0204] When screen 700A displays a game screen image 710 with a 16:9 aspect ratio on a display screen with a 16:9 aspect ratio, the game screen image 710 can be displayed precisely to fit the display screen. A mini-map 700 can be displayed in the lower left corner of the game screen image 710, and can display notification events 750 provided by other gamers (e.g., users of electronic devices 800). The mini-map 700 can be provided at various locations within the game screen image 710 according to user settings.

[0205] When screen 700B displays a game screen image 720 with a 21:9 aspect ratio on a display screen with a 16:9 aspect ratio, the game screen image 720 may have an area as a black area 740, which is partially displayed on the display screen and in which the game screen image 720 is not displayed. A mini-map 700 may be displayed in the lower left corner of the game screen image 720 and may display notification events 750 provided by other game players (e.g., the user of electronic device 800). The mini-map 700 can be provided at various locations within the game screen image 720 according to user settings. Electronic device 100 provides a mini-map zoom function. That is, since the mini-map provided by server device 300 is small and may therefore be unreadable, electronic device 100 provides the function of expanding and displaying the mini-map. When the minimap zoom function is selected, the electronic device 100 can expand the minimap 700 included in the game screen image 720, and can display the expanded minimap image 760 in areas where the game screen image 720 is not displayed (e.g., in the area that is part of the black area 740). Therefore, by using the expanded minimap image 760, the user can more easily identify notification events occurring in the minimap.

[0206] When screen 700C displays a game screen image 730 with a 32:9 aspect ratio on a display screen with a 16:9 aspect ratio, the game screen image 730 may have an area as a black area 780, which is partially displayed on the display screen and in which the game screen image 730 is not displayed. A mini-map 700 may be displayed in the lower left corner of the game screen image 730 and may display notification events 750 provided by other gamers (e.g., the user of electronic device 800). The mini-map 700 may be provided at various locations within the game screen image 730 according to user settings. Electronic device 100 provides a mini-map zoom function. Additionally, electronic device 100 may display an extended mini-map image 770, which is included in the game screen image 730, in areas where the game screen image 730 is not displayed (e.g., in a portion of the black area 780). Therefore, the user can further easily identify notification events occurring in the mini-map by using the extended mini-map image 770.

[0207] According to embodiments of this disclosure, electronic device 100 can use a minimap sharing function to allow a minimap to be displayed on other devices, such as display devices external to electronic device 100.

[0208] Figure 8 This is a reference diagram used to illustrate an example of sharing a minimap using a minimap sharing function according to embodiments of the present disclosure.

[0209] refer to Figure 8 Electronic device 100 can be communicatively connected to an external electronic device such as display device 200, can mirror at least a portion of an image displayed on the display screen, and can allow the mirrored portion to be displayed on display device 200. At least a portion of the image to be shared via mirroring may include a minimap.

[0210] According to embodiments of this disclosure, electronic device 100 can send an image to display device 200 using a mini-map sharing function. The image corresponding to the mini-map 700 is a portion of a game screen image displayed on the monitor of electronic device 100. Display device 200 can display the corresponding image in the mini-map 700, wherein the corresponding image is received from electronic device 100. In this way, electronic device 100 allows the mini-map to be displayed on external display device 200, enabling users to see an expanded mini-map on a large screen and easily identify notification events in the mini-map.

[0211] In this way, when electronic device 100 displays a game screen including a minimap displaying notification events input by the user of electronic device 800, the user of electronic device 100 can recognize the notification events input by the user of electronic device 800. However, typically, because the minimap is a miniature version of the entire game space and has a small size, users may have difficulty recognizing notification events displayed in the minimap (or in emergency game running situations). Therefore, in embodiments of this disclosure, electronic device 100 may also perform operations 518 and 519 as operations to allow for easier recognition of notification events displayed in the minimap.

[0212] In operation 518, electronic device 100 can detect notification events displayed on the display screen. Electronic device 100 can detect notification events from a minimap displayed on the display screen.

[0213] In operation 519, electronic device 100 may provide visual / auditory effects in response to identification information of notification events detected from a minimap displayed on a display screen. Thus, electronic device 100 can not only simply display notification events in the minimap, but also provide separate visual or auditory effects corresponding to the notification events, allowing users to more easily identify notification events displayed in the minimap, thereby making it easier for users to use the minimap.

[0214] The following text will now describe it in detail. Figure 4 The operation shown is illustrated.

[0215] Figure 9An example flowchart of a method for an electronic device to detect whether a notification event has occurred, according to an embodiment of the present disclosure, is shown.

[0216] refer to Figure 9 In operation 910, the electronic device 100 can identify a predefined area in an image displayed on the display screen. The predefined area may include an area for displaying notification events. For example, the predefined area may include a mini-map area. An example of a mini-map area will now be described below.

[0217] Electronic device 100 can identify mini-map areas in images displayed on a display screen by using various methods.

[0218] According to embodiments of this disclosure, electronic device 100 can receive setting information via user input regarding the area where a mini-map is displayed on a screen on the display of electronic device 100, and recognize the mini-map on the screen on the display based on the setting information received via user input.

[0219] Figure 10 An example of a display screen of an electronic device 100 according to an embodiment of the present disclosure is shown.

[0220] refer to Figure 10 The display screen 1000 of the electronic device 100 may include area 1010 and area 1020. Area 1010 displays an image received from the server device 300 and corresponding to the game execution screen, while area 1020 does not display the image corresponding to the game execution screen on the display screen 1000. Area 1020, where the image corresponding to the game execution screen is not displayed, may be referred to as the black area 1020. The game execution screen may include a mini-map area 1030. The black area 1020 may include a mini-map zoom area 1040 for displaying an expanded image of the mini-map according to user selection. The location of the mini-map area 1030 is not limited to... Figure 10 The location shown can be placed anywhere on the game execution screen, depending on user settings. The location of the minimap zoom area 1040 is not limited to... Figure 10 The position shown can be placed anywhere on the game execution screen according to user settings.

[0221] Electronic device 100 can receive user input from input device 10 to set minimap area 1030 or minimap zoom area 1040. For example, electronic device 100 can provide a graphical user interface for specifying minimap area 1030 or minimap zoom area 1040. When a user performs a manipulation operation to specify minimap area 1030 or minimap zoom area 1040 using input device 10, input device 10 can send the input specifying minimap area 1030 or minimap zoom area 1040 to electronic device 100. Therefore, electronic device 100 can store user settings for specifying minimap area 1030 or minimap zoom area 1040, and subsequently, when a display device recognizes a minimap area on the display screen, electronic device 100 can recognize the minimap area 1030 or minimap zoom area 1040 specified according to the user settings.

[0222] According to embodiments of this disclosure, electronic device 100 can identify minimap regions by analyzing images output from a display screen using various object detection algorithms or filters. For example, based on the shape or size of the minimap region, electronic device 100 can detect minimap regions with corresponding shapes or sizes in an image corresponding to the display screen. For example, when the minimap region has a square shape, electronic device 100 can detect regions (or objects) indicating square shapes in the image corresponding to the display screen by using edge detection algorithms. Optionally, when the minimap has a circular shape, electronic device 100 can detect regions (or objects) indicating circular shapes in the image corresponding to the display screen by using circular detection algorithms. However, this disclosure is not limited to this. Optionally, electronic device 100 can obtain information about the shape and size of the minimap region based on displayed content recognition information. For example, information about a minimap corresponding to each game content can be provided, and electronic device 100 can obtain information about the shape or size of the minimap provided in the game content based on the recognition information of the displayed game content.

[0223] According to embodiments of this disclosure, electronic device 100 can identify minimap regions in an image corresponding to a display screen by using neural network-based artificial intelligence (AI) technology. For example, electronic device 100 can identify minimap regions in an image corresponding to a display screen by using a neural network trained for each game content based on minimap regions corresponding to the game content.

[0224] According to embodiments of this disclosure, when the location of a specified minimap area in the currently displayed game content or game application is fixed, the electronic device 100 can identify the minimap area at that location. For example, the minimap area provided in the game execution screen of each game content or game application can be fixed. Therefore, in this case, the electronic device 100 can identify the location of the fixed minimap area based on the identification information of the currently displayed game content or game application, and can detect the minimap area at that location.

[0225] Return to reference Figure 9 In operation 920, electronic device 100 can detect notification events from a predefined area.

[0226] According to embodiments of this disclosure, electronic device 100 may store one or more notification event messages that can be identified from a predefined area. Electronic device 100 can then detect notification events from the predefined area by referring to the stored one or more notification event messages. In this regard, the notification event messages may vary depending on each game application or each game content; therefore, electronic device 100 can detect notification events from the predefined area by referring to notification event messages corresponding to the currently displayed game content. The notification event messages may include images of items corresponding to one or more notification events. Items corresponding to notification events may be referred to as icons corresponding to notification events.

[0227] refer to Figure 11 and 12 The notification event information according to embodiments of the present disclosure will now be described.

[0228] Figure 11 An example of notification event information according to an embodiment of this disclosure is shown.

[0229] The delivery of notification events can vary for each game application. Therefore, notification event information can exist corresponding to each game application or each game content. For example, electronic device 100 can store notification event information corresponding to one or more game content (e.g., notification event information corresponding to the first game content, notification event information corresponding to the second game content, notification event information corresponding to the third game content, etc.). For each game content, the number of notification events, the shape of the item image corresponding to the notification event, and the number and attributes of the visual or auditory effects corresponding to the notification event can differ.

[0230] refer to Figure 11 Information 1100 regarding notification events corresponding to the first game content may include information about ID1, ID2, ID3, ID4, etc. as information about one or more notification events.

[0231] The information about each notification event in one or more notification event messages may include notification event identification information 1110 for identifying the notification event, an item image 1120 corresponding to the notification event, and an indication 1130 corresponding to the notification event.

[0232] Notification event identification information 1110 can indicate information used to identify each notification event from one or more notification events.

[0233] The image 1120 corresponding to the notification event can indicate the image of the item that the electronic device 100 can detect, in order to determine the occurrence of the notification event in the image corresponding to the display screen.

[0234] The indication 1130 corresponding to the notification event may include at least one of a visual effect or an auditory effect provided in response to the detection of the notification event. The visual effect may include at least one of a color 1131, a graphic effect 1132, text 1133, or an information display area position 1134.

[0235] Color 1131 can indicate the color to be provided as a visual effect in response to the detection of a notification event. For example, the information display area providing the visual effect can be displayed in various colors, including red, black, etc. Colors can be displayed according to a specific pattern.

[0236] Graphical effect 1132 can indicate a graphical effect to be provided as a visual effect in response to the detection of a notification event. The graphical effect can indicate various visual effects, including blinking and flashing, to be provided in the information display area to provide a visual experience. When providing effects such as blinking or flashing, the graphical effect can have a specified period. For example, the graphical effect can be set to indicate a relatively imminent situation or emergency by shortening the blinking period.

[0237] In response to the detection of a notification event, text 1133 can indicate the text to be provided as a visual effect.

[0238] Information display area location 1134 can indicate a portion of the display screen to provide visual effects in response to the detection of a notification event. According to embodiments of this disclosure, the portion of the display screen providing visual effects in response to the detection of a notification event may include an area where the game execution screen is not displayed, i.e., at least a portion of a black area. According to embodiments of this disclosure, the portion of the display screen providing visual effects in response to the detection of a notification event may include: when the black area includes a minimap zoom area, at least a portion of the remaining area of ​​the black area excluding the minimap zoom area. According to embodiments of this disclosure, the portion of the display screen providing visual effects in response to the detection of a notification event may include, when the electronic device 100 uses the minimap sharing function to share a minimap with other display devices, at least a portion of the remaining area of ​​the screen of the other display device sharing the minimap, excluding the area sharing the minimap.

[0239] Auditory effects may include sound 1135. Sound 1135 may include not only the sounds of various effects, but also the spoken voice of text 1133.

[0240] Notification event information is not limited to Figure 11 The example shown.

[0241] Although Figure 11 The location of the information display area that provides visual effects in response to each notification event is shown to be fixed, but this disclosure is not limited thereto.

[0242] According to embodiments of this disclosure, the visual or auditory effects may vary depending on the location of each notification event occurring in the game space, or the location of the information display area providing the visual effects may vary.

[0243] According to embodiments of this disclosure, notification event information can be configured such that visual or auditory effects can be changed, or the location of the information display area to provide visual effects can be changed, depending on whether the location of the notification event in the game space is within the space displayed on the screen of the electronic device 100, or whether it is not within the space displayed on the screen of the electronic device 100. For example, the electronic device 100 can identify whether the location of the notification event in the game space is within the space displayed on the screen of the electronic device 100. When it is identified that the location of the notification event in the game space is within the space displayed on the screen of the electronic device 100, the electronic device 100 can provide visual or auditory effects according to a first indication corresponding to the notification event. When it is identified that the location of the notification event in the game space is not within the space displayed on the screen of the electronic device 100, the electronic device 100 can provide visual or auditory effects according to a second indication corresponding to the notification event. The first indication and the second indication can have different sets of visual and / or auditory effects.

[0244] According to embodiments of this disclosure, notification event information can be configured such that visual or auditory effects can vary depending on whether the location of the notification event in the game space is close to or far from the user's character on the electronic device 100, or the location of the information display area to provide visual effects can vary. For example, the electronic device 100 can calculate the distance between the location where the notification event has occurred in the game space and the location where the user's character on the electronic device 100 is located, and can determine whether the calculated distance exceeds a threshold. When the electronic device 100 determines that the calculated distance exceeds the threshold, the electronic device 100 can provide visual or auditory effects according to a first indication corresponding to the notification event. When the electronic device 100 determines that the calculated distance does not exceed the threshold, the electronic device 100 can provide visual or auditory effects according to a second indication corresponding to the notification event. The first indication and the second indication can have different sets of visual and / or auditory effects.

[0245] Figure 12 An example of notification event information according to an embodiment of this disclosure is shown.

[0246] refer to Figure 12The notification event information 1200 may include five notification events. The notification event identification information 1210 may include ID1 representing "attack," ID2 representing "target," ID3 representing "defense," ID4 representing "attention," and ID5 representing "assistance." The project image 1220 may correspond to each notification event identification information 1210. For notification event ID1, color 1231 is set to red, text 1232 is set to attack, and sound 1233 is set to sound A. For notification event ID2, color 1231 is set to red; for notification event ID3, color 1231 is set to green, text 1232 is set to defense, and sound 1233 is set to sound B. For notification event ID4, color 1231 is set to red, text 1232 is set to attention, and sound 1233 is set to sound C. For notification event ID5, color 1231 is set to blue, and text 1232 is set to assistance. When electronic device 100 detects an image of an item corresponding to ID1 in the mini-map area, according to notification event information 1200, electronic device 100 can display red as the color of the information display area, output <attack> as text, and output sound A as an auditory effect.

[0247] Return to reference Figure 9 In operation 920, electronic device 100 can access a predefined area from a reference. Figure 11 One of the images detected in the notification event information described.

[0248] According to embodiments of this disclosure, electronic device 100 can determine whether an item image is detected from a predefined area by analyzing an image of a predefined area using various object detection algorithms or filters. The item image is included in notification event information corresponding to game content or game application currently displayed on the display screen.

[0249] According to embodiments of this disclosure, electronic device 100 can determine whether an item image has been detected from a predefined area using neural network-based AI technology. This item image is included in notification event information corresponding to game content or a game application currently displayed on the screen. For example, electronic device 100 can detect item images of notification events in a minimap area for each piece of game content by using a neural network trained on item images included in notification event information corresponding to the game content.

[0250] An algorithm or set of algorithms used to implement AI technology is called a neural network. Here, a neural network can receive input data, analyze the input data, and output target result data. To enable the neural network to correctly output result data corresponding to the input data, it needs to be trained. Here, "training" can mean that the neural network is trained to discover or recognize methods for inputting various types of data into the neural network and analyzing the input data, methods for classifying each piece of input data, and / or methods for extracting features from each piece of input data to generate result data. Here, "training" can also be interpreted as "learning." Furthermore, a set of algorithms used to output result data corresponding to the input data through the neural network, the software used to execute the set of algorithms, and / or the hardware used to execute the set of algorithms can be called an "AI model" ("artificial intelligence model"). AI models can exist in various forms. Specifically, there can be various AI models for receiving image input, analyzing the input image, and classifying gestures of objects included in the image into at least one class. An AI model may include at least one neural network.

[0251] For example, methods for performing object recognition, object tracking, and / or object identification have been developed and used by employing AI techniques that perform operations via neural networks. In the following text, for ease of description, the operation of identifying specific image objects through image analysis, such as object recognition, object tracking, and object identification, is collectively referred to as "object recognition." For example, the neural network can be a deep neural network (DNN) comprising multiple layers to perform multi-layer operations. Furthermore, DNN operations can include convolutional neural network (CNN) operations, etc. Specifically, a data recognition model for object recognition can be implemented via a neural network, and the implemented recognition model can be trained using training data. Then, by using the trained data recognition model, input data (e.g., received images) can be analyzed, objects can be identified from the input images, and the identified objects can be output as result data. Furthermore, CNN refers to all neural networks configured to perform algorithms for finding patterns by analyzing images, and can include various types and forms.

[0252] In this way, when the electronic device 100 detects one of the item images included in the notification event information from a predefined area, it can output at least one of the visual or auditory effects included in the indication corresponding to the detected item image.

[0253] According to embodiments of this disclosure, electronic device 100 can display visual effects corresponding to detected notification events in an information display area (e.g., a black area) of a display screen that does not display the game execution screen. Reference will now be made to... Figure 13 Describe the various locations of the information display area.

[0254] Figure 13 An example of an information display area that displays visual effects corresponding to a notification event, according to an embodiment of the present disclosure, is shown.

[0255] refer to Figure 13 In the case 1300A, where a game execution screen 1311, including a minimap 1312 at the bottom of the display screen 1310 of the electronic device 100, is displayed and the black area 1313 is located at the bottom, the electronic device 100 can provide a visual effect to at least a portion of the black area 1313, which serves as an information display area. That is, the electronic device 100 can provide a visual effect to at least a portion of the black area 1313 corresponding to a notification event detected at the minimap 1312. (See reference...) Figure 12 The notification event information 1200 shown can, when a project image corresponding to notification event ID4 is detected, display red in at least a portion of the black area 1313, output the text <CAUTION>, and output the sound C as an auditory effect.

[0256] In a scenario 1300B where a game execution screen 1321, including a mini-map 1322, is displayed at the bottom of the display screen 1320 of the electronic device 100, and black areas 1323 and 1324 are located at the top and bottom, the electronic device 100 can provide visual effects to at least a portion of each of the black areas 1323 and 1324, which serve as information display areas. (Reference) Figure 12 The notification event information 1200 shown indicates that when an item image corresponding to notification event ID4 is detected, the electronic device 100 may display red in at least a portion of each of black areas 1323 and black areas 1324, may output the text <CAUTION>, and may output the sound C as an auditory effect.

[0257] In case 1300C, when the game execution screen 1331, including the minimap 1332 located at the bottom of the display screen 1330 of the electronic device 100, is displayed and the minimap zoom area 1334 is located in the black area 1333 at the bottom, the electronic device 100 can provide visual effects to at least a portion of the black area 1333, which serves as an information display area. That is, the electronic device 100 can provide visual effects to at least a portion of the black area 1333 corresponding to notification events detected at the minimap 1332 or the minimap zoom area 1334. (See reference...) Figure 12The notification event information 1200 shown can, when a project image corresponding to notification event ID4 is detected, display red in at least a portion of the black area 1333, output the text <CAUTION>, and output the sound C as an auditory effect.

[0258] In the case 1300D, where a game execution screen 1341, including a minimap 1342 located at the bottom of the display screen 1340 of the electronic device 100, is displayed and the minimap zoom area 1344 is located within the top black area 1343, the electronic device 100 can provide visual effects to at least a portion of the black area 1343, which serves as an information display area. That is, the electronic device 100 can provide visual effects to at least a portion of the black area 1343 corresponding to notification events detected at the minimap 1342 or the minimap zoom area 1344. (See reference...) Figure 12 The notification event information 1200 shown can, when a project image corresponding to notification event ID4 is detected, display red in at least a portion of the black area 1343, output the text <CAUTION>, and output the sound C as an auditory effect.

[0259] According to embodiments of this disclosure, electronic device 100 can display visual effects corresponding to detected notification events in an information display area of ​​a display screen of a display device communicatively connected to electronic device 100. For example, the information display area of ​​the display screen of the display device may include an area where a shared mini-map is not displayed or a black area. Reference will now be made to... Figure 14 An example is described of displaying a visual effect corresponding to a notification event on the display screen of a display device communicatively connected to electronic device 100.

[0260] Figure 14 This is a reference diagram illustrating an example of an electronic device 100 according to an embodiment of the present disclosure displaying a visual effect corresponding to a notification event on a display screen of a display device communicatively connected to the electronic device 100.

[0261] refer to Figure 14 Electronic device 100 can be communicatively connected to display device 200 to share at least a portion of an image displayed on the display screen of electronic device 100. Various screen mirroring technologies can be used for image sharing.

[0262] According to embodiments of this disclosure, when electronic device 100 displays a game execution screen, electronic device 100 can communicatively connect to display device 200 to share a mini-map area. Only the mini-map area is displayed on the display screen of display device 200, allowing the user to experience a mini-map area with a further expanded size. Electronic device 100 can communicatively connect to various types of display device 200. For example, display device 200 may include monitor 200a, PC 200b, and tablet computer 200c.

[0263] Reference Figure 14 The document describes a monitor 200a, a PC 200b, and a tablet computer 200c capable of sharing and displaying a minimap area of ​​an electronic device 100. The monitor 200a may include a central area displaying a minimap received from the electronic device 100 using a mirror image, and right and left areas of the screen where black areas may exist. The electronic device 100 can control the use of at least a portion of each black area of ​​the monitor 200a as an information display area to provide visual effects corresponding to notification events detected in the minimap. The PC 200b may include a left area of ​​the screen displaying a minimap received from the electronic device 100 using a mirror image, and a right area of ​​the screen displaying a window. The electronic device 100 can control the use of at least a portion of a window area included in the right area of ​​the PC 200b as an information display area to provide visual effects corresponding to notification events detected in the minimap. The tablet computer 200c may include a central area of ​​the screen, and right and left areas of the screen, wherein a minimap received from the electronic device 100 using a mirror image is displayed in the central area of ​​the screen, and black areas may exist in the right and left areas of the screen. Electronic device 100 can control the provision of visual effects corresponding to notification events detected in the minimap by using at least a portion of each black area of ​​tablet computer 200c as an information display area.

[0264] Figure 15 An example flowchart of an operation method of an electronic device according to an embodiment of the present disclosure is shown.

[0265] refer to Figure 15 In operation 1510, electronic device 100 and display device 200 can be communicatively connected. According to embodiments of this disclosure, electronic device 100 can establish a communication connection to allow at least a portion of an image displayed on the display screen of electronic device 100 to be mirrored onto the screen of display device 200. For example, electronic device 100 can establish a communication connection using Wi-Fi or Bluetooth communication technologies.

[0266] In operation 1520, electronic device 100 can display the game execution screen.

[0267] In operation 1530, electronic device 100 can identify the mini-map area on the game execution screen.

[0268] In operation 1540, electronic device 100 can send an image corresponding to the identified mini-map area to display device 200.

[0269] During operation 1550, electronic device 100 can display an image of a mini-map area on the monitor.

[0270] In operation 1560, electronic device 100 can detect notification events in the mini-map area.

[0271] In operation 1570, the electronic device 100 may receive an indication corresponding to the detected notification event. This indication may include visual or auditory effects provided in response to the notification event.

[0272] In operation 1580, electronic device 100 may send instruction information or a screen displaying instructions to display device 200. Electronic device 100 may send instruction information to display device 200 according to the instruction, which may instruct the provision of visual or auditory effects to areas other than the mini-map area.

[0273] In operation 1590, the display device 200 can display a screen in the information display area that provides visual effects corresponding to the instructions.

[0274] According to embodiments of this disclosure, the electronic device 100 can store not only information about preset notification events, but also information about notification events added or edited based on user input. When running a game application, a user may want to add notification events or edit existing notification events according to his / her intentions. Therefore, the electronic device 100 can provide a graphical user interface for allowing users to edit or add notification events.

[0275] Figure 16 This is a reference diagram used to describe information about notification events that can be set according to user input, based on embodiments of the present disclosure.

[0276] refer to Figure 16 The electronic device 100 may include not only information about preset notification events, but also information about notification events based on user settings.

[0277] According to embodiments of this disclosure, electronic device 100 can provide a graphical user interface 1600 for allowing users to add or edit notification event information.

[0278] For example, refer to Figure 16Users can edit the item image and indication corresponding to notification event ID1. For example, when icon 1610 for selecting an item image is selected, electronic device 100 can output icon 1611 including multiple selectable item images. When icon 1620 for selecting a color is selected, electronic device 100 can output icon 1621 including multiple selectable colors. When icon 1630 for selecting text is selected, electronic device 100 can output icon 1631 including multiple selectable colors. When icon 1640 for selecting a sound is selected, electronic device 100 can output icon 1641 including multiple selectable items for sound. For example, in response to the first notification event ID1, a user can select a third item from icon 1611 as an item image, select red from icon 1621, select "enemy missing" as text from icon 1631, and select sound B from icon 1641, thereby setting the notification event information corresponding to notification event ID1. By providing a graphical user interface that allows editing of notification event information, users can change, edit, and use notification events according to their intentions.

[0279] The operation method of the electronic device according to embodiments of the present disclosure can be implemented as programming commands executable in various computer devices and then recorded on a computer-readable medium. Furthermore, embodiments of the present disclosure can be recorded on a computer-readable recording medium having one or more programs recorded thereon, including instructions for performing the operation method of the display device.

[0280] Computer-readable media may include one or more of programming commands, data files, data structures, etc. Programming commands recorded on a computer-readable recording medium may be specifically designed or configured for this disclosure, or may be well known to those skilled in the art. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as optical disc read-only memory (CD-ROM) and digital versatile discs (DVDs); magneto-optical media such as optical-magnetic floppy disks; read-only memory (ROM); random access memory (RAM); flash memory; etc., and may be specifically configured to store and execute programming commands. Examples of programming commands include not only machine code produced by a compiler, but also high-level language code executable in a computer using an interpreter.

[0281] Here, a machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" may mean that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), and may mean that data can be stored permanently or temporarily in the storage medium. For example, a "non-transitory storage medium" may include a buffer for temporarily storing data.

[0282] According to embodiments of this disclosure, methods according to various embodiments of this disclosure can be included and provided in a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., CD-ROM), or it can be distributed online (e.g., downloaded or uploaded) through an app store (e.g., Play Store™), or directly distributed between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) can be at least temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an app store's server, or a relay server.

Claims

1. An electronic device, comprising: Memory, storing at least one instruction; and At least one processor is configured to execute the at least one instruction. Wherein, the at least one instruction, when executed by the at least one processor, causes the electronic device to: Detect whether a notification event has occurred on the display screen showing the image, the notification event indicating that another user is trying to provide information to the user; Based on the detection that the notification event has occurred, an indication is obtained including at least one of a visual effect or an auditory effect corresponding to the notification event; and The instruction is provided to the user by using at least one of the information display area or the audio output unit.

2. The electronic device according to claim 1, wherein, When executed by the at least one processor, the electronic device also causes: Identify a predefined region in the image displayed on the display screen; and The notification event is detected based on the predefined region.

3. The electronic device according to claim 1 or 2, wherein, When executed by the at least one processor, the electronic device also causes: The predefined region is identified by receiving setting information of the predefined region from the user or by automatically detecting at least one of the predefined regions from the image.

4. The electronic device according to any one of claims 1 to 3, wherein, When executed by the at least one processor, the electronic device also causes: The notification event is detected by detecting the project image corresponding to the notification event in the predefined area based on one or more notification event information.

5. The electronic device according to any one of claims 1 to 4, wherein, The one or more notification event information includes: Identification information regarding the notification event; The project image corresponding to the notification event; and At least one of the visual effect or the auditory effect corresponding to the notification event.

6. The electronic device according to any one of claims 1 to 5, wherein, When executed by the at least one processor, the electronic device also causes: An instruction corresponding to the notification event is obtained by referring to the registration instructions corresponding to one or more notification event messages and the identification information about the notification event.

7. The electronic device according to any one of claims 1 to 6, wherein, The information display area includes a predetermined area of ​​the display screen where the image is not displayed, and The at least one instruction, when executed by the at least one processor, also causes the electronic device to provide the visual effect by using the predetermined area.

8. The electronic device according to any one of claims 1 to 7, wherein, The information display area includes a predetermined area in the display of an external display device, the external display device being configured to share and display at least a portion of the display screen displayed in the electronic device, and The at least one instruction, when executed by the at least one processor, also causes the electronic device to provide the visual effect by using the predetermined area in the display of the external display device.

9. The electronic device according to any one of claims 1 to 8, wherein, The at least portion of the display screen includes a mini-map area, and The predetermined area in the display of the external display device includes the area other than the area displaying the mini-map.

10. The electronic device according to any one of claims 1 to 9, wherein, When executed by the at least one processor, the electronic device also causes: Identify the first location in the game content where the notification event occurs; as well as Based on the first location where the notification event has occurred, a second location is determined where the instruction should be provided.

11. A method of operating an electronic device, the method comprising: Detect whether a notification event has occurred on the display screen showing the image, the notification event indicating that another user is trying to provide information to the user; Based on the detection that the notification event has occurred, an indication is obtained including at least one of a visual effect or an auditory effect corresponding to the notification event; as well as The instruction is provided to the user by using at least one of the information display area or the audio output unit.

12. The operating method according to claim 11, further comprising: Identify predefined regions in the image displayed on the display screen; as well as The notification event is detected based on the predefined region.

13. The operating method according to claim 11 or 12, further comprising: The predefined region is identified by receiving setting information of the predefined region from the user or by automatically detecting at least one of the predefined regions from the image.

14. The operating method according to any one of claims 11 to 13, further comprising: The notification event is detected by detecting the project image corresponding to the notification event in the predefined area based on one or more notification event information.

15. A non-transitory computer-readable storage medium storing one or more computer-executable instructions for causing a computer to perform a method of operating an electronic device, wherein the one or more computer-executable instructions, when executed by at least one processor of the electronic device, cause the electronic device to: Detect whether a notification event has occurred on the display screen showing the image, the notification event indicating that another user is trying to provide information to the user; Based on the detection that the notification event has occurred, an indication is obtained including at least one of a visual effect or an auditory effect corresponding to the notification event; as well as The instruction is provided to the user by using at least one of the information display area or the audio output unit.

Images