Electronic device and operation method thereof

The electronic device addresses the challenge of providing effective notification events during game content reproduction by detecting and conveying visual or auditory cues, thereby enhancing user satisfaction and teamwork in multiplayer games.

WO2025110798A1PCT designated stage expired Publication Date: 2025-05-30SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/018637
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-11-23
Filing Date
2024-11-22
Publication Date
2025-05-30

AI Technical Summary

Technical Problem

Existing display devices struggle to effectively provide notification events to users during game content reproduction, particularly in multiplayer games where timely cooperation is crucial.

Method used

An electronic device equipped with a processor that detects notification events on a display screen, obtains visual or auditory effects corresponding to these events, and provides them to the user through an information display area or audio output unit.

Benefits of technology

Enhances user satisfaction by effectively conveying important information during game play, improving teamwork and response times in multiplayer games.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024018637_30052025_PF_FP_ABST
    Figure KR2024018637_30052025_PF_FP_ABST
Patent Text Reader

Abstract

This electronic device detects, on a display screen on which an image is displayed, whether a notification event indicating information that a user intends to deliver to another user has occurred, acquires an indication including a visual effect and / or an auditory effect corresponding to the detected notification event according to the detection that the notification event has occurred, and uses an information display area and / or an audio output unit so as to provide the indication to the user.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device and method of operation thereof

[0001] The disclosed embodiments relate to a display device capable of playing content and a method of operating the same. Specifically, the disclosed embodiments relate to an electronic device capable of effectively providing notification events related to the playing of content and a method of operating the same.

[0002] Advances in display technology have led to the development of display devices capable of implementing a variety of functions. A prime example of a display device is the television. Conventional TVs simply received broadcast signals and played corresponding broadcast content (e.g., news, dramas, music programs, etc.).

[0003] Recent advancements in display technology have enabled TVs to store and install a variety of applications or programs to perform a variety of functions. These applications can provide a variety of functions and services beyond just broadcast content playback. For example, game applications can be stored and installed on a TV, allowing game content to be played.

[0004] As communication technologies or communication connection capabilities of display devices develop, display devices can now provide various functions or services through wired or wireless communication with external devices. For example, a display device can be connected to an external device, such as a game console, or a game server providing game content via wired or wireless communication, and can receive game content from the external device or game server via the aforementioned wired or wireless communication.

[0005] Meanwhile, game content may include multiplayer game content, where multiple users form a team and engage in gameplay with other teams. In this case, the multiple users forming a team need to cooperate with each other to progress through the game. Therefore, the game content or the display device that plays the game content may provide various means for the multiple users within the same team to cooperate.

[0006] According to one embodiment of the present disclosure, in providing game content through an electronic device, an electronic device capable of outputting a playback screen of game content in a manner that increases user satisfaction, a method of operating the electronic device, and a non-transitory computer-readable recording medium are provided.

[0007] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0008] According to one embodiment, an electronic device may include a memory storing at least one instruction; and at least one processor executing the at least one instruction. According to one embodiment, the at least one processor may execute the at least one instruction to detect whether a notification event indicating information that another user wishes to convey to the user has occurred on a display screen on which an image is displayed. According to one embodiment, the at least one processor may execute the at least one instruction to obtain an indication including at least one of a visual effect or an auditory effect corresponding to the detected notification event when it is detected that the notification event has occurred. According to one embodiment, the at least one processor may execute the at least one instruction to provide the indication to the user using at least one of an information display area or an audio output unit.

[0009] According to one embodiment, a method of operating an electronic device may include an operation of detecting whether a notification event indicating information that another user wishes to convey to the user has occurred on a display screen on which an image is displayed. According to one embodiment, the method of operating an electronic device may include an operation of acquiring an indication including at least one of a visual effect or an auditory effect corresponding to the detected notification event when the notification event is detected to have occurred. According to one embodiment, the method of operating an electronic device may include an operation of providing the indication to the user using at least one of an information display area or an audio output unit.

[0010] In one embodiment, a non-transitory computer-readable recording medium storing one or more instructions is provided, wherein the one or more instructions are executed by at least one processor of an electronic device, such that the electronic device detects whether a notification event indicating information that another user wants to convey to the user has occurred on a display screen on which an image is displayed, and, upon detection that the notification event has occurred, obtains an indication including at least one of a visual effect or an auditory effect corresponding to the detected notification event, and provides the indication to the user using at least one of an information display area or an audio output unit.

[0011] According to an embodiment of the present invention, an electronic device, a method of operating the electronic device, and a non-transitory computer-readable recording medium can effectively enhance the experience of a user playing game content using the electronic device.

[0012] The effects that can be obtained from the embodiments disclosed in this disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.

[0013] The present invention can be readily understood by the following detailed description and its accompanying drawings, wherein reference numerals refer to structural elements.

[0014] FIG. 1 is a reference diagram for explaining an example of displaying game content provided from a server device on multiple electronic devices according to one embodiment.

[0015] Figure 2 illustrates an example of a system according to one embodiment.

[0016] FIG. 3 is an example of a block diagram of an electronic device according to one embodiment.

[0017] FIG. 4 illustrates an example of a flowchart of a method of operating an electronic device according to one embodiment.

[0018] FIG. 5 illustrates an example of a flowchart of a method of operating an electronic device according to one embodiment.

[0019] FIG. 6 illustrates an example of a graphical user interface that allows selection or input of items for a notification event according to an example.

[0020] FIG. 7 illustrates an example of outputting screens of various aspect ratios in an electronic device according to one embodiment.

[0021] FIG. 8 is a reference diagram for explaining an example of sharing a minimap using the minimap sharing function according to one embodiment.

[0022] FIG. 9 illustrates an example of a flowchart of a process for detecting whether a notification event has occurred in an electronic device according to one embodiment.

[0023] FIG. 10 illustrates an example of a display screen of an electronic device 100 according to one embodiment.

[0024] Figure 11 illustrates an example of information for a notification event according to one embodiment.

[0025] Figure 12 illustrates an example of information for a notification event according to one embodiment.

[0026] FIG. 13 illustrates examples of black areas in which visual effects corresponding to notification events are displayed according to one embodiment.

[0027] FIG. 14 is a reference diagram for explaining an example of displaying a visual effect corresponding to a notification event in an electronic device on a display screen of a display device connected to the electronic device in communication according to one embodiment.

[0028] FIG. 15 illustrates an example of a flowchart of a method of operating an electronic device according to one embodiment.

[0029] FIG. 16 is a reference diagram for explaining information about a notification event that can be set according to user input according to one embodiment.

[0030] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings so that those skilled in the art can easily practice the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted to clearly explain the present invention, and similar parts are designated with similar reference numerals throughout the specification. In addition, throughout the drawings, the same reference numerals are assigned to the same components.

[0031] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the cases where the parts are "directly connected" but also the cases where the parts are "electrically connected" with other elements intervening. Furthermore, when a part is said to "include" a component, this does not exclude other components, but rather includes other components, unless otherwise stated.

[0032] The appearances of phrases such as “in some embodiments” or “in one embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment.

[0033] Some embodiments may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various hardware and / or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more processors or microprocessors, or by circuit configurations for performing the intended functions. Furthermore, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented by algorithms that execute on one or more processors. Furthermore, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and / or data processing. Terms such as modules and configurations may be used broadly and are not limited to mechanical and physical configurations.

[0034] Additionally, the connecting lines or connecting members between components depicted in the drawings are merely exemplary representations of functional connections and / or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that may be replaced or added.

[0035] In this disclosure, the expression “at least one of a, b or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “all of a, b and c”, or variations thereof.

[0036] In the disclosed embodiment, an electronic device may refer to any electronic device capable of receiving content from a source device and displaying a corresponding screen. Here, the content may be a game, lecture, movie, home training service content, etc.

[0037] Specifically, an electronic device according to an embodiment of the present disclosure may be any electronic device capable of selectively displaying at least one content, and may exist in various forms, such as a TV, a smart TV, a digital broadcasting terminal, a tablet PC, a smart phone, a mobile phone, a computer, a laptop, etc. In addition, the display device may be not only fixed, but also movable or portable.

[0038] FIG. 1 is a reference diagram for explaining an example of displaying game content provided from a server device on multiple electronic devices according to one embodiment.

[0039] Referring to FIG. 1, the server device 300 may execute a content application upon a request from the electronic device 100, and transmit a result screen according to the execution of the content application to the electronic device 100 via a communication network. For example, when the server device 300 receives a request to execute a game application from the electronic device 100, the server device 300 may execute the game application and transmit a result screen or result image rendered according to the execution of the game application to the electronic device 100 via a communication network.

[0040] In addition, if the game content is a type of game that multiple users can play as a team, the server device 300 can execute a content application upon request from multiple electronic devices and transmit an execution result screen according to the execution of the content application to the multiple electronic devices via a communication network. For example, if the server device 300 receives a request to execute a game application from the electronic device 100 and the electronic device 800, the server device 300 can execute the game application and transmit an execution result screen or a result image rendered according to the execution of the game application to the electronic device 100 and the electronic device 800 via a communication network.

[0041] The electronic device 100 can transmit a request for executing a content application to the server device 300, and according to the execution request, can receive an execution result screen according to the execution of the content application from the server device 300 and display the received execution result screen on the display. The user of the electronic device 100 can operate the input device 10 to control the execution screen displayed on the display of the electronic device 100. According to the user's operation, the input device 10 can transmit a control signal to the electronic device 100, and the electronic device 100 can transmit the control signal received from the input device 10 to the server device 300. The server device 300 can execute the content application based on the control signal received from the electronic device 100 and transmit the execution result screen to the electronic device 100. In addition, the server device 300 can also transmit the execution result screen to an electronic device 800 that is playing the same content application.

[0042] The electronic device 800 can transmit a request for executing a content application to the server device 300, and according to the execution request, can receive an execution result screen according to the execution of the content application from the server device 300 and display the received execution result screen on the display. The user of the electronic device 800 can operate the input device 20 to control the execution screen displayed on the display of the electronic device 800. According to the user's operation, the input device 20 can transmit a control signal to the electronic device 800, and the electronic device 800 can transmit the control signal received from the input device 20 to the server device 300. The server device 300 can execute the content application based on the control signal received from the electronic device 800 and transmit the execution result screen to the electronic device 100 and the electronic device 800. In addition, the server device 300 can also transmit the execution result screen to the electronic device 100 that is playing the same content application.

[0043] In this way, when electronic devices 100 and 800 play the same game content cooperatively, the users of electronic devices 100 and 800 can communicate with each other or provide notifications to each other for collaborative work. To provide notifications to multiple users playing the game content, the game content may provide means such as a minimap and notification events such as pings.

[0044] A minimap is a miniature map often placed in the corner of a video game screen to help players navigate the game world. It's a miniature map-like representation of the game's current location. The elements typically included in a minimap vary depending on the video game genre. Typically, a minimap can display the player's character's location (including allies and enemies), friendly units or structures, objectives, and surrounding terrain. The minimap can also provide visual alerts to indicate various game situations. System-defined alerts (such as attack notifications) can be displayed on the minimap, and players can also directly alert allies. This ability to alert allies directly can be referred to as a notification event, such as a ping. Pings are useful in urgent gameplay situations where chat input is limited, allowing allies to be notified with a single keypress or mouse click. Pings can be considered notification events in a game environment, allowing players to convey information to other players.

[0045] In the example of FIG. 1, the electronic device 100 and the electronic device 800 can each display a minimap 50 on their displays. And, for example, when a user of the electronic device 800 inputs an item for a notification event to provide a notification to a user of the electronic device 100, the input for the notification event input by the electronic device 800 can be displayed as a notification event 60 on the minimap 50 of the electronic device 100 and the electronic device 800. Using this method, the user of the electronic device 100 can receive a notification provided by the electronic device 800, which is an ally.

[0046] Notification Event 60 displayed on the minimap 50 can provide a useful means of notification between game users.

[0047] However, since the minimap itself is typically small in size as a miniature map, and the notification events displayed within such a minimap are also small in size, it may be difficult for the user to immediately identify them in urgent situations while playing a game. Therefore, the disclosed embodiments provide examples that enable the user to more effectively recognize the notification event 60 displayed within the minimap 50.

[0048] According to one embodiment, the electronic device 100 may be configured to detect whether a notification event indicating information that another game player wishes to convey has occurred in game content displayed on the display. According to one embodiment, the electronic device 100 may detect the notification event from a minimap. According to one embodiment, the electronic device 100 may detect the minimap from a designated area based on a user input or may automatically detect the minimap.

[0049] According to one embodiment, the electronic device 100 may be configured to identify attributes of a detected notification event when a notification event occurs. According to one embodiment, the electronic device 100 may store attributes of one or more notification events, and may identify attributes of a detected notification event among the attributes of the stored notification events. According to one embodiment, the electronic device 100 may store one or more notification events. The one or more notification events may include a notification event set by default in the electronic device 100 and a notification event specified by a user.

[0050] According to one embodiment, the electronic device 100 may be configured to obtain an indication including at least one visual or auditory effect corresponding to an attribute of an identified notification event. For example, the visual effect may include various visual effects such as color, blinking, and text.

[0051] According to one embodiment, the electronic device 100 may be configured to provide an indication using at least one of an information display area or an audio output unit. According to one embodiment, the electronic device 100 may use a black area on the display screen where game content is not displayed as the information display area. According to one embodiment, when a mini-map is displayed on an external display device, the electronic device 100 may use at least a portion of the display screen of the external display device as the information display area.

[0052] Figure 2 illustrates an example of a system according to one embodiment.

[0053] Referring to FIG. 2, the system may include an electronic device 100 for displaying content, a display device 200 for sharing at least a portion of the content displayed on the electronic device 100, a server 300, and an input device 10 for controlling the electronic device 100.

[0054] The electronic device 100 can output or display content received from the server device 300. The electronic device 100 may include various types of electronic devices capable of receiving and outputting content, such as a network TV, a smart TV, an Internet TV, a web TV, an IPTV, a PC, etc. The electronic device 100 may be referred to as a display device in terms of receiving and displaying content, and may also be referred to as a content receiving device, a sink device, a computing device, etc.

[0055] The electronic device 100 can be connected to the display device 200 via a wired or wireless communication network.

[0056] The electronic device 100 and the display device 200 can transmit and receive content by being connected via a wired connection means to form a wired network. For example, the wired connection means may include a cable, and the electronic device 100 and the display device 200 may each include one or more ports for cable connection. The one or more ports may include a digital input interface, such as an HDMI port, a DisplayPort, or a Type-C port.

[0057] The electronic device 100 and the display device 200 can transmit and receive content by being connected via a wireless connection means for forming a wireless network. For example, the wireless connection means may include a wireless HDMI communication module, and each of the electronic device 100 and the display device 200 may include a wireless HDMI communication module. As another example, the wireless connection means may include at least one communication module that performs communication according to a communication standard such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, ZIGBEE, Internet, 3G, 4G, 5G, and / or 6G.

[0058] The electronic device 100 is a device that can display images or data according to a user's request, and may include a communication interface 110, a display 120, a memory 130, and a processor 140.

[0059] The communication interface 110 may perform communication with at least one external device. Here, 'communication' may mean an operation of transmitting and / or receiving data, signals, requests, and / or commands.

[0060] The communication interface 110 can perform wired or wireless communication with at least one external device. The external device may be a display device 200, a server device 300, or an input device 10.

[0061] For example, the communication interface 110 may include at least one of a communication module, a communication circuit, a communication device, an input / output port, and an input / output plug for performing wired or wireless communication with at least one external device.

[0062] For example, the communication interface 110 may include at least one wireless communication module, wireless communication circuit, or wireless communication device that performs wireless communication with at least one external device.

[0063] For example, the communication interface 110 may include a short-range communication module, such as an IR (infrared) communication module, capable of receiving control commands from a remote controller located in close proximity, such as an input device 10. In this case, the communication interface 110 may receive a control signal from the remote controller.

[0064] As another example, the communication interface 110 may include at least one communication module that performs communication according to a wireless communication standard such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, or ZIGBEE. Alternatively, the communication interface 110 may further include a communication module that performs communication with a server to support long-distance communication according to a long-distance communication standard. For example, the communication interface 110 may include a communication module that performs communication through a network for Internet communication. In addition, the communication interface 110 may include a communication module that performs communication through a communication network according to a communication standard such as 3G, 4G, 5G, and / or 6G.

[0065] As another example, the communication interface 110 may include at least one port for connecting to an external device via a wired cable in order to communicate with the external device via a wired connection. For example, the communication interface 110 may include at least one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, and a USB port. Accordingly, the communication interface 110 may communicate with a wired external device through at least one port. Here, the port may refer to a physical device configuration into which a cable, communication line, or plug can be connected or inserted.

[0066] As described above, the communication interface 110 may include at least one support element for supporting communication between the electronic device 100 and an external device. Here, the support element may include the communication module, the communication circuit, the communication device, the port (for input / output of data), the cable port (for input / output of data), the plug (for input / output of data), etc., as described above. For example, the at least one support element included in the communication interface 110 may include an Ethernet communication module, a Wi-Fi communication module, a Bluetooth communication module, an IR communication module, a USB port, a tuner (or a broadcast receiver), an HDMI port, a DP (display port), a DVI (digital visual interface) port, etc.

[0067] The display 120 can output an image to the screen under the control of the processor 140. For example, the processor 140 can control the display 120 so that an intended image is output to the display 120.

[0068] The display 120 outputs an image onto a screen. For example, the display 120 may output an image corresponding to the video data through an internally included display panel so that a user can visually recognize the video data. Specifically, the video data forming the content may include a plurality of frame images, and the display 120 may play the video content by sequentially displaying the plurality of frame images under the control of the processor 140. For example, the display 120 may output a content image corresponding to the video content onto a screen under the control of the processor 140.

[0069] The display 120 is depicted as being arranged within the electronic device 100, but is not limited thereto. The display 120 may also be arranged externally to the electronic device 100 and connected to the electronic device 100 via wired or wireless communication.

[0070] Memory 130 may store at least one instruction, data, information, and / or application. For example, memory 130 may store at least one instruction to be executed by processor 140. For example, memory 130 may store at least one program to be executed by processor 140. For example, memory 130 may store an application for providing a certain service.

[0071] The memory 130 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0072] The processor 140 may control the execution of at least one instruction to perform an intended operation. Here, the at least one instruction may be stored in an internal memory included in the processor 140 or in a memory 130 included in the electronic device 100 separately from the processor 140.

[0073] The processor 140 can control at least one component included in the electronic device 100 to perform an intended operation by executing at least one instruction. Accordingly, even if an example is given of the processor 140 performing predetermined operations, this may mean that the processor 140 controls at least one component included in the electronic device 100 to perform the predetermined operations.

[0074] In addition, although the processor 140 is described and illustrated as an example of being formed as a single processor, it may also be formed in a form including multiple processors.

[0075] For example, the processor 140 may include a RAM that stores signals or data input from the outside of the electronic device 100, a storage area corresponding to various tasks performed in the electronic device 100, a control program for controlling the electronic device 100, an application for providing a predetermined function or service, and / or a ROM that stores a plurality of instructions, and at least one processor. The processor 140 may include a graphics processor (Graphics Processing Unit) for graphics processing corresponding to video. The processor 140 may be implemented as a SoC (System On Chip) that integrates a core and a GPU. In addition, the processor 140 may include multiple cores more than a single core. For example, the processor 140 may include a dual core, a triple core, a quad core, a hexa core, an octa core, a deca core, a dodeca core, a hexa decimal core, etc.

[0076] Processor 140 may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits, including at least one processor. At least one processor, one or more processors may be configured to perform various functions described herein, individually and / or collectively, in a distributed fashion. As used herein, “processor,” “at least one processor,” and “one or more processors” may be configured to perform various functions. However, these terms encompass, for example, but not limited to, situations where one processor performs some of the functions and other processor(s) perform other parts of the functions, and situations where a single processor may perform all of the functions. Furthermore, the at least one processor may include a combination of processors that perform various of the disclosed functions in a distributed manner. The at least one processor may execute program instructions to achieve or perform various functions.

[0077] In an embodiment of the present disclosure, the processor 140 may store one or more instructions in an internally provided memory, and may control the operations of the electronic device 100 to be performed by executing one or more instructions stored in the internally provided memory. That is, the processor 140 may perform a predetermined operation by executing at least one instruction or program stored in an internal memory or memory 130 provided within the processor 140.

[0078] According to one embodiment, the processor 140 may control the communication interface 110 to transmit an execution request of a content application to the server device 300 by executing one or more instructions stored in the memory 130, and to receive an execution result screen obtained by executing the content application from the server device 300.

[0079] According to one embodiment, the processor 140 may control the display 120 to display a content execution result screen received from the server device 300 by executing one or more instructions stored in the memory 130.

[0080] According to one embodiment, the processor 140 may detect whether a notification event indicating information that another user wishes to convey has occurred on a display screen on which an image is displayed, by executing one or more instructions stored in the memory 130.

[0081] According to one embodiment, the processor 140 may obtain an indication including at least one of a visual effect or an auditory effect corresponding to the detected notification event by executing one or more instructions stored in the memory 130 when the notification event is detected to have occurred.

[0082] According to one embodiment, the processor 140 can identify a pre-designated area from an image displayed on the display by executing one or more instructions stored in the memory 130.

[0083] According to one embodiment, the processor 140 may detect the notification event from the identified pre-designated region by executing one or more instructions stored in the memory 130.

[0084] According to one embodiment, the processor 140 may identify the pre-designated area using information set based on a user input setting the pre-designated area by executing one or more instructions stored in the memory 130, or may automatically detect the pre-designated area in the image.

[0085] According to one embodiment, the processor 140 may detect a notification event by executing one or more instructions stored in the memory 130, thereby detecting an item image corresponding to the notification event from the pre-designated area using information about one or more notification events.

[0086] According to one embodiment, the information about the one or more notification events may include identification information for each notification event, an item image corresponding to each notification event, and a visual effect or auditory effect corresponding to each notification event.

[0087] According to one embodiment, the processor 140 may obtain an indication corresponding to the identified notification event by referencing identification information of one or more notification events and an indication registered corresponding to the identification information of each notification event by executing one or more instructions stored in the memory 130.

[0088] According to one embodiment, the processor 140 may provide the visual effect by using a predetermined area on the display screen where the image is not displayed, by executing one or more instructions stored in the memory 130.

[0089] According to one embodiment, the information display area includes a predetermined area on the display of an external display device that displays at least a portion of the display screen displayed on the electronic device, and according to one embodiment, the processor 140 can provide the visual effect by using the predetermined area on the display of the external display device by executing one or more instructions stored in the memory 130.

[0090] According to one embodiment, at least a portion of the shared screen may include a minimap area, and the predetermined area on the display of the external display device may include an area excluding an area where the minimap area is displayed.

[0091] According to one embodiment, the processor 140 may identify a location in the game content where the notification event occurred by executing one or more instructions stored in the memory 130, and determine a location where the indication is provided based on the location where the notification event occurred.

[0092] The electronic device 100 may be any type of device that performs a function, including a processor and memory. The electronic device 100 may be a fixed or portable device. For example, the electronic device 100 may be a device that has a display and can display image content, video content, game content, graphic content, etc. The electronic device 100 may output or display images or content received from the server device 300. The electronic device 100 may include various types of electronic devices that can receive and output content, such as televisions such as network TVs, smart TVs, Internet TVs, web TVs, and IPTVs; computers such as desktops, laptops, and tablets; smartphones, cellular phones, game players, music players, video players, medical equipment, home appliances, and various other smart devices. The electronic device 100 may be referred to as a display device in that it receives and displays content, and may also be referred to as a content receiving device, a sink device, a computing device, etc.

[0093] The block diagram of the electronic device 100 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the electronic device 100 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0094] Now let's describe the display device 200.

[0095] The display device 200 can output or display content received from the electronic device 100. The display device 200 can be connected to the electronic device 100 using wired or wireless communication technology, and can receive and display at least a portion of the content displayed on the electronic device 100. For example, the display device 200 can receive and display a mini-map, which is at least a portion of the content execution result screen displayed on the display of the electronic device 100, from the electronic device 100.

[0096] The display device 200 is a device that can display images or data according to a user's request, and may include a communication interface 210, a display 220, a memory 230, and a processor 240.

[0097] The communication interface 210 may include one or more modules that enable wired or wireless communication between the electronic device 100 and the display device 200.

[0098] According to one embodiment, the communication interface 210 may receive content to be shared from the electronic device 100 by performing communication with the electronic device 100 using wired or wireless communication technology. The wireless communication technology may include short-range communication technology. The short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, infrared communication, etc.

[0099] The display 220 can output images or data processed by the electronic device 100. In one example, the display 200 can receive a minimap area from the electronic device 100 and display the minimap area.

[0100] Memory 230 can store a program for processing and controlling the processor 240, and can store data input to or output from the display device 200. In addition, memory 230 can store data necessary for the operation of the display device 200.

[0101] The memory 230 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0102] The processor 240 controls the overall operation of the display device 200. For example, the processor 240 may perform the functions of the display device 200 described in the present disclosure by executing one or more instructions stored in the memory 230.

[0103] In an embodiment of the present disclosure, the processor 240 may store one or more instructions in an internally provided memory, and may control the operations of the display device 200 to be performed by executing one or more instructions stored in the internally provided memory. That is, the processor 240 may perform a predetermined operation by executing at least one instruction or program stored in an internal memory or memory 230 provided within the processor 240.

[0104] According to one embodiment, the processor 240 may communicate with the electronic device 100 by executing one or more instructions stored in the memory 230, thereby establishing a wireless or wired communication connection with the electronic device 100.

[0105] According to one embodiment, the processor 240 may receive at least a portion of a content screen displayed on the display of the electronic device 100 and display at least a portion of the received content screen by executing one or more instructions stored in the memory 230. For example, at least a portion of the content screen received from the electronic device 100 may include a minimap area displayed in game content.

[0106] According to one embodiment, the processor 240 may provide at least one of a visual effect and an auditory effect corresponding to a notification event to at least a portion of the screen based on a signal received from the electronic device 100 while displaying the minimap area received from the electronic device 100 by executing one or more instructions stored in the memory 230. The at least portion of the screen where the visual effect corresponding to the notification event is provided may include a black area where the minimap area is not displayed.

[0107] The display device 200 may be any type of device that performs a function, including a processor and memory. The display device 200 may be a fixed or portable device. For example, the display device 200 may refer to a device that has a display and can display image content, video content, game content, graphic content, etc. The display device 200 may include various types of electronic devices that can receive and output content, such as televisions such as network TVs, smart TVs, Internet TVs, web TVs, and IPTVs; computers such as desktops, laptops, and tablets; smart phones, cellular phones, game players, music players, video players, medical equipment, home appliances, and various other smart devices. The display device 200 may be referred to as a display device in that it receives and displays content, and may also be referred to as a content receiving device, a sync device, an electronic device, a computing device, etc.

[0108] The block diagram of the display device 200 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the display device 200 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0109] Now let's describe server device 300.

[0110] The server device 300 can provide content such as video and audio to the electronic device 100. The server device 300 can include various types of electronic devices that can provide content to the electronic device 100. The server device 300 can be referred to as a source device in terms of providing content, and can also be referred to as a host device, a content providing device, an electronic device, a storage device, a computing device, a server computer, etc.

[0111] The server device 300 may include a communication interface 310, memory 320, and a processor 330. However, the server device 300 may be implemented with more components than those illustrated, and is not limited to the examples described above. For example, the server device 300 may include a separate image processing unit for image processing of application images executed on the server device 300.

[0112] The communication interface 310 may include one or more modules that enable wireless communication between the server device 300 and the electronic device 100. In one embodiment, the communication interface 310 may communicate with the electronic device 100 according to an Internet protocol. In one embodiment, the communication interface 310 may communicate with the input device 10 according to an Internet protocol.

[0113] The memory 320 can store a program for processing and controlling the processor 330, and can store data input to or output from the server device 300.

[0114] The memory 320 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0115] The processor 330 controls the overall operation of the server device 300. For example, the processor 330 may perform the functions of the server device 300 described in the present disclosure by executing one or more instructions stored in the memory 320.

[0116] In an embodiment of the present disclosure, the processor 330 can store one or more instructions in an internally provided memory, and control the execution of the one or more instructions stored in the internally provided memory so that the aforementioned operations are performed. That is, the processor 330 can perform a predetermined operation by executing at least one instruction or program stored in an internal memory provided within the processor 330 or in the memory 320.

[0117] According to one embodiment, the processor 330 may receive a request to execute a content application from the electronic device 100 by executing one or more instructions stored in the memory 320, and transmit an execution result screen of the requested content application to the electronic device 100.

[0118] The block diagram of the server device 300 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the server device 300 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0119] Now let's describe input device 10.

[0120] The input device 10 may include a communication interface 11, a user input unit 12, memory 13, and a processor 14. However, the input device 10 may be implemented by more components than the illustrated components and is not limited to the examples described above.

[0121] The communication interface 11 may include one or more modules that enable wired or wireless communication between the input device 10 and the electronic device 100. According to one embodiment, the communication interface 11 may perform communication with the electronic device 100 according to a short-range communication technology. The short-range communication technology may include, for example, Bluetooth communication, Wi-Fi communication, infrared communication, etc. According to one embodiment, the communication interface 11 may perform communication with the server device 300 according to an Internet protocol.

[0122] The user input unit 12 may be any form of interface means capable of receiving user input. For example, the user input unit 12 may include an operation button arranged on a part of the input device 10 capable of receiving user input, a touch-sensitive display configured to detect touch input, a microphone capable of receiving user voice input, etc.

[0123] According to one embodiment, the user input unit 12 may receive user input for controlling a game content execution result screen displayed on the display of the electronic device 100 based on the control of the processor 14.

[0124] Memory 13 can store a program for processing and controlling the processor 14, and can store data input to or output from the input device 10.

[0125] Memory 13 may include at least one type of storage medium among flash memory type, hard disk type, multimedia card micro type, card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, and optical disk.

[0126] Processor 14 controls the overall operation of input device 10. For example, processor 14 may perform the functions of input device 10 described in the present disclosure by executing one or more instructions stored in memory 13.

[0127] In an embodiment of the present disclosure, the processor 14 can store one or more instructions in an internally provided memory, and control the execution of the one or more instructions stored in the internally provided memory so that the aforementioned operations are performed. That is, the processor 14 can perform a predetermined operation by executing at least one instruction or program stored in an internal memory or memory 13 provided within the processor 14.

[0128] According to one embodiment, the processor 14 may perform a communication connection with the electronic device 100 using a short-range wireless communication technology by executing one or more instructions stored in the memory 13. The short-range wireless communication technology may include Bluetooth communication technology, Wi-Fi Direct technology, infrared communication technology, and the like.

[0129] According to one embodiment, the processor 14 may control the communication interface 11 to transmit a control signal corresponding to a user input received through the user input unit 12 to the electronic device 100 by executing one or more instructions stored in the memory 13.

[0130] Input device 10 may be any type of device that performs a function, including a processor and memory. Input device 10 may include various electronic devices, such as a remote controller, a game controller, or a smartphone.

[0131] Meanwhile, the block diagram of the input device 10 illustrated in FIG. 2 is a block diagram for one embodiment. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the input device 10 actually implemented. For example, two or more components may be combined into one component, or one component may be subdivided into two or more components, as needed. In addition, the functions performed by each block are for the purpose of explaining embodiments, and the specific operations or devices thereof do not limit the scope of the present invention.

[0132] FIG. 3 is an example of a block diagram of an electronic device according to one embodiment.

[0133] Referring to FIG. 3, the electronic device 100 may include, in addition to a communication interface 110, a display 120, a memory 130, and a processor 140, an image processing unit 150, an audio processing unit 160, an audio output unit 170, a receiving unit 180, and a detection unit 190.

[0134] The communication interface 110 may include one or more modules that enable wireless communication between the electronic device 100 and a wireless communication system or between the electronic device 100 and a network in which another electronic device is located. For example, the communication interface 110 may include a mobile communication module 111, a wireless Internet module 112, and a short-range communication module 113.

[0135] The mobile communication module 111 transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signals may include various types of data, such as voice call signals, video call signals, or text / multimedia message transmission and reception.

[0136] The wireless Internet module 112 refers to a module for wireless Internet access, which may be built into or external to the device. Wireless Internet technologies that may be used include WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), and HSDPA (High Speed ​​Downlink Packet Access). Through the wireless Internet module 112, the electronic device 100 can establish a Wi-Fi P2P (Peer to Peer) connection with other devices.

[0137] Short-range communication module 113 refers to a module for short-range communication. Short-range communication technologies that can be used include Bluetooth, BLE (Bluetooth Low Energy), RFID (Radio Frequency Identification), IrDA (Infrared Data Association), UWB (Ultra Wideband), and ZigBee.

[0138] The display 120 can display a video signal received from the server device 300 on the screen.

[0139] Memory 130 can store programs related to the operation of the electronic device 100 and various data generated during the operation of the electronic device 100.

[0140] Memory 130 can store at least one instruction. Additionally, memory 140 can store at least one program executed by processor 150. Additionally, memory 150 can store an application for providing a specific service.

[0141] Specifically, the memory 130 may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0142] The processor 140 controls the overall operation of the electronic device 100. For example, the processor 140 may perform the functions of the electronic device 100 described in the present disclosure by executing one or more instructions stored in the memory 130.

[0143] In an embodiment of the present disclosure, the processor 140 can store one or more instructions in an internally provided memory, and control the execution of operations of the display device by executing one or more instructions stored in the internally provided memory. That is, the processor 140 can perform a predetermined operation by executing at least one instruction or program stored in the internal memory or memory 130 provided within the processor 140.

[0144] The processor 140 controls the overall operation of the electronic device 100 and the signal flow between internal components (not shown) of the electronic device 100, and performs the function of processing data. When there is a user input or a preset and stored condition is satisfied, the processor 140 can execute the OS (Operating System) stored in the memory 130 and various applications.

[0145] Processor 140 may include a graphic processor (Graphic Processing Unit) for graphics processing corresponding to video. The graphic processor generates a screen including various objects such as icons, images, and text using a calculation unit and a rendering unit. The calculation unit uses user interactions detected by the detection unit to calculate attribute values ​​such as coordinate values, shape, size, and color for each object to be displayed according to the screen layout. The rendering unit generates a screen including various layouts of objects based on the attribute values ​​calculated by the calculation unit.

[0146] According to one embodiment, the processor 140 may be configured to detect whether a notification event indicating information that another user wishes to convey has occurred on a display screen on which an image is displayed, by executing at least one instruction stored in the memory 130.

[0147] According to one embodiment, the processor 140 may be configured to obtain an indication including at least one of a visual effect or an auditory effect corresponding to the detected notification event by executing at least one instruction stored in the memory 130, upon detecting that a notification event has occurred.

[0148] According to one embodiment, the processor 140 may be configured to provide the indication using at least one of the information display area or the audio output by executing at least one instruction stored in the memory 130.

[0149] According to one embodiment, the processor 140 may be configured to identify a pre-designated area from an image displayed on the display and detect the notification event from the identified pre-designated area by executing at least one instruction stored in the memory 130.

[0150] According to one embodiment, the processor 140 may be configured to identify the pre-designated area using information set based on a user input setting the pre-designated area, or to automatically detect the pre-designated area in the image, by executing at least one instruction stored in the memory 130.

[0151] According to one embodiment, the processor 140 may be configured to detect a notification event by executing at least one instruction stored in the memory 130, thereby detecting an item image corresponding to the notification event from the pre-designated area using information about one or more notification events. The information about one or more notification events may include identification information for each notification event, an item image corresponding to each notification event, and a visual effect or an auditory effect corresponding to each notification event.

[0152] According to one embodiment, the processor 140 may be configured to obtain an indication corresponding to the identified notification event by referencing identification information of one or more notification events and an indication registered corresponding to the identification information of each notification event, by executing at least one instruction stored in the memory 130.

[0153] According to one embodiment, the processor 140 may be configured to provide the visual effect by using an information display area on the display screen where the image is not displayed, by executing at least one instruction stored in the memory 130.

[0154] The above information display area may include a predetermined area on the display of an external display device that displays at least a portion of the display screen displayed on the electronic device, and may be configured to provide the visual effect by using a predetermined area on the display of the external display device where the image is not displayed on the display screen. At least a portion of the shared screen includes a minimap area, and the predetermined area on the display of the external display device includes an area excluding the area where the minimap area is displayed.

[0155] According to one embodiment, the processor 140 may be configured to identify a location in the game content where the notification event occurred by executing at least one instruction stored in the memory 130, and determine a location where the indication is provided based on the location where the notification event occurred.

[0156] The image processing unit 150 can process an image signal received from the receiving unit 110 or the communication interface 110 under the control of the processor 140 and output it to the display 130.

[0157] The audio processing unit 160 can convert an audio signal received from the receiving unit 110 or the communication interface 110 into an analog audio signal and output it to the audio output unit 180 under the control of the processor 140.

[0158] The audio output unit 170 can output audio (e.g., voice, sound) input through the communication interface 110 or the receiver 180. In addition, the audio output unit 170 can output audio stored in the memory 130 under the control of the processor 140. The audio output unit 170 can include at least one of a speaker, a headphone output terminal, or an S / PDIF (Sony / Philips Digital Interface:) output terminal, or a combination thereof.

[0159] The receiving unit 180 can receive video (e.g., moving images, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from the outside of the electronic device 100 under the control of the processor 140. The receiving unit 180 may include one of an HDMI port (High-Definition Multimedia Interface port, 181), a component jack (component jack, 182), a PC port (PC port, 183), and a USB port (USB port, 184), or a combination of one or more thereof. In addition to the HDMI port, the receiving unit 180 may further include a DisplayPort (DP), Thunderbolt, or MHL (Mobile High-Definition Link).

[0160] The detection unit 190 detects the user's voice, the user's image, or the user's interaction, and may include a microphone 191, a camera 192, and an optical receiver 193.

[0161] Microphone 191 receives the user's spoken voice. Microphone 191 can convert the received voice into an electrical signal and output it to processor 140. The user's voice may include, for example, a voice corresponding to a menu or function of electronic device 100.

[0162] Camera 192 can receive images (e.g., consecutive frames) corresponding to a user's motion, including a gesture, within the camera's recognition range. Processor 140 can use the recognition results of the received motion to select a menu displayed on the electronic device 100 or perform a control corresponding to the motion recognition results.

[0163] The optical receiver 193 receives an optical signal (including a control signal) from an external control device. The optical receiver 193 can receive an optical signal corresponding to a user input (e.g., touch, pressing, touch gesture, voice, or motion) from the control device. A control signal can be extracted from the received optical signal under the control of the processor 140.

[0164] FIG. 4 illustrates an example of a flowchart of a method of operating an electronic device according to one embodiment.

[0165] Referring to FIG. 4, in operation 410, the electronic device 100 can detect whether a notification event indicating information that another game player wants to convey has occurred on a game execution result screen displayed on a display.

[0166] According to one embodiment, the electronic device 100 may transmit a request to execute a game application to the server device 300, and may receive an execution result screen of the game application executed in response to the request from the server device 300 and display the screen on the display.

[0167] According to one embodiment, the electronic device 100 can detect whether a notification event indicating information intended to be conveyed by another game player has occurred on the game execution result screen by analyzing an image corresponding to the execution result screen displayed on the display. The notification event indicating information intended to be conveyed by another game player may include, for example, a ping displayed on a minimap.

[0168] According to one embodiment, the electronic device 100 can identify a predetermined area in an image corresponding to the execution result screen and detect whether a notification event has occurred from the identified predetermined area. For example, the predetermined area may include a minimap area that displays information related to the progress of game content.

[0169] According to one embodiment, the electronic device 100 can receive settings for a predetermined area according to a user input, and identify the predetermined area set according to the user input in an image corresponding to the execution result screen.

[0170] According to one embodiment, the electronic device 100 can automatically identify a predetermined area by analyzing an image corresponding to an execution result screen.

[0171] In operation 420, the electronic device 100 may identify identification information of the detected notification event upon detecting that a notification event has occurred.

[0172] According to one embodiment, the electronic device 100 may store information about one or more notification events.

[0173] In one embodiment, information about one or more notification events may include an identifier for each notification event and an indication corresponding to each notification event. The indication corresponding to each notification event may include at least one visual or auditory effect to be provided in response to each notification event. For example, the visual effect may include color, blinking, text, etc.

[0174] In operation 430, the electronic device 100 may obtain an indication including at least one of a visual effect or an auditory effect corresponding to the identification information of the identified notification event.

[0175] In operation 440, the electronic device 100 may provide an indication using at least one of an information display area or an audio output.

[0176] According to one embodiment, the electronic device 100 may provide visual effects included in an indication using an information display area or may provide auditory effects included in an indication using an audio output unit. The information display area may include a black area as an area not used for displaying game content in the electronic device 100.

[0177] According to one embodiment, the electronic device 100 may provide a visual effect included in an indication using an information display area of ​​a display screen of the electronic device 100.

[0178] According to one embodiment, the electronic device 100 may provide a visual effect included in an indication by using an information display area of ​​a display screen of a display device that is communicatively connected to the electronic device 100. For example, the electronic device 100 may communicate with the display device to share a minimap area, thereby causing the minimap area to be displayed on the display device. In addition, the electronic device 100 may transmit information about an indication or information about a visual effect to the display device so that the visual effect included in the indication can be provided by using the information display area of ​​the display screen of the display device. The information display area of ​​the display screen of the display device may include an area on the display screen of the display device where the minimap area is not displayed, i.e., a black area.

[0179] FIG. 5 illustrates an example of a flowchart of a method of operating an electronic device according to one embodiment.

[0180] Referring to FIG. 5, in operation 501, a user of an electronic device 100 may perform an operation requesting execution of a game application using an input device 10, and accordingly, the input device 10 may transmit an input requesting execution of the game application to the electronic device 100.

[0181] In operation 502, the electronic device 100 may transmit a game application execution request received from the input device 10 to the server device 300.

[0182] In operation 503, a user of the electronic device 800 may perform an operation requesting execution of a game application using the input device 20, and accordingly, the input device 20 may transmit an input requesting execution of the game application to the electronic device 800.

[0183] In operation 504, the electronic device 800 may transmit a game application execution request received from the input device 20 to the server device 300.

[0184] In operation 505, the server device 300 can execute a game application requested to be executed from the electronic device 100. The game application requested to be executed from the electronic device 100 and the game application requested to be executed from the electronic device 800 may be the same game application.

[0185] In operation 506, the server device 300 can transmit a game execution result screen of the game application to the electronic device 100.

[0186] In operation 507, the electronic device 100 can display a game application execution result screen received from the server device 300.

[0187] In operation 508, the server device 300 can transmit a game execution result screen of the game application to the electronic device 800.

[0188] In operation 509, the electronic device 800 can display a game application execution result screen received from the server device 300.

[0189] In operation 510, electronic devices 100 and 800 can perform game play operations via server device 300. Electronic devices 100 and 800 play the same game application, and users of electronic device 100 and users of electronic device 800 can form the same team, i.e., allies.

[0190] In the game play operation 510, the server device 300 may execute the game application according to an input for controlling execution of the game application from either the input device 10 of the electronic device 100 or the input device 20 of the electronic device 800, and transmit a game execution result screen to the electronic device 100 and the electronic device 800. For example, when an input for controlling execution of the game application is transmitted from the input device 10 of the electronic device 100 to the electronic device 100, the electronic device 100 may transmit a control signal corresponding to the execution control input to the server device 300. The server device 300 may execute the game application based on the received control signal and transmit the game execution result screen to the electronic device 100 and the electronic device 800. Then, the electronic device 100 and the electronic device 800 may each display the game execution result screen received from the server device 300. In this way, while the users of electronic device 100 and electronic device 800 form a single team and play a game, the users of electronic device 100 and electronic device 800 can share information or provide notifications to each other to facilitate efficient gameplay. Notification events can be used for this purpose.

[0191] In operation 511, a user of the electronic device 800 may input an item for a notification event using an input device 20. For example, the electronic device 800 may provide a graphical user interface for inputting an item for a notification event, and the user of the electronic device 800 may input the notification event using the graphical user interface.

[0192] FIG. 6 illustrates an example of a graphical user interface that allows selection or input of items for a notification event according to an example.

[0193] Referring to FIG. 6, the graphical user interface 600 may include five items, a first item 610, a second item 620, a third item 630, a fourth item 640, and a fifth item 650. The first item 610 may indicate a message indicating that attention is required, the second item 620 may indicate a message indicating that assistance is required, the third item 630 may indicate a message indicating that an attack is imminent, the fourth item 640 may indicate a message indicating that a target is present, and the fifth item 650 may indicate a message indicating that defense is required.

[0194] If you want to alert or notify other game players on the same team, you can generate a notification event by selecting an item from one of the graphical user interfaces 600. For example, a user of an electronic device 800 can use input device 20 to select an item from one of the graphical user interfaces 600 at a desired location within the game space. Then, input device 10 can transmit an input to the electronic device 800 to select an item for a notification event.

[0195] At operation 512, the electronic device 800 may transmit a signal corresponding to an input for selecting one item for a notification event, received from the input device 20, to the server device 300.

[0196] In operation 513, the server device 300 may display a notification event corresponding to an item selected by the electronic device 800 on the minimap according to a signal received from the electronic device 800.

[0197] In operation 514, the server device 300 transmits a game screen including a minimap on which a notification event is displayed to the electronic device 800, and in operation 515, the electronic device 800 can display a game screen including a minimap on which a notification event is displayed.

[0198] In operation 516, the server device 300 transmits a game screen including a minimap displaying a notification event to the electronic device 100, and in operation 517, the electronic device 100 can display the game screen including the minimap displaying the notification event. The electronic device 100 can display game screens of various aspect ratios.

[0199] Referring to FIG. 7, images displayed on an electronic device that supports output of various aspect ratios are described.

[0200] FIG. 7 illustrates an example of outputting screens of various aspect ratios in an electronic device according to one embodiment.

[0201] The electronic device 100 according to the disclosed embodiment can support the output of a screen having multiple aspect ratios. Here, the aspect ratio represents the ratio of the vertical length to the horizontal length of the screen, and can be expressed as values ​​such as 4:3, 16:9, 16:10, 21:9, and 32:9. In addition, since the aspect ratio represents the ratio of the width and height of the output screen or image, it can also be referred to as a 'screen ratio', 'image ratio', etc. The aspect ratio of the screen can be optimized according to the type of input image. For example, an aspect ratio that increases user satisfaction can be selected according to the type of image output through the screen. For example, an aspect ratio of 16:9 is the most commonly used screen ratio, and can be used for outputting menu screens, work screens, etc. As another example, an aspect ratio of 21:9 can be used when more information is to be provided on the screen in the left-right direction (or, horizontal direction), such as when watching a movie or playing a game. As another example, an aspect ratio of 32:9 can be used to output images that provide or are intended to provide a wide field of view. Specifically, the aspect ratio of 32:9 can be widely used in games that provide 360-degree images or panoramic images, such as sports games, racing games, and battle games, to enhance user satisfaction. When displaying images of the same game content, different field of view angles can be provided depending on the aspect ratio of the image. For example, as the aspect ratio of the image increases in the direction of horizontal expansion, a wider field of view (FoV) or field of view can be provided. For example, a wide field of view or field of view can be provided in the order of an aspect ratio of 32:9, an aspect ratio of 21:9, and an aspect ratio of 16:9.

[0202] Referring to FIG. 7, when the ratio of the vertical length to the horizontal length of the display (or display panel) included in the electronic device 100, i.e., the aspect ratio of the display of the electronic device is 16:9, a screen 700A that outputs a game screen image 710 having an aspect ratio of 16:9, a screen 700B that outputs a game screen image 720 having an aspect ratio of 21:9, and a screen 700C that outputs a game screen image 730 having an aspect ratio of 32:9 are illustrated.

[0203] Since screen 700A displays a game screen image 710 having an aspect ratio of 16:9 on a display screen having an aspect ratio of 16:9, the game screen image 710 can be displayed to fit the display screen perfectly. A minimap 700 can be displayed in the lower left corner of the game screen image 710, and the minimap 700 can display notification events 750 provided by other game players, for example, users of electronic devices 800. The minimap 700 can be arranged in various locations on the game screen image 710 depending on the user's settings.

[0204] Since the screen 700B displays a game screen image 720 having an aspect ratio of 21:9 on a display screen having an aspect ratio of 16:9, the game screen image 720 may be displayed on a portion of the display screen, and a black area 740 may exist in which the game screen image 720 is not displayed. A minimap 700 may be displayed in the lower left corner of the game screen image 720, and the minimap 700 may display a notification event 750 provided by another game player, for example, a user of the electronic device 800. The minimap 700 may be arranged in various positions on the game screen image 720 depending on the user's settings. The electronic device 100 may provide a minimap zoom function. That is, since the minimap provided to the server device 300 may be difficult to identify due to its small size, the electronic device 100 may provide a function that can display the minimap in an enlarged form. When the minimap zoom function is selected, the electronic device 100 can enlarge the minimap included in the game screen image and display the enlarged minimap image 760 in an area where the game screen image 720 is not displayed, for example, a part of the black area 740. Accordingly, the user can more easily recognize a notification event occurring on the minimap using the enlarged minimap image 760.

[0205] Since the screen 700C displays a game screen image 730 having an aspect ratio of 32:9 on a display screen having an aspect ratio of 16:9, the game screen image 730 may be displayed on a part of the display screen, and an area where the game screen image 730 is not displayed, that is, a black area 780, may exist. A minimap 700 may be displayed on the lower left corner of the game screen image 730, and the minimap 700 may display a notification event 750 provided by another game player, for example, a user of the electronic device 800. The minimap 700 may be arranged at various locations on the game screen image 720 depending on the user's settings. The electronic device 100 may provide a minimap zoom function. In addition, the electronic device 100 may display an enlarged minimap image 770 of the minimap 700 included in the game screen image on a part of the area where the game screen image 730 is not displayed, for example, a black area 780. Therefore, users can more easily recognize notification events that occur on the minimap by using the enlarged minimap image 770.

[0206] According to one embodiment, the electronic device 100 may use the minimap sharing function to display the minimap on another device external to the electronic device 100, i.e., a display device.

[0207] FIG. 8 is a reference diagram for explaining an example of sharing a minimap using the minimap sharing function according to one embodiment.

[0208] Referring to FIG. 8, the electronic device 100 may communicate with an external electronic device, for example, a display device 200, to mirror at least a portion of an image displayed on a display screen so that it is displayed on the display device 200. The image shared by mirroring may include a minimap.

[0209] According to one embodiment, the electronic device 100 may transmit an image corresponding to a minimap 700, which is a part of a game screen image displayed on the display of the electronic device 100, to a display device 200 using a minimap sharing function. The display device 200 may display an image corresponding to the minimap 700 received from the electronic device 100. In this way, the electronic device 100 may display the minimap on an external display device 200, thereby enabling a user to view an enlarged minimap on a larger screen, thereby enabling a user to more easily recognize a notification event within the minimap.

[0210] In this way, by displaying a game screen including a mini-map in which a notification event input by a user of the electronic device 800 is displayed, the user of the electronic device 100 can check the notification event input by the user of the electronic device 800. However, since such a mini-map is typically a miniature version of the entire game space and is small in size, it may be difficult for users to recognize the notification event displayed within the mini-map in an urgent game play environment. Therefore, in the embodiments disclosed in the present disclosure, the electronic device 100 may further perform operations 518 and 519 as operations to facilitate recognition of the notification event displayed within the mini-map.

[0211] In operation 518, the electronic device 100 can detect a notification event displayed on the display screen. The electronic device 100 can detect the notification event on a minimap displayed on the display screen.

[0212] In operation 519, the electronic device 100 may provide visual / auditory effects in response to identification information of a notification event detected in a minimap displayed on a display screen. In this way, the electronic device 100 not only displays a notification event on the minimap, but also provides a separate visual or auditory effect corresponding to the notification event so that the user can more easily recognize the notification event displayed on the minimap, thereby enabling the user to utilize the minimap more smoothly.

[0213] Below, the operation illustrated in Fig. 4 is described in detail.

[0214] FIG. 9 illustrates an example of a flowchart of a process for detecting whether a notification event has occurred in an electronic device according to one embodiment.

[0215] Referring to FIG. 9, in operation 910, the electronic device 100 may identify a predefined area in an image displayed on the display screen. The predefined area may include an area where a notification event is displayed. For example, the predefined area may include a minimap area. An example of the minimap area will be described below.

[0216] The electronic device 100 can identify a minimap area in an image displayed on a display screen using various methods.

[0217] According to one embodiment, the electronic device 100 receives, through a user input, setting information regarding an area where a minimap is displayed on a screen displayed on a display of the electronic device 100, and identifies a minimap area on the screen displayed on the display based on the setting information received through the user input.

[0218] FIG. 10 illustrates an example of a display screen of an electronic device 100 according to one embodiment.

[0219] Referring to FIG. 10, the display screen of the electronic device 100 may include an area 1010 where an image corresponding to a game execution screen received from a server device 300 is displayed, and an area 1020 where an image corresponding to the game execution screen is not displayed on the display screen 1000. The area 1020 where an image corresponding to the game execution screen is not displayed may be referred to as a black area 1020. The game execution screen may include a minimap area 1030. In addition, the black area 1020 may include a minimap zoom area 1040 to display an enlarged image of the minimap according to a user's selection. The position of the minimap area 1030 is not limited to the position illustrated in FIG. 10 and may be positioned at any position on the game execution screen according to a user's setting. The position of the minimap zoom area 1040 is not limited to the position illustrated in FIG. 10 and may be positioned at any position on the game execution screen according to a user's setting.

[0220] The electronic device 100 can receive a user input for setting a minimap area 1030 or a minimap zoom area 1040 from the input device 10. For example, the electronic device 100 can provide a graphical user interface that allows the user to specify the minimap area 1030 or the minimap zoom area 1040. When the user performs an operation for specifying the minimap area 1030 or the minimap zoom area 1040 using the input device 10, the input device 10 can transmit an input for specifying the minimap area 1030 or the minimap zoom area 1040 to the electronic device 100. Accordingly, the electronic device 100 can store the user setting for specifying the minimap area 1030 or the minimap zoom area 1040, and can identify the minimap area 1030 or the minimap zoom area 1040 specified in accordance with the user setting when identifying the minimap area on the display screen thereafter.

[0221] According to one embodiment, the electronic device 100 can identify a minimap area by analyzing an image output from a display screen and using various object detection algorithms or filters. For example, the electronic device 100 can detect a minimap area having the corresponding shape and size from an image corresponding to the display screen based on the shape or size of the minimap area. For example, if the minimap area has a rectangular shape, the electronic device 100 can detect an area (or object) representing the rectangular shape through edge detection using an edge detection algorithm from an image corresponding to the display screen. Alternatively, if the minimap area has a circular shape, the electronic device 100 can detect an area (or object) representing the circular shape using a circle detection algorithm from an image corresponding to the display screen. However, the present invention is not limited thereto. In addition, the electronic device 100 can obtain information about the shape and size of the minimap area based on displayed content identification information. For example, information about a minimap corresponding to each game content may be provided for each game content, and the electronic device 100 may obtain information about the shape or size of the minimap area provided in the game content based on the displayed game content identification information.

[0222] According to one embodiment, the electronic device 100 may identify a minimap area in an image corresponding to a display screen using artificial intelligence (AI) technology based on a neural network. For example, the electronic device 100 may identify a minimap area in an image corresponding to the display screen using a neural network that has learned the minimap area corresponding to each game content.

[0223] According to one embodiment, the electronic device 100 may identify a minimap area from a fixed location of a minimap area designated in the currently displayed game content or game application. For example, the minimap area provided on the game execution screen may be fixed for each game content or game application. Accordingly, in such a case, the electronic device 100 may identify the location of a minimap area provided as fixed in response to identification information of the currently displayed game content or game application, and detect the minimap area from this location.

[0224] Returning to FIG. 9 again, at operation 920, the electronic device 100 may detect a notification event in a pre-designated area.

[0225] According to one embodiment, the electronic device 100 may store information about one or more notification events that can be detected in a pre-designated area. The electronic device 100 may detect a notification event in the pre-designated area by referring to the information about one or more notification events stored in this manner. In this case, since the information about the notification event may be different for each game application or each game content, the electronic device 100 may detect a notification event in the pre-designated area by referring to the information about the notification event corresponding to the currently displayed game content. The information about the notification event may include an image of an item corresponding to one or more notification events. An item corresponding to a notification event may also be referred to as an icon corresponding to the notification event.

[0226] Information about a notification event according to one embodiment is described with reference to FIGS. 11 and 12.

[0227] Figure 11 illustrates an example of information for a notification event according to one embodiment.

[0228] How notification events are provided may vary for each game application. Accordingly, notification event information corresponding to each game application or each game content may exist. For example, the electronic device 100 may store notification event information corresponding to one or more game contents, i.e., notification event information corresponding to a first game content, notification event information corresponding to a second game content, notification event information corresponding to a third game content, etc. For each game content, the number of notification events, the shape of the item image corresponding to the notification event, and the number and properties of visual or auditory effects corresponding to the notification event may vary.

[0229] Referring to FIG. 11, information 1100 for a notification event corresponding to the first game content may include information for one or more notification events, such as ID1, ID2, ID3, ID4, etc.

[0230] In the information for one or more notification events, the information for each notification event may include notification event identification information 1110 for identifying the notification event, an item image 1120 corresponding to the notification event, and an indication 1130 corresponding to the notification event.

[0231] Notification event identification information 1110 may indicate information for identifying each notification event among one or more notification events.

[0232] The item image 1120 corresponding to the notification event may represent an image of an item that the electronic device 100 can detect in an image corresponding to the display screen to determine the occurrence of a notification event.

[0233] The indication 1130 corresponding to the notification event may include at least one of a visual effect or an auditory effect that may be provided in response to the detection of the notification event. The visual effect may include, for example, at least one of a color 1131, a graphic effect 1132, text 1133, and a location 1134 of an information display area.

[0234] Color 1131 can indicate a color to be used as a visual effect in response to the detection of a notification event. For example, the information display area for the visual effect can be displayed in various colors, such as red or black. The colors can also be displayed according to specific patterns.

[0235] Graphic effect 1132 may display a graphic effect to be provided as a visual effect in response to the detection of a notification event. The graphic effect may display various visual effects, such as blinking or flashing, in the information display area where the visual effect is to be provided. The graphic effect may have a certain cycle when providing the effect, such as blinking or flashing. For example, the graphic effect may be set to have a shorter blink cycle to indicate a relatively imminent or urgent situation.

[0236] Text 1133 may represent text to be provided as a visual effect in response to detection of a notification event.

[0237] The location 1134 of the information display area may indicate a portion of the display screen for which a visual effect is to be provided in response to detection of a notification event. According to one embodiment, the portion of the display screen for which a visual effect is to be provided in response to detection of a notification event may include at least a portion of an area where a game execution screen is not displayed, i.e., a black area. According to one embodiment, the portion of the display screen for which a visual effect is to be provided in response to detection of a notification event may include at least a portion of an area excluding the minimap zoom area in the black area, when the black area includes a minimap zoom area. According to one embodiment, the portion of the display screen for which a visual effect is to be provided in response to detection of a notification event may include at least a portion of an area other than an area where the shared minimap is displayed on a screen of the other display device when the electronic device 100 uses a minimap sharing function to share a minimap with another display device.

[0238] The auditory effects may include sound 1135. Sound 1135 may include sounds of various effects as well as voice sounds uttering text 1133.

[0239] Information about notification events is not limited to the example shown in Fig. 11.

[0240] In Fig. 11, the location of the information display area where visual effects are provided in response to each notification event is shown as fixed, but is not limited thereto.

[0241] In one embodiment, the visual or auditory effects may be different depending on the location in the game space where each notification event occurs, or the location of the information display area that provides the visual effects may be different.

[0242] According to one embodiment, when a location in a game space where a notification event occurs is a space currently displayed on a display screen of an electronic device 100, and when a location in a game space where a notification event occurs is not a space currently displayed on a display screen of an electronic device 100, information about the notification event may be configured to provide different visual or auditory effects, or to provide different locations for information display areas where visual effects are provided. For example, the electronic device 100 may identify whether a location in a game space where a notification event occurs belongs to a space currently displayed on a display screen of the electronic device 100. When the electronic device 100 identifies that a location in a game space where a notification event occurs belongs to a space currently displayed on a display screen of the electronic device 100, the electronic device 100 may provide a visual or auditory effect according to a first indication corresponding to the notification event. When the electronic device 100 identifies that a location in a game space where a notification event occurs does not belong to a space currently displayed on a display screen of the electronic device 100, the electronic device 100 may provide a visual or auditory effect according to a second indication corresponding to the notification event. The first and second indications may have different sets of visual and / or auditory effects.

[0243] According to one embodiment, information regarding a notification event may be configured to provide different visual or auditory effects, or to change the location of an information display area for providing visual effects, depending on whether the location in the game space where the notification event occurred is close to or far from the character of the current user of the electronic device 100. For example, the electronic device 100 may calculate the distance between the location in the game space where the notification event occurred and the location where the character of the user of the electronic device 100 is located, and determine whether the calculated distance exceeds a threshold. If the electronic device 100 determines that the calculated distance exceeds the threshold, the electronic device 100 may provide a visual or auditory effect according to a first indication corresponding to the notification event. If the electronic device 100 determines that the calculated distance exceeds the threshold, the electronic device 100 may provide a visual or auditory effect according to a second indication corresponding to the notification event. The first and second indications may have different sets of visual and / or auditory effects.

[0244] Figure 12 illustrates an example of information for a notification event according to one embodiment.

[0245] Referring to FIG. 12, information 1200 for a notification event may include five notification events. Notification event identification information 1210 may include ID1 indicating an attack, ID2 indicating a target, ID3 indicating defense, ID4 indicating caution, and ID5 indicating a request for support. Each notification event identification information 1210 corresponds to an item image 1220. For notification event ID1, color 1231 is set to RED, text 1232 is set to Attack, and sound 1233 is set to Sound A. For notification event ID2, color 1231 is set to RED. For notification event ID3, color 1231 is set to Green, text 1232 is set to Defend, and sound 1233 is set to Sound B. For notification event ID4, color 1231 is set to RED, text 1232 is set to Caution, and sound 1233 is set to Sound C. For notification event ID5, color 1231 is set to BLUE and text 1232 is set to Assist. According to information 1200 for such notification event, when the electronic device 100 detects an item image corresponding to ID1 in the minimap area, it displays the color in red in the information display area and text <attack>It outputs and can also output Sound A as an auditory effect.

[0246] Returning to FIG. 9 again, at operation 920, the electronic device 100 may detect any one of the item images among the information for the notification event as described with reference to FIG. 11 in a pre-designated area.

[0247] According to one embodiment, the electronic device 100 can determine whether an item image included in information about a notification event corresponding to game content or a game application currently displayed on a display screen is detected in a pre-designated area by using various object detection algorithms or filters through image analysis of a pre-designated area.

[0248] According to one embodiment, the electronic device 100 may use artificial intelligence (AI) technology based on a neural network to determine whether an item image included in information about a notification event corresponding to game content or a game application currently displayed on the display screen is detected in a pre-designated area. For example, the electronic device 100 may use a neural network that has learned the item image included in information about a notification event corresponding to each game content to detect an item image for a notification event in a minimap area.

[0249] An algorithm or set of algorithms for implementing AI technology is called a neural network. Here, a neural network can receive input data, analyze the input data, and output the desired output data. In order for a neural network to accurately output output data corresponding to the input data, it must be trained. Here, "training" can mean training the neural network by inputting various data into the neural network and allowing the neural network to discover or acquire methods for analyzing the input data, classifying the input data, and / or extracting features necessary for generating output data from the input data. Here, "training" can be expressed as "learning" or "training." Furthermore, a set of algorithms that output output data corresponding to input data through the aforementioned neural network, software that executes the set of algorithms, and / or hardware that executes the set of algorithms can be referred to as an "AI model" (or "artificial intelligence model"). AI models can exist in a variety of forms. Specifically, there may be various AI models that receive an image as input, analyze the input image, and perform an action to classify the gestures of objects contained in the image into at least one category. The AI ​​model may include at least one neural network.

[0250] For example, methods for performing object recognition, object tracking, and / or object discrimination, etc., using artificial intelligence (AI) technology that performs operations through neural networks, are being developed and utilized. For convenience of explanation, operations for performing object recognition, object tracking, and object discrimination, etc., to recognize specific image objects by analyzing images are collectively referred to as "object recognition." For example, the neural network may be a deep neural network (DNN) that includes multiple layers and performs multi-stage operations. In addition, deep neural network (DNN) operations may include convolutional neural network (CNN) operations, etc. Specifically, a data recognition model for object recognition can be implemented through the exemplified neural network, and the implemented recognition model can be trained using training data. Then, input data, for example, a received image, can be analyzed using the trained data recognition model, and an object can be recognized in the input image and the recognized object can be output as output data. Additionally, convolutional neural networks (CNNs) are a general term for neural networks that perform algorithms to analyze images and find patterns, and can come in many different types and forms.

[0251] In this way, when the electronic device 100 detects one of the item images included in the information about the notification event in a pre-designated area, it can output at least one of the visual or auditory effects included in the indication corresponding to the detected item image.

[0252] According to one embodiment, the electronic device 100 may display a visual effect corresponding to a detected notification event in an information display area, for example, a black area, on the display screen where a game execution screen is not displayed. Various locations of the information display area are described with reference to FIG. 13.

[0253] FIG. 13 illustrates examples of information display areas in which visual effects corresponding to notification events are displayed according to one embodiment.

[0254] Referring to FIG. 13, in case 1300A, in which a game execution screen 1311 including a minimap 1312 is displayed on the top of a display screen 1310 of an electronic device 100 and a black area 1313 is located at the bottom, the electronic device 100 can provide a visual effect to at least a part of the black area 1313 as an information display area. That is, the electronic device 100 can provide a visual effect corresponding to a notification event detected in the minimap 1312 to at least a part of the black area. Referring to information 1200 for a notification event illustrated in FIG. 12, when an item image corresponding to a notification event ID4 is detected, the electronic device 100 displays at least a part of the black area 1313 in red. <caution>It outputs the text " and can also output Sound C as an auditory effect.

[0255] In case 1300B, in which a game execution screen 1321 including a minimap 1322 is displayed in the center of a display screen 1320 of an electronic device 100, and black areas 1323 and 1324 are positioned at the top and bottom, the electronic device 100 can provide a visual effect to at least a part of the black area 1323 and the black area 1324 as an information display area. Referring to information 1200 for a notification event illustrated in FIG. 12, when an item image corresponding to a notification event ID4 is detected, the electronic device 100 displays at least a part of the black area 1323 and the black area 1324 in red. <caution>It outputs the text " and can also output Sound C as an auditory effect.

[0256] In a case 1300C in which a game execution screen 1331 including a minimap 1332 is displayed on the top of a display screen 1330 of an electronic device 100, and a minimap zoom area 1334 is located in a black area 1333 at the bottom, the electronic device 100 can provide a visual effect to at least a part of the black area 1333 as an information display area. That is, the electronic device 100 can provide a visual effect corresponding to a notification event detected in the minimap 1332 or the minimap zoom area 1334 to at least a part of the black area. Referring to information 1200 for a notification event illustrated in FIG. 12, when an item image corresponding to a notification event ID4 is detected, the electronic device 100 displays at least a part of the black area 1333 in red. <caution>It outputs the text " and can also output Sound C as an auditory effect.

[0257] In a case 1300D in which a game execution screen 1341 including a minimap 1342 is displayed at the bottom of a display screen 1340 of an electronic device 100, and a minimap zoom area 1344 is located in a black area 1343 at the top, the electronic device 100 may provide a visual effect to at least a part of the black area 1334 as an information display area. That is, the electronic device 100 may provide a visual effect corresponding to a notification event detected in the minimap 1342 or the minimap zoom area 1344 to at least a part of the black area. Referring to information 1200 for a notification event illustrated in FIG. 12, when an item image corresponding to a notification event ID4 is detected, the electronic device 100 displays at least a part of the black area 1344 in red. <caution>It outputs the text " and can also output Sound C as an auditory effect.

[0258] According to one embodiment, the electronic device 100 may display a visual effect corresponding to a detected notification event on an information display area of ​​a display screen of a display device that is communicatively connected to the electronic device 100. The information display area of ​​the display screen of the display device may include, for example, an area where a shared mini-map is not displayed or a black area. An example of displaying a visual effect corresponding to a notification event on a display screen of a display device that is communicatively connected to the electronic device 100 will be described with reference to FIG. 14.

[0259] FIG. 14 is a reference diagram for explaining an example of displaying a visual effect corresponding to a notification event in an electronic device 100 on a display screen of a display device that is connected to the electronic device 100 in communication according to one embodiment.

[0260] Referring to FIG. 14, the electronic device 100 can communicate with the display device 200 to share at least a portion of the image displayed on the display screen of the electronic device 100. Various screen mirroring technologies can be used for such image sharing.

[0261] According to one embodiment, when the electronic device 100 displays a game execution screen, it can communicate with the display device 200 to share a minimap area. By displaying only the minimap area on the display screen of the display device 200, the user can experience a minimap area of ​​a larger size. The electronic device 100 can communicate with various types of display devices 200. For example, the display device 200 can include a monitor 200a, a personal computer 200b, and a tablet computer 200c.

[0262] Referring to FIG. 14, a monitor 200a, a personal computer 200b, and a tablet computer 200c are illustrated, which can share and display a minimap area of ​​an electronic device 100. The monitor 200a displays a minimap received from the electronic device 100 using mirroring in the center area of ​​the screen, and black areas may exist in the right and left areas of the screen. The electronic device 100 can control to provide a visual effect corresponding to a notification event detected in the minimap by using at least a part of the black area of ​​the monitor 200a as an information display area. The personal computer 200b can display a minimap received from the electronic device 100 using mirroring in the left area of ​​the screen, and a window may be displayed in the right area of ​​the screen. The electronic device 100 can control to provide a visual effect corresponding to a notification event detected in the minimap by using at least a part of the window area included in the right area of ​​the personal computer 200b as an information display area. The tablet computer 200c may display a minimap received from the electronic device 100 using mirroring in the central area of ​​the screen, and black areas may exist in the right and left areas of the screen. The electronic device 100 may control at least a portion of the black area of ​​the tablet computer 200c to be used as an information display area, and provide visual effects corresponding to notification events detected in the minimap.

[0263] FIG. 15 illustrates an example of a flowchart of a method of operating an electronic device according to one embodiment.

[0264] Referring to FIG. 15, in operation 1510, an electronic device 100 and a display device 200 may communicate with each other. According to one embodiment, the electronic device 100 may communicate with each other to mirror at least a portion of an image displayed on the display screen of the electronic device 100 and display it on the screen of the display device 200. For example, the electronic device 100 may communicate with each other using Wi-Fi communication technology or Bluetooth communication technology.

[0265] At operation 1520, the electronic device 100 may display a game execution screen.

[0266] At action 1530, the electronic device 100 can identify a minimap area on the game play screen.

[0267] At operation 1540, the electronic device 100 may transmit an image corresponding to the identified minimap area to the display device 200.

[0268] At operation 1550, the display device 100 can display a minimap area image on the display.

[0269] At operation 1560, the electronic device 100 can detect a notification event in the minimap area.

[0270] In operation 1570, the electronic device 100 may obtain an indication corresponding to the detected notification event. The indication may include a visual or auditory effect to be provided in response to the notification event.

[0271] In operation 1580, the electronic device 100 may transmit indication information or a screen displaying an indication to the display device 200. The electronic device 100 may transmit indication information to the display device 200 that instructs the display device 200 to provide a visual effect or an auditory effect according to the indication in an area other than the minimap area.

[0272] In operation 1590, the display device 200 can display a screen in which a visual effect corresponding to an indication is provided in an information display area.

[0273] According to one embodiment, the electronic device 100 may store information about preset notification events, as well as information about notification events added or edited based on user input. When running a game application, a user may wish to add a notification event or edit an existing notification event as desired. Accordingly, the electronic device 100 may provide a graphical user interface that allows the user to edit or add a notification event.

[0274] FIG. 16 is a reference diagram for explaining information about a notification event that can be set according to user input according to one embodiment.

[0275] Referring to FIG. 16, the electronic device 100 may include information about notification events according to user settings as well as information about preset notification events.

[0276] According to one embodiment, the electronic device 100 may provide a graphical user interface 1600 that allows a user to add or edit information about a notification event.

[0277] For example, referring to FIG. 16, a user can edit an item image and indication corresponding to a notification event ID1. For example, if an icon 1610 for selecting an item image is selected, the electronic device 100 can output an icon 1611 including multiple selectable item images. If an icon 1620 for selecting a color is selected, the electronic device 100 can output an icon 1621 including multiple selectable colors. If an icon 1630 for selecting text is selected, the electronic device 100 can output an icon 1631 including multiple selectable colors. If an icon 1640 for selecting a sound is selected, the electronic device 100 can output an icon 1641 including multiple selectable sounds. For example, a user can set notification event information corresponding to notification event ID1 by selecting the third item from icon 1611 for the item image, selecting RED from icon 1621 for the color, selecting Enemy missing from icon 1631 for the text, and selecting Sound B from icon 1641 for the sound in response to notification event ID1. By providing a graphical user interface that allows editing of such notification event information, the user can be enabled to change or edit the notification event as desired.

[0278] The method of operating an electronic device according to the disclosed embodiment may be implemented in the form of program commands that can be executed by various computer means and recorded on a computer-readable medium. Furthermore, the disclosed embodiment may be recorded on a computer-readable recording medium having recorded thereon one or more programs containing commands for executing the method of operating a display device.

[0279] The above computer-readable medium may include program commands, data files, data structures, etc., either singly or in combination. The program commands recorded on the medium may be those specially designed and configured for the present invention, or may be those known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0280] Here, the device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory storage medium" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage medium and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.

[0281] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smartphones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be at least temporarily stored or temporarily created in a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.< / caution> < / caution> < / caution> < / caution> < / attack>

Claims

1. In electronic devices, memory for storing at least one instruction; and comprising at least one processor executing at least one instruction; The electronic device, wherein the at least one instruction is executed by the at least one processor, Detects whether a notification event has occurred on a display screen where a video is displayed, indicating information that another user wants to convey to the user; Upon detecting that the above notification event has occurred, an indication is obtained including at least one of a visual effect or an auditory effect corresponding to the detected notification event, An electronic device configured to provide the indication to the user using at least one of an information display area or an audio output section.

2. In the first paragraph, the electronic device, by executing the at least one instruction by the at least one processor, Identify a pre-designated area from the image displayed on the above display, An electronic device configured to detect the notification event from the identified pre-designated area.

3. An electronic device according to claim 1 or 2, wherein the electronic device is configured to identify the pre-designated area by at least one of receiving setting information of the pre-designated area from the user or automatically detecting the pre-designated area in the image, by executing the at least one instruction by the at least one processor.

4. An electronic device according to any one of claims 1 to 3, wherein the electronic device is configured to detect a notification event by detecting an item image corresponding to the notification event from the pre-designated area using information about one or more notification events by executing the at least one instruction by the at least one processor.

5. In any one of paragraphs 1 to 4, Information about one or more of the above notification events, An electronic device comprising identification information for a notification event, an item image corresponding to the notification event, and a visual or auditory effect corresponding to each notification event.

6. In any one of paragraphs 1 to 5, An electronic device, wherein the electronic device is configured to obtain an indication corresponding to the identified notification event by referencing identification information of one or more notification events and an indication registered corresponding to the identification information of each notification event, by executing the at least one instruction by the at least one processor.

7. In any one of paragraphs 1 to 6, The above information display area includes a predetermined area on the display screen where the image is not displayed, An electronic device, wherein the electronic device is configured to provide the visual effect by using the predetermined area by executing the at least one instruction by the at least one processor.

8. In any one of paragraphs 1 to 7, The above information display area includes a predetermined area on the display of an external display device that shares and displays at least a portion of the display screen displayed on the electronic device, An electronic device, wherein the electronic device is configured to provide the visual effect by using a predetermined area on a display of the external display device, by executing the at least one instruction by the at least one processor.

9. In any one of paragraphs 1 to 8, At least a portion of the shared screen includes a minimap area, An electronic device, wherein the predetermined area on the display of the external display device includes an area excluding an area where the minimap area is displayed.

10. In any one of paragraphs 1 to 9, The electronic device identifies a first location in the game content where the notification event occurs by executing the at least one instruction by the at least one processor, An electronic device configured to determine a second location at which the indication is provided based on the location at which the notification event occurred.

11. A method of operating an electronic device, An action to detect whether a notification event has occurred on a display screen where an image is displayed, indicating information that another user wishes to convey to the user; An operation of obtaining an indication including at least one of a visual effect or an auditory effect corresponding to the detected notification event upon detecting that the above notification event has occurred, and A method comprising providing the indication to the user using at least one of an information display area or an audio output unit.

12. In paragraph 11, An operation of identifying a pre-designated area from an image displayed on the above display, and A method comprising the action of detecting the notification event from the identified pre-designated area.

13. In paragraph 11 or 12, A method comprising an action of identifying the pre-designated area by at least one of receiving setting information of the pre-designated area from the user or automatically detecting the pre-designated area in the image.

14. In any one of paragraphs 11 to 13, A method comprising the action of detecting a notification event by detecting an item image corresponding to the notification event from the pre-designated area using information about one or more notification events.

15. A non-transitory computer-readable recording medium storing one or more instructions for executing a method of operating an electronic device by a computer, wherein the one or more instructions are executed by at least one processor of the electronic device, such that the electronic device: Detects whether a notification event has occurred on a display screen where a video is displayed, indicating information that another user wants to convey to the user; Upon detecting that the above notification event has occurred, an indication is obtained including at least one of a visual effect or an auditory effect corresponding to the detected notification event, A non-transitory computer-readable recording medium providing the indication to the user using at least one of an information display area or an audio output section.

Citation Information

Patent Citations

  • Game relay method, game relay server executing same, and recoding medium storing same

    KR1020140023636A

  • hole hygiene mask

    KR1020210091870A

  • Vehicle and method of managing in-car cleanliness for the same

    KR1020220003320A

  • Method for quantitavely anaylyzing oxidation degree of reverse osmosis membrane

    KR1020220057930A

  • KR20230073841A