Electronic device, method for operating electronic device, and computer-readable recording medium therefor
The electronic device uses AI to prioritize and summarize notifications based on importance, addressing inefficiencies in notification management and improving user experience and productivity.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2026-01-05
- Publication Date
- 2026-07-23
AI Technical Summary
Existing electronic devices face challenges in efficiently managing notifications, as they are often displayed in chronological order without consideration for importance, leading to reduced readability and user inconvenience.
An electronic device that utilizes artificial intelligence to analyze notification context, reconstruct notifications based on importance, and provide priority notifications, summarizing important ones while reducing exposure to less important ones.
Improves notification readability and user convenience by distinguishing important notifications, enhancing user experience and productivity through intelligent notification management.
Smart Images

Figure KR2026000224_23072026_PF_FP_ABST
Abstract
Description
Electronic device, method of driving the electronic device, and computer-readable recording medium for the same
[0001] Embodiments of the present disclosure provide an electronic device for providing notification, a method for operating the electronic device, and a computer-readable recording medium for the same.
[0002] With the development of digital technology, various types of electronic devices such as smartphones, tablet PCs, laptop computers, desktop computers, digital cameras, and / or wearable devices are widely used. To support and enhance the functionality of these electronic devices, the hardware and / or software parts of the devices are continuously being developed.
[0003] For example, portable electronic devices (hereinafter referred to as "electronic devices"), such as smartphones, have become capable of incorporating various functions. Electronic devices include touchscreen-based displays to allow users easy access to various functions, and can provide screens for various applications through the display.
[0004] An electronic device may receive notifications in real-time or periodically from applications or services (e.g., systems) installed on the device. Notifications may include various notifications received from external devices (e.g., other electronic devices and / or servers) or generated by applications or systems on the electronic device. Notifications may be displayed via a notification panel (or notification screen or notification list) until acknowledged by the user. Generally, notifications are intended to provide information quickly to the user of the electronic device; however, the readability of notifications may be reduced because the electronic device displays a very large number of notifications simply in the chronological order in which they were received (or acquired).
[0005] Meanwhile, with the rapid development of big data and deep learning technologies in recent years, artificial intelligence (AI) technology has been implemented in electronic devices and is also being applied to intelligent personalized services that analyze specific data and integrate and utilize information from various fields tailored to the user. For example, users can control electronic devices through voice conversation and perform searches, queries, and responses regarding specific information using a knowledge base powered by deep learning. Recently, with the evolution of AI technology, generative AI technology is being implemented. Generative AI can refer to AI technology that creates new, similar content using existing content such as text, audio, and / or images. For instance, generative AI can refer to AI technology capable of generating content (e.g., text, audio, images, and / or videos) corresponding to a given input.
[0006] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.
[0007] In one embodiment of the present disclosure, an electronic device capable of improving the readability of notifications and the convenience of checking notifications for a user by rearranging notifications according to importance on a notification panel (or notification screen), a method for operating the electronic device, and a computer-readable recording medium for the same are provided.
[0008] In one embodiment of the present disclosure, an electronic device capable of increasing the rapid delivery of information and task productivity, which are the original purposes of a notification, by analyzing the context of the notification and reconstructing the notification, a method for operating the electronic device, and a computer-readable recording medium for the same are provided.
[0009] In one embodiment of the present disclosure, an electronic device, a method for operating the electronic device, and a computer-readable recording medium for the same are provided, which determine the importance of a notification based on a user's personalized data and / or learning data, and provide priority notifications (or important notifications) and non-important notifications distinguished according to the importance of the notification, thereby more easily exposing priority notifications to the user and reducing the frequency of exposure of non-important notifications to the user, so as to provide notifications more efficiently.
[0010] In one embodiment of the present disclosure, an electronic device capable of summarizing and providing important notifications on a notification panel, a method for operating the electronic device, and a computer-readable recording medium for the same are provided.
[0011] The technical problems intended to be solved in this document are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.
[0012] According to an embodiment of the present disclosure, an electronic device is provided that distinguishes and provides notifications according to importance through a notification panel. The electronic device may include a display, communication circuitry, memory storing one or more computer programs, and one or more processors including processing circuitry that are communicatively coupled to the display and memory. One or more computer programs may include instructions (e.g., computer-executable instructions) that cause the electronic device to perform the following when executed individually or collectively by one or more processors.
[0013] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may receive a signal including a notification through the communication circuit. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may identify the personalized data associated with the notification. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may identify the priority of the notification based on the identified data. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may select an area within the display to display the notification based on the priority of the notification. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may identify whether the notification has a defined condition if the selected area is a first area. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may generate a prompt for generating data (or a summary) related to the notification when the notification has a defined condition. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may transmit the prompt to generative artificial intelligence (AI) on-device and / or a server.According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may obtain data (or a summary) based on the prompt. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may update the contents of the notification of the first area based on the obtained data (or a summary).
[0014] A method of operation of an electronic device according to an embodiment of the present disclosure may include an operation of receiving a signal including a notification through a communication circuit. According to one embodiment, the method of operation may include an operation of checking personal data related to the notification. According to one embodiment, the method of operation may include an operation of identifying the priority of the notification based on the checked data. According to one embodiment, the method of operation may include an operation of selecting an area within a display to display the notification based on the priority of the notification. According to one embodiment, if the selected area is a first area, the method of operation may include an operation of identifying whether the notification has a defined condition. According to one embodiment, if the notification has a defined condition, the method of operation may include an operation of generating a prompt for generating data (or a summary) related to the notification. According to one embodiment, the method of operation may include an operation of transmitting the prompt to an on-device and / or server-side generative artificial intelligence (AI). According to one embodiment, the operation method may include an operation of obtaining data (or a summary) based on the prompt. According to one embodiment, the operation method may include an operation of updating the content of the notification of the first area based on the obtained data (or a summary).
[0015] In order to solve the above problems, various embodiments of the present disclosure may include a computer-readable recording medium that records a program for executing the method on a processor.
[0016] According to one embodiment, one or more non-transitory computer-readable recording media are provided for storing computer-executable instructions that cause one or more processors of an electronic device to perform operations when one or more processors are executed individually or collectively.
[0017] According to one embodiment, the operations may include receiving a signal including a notification through a communication circuit; verifying personal data related to the notification; identifying the priority of the notification based on the verified data; selecting an area within a display to display the notification based on the priority of the notification; identifying whether the notification has a defined condition when the selected area is a first area; generating a prompt to generate data (or a summary) related to the notification when the notification has a defined condition; transmitting the prompt to a generative artificial intelligence (AI) on a device and / or server; obtaining data (or a summary) based on the prompt; and updating the content of the notification in the first area based on the obtained data (or summary).
[0018] Further scopes of the applicability of the present disclosure will become apparent from the following detailed description. However, since various changes and modifications within the spirit and scope of the present disclosure are clearly understood by those skilled in the art, specific embodiments, such as the detailed description and preferred embodiments of the present disclosure, should be understood as being given merely as examples.
[0019] According to an electronic device, a method for operating an electronic device, and a computer-readable recording medium for the same, in accordance with one embodiment of the present disclosure, it is possible to provide a user with the ability to more conveniently and intuitively understand important notifications and the content of important notifications. According to one embodiment, the problems of inefficiency in notification management and deterioration of user experience found in the prior art can be resolved. According to one embodiment, by utilizing the user's personalized data (and / or learning data), notifications can be arranged by importance (or priority), and summarized information (e.g., summary) related to important notifications can be provided, thereby improving user satisfaction and task productivity.
[0020] According to one embodiment, conventionally, generated notifications are not classified separately but are simply sorted and displayed based on some elements such as time information, so when a large number of notifications accumulate, it may be difficult for the user to check important notifications. In one embodiment, through a ranking system based on artificial intelligence and user experience, important notifications among currently registered notifications can be selected, long notifications are summarized and provided, and less important notifications are placed at the bottom of the notification panel, thereby allowing the user to more intuitively distinguish and identify important notifications and non-important notifications (e.g., notifications of less important information or unnecessary information), and to support easy understanding of the content of long notifications at once.
[0021] According to one embodiment, by providing the user with the convenience of checking notifications, a new UX (user experience) / UI (user interface) can be provided to the user.
[0022] In addition, various effects that can be understood directly or indirectly through this document may be provided. The effects obtainable from this disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.
[0023] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0024] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
[0025] FIG. 2 is a block diagram showing an integrated intelligence system according to one embodiment.
[0026] FIG. 3 is a block diagram illustrating a generative artificial intelligence system according to one embodiment.
[0027] FIG. 4 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0028] FIG. 5 is a block diagram illustrating a notification management system according to one embodiment of the present disclosure.
[0029] FIG. 6 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0030] FIGS. 7a, FIGS. 7b, and FIGS. 7c are drawings illustrating examples of an operation of providing a notification in an electronic device according to one embodiment of the present disclosure.
[0031] FIG. 8 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0032] FIG. 9 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0033] FIG. 10 is a drawing illustrating an example of providing a notification panel in an electronic device according to one embodiment of the present disclosure.
[0034] FIG. 11 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0035] FIG. 12 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0036] FIG. 13 is a drawing illustrating the operation of providing a notification in an electronic device according to one embodiment of the present disclosure.
[0037] FIGS. 14a, FIGS. 14b, and FIGS. 14c are drawings illustrating examples of an operation of providing a notification in an electronic device according to one embodiment of the present disclosure.
[0038] FIG. 15 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0039] FIG. 16 is a drawing illustrating an example of an interface related to setting a notification function in an electronic device according to one embodiment of the present disclosure.
[0040] FIG. 17 is a drawing illustrating an example of providing a notification panel in an electronic device according to one embodiment of the present disclosure.
[0041] FIG. 18 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0042] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.
[0043] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.
[0044] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0045] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0046] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0047] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0048] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (OS) (142), middleware (144), or an application (146).
[0049] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0050] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0051] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0052] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0053] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0054] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0055] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0056] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0057] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0058] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0059] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0060] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a WAN (wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0061] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimization of terminal power and connection of multiple terminals (mMTC, massive machine type communications), or high reliability and low-latency (URLLC, ultra-reliable and low-latency communications). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.
[0062] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0063] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0064] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0065] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0066] FIG. 2 is a block diagram showing an integrated intelligence system according to one embodiment.
[0067] Referring to FIG. 2, an integrated intelligent system of one embodiment may include an electronic device (201) (e.g., the electronic device (101) of FIG. 1), an intelligent server (300), and a service server (399).
[0068] According to the illustrated embodiment, the electronic device (201) may include a communication interface (210), an input / output (I / O) interface (220), a processor (230), and / or memory (240). The listed components may be operatively or electrically connected to each other. For example, the electronic device (201) may include at least some of the components of the electronic device (101) of FIG. 1.
[0069] The communication interface (210) can be connected to an external device (e.g., an intelligent server (300) and / or a service server (399)) via a network (299) (e.g., any network including a cellular network and / or a WLAN (wireless local area network)) to transmit and receive data. For example, the communication interface (210) may correspond to the CP and / or communication circuit of FIG. 1. The I / O interface (220) can receive user input, process received user input, and / or output results processed by the processor (230) using an input / output device (not shown) (e.g., a microphone, a speaker, and / or a display (e.g., the display of FIG. 1).
[0070] The processor (230) may perform a specified operation by being operatively or electrically connected to a communication interface (210), an I / O interface (220), and / or a memory (240) (e.g., the memory (130) of FIG. 1). For example, the processor (230) may correspond to the processor (120) of FIG. 1. The processor (230) may perform a specified operation by executing a program (or one or more instructions) stored in the memory (240). For example, the processor (230) may receive a user's voice input (e.g., user speech) through the I / O interface (220) or from an external electronic device. The processor (230) may transmit the voice input received through the communication interface (210) to an intelligent server (300). For example, the processor (230) may include one or more processors.
[0071] The processor (230) may receive a result corresponding to a voice input from the intelligent server (300). For example, the processor (230) may receive a plan corresponding to the voice input and / or a result calculated using the plan from the intelligent server (300). For example, the plan may include, but is not limited to, information regarding a plurality of sequential operations to be executed by the first electronic device (201) and / or other electronic devices in relation to the voice input. The processor (230) may receive a request from the intelligent server (300) to obtain information (e.g., entities, slots, and / or parameters) necessary to generate a plan corresponding to the voice input. The processor (230) may transmit the necessary information to the intelligent server (300) in response to the request.
[0072] The processor (230) can output the result of executing a specified action according to a plan visually, tactilely, and / or audibly through the I / O interface (220). For example, the processor (230) can sequentially display the result of executing multiple actions on a display. For example, the processor (230) can display only the result of executing multiple actions (e.g., the result of executing one of the multiple actions or the last action) on a display.
[0073] The processor (230) can recognize voice input. For example, the processor (230) can execute an intelligent app (or voice recognition app) to process voice input in response to a specified voice input (e.g., Wake up!). The processor (230) can provide voice recognition services through the intelligent app. The processor (230) can transmit voice input to an intelligent server (300) through the intelligent app and receive a result corresponding to the voice input from the intelligent server (300).
[0074] An intelligent server (300) of one embodiment can receive a user's voice input from an electronic device (201) via a network (299). The intelligent server (300) can convert audio data corresponding to the received voice input into text data. Based on the text data, the intelligent server (300) can generate at least one plan for performing a task corresponding to the user's voice input. The intelligent server (300) can transmit the generated plan, or the result according to the generated plan, to the electronic device (201) via the network (299).
[0075] An intelligent server (300) of one embodiment may include a front end (310), a natural language platform (320), a capsule database (330), an execution engine (340), and / or an end user interface (350).
[0076] The front end (310) can receive voice input received by the electronic device (201) from the electronic device (201). The front end (310) can transmit a response corresponding to the voice input to the electronic device (201).
[0077] The natural language platform (320) may include an automatic speech recognition (ASR) module (321), a natural language understanding (NLU) module (323), a planner module (325), a natural language generator (NLG) module (327), and / or a text-to-speech (TTS) module (329).
[0078] The automatic speech recognition module (321) can convert voice input received from the electronic device (201) into text data. The natural language understanding module (323) can identify the user's intent and / or parameters (e.g., entities and / or slots) based on the text data of the voice input. The user's intent corresponds to the voice input and may include information indicating an action (or function) that the user intends to perform using the device. A slot may be detailed information related to the user's intent. A slot may be obtained based on a domain corresponding to the utterance. A slot may be variable information required to perform an action. In one embodiment, the variable information constituting the slot may include a named entity.
[0079] The planner module (325) can generate a plan using the intent and / or parameters determined by the natural language understanding module (323). For example, the planner module (325) can determine at least one domain required to perform a task based on the determined intent. The planner module (325) can determine multiple actions included in each of the at least one domain determined based on the intent. The domain may correspond to a category (or service) associated with an action (or function) that the user intends to execute using the device. The domain may be classified according to a service (e.g., an app) related to text. The domain may be related to the user's intent corresponding to the text. The domain may be classified according to, for example, the application that receives voice input and / or the type of service to be provided based on voice input, but is not limited thereto. In one example, the determination of the domain may be performed by another module (e.g., the natural language understanding module (323)). The planner module (325) can determine parameters required to execute a plurality of determined actions or result values output by the execution of a plurality of actions. The parameters and result values may be defined as concepts of a specified format (or class). For example, the plan may include a plurality of actions and / or a plurality of concepts determined by the user's intent. The planner module (325) can determine the relationship between the plurality of actions and / or a plurality of concepts in a stepwise (or hierarchical) manner. For example, the planner module (325) can identify the execution order of a plurality of actions (e.g., a plurality of actions determined based on the user's intent) based on a plurality of concepts (e.g., parameters required to execute a plurality of actions, and result values output by the execution of a plurality of actions). The planner module (325) can generate a plan that includes association information (e.g., an ontology) between the plurality of actions and the plurality of concepts.The planner module (325) can generate a plan using information (e.g., at least one capsule) stored in a capsule database (330) in which a set of relationships between concepts and actions is stored.
[0080] The planner module (325) can generate a plan based on an artificial intelligence (AI) system. For example, the AI system may include one or more electronic devices and / or one or more processing circuits to execute a rule-based system, a neural network-based system (e.g., a feedforward neural network (FNN), a recurrent neural network (RNN)), or a combination of the above. The AI system described above is exemplary, and the AI system may be an AI system based on any model based on machine learning. The planner module (325) may select a plan corresponding to a user request from a set of predefined plans, or generate a plan in real time in response to a user request.
[0081] The natural language generation module (327) can change the specified information into a text form. The information changed into a text form may be in the form of a natural language utterance. The text-to-speech conversion module (329) can convert the information in the text form into information in the speech form.
[0082] The capsule database (330) can store information regarding the relationships between multiple concepts and actions corresponding to multiple domains (e.g., applications). The capsule database (330) can store at least one capsule (e.g., capsule (331) and / or capsule (333)) in the form of a concept action network (CAN). For example, the capsule database (330) can store actions for processing a task corresponding to a user's voice input, and parameters required for the actions, in the form of a CAN. A capsule may include multiple action objects (or action information) and / or concept objects (or concept information) included in a plan. For example, capsules (331, 333) may be created per domain and stored in the capsule database (330), but are not limited thereto.
[0083] The execution engine (340) can produce a result using the generated plan. The end user interface (350) can transmit the produced result to the electronic device (201).
[0084] According to one embodiment, some functions (e.g., natural language platform (320)) or all functions of the intelligent server (300) may be implemented in the electronic device (201). For example, the electronic device (201) may execute one or more programs including a natural language platform (e.g., the natural language platform (320) of FIG. 2) separately from the intelligent server (300). For example, the electronic device (201) may directly perform at least some of the operations of the natural language platform (320) of the intelligent server (300) (e.g., automatic speech recognition module (321), natural language understanding module (323), planner module (325), natural language generation module (327), and / or text-to-speech module (329)).
[0085] In one embodiment, the service server (399) may provide a designated service (e.g., food ordering or hotel reservation) to the electronic device (201). The service server (399) may be a server operated by an operator different from the intelligent server (300). The service server (399) may communicate with the intelligent server (300) and / or the electronic device (201) through the network (299). The service server (399) may communicate with the intelligent server (300) through a separate connection (not shown). The service server (399) may provide the intelligent server (300) with information (e.g., operation information and / or concept information for providing the designated service) to generate a plan corresponding to the voice input received by the electronic device (201). The provided information may be stored in the capsule database (330). The service server (399) may provide the intelligent server (300) with result information according to the plan received from the electronic device (201).
[0086] FIG. 3 is a block diagram illustrating a generative artificial intelligence system according to one embodiment.
[0087] Referring to FIG. 3, a generative artificial intelligence system according to one embodiment (e.g., server (108) of FIG. 1 or intelligent server (300) of FIG. 2) may include a user interface (260), a database (265), an application and service component (270), an artificial intelligence (AI) framework (280), and a generative AI model (290). According to one embodiment, the generative artificial intelligence system may be included in an electronic device (e.g., electronic device (101, 201) of FIG. 1 or FIG. 2) (e.g., AI engine) or / or in an intelligent server (e.g., external server (e.g., server (108) of FIG. 1).
[0088] The user interface (260) can receive user queries.
[0089] The above input may include user input and / or data obtained or generated by an electronic device (e.g., the electronic device (101, 201) of FIG. 1 or FIG. 2).
[0090] The above data may include images, videos, and / or sensor data generated by at least one processor of the electronic device (101, 201) (e.g., processor (120, 230) of FIG. 1 or FIG. 2).
[0091] The sensor data may include, for example, illuminance data around the electronic device (102, 201) obtained from the sensor module (176) or sensor hub of FIG. 1, posture data (or orientation data) of the electronic device (101, 201), temperature inside the electronic device (101, 201) (e.g., temperature of the display module (160) of FIG. 1 and / or temperature of the processor (120, 230)), size information of the display area of the display module (160), and / or an image obtained through the image sensor of the electronic device (101, 201) (e.g., camera module (180) of FIG. 1).
[0092] The above user query may be in the form of natural language, touch data obtained through a touch circuit included in the display module (160) (e.g., used to identify input from a finger and / or stylus), an image, audio, and / or video. Additionally, context information may be transmitted along with the user query. The context information may include various side information related to the time when the user query is input into the generative artificial intelligence system. For example, the side information may include information such as application information currently being used by the user and / or location information of the user. As another example, the user query may also be a non-natural language input that does not generate natural language, such as a design request or modification. Additionally, a mixed form of the natural language, image, sound, and context information described above is also possible.
[0093] Additionally, the user interface (260) may output results of the generative artificial intelligence system to the user. The output may include results (or result information) generated or obtained by the generative artificial intelligence system based on at least part of the input. The output may be in the form of natural language or specific content, and may also be provided in the form of an action requested by the user. For example, the output may have a format according to the user settings of the electronic device (101, 201).
[0094] The AI framework (280) can receive a user query and coordinate and control each component necessary to perform the user's intent. This AI framework (280) may include a prompt design component (281), an APIs / Plugins Management component (283), and an output modification component (285).
[0095] User queries or actions entered in the user interface (260) can be transmitted to a prompt design component (281). The prompt design component (281) can be used to generate prompts suitable for input into a large language model (LLM), a large vision model (LVM), or a large multimodal model (LMM). The prompt design component (281) may be an AI component that uses machine learning algorithms or neural networks to develop better prompts over time. The prompt design component (281) can generate prompts by accessing a database (265) (e.g., a knowledge component) containing user preference data, a prompt library, and prompt examples, and can transmit them to the large language model (LLM), the large vision model (LVM), and / or the large multimodal model (LMM).
[0096] The application and plugin management component (283) can perform the role of communicating with external information when there is a request for additional information when user input is transmitted as input to the generative AI model (290). The application and plugin management component (283) establishes a channel to communicate with the outside of the generative artificial intelligence system through an application programming interface (API), thereby enabling access to various data sources. For example, the application and plugin management component (283) can be used to request other components (e.g., application and service components (270)) that perform feedback (or response) according to the prompt. The acquired information can be used to generate a prompt by the prompt design component (281) together with the user input, or can be used as input to the generative AI model (290). Additionally, the application and plugin management component (283) can request the action through the API if the application or service needs to perform an action that ultimately executes the user query rather than an intermediate result. Information obtained from an external source can be transmitted as input to a generative AI model (290) along with user input.
[0097] The output modification component (285) can fine-tune (or adjust or change) the output produced by the generative AI model (290). For example, the output modification component (285) can determine the relevance (e.g., score) between the output (e.g., content) of the generative AI model (290) and the user input. For example, the output modification component (285) can verify whether the content generated through a large language model (LLM), a large vision model (LVM), or a large multimodal model (LMM) is relevant, contains biased information (e.g., selective information), or contains harmful information (e.g., violent content or profanity). Additionally, the output modification component (285) can determine the extent to which the output matches the desired result and, if additional processing is required, proceed with that process. Additionally, the output modification component (285) can configure and provide to the user a hint to avoid unwanted output.
[0098] A generative AI model (290) generally refers to an artificial intelligence neural network that generates new forms of data based on user input information. A generative AI model (290) may include an image generation model and / or a language generation model. An image generation model may include a generative adversarial network (GAN) and / or a variational autoencoder (VAE). An example of an image generation model is a diffusion-based generative model that uses the structures of a VAE and a Transformer. Additionally, a language generation model is a model trained to output the statistically most appropriate output value based on input values, and representative examples include models such as CHAT-GPT 3 and CHAT-GPT 4. Additionally, it may include a large-scale multimodal model (LMM) capable of recognizing various forms of data input, such as text, images, and / or speech, and generating new data corresponding to them.
[0099] In one embodiment, the AI framework (280) and / or generative AI model (290) may be included within an AI module (e.g., including a processing circuit) within the electronic device (101, 201). For example, the AI module may be operatively coupled with at least one processor (120, 230) of the electronic device (101, 201). For example, the AI module may be operatively coupled with a sensor hub of the electronic device (101, 201) for one or more sensors within the electronic device (101, 201).
[0100] FIG. 4 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0101] According to one embodiment, FIG. 4 may show a block diagram of an exemplary electronic device (400) (e.g., the electronic device (101) of FIG. 1) capable of performing the operations described in this document.
[0102] Referring to FIG. 4, the electronic device (400) may be one of various forms of electronic devices, such as a notebook (490), smartphones (491) having various form factors (e.g., a bar-type smartphone (491-1), a foldable-type smartphone (491-2), or a sliderable (or rollable)-type smartphone (491-3)), a tablet (492), a cellular phone (not shown), and other similar computing devices (not shown). The components, their relationships, and their functions illustrated in FIG. 4 are illustrative only and are not intended to limit the implementations described or claimed herein. The electronic device (400) may be referred to as a mobile device, a user device, a multifunction device, a portable device, or a server.
[0103] According to one embodiment, the electronic device (400) may include all or at least some of the components of the electronic device (400) as described in the description section with reference to FIG. 1. For example, in various embodiments of this document, some of the illustrated components may be omitted or substituted. The electronic device (400) may include at least some of the components and / or functions of the electronic device (101) of FIG. 1. At least some of each component of the illustrated (or unillustrated) electronic device (400) may be operatively, functionally, and / or electrically connected.
[0104] The electronic device (400) may include components comprising at least one processor (410) (e.g., processor (120) of FIG. 1) (hereinafter referred to as processor (410)), at least one memory (420) (e.g., memory (130) of FIG. 1) (hereinafter referred to as memory (420)), at least one display (440) (e.g., display module (160) of FIG. 1) (hereinafter referred to as display (440)), at least one image sensor (450) (hereinafter referred to as image sensor (450)), at least one communication circuit (460) (e.g., communication module (190) of FIG. 1) (hereinafter referred to as communication circuit (460)), and / or at least one sensor (470) (hereinafter referred to as sensor (470)). The components are merely exemplary. For example, the electronic device (400) may include other components (e.g., power management integrated circuitry (PMIC), audio processing circuit, antenna, rechargeable battery, or input / output interface). For example, some components may be omitted from the electronic device (400). For example, some components may be integrated into a single component.
[0105] The processor (410) can perform application layer processing functions required by the user of the electronic device (400). According to one embodiment, the processor (410) can provide control and commands for functions for various blocks of the electronic device (400). According to one embodiment, the processor (410) can perform operations or data processing regarding the control and / or communication of each component of the electronic device (400). For example, the processor (410) may include at least some of the configuration and / or functions of the processor (120) of FIG. 1. According to one embodiment, the processor (410) may be operatively connected to the components of the electronic device (400). According to one embodiment, the processor (410) may load commands or data received from other components of the electronic device (400) into memory (420), process commands or data stored in memory (420), and store result data.
[0106] The processor (410) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (410) may include at least one electrical circuit and may individually and / or collectively process instructions (or programs, data, etc.) stored in memory (420). The processor (410) may include a processor assembly comprising one or more processing circuitries and / or executable program elements.
[0107] The processor (410) may include any processing circuit operative to control the performance and operation of one or more components of the electronic device (400) (e.g., memory (420), display (440), image sensor (450), communication circuit (460), and / or sensor (470)). For example, the processor (410) may be an application processor (AP). For example, the processor (410) may be a system semiconductor responsible for various functions of the electronic device (400) (e.g., computation and multimedia driving functions). The processor (410) may be implemented as a system on chip (SoC) (e.g., a single chip or a chipset). For example, the processor (410) may be implemented as multiple cores (or at least one core circuit), multiple chips, or multiple chipsets. For example, the processor (410) may include one or more processing circuits. For example, the processor (410) may include one or more processing circuits configured to perform the various functions of the present disclosure individually and / or collectively. As an example without limitation, at least a portion of the processor (410) may be included in a first chip of the electronic device (400), and at least another portion of the processor (410) may be included in a second chip of the electronic device (400) that is different from the first chip of the electronic device (400).
[0108] For example, the processor (410) may include a central processing unit (CPU) (411), a graphics processing unit (GPU) (412), a neural processing unit (NPU) (413), an image signal processor (ISP) (414), a display controller (415), a memory controller (416), a storage controller (417), a communication processor (CP) (418), and / or a sensor interface (419). These components of the processor (410) are merely exemplary. For example, the processor (410) may include other components. For example, some components of the processor (410) may be omitted from the processor (410). For example, some components of the processor (410) may be included as separate components of the electronic device (400) outside of the processor (410). For example, some components of the processor (410) (e.g., memory controller (416)) may be included within other components (e.g., at least part of memory (420), an interface (e.g. available for connection to at least one component of the electronic device (400)), a display (440) and / or an image sensor (450)).
[0109] The processor (410) can cause other components of the electronic device (400) to perform various operations by executing instructions stored in memory (420).
[0110] The CPU (411) (or central processing circuit) may be configured to control the components of the processor (410) based on the execution of instructions stored in memory (420) (e.g., volatile memory (421) and / or non-volatile memory (422)). The CPU (411) may decode user commands and perform arithmetic and logical operations, and / or data processing operations. For example, the CPU (411) may be responsible for the functions of memory, interpretation, operation, and control. The CPU (411) may execute all software of the electronic device (400) (e.g., application (146) of FIG. 1) on an operating system (OS) and control hardware devices.
[0111] The CPU (411) can store instructions or data in the volatile memory (421) of the memory (420) (e.g., the volatile memory (132) of FIG. 1) as at least part of the data processing or operation, process the instructions or data stored in the volatile memory (421), and store the result data in the non-volatile memory (422) of the memory (420) (e.g., the non-volatile memory (134) of FIG. 1).
[0112] The CPU (411) may include a single processor core or multiple processor cores. The CPU (411) may be a programmable processor capable of storing executable instructions (e.g., instructions capable of performing operations on the CPU (411)) and executing the instructions.
[0113] The CPU (411) may operate in a multi-domain environment. The CPU (411) may operate in a domain of a normal world (e.g., a non-secure world, a framework, or a non-secure environment) and a multi-domain environment of a secure world (e.g., a security framework or a security environment). In one embodiment, a domain of the secure world may include one or more domains (e.g., a trusted OS, a Trustzone, and / or a virtualization framework).
[0114] The GPU (412) (or graphics processing circuit) may be configured to perform parallel operations (e.g., rendering). The GPU (412) may be responsible for graphics processing. The GPU (412) may receive instructions from the CPU (411) and perform graphics processing to represent the shape, position, color, shade, movement, and / or texture of objects (or things) on the display (440).
[0115] The NPU (413) (or neural processing circuit, or AI (artificial intelligence) chip) can be configured to execute computations (e.g., convolution computations) for artificial intelligence models. The NPU (413) can perform processing optimized for deep-learning algorithms of artificial intelligence. The NPU (413) is a processor optimized for deep-learning algorithm computations (e.g., artificial intelligence computations) and can process big data quickly and efficiently like a human neural network. For example, the NPU (413) can be primarily used for artificial intelligence computations. The NPU (413) can perform processing such as automatically adjusting the focus by recognizing objects, environments, and / or people in the background when capturing video through a camera, automatically switching the camera's shooting mode to food mode when taking food photos, and / or removing only unnecessary subjects from the captured results. The NPU (413) can perform processing to generate response content based on given information (e.g., natural language).
[0116] The ISP (414) (or image signal processing circuit) may be configured to process a raw image acquired through an image sensor (450) into a format suitable for components within the electronic device (400) or components of the processor (410). For example, the ISP (414) may be responsible for image processing and correction of images and videos. The ISP (414) may correct unprocessed data (e.g., raw data) transmitted from the image sensor (450) of a camera (e.g., camera module (180) of FIG. 1) to generate an image in a form more preferred by the user. The ISP (414) may perform post-processing such as adjusting the partial brightness of the image and emphasizing detailed parts. For example, the ISP (414) may independently undergo a process of image quality tuning and correction of the image acquired through the camera to generate a result preferred by the user.
[0117] The ISP (414) can support artificial intelligence-based image processing technology. The ISP (414) can support scene segmentation (e.g., image segmentation) technology that recognizes and / or classifies parts of the scene being captured in conjunction with the NPU (413). For example, the ISP (414) may include a function to process objects such as the sky, bushes, and / or skin by applying different parameters. The ISP (414) can detect and display a human face during video capture using artificial intelligence functions, or use the coordinates and information of the face to adjust the brightness, focus, and / or color of the image.
[0118] According to one embodiment, the electronic device (400) can support integrated machine learning processing by interacting with all processors such as a CPU (411), GPU (412), NPU (413), and ISP (414).
[0119] A display controller (415) (or display control circuit, or DPU (display processing unit)) may be configured to process an image obtained from a CPU (411), GPU (412), ISP (414), or memory (420) (e.g., volatile memory (421)) into a format suitable for display (440).
[0120] The memory controller (416) (or memory control circuit) may be configured to control reading data from the volatile memory (421) and writing data to the volatile memory (421).
[0121] The storage controller (417) (or storage control circuit) may be configured to control reading data from non-volatile memory (422) and writing data to non-volatile memory (422).
[0122] The CP (418) (or communication processing circuit) may be configured to process data obtained from a component of the processor (410) into a format suitable for transmitting to another electronic device via the communication circuit (460), or to process data obtained from another electronic device via the communication circuit (460) into a format suitable for processing by a component of the processor (410). For example, the communication circuit (460) may include one or more communication circuits.
[0123] The sensor interface (419) (or sensing data processing circuit, sensor hub) may be configured to process data regarding the state of the electronic device (400) and / or the state around the electronic device (400), obtained through the sensor (470), into a format suitable for the components of the processor (410).
[0124] According to one embodiment, the processor (410) can operate in a normal mode (or normal world) and a secure mode (or secure world). According to one embodiment, the processor (410) can control (or process) the overall operation related to distinguishing and providing notifications by importance through a notification panel (or notification screen) based on processing circuits and / or executable program elements. According to one embodiment, the processor (120) can control (or process) the overall operation related to managing the score (or ranking) of notifications according to the importance of the individual user, displaying notifications of a type deemed more important in a place easily visible to the user on the notification panel, and positioning notifications that are not important (e.g., less important notifications and / or unnecessary notifications) further down on the notification panel so that the user can more conveniently check important notifications and non-important notifications. According to one embodiment, the processor (120) can control (or process) the overall operation related to summarizing and providing important notifications having defined conditions (e.g., a conversation-type notification containing at least two conversations or an email-type notification containing long content) in a notification panel.
[0125] According to one embodiment, the processor (410) may receive a notification through a communication circuit (460). For example, the processor (410) may receive a signal containing a notification through the communication circuit (460). According to one embodiment, the processor (410) may identify the priority of the notification based on the verification (or analysis) of personal data (and / or learning data) related to the notification. According to one embodiment, the processor (410) may select an area within the display (440) to display the notification based on the priority of the notification. According to one embodiment, the processor (410) may identify whether the notification has a defined condition if the selected area is a defined area (e.g., a first area). According to one embodiment, if the notification has a defined condition, the processor (410) may provide a summary of the content of the notification. For example, the processor (410) may obtain data related to the summary based on a prompt for generating data related to the notification. For example, the processor (410) can use the acquired data to provide a summary of the contents of the notification of the selected area.
[0126] According to one embodiment, the processor (410) can detect the occurrence of a notification. According to one embodiment, the processor (410) can analyze personalized data (and / or training data) related to the notification. According to one embodiment, the processor (410) can identify the priority (or importance) of the notification based on the data analysis. According to one embodiment, the processor (410) can assign (or place) the notification to a first area or a second area of the notification panel based on the priority of the notification. According to one embodiment, when assigning (or placing) the notification to the first area, the processor (410) can identify whether the notification has a defined condition. According to one embodiment, if the notification has a defined condition, the processor (410) can generate a prompt containing content to generate data (or a summary) regarding the content of the notification. According to one embodiment, the processor (410) can transmit the prompt to an on-device and / or server-side generative artificial intelligence (AI). According to one embodiment, the processor (410) can obtain data (or a summary) based on a prompt. According to one embodiment, the processor (410) can update the content of a notification assigned to a first area based on the obtained data.
[0127] According to one embodiment, the processor (410) may provide a different configuration of notification panels corresponding to the screen size of the display (440). For example, the processor (410) may configure a first notification panel corresponding to the first screen size of the display (440) and a second notification panel corresponding to the second screen size of the display (440) (e.g., a screen size larger than the first screen size) differently (e.g., a plurality of notification panels distinguished by corresponding to the display area of the display), and may display different notification panels depending on the screen size of the display (440). According to one embodiment, the processor (410) may provide notification panels corresponding to the screen size and / or display area of the plurality of displays (440) and / or the display (440) of the electronic device (101).
[0128] According to one embodiment, the detailed operation of the processor (410) (e.g., processor (120) of FIG. 1) of the electronic device (400) (e.g., electronic device (101) of FIG. 1) is described with reference to the drawings described below.
[0129] According to one embodiment, operations performed by the processor (410) may be implemented by executing instructions stored in a recording medium (or computer program product or storage medium). For example, the recording medium may include a non-transitory computer-readable recording medium that records a program for executing various operations performed by the processor (410).
[0130] The embodiments described in this disclosure may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof. According to a hardware implementation, the operations described in one embodiment may be implemented using at least one of application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, and / or other electrical units for performing functions.
[0131] In one embodiment, a computer-readable recording medium (or computer program product or storage medium) is provided that records a program to perform (or execute) various operations in an electronic device (400).
[0132] The above operations may include: an operation to detect the occurrence of a notification; an operation to analyze personalized data related to the notification; an operation to identify the priority of the notification based on the data analysis; an operation to assign (or place) the notification to a first area or a second area of the notification panel based on the priority of the notification; an operation to identify whether the notification has a defined condition when the notification is assigned (or placed) to the first area; an operation to generate a prompt containing content to generate data (or a summary) regarding the content of the notification when the notification has a defined condition; an operation to transmit the prompt to a generative artificial intelligence on the device and / or server; an operation to obtain data (or a summary) based on the prompt; and an operation to update the content of the notification assigned (or placed) to the first area based on the obtained data (or summary).
[0133] The memory (420) includes at least some of the configuration and / or functions of the memory (130) of FIG. 1 and can store software (e.g., the program (140) of FIG. 1 and / or the application (146) of FIG. 1). The memory (420) may include one or more storage media (or one or more storage devices). For example, the memory (420) may include a memory assembly comprising one or more storage media. For example, the one or more storage media may include a hard drive, a permanent memory such as flash memory, read-only memory (ROM) (e.g., non-volatile memory (422)), a semi-permanent memory such as random access memory (RAM) (e.g., volatile memory (421)), any other suitable type of storage (or storage assembly), or any combination thereof.
[0134] The memory (420) may include a cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (400). As an example, but not limited to, the cache memory may be included within the processor (410).
[0135] The memory (420) can be fixedly embedded in the electronic device (400) or incorporated into one or more suitable types of components (e.g., a SIM (subscriber identity module) card and / or an SD (secure digital) card) that can be repeatedly inserted into and removed from the electronic device (400).
[0136] For example, memory (420) may store one or more software applications, such as operating system (OS) (or system) software applications, firmware software applications, driver software applications, plugin (e.g., add-in, add-on, and / or applet) software applications, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by the processor (410). For example, memory (420) may store instructions that can be called by an application programming interface (API). For example, memory (420) may store instructions within a library.
[0137] The memory (420) can store various data used by at least one component of the electronic device (400) (e.g., processor (410)). In one embodiment, the data may include software (e.g., program (140) of FIG. 1) (e.g., operating system (142), middleware (144), and / or application (146) of FIG. 1) and input data or output data for commands associated with the software.
[0138] The memory (420) may include a volatile memory (421) (e.g., the volatile memory (132) of FIG. 1) or a non-volatile memory (422) (e.g., the non-volatile memory (134) of FIG. 1). The memory (420) may store instructions or data received from the processor (410) in the volatile memory (421), and may store result data processed by the processor (410) from the instructions or data stored in the volatile memory (421) in the non-volatile memory (422).
[0139] In one embodiment, the data stored in the memory (420) may include personalized data and / or training data. In one embodiment, the personalized data may include various data related to the user's contacts, people the user frequently contacts, people allowed to not disturb, frequency of message usage, and / or preferences for notifications (or applications). In one embodiment, the training data may include data learned based on machine learning regarding the user's notification usage. According to one embodiment, the personalized data and / or training data may include various data such as usage history of notifications, usage history of applications associated with notifications, relationships between notifications, contact information of the other party associated with notifications, relationships with the other party, frequency of contact, etc. In one embodiment, the data stored in the memory (420) may include information related to rankings (ranking, importance value, etc.) related to notifications.
[0140] In one embodiment, the data stored in the memory (420) may include the original content (or data) of the notification and a summary (or data) summarized based on the original content of the notification. In one embodiment, the summary may include content (e.g., summary text) generated (or produced) based on generative artificial intelligence (generative AI) based on the content of the notification. In one embodiment, the data stored in the memory (420) may include various information related to the configuration of the notification panel based on the notification (e.g., setting information, ranking information, description information for the notification, and / or notification placement information, etc.). The various data (or information) stored in the memory (420) is not limited thereto and may include various data (or information) described with reference to the drawings described below.
[0141] In one embodiment, the data stored in the memory (420) may include various learning data and / or parameters obtained based on the user's learning through interaction with the user. In one embodiment, the data may include various schemas (or algorithms, models, networks, or functions) to support artificial intelligence-based operations (e.g., artificial intelligence-based operations related to distinguishing and providing notifications according to importance through a notification panel (or notification screen)).
[0142] In one embodiment, the fields in which artificial intelligence technology is applied may be diverse. For example, it may consist of technology fields of linguistic understanding, visual understanding, reasoning / prediction, knowledge representation, and / or motion control. Linguistic understanding is a technology that recognizes and applies / processes human language / characters, and may include natural language processing, machine translation, dialogue systems, question answering, and / or speech recognition / synthesis. Visual understanding is a technology that recognizes and processes objects like human vision, and may include object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and / or image enhancement. Reasoning / prediction is a technology that judges information to logically reason and predict, and may include knowledge / probability-based reasoning, optimization prediction, preference-based planning, and / or recommendation. Knowledge representation is a technology that automates the processing of human experience information into knowledge data, and may include knowledge construction (e.g., data generation / classification) and / or knowledge management (e.g., data utilization). Motion control is a technique for controlling the movement of an electronic device (200) and may include motion control and / or operation control (e.g., behavior control).
[0143] In one embodiment, a schema for supporting artificial intelligence-based operation in an electronic device (400) may include a neural network. In one embodiment, the neural network may include a neural network model based on at least one of an artificial neural network (ANN), a convolutional neural network (CNN), a region with convolutional neural network (R-CNN), a region proposal network (RPN), a recurrent neural network (RNN), a stacking-based deep neural network (S-DNN), a state-space dynamic neural network (S-SDNN), a Deconvolution Network, a deep belief network (DBN), a restricted Boltzmann machine (RBM), a long short-term memory (LSTM) network, a classification network, a plain residual network, a dense network, a hierarchical pyramid network, and / or a fully convolutional network. According to one embodiment, the types of neural network models are not limited to the examples described above.
[0144] According to one embodiment, the memory (420) can store instructions that cause the electronic device (200) to perform an operation when executed individually and / or collectively by the processor (410).
[0145] According to one embodiment, the memory (420) may store instructions that, when executed individually and / or collectively by the processor (410), allow the electronic device (400) to detect the occurrence of a notification, analyze personalized data related to the notification, identify the priority of the notification based on the data analysis, assign (or place) the notification to a first area or a second area of the notification panel based on the priority of the notification, identify whether the notification has a defined condition when the notification is assigned (or placed) to the first area, generate a prompt containing content to generate data (or a summary) regarding the content of the notification when the notification has a defined condition, transmit the prompt to a generative artificial intelligence on the device and / or server, obtain data (or a summary) based on the prompt, and update the content of the notification assigned (or placed) to the first area based on the obtained data (or summary).
[0146] Instructions can be stored as software (e.g., program (140) of FIG. 1) in memory (420) and can be executed by a processor (410). For example, instructions may include control commands such as arithmetic and logical operations, data movement, and / or input / output that can be recognized by the processor (410). According to one embodiment, the software may include various applications (e.g., application (146) of FIG. 1) that can provide various functions (or services) (e.g., notification function, learning function, content creation function, AI service function, conversational service function, routine function, search function, context awareness function, prompt generation function, call function, message function, messenger function, email function, social networking service (SNS) function, media (e.g., video and / or music) playback function, game function, and / or wireless communication function) in an electronic device (400).
[0147] The display (440) may include a configuration identical or similar to the display module (160) of FIG. 1. The display (440) may display various images provided by the processor (410). Under the control of the processor (410), the display (440) may visually provide various screens related to an application being executed (e.g., the application (146) of FIG. 1) and its use (e.g., contents screen, application execution screen, menu screen, and / or function execution screen). According to one embodiment, the display (440) may display a screen that provides notifications distinguished by importance through a notification panel (or notification screen).
[0148] According to one embodiment, the display (440) may have a screen size that changes according to the form factor of the electronic device (400) (e.g., a bar-type smartphone (491-1), a foldable-type smartphone (491-2), or a sliderable (or rollable)-type smartphone (491-3)), or a tablet (492)). For example, the display (440) may be configured to provide a first state having a first screen size and a second state having a second screen size larger than the first screen size. According to one embodiment, the display (440) may display a screen in which notifications of a notification panel are distinguished according to the screen size and / or display area.
[0149] According to one embodiment, the electronic device (400) may include an electronic device of the form of a foldable electronic device (e.g., a foldable type smartphone (491-2)) (e.g., including a multi-foldable electronic device). For example, the electronic device (400) may be a foldable electronic device of various forms such as a G-type, Z-type, or e-type. According to one embodiment, if the electronic device (400) is in the form of a multi-foldable electronic device, the electronic device (400) may include a first housing, a second housing, and a third housing. According to one embodiment, the electronic device (400) may provide different information displays depending on the state of the display (440) of the electronic device (400) (or the size of the displayed screen (or screen display area)) (e.g., flex state (or intermediate mode)), such as when the first housing is folded or when the first housing and the third housing are folded together.
[0150] In one embodiment, the operation when the electronic device (400) is a foldable electronic device is merely illustrative and is not intended to limit the implementations described or claimed in this document, and the implementation of the present disclosure may be implemented in various devices such as smartphones, wearable devices, laptop computers, home appliances, and / or vehicles equipped with a notification function.
[0151] The display (440) may be combined with a touch sensor, a pressure sensor capable of measuring the intensity of the touch, and / or a touch panel (e.g., a digitizer) that detects a magnetic field-based stylus pen. The display (440) may detect touch input, air gesture input, and / or hovering input (or proximity input) by measuring a change in a signal (e.g., voltage, light intensity, resistance, electromagnetic signal, and / or charge quantity) at a specific location on the display (440) based on the touch sensor, pressure sensor, and / or touch panel. For example, the display (440) may include a touchscreen that detects touch and / or proximity touch (or hovering) input using a part of the user's body (e.g., a finger) or an input device (e.g., a stylus pen).
[0152] The display (440) may include, but is not limited to, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, and / or an active matrix OLED (AMOLED) display, a micro electro mechanical systems (MEMS) display, or an electronic paper display. According to one embodiment, the display (440) may include a flexible display.
[0153] The communication circuit (460) can support the establishment of a designated wireless communication channel (e.g., short-range communication such as Bluetooth communication and / or BLE communication) and the performance of communication through the established wireless communication channel. For example, the communication circuit (460) can perform designated communication (e.g., Bluetooth communication and / or BLE communication) with an external device. The communication circuit (460) can support wireless communication with an external device using cellular wireless communication (e.g., 4G LTE, 5G NR) and / or short-range wireless communication (e.g., Wi-Fi). For example, the electronic device (400) can use the communication circuit (460) to communicate with an external server (e.g., generative artificial intelligence server, intelligent server (300)) that provides artificial intelligence-based functions (e.g., conversational services or assistant services or AI agents) over a network. According to one embodiment, the communication circuit (460) can transmit data generated from the electronic device (400) to an external server and receive data transmitted from an external server. The communication circuit (460) may include at least some of the configuration and / or functions of the communication module (190) of FIG. 1.
[0154] In one embodiment, the electronic device (400) may include an artificial intelligence-based function within an AI engine (or module or model) (e.g., including a processing circuit) within the electronic device (400). For example, the AI engine may be operatively coupled with at least one processor of the electronic device (400) (e.g., processor (120), processor (230), or processor (410)). For example, the AI engine may be operatively coupled with a sensor of the electronic device (400) for one or more sensors within the electronic device (400) (e.g., sensor module (176), sensor (470), or sensor interface (419)).
[0155] FIG. 5 is a block diagram illustrating a notification management system according to one embodiment of the present disclosure.
[0156] According to one embodiment, FIG. 5 may represent components of an exemplary notification management system (500) capable of performing the operations described herein. The components may be included individually or collectively in an electronic device (101, 201, 400) (hereinafter referred to as electronic device (101)), a processor (120, 230, 410) of the electronic device (101) (hereinafter referred to as processor (120)), and / or a server (e.g., the intelligent server (300) of FIG. 3).
[0157] Referring to FIG. 5, a notification management system (500) according to one embodiment may include a notification processing engine (501) and artificial intelligence (or an AI engine or AI module) (550). According to one embodiment, the notification processing engine (501) may include components including a notification manager (510), a personal data processing engine (520), a notification panel processing engine (530), a monitoring engine (550), and / or a settings management engine (540). The components are merely exemplary. For example, the notification management system (500) may include other components. For example, some components may be omitted from the electronic device (101). For example, some components may be integrated into a single component. For example, artificial intelligence (550) may be included in the notification processing engine (501).
[0158] According to one embodiment, a notification manager (510) can collect and manage notifications of an electronic device (101). In one embodiment, notifications may include various notifications, such as notifications received from an external device (e.g., another electronic device and / or server) (e.g., external notifications) and notifications generated by an application or system (or service) on the electronic device (101) (e.g., internal notifications). According to one embodiment, the notification manager (510) can detect notifications generated by each application of the external device and / or electronic device (101), classify the generated notifications according to importance (or priority), and manage the overall operation (or processing) related to delivering notifications to the user via a notification panel.
[0159] According to one embodiment, the personal data processing engine (520) may collect various personal data related to the user and / or machine learning-based training data related to the user, such as the user's contacts, people the user frequently contacts, people allowed to not disturb, message usage frequency, and / or notification (or application) preferences. According to one embodiment, the personal data processing engine (520) may analyze the collected data and evaluate the importance (or priority) of notifications based on the results of the analysis. For example, the personal data processing engine (520) may identify contacts or important relationships with the user that they frequently communicate with and set the priority of the corresponding notifications. In one embodiment, the personal data processing engine (520) may be referred to as a personal data engine (PDE) or a personal data core (PDC).
[0160] According to one embodiment, the notification panel processing engine (or notification panel UI engine) (530) may be an interface processing engine (or module) that visually provides notifications to a user. According to one embodiment, the notification panel processing engine (530) may provide notifications by configuring a notification panel (or notification screen) divided into areas corresponding to a first notification having a first condition (or first priority) (e.g., a first important notification), a second notification having a second condition (or second priority) (e.g., a second important notification that is relatively less important than the first important notification), and a third notification having a third condition (or third priority) (e.g., a notification of low importance or a non-important notification). For example, the notification panel processing engine (530) may divide the notification panel into a first area for notifications of high importance and a second area for notifications of low importance, and the first area may be divided into a main area for the first important notification and a sub-area for the second important notification, thereby providing an interface to the user so that notifications can be efficiently checked according to importance.
[0161] According to one embodiment, the monitoring engine (550) may be referred to, for example, as a notification activity background monitoring module (e.g., a notification manager service). According to one embodiment, the monitoring engine (550) operates in the background of the electronic device (101) and, when a notification occurs (or is received), grasps (or analyzes) the notification and can filter out notifications of low importance and / or promotional notifications. For example, the monitoring engine (550) can function to minimize user distraction caused by unnecessary notifications. According to one embodiment, the monitoring engine (550) can provide automation of notification filtering and classification. For example, the monitoring engine (550) can automatically filter out advertisements, old notifications, and / or background notifications and move them to the bottom of the notification panel (e.g., a third area).
[0162] According to one embodiment, the setting management engine (540) can manage various settings related to notification operation in the electronic device (101). For example, the setting management engine (540) can support various user settings related to notifications. According to one embodiment, the setting management engine (540) can support the user in setting the priority (or importance) of the notification, the area placement of the notification, the summary function, and / or filtering options (or conditions), etc. According to one embodiment, the user can customize the operation of the notification management system (500) to suit their needs.
[0163] According to one embodiment, the artificial intelligence (550) may be referred to, for example, as an AI engine or an AI module. According to one embodiment, the artificial intelligence (550) may include an on-device AI engine implemented within an electronic device (101) and / or a server AI engine implemented in a server (e.g., an intelligent server (300)). According to one embodiment, the artificial intelligence (550) may analyze data (or metadata) related to a notification based on personalized data (and / or training data) to determine (or judge) the priority (or importance) and / or ranking (or rank) of the notification. According to one embodiment, the artificial intelligence (550) may analyze the content of the notification and summarize the content of the notification. According to one embodiment, the artificial intelligence (550) may generate and provide to the user a summary based on the content (or key content) of a conversational type notification or an email-type notification containing long content (e.g., more than a set character count).
[0164] According to one embodiment, artificial intelligence (550) may be an AI component that uses a machine learning algorithm or a neural network. For example, artificial intelligence (550) may use a large language model (LLM), a large vision model (LVM), or a large multimodal model (LMM).
[0165] According to one embodiment, artificial intelligence (550) may refer to an artificial intelligence neural network that generates new forms of data based on input information (e.g., personalized data). According to one embodiment, artificial intelligence (550) may include an image generation model and / or a language generation model. The image generation model may include a generative adversarial network (GAN) and / or a variational autoencoder (VAE). An example of an image generation model is a diffusion-based generative model that uses the structure of a VAE and a Transformer. Additionally, the language generation model is a model trained to output the statistically most appropriate output value based on input values, and representative examples include models such as GPT 3, GPT 4, BARD (or Gemini), BERT, PaLM, and / or LLaMA. Additionally, artificial intelligence (550) may recognize various forms of data input, such as text, images, and / or speech, and generate new data corresponding to them.
[0166] According to one embodiment, the artificial intelligence (550) may use an AI engine from an external source (e.g., a server) or an AI engine of an electronic device (101) (e.g., on-device artificial intelligence) with the user's consent to use the service, in order to prepare for the possibility of privacy issues arising from the user's use of the service.
[0167] According to one embodiment, artificial intelligence (550) can determine the priority (or importance) of a notification by extracting an AI intent / AI entity through natural language processing (NLP). In one embodiment, an intent may represent a technical concept of NLP for identifying the intent or purpose of a notification. For example, in the content "Today's Seoul weather," the intent of the notification may be "weather," and an intent classification model may be used to identify this intent. In one embodiment, the intent classification model may include a model that receives text as input and classifies what intent the input text represents. In one embodiment, an entity may represent a word or phrase representing a specific object or data. For example, in the content "Today's Seoul weather," "Today" may represent a time entity, "Seoul" may represent a region entity, and "weather" may represent a weather entity. According to one embodiment, an entity recognition model may recognize entities in text and extract necessary information based on them.
[0168] According to one embodiment, the artificial intelligence (550) can classify the notifications by adding various positive or negative vectors to determine the ranking (or rank) of the notifications, in addition to undergoing a process of converting the notifications into vector values through a vectorization operation. For example, the artificial intelligence (550) can assign a higher ranking to the notification if the notification contains metadata (or vector values) based on personalized data. For example, the artificial intelligence (550) can construct the vector values by mixing in content corresponding to personalization. For example, if the artificial intelligence determines based on personalized data that the user dislikes the advertisement, it may assign a negative value to the vector values for notifications containing advertisements and / or notifications classified as advertisements, thereby assigning a lower ranking to the notifications.
[0169] According to one embodiment, all or at least part of the aforementioned operation (or function) of the artificial intelligence (550) may be integrated into the processor (120) (or notification management system (500)).
[0170] According to one embodiment, the electronic device (101) can provide user-customized notifications through the aforementioned operation (or function), thereby prioritizing the exposure of important information and placing less important notifications at the bottom.
[0171] According to one embodiment, the electronic device (101) may classify notifications based on their importance and arrange areas of the notifications in the notification panel. For example, the electronic device (101) may evaluate the importance and / or urgency of the notifications and divide the areas of the notification panel into a plurality of areas (e.g., three areas). For example, the electronic device (101) may provide a notification panel divided into a first area for a notification having a first priority (or first condition), a second area for a notification having a second priority (or second condition), and a third area for a notification having a third priority (or third condition). In one embodiment, the first area may be an area where a first notification (e.g., a notification related to family, work contact, etc.) is placed (or assigned or designated) and may be placed at the top of the notification panel. In one embodiment, the second area may be an area where a second notification (e.g., a notification with relatively lower importance compared to the first notification) is placed and may be placed in the center of the notification panel. In one embodiment, the third area may be an area where a third notification (e.g., a notification of low importance such as an advertisement or an unnecessary notification) is placed, and may be placed at the bottom as a single group (or bundle) in the notification panel.
[0172] According to one embodiment, the detailed operation of the processor (120) (or notification management system (500)) of the electronic device (101) is described with reference to the drawings described below.
[0173] An electronic device according to one embodiment of the present disclosure (e.g., the electronic device (101, 201, 400) of FIG. 1, FIG. 2, FIG. 4, or FIG. 5) (hereinafter referred to as electronic device (101)) comprises a display (e.g., the display module (160) of FIG. 1 or the display (440) of FIG. 4) (hereinafter referred to as display (160)), communication circuitry (e.g., the communication module (190) of FIG. 1 or the communication circuitry (460) of FIG. 4) (hereinafter referred to as communication circuitry (190)), at least one processor (e.g., the processor (120, 230, 410) of FIG. 1, FIG. 2, or FIG. 4)) (hereinafter referred to as processor (120)) comprising processing circuitry, and a memory (e.g., the memory (130) of FIG. 1, FIG. 2, or FIG. 4, It may include 240, 420)) (hereinafter referred to as memory (130). In one embodiment, memory (130) may store personal data (and / or learning data). In one embodiment, memory (130) may store instructions that cause the electronic device (101) to perform an operation when executed individually and / or collectively by the processor (120).
[0174] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may receive a signal including a notification through the communication circuit (190). When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may identify personalized data associated with the notification. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may identify the priority of the notification based on the identified data. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may select an area within the display (160) to display the notification based on the priority of the notification. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may identify whether the notification has a defined condition when the selected area is a first area. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may generate a prompt for generating data related to the notification when the notification has a defined condition. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may transmit the prompt to an on-device and / or server generative artificial intelligence (AI).When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may acquire data based on the prompt. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may update the content of the notification of the first area based on the acquired data.
[0175] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be able to display a notification panel through the display in response to user input.
[0176] According to one embodiment, the notification panel may include the first area and the second area distinguished from the first area.
[0177] According to one embodiment, the first area may be set at the top of the notification panel, where a notification having a first priority is placed. According to one embodiment, the second area may be set at the bottom of the notification panel, where a notification lower than the first priority is placed.
[0178] According to one embodiment, the first area may be divided into a main area and a sub area. According to one embodiment, the main area may display a first notification of a first importance level determined by an importance level determination and may arrange a predetermined number of notification cards corresponding to the first notification. According to one embodiment, the sub area may display a second notification of a second importance level determined by an importance level determination and may arrange notification cards corresponding to each of the second notifications.
[0179] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may determine the ranking of the notifications for the first area by the main area and the sub-area, and provide them sorted in descending order according to the determined ranking.
[0180] According to one embodiment, the second area may display a third notification of a third importance and group the third notifications to place a single grouping card.
[0181] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may group a plurality of notifications of the second area and provide them through a single grouping card. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may display the most recently occurred notification among the third notifications through the grouping card. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may provide the third notifications sorted in descending chronological order when the grouping card is unfolded.
[0182] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be able to identify a predetermined condition corresponding to the notification.
[0183] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may select the main area of the first area as the placement area of the notification based on the notification satisfying a first condition. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may sort the notifications of the main area based on a ranking among the notifications of the main area.
[0184] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may select a sub-region of the first region as a placement region of the notification based on the notification satisfying a second condition. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may sort the notifications of the sub-region based on a ranking among the notifications of the sub-region.
[0185] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may select the second area as the placement area of the notification based on the fact that the notification does not satisfy the first condition and the second condition. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may group the notification to a notification card in the second area and align the notification above other notifications in the second area.
[0186] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may identify other notifications that can be grouped with the notification based on the fact that the notification is assigned to a first area and the type of the notification is the type of the first condition. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may group the notification with the other notifications. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may obtain a summary generated based on the content of the notification and the content of the other notifications. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may update the contents of the grouping card of the notification and the other notification to the acquired summary.
[0187] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may place the additional notification in a designated area of the notification panel when it receives a signal including an additional notification related to the notification of the grouping card through the communication circuit. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may group the notification, the other notification, and the additional notification after a designated time has elapsed.
[0188] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be able to update and display a summary generated based on the contents of the notification, the other notification, and the additional notification through a grouping card.
[0189] According to one embodiment, groupable notifications may include notifications generated from the same application and the same sender.
[0190] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may obtain a summary generated based on the content of the notification, based on the fact that the notification is assigned to a first area and the type of the notification is the type of a second condition. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may update the content of the notification card of the notification with the obtained summary.
[0191] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may monitor the status of a notification placed in the first area. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may identify at least one notification having a defined condition, such as a notification with a ranking change and / or an old notification, based on the monitoring results. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may move the at least one notification having the defined condition to the second area.
[0192] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be made to rearrange the remaining notifications other than the notifications moved from the first area to the second area in a ranking order within the first area. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be made to rearrange the notifications moved to the second area and the notifications of the second area in a chronological order within the second area.
[0193] Hereinafter, the operation method of an electronic device (101, 201, 400) (hereinafter referred to as electronic device (101)) of various embodiments will be described in detail. Operations performed in the electronic device (101) according to various embodiments may be executed by at least one processor (120, 230, 410) (hereinafter referred to as processor (120)) comprising various processing circuitry and / or executable program elements (e.g., notification management system (500)) of the electronic device (101). According to one embodiment, operations performed in the electronic device (101) may be stored as instructions in memory (130, 240, 420) (hereinafter referred to as memory (130)) and may be performed (or executed) individually and / or collectively by the processor (120).
[0194] FIG. 6 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0195] According to one embodiment, FIG. 6 may illustrate an example of an operation (or method) in which notifications are distinguished and provided according to importance through a notification panel (or notification screen) in an electronic device (101) according to one embodiment. According to one embodiment, as illustrated in FIG. 5, the operation method performed by the electronic device (101) may include placing notifications on a notification panel according to priority (or importance) determined based on predetermined data (e.g., personalized data and / or learning data), generating a prompt related to summary generation for notifications having predetermined conditions among important notifications, and obtaining information (e.g., summary or result data) generated in relation to the prompt from an on-device and / or server based on the prompt and providing it to the user.
[0196] According to one embodiment, the artificial intelligence may include generative AI. Generative AI may represent an artificial intelligence technology that creates new content using existing content such as text, audio, and / or images. For example, generative AI may represent an artificial intelligence technology that can generate content (e.g., text, audio, images, and / or videos) corresponding to an input based on a given input (e.g., a prompt). According to one embodiment, an electronic device (101) may generate and provide a summary based on generative AI (e.g., on-device AI). According to one embodiment, the electronic device (101) may request the server to generate a summary and receive and provide the summary generated based on the server's generative AI from the server. According to one embodiment, the electronic device (101) may provide the generative AI with a prompt (or instruction or generative AI prompt) requesting the generation of a summary (e.g., instructions to input into the generative AI).
[0197] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 6. The flowchart illustrated in FIG. 6 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 601 through 617 may be performed by at least one processor (120) (or notification management system (500)) of the electronic device (101).
[0198] As illustrated in FIG. 6, the operation method performed by an electronic device (101) according to one embodiment includes: detecting the occurrence of a notification (operation 601); analyzing predetermined data related to the notification (operation 603); identifying the priority of the notification based on the data analysis (operation 605); assigning (or placing or designating) a notification (e.g., location of the notification) to a first area or a second area of a notification panel based on the priority of the notification (operation 607); identifying whether the notification has a predetermined condition when assigning the notification to the first area (operation 609); generating a prompt containing content to generate data (e.g., summary, summary data, or result data) regarding the content of the notification (e.g., message content) when the notification has a predetermined condition (operation 611); transmitting the prompt to a generative artificial intelligence (AI) on-device and / or a server (operation 613); and based on (or in relation to) the prompt It may include an operation to obtain data (e.g., summary, summary data, or result data) (operation 615), and an operation to update the content of a notification assigned to a first area based on the obtained data (operation 617).
[0199] Referring to FIG. 6, in operation 601, the processor (120) of the electronic device (101) can detect the occurrence of a notification. According to one embodiment, the processor (120) can detect a notification event. According to one embodiment, the notification event may include various notification events, such as a notification event received from an external device (e.g., another electronic device and / or server) (e.g., an external notification event) (e.g., a message reception event), or a notification event generated by an application or system (or service) in the electronic device (101) (e.g., an internal notification event) (e.g., a device or network connection event). According to one embodiment, the processor (120) can detect a notification event generated by an application in the external device and / or electronic device (101) and detect a notification corresponding to the generated notification event.
[0200] According to one embodiment, the processor (120) may provide a notification corresponding to a notification event through a designated area (or part) on the display (e.g., top center of the screen or bottom center of the screen). Examples of this are illustrated in FIGS. 7a, 7b, and 7c.
[0201] FIGS. 7a, FIGS. 7b, and FIGS. 7c are drawings illustrating examples of an operation of providing a notification in an electronic device according to one embodiment of the present disclosure.
[0202] As illustrated in FIG. 7a, when a first notification (710) corresponding to a notification event is received, the electronic device (101) may display it in a designated area (e.g., top center of the screen) in the display area (701) of the display. According to one embodiment, the electronic device (101) may provide the first notification (710) through the designated area for a set time (e.g., N seconds (e.g., N is a natural number)).
[0203] According to one embodiment, the electronic device (101) may not display the first notification (710) in the display area (701) of the display, as illustrated in FIG. 7b, when a set time has elapsed. For example, the electronic device (101) may display the first notification (710) for a set time and remove the first notification (710) from the display area (701) of the display after the set time. According to one embodiment, even if the first notification (710) is not displayed in the display area (701), it may be provided through a set area of the notification panel until it is confirmed (e.g., executed) by a user through the notification panel or an application corresponding to the first notification (710).
[0204] As illustrated in FIG. 7c, when a second notification (720) corresponding to a notification event is received, the electronic device (101) may display it in a designated area (e.g., top center of the screen) in the display area (701) of the display. According to one embodiment, the electronic device (101) may provide the second notification (720) through the designated area for a set time (e.g., N seconds (e.g., N is a natural number)).
[0205] According to one embodiment, the electronic device (101) may not display the second notification (720) in the display area (701) of the display, as illustrated in FIG. 7b, when a set time has elapsed. For example, the electronic device (101) may display the second notification (720) for a set time and remove the second notification (720) from the display area (701) of the display after the set time. According to one embodiment, even if the second notification (720) is not displayed in the display area (701), it may be provided through a set area of the notification panel until it is confirmed (e.g., executed) by the user through the notification panel or an application corresponding to the second notification (720).
[0206] The examples according to FIGS. 7a, 7b, and 7c are for the purpose of facilitating understanding of the present disclosure, and the embodiments of the present disclosure are not limited by the examples.
[0207] Referring again to FIG. 6, in operation 603, the processor (120) can analyze defined data related to a notification. In one embodiment, the defined data may include, for example, personalized data and / or learning data. For example, the processor (120) can perform data analysis based on the personalized data and / or learning data set to determine the importance of the notification. According to one embodiment, the processor (120) can collect and / or learn various user personalized data related to the user's notification preference information (e.g., user's contacts, people the user contacts frequently, people allowed to do not disturb, message usage frequency, and / or notification (or application) preference, etc.) based on machine learning or artificial intelligence. According to one embodiment, the processor (120) can determine the user's importance of the notification based on the defined data.
[0208] In operation 605, the processor (120) can identify the priority of the notifications based on data analysis. According to one embodiment, the processor (120) can identify (or determine) whether the notification belongs to a notification of a first priority (or first condition), a notification of a second priority (or second condition), or a notification of a third priority (or third condition) based on importance according to the result of the data analysis.
[0209] In operation 607, the processor (120) may assign (or place or designate) a notification (e.g., location of the notification) to a first area or a second area of the notification panel based on the priority of the notification. According to one embodiment, the processor (120) may decide to place the notification in the first area if the notification belongs to a first priority or a second priority. According to one embodiment, in the case of a notification belonging to a first priority, it may be placed in a main area separated from the first area. According to one embodiment, in the case of a notification belonging to a second priority, it may be placed in a sub-area separated from the first area. According to one embodiment, the processor (120) may decide to place the notification in the second area if the notification belongs to a third priority. In one embodiment, the first priority may have a higher rank than the second priority, and the third priority may have a lower rank than the second priority. An embodiment thereof is described with reference to the drawings described below.
[0210] In operation 609, when the processor (120) assigns a notification to a first area, it can identify whether the notification has a defined condition. According to one embodiment, the defined condition may include a conversational type notification including at least two conversations assigned to the first area, an email type notification including long content, and / or a condition in which the number of notifications received from the same application is greater than or equal to a specified number (e.g., N, N ≥ 2). For example, the processor (120) can identify whether the notification assigned to the first area is a conversational type notification or a notification of a defined type of application (e.g., an email application).
[0211] In operation 611, the processor (120) may generate a prompt containing content to generate data (e.g., summary, summary data, or result data) for the content of the notification (e.g., message content) when the notification has a defined condition. According to one embodiment, the processor (120) may determine that the notification assigned to the first area is a notification to be summarized and generate a prompt requesting the generation of a summary for the content of the notification. An embodiment thereof is described with reference to the drawings described below.
[0212] In operation 613, the processor (120) can pass the prompt to the generative artificial intelligence on the device and / or server (e.g., the intelligent server (300) of FIG. 3).
[0213] In operation 615, the processor (120) may obtain data (e.g., summary, summary data or result data) based on (or in relation to) a prompt. According to one embodiment, the processor (120) may obtain data (e.g., a summary of the content of a notification) from a generative artificial intelligence based on a prompt.
[0214] In operation 617, the processor (120) can update the content of a notification assigned to a first area based on acquired data. According to one embodiment, the processor (120) can update (or replace) the content displayed in the notification panel with the summarized content (e.g., regenerated information) for the corresponding notification assigned to the first area of the notification panel (e.g., a notification of a summary target).
[0215] FIG. 8 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0216] According to one embodiment, FIG. 8 may illustrate an example of an operation (or method) in which notifications are distinguished and provided according to importance through a notification panel (or notification screen) in an electronic device (101) according to one embodiment.
[0217] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 8. The flowchart illustrated in FIG. 8 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 801 through 817 may be performed by at least one processor (120) (or notification management system (500)) of the electronic device (101).
[0218] According to one embodiment, the operations described in FIG. 8 may be performed heuristically in combination with the operations described in FIG. 5 to 7c, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as detailed operations of at least some of the operations described.
[0219] As illustrated in FIG. 8, the operation method performed by an electronic device (101) according to one embodiment may include: receiving a notification (operation 801); analyzing a notification (operation 803); collecting metadata related to the notification (operation 805); determining the importance of the notification (operation 807); determining a condition (e.g., a first condition, a second condition, or a third condition) that the notification satisfies based on the determined importance (operation 809, operation 813); providing the notification in a first form in a first area of a notification panel based on the notification satisfying the first condition (operation 811); providing the notification in a second form in a second area of a notification panel based on the notification satisfying the second condition (operation 815); and providing the notification in a third form in a third area of a notification panel based on the notification satisfying the third condition that does not fall under the first and second conditions (operation 817).
[0220] Referring to FIG. 8, in operation 801, the processor (120) of the electronic device (101) may receive a notification. According to one embodiment, the processor (120) may include various notification events, such as a notification event received from an external device (e.g., another electronic device and / or server) (e.g., an external notification event) (e.g., a message reception event), and a notification event generated by an application or system (or service) in the electronic device (101) (e.g., an internal notification event) (e.g., a device or network connection event). According to one embodiment, the processor (120) may detect a notification event generated by an application of the external device and / or electronic device (101) and obtain a notification corresponding to the generated notification event. For example, the notification may be received from an external device (e.g., another electronic device or server) through an application. For example, the notification may be received from an internal system through an application. According to one embodiment, the processor (120) may receive a first notification and a second notification different from the first notification through an application. According to one embodiment, the processor (120) receives a first notification through a first application and can receive a second notification through a second application different from the first application.
[0221] In operation 803, the processor (120) can analyze the notification. According to one embodiment, the processor (120) can analyze (e.g., parse) data related to the notification (e.g., type of notification, information of the application that generated the notification, the sender of the notification, time of occurrence of the notification, and / or length of the content of the notification).
[0222] In operation 805, the processor (120) can collect metadata related to the notification. According to one embodiment, the processor (120) can collect metadata such as the sender, content, time of occurrence, and / or application type of the notification based on the notification analysis. According to one embodiment, the processor (120) can use the metadata to identify and classify the context of the notification.
[0223] In operation 807, the processor (120) can determine the importance (or importance value) of a notification. According to one embodiment, the processor (120) can use personalization data (and / or training data) to determine the user's preference for the notification (e.g., frequency of contact with the sender of the notification, relationship, intimacy, and / or do not disturb allowed contacts or applications, etc.) and evaluate (or re-evaluate) the importance of the notification based thereon. According to one embodiment, the processor (120) can evaluate the importance for each notification (e.g., a first notification and a second notification) and set the importance (or importance value) for each notification differently.
[0224] In operation 809, the processor (120) may determine whether a notification satisfies a first condition based on a determined importance. In one embodiment, the first condition (or first priority) may be a condition for classifying a first important notification having a high importance (or importance value). For example, a notification that is highly preferred by the user (e.g., a notification where the relationship with the sender of the notification is family, the relationship with the sender of the notification is a close friend, or the frequency of contact with the sender with whom the user has a relationship is high, etc.) or a notification that is given urgency (e.g., a time-sensitive notification such as a meal invitation, a business meeting, or a delivery) may have a high importance and may be classified as a notification that satisfies the first condition.
[0225] In operation 809, if the notification satisfies the first condition (e.g., 'Yes' of operation 809), the processor (120) may, in operation 811, provide the notification by arranging it in a first form in the first area of the notification panel. According to one embodiment, the processor (120) may place the notification of the first condition in the first area of the notification panel (e.g., the top part of the notification panel) in a predetermined ranking order. According to one embodiment, the processor (120) may set a predetermined effect (e.g., applying highlight, applying color, applying edge lighting, etc.) for the notification placed in the first area to distinguish it from other notifications. According to one embodiment, the processor (120) may provide notifications individually (or independently) without grouping them in the first area, even if they are notifications of the same application, if they are not notifications by the same sender (e.g., conversation notifications). For example, if the first notification and the second notification placed in the first area are notifications from the same sender of the same application, the first notification and the second notification may be grouped and provided as a single form. For example, if the first notification and the second notification placed in the first area are notifications from different senders of the same application, the first notification and the second notification may not be grouped and may be provided separately according to their respective rankings. In one embodiment, notification placement and grouping based on ranking within the area of the notification panel will be described later.
[0226] In operation 809, if the notification does not satisfy the first condition (e.g., 'No' in operation 809), the processor (120) may determine in operation 813 whether the notification satisfies the second condition based on the determined importance. In one embodiment, the second condition (or second priority) may be a condition for classifying a second important notification (or general notification) of relatively low importance.
[0227] In operation 813, if the notification satisfies the second condition (e.g., 'Yes' in operation 813), the processor (120) may, in operation 815, provide the notification by arranging it in a second form in the second area of the notification panel. According to one embodiment, the processor (120) may place the notifications of the second condition in the second area of the notification panel (e.g., the central part of the notification panel) in a predetermined ranking order. According to one embodiment, the processor (120) may provide the notifications individually (or independently) without grouping them in the second area, even if they are notifications of the same application, if they are not notifications by the same sender (e.g., conversation notifications). In one embodiment, the placement and grouping of notifications based on ranking within the area of the notification panel will be described later.
[0228] In operation 813, if the notification does not satisfy the second condition (e.g., 'No' in operation 813), the processor (120) may, in operation 817, provide the notification by aligning it in a third form in a third area of the notification panel. According to one embodiment, if the notification does not satisfy the first and second conditions, it may be determined that the notification satisfies the third condition. In one embodiment, the third condition may be a condition for classifying notifications that are of low importance or non-urgent, other than the first and second conditions. For example, advertising notifications, old notifications (e.g., important notifications or general notifications, but more than a set amount of time (e.g., about 24 hours) has passed since receipt), notifications that run in the background without running an application, and / or notifications designated as having low importance in the application, etc., may be of low importance and may be classified as notifications satisfying the third condition. For example, if a notification satisfies a third condition that does not fall under the first and second conditions, the processor (120) may group the notification with other notifications that fall under the third condition and place it in a third area of the notification panel (e.g., the bottom part of the notification panel). According to one embodiment, the processor (120) may not stack notifications in the third area, position the most recent notification of the third condition at the top, and group the remaining notifications of the third condition in chronological order so that a single notification is displayed.
[0229] As illustrated in FIG. 8, the processor (120) may provide notifications differently based on the importance of the notifications. For example, when a notification occurs, the processor (120) may establish internal criteria to classify it into important notifications and non-important notifications, place important notifications at the top of the notification panel so that the user can check them immediately, and gather non-important notifications separately and place them at the bottom of the notification panel so that the user can easily determine the importance of the notifications.
[0230] According to one embodiment, the processor (120) can determine an importance (e.g., a first importance value for the first notification and a second importance value for the second notification) corresponding to each notification (e.g., a first importance value for the first notification and a second importance value for the second notification). According to one embodiment, the processor (120) can provide at least one notification satisfying a specified first condition among the first importance value for the first notification and the second importance value for the second notification in a first form to a first area of the notification panel. According to one embodiment, the processor (120) can provide at least one other notification satisfying a specified second condition different from the specified first condition in a second form to a second area separated from the first area of the notification panel. According to one embodiment, the processor (120) can provide at least one notification not satisfying the first and second conditions (e.g., satisfying a specified third condition) in a third form to a third area separated from the second area.
[0231] According to one embodiment, the processor (120) may divide the areas of the notification panel and provide corresponding notifications to each area. For example, the processor (120) may determine the conditions (e.g., a first condition, a second condition, or a third condition) that the notification satisfies based on the importance of the notification. Based on the notification satisfying the first condition, the processor (120) may provide the notification by aligning it in a first form in the first area of the notification panel. Based on the notification satisfying the second condition, the processor (120) may provide the notification by aligning it in a second form in the second area of the notification panel. Based on the notification satisfying the third condition that does not fall under the first or second conditions, the processor (120) may provide the notification by aligning it in a third form in the third area of the notification panel.
[0232] FIG. 9 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0233] According to one embodiment, FIG. 9 may illustrate an example of an operation (or method) in which notifications are distinguished and provided according to importance through a notification panel (or notification screen) in an electronic device (101) according to one embodiment.
[0234] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 9. The flowchart illustrated in FIG. 9 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 901 through 927 may be performed by at least one processor (120) (or notification management system (500)) of the electronic device (101).
[0235] According to one embodiment, the operations described in FIG. 9 may be performed heuristically in combination with the operations described in FIG. 5 to 8, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.
[0236] As illustrated in FIG. 9, the operation method performed by an electronic device (101) according to one embodiment includes: an operation of detecting the occurrence of a notification (operation 901); an operation of analyzing predetermined data related to the notification (operation 903); an operation of identifying a predetermined condition corresponding to the notification (operation 905); an operation of determining a predetermined condition satisfied by the notification (e.g., a first predetermined condition, a second predetermined condition, or a third predetermined condition) (operation 907, operation 915); an operation of determining a main area of a first region in a notification panel as a placement area for the notification based on the notification satisfying the first predetermined condition (909); an operation of determining a ranking among the notifications if other notifications exist in the main area (operation 911); an operation of rearranging the notifications in the main area according to the determined ranking (operation 913); an operation of determining a sub-area of the first region in a notification panel as a placement area for the notification based on the notification satisfying the second predetermined condition (operation 917); and determining a ranking among the notifications if other notifications exist in the sub-area. It may include an action (action 919), an action of rearranging notifications in a sub-area according to a determined ranking (action 921), an action of determining a second area of the notification panel as a notification placement area based on the fact that the notification does not satisfy the first condition and the second condition (action 923), an action of grouping notifications to notification cards in the second area (action 925), and an action of aligning them above other notifications (action 927).
[0237] Operations 901 to 915 of FIG. 9 according to one embodiment may be substantially identical to operations 601 to 605 of FIG. 6 described above and / or operations 801 to 813 of FIG. 8 described above, and a detailed description thereof may be substituted with the description of FIG. 6 and / or FIG. 8.
[0238] Referring to FIG. 9, in operation 901, the processor (120) of the electronic device (101) can detect the occurrence of a notification. According to one embodiment, the processor (120) may include various notification events, such as notification events received from an external device (e.g., another electronic device and / or server) (e.g., external notification events) (e.g., message reception events), and notification events generated by an application or system (or service) in the electronic device (101) (e.g., internal notification events) (e.g., device or network connection events). According to one embodiment, the processor (120) can detect notification events generated by an application of the external device and / or electronic device (101) and obtain a notification corresponding to the generated notification event. For example, the notification may be received from an external device (e.g., another electronic device or server) through an application. For example, the notification may be received from an internal system through an application. According to one embodiment, the processor (120) may receive a first notification and a second notification different from the first notification through an application. According to one embodiment, the processor (120) may receive a first notification through a first application and receive a second notification through a second application different from the first application.
[0239] In operation 903, the processor (120) may analyze defined data related to the notification. In one embodiment, the defined data may include, for example, personalized data and / or learning data. For example, the processor (120) may perform data analysis based on the personalized data and / or learning data set to determine the importance of the notification. According to one embodiment, the processor (120) may collect and / or learn various user personalized data related to the user's notification preference information (e.g., user's contacts, people the user contacts frequently, people allowed to do not disturb, message usage frequency, and / or notification (or application) preference, etc.) based on machine learning or artificial intelligence. According to one embodiment, the processor (120) may determine the user's importance of the notification based on the defined data.
[0240] In operation 905, the processor (120) can identify a defined condition corresponding to a notification. According to one embodiment, the processor (120) can identify a defined condition to which the notification belongs (e.g., important notification, general notification, or non-important notification) by comprehensively determining data related to the notification (e.g., the application that delivered the notification, the style of the notification, the content of the notification, etc.) and personalization data (e.g., contacts, interests, user interactions, etc.).
[0241] In operation 907, the processor (120) can determine whether the notification has a first determined condition. In one embodiment, the first determined condition (or first priority) may be a condition for classifying a first important notification having high importance.
[0242] In operation 907, if the notification has a first determined condition (e.g., 'yes' of operation 907), the processor (120) may determine in operation 909 that the main area of the first area in the notification panel is the placement area of the notification. According to one embodiment, the processor (120) may place the notification of the first determined condition in the main area of the notification panel (e.g., the top part of the notification panel).
[0243] In operation 911, the processor (120) can determine the ranking among the notifications in the main area based on the determination of the placement area of the notifications, if there are other notifications in the main area.
[0244] According to one embodiment, the processor (120) may determine the importance of a notification based on a ranking system. For example, the processor (120) may define internal scoring rules and define a score corresponding to each defined item, assign a score to each notification, and sort the importance according to how many points the assigned score is. According to one embodiment, the processor (120) may periodically and / or in real time calculate and apply a ranking for the notification based at least on when the notification occurs or / or a change in the state of the notification.
[0245] In operation 913, the processor (120) can reorder the notifications in the main area according to the determined ranking. According to one embodiment, the processor (120) can sort the notifications in the main area in descending order according to the ranking.
[0246] In operation 907, if the processor (120) determines whether the notification has a first defined condition (e.g., 'No' in operation 907), in operation 915, whether the notification has a second defined condition. In one embodiment, the second defined condition (or second priority) may be a condition for classifying a second important notification (or general notification) of relatively low importance.
[0247] In operation 915, if the notification has a second defined condition (e.g., 'yes' of operation 915), the processor (120) may determine, in operation 917, a sub-area of the first area in the notification panel as the placement area of the notification. According to one embodiment, the processor (120) may place the notification of the second defined condition in a sub-area of the notification panel (e.g., the central part of the notification panel).
[0248] In operation 919, the processor (120) can determine the ranking among the notifications in the sub-region based on the determination of the placement area of the notifications, if there are other notifications in the sub-region.
[0249] In operation 921, the processor (120) can reorder the notifications of the sub-regions according to the determined ranking. According to one embodiment, the processor (120) can sort the notifications of the sub-regions in descending order according to the ranking.
[0250] In operation 915, if the notification does not have a second defined condition (e.g., 'No' in operation 915), the processor (120) may determine, in operation 923, a second area of the notification panel as a placement area for the notification. According to one embodiment, if the notification does not satisfy the first defined condition and the second defined condition, the processor (120) may determine that the notification satisfies the third defined condition. In one embodiment, the third defined condition may be a condition for classifying notifications of low importance or non-urgent status other than the first defined condition and the second defined condition.
[0251] In operation 925, the processor (120) can group notifications to notification cards in a second area based on determining the placement area of the notifications.
[0252] In operation 927, the processor (120) can arrange the notifications in the second area of the notifications above other notifications. According to one embodiment, the processor (120) can arrange the notifications in the second area in the order of the time of notification occurrence (e.g., in descending order of time) and place the most recently occurred notification at the top.
[0253] FIG. 10 is a drawing illustrating an example of providing a notification panel in an electronic device according to one embodiment of the present disclosure.
[0254] According to one embodiment, FIG. 10 may illustrate an example of a notification panel (or interface) for notifications. According to one embodiment, an electronic device (101) may display the notification panel (1000) on a display in response to a user input (e.g., a touch gesture of swiping down on a status bar (e.g., swipe, flick, or drag)) that causes the notification panel (1000) to be displayed. According to one embodiment, the electronic device (101) may display the notification panel (1000) on various screens (e.g., an application launch screen, a home screen, or a lock screen (or status)) provided through the display (160).
[0255] As illustrated in FIG. 10, the notification panel (1000) may be divided into a first area (1001) and a second area (1003). In one embodiment, the first area (1001) of the notification panel (1000) may be divided into a main area (1001A) and a sub area (1001B). For example, the notification panel (1000) may be divided into a main area (1001A) of a first area (1001) for notification of a first condition, a sub-area (1001B) of a first area (1001) for notification of a second condition, and a second area (1003) for notification of a third condition (e.g., the remainder other than the first and second conditions), and may provide a fixed number of priority notifications in the main area (1001A), notifications of lower priority than the priority notifications in the sub-area (1001B), and notifications of lower importance in the second area (1003). According to one embodiment, when the electronic device (101) provides the notification panel (1000) in response to user input for displaying the notification panel (1000) on a lock screen (state), the notification panel (1000) may not include a second area (1003), or may provide the notification panel (1000) by including only the main area (1001A) of the first area (1001).
[0256] In one embodiment, the main area (1001A) of the first area (1001) may be an area where a notification of a first defined condition (or first priority) (e.g., important notification) is placed. According to one embodiment, the main area (1001A) may be provided with up to a defined number of notifications (e.g., about 3). For example, the electronic device (101) may provide three notification cards in the main area (1001A) in a stacked structure, arranged according to the ranking of the notifications. In one embodiment, FIG. 10 may show an example in which one notification card (1010) is placed in the main area (100A).
[0257] According to one embodiment, the electronic device (101) can set and provide a predetermined effect (e.g., highlight application, color application, edge lighting application, etc.) based on a notification card (e.g., notification card (1010)) for a notification placed in the main area (1001A) of the first area (1001) so as to be distinguished from other notifications.
[0258] In one embodiment, a sub-region (1001B) of a first region (1001) may be an area where a notification of a second defined condition (or second priority) (e.g., a general notification) is placed. According to one embodiment, the sub-region (1001B) may provide notifications without limit in number. For example, the electronic device (101) may provide notification cards (1030, 1040, 1050) corresponding to a plurality of notifications in a stacked structure in the sub-region (1001B), arranged according to the ranking of the notifications. In one embodiment, FIG. 10 illustrates an example in which three notification cards (1030, 1040, 1050) are placed in the sub-region (1001B), but more notification cards may be provided. This example is provided to aid in understanding the present disclosure, and the embodiments of the present disclosure are not limited by the example.
[0259] In one embodiment, the second area (1003) may be an area where a notification of a third defined condition (or third priority) (e.g., a non-critical notification) is placed. According to one embodiment, the second area (1003) may provide notifications without limit on the number, but multiple notifications may be provided in a grouped manner. For example, the electronic device (101) may group multiple notifications in the second area (1003) and provide a notification card (1060) corresponding to the most recently occurred notification, arranged at the top.
[0260] According to one embodiment, the electronic device (101) may provide a summary for a notification having a defined condition among the notifications respectively placed in the main area (1001A) and the sub area (1001B) of the first area (1001). For example, the defined condition may include a condition that the notification is a conversation type notification including at least two conversations assigned to the first area (1001) or an email type notification including long content. For example, if the notification assigned to the first area (1001) is a notification having a defined condition, the electronic device (101) may provide a summary for the content (e.g., message content) of the notification.
[0261] According to one embodiment, the electronic device (101) may receive an input selecting a part of a notification card or an unfolded object of a notification card (e.g., an arrow object) in a notification panel (1000). According to one embodiment, regarding a notification in the notification panel, the user may launch an application corresponding to the notification or unfold the notification card to check the content of the notification through an input (e.g., a tap touch gesture) to a part of the notification card or an unfolded object of the notification card.
[0262] According to one embodiment, when a portion of the notification card (1010) of the first area (1001) is selected, the electronic device (101) may execute the corresponding application and provide the content of the notification to the user through the interface of the application. According to one embodiment, when an unfolding object (1020) of the notification card (1010) of the first area (1001) is selected, the electronic device (101) may unfold the notification card on the notification panel (1000) and provide the content of the notification to the user.
[0263] According to one embodiment, when a notification card (1010) of a first area (1001) displays a summary of a notification, or when the notification card (1010) is unfolded through an unfolding object (1020), the notification card (1010) may display the original text of the notification. For example, an electronic device (101) may provide a notification card of a first notification in the first area (1001), and when a second notification (e.g., of the same category) related to the first notification is received, the first notification and the second notification may be grouped, and a summary generated based on the content of the first notification and the content of the second notification may be provided through the corresponding notification card. For example, the electronic device (101) may update (or replace) the content of a notification having a predetermined condition among the notifications of the first area (1001) of the notification panel (1000) with a summary and provide it.
[0264] According to one embodiment, when a portion of the notification card (1060) of the second area (1003) is selected, the electronic device (101) can execute the corresponding application and provide the content of the notification to the user through the interface of the application. For example, when the unfolded object (1070) of the notification card (1060) of the second area (1003) is selected, the electronic device (101) can provide the user with notification cards corresponding to each of the notifications placed in the third area (1003) through the notification panel (1000).
[0265] As illustrated in FIG. 10, the notification panel (1000) can provide notifications in the main area (1001A) in a first format (e.g., providing a fixed number, applying a highlighting effect), provide notifications in the sub area (1001B) in a second format (e.g., providing them without a limit on the number), and provide notifications in the second area (1003) in a third format (e.g., providing the most recent notifications in chronological order, and managing the remaining notifications as a group).
[0266] FIG. 11 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0267] According to one embodiment, FIG. 11 may illustrate an example of an operation (or method) in which notifications are distinguished and provided according to importance through a notification panel (or notification screen) in an electronic device (101) according to one embodiment.
[0268] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 11. The flowchart illustrated in FIG. 11 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 1101 to 1113 may be performed by at least one processor (120) (or notification management system (500)) of the electronic device (101).
[0269] According to one embodiment, the operations described in FIG. 11 may be performed heuristically in combination with the operations described in FIG. 5 to FIG. 10, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.
[0270] As illustrated in FIG. 11, the operation method performed by an electronic device (101) according to one embodiment may include, when a notification occurs, placing the notification in a designated area of a notification panel (operation 1101), monitoring the notification of the notification panel (operation 1103), rearranging at least one notification having a designated condition based on the monitoring result (operation 1105), receiving a first input for displaying the notification panel (operation 1107), displaying a notification panel in which notification cards corresponding to each notification are arranged in a designated order in response to the first input (1109), receiving a second input based on the notification card of the notification panel (operation 1111), and displaying a notification for the notification card based on the type of the second input in response to the second input (operation 1113).
[0271] Referring to FIG. 11, in operation 1101, the processor (120) of the electronic device (101) may place the notification in a designated area of the notification panel when the notification occurs. According to one embodiment, the processor (120) may identify the importance of the notification based on the data related to the notification and the user's personal data (and / or learning data) as described in the above description, and place the notification in a corresponding area of the notification panel according to the importance of the notification.
[0272] In operation 1103, the processor (120) can monitor notifications on the notification panel. According to one embodiment, the processor (120) can monitor the status of notifications placed on the notification panel periodically and / or in real time in response to the occurrence of a notification event.
[0273] In operation 1105, the processor (120) may reorder at least one notification having a defined condition based on the monitoring result. According to one embodiment, the processor (120) may reorder notifications having a defined condition, such as a notification with a ranking change and / or an old notification, based on the monitoring result, according to the ranking order within the area, and / or according to the placement area movement.
[0274] In operation 1107, the processor (120) may receive a first input for displaying a notification panel. According to one embodiment, the processor (120) may receive a first input from a user that causes the notification panel to be displayed (e.g., a touch gesture of swiping down on the status bar (e.g., swipe, flick, or drag)).
[0275] In operation 1109, the processor (120) may, in response to the first input, display on the display a notification panel in which notification cards corresponding to each notification are arranged in a predetermined order (e.g., see FIG. 10).
[0276] In operation 1111, the processor (120) may receive a second input based on a notification card of the notification panel. According to one embodiment, the processor (120) may receive a second input (e.g., a tap touch gesture) for selecting one of the notification cards of the notification panel.
[0277] In operation 1113, the processor (120) may display a notification for a notification card based on the type of the second input in response to the second input. According to one embodiment, the processor (120) may receive a second input selecting a part of the notification card or an unfolded object of the notification card (e.g., an arrow object) on the notification panel. According to one embodiment, regarding the notification on the notification panel, the user may execute an application corresponding to the notification or unfold the notification card to check the content of the notification through an input (e.g., a tap touch gesture) to the part of the notification card or the unfolded object of the notification card. According to one embodiment, when a part of the notification card is selected, the processor (120) may execute an application corresponding to the notification of the notification card and display the content of the notification through the interface of the application. According to one embodiment, when an unfolded object of the notification card is selected, the processor (120) may unfold the notification card on the notification panel and display the content of the notification of the notification card.
[0278] FIG. 12 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0279] According to one embodiment, FIG. 12 may illustrate an example of an operation (or method) of providing a summary of a notification through a notification panel (or notification screen) in an electronic device (101) according to one embodiment.
[0280] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 12. The flowchart illustrated in FIG. 12 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 1201 to 1227 may be performed by at least one processor (120) (or notification management system (500)) of the electronic device (101).
[0281] According to one embodiment, the operations described in FIG. 12 may be performed heuristically in combination with the operations described in FIG. 5 to FIG. 11, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.
[0282] As illustrated in FIG. 12, the operation method performed by an electronic device (101) according to one embodiment comprises: receiving a first notification (operation 1201); identifying the type of the first notification (operation 1203); determining whether the type of the first notification is of a type of a first predetermined condition or a type of a second predetermined condition (operation 1205, operation 1219); identifying a second notification that can be grouped with the first notification based on the fact that the first notification is of a type of the first predetermined condition (operation 1207); grouping the first notification and the second notification (operation 1209); generating a prompt including the content of the first notification and the content of the second notification to generate a summary regarding the content of the notification (operation 1211); transmitting the prompt to a generative artificial intelligence on the device and / or server (operation 1213); obtaining a summary based on the prompt (operation 1215); and the first notification and the second The method may include an operation to update the contents of a grouping card of a notification with the acquired summary (operation 1217), an operation to generate a prompt containing the contents of the first notification to generate a summary for the contents of the notification based on the fact that the first notification is of the type of the second defined condition (operation 1221), an operation to transmit the prompt to a generative artificial intelligence on the device and / or server (operation 1223), an operation to acquire summary data based on the prompt (operation 1225), and an operation to update the contents of a card of the first notification with the acquired summary (operation 1227).
[0283] Referring to FIG. 12, in operation 1201, the processor (120) of the electronic device (101) may receive a first notification. According to one embodiment, the processor (120) may acquire (or receive) the first notification and display it on a display (e.g., see FIG. 7a or FIG. 7c). According to one embodiment, the processor (120) may acquire (or receive) the first notification as a new notification from an application or service (e.g., a system) installed on the electronic device (101). According to one embodiment, the processor (120) may acquire the first notification if the application or the electronic device (101) is allowed to receive a push message.
[0284] In operation 1203, the processor (120) can identify the type of the first notification. According to one embodiment, the processor (120) can identify the type of the first notification based on the type of application that generates the notification.
[0285] In operation 1205, the processor (120) can determine whether the type of the first notification corresponds to the type of the first determined condition. According to one embodiment, the type of the first determined condition may include, for example, a conversation type in which the notification is placed in a first area of the notification panel (e.g., a main area or a sub-area) and the notification is delivered by an application that supports the sending and receiving of conversational messages (e.g., a messenger, SMS, MMS, or SNS application). For example, the processor (120) can determine whether the type of the first notification corresponds to the conversation type.
[0286] In operation 1205, the processor (120) can identify a second notification that can be grouped with the first notification in operation 1207 if the type of the first notification is the type of the first defined condition (e.g., 'yes' in operation 1205). According to one embodiment, the processor (120) can determine whether there is a second notification related to the first notification (e.g., a notification of the same category (or group)) among the notifications placed in the first area of the notification panel. According to one embodiment, the processor (120) can receive the first notification after receiving the second notification related to the first notification. According to one embodiment, if the type of the first notification is the first defined type, the processor (120) can identify whether there is another second notification related to the first notification that is of the first defined type in the first area of the notification panel.
[0287] According to one embodiment, the first notification and the second notification may be received from the same application and the same counterparty (or sender). For example, the type of application generating the notification may be a phone, message, or messenger, where the target associated with the notification is specified as a person. According to one embodiment, if the first notification and the second notification that can be grouped together are not identified, the processor (120) may not perform operations 1207 to 1217 and may provide the first notification by placing it in a first area according to ranking.
[0288] In operation 1209, the processor (120) can group the first notification and the second notification. According to one embodiment, if the processor (120) is placed in a first area and there is a second notification associated with the first notification, the first notification and the second notification can be grouped and provided in the form of a single card (e.g., a grouping card). For example, if the first notification and the second notification placed in the first area are notifications from different senders of the same application, the first notification and the second notification can be provided separately according to their respective rankings without grouping.
[0289] In operation 1211, the processor (120) may generate a prompt including the content of a first notification and the content of a second notification to generate a summary regarding the content of the notification. According to one embodiment, the processor (120) may group the notifications and determine them as notifications to be summarized when at least M (e.g., M > 1) notifications having a type of a first defined condition are accumulated, and generate a summary based on the content of each of at least M notifications.
[0290] In operation 1213, the processor (120) may pass a prompt to a generative artificial intelligence on the device and / or server. According to one embodiment, the generative artificial intelligence may generate a summary by analyzing the content of the first notification and the content of the second notification (e.g., context analysis). For example, the generated summary may be data (e.g., text) reconstructed by analyzing the context of the first notification and the second notification. According to one embodiment, the generated summary may include at least one of text, images, or videos corresponding to the first notification and the second notification. According to one embodiment, the generative artificial intelligence may pass the generated summary to the processor (120). According to one embodiment, the generative artificial intelligence may be implemented within the electronic device (101) or on a server (e.g., an intelligent server (300)).
[0291] In operation 1215, the processor (120) can obtain a summary based on a prompt. According to one embodiment, the processor (120) can obtain a summary generated from a generative artificial intelligence.
[0292] In operation 1217, the processor (120) can update the contents of the grouping card of the first notification and the second notification with the acquired summary. An example of this is described with reference to FIG. 7a, FIG. 7c and FIG. 14a described below. According to one embodiment, the processor (120) may operate to regenerate and update the summary based on the contents of the existing notification (e.g., the contents of the first notification and the second notification) and the contents of the third notification when a new notification (hereinafter referred to as the third notification) that can be grouped with the first notification and the second notification occurs before the notifications of the grouping card (e.g., the first notification and the second notification) are acknowledged.
[0293] In operation 1205, the processor (120) can determine whether the type of the first notification corresponds to the type of the second predetermined condition when the type of the first notification is not the type of the first predetermined condition (e.g., 'No' in operation 1205), in operation 1219, whether the type of the first notification corresponds to the type of the second predetermined condition. According to one embodiment, the type of the second predetermined condition may include, for example, an email type in which the notification is placed in a first area of the notification panel (e.g., a main area or a sub-area) and the notification is delivered by an application that supports a long message format (e.g., an email application). For example, the processor (120) can determine whether the type of the first notification corresponds to the email type when the type of the first notification is not a conversation type.
[0294] In operation 1219, if the type of the first notification is the type of the second defined condition (e.g., 'Yes' in operation 1219), the processor (120) may, in operation 1221, generate a prompt containing the content of the first notification to generate a summary regarding the content of the notification. According to one embodiment, the processor (120) may determine a notification having the type of the second defined condition (e.g., a notification of a defined type of application) as the notification to be summarized and generate a summary based on the content of the notification. According to one embodiment, when generating the prompt, the processor (120) may further include the user's personal data related to the notification along with the content of the notification. For example, the processor (120) may generate a prompt containing the content of the notification and personal data related to the notification and transmit it to a generative artificial intelligence on the device and / or server to generate context analysis and summary information of the notification through the generative artificial intelligence.
[0295] In operation 1223, the processor (120) may pass a prompt to a generative artificial intelligence on the device and / or server. According to one embodiment, the generative artificial intelligence may generate a summary by analyzing the content of the first notification (e.g., context analysis). For example, the generated summary may be data (e.g., text) reconstructed by analyzing the context of the first notification. According to one embodiment, the generated summary may include at least one of text, an image, or a video corresponding to the first notification. According to one embodiment, the generative artificial intelligence may pass the generated summary to the processor (120). According to one embodiment, the generative artificial intelligence may be implemented within the electronic device (101) or on a server (e.g., an intelligent server (300)).
[0296] In operation 1225, the processor (120) can obtain summary data based on a prompt. According to one embodiment, the processor (120) can obtain a summary generated from a generative artificial intelligence.
[0297] In operation 1227, the processor (120) can update the contents of the card of the first notification with the acquired summary.
[0298] According to one embodiment, when user input selecting a summary (e.g., a summary notification) is detected, the processor (120) may provide an application execution screen associated with the summary. The processor (120) may display the summary on the application execution screen. For example, the processor (120) may indicate which notification the summary was generated based on. For example, if the existing notification is a message from a message application, when the user checks the message associated with the summary, the summary may be displayed in a pop-up form or the summary may be displayed in an area adjacent to the message. Alternatively, the processor (120) may provide the content and / or history of the summary on the application execution screen.
[0299] According to one embodiment, the processor (120) may obtain a new notification, a third notification, after a summary is generated based on a first notification and a second notification. The processor (120) checks (or analyzes or determines) whether the third notification is associated with the summary, and if the third notification is associated with the summary, it may update the summary based on the first notification, the second notification, and the third notification. If the processor (120) obtains the third notification while the summary has not been verified by a user, it may update the summary based on the first notification through the third notification.
[0300] According to one embodiment, the processor (120) may remove (or stop or not display) the display of the summary when the summary is confirmed by the user. If the third notification is associated with the summary, the processor (120) may display the third notification without creating a new summary. If the third notification is not associated with the summary, the processor (120) may identify whether there is another notification associated with the third notification and create a new summary based on the identified other notification and the third notification.
[0301] According to one embodiment, the processor (120) may display a plurality of summaries. For example, the processor (120) may display a first summary based on at least one notification corresponding to a first application and a second summary based on at least one notification corresponding to a second application different from the first application, each through a designated area. While displaying the first summary, if a user input requesting the display of the second summary is received, the processor (120) may display the second summary in response to the user input.
[0302] According to one embodiment, when displaying existing notifications below a summary, the processor (120) may display existing notifications associated with the summary above existing notifications not associated with the summary.
[0303] According to one embodiment, the processor (120) may determine that the priority of a target stored (or registered) in a contact application is higher than that of a target not stored in a contact application. Additionally, when the processor (120) acquires a new notification, it may determine whether the new notification corresponds to an advertisement or spam, and if the new notification corresponds to an advertisement or spam, it may remove (or delete) the display of the new notification.
[0304] According to one embodiment, when the processor (120) generates a summary based on a target stored (or registered) in a contact application, it may reconfigure the generated summary differently depending on whether the communication with the target is one-to-one communication or communication within a group including the target. For example, if the processor (120) obtains a first notification from a counterpart named A through one-to-one communication (e.g., a messenger application) and obtains a second notification through communication within a group including the counterpart named A, the processor (120) may not generate the first notification and the second notification as a single generated summary notification. For example, even if the first notification and the second notification are from the same application to the same counterpart, the processor (120) may not combine the one-to-one notification and the group notification into a single generated summary notification, but may identify them as separate notifications.
[0305] FIG. 13 is a drawing illustrating the operation of providing a notification in an electronic device according to one embodiment of the present disclosure.
[0306] Referring to FIG. 13, an electronic device (101) according to one embodiment may include a notification framework (1310), a notification manager (1330) (e.g., the notification processing engine (501) or notification manager (510) of FIG. 5), and an AI engine (1350) (e.g., the artificial intelligence (550) of FIG. 5).
[0307] According to one embodiment, the notification framework (1310) is a module that displays a notification on a display in an electronic device (101) and can check the content of all notifications displayed in the electronic device (101). According to one embodiment, the notification manager (1330) is a module that manages notifications and can obtain notification information such as the format of the notification, the application of the notification, the title of the notification, and the content of the notification. According to one embodiment, the AI engine (1350) may be a module that generates a summary of the notification. According to one embodiment, the AI engine (1350) can generate a summary based on the notification information obtained from the notification manager (1330).
[0308] In operation 1301, the notification framework (1310) may acquire a notification and transmit the acquired notification to the notification manager (1330). According to one embodiment, the notification framework (1310) may display the acquired notification on a display and transmit the acquired notification to the notification manager (1330).
[0309] In operation 1303, the notification manager (1330) receives a notification from the notification framework (1310) and can transmit the notification information to the AI engine (1350). According to one embodiment, the notification manager (1330) can obtain (or extract) notification information such as the format of the notification, the application of the notification, the title of the notification, and the content of the notification from the obtained notification, and transmit the notification information to the AI engine (1350).
[0310] In operation 1305, the AI engine (1350) can generate a summary based on notification information obtained from the notification manager (1330). According to one embodiment, the AI engine (1350) may be included in an electronic device (101) or in an intelligent server (e.g., the intelligent server (300) of FIG. 3).
[0311] In operation 1307, the AI engine (1350) can deliver (or send) the generated summary to the notification manager (1330).
[0312] In operation 1309, the notification manager (1330) can transmit the generated summary received from the AI engine (1350) to the notification framework (1310).
[0313] According to one embodiment, the notification framework (1310) can display the generated summary on the display through the notification panel. According to one embodiment, the notification framework (1310) can display the notification (e.g., existing notification) and the generated summary on the display through the notification panel.
[0314] FIGS. 14a, FIGS. 14b, and FIGS. 14c are drawings illustrating examples of an operation of providing a notification in an electronic device according to one embodiment of the present disclosure.
[0315] According to one embodiment, FIGS. 14a, 14b, and 14c may illustrate an example of displaying a notification panel on a display based on user input. According to one embodiment, FIGS. 14a, 14b, and 14c may illustrate an example of providing a summary of the notification when displaying the notification panel, and displaying the content of the notification or executing an application depending on the type of user input regarding the notification. In one embodiment, the notification may be provided in a card format (e.g., notification card, group card) in the notification panel, and below, each object constituting the notification may be referred to as a card (e.g., notification card or grouping card).
[0316] Referring to FIG. 14a, FIG. 14a may illustrate an example of grouping a first notification and a second notification, and providing a summary (1420) generated based on the content of the first notification and the content of the second notification through the corresponding grouping card (1410).
[0317] According to one embodiment, referring to FIG. 7a and FIG. 7c and FIG. 14a, an electronic device (101) receives a first notification (710) and a second notification (720) respectively through an application, and if the first notification (710) and the second notification (720) are notifications of a summary target that can be grouped in a first area (e.g., main area) of a notification panel (1000), the first notification and the second notification may be grouped, and a summary generated based on the content of the first notification (710) and the content of the second notification (720) may be provided through the corresponding grouping card (1410). For example, the electronic device (101) may update (or replace) the content of the first notification (710) and the second notification (720) of the grouping card (1410) of the notification panel (1000) with a summary and provide it.
[0318] According to one embodiment, the grouping card (1410) may include a summary (1420) and a spread object (1430). According to one embodiment, depending on the type of notification of the notification card, the notification card may further include task action items for performing functions associated with the notification (e.g., auto-reply item, first function (e.g., call) item, second function (e.g., mark as read) item, third function (e.g., reply) item). According to one embodiment, the grouping card (1410) may include a visual object (1425) (e.g., artificial intelligence object or artificial intelligence indicator) indicating that the summary (1420) displayed on the grouping card (1420) is generated by a generative artificial intelligence (or AI engine) in relation to the summary (1420).
[0319] According to one embodiment, the electronic device (101) may receive an input selecting a part of the grouping card (1410) or an unfolded object (1430) of the grouping card (1410) in the notification panel (1000). According to one embodiment, through an input (e.g., a tap touch gesture) to the part of the grouping card (1410) or the unfolded object (1430) of the grouping card (1410) in the notification panel (1000), the user may execute an application corresponding to the notification of the grouping card (1410) or unfold the grouping card (1410) to check the content of the notification.
[0320] According to one embodiment, when a portion of a grouping card (1410) of a notification panel (1000) is selected, the electronic device (101) executes an application corresponding to the notification of the grouping card (1410) and can provide the content of the first notification (710) and the second notification (720) of the grouping card (1410) to the user through the interface (or execution screen) (e.g., a conversation screen) of the application.
[0321] According to one embodiment, when an unfolded object (1430) of a grouping card (1400) of a notification panel (1000) is selected, the electronic device (101) can unfold the grouping card on the notification panel (1000) and provide the contents of the first notification (710) and the second notification (720) of the grouping card (1410) to the user. An example of this is illustrated in FIG. 14b.
[0322] Referring to FIG. 14b, while displaying a summary (1420) of the first notification (710) and the second notification (720) through the grouping card (1410), if the grouping card (1410) is unfolded through the unfolding object (1430), the electronic device (101) can display the original content (1440, 1450) of the first notification (710) and the second notification (720) through the grouping card (1410). For example, when the grouping card (1410) is unfolded, the electronic device (101) can display the summary by updating (or replacing) it with the content (1440) of the first notification (710) and the content (1450) of the second notification (720). For example, when the summary notification is unfolded, the electronic device (101) can display the original notification.
[0323] According to one embodiment, the electronic device (101) can display original text content (1440, 1450) corresponding to the first notification (710) and the second notification (720), respectively, through a grouping card (1410). According to one embodiment, the electronic device (101) can display the first notification (710) above the second notification (720) on the display in the order in which the first notification (710) and the second notification (720) were acquired.
[0324] According to one embodiment, the electronic device (101) may receive an input selecting a part of the grouping card (1410), a task action item part, an unfolded object (1430) of the grouping card (1410), or another notification card while the grouping card (1410) is unfolded. According to one embodiment, while the grouping card (1410) is unfolded, the user may perform an input related to substantially checking the notification of the grouping card (1410) (e.g., a first notification (710) and a second notification (720)) (hereinafter referred to as the first input), or an input related to switching (or folding the unfolded grouping card (1410)) without substantially checking the notification of the grouping card (1410) (e.g., a first notification (710) and a second notification (720)) (hereinafter referred to as the second input).
[0325] In one embodiment, the first input may include an input (e.g., a tap touch gesture) for selecting a part of the grouping card (1410) (e.g., any part where the content of the notification is displayed) or a task action item part while the grouping card (1410) is unfolded. In one embodiment, the second input may include an input (e.g., a tap touch gesture) for selecting an unfolded object (1430) of the grouping card (1410) or another notification card while the grouping card (1410) is unfolded.
[0326] According to one embodiment, when a first input is received from a user, the electronic device (101) executes an application corresponding to a notification of a grouping card (1410) and provides the content of the first notification (710) and the second notification (720) of the grouping card (1410) to the user through the application's interface (or execution screen) (e.g., a conversation screen).
[0327] According to one embodiment, when a second input is received from a user, the electronic device (101) may fold the grouping card (1410) on the notification panel (1000) as illustrated in FIG. 14c and switch to a state before unfolding, thereby providing the user with a summary (1420) of the first notification (710) and the second notification (720) of the grouping card (1410).
[0328] According to one embodiment, the electronic device (101) may display a third notification (e.g., a notification from the same application and the same sender, or a notification that can be grouped with the first notification (710) and the second notification (720) of the grouping card (1410) when the notification panel (1000) is displayed as illustrated in FIG. 14a or FIG. 14b), in a designated area (e.g., a first area) of the notification panel (1000), and after a set time (e.g., N seconds (e.g., N is a natural number)) has elapsed, the first notification (710), the second notification (720), and the third notification may be grouped and displayed by updating (or replacing) with a summary generated based on the contents of the first notification (710), the second notification (720), and the third notification through the grouping card (1410).
[0329] FIG. 15 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0330] According to one embodiment, FIG. 15 may illustrate an example of an operation (or method) of providing a notification through a notification panel (or notification screen) in an electronic device (101) according to one embodiment.
[0331] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 15. The flowchart illustrated in FIG. 15 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 1501 to 1509 may be performed by at least one processor (120) (or notification management system (500)) of the electronic device (101).
[0332] According to one embodiment, the operations described in FIG. 15 may be performed heuristically in combination with the operations described in FIG. 5 to FIG. 16, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.
[0333] As illustrated in FIG. 15, the operation method performed by an electronic device (101) according to one embodiment may include an operation of monitoring a notification placed in a first area (operation 1501), an operation of determining whether there is a notification of a predetermined condition (operation 1503), an operation of moving the notification to a second area if there is a notification of a predetermined condition (operation 1505), an operation of sorting the notifications in the first area in order of importance (operation 1507), and an operation of sorting the notifications in the second area in chronological order (operation 1509).
[0334] Referring to FIG. 15, in operation 1501, the processor (120) of the electronic device (101) can monitor a notification placed in a first area of the notification panel. According to one embodiment, the processor (120) can monitor the status of a notification placed in a main area and / or a sub-area of the notification panel.
[0335] In operation 1503, the processor (120) can determine whether there is a notification of a defined condition. According to one embodiment, the processor (120) can identify at least one notification having a defined condition based on a monitoring result. According to one embodiment, the processor (120) can identify a notification of a defined condition, such as a notification with a ranking change and / or an old notification, based on a monitoring result.
[0336] In operation 1505, the processor (120) may move a notification to a second area if there is a notification with a defined condition. According to one embodiment, the processor (120) may move at least one notification having a defined condition from a first area (e.g., a main area or a sub-area) to a second area.
[0337] In operation 1507, the processor (120) can sort the notifications in the first area in order of importance. According to one embodiment, the processor (120) can reorder the remaining notifications, excluding those moved from the first area to the second area, according to ranking within the first area.
[0338] In operation 1509, the processor (120) can sort the notifications of the second area in chronological order. According to one embodiment, the processor (120) can reorder the notifications moved to the second area and the notifications of the second area in chronological order within the second area.
[0339] FIG. 16 is a drawing illustrating an example of an interface related to setting a notification function in an electronic device according to one embodiment of the present disclosure.
[0340] According to one embodiment, the examples of various interfaces related to notification function settings illustrated in FIG. 16 are intended to aid in understanding the present disclosure, and the embodiments of the present disclosure are not limited by such examples. For example, the interface related to notification function settings may be provided in various forms that support the user in customizing the notification function in a diverse and convenient manner.
[0341] Referring to Fig. 16, the example screen <1610> The first interface (1610) may be shown as an example of an initial screen provided upon entry into the notification settings menu. According to one embodiment, the first interface (1610) may include a first menu for a first setting (e.g., priority conversations) related to a notification of the notification panel, a second menu for a second setting (e.g., summarize content), and a third menu for a third setting (e.g., auto grouping).
[0342] According to one embodiment, an example screen <1620> The first interface (1610) may show an example of a screen provided according to a first menu selection (hereinafter referred to as the second interface (1620)). According to one embodiment, the second interface (1620) may include a toggle object (e.g., an on / off button) for applying / not applying a first setting (e.g., priority conversations) and a guide message for the first setting (e.g., use notification classification function) (e.g., AI puts messages from your important persons or urgent messages not to miss them. Notifications are processed on your phone.).
[0343] According to one embodiment, an example screen <1630> ...can represent an example of a screen provided according to a second menu selection in the first interface (1610) (hereinafter referred to as the third interface (1630)). According to one embodiment, the third interface (1630) may include a toggle object (e.g., an on / off button) for applying / not applying a second setting (e.g., summarize content), and a guide message for the second setting (e.g., use of the notification content summary function) (e.g., In the notification panel, you can grasp important content at a glance with the summary from the multiple conversational messages or long notification texts. Notifications are processed on your phone.).
[0344] According to one embodiment, an example screen <1640> The first interface (1610) may show an example of a screen provided upon selection of a third menu (hereinafter referred to as the fourth interface (1640)). According to one embodiment, the fourth interface (1640) may include a toggle object (e.g., an on / off button) for applying / not applying a third setting (e.g., auto grouping), a guide message for the third setting (e.g., classifying non-important notifications and using grouping functions) (e.g., AI automatically sorts out less-important notifications and silently put them in a group at the tail of the notification list in the panel. Notifications are processed on your phone.), and an option menu (e.g., a notification type selection menu) for setting items to be included in the third setting (e.g., notifications to be grouped and set silent). In one embodiment, the option menu may include setting menus for a first notification type (e.g., Promotions), a second notification type (e.g., Old notifications), a third notification type (e.g., Background activities), and a fourth notification type (e.g., Minimized notifications).
[0345] According to one embodiment, various interfaces related to notification function settings may include an interface that can set an option to select whether to use on-device artificial intelligence of the electronic device (101) or artificial intelligence of a server (e.g., intelligent server (300)) in consideration of user privacy infringement.
[0346] FIG. 17 is a drawing illustrating an example of providing a notification panel in an electronic device according to one embodiment of the present disclosure.
[0347] According to one embodiment, FIG. 17 may illustrate an example in which an electronic device (101) provides an interface according to an electronic device of the form (e.g., a foldable type smartphone (491-2)) or an electronic device of the form (e.g., including a multi-foldable electronic device). For example, the electronic device (101) may be a foldable electronic device of various forms such as a G-type, Z-type, or e-type. According to one embodiment, the electronic device (101) may have a different state of display (or size of the screen displayed (or screen display area)) depending on the form factor of the electronic device (101), and may provide different displays of information (e.g., a notification panel) depending on the state of the display of the electronic device (101).
[0348] According to one embodiment, the electronic device (101) can provide a notification panel with a corresponding area based on the screen size and / or display area of the display.
[0349] According to one embodiment, the display may be divided into a first display area (1701) (or first divided area) and a second display area (1702) (or second divided area) based on a first folding axis (e.g., A axis) between a first housing and a second housing, and into a second display area (1702) (or second divided area) and a third display area (1703) (or third divided area) based on a second folding axis (e.g., B axis) between a second housing and a third housing, depending on the form factor of the electronic device (101) as illustrated in FIG. 17.
[0350] According to one embodiment, an example of an electronic device (101) illustrated in FIG. 17 may have two folding axes (e.g., A axis and B axis). For example, FIG. 17 may have an example of providing an interface of a notification panel in an electronic device (101) comprising three display areas (e.g., a first display area (1701), a second display area (1702), and a third display area (1703)). Various embodiments are not limited thereto and are exemplary, and the number of folding axes that the electronic device (101) may have is not limited. According to one embodiment, the electronic device (101) may include a multi-foldable electronic device composed of N (e.g., N is a natural number greater than or equal to 2) folding axes (e.g., N hinge structures) and N+1 housings (or display areas).
[0351] According to one embodiment, as illustrated in FIG. 17, the electronic device (101) divides the display into a first display area (1701), a second display area (1702), and a third display area (1703) based on two folding axes (e.g., A axis and B axis), divides the areas of the notification panel (e.g., a main area (1710) of the first area, a sub-area (1720) of the first area, and a second area (1730)) corresponding to the first display area (1701), the second display area (1702), and the third display area (1703), and can provide corresponding notifications through the divided areas of the notification panel.
[0352] According to one embodiment, the electronic device (101) may provide a main area (1710) of a first area for a first notification (1715) (e.g., important notification) through a first display area (1701). For example, the first display area (1701) may display a first notification (1715) placed in the main area (1710).
[0353] According to one embodiment, the electronic device (101) may provide a sub-area (1720) of a first area for a second notification (1725) (e.g., a general notification) through a second display area (1702). For example, the second display area (1702) may display a second notification (1725) placed in the sub-area (1720).
[0354] According to one embodiment, the electronic device (101) may provide a second area (1730) for a third notification (1735) (e.g., a non-important notification) through a third display area (1703). For example, the third display area (1703) may display a third notification (1735) placed in the second area (1730).
[0355] According to one embodiment, information (e.g., notifications) included in the first display area (1701), the second display area (1702), and / or the third display area (1703) of the display is not limited to the examples described above. For example, the electronic device (101) may visually display various information related to notification panels and notification operations in various layout (or screen freely divided) configurations of the first display area (1701), the second display area (1702), and / or the third display area (1703). In one embodiment, as illustrated in FIG. 17, the operation when the electronic device (101) is a foldable electronic device is merely illustrative and does not limit the implementations described or claimed in this document.
[0356] FIG. 18 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0357] According to one embodiment, FIG. 18 may illustrate an example of an operation (or method) in which notifications are distinguished according to importance and provided through a designated screen (e.g., a notification panel) of a display in an electronic device (101) according to one embodiment.
[0358] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 18. The flowchart illustrated in FIG. 18 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 1801 to 1817 may be performed by at least one processor (120) (or notification management system (500)) of the electronic device (101).
[0359] According to one embodiment, the operations described in FIG. 18 may be performed heuristically in combination with the operations described in FIG. 5 to FIG. 17, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.
[0360] As illustrated in FIG. 18, an operation method performed by an electronic device (101) according to one embodiment comprises: receiving a signal including a notification through a communication circuit (operation 1801); checking personalized data related to the notification (operation 1803); identifying the priority of the notification based on the checked data (operation 1805); selecting an area within a display to display the notification based on the priority of the notification (operation 1807); identifying whether the notification has a defined condition if the selected area is a designated area (e.g., a first area) (operation 1809); generating a prompt for generating data related to the notification if the notification has a defined condition (operation 1811); transmitting the prompt to a generative artificial intelligence (e.g., an AI engine) on the device and / or server (operation 1813); acquiring data based on the prompt (operation 1815); and updating the content of the notification in the designated area (e.g., the first area) based on the acquired data (operation It may include 1817).
[0361] Referring to FIG. 18, in operation 1801, the processor (120) of the electronic device (101) may receive a signal including a notification through a communication circuit. According to one embodiment, the processor (120) may receive a signal including a notification (e.g., message, email) from an external device (e.g., another electronic device and / or server) through a communication circuit.
[0362] In operation 1803, the processor (120) can check personalized data related to a notification. According to one embodiment, the processor (120) can check data based on personalized data set for determining the importance of the notification. According to one embodiment, the processor (120) can collect and / or learn various user personal data related to the user's notification preference information (e.g., user's contacts, people the user contacts frequently, people allowed to do not disturb, message usage frequency, and / or notification (or application) preference, etc.) based on machine learning or artificial intelligence. According to one embodiment, the processor (120) can select (or judge or determine) the user's importance of the notification based on the personalized data.
[0363] In operation 1805, the processor (120) can identify the priority of the notification based on the identified data. According to one embodiment, the processor (120) can identify (or determine) whether the notification belongs to a notification of a first priority (or first condition), a notification of a second priority (or second condition), or a notification of a third priority (or third condition) based on the selected importance using the identified data.
[0364] In operation 1807, the processor (120) may select an area within the display to display the notification based on the priority of the notification. According to one embodiment, the processor (120) may select an area to display the notification (e.g., a first area or a second area) in a notification panel provided through the display based on the priority of the notification. According to one embodiment, the processor (120) may select an area designated as the area to display the notification (e.g., a first area) if the notification belongs to the first priority or the second priority. According to one embodiment, in the case of a notification belonging to the first priority, it may be placed in a main area separated from the first area. According to one embodiment, in the case of a notification belonging to the second priority, it may be placed in a sub-area separated from the first area. According to one embodiment, if the notification belongs to the third priority, the processor (120) may select another area (e.g., a second area) separated from the area designated as the area to display the notification (e.g., a first area). In one embodiment, the first priority may have a higher rank than the second priority, and the third priority may have a lower rank than the second priority.
[0365] In operation 1809, the processor (120) can identify whether a notification has a defined condition when the selected area is a designated area (e.g., a first area). According to one embodiment, the defined condition may include a conversation type notification including at least two conversations assigned to the first area, an email type notification including long content, and / or a condition in which the number of notifications received from the same application is greater than or equal to a specified number (e.g., N, N ≥ 2).
[0366] In operation 1811, the processor (120) may generate a prompt for generating data related to the notification when the notification has a defined condition. According to one embodiment, the processor (120) may generate a prompt containing content for the notification to generate data (e.g., summary, summary data, or result data) for the content of the notification (e.g., message content, email content, or content of a plurality of notifications) when the notification has a defined condition. According to one embodiment, the processor (120) may determine that the notification assigned to the first area is a notification to be summarized and generate a prompt requesting the generation of a summary for the content of the notification.
[0367] In operation 1813, the processor (120) can pass the prompt to a generative artificial intelligence (e.g., AI engine) on the device and / or server.
[0368] In operation 1815, the processor (120) can obtain data based on a prompt. According to one embodiment, the processor (120) can obtain data (e.g., a summary, summary data, or result data) based on (or in relation to) a prompt. According to one embodiment, the processor (120) can obtain data (e.g., a summary of the content of a notification) from a generative artificial intelligence based on a prompt.
[0369] In operation 1817, the processor (120) can update the content of a notification in a designated area (e.g., a first area) based on acquired data. According to one embodiment, the processor (120) can update (or replace) the content related to the corresponding notification (e.g., a notification of a summary target) in the designated area (e.g., a first area) with the summarized content (e.g., regenerated information).
[0370] An operation method performed in an electronic device (101) according to one embodiment of the present disclosure may include an operation of receiving a signal including a notification through a communication circuit. The operation method may include an operation of checking personal data related to the notification. The operation method may include an operation of identifying the priority of the notification based on the checked data. The operation method may include an operation of selecting an area within a display to display the notification based on the priority of the notification. The operation method may include an operation of identifying whether the notification has a defined condition when the selected area is a first area. The operation method may include an operation of generating a prompt for generating data related to the notification when the notification has a defined condition. The operation method may include an operation of transmitting the prompt to a generative artificial intelligence (AI) on a device and / or server. The operation method may include an operation of acquiring data based on the prompt. The operation method may include an operation of updating the content of the notification in the first area based on the acquired data.
[0371] According to one embodiment, the operation method may include an operation of identifying a predetermined condition corresponding to the notification.
[0372] According to one embodiment, the operation method may include an operation of selecting a main area of the first area as a placement area for the notification based on the notification satisfying a first condition. The operation method may include an operation of sorting the notifications of the main area based on a ranking among the notifications of the main area.
[0373] According to one embodiment, the operation method may include an operation of selecting a sub-region of the first region as a placement area for the notification based on the notification satisfying a second condition. The operation method may include an operation of sorting the notifications of the sub-region based on a ranking among the notifications of the sub-region.
[0374] According to one embodiment, the operation method may include an operation of selecting a second area distinct from the first area as a placement area for the notification based on the fact that the notification does not satisfy the first condition and the second condition. The operation method may include an operation of grouping the notification to a notification card in the second area and aligning the notification higher than other notifications in the second area.
[0375] According to one embodiment, the operation method may include an operation of identifying other notifications that can be grouped with the notification based on the fact that the notification is assigned to a first area and the type of the notification is the type of a first condition. The operation method may include an operation of grouping the notification with the other notification. The operation method may include an operation of obtaining a summary generated based on the content of the notification and the content of the other notification. The operation method may include an operation of updating the content of the grouping card of the notification and the other notification with the obtained summary.
[0376] According to one embodiment, the operation method may include an operation of placing the additional notification in a designated area of the display when an additional notification related to the notification of the grouping card occurs. The operation method may include an operation of grouping the notification, the other notification, and the additional notification after a set time has elapsed. The operation method may include an operation of updating and displaying a summary generated based on the contents of the notification, the other notification, and the additional notification through the grouping card.
[0377] According to one embodiment, the operation method may include an operation of monitoring the status of a notification placed in the first area. The operation method may include an operation of identifying at least one notification having a defined condition, such as a notification with a ranking change and / or an old notification, based on the monitoring result. The operation method may include an operation of moving the at least one notification having the defined condition to a second area distinguished from the first area. The operation method may include an operation of rearranging the notifications in the first area and the notifications in the second area.
[0378] In a non-transitory computer-readable recording medium storing instructions that cause a processor (120, 230, 410) to perform operations when executed by a processor (120, 230, 410) of an electronic device (101, 201, 400) according to one embodiment of the present disclosure, the instructions include, when executed by the processor (120, 230, 410), the electronic device (101, 201, 400) receiving a signal including a notification through a communication circuit; checking personal data related to the notification; identifying the priority of the notification based on the checked data; selecting an area within a display to display the notification based on the priority of the notification; if the selected area is a first area, identifying whether the notification has a predetermined condition; if the notification has a predetermined condition, the notification related The operation of generating a prompt for generating data, the operation of transmitting the prompt to an on-device and / or server generative artificial intelligence (AI), the operation of acquiring data based on the prompt, and the operation of updating the content of the notification in the first area based on the acquired data can be performed.
[0379] It will be understood that the foregoing embodiments and their technical features may be combined with one another in any combination, provided there is no conflict between the two embodiments or features. For example, any combination of two or more of the foregoing embodiments may be conceived and included within the present disclosure. One or more features from any embodiment may be incorporated into any other embodiment and may provide corresponding advantages or benefits.
[0380] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0381] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0382] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0383] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (or recording medium) (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-transient' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0384] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium (or recording medium), such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0385] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0386] The various embodiments of the present disclosure disclosed in this specification and drawings are provided as specific examples to facilitate the explanation of the technical content of the present disclosure and to aid in understanding the present disclosure, and are not intended to limit the scope of the present disclosure. Accordingly, the scope of the present disclosure should be interpreted to include all modifications or variations derived based on the technical concept of the present disclosure, in addition to the embodiments disclosed herein.
Claims
1. In an electronic device, display; communication circuit; At least one processor including processing circuitry; and It includes memory for storing personal data and instructions, and When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, A signal including a notification is received through the above communication circuit, and Check the personal data related to the above notification, Identify the priority of the above notification based on verified data, and Based on the priority of the above notification, select an area within the display to display the above notification, and If the selected area above is the first area, identify whether the notification above has a defined condition, and If the above notification meets a defined condition, a prompt is generated to generate data related to the above notification, and The above prompt is transmitted to generative artificial intelligence (AI) on-device and / or server, and Acquire data based on the above prompt, and An electronic device that updates the content of the notification in the first area based on acquired data.
2. In Paragraph 1, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, In response to user input, a notification panel is displayed through the above display, and The above notification panel includes the above first area and a second area distinguished from the above first area, and The above first area is configured to have a notification having a first priority placed thereon and is set at the top of the notification panel, and An electronic device in which the second area above is configured to have a notification lower than the first priority and is set at the bottom of the notification panel.
3. In Paragraph 2, The above-mentioned first area is divided into a main area and a sub-area, and The above main area displays a first notification of a first importance level according to an importance determination, and arranges a predetermined number of notification cards corresponding to the first notification. The above sub-region is an electronic device that displays a second notification of a second importance based on an importance determination and places notification cards corresponding to each of the second notifications.
4. In Paragraph 3, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, An electronic device that determines the ranking of notifications for the first area according to the main area and the sub area, and provides them sorted in descending order according to the determined ranking.
5. In Paragraph 2, The above second area is an electronic device that displays a third notification of third importance and groups the third notifications to place a single grouping card.
6. In Paragraph 5, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, A plurality of notifications in the second area are grouped and provided through a single grouping card, and Display the most recently generated notification among the above third notifications through the above grouping card, and An electronic device that, when the above grouping card is unfolded, provides the above third notification sorted in descending order of time.
7. In Paragraph 2, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, Identify the defined conditions corresponding to the above notification, and Based on the fact that the above notification satisfies the first condition, the main area of the first area is selected as the placement area of the above notification, and Based on the ranking among the notifications in the main area above, the notifications in the main area above are sorted, and Based on the fact that the above notification satisfies the second condition, a sub-area of the first area is selected as the placement area of the above notification, and Based on the ranking among the notifications of the above sub-area, the notifications of the above sub-area are sorted, and Based on the fact that the above notification does not satisfy the above first condition and the above second condition, the above second area is selected as the placement area of the above notification, and An electronic device that groups the notifications on a notification card in the second area and aligns the notifications above other notifications in the second area.
8. In Paragraph 2, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, Based on the fact that the above notification is assigned to a first area and the type of the above notification is the type of the first condition, other notifications that can be grouped with the above notification are identified, and Grouping the above notification and the above other notifications, Obtain a summary generated based on the content of the above notification and the content of the above other notification, and An electronic device that updates the contents of the grouping card of the above notification and the other notification with the acquired summary.
9. In Paragraph 8, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, When a signal including an additional notification related to the notification of the grouping card is received through the communication circuit above, the additional notification is placed in a designated area of the notification panel, and An electronic device that groups the above notification, the above other notification, and the above additional notification after a set time has elapsed.
10. In Paragraph 9, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, An electronic device that updates and displays a summary generated based on the contents of the above notification, the above other notification, and the above additional notification through a grouping card.
11. In Paragraph 8, An electronic device in which groupable notifications include notifications generated from the same application and the same sender.
12. In Paragraph 2, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, Based on the fact that the above notification is assigned to a first area and the type of the above notification is the type of the second condition, a summary generated based on the content of the above notification is obtained, and An electronic device that updates the contents of the notification card of the above notification with the acquired summary.
13. In Paragraph 2, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, Monitoring the status of the notification placed in the first area above, and Based on monitoring results, identify at least one notification having defined conditions, such as a notification with a ranking change and / or an old notification, and An electronic device that moves the at least one notification having the above-determined conditions to the second area.
14. In Paragraph 13, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, For the remaining notifications other than those moved from the first area to the second area, they are reordered according to ranking within the first area, and An electronic device that rearranges notifications moved to the second area and notifications in the second area in chronological order within the second area.
15. In a method of operating an electronic device, The operation of receiving a signal including a notification through a communication circuit; An action of verifying personal data related to the above notification; An action of identifying the priority of the above notification based on verified data; An action of selecting an area within a display to display the above notification based on the priority of the above notification; If the selected area is a first area, an action of identifying whether the notification has a predetermined condition; If the above notification has a defined condition, the operation of generating a prompt to generate data related to the above notification; The operation of transmitting the above prompt to generative artificial intelligence (AI) on-device and / or server; An operation to acquire data based on the above prompt; and A method comprising an operation to update the content of the notification of the first area based on acquired data.