Notification providing method and electronic device

The electronic device generates and displays notification images based on theme and context data, addressing the lack of relevance in existing systems and enhancing user experience through visually appealing notifications.

WO2026054409A1PCT designated stage Publication Date: 2026-03-12SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-08-27
Publication Date
2026-03-12

AI Technical Summary

Technical Problem

Existing notification systems lack the ability to generate and display contextually relevant and visually appealing notification images based on event themes and time-specific data, leading to a suboptimal user experience.

Method used

An electronic device is equipped with a processor that requests and generates notification images based on theme data, notification data, and context data corresponding to the time of event occurrence, and displays the obtained notification image on a display.

Benefits of technology

Enhances user experience by providing contextually relevant and visually appealing notification images, improving engagement and interaction with the device.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2025013077_12032026_PF_FP_ABST
    Figure KR2025013077_12032026_PF_FP_ABST
Patent Text Reader

Abstract

An electronic device is disclosed. This electronic device may comprise: a display; a memory storing instructions; and at least one processor comprising a processing circuit. The instructions, when executed individually or collectively by the at least one processor, may instruct the electronic device to: on the basis of detecting the occurrence of an event for providing a notification, request the generation of a notification image on the basis of theme data of the electronic device, notification data related to the notification, and context data corresponding to the time point at which the event occurred; acquire a notification image generated in response to the request; and display the notification and the acquired notification image on the display.
Need to check novelty before this filing date? Find Prior Art

Description

Methods and electronic devices for providing notifications

[0001] The present disclosure relates to a method and an electronic device for providing notification.

[0002] Generative AI is a technology that learns the structure and patterns of data and generates new data based on input data. Generative AI can generate a variety of data, such as text and images.

[0003] An electronic device according to one embodiment includes a display, a memory storing instructions, and at least one processor including a processing circuit, wherein the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to request generation of a notification image based on theme data of the electronic device, notification data related to the notification, and context data corresponding to a time point of occurrence of the event, based on detection of occurrence of an event for providing a notification, obtain a notification image generated in response to the request, and display the notification and the obtained notification image on the display.

[0004] A method for providing a notification of an electronic device according to one embodiment may include an operation of requesting generation of a notification image based on theme data of the electronic device, notification data related to the notification, and context data corresponding to the time of occurrence of the event, based on detection of occurrence of an event for providing a notification, an operation of obtaining a notification image generated in response to the request, and an operation of displaying the notification and the obtained notification image.

[0005] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0006] Figures 2a, 2b and 2c illustrate various types of electronic devices according to embodiments.

[0007] FIG. 3A illustrates an example of an accessory attachable to a first type of electronic device according to one embodiment.

[0008] FIG. 3b illustrates an example of an accessory attachable to a second type of electronic device according to one embodiment.

[0009] FIG. 3c illustrates an example of an accessory attachable to a third type of electronic device according to one embodiment.

[0010] FIG. 4 illustrates an example of an electronic device displaying content when an accessory is mounted on the electronic device according to one embodiment.

[0011] FIG. 5A illustrates an example in which a display is arranged on the rear surface of a first type of electronic device according to one embodiment.

[0012] FIG. 5b illustrates an example in which a display is arranged on the rear of a second type of electronic device according to one embodiment.

[0013] FIG. 5c illustrates an example in which a display is arranged on the rear of a third type of electronic device according to one embodiment.

[0014] FIG. 6 illustrates an example block diagram of an electronic device according to one embodiment.

[0015] FIGS. 7A and 7B are diagrams illustrating an example of a method for an electronic device to obtain a notification image according to one embodiment.

[0016] FIGS. 8A and 8B illustrate an example of an electronic device displaying an image related to a notification according to one embodiment.

[0017] FIG. 9 is a diagram illustrating operations of an electronic device displaying a notification according to one embodiment.

[0018] FIG. 10, FIG. 11, FIG. 12a, FIG. 12b, FIG. 13a, FIG. 13b, FIG. 14a, FIG. 14b, FIG. 15a, FIG. 15b, FIG. 15c, FIG. 16a, FIG. 16b, FIG. 17, FIG. 18a, FIG. 18b, FIG. 19a, FIG. 19b, FIG. 19c and FIG. 20 are drawings showing various examples of an electronic device displaying notifications and images according to one embodiment.

[0019] FIGS. 21 and 22 are drawings showing various examples of an electronic device providing an image according to one embodiment.

[0020] FIG. 23 is a diagram illustrating an example of an operation of an electronic device generating a prompt according to one embodiment.

[0021] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

[0022] Electronic devices according to various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of the present disclosure are not limited to the aforementioned devices.

[0023] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0024] Throughout this specification, singular expressions include plural expressions unless the context clearly dictates otherwise. When a part of this specification refers to "including" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated.

[0025] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0026] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0027] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0028] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0029] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0030] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0031] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0032] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0033] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0034] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0035] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0036] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0037] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0038] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0039] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0040] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0041] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0042] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0043] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0044] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0045] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0046] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0047] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0048] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be utilized.

[0049] The electronic device (101) can provide ultra-low latency services, for example, by utilizing distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in a second network (199). The electronic device (101) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0050] FIGS. 2A to 2C illustrate various types of electronic devices according to embodiments.

[0051] FIG. 2A illustrates an example of a first type of electronic device according to one embodiment.

[0052] Referring to FIG. 2A, the electronic device (101) may be a flip-type electronic device. The electronic device (101) may include a housing structure (211), a hinge structure (214), a first display (215), and a second display (216). The housing structure (211) may include a first housing part (212) and a second housing part (213).

[0053] The hinge structure (214) may include a hinge for rotatably connecting the first housing part (212) and the second housing part (213) and a hinge housing part for covering the hinge. The first housing part (212) may be rotatably connected to the second housing part (213) by the hinge structure (214). The first housing part (212) and the second housing part (213) may be rotated with respect to the hinge structure (214). By the hinge structure (214), the relative positions, angles, shapes and / or distances of the first housing part (212) and the second housing part (213), which are rigid bodies, may be changed by an external force. While the first housing part (212) is rotated about the hinge structure (214), the second housing part (213) can be rotated about the hinge structure (214). For example, when the first housing part (212) and the second housing part (213) are rotated about the hinge structure (214), the angular displacement of the first housing part (212) can be substantially equal to the angular displacement of the second housing part (213). A folding axis (e.g., (A-A')) formed in the hinge structure (214) can be a rotation axis of the first housing part (212) and the second housing part (213). As the first housing part (212) and / or the second housing part (213) are rotated about the folding axis, the angle between the first housing part (212) and the second housing part (213) can be changed.

[0054] The electronic device (101) may include a first display (215). The first display (215) may be implemented as a foldable flexible display and may include a touch circuit for detecting a touch input. The first display (215) may be disposed on the front surfaces of the first housing part (212) and the second housing part (213). For example, the first display (215) may be disposed across a hinge structure (214) from the first housing part (212) to the second housing part (213). The second display (216) may be implemented as a flat display and may include a touch circuit for detecting a touch input. The second display (216) may be disposed on the rear surface of the first housing part (212). In the present disclosure, the surface on which the first display (215) is arranged may be defined as the front surface of the electronic device (101), and the surface opposite the front surface may be defined as the rear surface of the electronic device (101). For example, the first display (215) may be replaced with an expression such as a front display or a main display, and the second display (216) may be replaced with an expression such as a rear display or a sub display. In addition, the camera (217) may be arranged on the rear surface of the first housing part (212).

[0055] The electronic device (101) may further include a key button (218). The key button (217) may be disposed on a side surface of the first housing part (212). For example, the key button (217) may be exposed from a structure (e.g., an opening) formed on the side surface of the first housing part (212) and may partially protrude outside the electronic device (101). The key button (218) may provide a physical input to a processing circuit inside the electronic device (101) by pressure transmitted from the outside. The key button (218) may not be included in the electronic device (101) and may be implemented in another form, such as a soft key displayed on the first display (215) or the second display (216).

[0056] The hinge structure (214) can change the state of the electronic device (101). The hinge structure (214) can provide a first state of the electronic device (101) (or a first state of the housing structure (211)). The first state of the electronic device (101) can be referred to as a fully unfolded state, an opened state, an unfolded state, a flat state, and / or a planar state. Within the first state, the front surface of the first housing part (212) and the front surface of the second housing part (213) can define the front surface of the electronic device (101). Within the first state, the front surface of the first housing part (212) and the front surface of the second housing part (213) face the same direction, and the angle between the first housing part (212) and the second housing part (213) may be a substantially straight angle (e.g., about 180 degrees). The angle between the first housing part (212) and the second housing part (213) may correspond to the angle between one side of the first housing part (212) on which the first display (215) is arranged, which can be folded by the folding axis of the hinge structure (214), and one side of the second housing part (213). Within the first state, the first display (215) may have a substantially flat shape.

[0057] The hinge structure (214) may provide a second state of the electronic device (101) (or a second state of the housing structure (211)). The second state of the electronic device (101) may be referred to as a fully folded state, a folded state, and / or a closed state. Within the second state, the front surface of the first housing part (212) and the front surface of the second housing part (213) may face opposite directions, and the angle between the first housing part (212) and the second housing part (213) may be substantially 0 degrees. Within the second state, the first display (215) may be visually completely obscured by the first housing part (212) and the second housing part (213).

[0058] FIG. 2b illustrates an example of a second type of electronic device according to one embodiment.

[0059] Referring to FIG. 2B, the electronic device (101) may be a bar-type electronic device. The electronic device (101) may include a housing structure (221) and a display (222). The electronic device (101) of FIG. 2B may be fixed by the housing structure (221), which is a rigid body. The display (222) may be arranged on the front surface of the housing structure (221). In the present disclosure, the surface on which the display (222) is arranged may be defined as the front surface of the electronic device (101), and the surface opposite to the front surface may be defined as the rear surface of the electronic device (101). The camera (223) may be arranged on the rear surface of the housing structure (221).

[0060] The electronic device (101) may further include a key button (224). The key button (224) may be positioned on a side of the housing structure (221). For example, the key button (224) may be exposed from a structure (e.g., an opening) formed on the side of the housing structure (221) and may partially protrude outside of the electronic device (101). The key button (224) may provide a physical input to a processing circuit inside the electronic device (101) by pressure transmitted from the outside. The key button (224) may not be included in the electronic device (101) and may be implemented in another form, such as a soft key displayed on the display (222).

[0061] FIG. 2c illustrates an example of a third type of electronic device according to one embodiment.

[0062] Referring to FIG. 2C, the electronic device (101) may be a foldable type electronic device. The electronic device (101) may include a housing structure (231), a hinge structure (234), a first display (235), and a second display (236). The housing structure (231) may include a first housing part (232) and a second housing part (233).

[0063] Comparing the electronic device (101) of FIG. 2A with the electronic device (101) of FIG. 2C, in FIG. 2A, the first housing part (212) and the second housing part (213) are rotatably coupled up and down with the hinge structure (214) as the center, and in FIG. 2C, the first housing part (232) and the second housing part (233) are rotatably coupled left and right with the hinge structure (234) as the center.

[0064] The hinge structure (234) may include a hinge for rotatably connecting the first housing part (232) and the second housing part (233) and a hinge housing part for covering the hinge. The first housing part (232) may be rotatably connected to the second housing part (233) by the hinge structure (234). The first housing part (232) and the second housing part (233) may be rotated with respect to the hinge structure (234). By the hinge structure (234), the relative positions, angles, shapes, and / or distances of the first housing part (232) and the second housing part (233), which are rigid bodies, may be changed by an external force. While the first housing part (232) is rotated about the hinge structure (234), the second housing part (233) can be rotated about the hinge structure (234). For example, when the first housing part (232) and the second housing part (233) are rotated about the hinge structure (234), the angular displacement of the first housing part (232) can be substantially equal to the angular displacement of the second housing part (233). A folding axis (e.g., (A-A')) formed in the hinge structure (234) can be a rotation axis of the first housing part (232) and the second housing part (233). As the first housing part (232) and / or the second housing part (233) are rotated about the folding axis, the angle between the first housing part (232) and the second housing part (233) can be changed.

[0065] The electronic device (101) may include a first display (235). The first display (235) may be implemented as a flexible display that can be folded. The first display (235) may be disposed on the front surfaces of the first housing part (232) and the second housing part (233). For example, the first display (235) may be disposed across a hinge structure (234) from the first housing part (232) to the second housing part (233). The second display (236) may be disposed on the rear surface of the first housing part (232). In the present disclosure, the surface on which the first display (235) is disposed may be defined as the front surface of the electronic device (101), and the surface opposite the front surface may be defined as the rear surface of the electronic device (101). For example, the first display (235) may be replaced with an expression such as a front display or a main display, and the second display (236) may be replaced with an expression such as a rear display or a sub display. In addition, the camera (237) may be placed on the rear of the second housing part (233).

[0066] The electronic device (101) may further include a key button (238). The key button (237) may be positioned on a side of the first housing part (232). For example, the key button (237) may be exposed from a structure (e.g., an opening) formed on a side of the second housing part (232) and may partially protrude outside the electronic device (101). The key button (238) may provide a physical input to a processing circuit inside the electronic device (101) by pressure transmitted from the outside. The key button (238) may not be included in the electronic device (101) and may be implemented in another form, such as a soft key displayed on the first display (235) or the second display (236).

[0067] The hinge structure (234) can change the state of the electronic device (101). The hinge structure (234) can provide a first state of the electronic device (101) (or a first state of the housing structure (231)). The first state of the electronic device (101) can be referred to as a fully unfolded state, an opened state, an unfolded state, a flat state, and / or a planar state. Within the first state, the front surface of the first housing part (232) and the front surface of the second housing part (233) can define the front surface of the electronic device (101). Within the first state, the front surface of the first housing part (232) and the front surface of the second housing part (233) face the same direction, and the angle between the first housing part (232) and the second housing part (233) may be a substantially straight angle (e.g., about 180 degrees). The angle between the first housing part (232) and the second housing part (233) may correspond to the angle between one side of the first housing part (232) on which the first display (235) is arranged and one side of the second housing part (233), which can be folded by the folding axis of the hinge structure (234). Within the first state, the first display (235) may have a substantially flat shape.

[0068] The hinge structure (234) can provide a second state of the electronic device (101) (or a second state of the housing structure (231)). The second state of the electronic device (101) can be referred to as a fully folded state, a folded state, and / or a closed state. Within the second state, the front surface of the first housing part (232) and the front surface of the second housing part (233) face opposite directions, and the angle between the first housing part (232) and the second housing part (233) can be substantially 0 degrees. Within the second state, the first display (235) can be visually completely obscured by the first housing part (232) and the second housing part (233).

[0069] According to one embodiment, various types of accessories can be attached or detached to the electronic device (101). Hereinafter, an accessory (102) (e.g., a card-type accessory) will be described as an example of an accessory attachable or detachable to the electronic device (101). The accessory (102) may correspond to an external electronic device (e.g., the electronic device (102)) that communicates directly or wirelessly with the electronic device (101) of FIG. 1.

[0070] Although the camera is described as being positioned on the rear of the electronic device (101) in FIGS. 2A, 2B, and 2C, the present disclosure is not limited thereto. The electronic device (101) may include a camera positioned on the front.

[0071] FIG. 3A illustrates an example of an accessory attachable to a first type of electronic device according to one embodiment. FIG. 3B illustrates an example of an accessory attachable to a second type of electronic device according to one embodiment. FIG. 3C illustrates an example of an accessory attachable to a third type of electronic device according to one embodiment.

[0072] According to one embodiment, the protective case may include a case that covers at least a portion of the front side or at least a portion of the rear side of the housing structure of the electronic device (101). The protective case may be replaced with an expression such as a cover, for example. The protective case may be manufactured to suit the appearance of various types of electronic devices (101) (e.g., the first type of electronic device (101) illustrated in FIG. 2A, the electronic device (101) illustrated in FIG. 2B, and the electronic device (101) illustrated in FIG. 2C). An accessory (102) may be mounted on the electronic device (101) by the protective case. The protective case may be implemented with a transparent material. Accordingly, the accessory (102) disposed between the protective case and the electronic device (101) may be visually exposed.

[0073] For example, referring to FIG. 3a, a protective case (301) may be mounted on the rear surface (213a) of the second housing part (213) of the electronic device (101). An accessory (102) may be mounted so as to face the rear surface (213a) of the second housing part (213) by the protective case (301). Referring to FIG. 3b, a protective case (302) may be mounted on the rear surface (221a) of the housing structure (221) of the electronic device (101). An accessory (102) may be mounted so as to face the rear surface (221a) of the housing structure (221) by the protective case (302). Referring to FIG. 3c, a protective case (303) may be mounted on the rear surface (233a) of the second housing part (233) of the electronic device (101). The accessory (102) can be mounted facing the rear side (233a) of the second housing part (233) by a protective case (303).

[0074] According to one embodiment, the method of mounting the accessory (102) on the electronic device (101) is not limited to the above-described example. For example, the protective case may have a storage structure that facilitates insertion and withdrawal of the accessory (102). The accessory (102) may be mounted on the electronic device (101) by being inserted into the storage structure of the protective case mounted on the electronic device (101). In another example, the accessory (102) may be mounted on the electronic device (101) without a protective case, through a magnet, an adhesive material, or the like. In the present disclosure, mounting the accessory (102) on the electronic device (101) may include physically coupling, mounting, or directly attaching the accessory (102) to the electronic device (101).

[0075] According to one embodiment, the electronic device (101) can identify whether an accessory (102) is mounted on the electronic device (101). The electronic device (101) can communicate with the accessory (102) through near field communication (NFC). For example, the electronic device (101) can include an NFC reader (290a). When the accessory (102) is mounted on the electronic device (101), an NFC tag (290b) included in the accessory (102) can come into proximity with the NFC reader (290a). The electronic device (101) can detect the NFC tag (290b) using the NFC reader (290a) and obtain identification information of the accessory (102) stored in the NFC tag (290b) from the NFC tag (290b). The electronic device (101) can use the identification information to identify whether the accessory (102) is mounted on the electronic device (101).

[0076] According to one embodiment, the electronic device (101) can obtain data associated with the accessory (102) when the accessory (102) is identified as being mounted on the electronic device (101).

[0077] For example, one side of the accessory (102) may have various visual elements expressed (or printed), such as a specific pattern (e.g., geometric pattern, abstract pattern, etc.), a picture representing a specific event (e.g., Olympics, concert, etc.), a picture representing an artist's work, a scene from a movie or game, a natural or urban landscape, an animal, a character, or a brand logo. The one side of the accessory (102) may be visually exposed when the accessory (102) is mounted on the electronic device (101). The electronic device (101) may obtain data associated with the accessory (102) based on the identification that the accessory (102) is mounted on the electronic device (101). The data associated with the accessory (102) may include data for setting a theme of the electronic device (101) with a design that matches the design expressed on the one side of the accessory (102). For example, the theme of the electronic device (101) may include various visual elements of the user interface of the electronic device (101), such as a background image (or wallpaper) of the electronic device (101) (e.g., a background image includes a lock screen image displayed on a lock screen or a home screen image displayed on a home screen, and may be a still image or a moving image), a style of icons (e.g., shape, size, color, etc. of icons), a style of text (e.g., font, size, color, etc. of text), etc.

[0078] According to one embodiment, the electronic device (101) can obtain data associated with the accessory (102) using identification information of the accessory (102).

[0079] For example, the memory (e.g., 130 of FIG. 1) of the electronic device (101) can store data associated with accessories according to identification information of the plurality of accessories. The electronic device (101) can obtain data corresponding to identification information of the accessory (102) from the data stored in the memory (130). For example, if data is not stored in the electronic device (101), the electronic device (101) can access a server (e.g., 108 of FIG. 1) via the Internet, download data from the server (108), and store the downloaded data in the memory (130). The electronic device (101) can output a message for inquiring about downloading data, and when a user input requesting download of data is input, the electronic device (101) can request data corresponding to identification information of the accessory (102) from the server (108). For example, the electronic device (101) can transmit identification information of the accessory (102) to the server (108), thereby downloading data corresponding to the identification information of the accessory (102) from the server (108). For example, the accessory (102) can include a memory capable of storing data. When the accessory (102) is mounted on the electronic device (101), the electronic device (101) can directly receive the data from the accessory (102) together with the identification information of the accessory (102) through NFC communication, and store the received data in the memory (130).

[0080] According to one embodiment, the electronic device (101) can set a theme of the electronic device (101) using data associated with the accessory (102).

[0081] For example, the electronic device (101) can set a lock screen image or home screen image of the electronic device (101) using an image included in data associated with the accessory (102). As an example, an accessory (102) displaying a specific character can be mounted on the electronic device (101). The character can be a visual element appearing in content such as movies, animations, games, etc., or a visual element representing a brand. When the accessory (102) is mounted on the electronic device (101), the electronic device (101) can set an image including the character or an animation of the character moving as a lock screen image.

[0082] For example, the electronic device (101) can set the style of an icon of the electronic device (101) using the style information of the icon included in the data associated with the accessory (102). As an example, an accessory (102) displaying a brand logo can be mounted on the electronic device (101). When the accessory (102) is mounted, the electronic device (101) can set the color of the icon to the color of the brand logo.

[0083] In this way, in the present disclosure, a theme that matches the design of the accessory (102) is applied to the electronic device (101), thereby providing a unified and consistent visual experience to the user.

[0084] FIG. 4 illustrates an example of an electronic device displaying content when an accessory is mounted on the electronic device according to one embodiment.

[0085] Referring to FIG. 4, when an accessory (102) having a character (410) expressed thereon is mounted on an electronic device (101), the electronic device (101) may acquire an image (420) using data associated with the accessory (102) and set the image (420) as a lock screen image of the electronic device (101). The image (420) may display multiple characters (410). The motion or expression of the character included in the image (420) may be the same as or different from the motion or expression of the character (410) displayed on the accessory (102). For example, in a second state (e.g., a fully folded state), the second display (216) provided on the rear surface (212a) of the first housing part (212) may be deactivated. The electronic device (101) can activate the second display (216) and display an image (420) on the second display (216) when the user presses the key button (218) or touches the second display (216).

[0086] According to one embodiment, a display may be arranged on the back of the electronic device (101). FIG. 5A illustrates an example in which a display is arranged on the back of a first type of electronic device according to one embodiment. FIG. 5B illustrates an example in which a display is arranged on the back of a second type of electronic device according to one embodiment. FIG. 5C illustrates an example in which a display is arranged on the back of a third type of electronic device according to one embodiment.

[0087] Referring to FIG. 5a, the display (241) may be disposed on the rear side of the second housing part (213) of the electronic device (101). Referring to FIG. 5b, the display (242) may be disposed on the rear side of the housing structure (221) of the electronic device (101). Referring to FIG. 5c, the display (243) may be disposed on the rear side of the second housing part (233) of the electronic device (101).

[0088] Referring to FIGS. 5A, 5B, and 5C, the displays (241, 242, and 243) may be implemented as electronic ink (e-ink) displays. For example, the e-ink display may be composed of millions of microcapsules, each of which may contain white and black charged particles. The electronic device (101) may manipulate the particles via an electric field to display an image on the e-ink display. According to one embodiment, the displays (241, 242, and 243) may be implemented as detachable (or externally mountable) e-ink displays. For example, when the displays (241, 242, and 243) are implemented as detachable e-ink displays, the electronic device (101) may communicate with the displays (241, 242, and 243) via a short-range communication method such as Bluetooth or NFC, to display an image on the displays (241, 242, and 243).

[0089] FIG. 6 illustrates an example of a block diagram of an electronic device according to one embodiment. The electronic device (101) of FIG. 1 may correspond to the electronic device (600) of FIG. 6. The electronic device (600) of FIG. 6 may include the electronic device (101) of FIG. 1. The electronic device (600) of FIG. 6 may include at least one component among the components of the electronic device (101) illustrated in FIG. 1. In addition, the electronic device (600) of FIG. 6 may be the first type of electronic device (101), the second type of electronic device (101), or the third type of electronic device (101) described above. The components, their relationships, and their functions illustrated in FIG. 6 are merely exemplary and do not limit the implementations described or claimed within this document.

[0090] The electronic device (600) may include at least one processor (610) (hereinafter, referred to as processor (610)), at least one memory (620) (hereinafter, referred to as memory (620)), and at least one display (630) (hereinafter, referred to as display (630)). The processor (610), the memory (620), and the display (630) of FIG. 6 may be implemented substantially identically to the processor (120), the memory (130), and the display module (160) of FIG. 1, respectively, and thus may perform the same functions.

[0091] The components illustrated in FIG. 6 are merely exemplary. For example, the electronic device (600) may include other components (e.g., at least one image sensor, at least one communication circuit, at least one sensor, power management integrated circuitry (PMIC), audio processing circuitry, an antenna, a rechargeable battery, and / or an input / output interface). For example, some components may be omitted from the electronic device (600). For example, some components may be integrated into a single component.

[0092] The processor (610) can control the overall operations of the electronic device (600). For example, the processor (610) can be operatively connected to the memory (620) and the display (630) to control the operations of the electronic device (600). In addition, the processor (610) can control the operations of the electronic device (600) according to the present disclosure by executing one or more instructions stored in the memory (620). The processor (610) can be composed of one or more processors.

[0093] The processor (610) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing. The processor (610) may include at least one electrical circuit and may individually or collectively perform distributed processing of instructions (or programs, data, etc.) stored in the memory (620). The processor (610) may include a processor assembly including one or more processing circuits. The processor (610) may include any processing circuit operative to control the performance and operations of one or more components (e.g., the memory (620), the display (630)) of the electronic device (600). For example, the processor (610) (e.g., an application processor (AP)) may be implemented as a system on chip (SoC) (e.g., a single chip or chipset). For example, the processor (610) may be implemented as multiple cores (or at least one core circuit), multiple chips, or multiple chipsets. For example, the processor (610) may include one or more processing circuits. For example, the processor (610) may include one or more processing circuits configured to individually and / or collectively perform various functions of the present disclosure. As a non-limiting example, at least a portion of the processor (610) may be included in a first chip of the electronic device (600), and at least another portion of the processor (610) may be included in a second chip of the electronic device (600) that is different from the first chip of the electronic device (600).

[0094] For example, the processor (610) may include a central processing unit (CPU), a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a display controller, a memory controller, a storage controller, a communication processor (CP), and / or a sensor interface. These components of the processor (610) are merely exemplary. For example, the processor (610) may further include other components. For example, some components of the processor (610) may be omitted from the processor (610). For example, some components of the processor (610) may be included as separate components of the electronic device (600) outside the processor (610). For example, some components of the processor (610) (e.g., a memory controller) may be included within other components (e.g., at least a portion of the memory (220), an interface (e.g., available for connecting to at least one component of the electronic device (600), the display (230)).

[0095] The processor (610) may cause other components of the electronic device (600) to perform various operations by executing instructions stored in the memory (220). The CPU (or central processing circuit) may be configured to control components of the processor (610) based on the execution of instructions stored in the memory (220) (e.g., volatile memory and / or non-volatile memory). The GPU (or graphics processing circuit) may be configured to perform parallel operations (e.g., rendering). The NPU (or neural processing circuit, or AI (artificial intelligence) chip) may be configured to perform operations for an artificial intelligence model (e.g., convolution computation). The ISP (or image signal processing circuit) may be configured to process a raw image acquired through an image sensor into a format suitable for components within the electronic device (600) or components of the processor (610). A display controller (or display control circuit, or display processing unit (DPU)) may be configured to process an image acquired from a CPU, GPU, ISP, or memory (220) (e.g., volatile memory) into a format suitable for the display (230). A memory controller (or memory control circuit) may be configured to control reading data from volatile memory and writing data to volatile memory. A storage controller (or storage control circuit) may be configured to control reading data from non-volatile memory and writing data to non-volatile memory. A CP (communication processing circuit) may be configured to process data acquired from a component of the processor (610) into a format suitable for transmitting to another electronic device via a communication circuit, or to process data acquired from another electronic device via a communication circuit into a format suitable for processing by a component of the processor (610).For example, the communication circuit may include one or more communication circuits. The sensor interface (or sensing data processing circuit, sensor hub) may be configured to process data about the state of the electronic device (600) and / or the state of the surroundings of the electronic device (600), obtained through the sensor, into a format suitable for components of the processor (610).

[0096] For example, the processor (610) may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in the memory (220).

[0097] When a method according to an embodiment of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0098] The processor (610) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When the processor (610) is implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0099] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0100] In embodiments of the present disclosure, a processor may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but embodiments of the present disclosure are not limited thereto.

[0101] The memory (620) may include one or more storage media (or one or more storage devices). For example, the memory (620) may include a memory assembly including one or more storage media. For example, the one or more storage media may include permanent memory (e.g., non-volatile memory) such as a hard drive, flash memory, read-only memory (ROM), semi-permanent memory (e.g., volatile memory) such as random access memory (RAM), any other suitable type of storage (or storage assembly), or any combination thereof. The memory (620) may include cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (200). As a non-limiting example, the cache memory may be included within the processor (610). The memory (620) may be fixedly embedded within the electronic device (200) or incorporated into one or more suitable types of components (e.g., a subscriber identity module (SIM) card and / or a secure digital (SD) card) that can be repeatedly inserted into and removed from the electronic device (200).

[0102] For example, the memory (620) may store one or more software applications, such as an operating system (or system) software application, a firmware software application, a driver software application, a plug-in (e.g., add-in, add-on, and / or applet) software application, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by the processor (210). For example, the memory (620) may store instructions callable by an application programming interface (API). For example, the memory (620) may store instructions within a library.

[0103] The display (630) is controlled by the processor (610) and can output visualized information to the user. The visual information may include visual objects displayed on the display (630). For example, the visual objects may include screens, images, icons, GUIs, UI elements, etc.

[0104] For example, if the electronic device (600) is a first type of electronic device (101), the display (630) may include a first display (215) and a second display (216). If the electronic device (600) is a second type of electronic device (101), the display (630) may include a display (222). If the electronic device (600) is a third type of electronic device (101), the display (630) may include a first display (235) and a second display (236).

[0105] For example, the display (630) may be implemented as a flat panel display (FPD), a curved display, or a flexible display. For example, the display (630) may be implemented as various types of displays, such as a liquid crystal display (LCD) display, an active matrix organic light emitting diode (AMOLED) display, a light emitting diode (LED), a micro LED, a mini LED, etc.

[0106] The display (630) may include a touch-sensitive circuit configured to detect a touch. The touch-sensitive circuit may acquire user input for the display (630). For example, the touch-sensitive circuit may detect an input (e.g., a touch input or a hovering input) at a specific location of the display (630) by measuring a change in a signal (e.g., voltage, light intensity, resistance, or charge) at the specific location, and provide information about the detected input to the processor (610).

[0107] FIGS. 7A and 7B are diagrams illustrating an example of a method for an electronic device to provide a notification according to one embodiment. The processor (610) may perform at least one of the operations of FIGS. 7A and 7B . Instructions stored in the memory (620) of the electronic device (600), when individually or collectively executed by the processor (610) of the electronic device (600), may cause the electronic device (600) to perform the operations of FIGS. 7A and 7B .

[0108] According to one embodiment, when displaying a notification, the electronic device (600) may obtain a notification image (or images) and display the notification image on the display (630) together with the notification.

[0109] Referring to FIGS. 7A and 7B, the electronic device (600) may request generation of a notification image based on theme data (710), notification data (720), and context data (730).

[0110] For example, theme data (710) may include at least one of information about a background image (711), style information about text (712), and style information about an icon (713).

[0111] For example, the notification data (720) may include at least one of the name of the application providing the notification (721), the content of the notification (722), the color of the application icon (723), and the importance of the alarm (724).

[0112] For example, context data (730) may include at least one of the time and / or date (731) when the event occurred, the weather (732) when the event occurred, the season (733) when the event occurred, the location (734) of the electronic device (600) when the event occurred, a device (735) connected to the electronic device (600) when the event occurred, the user's schedule (736) when the event occurred, the user's activity status (737) when the event occurred, the user's profile information (738) when the event occurred, the user's taste information (739), and the user's emotional information (741).

[0113] For example, a request for generating a notification image may include generating a prompt (750) requesting the generation of an image related to a notification based on theme data (710) of the electronic device (600), notification data (720) related to the notification, and context data (730) corresponding to the time of occurrence of the event, and inputting the prompt (750) into an artificial intelligence model. The artificial intelligence model may be a model that generates new content (e.g., images, text, audio, etc.) based on the input.

[0114] For example, referring to FIG. 7A, the artificial intelligence model (761) may be a model included in and operated by the electronic device (600). For example, the artificial intelligence model (761) may be implemented in the form of an on-device included in the electronic device (600). The electronic device (600) may input a prompt (750) into the artificial intelligence model (761) stored in the memory (620) to obtain a notification image (770) generated by the artificial intelligence model (761).

[0115] For example, referring to FIG. 7B, the artificial intelligence model (781) may be a model that operates in a computing device (780) (e.g., 108 of FIG. 1) that is operatively connected to the electronic device (600). For example, the electronic device (600) may communicate with the computing device (780) via a communication module (e.g., 190 of FIG. 1), transmit a prompt (750) to the computing device (780), and receive a notification image (770) generated by the artificial intelligence model (781) of the computing device (780).

[0116] FIGS. 8A and 8B illustrate an example of an electronic device displaying a notification image according to one embodiment.

[0117] Referring to 801 of FIG. 8A, the electronic device (600) may display a lock screen (811). Referring to 821 of FIG. 8B, the electronic device (600) may display a home screen (831). The lock screen (811) or the home screen (831) may include a background image (840). The background image (840) may be set by the user or may be set based on an accessory (102) mounted on the electronic device (600).

[0118] For example, when a user orders a beverage through an application stored in an electronic device (600), the application may provide a notification message indicating that the beverage order has been completed. When the occurrence of an event for providing the notification is detected, the electronic device (600) may obtain a notification image using an artificial intelligence model. For example, referring to 802 of FIG. 8A , the electronic device (600) may display a lock screen (811) including an image (850) related to the notification, and may display a notification (812) indicating that the beverage order has been completed on the lock screen (811). Referring to 822 of FIG. 8B , the electronic device (600) may display a home screen (831) including a notification image (850), and may display a notification (832) indicating that the beverage order has been completed on the home screen (831). Referring to 802 of FIG. 8A and 822 of FIG. 8B , the notification image (850) may include the same character as the background image (840). The character included in the notification image (850) may be wearing clothes of the color of the icon corresponding to the retail application and may be holding a cup with the brand logo of the beverage drawn on it.

[0119] Referring to 803 of FIG. 8A and 823 of FIG. 8B , the electronic device (600) may stop displaying notifications (812, 832) when a preset time elapses without a touch input for the notification. In addition, the electronic device (600) may stop displaying the notification image (850) and display the background image (840) that was originally displayed on the lock screen (811) or home screen (831). Meanwhile, when a touch input for the notification is received, the electronic device (600) may display an execution screen of a retail application. The execution screen may display specific information related to a beverage order.

[0120] FIG. 9 is a diagram illustrating operations of an electronic device displaying a notification according to one embodiment. The processor (610) may perform at least one of the operations of FIG. 9. Instructions stored in the memory (620) of the electronic device (600), when individually or collectively executed by the processor (610) of the electronic device (600), may cause the electronic device (600) to perform the operations of FIG. 9.

[0121] In operation 910, the electronic device (600) may detect the occurrence of an event to provide a notification.

[0122] According to one embodiment, the notification may include a notification provided by the system of the electronic device (600).

[0123] For example, the system may include software (e.g., an operating system) and / or hardware that manages the basic operations and functions of the electronic device (600) so that the electronic device (600) operates smoothly. For example, system notifications may include battery notifications (e.g., a notification indicating a low battery), software update notifications (e.g., a notification indicating that a software update is available), storage space notifications (e.g., a notification indicating that storage space is low), network status notifications (e.g., a notification indicating a lost network connection, a notification indicating that a new network has been discovered), and the like.

[0124] According to one embodiment, the notification may include a notification provided by an application stored in the electronic device (600). The notification may be provided in the form of a push notification.

[0125] For example, when a mail application receives an email, it may provide (or generate) a notification related to the email. For example, the notification may include a notification message indicating the receipt of a new email, the sender, and the content of the email.

[0126] For example, a schedule management application (e.g., a calendar application) may provide a notification related to an event when an event set in the schedule management application approaches. For example, the notification may include a notification message indicating that the event has arrived, the event details (e.g., the event name, time, etc.), etc.

[0127] For example, a messaging application may provide notifications related to the receipt of a message. For example, the notification may include information about the receipt of a new message, the sender, and the content of the message.

[0128] For example, a social media application (or social networking service application) may provide a notification related to a specific event, such as receiving a message, another user commenting or indicating a preference (e.g., liking) on ​​a user's post (e.g., a photo or post), or another user tagging the user in a post. For example, the notification may include information about the event (e.g., a notification message indicating that a new message or comment has been received, the content of the message or comment, etc.).

[0129] For example, a shopping application can provide notifications related to events related to the shopping service when they occur. For example, notifications may include product ordering and delivery, product restocking, and promotions.

[0130] For example, a financial application may provide notifications related to financial transactions, such as account transfers or payment approvals, when such transactions occur. For example, the notifications may include a notification message indicating the occurrence of a financial transaction and details of the transaction (e.g., the transferee, the amount transferred, the payment approval location, the amount approved, etc.).

[0131] For example, a gaming application may provide notifications related to game-related events when they occur. For example, notifications may include notification messages for game launches, friend requests, updates, promotions, and more.

[0132] For example, a retail application can provide notifications related to events occurring within a store's services. For example, notifications can include messages indicating that a user has completed a food (or beverage) order, messages indicating that the food ordered is ready at the store, locations and operating hours of nearby stores, coupons, new product launches, promotions, and more.

[0133] For example, a delivery application may provide notifications related to delivery service-related events when they occur. For example, notifications may include a notification message indicating that the delivery person has picked up the food, or a notification message indicating the delivery progress (e.g., the delivery person's location, estimated arrival time, etc.).

[0134] For example, a health application may provide notifications related to health service-related events when they occur. For example, notifications may include notification messages indicating exercise progress, exercise time, exercise amount (e.g., distance traveled), and exercise reminders.

[0135] In operations 910-Y, 920, the electronic device (600) may acquire theme data of the electronic device (600), notification data related to the notification, and context data corresponding to the occurrence time of the event based on the detection of the occurrence of an event for providing a notification.

[0136] According to one embodiment, the electronic device (600) may obtain theme data. The theme may include various visual elements related to the user interface of the electronic device (600).

[0137] According to one embodiment, the theme data may include information about a background image of the electronic device (600). The background image may include a lock screen image displayed on the lock screen or a background image displayed on the home screen. The information about the background image may include a text description of the background image. The text description may include descriptions of various visual elements, such as objects, scenes, etc. included in the background image. For example, the text description may be obtained by various techniques for extracting text from an image (e.g., image captioning, etc.) or may be generated by a user.

[0138] For example, information about a background image may include information about an object contained within the background image. Information about an object contained within the background image may include information that describes the object, such as the object's type, name, color, or location. An object may include an object or element visually represented in the image. For example, an object may include a character, a person, an animal, a building, a means of transportation, or a natural element (e.g., a mountain, the sea, the sky, etc.).

[0139] For example, information about a background image may include information about the content of the background image. The content of the background image may include a description of visual information contained in the background image, such as the scene, pattern, color, etc. that the background image represents.

[0140] According to one embodiment, the electronic device (600) can receive information about a background image from an external electronic device (e.g., server (108), accessory (102)). As described above, the electronic device (600) can transmit identification information of the accessory (102) to the server (108) to download data associated with the accessory (102) from the server (108) or receive data associated with the accessory (102) from the accessory (102). The data associated with the accessory (102) can include an image and information about the image. The electronic device (600) can set the received image as a background image and obtain information about the background image using the information about the image.

[0141] According to one embodiment, the memory (620) of the electronic device (600) may store information about a background image. For example, the electronic device (600) may store an image and information about the image in the media storage of the memory (620). The information about the image may be automatically generated when the image is captured by the electronic device (600). Alternatively, the information about the image may be manually input by a user. For example, the electronic device (600) may provide an interface through which a user may input information about the image when capturing the image or after capturing the image. The interface may be provided through various applications (e.g., a camera application, a gallery application, etc.). The electronic device (600) may retrieve information about the background image by searching for information corresponding to an image set as a background image among the information stored in the media storage.

[0142] According to one embodiment, theme data may include style information of text set on the electronic device (600). For example, the text may be text used on the home screen, settings menu, messages, etc. The style information of the text may include at least one of the font, size, and color of the text currently applied to the electronic device (600).

[0143] According to one embodiment, theme data may include style information of icons set on the electronic device (600). For example, icons may include application icons, system icons, folder icons, etc. used on the home screen, settings menu, etc. The style information of the icon may include at least one of the shape, size, and color of the icon currently applied to the electronic device (600).

[0144] According to one embodiment, the electronic device (600) may obtain notification data related to a notification. The notification data may include information about the notification. For example, the notification data may include information about at least one of the name of the application providing the notification, the content of the notification, the color of the icon corresponding to the application, and the importance of the notification.

[0145] For example, the importance of notifications can be set for each application or for each notification provided by an application. Users can set the importance of notifications provided by each application or for each notification provided by the application via an interface provided by the electronic device (600).

[0146] For example, the importance of a notification can be determined by whether the notification message is spam (or an advertisement).

[0147] For example, the electronic device (600) can analyze the message content using a message filtering algorithm to identify whether a received message is spam. A spam message may have the lowest importance level among multiple importance levels. For example, if the multiple importance levels are "high," "medium," and "low," the importance of a regular message may be "high" or "medium," while the importance of a spam message may be "low."

[0148] According to one embodiment, the electronic device (600) can obtain context data corresponding to the time of occurrence of an event.

[0149] Context data may include various information related to the status of the electronic device (600), the surrounding environment of the electronic device (600), the user's actions and status, etc.

[0150] For example, context data may include at least one piece of information from among multiple pieces of information. The multiple pieces of information may include various pieces of information with different attributes.

[0151] For example, context data may include information about the time and / or date an event occurred. For example, the electronic device (600) may obtain information about the time and / or date an event occurred using the system time (e.g., date and current time) managed by the operating system (e.g., 142 of FIG. 1 ). The system time may be acquired via cellular communication or managed in synchronization with time information acquired from a time server via the Internet.

[0152] For example, context data may include information about the location of the electronic device (600) at the time an event occurs. For example, the electronic device (600) may obtain location information of the electronic device (600) using a global positioning system (GPS) signal. For example, the electronic device (600) may search for access points around the electronic device (600) using WiFi communication, and may obtain location information of the electronic device (600) by identifying the location of the access point using identification information of the access point connected through WiFi communication (e.g., serial number, MAC address, or WiFi service set identifier (SSID).

[0153] For example, context data may include information about the weather at the time an event occurred. The electronic device (600) may request weather information from a server (e.g., 108 of FIG. 1) that provides weather information. For example, the electronic device (600) may transmit location information of the electronic device (600) to the server (108), thereby obtaining information about the weather in the area where the electronic device (600) is located from the server (108).

[0154] For example, context data may include information about the season at which an event occurred. For example, the electronic device (600) may identify the season at which an event occurred using time information (e.g., date) and location information of the electronic device (600).

[0155] For example, context data may include information about a device connected to the electronic device (600) at the time an event occurs. For example, the electronic device (600) may be connected to wireless earphones, wireless headphones, a smart phone, a wearable device (e.g., a smart watch, a smart ring), an electronic ink display attached to the electronic device (600), etc. via short-range wireless communication. The electronic device (600) may identify a device connected to the electronic device (600) at the time an event occurs and obtain information about the device (e.g., the type of device, the time the device was connected, information displayed on the device, etc.).

[0156] For example, context data may include information about the user's schedule at the time the event occurred. For example, based on the user's schedule information stored in a schedule management application, the electronic device (600) may obtain information (e.g., schedule name, time, etc.) about schedules within a preset time period from the time the event occurred within the user's schedule.

[0157] For example, contextual data may include information about the user's activity status at the time the event occurred. The user's activity status may include the user's exercise status and duration, such as whether the user is walking, running, or engaging in other types of exercise.

[0158] For example, the electronic device (600) can identify the user's activity state using a sensor module (e.g., 176 of FIG. 1). As an example, the sensor module (176) can include an acceleration sensor, a gyro sensor, or a geomagnetic sensor. The acceleration sensor can detect acceleration or impact of the electronic device (100). The gyro sensor can detect the rotational direction or rotational angle of the electronic device (100). The geomagnetic sensor can detect the direction of geomagnetism. The electronic device (600) can recognize the movement pattern of the electronic device (600) using sensor data detected by the acceleration sensor, the gyro sensor, or the geomagnetic sensor, and identify the user's activity state.

[0159] For example, a user's activity status can be received from the user. For example, the user can input the type of exercise the user performs, the start time, and the end time of the exercise, etc. through a health application. The electronic device (600) can identify the user's activity status based on the user input entered into the health application.

[0160] For example, the user's activity status can be received from a device connected to the electronic device (600). The wearable device connected to the electronic device (600) can obtain sensor data using a sensor module, and use the sensor data to recognize the movement pattern of the wearable device to identify the user's activity status.

[0161] For example, contextual data may include profile information from the time an event occurred. This profile information may include the user's gender, age, address, occupation, etc.

[0162] For example, context data may include information about the user's emotions or preferences at the time an event occurs. The electronic device (600) may analyze the user's personal data using an artificial intelligence model to identify the user's emotions or preferences. Personal data may include content stored in a media storage (e.g., photos, videos, etc.), content playlists of applications, the user's search history, content favorited by the user, messages sent by the user, etc. Personal data may be acquired through various applications and stored in the memory (620) of the electronic device (600) or a cloud server. For example, the electronic device (600) may analyze the background or location where an image was taken, objects included in the image, or identify keywords frequently searched by the user through the user's search history to identify the user's preferred foods, animals, locations, weather, etc. For example, the electronic device (600) may understand the meaning of words included in a message or notification message, determine whether the words are positive, negative, or neutral, and identify the user's emotions (e.g., happiness, joy, anxiety, sadness, etc.). For example, the electronic device (600) can identify the user's emotional state or mood by using information about the mood, genre, etc. of the content played by the user (e.g., music, movies, dramas, etc.).

[0163] In this way, context data may include at least one piece of information among multiple pieces of information.

[0164] According to one embodiment, the electronic device (600) can obtain context data corresponding to the time at which an event occurred by using context data stored in the memory (620). For example, the user's location, emotions, preferences, etc. may change over time. Therefore, information obtained a certain period of time ago may differ from the user's current state. If the time at which the context data stored in the memory (620) is obtained is within a preset time from the time at which the event occurred, the electronic device (600) can retrieve the context data stored in the memory (620) and obtain context data corresponding to the time at which the event occurred.

[0165] According to one embodiment, at least one piece of information included in the context information may be selected based on a user input. The electronic device (600) may obtain context data including at least one piece of information selected based on a user input from among a plurality of pieces of information. For example, the electronic device (600) may display an interface screen for selecting information to be used as context data on the display (630). For example, when location, weather, and time are selected through the interface screen, the electronic device (600) may obtain information about the location of the electronic device (600) at the time an event occurs, the weather at the time the event occurs, and the time the event occurred when generating context data, thereby generating context data. According to the present disclosure, since an artificial intelligence model uses context data composed of information selected by the user when generating a notification image, a notification image that better suits the user's preferences can be generated while protecting the user's privacy.

[0166] According to one embodiment, the electronic device (600) may identify context data including a first information set from among a plurality of pieces of information based on the event being a first event, and may identify context data including a second information set from among the plurality of pieces of information based on the event being a second event occurring after the first event. The attribute of at least one piece of information in the first information set may be different from the attribute of information included in the second information set. If the first event and the second event are different, the information sets included in the context data may be different.

[0167] For example, the electronic device (600) can identify a first information set and a second information set based on history data. The history data can include data about information used to generate a notification image. That is, the history data can include a history of which attributes of information were used as context data and used to generate a notification image. For example, the history data can include the number of times each piece of information was used to generate a notification image. For example, the history data can include a combination of information included in a group when a combination of information constituting context data is considered a group. The electronic device (600) can identify an information set from among a plurality of pieces of information based on the history data. For example, the electronic device (600) can identify a preset number of pieces of information in descending order of number of uses from among the plurality of pieces of information based on the history data, and obtain an information set including the identified information. For example, the electronic device (600) can identify a combination of information that has not been used previously based on the history data, and obtain an information set including the identified information. According to the present disclosure, when an artificial intelligence model generates a notification image using context data, context data composed of a different set of information than before can be used, so that various notification images can be generated.

[0168] According to one embodiment, the electronic device (600) can obtain context data including a set of information from among a plurality of pieces of information based on priority.

[0169] For example, the electronic device (600) may identify a predetermined number of pieces of information with a high priority among the plurality of pieces of information based on the priorities of the pieces of information, and obtain context data including the identified pieces of information. The priorities may be determined based on the preference for the information. For example, the higher the preference for the information, the higher the priority of the information. The lower the preference for the information, the lower the priority of the information.

[0170] According to one embodiment, the electronic device (600) can update a preference for at least one piece of information used to generate a notification image based on a user input for a notification image generated by an artificial intelligence model, and identify priorities for a plurality of pieces of information based on the preference.

[0171] For example, preferences can be generated or updated based on user input for a notification image generated by an AI model using contextual data.

[0172] For example, the user input may include a user input (e.g., a "like" button) for indicating a preference for a notification image. For example, the electronic device (600) may display a notification image generated by an artificial intelligence model as a background image on the screen and receive a user input selecting a heart-shaped icon displayed on the screen. Based on the user input, the electronic device (600) may increase a preference for at least one piece of information included in the context data used to generate the notification image, thereby generating or updating a preference for the information.

[0173] For example, the user input may include a user input for displaying a notification image on the electronic device (600) or transmitting it to another device. The electronic device (600) may store a notification image generated by an artificial intelligence model in a media storage. For example, the electronic device (600) may receive a user input for displaying a notification image from among images stored in the media storage through a gallery application. As another example, the electronic device (600) may receive a user input for transmitting a notification image from among images stored in the media storage to another device through a message application. In these cases, the electronic device (600) may increase a preference for at least one piece of information included in the context data used to generate the notification image based on the user input, thereby generating or updating a preference for the information.

[0174] In one embodiment, the time at which an event occurs may include a time interval from a first time point to the time point, a time interval from the time point to a second time point, or a time interval from the first time point to the second time point. The first time point may be a time interval before a preset time from the time at which the event occurs, and the second time point may be a time interval after a preset time from the time at which the event occurs. In other words, the time at which an event occurs may not mean the moment at which the event occurs, but rather a time interval before and after the time at which the event occurs.

[0175] For example, the preset time may be set at the time of manufacturing or initial use, or may be set and changed by user input.

[0176] For example, the preset time may be determined based on the properties of the information contained in the context data.

[0177] For example, an application may provide a notification indicating the user's progress after a certain amount of time has elapsed since the user began exercising or after the user has moved a certain distance since the user began exercising. The electronic device (600) may identify information about the user's activity status from before the event for providing the notification to after the event occurs, and obtain context data including the identified information.

[0178] For example, analyzing a user's emotions or preferences using personal data collected over a certain period of time can be more accurate. The electronic device (600) can acquire the user's personal data from a time period before an event to provide a notification occurs to a time period after the event occurs, use the personal data to identify the user's emotional or preference information, and obtain context data including the emotional or preference information.

[0179] In operation 930, the electronic device (600) may request generation of a notification image based on theme data, notification data, and context data.

[0180] As described above, the request for generating a notification image may include inputting a prompt to an artificial intelligence model requesting the generation of an image related to the notification based on theme data of the electronic device (600), notification data related to the notification, and context data corresponding to the time of occurrence of the event.

[0181] According to one embodiment, the electronic device (600) can obtain keywords from theme data, notification data, and context data.

[0182] Keywords can include words that represent the core content of a text. For example, keywords can include words that represent an object (e.g., a subject), words that represent an object's action, words that describe an object or its actions, words that represent a setting or location, words that represent time, words that express emotions or preferences, words that indicate importance, etc.

[0183] For example, the electronic device (600) may parse text constituting data to break down the text into multiple components and extract at least one keyword from the multiple components. For example, the electronic device (600) may extract at least one keyword from the text using a natural language processing (NLP) model. For example, the electronic device (600) may analyze the text using a pre-trained language model, identify the meaning, context, etc. of words in the text, extract important words in the text, and obtain at least one keyword. However, the present disclosure is not limited thereto, and the electronic device (600) may extract keywords using various algorithms.

[0184] According to one embodiment, the electronic device (600) can generate a prompt using a keyword.

[0185] A prompt may refer to an input for initiating an interaction with an artificial intelligence model that generates an image. The prompt may be a text input containing at least one word and / or at least one sentence. For example, the prompt may include natural language text. The natural language text may include various information that the artificial intelligence model can utilize to generate an image, such as context, intent, task, and constraints. The electronic device (600) may process the natural language text using an NLP model.

[0186] According to one embodiment, the electronic device (600) may generate a prompt requesting the generation of an image related to the notification by inserting a keyword into a placeholder of a prompt template.

[0187] For example, a placeholder may be a pre-designated location in a prompt template where a keyword is inserted. A placeholder to which a keyword is mapped may be pre-designated based on the keyword's attributes. For example, the electronic device (600) may generate a prompt by inserting a keyword into a placeholder of a prompt template. For example, the electronic device (600) may generate a prompt by inserting a keyword into a placeholder of a prompt template and specifying each element of the prompt template into which the keyword is inserted. For example, the electronic device (600) may add a specific description related to a keyword indicating an object, an object's behavior, a background or location, a time, an emotion, a color, etc. to the prompt template.

[0188] For example, the electronic device (600) can extract the keyword “XXX” (e.g., the name of a character included in a background image) from the theme data. The electronic device (600) can extract the keywords “YYY” (e.g., the name of the application providing the notification), “blue” (e.g., the color of the icon corresponding to the application), and “drink” from the notification data. “Drink” may be a keyword extracted from the notification message “Drink order completed.” In addition, the electronic device (600) can extract the keywords “sunny” (e.g., the weather at the time the event occurred) and “afternoon” (e.g., the time the event occurred) from the context data. The electronic device (600) can use the keywords to generate a prompt such as “Generate an image for [XXX] in [blue] clothes with [drink] of [sunny] [afternoon] [YYY].” However, the present disclosure is not limited thereto, and the electronic device (600) can generate a prompt using various prompt templates.

[0189] According to one embodiment, the electronic device (600) may generate a prompt requesting the generation of an image related to a notification by arranging keywords obtained from theme data, notification data, and context data by data.

[0190] Arranging keywords by data may include arranging at least one keyword extracted from the same data adjacent to each other within a prompt. For example, the electronic device (600) may group keywords obtained from the data and arrange the keywords by group to generate a prompt. For example, the keywords may be arranged in the following order within the prompt: a first keyword, a second keyword, and a third keyword. The first keyword may include at least one keyword extracted from any one of theme data, notification data, and context data. The second keyword may include at least one keyword extracted from another data. The third keyword may include at least one keyword extracted from the remaining data excluding the first two data.

[0191] As in the example described above, keywords extracted from theme data may include "XXX", keywords extracted from notification data may include "YYY", "blue", "drink", and keywords extracted from context data may include "sunny", "afternoon". The electronic device (600) may arrange the keywords in the order of XXX, YYY, blue, drink, sunny, afternoon, and generate a prompt such as "Generate an image for [XXX], [YYY], [blue], [drink], [sunny], [afternoon]". However, the present disclosure is not limited thereto, and the electronic device (600) may generate a prompt by arranging the keywords in various orders.

[0192] In operation 940, the electronic device (600) may obtain a notification image generated in response to the request.

[0193] According to one embodiment, the electronic device (600) may input a prompt to an artificial intelligence model, obtain an image generated by the artificial intelligence model (e.g., a notification image) from the artificial intelligence model, and store the image in a memory (620).

[0194] For example, an AI model may be a generative AI model. Generative AI can refer to an AI technology that can generate new text, images, audio, etc. in response to input data (e.g., text, images, audio, etc.). A generative AI model (or generative model) can refer to a neural network model that implements generative AI technology. A generative AI model can generate new data with similar characteristics to the input data or new data corresponding to the input data by learning the patterns and structure of training data. For example, a generative AI model can generate an image using a text-to-image method. For example, when a prompt is input, the AI ​​model can generate content corresponding to the prompt based on what it has learned.

[0195] In operation 950, the electronic device (600) may display a notification and a notification image on the display (630).

[0196] For example, the electronic device (600) may set an image generated by an artificial intelligence model based on a prompt as a background image, display a screen including the background image on a display (630), and display a notification on the screen. For example, the electronic device (600) may display an image generated by an artificial intelligence model based on a prompt on a display (630), and display a notification on the image, without changing the currently set background image.

[0197] According to one embodiment, the electronic device (600) may be the first type of electronic device (101) illustrated in FIG. 2A. In a first state of the electronic device (600), the electronic device (600) may display a screen including a notification image on a first display (e.g., 215 of FIG. 2A) and display a notification on the screen. In a second state of the electronic device (600), the electronic device (600) may display a screen including a notification image on a second display (e.g., 216 of FIG. 2A). The screen may include a home screen or a lock screen.

[0198] According to one embodiment, the electronic device (600) may be the second type of electronic device (101) illustrated in FIG. 2B. The electronic device (600) may display a screen including the image on a display (e.g., 222 of FIG. 2B). The screen may include a home screen or a lock screen.

[0199] According to one embodiment, the electronic device (600) may be the third type of electronic device (101) illustrated in FIG. 2C. In a first state of the electronic device (600), the electronic device (600) may display a screen including the image on a first display (e.g., 235 of FIG. 2C) and display a notification on the screen. In a second state of the electronic device (600), the electronic device (600) may display a screen including the image on a second display (e.g., 236 of FIG. 2C). The screen may include a home screen or a lock screen.

[0200] According to one embodiment, the electronic device (600) may display a notification image acquired based on a first event on the display (630) within a set time period, and then display a notification and the notification image related to the second event on the display (630) at least based on detecting the occurrence of a second event substantially the same as the first event.

[0201] According to one embodiment, the electronic device (600) may, within a set time after displaying a notification image acquired based on a first event on the display (630), request generation of a notification image to acquire a notification image different from the notification image, at least based on detection of occurrence of a second event substantially the same as the first event, acquire a notification image generated in response to the request, and display a notification related to the second event and the notification image on the display (630).

[0202] For example, the second event may be an event that occurred after the first event. For example, the first and second events being the same may include the application providing the notification related to the first event being substantially the same as the application providing the notification related to the second event, or the content of the notifications being substantially the same.

[0203] For example, when the occurrence of an event identical to a previously occurred event is detected, the electronic device (600) can retrieve a notification image for the previous event from the memory (620) without requesting the generation of a notification image, and display the notification image on the display (630) together with a notification for the event.

[0204] For example, when the occurrence of an event different from a previously occurred event is detected, the electronic device (600) may generate a prompt to obtain a notification image different from the previous event. For example, the electronic device (600) may configure information included in any one of theme data, notification data, or context data as information different from the previous one to generate a prompt. As another example, the electronic device (600) may generate a prompt that includes a request for a different notification image. As an example, assume that the prompt generated for the previous event is “Generate images for [XXX], [YYY], [Blue], [Drink], [Clear], [Afternoon].” The electronic device (600) may generate a prompt for an event that occurs after the previous event, such as “Generate images different from the previously generated images for [XXX], [YYY], [Blue], [Drink], [Clear], [Afternoon].”

[0205] In this way, according to the present disclosure, if the event is the same as before, the previous notification image can be provided to the user again, or a different notification image can be provided to the user, thereby increasing efficiency and user experience.

[0206] FIGS. 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, and 20 are diagrams illustrating various examples of an electronic device displaying notifications and images according to one embodiment. Instructions stored in a memory (620) of an electronic device (600) may cause the electronic device (600) to perform the operations of FIGS. 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, and 20 when individually or collectively executed by a processor (610) of the electronic device (600).

[0207] Below, the notification image displayed with the notification is described as an image.

[0208] Referring to 1001 of FIG. 10, the electronic device (600) may display a lock screen including a background image (1011).

[0209] For example, when a user orders a drink using an application stored in an electronic device (600), the application may provide a notification indicating that the drink order has been completed. When the occurrence of an event for providing a notification is detected, the electronic device (600) may acquire an image using theme data (1021), notification data (1022), and context data (1023). The image is a notification image displayed together with the notification and may be generated by an artificial intelligence model. For example, theme data (1021) may include the name of a character included in the background image (1011). Notification data (1022) may include the name of the application, the color of the icon of the application, the content of the notification (e.g., completion of a drink order), and the importance of the notification (e.g., high). Context data (1023) may include the weather (e.g., clear) and season (e.g., summer) at the time the event occurred, and the time (e.g., daytime) at which the event occurred.

[0210] Referring to 1002 of FIG. 10, the electronic device (600) may display an image (1031) and a notification (1032) obtained based on theme data (1021), notification data (1022), and context data (1023). The character included in the image (1031) may include the same character as the character included in the background image (1011). The character in the image (1031) may be wearing a hat and clothes of the color of the icon of the application, and may be holding a cup having the logo of a beverage brand corresponding to the name of the application drawn on it. The background of the image (1031) may be a cafe on a summer day.

[0211] Referring to 1101 of FIG. 11, the electronic device (600) may display a lock screen including a background image (1111).

[0212] For example, an application stored in an electronic device (600) may provide a notification notifying the issuance of a birthday coupon on the user's birthday. When the occurrence of an event for providing a notification is detected, the electronic device (600) may acquire an image using theme data (1121), notification data (1122), and context data (1123). The image is a notification image displayed together with the notification and may be generated by an artificial intelligence model. For example, theme data (1121) may include the name of a character included in the background image (1111). Notification data (1122) may include the name of the application, the color of the application's icon, the content of the notification (e.g., issuance of a birthday coupon), and the importance of the notification (e.g., high). Context data (1123) may include the weather (e.g., clear) and season (e.g., summer) at the time the event occurred, and the time (e.g., daytime) at which the event occurred.

[0213] Referring to 1102 of FIG. 11, the electronic device (600) may display an image (1131) and a notification (1132) obtained based on theme data (1121), notification data (1122), and context data (1123). The image (1131) may include the same character as the character included in the background image (1111). The character in the image (1131) may wear a hat in the color of the application's icon, wear clothes with the logo of a beverage brand corresponding to the application's name, and hold a coupon. The background of the image (1131) may be a birthday party location.

[0214] Referring to 1201a of FIG. 12a and 1201b of FIG. 12b, the electronic device (600) can display a lock screen including a background image (1211).

[0215] For example, an application stored in an electronic device (600) may provide a notification informing of the issuance of a Christmas coupon when Christmas approaches. When the occurrence of an event for providing a notification is detected, the electronic device (600) may acquire an image using theme data (1221), notification data (1222), and context data (1223a, 1223b). The image is a notification image displayed together with the notification and may be generated by an artificial intelligence model. For example, theme data (1221) may include the name of a character included in the background image (1211). Notification data (1222) may include the name of the application, the color of the application icon, the content of the notification (e.g., issuance of a Christmas coupon), and the importance of the notification (e.g., upper). Context data (1223a) may include a schedule (e.g., Christmas) and season (e.g., winter) at the time the event occurred, a time (e.g., daytime) at the time the event occurred, a user's emotion (e.g., happiness) and preferences (e.g., 2D graphics) at the time the event occurred. Context data (1223b) may include a schedule (e.g., Christmas) and season (e.g., winter) at the time the event occurred, a time (e.g., daytime) at the time the event occurred, a user's emotion (e.g., happiness) and preferences (e.g., 3D graphics) at the time the event occurred.

[0216] Referring to 1202a of FIG. 12a, the electronic device (600) may display an image (1231a) and a notification (1232) obtained based on theme data (1221), notification data (1222), and context data (1223a). The image (1231a) may include the same character as the character included in the background image (1211). The visual elements (e.g., character, background, etc.) of the image (1231a) may be expressed in 2D. The character in the image (1231a) may be wearing a Santa hat and clothes with the logo of a beverage brand corresponding to the name of the application drawn on them. The background of the image (1231a) may be a place with a Christmas tree and presents.

[0217] Referring to 1202b of FIG. 12b, the electronic device (600) may display an image (1231b) and a notification (1232) obtained based on theme data (1221), notification data (1222), and context data (1223b). The image (1231b) may include the same character as the character included in the background image (1211). The visual elements (e.g., character, background, etc.) of the image (1231b) may be expressed in 3D. The character in the image (1231b) may be wearing a Santa hat and clothes with the logo of a beverage brand corresponding to the name of the application drawn on them. The background of the image (1231b) may be a place with a Christmas tree and presents.

[0218] In this way, according to the present disclosure, images having various graphic forms can be displayed along with notifications according to the user's preference.

[0219] Referring to 1301a of FIG. 13a and 1301b of FIG. 13b, the electronic device (600) can display a lock screen including a background image (1311).

[0220] For example, an application stored in an electronic device (600) may provide a notification notifying a "golf appointment" when a schedule for a "golf appointment" set by a user approaches. When the occurrence of an event for providing a notification is detected, the electronic device (600) may acquire an image using theme data (1321), notification data (1322), and context data (1323a, 1323b). The image is a notification image displayed together with the notification and may be generated by an artificial intelligence model. For example, theme data (1321) may include the name of a character included in the background image (1311). Notification data (1322) may include the name of the application, the color of the icon of the application, the content of the notification (e.g., the content of the golf appointment including the appointment location and time), and the importance of the notification (e.g., "high"). Context data (1323a) may include the season (e.g., summer) and weather (e.g., rain) at the time the event occurred, the time the event occurred (e.g., daytime), and the user's preference (e.g., dislikes rainy days) at the time the event occurred. Context data (1323b) may include the season (e.g., summer) and weather (e.g., rain) at the time the event occurred, the time the event occurred (e.g., daytime), and the user's preference (e.g., likes rainy days) at the time the event occurred.

[0221] Referring to 1302a of FIG. 13a, the electronic device (600) may display an image (1331a) and a notification (1332) obtained based on theme data (1321), notification data (1322), and context data (1323a). The image (1331a) may include the same character as the character included in the background image (1311). The character in the image (1331a) may have a sad expression and assume a golfing pose. The background of the image (1331a) may be a rainy golf course.

[0222] Referring to 1302b of FIG. 13b, the electronic device (600) may display an image (1331b) and a notification (1332) obtained based on theme data (1321), notification data (1322), and context data (1323b). The image (1331b) may include the same character as the character included in the background image (1311). The character in the image (1331b) may assume a golfing pose with a cheerful expression. The background of the image (1331b) may be a rainy golf course.

[0223] In this way, according to the present disclosure, an image including characters with various facial expressions may be displayed along with a notification according to the user's preference.

[0224] Referring to 1401a of FIG. 14a and 1401b of FIG. 14b, the electronic device (600) can display a lock screen including a background image (1411).

[0225] For example, the system of the electronic device (600) may provide a notification indicating "sleep mode" when midnight approaches. When the occurrence of an event for providing a notification is detected, the electronic device (600) may acquire an image using theme data (1421), notification data (1422), and context data (1423a, 1423b). The image is a notification image displayed together with the notification and may be generated by an artificial intelligence model. For example, theme data (1421) may include the name of the character included in the background image (1411) and the font of the text. Notification data (1422) may include the content of the notification (e.g., sleep mode) and the importance of the notification (e.g., high). Context data (1423a) may include the season (e.g., winter) and weather (e.g., snow) at the time the event occurred, the time the event occurred (e.g., night), and the user's schedule at the time the event occurred (e.g., tomorrow's exam). Context data (1423b) may include the season when the event occurred (e.g., summer), the time when the event occurred (e.g., night), and the user's schedule when the event occurred (e.g., exam tomorrow).

[0226] Referring to 1402a of FIG. 14A, the electronic device (600) may display an image (1431a) and a notification (1432) obtained based on theme data (1421), notification data (1422), and context data (1423a). The image (1431a) may include the same character as the character included in the background image (1411). The character in the image (1431a) may be lying down with a sleepy expression. The background of the image (1431a) may be an indoor location on a snowy night. The image (1431a) may include text such as "Good night for tomorrow's test." The font of the text included in the image may be the same font as the font of the text set in the electronic device (600).

[0227] Referring to 1402b of FIG. 14B, the electronic device (600) may display an image (1431b) and a notification (1432) obtained based on theme data (1421), notification data (1422), and context data (1423b). The image (1431b) may include the same character as the character included in the background image (1411). The image (1431b) may be sitting with a sleepy expression. The background of the image (1431b) may be an outdoor location on a summer night. The image (1431b) may include text such as "I'm tired from preparing for the exam." The font of the text included in the image may be the same font as the font of the text set in the electronic device (600).

[0228] In this way, according to the present disclosure, images with different backgrounds can be displayed along with a notification depending on the time and season at which the event occurred.

[0229] Referring to 1501a of FIG. 15a, 1501b of FIG. 15b and 1501c of FIG. 15b, the electronic device (600) can display a lock screen including a background image (1511).

[0230] For example, an application stored in an electronic device (600) may provide a notification informing the user of the progress of his / her exercise. When the occurrence of an event for providing a notification is detected, the electronic device (600) may acquire an image using theme data (1521), notification data (1522), and context data (1523a, 1523b, 1523c). The image is a notification image displayed together with the notification and may be generated by an artificial intelligence model. For example, theme data (1521) may include the name of a character included in the background image (1511). Notification data (1522) may include the name of the application, the content of the notification (e.g., exercise progress including running time, distance, etc.), and the importance of the notification (e.g., "high"). Context data (1523a) may include the time when the event occurred (e.g., morning), the weather at the time when the event occurred (e.g., cloudy), the user's activity status (e.g., running time (10 minutes), distance (7.5 km)), and a device (e.g., headset) connected to the electronic device (600) at the time when the event occurred. Context data (1523a) may include the time when the event occurred (e.g., morning), the weather at the time when the event occurred (e.g., cloudy), the user's activity status (e.g., running time (2 hours 10 minutes), distance (30.5 km)), and a device (e.g., headset) connected to the electronic device (600) at the time when the event occurred. Context data (1523c) may include the time when the event occurred (e.g., morning), the weather at the time when the event occurred (e.g., cloudy), the user's activity status (e.g., running time (2 hours 10 minutes), distance (30.5 km)), and a device (e.g., headset) connected to the electronic device (600) at the time when the event occurred.

[0231] Referring to 1502a of FIG. 15a, the electronic device (600) may display an image (1531a) and a notification (1532a) obtained based on theme data (1521), notification data (1522), and context data (1523a). The image (1531a) may include the same character as the character included in the background image (1511). The character in the image (1531a) may be wearing a headset and running. The background of the image (1531a) may be a park on a cloudy morning.

[0232] Referring to 1502b of FIG. 15b, the electronic device (600) may display an image (1531b) and a notification (1532b) obtained based on theme data (1521), notification data (1522), and context data (1523b). The image (1531b) may include the same character as the character included in the background image (1511). The character in the image (1531b) may be wearing a headset and running with a tired expression. The background of the image (1531b) may be a park on a cloudy morning.

[0233] Referring to 1502c of FIG. 15c, the electronic device (600) may display an image (1531c) and a notification (1532c) obtained based on theme data (1521), notification data (1522), and context data (1523c). The image (1531c) may include the same character as the character included in the background image (1511). The character in the image (1531c) may be wearing a headset and running with a cheering expression. The background of the image (1531b) may be a stadium on a cloudy morning.

[0234] In this way, according to the present disclosure, an image including a character making various facial expressions and poses may be displayed along with a notification depending on the user's activity state at the time the event occurs.

[0235] Referring to 1601a of FIG. 16a and 1601b of FIG. 16b, the electronic device (600) can display a lock screen including a background image (1611).

[0236] For example, an application stored in an electronic device (600) may provide a notification informing a user of the delivery status (e.g., expected arrival time) of food ordered through the application. When the occurrence of an event for providing a notification is detected, the electronic device (600) may acquire an image using theme data (1621), notification data (1622a, 1622b), and context data (1623). The image is a notification image displayed together with the notification and may be generated by an artificial intelligence model. For example, theme data (1621) may include the type of object included in the background image (1611) (e.g., cat, puppy). Notification data (1622a) may include the name of the application, the color of the icon of the application, the content of the notification (e.g., delivery progress indicating an expected arrival in 20 minutes), and the importance of the notification (e.g., high). Notification data (1622b) may include the name of the application, the color of the application icon, the content of the notification (e.g., delivery progress indicating an expected arrival in 10 minutes), and the importance of the notification (e.g., "high"). Context data (1623) may include the weather at the time the event occurred (e.g., "sunny"), the location of the electronic device (600) (e.g., "home"), and the user's preferences (e.g., "animals").

[0237] Referring to 1602a of FIG. 16A, the electronic device (600) may display an image (1631a) and a notification (1632a) obtained based on theme data (1621), notification data (1622a), and context data (1623). The image (1631a) may include a puppy among the types of objects (e.g., puppy, cat) included in the background image (1611). The puppy in the image (1631a) may be holding a shopping bag with the logo of a delivery brand corresponding to the name of the application drawn on it. The color of the shopping bag may be the color of the application icon.

[0238] Referring to 1602b of FIG. 16b, the electronic device (600) may display an image (1631b) and a notification (1632b) obtained based on theme data (1621), notification data (1622b), and context data (1623). The image (1631b) may include a cat among the types of objects (e.g., dog, cat) included in the background image (1611). The cat in the image (1631b) may be wearing a hat with a logo of a delivery brand corresponding to the name of the application drawn on it, and may be carrying a bag. The colors of the hat and bag may be the colors of the icon of the application.

[0239] In this way, according to the present disclosure, images including various visual elements (e.g., objects, backgrounds) may be displayed along with a notification depending on the number of times the notification is provided.

[0240] Referring to 1701 of FIG. 17, the electronic device (600) may display a lock screen including a background image (1711).

[0241] For example, when a message is received, an application stored in an electronic device (600) may provide a notification to notify the receipt of the message. When the occurrence of an event for providing a notification is detected, the electronic device (600) may acquire an image using theme data (1721), notification data (1722), and context data (1723). The image is a notification image displayed together with the notification and may be generated by an artificial intelligence model. For example, theme data (1721) may include the name of a character included in the background image (1711). Notification data (1722) may include the content of the notification (e.g., that it is a spam message) and the importance of the notification (e.g., low). If the electronic device (600) identifies a received message as a spam message, the electronic device (600) may generate notification data (1722) including spam message information (e.g., text information indicating that the message is a spam message, information indicating that the message has the lowest importance level) without using other information related to the notification (e.g., the content of the received message). Context data (1723) may include the weather (e.g., sunny) and season (e.g., summer) at the time the event occurred, and the time (e.g., daytime) at the time the event occurred.

[0242] Referring to 1702 of FIG. 17, the electronic device (600) may display an image (1731) and a notification (1732) obtained based on theme data (1721), notification data (1722), and context data (1723). The character included in the image (1731) may include the same character as the character included in the background image (1711). The character in the image (1731) may be wearing a police uniform and a police hat.

[0243] Thus, according to the present disclosure, if a received message is a spam message, an image that can alert the user to the spam message may be displayed along with a notification.

[0244] Referring to 1801a of FIG. 18a and 1801b of FIG. 18b, the electronic device (600) can display a lock screen including a background image (1811).

[0245] For example, an electronic ink display attached to the back of an electronic device (600) may display an airplane ticket. An application stored in the electronic device (600) may provide a notification to inform of the flight time when the flight time approaches. When the occurrence of an event for providing a notification is detected, the electronic device (600) may acquire an image using theme data (1821), notification data (1822), and context data (1823a, 1823b). The image is a notification image displayed along with the notification and may be generated by an artificial intelligence model. For example, theme data (1821) may include the type of object included in the background image (1811) (e.g., puppy). Notification data (1822) may include the content of the notification (e.g., travel itinerary including flight date and time) and the importance of the notification (e.g., high). Context data (1823a, 1823b) may include the weather at the time the event occurred (e.g., clear), the location of the electronic device (600) (e.g., home), and the user's preferences (e.g., animals). Additionally, context data (1823a, 1823b) may include information related to electronic ink data. The electronic ink data may be data displayed on the electronic ink display (e.g., a flight ticket). For example, context data (1823a) may further include the destination of the flight ticket displayed on the electronic ink display (e.g., Paris) and the weather at the destination (e.g., clear). Context data (1823b) may further include the destination of the flight ticket displayed on the electronic ink display (e.g., Paris) and the weather at the destination (e.g., rain).

[0246] Referring to 1801a of FIG. 18A, the electronic device (600) may display an image (1831a) and a notification (1832) obtained based on theme data (1821), notification data (1822), and context data (1823a). The image (1831a) may include an object of the same type as the object included in the background image (1811), for example, a puppy. The puppy in the image (1831a) may be sitting. The background of the image (1831a) may be Paris on a clear day.

[0247] Referring to 1801b of FIG. 18b, the electronic device (600) may display an image (1831b) and a notification (1832) obtained based on theme data (1821), notification data (1822), and context data (1823b). The image (1831b) may include an object of the same type as the object included in the background image (1811), for example, a puppy. The puppy in the image (1831a) may be running. The background of the image (1831b) may be Paris on a rainy day.

[0248] In this way, according to the present disclosure, an image related to information displayed on an electronic ink display attached to an electronic device (600) may be displayed together with a notification.

[0249] In the above-described example, it was described that when the occurrence of an event for providing a notification is detected by the electronic device (600), an image is acquired using theme data, notification data, and context data, but the present disclosure is not limited thereto.

[0250] For example, when the occurrence of an event is detected, the electronic device (600) can generate a prompt, input the prompt into an artificial intelligence model, and obtain an image from the artificial intelligence model. The event may include an event in which the screen of the electronic device (600) turns on. This will be described in more detail below with reference to FIGS. 19 and 20 .

[0251] According to one embodiment, the electronic device (600) can obtain a prompt using theme data and context data, input the prompt into an artificial intelligence model, and obtain an image from the artificial intelligence model.

[0252] Referring to 1901a of FIG. 19A, 1901b of FIG. 19B, and 1901c of FIG. 19C, the lock screen of the electronic device (600) may include a background image (1911). When the occurrence of an event is detected, the electronic device (600) may acquire an image using theme data (1921) and context data (1922a, 1922b, 1922c). The event may be an event for displaying a lock screen on the second display (216). For example, within the second state, the electronic device (600) may display a lock screen on the second display (216) when a user presses a key button (e.g., 218 of FIG. 2A) or touches the second display (e.g., 216 of FIG. 2A). The image may be generated by an artificial intelligence model. Theme data (1921) may include the type of object included in the background image (1911) (e.g., cat, dog). Context data (1922a) may include the weather (e.g., sunny), the user's preference (e.g., animal), and the location of the electronic device (600) (e.g., park) at the time the event occurred. Context data (1922b) may include the weather (e.g., sunny), the season (e.g., summer), the user's preference (e.g., animal), and the location of the electronic device (600) (e.g., swimming pool) at the time the event occurred. Context data (1922c) may include the weather (e.g., sunny), the season (e.g., winter), the user's preference (e.g., animal), and the location of the electronic device (600) (e.g., mountain) at the time the event occurred.

[0253] Referring to 1902a of FIG. 19A, the electronic device (600) may acquire an image (1931a) based on theme data (1921) and context data (1922b), and display a lock screen including the image (1931a). The image (1931a) may include an object of the same type (e.g., a puppy or a cat) as an object included in the background image (1911). The puppy and cat in the image (1931a) may be sitting facing each other. The background of the image (1931a) may be a park on a sunny day.

[0254] Referring to 1902b of FIG. 19b, the electronic device (600) may acquire an image (1931b) based on theme data (1921) and context data (1922b), and display a lock screen including the image (1931b). The image (1931b) may include one type of object (e.g., a puppy) among the objects included in the background image (1911). The puppy in the image (1931b) may be swimming. The background of the image (1931b) may be a swimming pool on a sunny summer day.

[0255] Referring to 1902c of FIG. 19c, the electronic device (600) may acquire an image (1931c) based on theme data (1921) and context data (1922c), and display a lock screen including the image (1931c). The image (1931c) may include objects of the same type (e.g., a puppy or a cat) as those included in the background image (1911). The puppy and cat in the image (1931c) may be shown running and playing. The background of the image (1931c) may be a snow-covered mountain.

[0256] According to one embodiment, the electronic device (600) can obtain a prompt using theme data, input the prompt into an artificial intelligence model, and obtain an image from the artificial intelligence model.

[0257] Referring to 2001 of FIG. 20, the lock screen of the electronic device (600) may include a background image (2011). When the occurrence of an event is detected, the electronic device (600) may acquire an image using theme data (2011). The event may be an event for displaying a lock screen on the second display (216). For example, within the second state, the electronic device (600) may display a lock screen on the second display (216) when a user presses a key button (e.g., 218 of FIG. 2A) or touches the second display (e.g., 216 of FIG. 2A). The image may be generated by an artificial intelligence model. The theme data (2021) may include the type of object included in the background image (1911) (e.g., cat, dog).

[0258] Referring to 2002 of FIG. 20, the electronic device (600) may acquire an image (2031) based on theme data (2021) and display a lock screen including the image (2031). The image (2031) may include an object of the same type (e.g., a puppy or a cat) as an object included in the background image (2011). The puppy and cat in the image (2031) may be sitting.

[0259] Referring to 2003 of FIG. 20, when the occurrence of an event is detected again, the electronic device (600) may acquire an image (2032) based on theme data (2021) and display a lock screen including the image (2032). The image (2032) may include an object of the same type (e.g., a puppy or a cat) as an object included in the background image (2011). The puppy and cat in the image (2032) may be sitting.

[0260] Meanwhile, although FIGS. 19 and 20 illustrate that the electronic device (600) is a first type of electronic device (101), the present disclosure is not limited thereto. For example, the above-described embodiment may also be applied to a second type of electronic device (101) or a third type of electronic device (101). In addition, although FIGS. 19 and 20 illustrate a case in which a lock screen is displayed in response to a screen-on event, the present disclosure is not limited thereto. For example, the electronic device (600) may acquire an image and display a home screen including the image based on a home screen being displayed in response to a screen-on event.

[0261] In the above-described example, it has been described that the electronic device (600) uses the notification content obtained using theme data, notification data, and context data as a background image, but the present disclosure is not limited thereto.

[0262] According to one embodiment, the electronic device (600) can obtain content using theme data and context data.

[0263] For example, context data may include information about text entered into an application. The application may include an application that allows text input by a user, such as a messaging application. The electronic device (600) may extract keywords from the text by understanding the meaning and context of words included in the text.

[0264] For example, context data may include information about a user's facial expression. The electronic device (600) may acquire an image of the user's face using a camera provided on the front or rear of the electronic device (600). The electronic device (600) may acquire information about the facial expression included in the image using an artificial intelligence model. For example, the electronic device (600) may detect a facial area in the image, analyze the location, shape, etc. of landmarks in the facial area to recognize the user's facial expression, and acquire keywords corresponding to the user's facial expression (e.g., joy, laughter, sadness, anger, surprise, etc.).

[0265] The electronic device (600) can generate a prompt using keywords obtained from theme data and context data, input the prompt into an artificial intelligence model, and obtain content from the artificial intelligence model. The electronic device (600) can provide the content through an application so that a user can utilize the content.

[0266] For example, referring to 2101 of FIG. 21, the electronic device (600) may display an execution screen (2111) of a message application. The execution screen (2111) may display messages received from the other party and messages sent by the user to the other party.

[0267] When the occurrence of an event is detected, the electronic device (600) can acquire content using theme data (2121) and context data (2122). The event may include a user entering a message on the execution screen of a messaging application. For example, theme data (2121) may include the name of a character included in a background image. Context data (2122) may include a word (e.g., "Hello") (2112) entered by the user into the messaging application.

[0268] Referring to 2102 of FIG. 21, the electronic device (600) may acquire a plurality of contents (2122) based on theme data (2121) and context data (2122), and display the plurality of contents (2122) on the execution screen (2121) of the application. The contents (2122) may be sticker contents. The sticker contents may include images or animations that a user may use during a conversation with a counterpart. The characters included in the contents (2122) may be the same characters as the characters included in the background image. The characters in the contents (2122) may perform actions that correspond to the meaning of "hello." In addition, the contents (2122) may include a speech bubble containing the corresponding word. Referring to 2103 of FIG. 21, when a touch input for one of the plurality of contents (2122) is received, the electronic device (600) may transmit the selected content to the counterpart.

[0269] For example, referring to 2201 of FIG. 22, the electronic device (600) may display an execution screen (2211) of a video call application. The execution screen (2211) may display a video (2212) taken by the user and a video (2213) taken by the other party.

[0270] When the occurrence of an event is detected, the electronic device (600) may acquire content based on theme data (2221) and context data (2222). The event may include a touch input input to a UI element (2214) displayed on the execution screen (2211). The UI element (2214) may include a character identical to a character included in a background image. For example, the theme data (2221) may include the name of a character included in the background image. The context data (2222) may include information about the user's facial expression acquired from a captured image of the user.

[0271] Referring to 2202 of FIG. 22, the electronic device (600) may acquire content (2232) based on theme data (2221) and context data (2222), and display the content (2232) on the execution screen (2231). The content (2232) may be avatar content. The avatar content may include an avatar that can be used by the user in a video call in place of his or her own face. For example, the electronic device (600) may display the content (2232) in place of a video (2212) taken by the user. The character included in the content (2232) may include the same character as the character included in the background image. The expression of the character of the content (2232) may be the same as the facial expression of the user, and the facial expression of the user may be reflected in real time on the character of the content (2232).

[0272] FIG. 23 illustrates an example of an operation of an electronic device according to one embodiment of the present invention to generate a prompt for image generation using theme data, notification data, and context data. Instructions stored in a memory (620) of the electronic device (600), when individually or collectively executed by a processor (610) of the electronic device (600), may cause the electronic device (600) to perform the operations of FIG. 23.

[0273] For example, an application stored in an electronic device (600) may provide a notification informing the user of a "golf appointment" when the scheduled "golf appointment" set by the user is approaching. When the occurrence of an event for providing a notification is detected, the electronic device (600) may generate a prompt using theme data (2310), notification data (2320), and context data (2330).

[0274] For example, the electronic device (600) can obtain “XXX” (e.g., the name of a character included in the background image (2311)) from theme data (2310). The electronic device (600) can obtain the content of the notification (2321) (e.g., field frizzy, 2 o’clock, golf appointment) from notification data (2320). The electronic device (600) can obtain the time (2331) at which the event occurred (e.g., 2 o’clock), the weather (2332) at which the event occurred (e.g., rain), and the user’s schedule (2333) at which the event occurred (e.g., schedule, field frizzy, 2 o’clock, golf appointment) from context data (2330). The electronic device (600) can use the acquired data to generate a prompt (2340) such as “Generate an image for [name of character included in background image], [schedule, field bridge, 2 o'clock, golf appointment], [rain], [field bridge], [2 o'clock]”, and input the prompt (2340) into the artificial intelligence model (2301) to obtain an image generated by the artificial intelligence model (2301).

[0275] Thus, according to various embodiments of the present disclosure, when providing a notification, an electronic device can acquire an image related to the notification and provide the image to the user along with the notification. This can enhance the user experience.

[0276] According to one embodiment, the electronic device (600) can enable the artificial intelligence model to be trained based on user input for an image generated by the artificial intelligence model.

[0277] For example, the electronic device (600) can train an artificial intelligence model based on a user's preference for an image generated by the artificial intelligence model. The preference can be determined based on data on whether the user uses the image generated by the artificial intelligence model and the number of times the image is used. For example, when a user input is received to indicate a preference for an image generated by the artificial intelligence model, or a user input is received to display the image generated by the artificial intelligence model on the electronic device (600) or transmit it to another device, the electronic device (600) can identify the image as being used by the user and count the number of times the image is used to obtain frequency data including information on the number of times the image is used. The electronic device (600) can train the artificial intelligence model using the image usage and frequency data. Accordingly, according to the present disclosure, images that better suit the user's preferences can be provided to the user.

[0278] While the aforementioned example described generating an image using an artificial intelligence model, the present disclosure is not limited thereto. For example, theme data may include information about an audio theme of the electronic device (600). Information about the audio theme may include information about the sound settings of the electronic device (600), such as a sound equalizer and sound field effects. In some embodiments, information about the audio theme may include information about a ringtone set on the electronic device (600).

[0279] When the occurrence of an event for providing a notification is detected, the electronic device (600) may acquire audio generated by an artificial intelligence model based on information about the audio theme, and output the audio when displaying the notification on the display (630). In some embodiments, the electronic device (600) may also set the audio generated by the artificial intelligence model as the electronic device's (600) ringtone.

[0280] As described above, an electronic device (e.g., 600 of FIG. 6) according to one embodiment may include a display (e.g., 630 of FIG. 6), a memory (e.g., 620 of FIG. 6) for storing instructions, and at least one processor (e.g., 610 of FIG. 6) including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to request generation of a notification image based on theme data of the electronic device, notification data related to the notification, and context data corresponding to a time point of occurrence of the event, based on detection of occurrence of an event for providing a notification, obtain a notification image generated in response to the request, and display the notification and the obtained notification image on the display.

[0281] For example, the request for generating the notification image may include generating a prompt requesting the generation of an image related to the notification based on the theme data, notification data related to the notification, and context data corresponding to the time of occurrence of the event, and inputting the prompt into the artificial intelligence model.

[0282] For example, the artificial intelligence model may be a model included in and operated by the electronic device, or a model operated by a computer device operatively connected to the electronic device.

[0283] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a notification image acquired based on a first event on the display, at least based on detecting occurrence of a second event identical to the first event, on the display.

[0284] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to request generation of a notification image to obtain a notification image different from the obtained notification image, at least based on detecting occurrence of a second event identical to the first event within a predetermined time after displaying the notification image obtained based on the first event on the display, obtain a notification image generated in response to the request, and display a notification related to the second event and the obtained notification image on the display.

[0285] For example, the theme data may include at least one of information about a background image of the electronic device, style information of text set on the electronic device, and style information of an icon set on the electronic device. Information about the background image may include information about an object included in the background image or the content of the background image. Style information about the text may include at least one of a font, size, and color of the text. Style information about the icon may include at least one of a shape, size, and color of the icon.

[0286] For example, the notification data may include information about at least one of the name of the application providing the notification, the content of the notification, the color of the icon corresponding to the application, and the importance of the notification.

[0287] For example, the context data may include at least one piece of information from among a plurality of pieces of information. The plurality of pieces of information may include at least one of the time and / or date when the event occurred, the weather when the event occurred, the season when the event occurred, the location of the electronic device when the event occurred, a device connected to the electronic device when the event occurred, the user's schedule when the event occurred, the user's activity status when the event occurred, the user's profile information when the event occurred, the user's taste information when the event occurred, and the user's emotional information when the event occurred.

[0288] For example, the at least one piece of information included in the context data may be selected based on user input.

[0289] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify context data including a first set of information from among the plurality of pieces of information based on the event being a first event, and to identify context data including a second set of information from among the plurality of pieces of information based on the event being a second event occurring after the first event. An attribute of at least one piece of information included in the first set of information may be different from an attribute of information included in the second set of information.

[0290] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify the first information set and the second information set based on history data about information used to generate the notification image.

[0291] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify a preset number of pieces of information in order of priority from among the plurality of pieces of information based on priorities for the plurality of pieces of information, and to obtain the context data including the identified pieces of information.

[0292] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to update a preference for at least one piece of information used to generate the notification image based on a user input for the notification image, and to identify a priority for the plurality of pieces of information based on the preference. The user input may include at least one of a user input for indicating a preference for the notification image, a user input for displaying the notification image on the display, and a user input for transmitting the notification image to another device.

[0293] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to set the notification image as a background image and display the notification on a screen including the background image.

[0294] As described above, a method for providing a notification of an electronic device according to one embodiment may include an operation of requesting generation of a notification image based on theme data of the electronic device, notification data related to the notification, and context data corresponding to the time of occurrence of the event, based on detection of occurrence of an event for providing a notification, an operation of obtaining a notification image generated in response to the request, and an operation of displaying the notification and the obtained notification image.

[0295] For example, the request for generating the notification image may include generating a prompt requesting the generation of an image related to the notification based on the theme data, notification data related to the notification, and context data corresponding to the time of occurrence of the event, and inputting the prompt into the artificial intelligence model.

[0296] For example, the artificial intelligence model may be a model included in and operated by the electronic device, or a model operated by a computer device operatively connected to the electronic device.

[0297] For example, a method for providing a notification according to one embodiment may further include an operation of displaying a notification image acquired based on a first event on the display, at least based on detecting the occurrence of a second event identical to the first event, and displaying the acquired notification image and a notification related to the second event.

[0298] For example, a method for providing a notification according to one embodiment may further include an operation of requesting generation of a notification image for obtaining a notification image different from the obtained notification image, at least based on detection of occurrence of a second event identical to the first event within a set time after displaying a notification image obtained based on a first event on the display, an operation of obtaining a notification image generated in response to the request, and an operation of displaying a notification related to the second event and the obtained notification image.

[0299] For example, the theme data may include at least one of information about a background image of the electronic device, style information of text set on the electronic device, and style information of an icon set on the electronic device. Information about the background image may include information about an object included in the background image or the content of the background image. Style information about the text may include at least one of a font, size, and color of the text. Style information about the icon may include at least one of a shape, size, and color of the icon.

[0300] For example, the notification data may include information about at least one of the name of the application providing the notification, the content of the notification, the color of the icon corresponding to the application, and the importance of the notification.

[0301] For example, the context data may include at least one piece of information from among a plurality of pieces of information. The plurality of pieces of information may include at least one of the time and / or date when the event occurred, the weather when the event occurred, the season when the event occurred, the location of the electronic device when the event occurred, a device connected to the electronic device when the event occurred, the user's schedule when the event occurred, the user's activity status when the event occurred, the user's profile information when the event occurred, the user's taste information when the event occurred, and the user's emotional information when the event occurred.

[0302] For example, the at least one piece of information included in the context data may be selected based on user input.

[0303] For example, a method for providing a notification according to one embodiment may further include an operation of identifying context data including a first information set among the plurality of pieces of information based on the event being a first event, and an operation of identifying context data including a second information set among the plurality of pieces of information based on the event being a second event occurring after the first event. An attribute of at least one piece of information included in the first information set may be different from an attribute of information included in the second information set.

[0304] For example, a method for providing a notification according to one embodiment may further include an operation of identifying the first information set and the second information set based on history data about information used to generate the notification image.

[0305] For example, a method for providing notification according to one embodiment may further include an operation of identifying a preset number of pieces of information in order of priority among the plurality of pieces of information based on priorities of the plurality of pieces of information, and an operation of obtaining the context data including the identified information.

[0306] For example, a method for providing a notification according to one embodiment may further include an operation of updating a preference for at least one piece of information used to generate the notification image based on a user input for the notification image, and an operation of identifying a priority for the plurality of pieces of information based on the preference. The user input may include at least one of a user input for indicating a preference for the notification image, a user input for displaying the notification image on the display, and a user input for transmitting the notification image to another device.

[0307] For example, a method for providing a notification according to one embodiment may further include an operation of setting the notification image as a background image and displaying the notification on a screen including the background image.

[0308] Various embodiments of the present document may be implemented as software including one or more instructions stored in a storage medium (e.g., memory (620)) readable by a machine (e.g., electronic device (600)). For example, a processor (e.g., processor (610)) of the machine (e.g., electronic device (600)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0309] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). ™) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0310] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0311] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In an electronic device (600), display (630); Memory (620) for storing instructions; and At least one processor (610) comprising processing circuitry; The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the detection of the occurrence of an event for providing a notification, a notification image is requested to be generated based on theme data of the electronic device, notification data related to the notification, and context data corresponding to the time of occurrence of the event. Obtain the notification image generated in response to the above request, An electronic device that displays the above notification and the acquired notification image on the display.

2. In paragraph 1, The request for the creation of the above notification image is: An electronic device comprising: generating a prompt requesting the generation of an image related to the notification based on the theme data, notification data related to the notification, and context data corresponding to the time of occurrence of the event, and inputting the prompt into an artificial intelligence model.

3. In paragraph 2, An electronic device wherein the artificial intelligence model is a model included in the electronic device and operated, or a model operated in a computer device operatively connected to the electronic device.

4. In any one of paragraphs 1 to 3, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that displays a notification image acquired based on a first event on the display, at least based on detecting the occurrence of a second event substantially the same as the first event, on the display.

5. In any one of paragraphs 1 to 3, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Requesting the generation of a notification image to obtain a notification image different from the obtained notification image, at least based on the detection of the occurrence of a second event substantially the same as the first event within a set time after displaying the notification image obtained based on the first event on the display, Obtain the notification image generated in response to the above request, An electronic device that displays a notification related to the second event and the acquired notification image on the display.

6. In any one of paragraphs 1 to 5, The above theme data is, It includes at least one of information about the background image of the electronic device, style information of text set on the electronic device, and style information of an icon set on the electronic device. Information about the background image includes information about an object included in the background image or the contents of the background image, The style information of the above text includes at least one of the font, size, and color of the above text, An electronic device, wherein the style information of the icon includes at least one of the shape, size, and color of the icon.

7. In any one of paragraphs 1 to 6, The above notification data is, An electronic device including information about at least one of the name of the application providing the notification, the content of the notification, the color of the icon corresponding to the application, and the importance of the notification.

8. In any one of paragraphs 1 to 7, The above context data includes at least one piece of information among a plurality of pieces of information, The above multiple pieces of information are: An electronic device comprising at least one of the time and / or date when the event occurred, the weather when the event occurred, the season when the event occurred, the location of the electronic device when the event occurred, a device connected to the electronic device when the event occurred, the user's schedule when the event occurred, the user's activity status when the event occurred, the user's profile information when the event occurred, the user's taste information when the event occurred, and the user's emotional information when the event occurred.

9. In paragraph 8, An electronic device, wherein at least one piece of information included in the context data is selected based on a user input.

10. In paragraph 8, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the above event being a first event, identifying the context data including a first information set among the plurality of pieces of information, Identify the context data including the second information set among the plurality of pieces of information based on the fact that the event is a second event that occurred after the first event, An electronic device, wherein at least one attribute of information included in the first information set is different from an attribute of information included in the second information set.

11. In paragraph 10, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that identifies the first information set and the second information set based on history data about information used to generate the above notification image.

12. In paragraph 8, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the priority of the plurality of pieces of information, a preset number of pieces of information are identified in order of priority among the plurality of pieces of information, An electronic device that obtains the context data including the identified information.

13. In paragraph 12, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Update a preference for at least one piece of information used to generate the notification image based on user input for the notification image; Identifying priorities for the plurality of pieces of information based on the above preferences, The above user input is, An electronic device comprising at least one of a user input for indicating a preference for the notification image, a user input for displaying the notification image on the display, and a user input for transmitting the notification image to another device.

14. In any one of paragraphs 1 to 13, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that sets the above notification image as a background image and displays the notification on a screen including the background image.

15. In the method of providing notifications on an electronic device, An action of requesting generation of a notification image based on theme data of the electronic device, notification data related to the notification, and context data corresponding to the time of occurrence of the event, based on detection of occurrence of an event for providing a notification; An action to obtain a notification image generated in response to the above request; and A method for providing a notification, comprising: an operation of displaying the above notification and the acquired notification image.

Citation Information

Patent Citations

  • Mobile communication terminal and method for displayingstandby screen on the basis behavior analysis resultof user

    KR1020080000103A

  • Mobile terminal and operation method thereof

    KR1020140060761A

  • Mobile terminal and emotional message displaying method thereof

    KR1020150088596A

  • Cosmetic composition containing the extract of dendropanax morbifera and wild ginseng as active ingredient

    KR1020220020056A

  • Augmenting text messages with emotion information

    US20170147202A1