Electronic device, method, and non-transitory computer-readable recording medium for generating visual object for notification

Abstract

Disclosed is an electronic device. The electronic device may receive a message transmitted by an external electronic device via a communication circuit. The electronic device may acquire summary information by using a machine-learning model on the basis of at least a portion of the message. The electronic device may display the summary information on a first portion of a display. The electronic device may generate a visual object indicating the content of the summary information by using the machine-learning model. The electronic device may display the visual object on a second portion of the display.

Description

Electronic device, method, and non-transitory computer-readable recording medium for generating a visual object for notification

[0001] The following descriptions relate to electronic devices, methods, and non-transitory computer-readable recording media for generating visual objects for notifications.

[0002] Artificial intelligence is a technology for simulating the neural activity of humans (or living things), such as perception and / or inference, and can be implemented by hardware, software, or a combination of these designed to perform computations for simulating neural activity.

[0003] An electronic device is disclosed. The electronic device may include a display, at least one processor including a communication circuit, a processing circuit, and a memory storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive a message transmitted by an external electronic device via the communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain summary information using a machine learning model based on at least a portion of the message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the summary information on a first portion via the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate a visual object representing the content of the summary information using the machine learning model. The above instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in the second portion through the display.

[0004] A method is disclosed. The method can be performed by an electronic device including a display and communication circuitry. The method can include receiving a message transmitted by an external electronic device via the communication circuitry. The method can include obtaining summary information based on at least a portion of the message using a machine learning model. The method can include displaying the summary information in a first portion via the display. The method can include generating a visual object representing the content of the summary information using the machine learning model. The method can include displaying the visual object in a second portion via the display.

[0005] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may store a program including instructions. The instructions, when individually or collectively executed by at least one processor of an electronic device including a display and communication circuitry, may cause the electronic device to receive a message transmitted by an external electronic device via the communication circuitry. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain summary information using a machine learning model based on at least a portion of the message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the summary information on a first portion via the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate a visual object representing the content of the summary information using the machine learning model. The above instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in the second portion through the display.

[0006] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0007] Figure 2 is a block diagram of an electronic device according to one embodiment.

[0008] FIG. 3 illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0009] FIG. 4A illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0010] FIG. 4b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0011] FIG. 5A illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0012] FIG. 5b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0013] FIG. 6A illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0014] FIG. 6b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0015] FIG. 7 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0016] FIG. 8A illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0017] FIG. 8b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0018] FIG. 9 illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0019] FIG. 10 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0020] FIG. 11A illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0021] FIG. 11b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0022] FIG. 11c illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0023] FIG. 11d illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0024] FIG. 12 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0025] FIG. 13 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0026] FIG. 14 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0027] FIG. 15 illustrates an example of an operation in which an electronic device displays an image transmitted by an external electronic device, according to one embodiment.

[0028] FIG. 16 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0029] Figure 17 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0030] FIG. 18a illustrates an example of an unfolded state of an electronic device according to one embodiment.

[0031] FIG. 18b illustrates an example of a folding state of an electronic device according to one embodiment.

[0032] FIG. 19A is a top plan view of an exemplary electronic device within a first state.

[0033] FIG. 19b is a bottom view of an exemplary electronic device within a first state.

[0034] Figure 19c is a plan view of an exemplary electronic device within the second state.

[0035] FIG. 19d is a bottom view of an exemplary electronic device within the second state.

[0036] FIG. 20A illustrates an example of an unfolded state of an electronic device according to one embodiment.

[0037] FIG. 20b illustrates an example of a fully folded state of an electronic device, according to one embodiment.

[0038] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0039] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0040] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0041] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0042] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0043] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0044] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0045] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0046] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0047] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0048] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0049] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0050] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0051] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0052] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0053] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0054] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0055] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0056] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 664 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 6 ms or less for round trip) for URLLC realization.

[0057] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0058] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0059] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0060] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0061] Figure 2 is a block diagram of an electronic device according to one embodiment.

[0062] The electronic device (101) of FIG. 2 may correspond to the electronic device (101) of FIG. 1. The electronic device (101) of FIG. 2 may be described with reference to the electronic device (101) of FIG. 1.

[0063] Referring to FIG. 2, the electronic device (101) may include a processor (120), a memory (130), a display (260), and a communication circuit (290). The processor (120) of FIG. 2 may correspond to the processor (120) of FIG. 1. The memory (130) of FIG. 2 may correspond to the memory (130) of FIG. 1. The display (260) of FIG. 2 may correspond to the display module (160) of FIG. 1. The communication circuit (290) of FIG. 2 may correspond to the communication module (190) of FIG. 1.

[0064] In one embodiment, the program (140) of the memory (130) may include an application (146), a notification manager (210), a generative artificial intelligence (GEN AI) model (220), an AI model (230), and a prompt generation model (240).

[0065] In one embodiment, the application (146) may correspond to the application (146) of FIG. 1.

[0066] In one embodiment, the application (146) can identify a message. For example, the application (146) can identify that a message is generated (or received) (or acquired). For example, the application (146) can acquire a message from an external electronic device (201) via the communication circuit (290). For example, the message can be related to the receipt of an incoming call (e.g., a voice call and / or a video call), the receipt of a conversation (or chat) (or an email) in a messaging service, the occurrence of an error (e.g., an error in background operation, an error in authentication status), the occurrence of an event (e.g., a calendar event), location sharing, the occurrence of a missed call, navigation, progress status (e.g., progress status in background operation), the receipt of a promotion (or advertisement), the occurrence of recommended information, or an event in a social network (e.g., sharing an update).

[0067] For example, the application (146) may determine whether to notify the user of the receipt (or acquisition) of a message. For example, based on a specified condition, if it is determined that notification of the receipt (or acquisition) of a message is not required, the notification manager (210) may not be requested to output a notification. For example, based on a determination that notification of the receipt (or acquisition) of a message is required, the notification manager (210) may be requested to output a notification. For example, whether to notify the user of the receipt (or acquisition) of a message may be determined based on the type of message and the user's settings. For example, in the case of a message obtained from a specified user, the application (146) may determine to notify the user of the receipt (or acquisition) of the message. For example, in the case of an advertisement message, the application (146) may determine not to notify the user of the receipt (or acquisition) of the message. In one embodiment, the application (146) may, based on obtaining a message, display a notification (e.g., a visual object (e.g., a visual object generated via the GEN AI model (220))) in a designated area in response to determining that the content of the message satisfies a designated condition. In one embodiment, the electronic device (101) may, based on determining that the content of the message does not satisfies a designated condition, forgo displaying the notification (e.g., a visual object (e.g., a visual object generated via the GEN AI model (220))).

[0068] For example, the application (146) may request the notification manager (210) to output a notification to notify the user of the receipt (or acquisition) of a message. For example, the application (146) may request the notification manager (210) to output a notification to notify the user of the receipt (or acquisition) of a message based on a determination that notification of the receipt (or acquisition) of a message is required.

[0069] In one embodiment, the notification manager (210) may output visual output, auditory output, and / or tactile output to notify the user of the receipt (or acquisition) of a message. For example, the notification manager (210) may display a visual object corresponding to the message on the display (260) based on identifying a request to output a notification. In one embodiment, the visual object may include, but is not limited to, an image (e.g., a logo, a symbol), an icon, and / or a widget related to the content of the message and / or the application that requested the output of the message. For example, the visual object may be text and / or a video related to the content of the message and / or the application that requested the output of the message.

[0070] For example, the notification manager (210) may determine a visual object to be displayed on the display (260) based on a notification policy corresponding to the message. For example, the notification manager (210) may determine a visual object to be displayed on the display (260) as an existing visual object (or a visual object created in advance) based on the notification policy. For example, the notification manager (210) may determine a visual object to be displayed on the display (260) as a new visual object (or a visual object to be created based on the message) based on the notification policy.

[0071] For example, the notification manager (210) may display an existing visual object to notify the user of receipt (or acquisition) of a message based on a determination to display an existing visual object. In one embodiment, the existing visual object (or a previously created visual object) may be a visual object that was stored in the electronic device (101) (or memory (130)) prior to acquisition (or creation) (or occurrence) of the message.

[0072] For example, the notification manager (210) may generate a new visual object to notify the user of the receipt (or acquisition) of a message based on a determination to display a new visual object. For example, the notification manager (210) may generate the new visual object using the GEN AI model (220), the AI ​​model (230), and / or the prompt generation model (240). In one embodiment, the new visual object (or the visual object to be generated based on the message) may be a visual object that was not stored in the electronic device (101) (or the memory (130)) prior to the acquisition (or generation) (or generation) of the message. In one embodiment, the new visual object (or the visual object to be generated based on the message) may be a visual object that is acquired (or generated) after the acquisition (or generation) (or generation) of the message.

[0073] For example, the notification manager (210) may display an existing visual object or a new visual object on the display (260) based on identifying a request for output of a message. For example, the notification manager (210) may display the visual object in a designated area of ​​the screen of the display (260). For example, the designated area may be an area on the screen of the display (260) allocated to indicate that a message has been acquired (or generated). For example, the designated area may be located at the top and / or bottom of the screen of the display (260). For example, the designated area may be an area where at least one other visual object is displayed to indicate the status of the electronic device (101) (e.g., charging status, communication status, current time, and / or location). However, the present invention is not limited thereto. For example, the designated area may be an area that at least partially overlaps an area where an icon and / or widget of an application that requested output of a message is displayed. Hereinafter, the designated area may be described with reference to FIG. 3. Hereinafter, with reference to FIGS. 4a to 10, a method of displaying a visual object in a designated area can be described.

[0074] For example, the notification manager (210) may display at least a portion of the content included in the message, or a summary corresponding to the content included in the message, at least simultaneously with displaying a visual object on the display (260). For example, the notification manager (210) may display at least a portion of the content included in the message, or a summary corresponding to the content included in the message, at least during a portion of the time period during which the visual object is displayed on the display (260). For example, the notification manager (210) may generate the summary based on a determination to display a summary corresponding to the content included in the message. For example, the notification manager (210) may generate the summary using the AI ​​model (230). Hereinafter, a method of displaying a summary at least simultaneously with displaying a visual object may be described with reference to FIGS. 4A, 5A, 6A, 8B, and 9.

[0075] In one embodiment, the GEN AI model (220) may include an AI model including a plurality of parameters related to a neural network having a structure based on an encoder and a decoder, such as a transformer. In one embodiment, the GEN AI model (220) may include a bi-directional model based on learning for an encoder (e.g., bidirectional encoder representations from transformers (BERT)) or an auto-encoding model (e.g., a diffusion model). In one embodiment, the GEN AI model (220) may include an auto-regressor model based on learning for a decoder (e.g., a generative pre-trained transformer (GPT)). In one embodiment, the GEN AI model (220) may include a sequence-to-sequence model (e.g., stable diffusion, DALL-E 2) based on learning for an encoder and a decoder. In one embodiment, the GEN AI model (220) may include a large language model (LLM) for processing natural language based on a massive number of parameters, but is not limited thereto. The GEN AI model (220) may include parameters for driving a neural network such as a convolutional neural network (CNN), a recurrent neural network (RNN), a feedforward neural network (FNN), and / or a long short-term memory (LSTM).

[0076] In one embodiment, the GEN AI model (220) can generate a visual object based on a prompt. In one embodiment, the prompt can include data for guiding the generation of an image based on a message. In one embodiment, the prompt can be a work instruction for the GEN AI model (220). For example, the prompt can include at least one sentence (or at least one word) for specifying a visual object to be generated by the GEN AI model (220). For example, the prompt can include at least a portion of the content included in the message. For example, the prompt can include a summary corresponding to the content included in the message. For example, the prompt can include words obtained (or generated) from the summary corresponding to the content included in the message.

[0077] For example, at least one sentence (or at least one word) included in the prompt may describe the characteristics (e.g., size, color, shape, whether it is a video) of a visual object to be generated through the GEN AI model (220). For example, characteristics of a visual object to be generated through the GEN AI model (220) that are not included in the prompt may be set as default characteristics.

[0078] For example, at least one sentence (or at least one word) included in the prompt may describe data (e.g., a message, the content of the message, a summary of the content of the message, information about an application that requested the output of the message) that the GEN AI model (220) will reference when generating a visual object. For example, at least one sentence (or at least one word) included in the prompt may indicate data that the GEN AI model (220) will reference when generating a visual object.

[0079] For example, at least one sentence (or at least one word) included in a prompt may be extracted by the AI ​​model (230) and / or the prompt generation model (240) from the message, the content of the message, and / or a summary of the content of the message.

[0080] In one embodiment, the AI ​​model (230) may be an AI model (e.g., a stable diffusion model) that performs the task of extracting words (or sentences) to describe a message from the content of the message (e.g., text, image, or video) (e.g., captioning). In one embodiment, the AI ​​model (230) may generate at least one sentence (or at least one word) that summarizes the content of the message from the content of the message.

[0081] In one embodiment, the prompt generation model (240) can obtain (or generate) a prompt. In one embodiment, the prompt generation model (240) can obtain (or generate) a prompt related to the content of a message. In one embodiment, the prompt generation model (240) can be an AI model (e.g., a stable diffusion model) for generating a prompt (or work instruction) input to the GEN AI model (220) based on an input.

[0082] Hereinafter, a method for an electronic device (101) to display a visual object through an application (146), a notification manager (210), a GEN AI model (220), an AI model (230), and a prompt generation model (240) will be described. The operations of the electronic device (101) described below may be performed by the processor (120). For example, the operations of the electronic device (101) described below may be performed by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0083] In one embodiment, the electronic device (101) can obtain a message. In one embodiment, the electronic device (101) can obtain a message transmitted by an external electronic device (107) through a communication circuit (290). In one embodiment, the electronic device (101) can obtain a message transmitted by an external electronic device (107) through an application (146) running in the background or foreground.

[0084] In one embodiment, the electronic device (101) may determine whether to notify (or output) a message. For example, the electronic device (101) may determine whether to notify (or output) a message through the notification manager (210) based on identifying a request to output a message from an application (146).

[0085] In one embodiment, the electronic device (101) may determine whether to output a new visual object based on a message based on a policy of the notification manager (210). For example, the electronic device may determine to output a new visual object based on the message based on the determination that the application (146) requesting the output of the message is a designated application (e.g., a messaging application, a social network application, a phone application, a mail application, a calendar application, a media playback application) (or a designated type of application).

[0086] In one embodiment, the electronic device (101) may acquire a visual object corresponding to a message based on a determination to output a new visual object. For example, the electronic device (101) may acquire a visual object corresponding to a message through the GEN AI model (220).

[0087] In one embodiment, the electronic device (101) may display a visual object in a designated area of ​​the screen displayed through the display (260). In one embodiment, the designated area may be an area on the screen allocated to indicate that a message has been obtained. For example, the designated area may be located at the top and / or bottom of the screen of the display (260). For example, the designated area may be an area where at least one other visual object is displayed to indicate the status of the electronic device (101) (e.g., charging status, communication status, current time, and / or location). However, the present invention is not limited thereto. For example, the designated area may be an area where an icon and / or widget related to an application that has requested notification of a message is displayed.

[0088] In one embodiment, the electronic device (101) may replace at least one of at least one other visual object displayed in a designated area with a visual object. In one embodiment, the electronic device (101) may replace at least one other visual object displayed in the designated area with a visual object for a designated period of time. In one embodiment, the electronic device (101) may display the visual object and the content (or summary) of the message together in the designated area for a designated period of time. For example, the electronic device (101) may display the visual object and at least one other visual object together in the designated area after a designated period of time has elapsed after replacing the visual object with the visual object. Hereinafter, an operation of replacing at least one of at least one other visual object displayed in the designated area with a visual object may be described with reference to FIGS. 4A and 4B.

[0089] In one embodiment, the electronic device (101) may obtain a summary summarizing the content of the message from the AI ​​model (230) based on obtaining the message. For example, the electronic device (101) may display the summary instead of the content in a different area of ​​the screen of the display (260) that is distinct from the designated area. For example, the electronic device (101) may display the summary in the different area at least partially simultaneously with displaying a visual object in the designated area. However, the present invention is not limited thereto. For example, the electronic device (101) may display the summary together with the visual object in the designated area. For example, the electronic device (101) may display the summary in the designated area so as to be adjacent to the visual object. For example, the fact that the summary is adjacent to the visual object may include that the area where the summary is displayed overlaps at least partially with the area where the visual object is displayed. For example, the fact that the summary is adjacent to the visual object may include that the area where the summary is displayed is located right next to the area where the visual object is displayed.

[0090] In one embodiment, the electronic device (101) may display icons. For example, based on receiving a message, the electronic device (101) may display a visual object adjacent to the icon of an application related to the message. Below, the operation of displaying a visual object adjacent to an icon will be described with reference to FIGS. 4A and 4B.

[0091] In one embodiment, the electronic device (101) may, in response to a user input for an icon, display a visual representation of the content of a message on the screen without switching to the application screen. For example, the user input may be a long-press input for the icon. For example, the user input may be a double-tap input for the icon. Hereinafter, an operation for responding to a user input for an icon may be described with reference to FIGS. 5A and 5B.

[0092] In one embodiment, the electronic device (101) may, while displaying a visual object, display an application screen of an application related to a message through the display in response to a user input for an icon. For example, the user input may be a press input for the icon. For example, the user input may be a tap input for the icon. Hereinafter, an operation for responding to a user input for an icon may be described with reference to FIGS. 6A and 6B.

[0093] In one embodiment, the electronic device (101) may, while displaying a visual object, obtain another message transmitted by another external electronic device through the communication circuit. For example, the other message may be related to an application.

[0094] In one embodiment, the electronic device (101) may acquire visual objects representing the content of each of the plurality of messages from a generative AI model based on acquiring multiple messages. In one embodiment, the electronic device (101) may display the visual objects in a designated area. Below, the operation of displaying the plurality of visual objects may be described with reference to FIG. 7.

[0095] In one embodiment, the electronic device (101) may obtain a user input directed to the designated area while displaying a visual object in the designated area. In one embodiment, the electronic device (101) may display a user interface such that a user interface for displaying a list of a plurality of visual objects displayed in the designated area is positioned on the screen based on the user input directed to the designated area. For example, the user interface may include a summary that summarizes the visual objects included in the list and the contents of a message corresponding to the visual object. Hereinafter, an operation of displaying the user interface may be described with reference to FIGS. 8A and 8B.

[0096] In one embodiment, the electronic device (101) may display a visual object of a first size based on the determination that the screen indicates a locked state of the electronic device, based on obtaining a message. In one embodiment, the electronic device (101) may display a visual object of a second size different from the first size based on the determination that the screen indicates an unlocked state of the electronic device. Hereinafter, an operation of displaying a visual object in a locked state may be described with reference to FIG. 9.

[0097] In one embodiment, the electronic device (101) may enlarge a designated area based on acquiring a message. For example, the electronic device (101) may enlarge a designated area in a designated direction based on acquiring a message. For example, the designated direction may be a direction perpendicular to the length direction of the designated area (e.g., a width direction). In one embodiment, the electronic device (101) may display a visual object in the designated area enlarged in the designated direction. For example, the size of a visual object displayed in the designated area enlarged in the designated direction may be larger than the size of at least one other visual object displayed in the designated area before being enlarged in the designated direction. Hereinafter, an operation of enlarging a designated area may be described with reference to FIG. 10.

[0098] In one embodiment, the electronic device (101) may display an icon of an application related to a message on the screen of the display (260). In one embodiment, the electronic device (101) may replace the icon displayed on the screen with a visual object based on the message obtained. The operation of replacing the icon with a visual object may be described below with reference to FIG. 13.

[0099] FIG. 3 illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0100] FIG. 3 may be described with reference to the electronic device (101) of FIG. 2. The screen (301) of FIG. 3 may be generated by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0101] Referring to FIG. 3, the electronic device (101) may display a screen (301) on a display (e.g., the display (260) of FIG. 2). For example, the screen (301) may be a home screen. For example, the screen (301) may include a plurality of areas (310, 330, 350, 370). For example, the area (310) may be a notification area. For example, the area (330) may be an area where a list (331) of application icons and / or widgets are displayed. For example, the area (350) may be an area where a page indicator (or affordance) is displayed. For example, the page indicator may indicate a currently displayed page among a plurality of pages. For example, the area (370) may be an area where icons (371, 375) of specified applications are displayed. For example, the display of at least one object displayed in areas (310, 370) may be maintained even if the currently displayed page changes.

[0102] In FIG. 3, screen (301) is illustrated as a home screen, but this is merely an example. For example, screen (301) may be an application screen. For example, while the application screen is displayed, the application execution screen may be displayed in some areas (330, 350, 370). For example, screen (301) may be a lock screen. For example, while the lock screen is displayed, information indicating the lock status may be displayed in some areas (330, 350, 370). For example, screen (301) may be an apps screen. For example, while the apps screen is displayed, application icons and / or folders may be displayed in some areas (330, 350, 370). For example, the apps screen may be a screen that displays an icon for executing at least one application. For example, the apps screen may display a screen for executing an application corresponding to an icon selected by the user among the displayed icons.

[0103] For example, the area (310) may be a notification area. For example, the area (310) may be a notification area in which at least one visual object is displayed to notify the user of the occurrence of a specified event (e.g., receipt of a message) by the notification manager (210).

[0104] For example, the area (310) (or notification area) may display one or more visual objects (311, 315) indicating the status of the electronic device (101) (e.g., charging status, communication status, current time, and / or location). For example, the area (310) (or notification area) may display an icon (313) indicating an application running in the background of the electronic device (101) and / or a function of the application running.

[0105] FIG. 4A illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 4B illustrates an example of a screen displayed by an electronic device according to an embodiment.

[0106] FIGS. 4A and 4B may be described with reference to the electronic device (101) of FIG. 2. The screen (301) of FIGS. 4A and 4B may be displayed by the electronic device (101) after the screen (301) of FIG. 3. The screen (301) of FIGS. 4A and 4B may be generated by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0107] In one embodiment, the electronic device (101) can obtain a message. In one embodiment, the electronic device (101) can obtain a message while displaying the screen (301) of FIG. 3.

[0108] In one embodiment, the electronic device (101) may determine a visual object to be displayed on the display (260) based on a notification policy corresponding to the message. In one embodiment, the electronic device (101) may determine a visual object to be displayed on the display (260) based on a determination to output a notification of the message. In one embodiment, when a message is received and it is determined to display notification information regarding the message reception on the display (260), the electronic device (101) may determine at least one visual object related to the reception of the message to be displayed on the display (260) and display the determined visual object on the display (260).

[0109] For example, the electronic device (101) may determine, based on a notification policy, an icon of a messaging application as a visual object to be displayed on the display (260). For example, the electronic device (101) may determine, based on a notification policy, a new visual object (or a visual object to be generated based on a message) as a visual object to be displayed on the display (260). For example, the notification policy may be set according to the content of the message and / or the application that requested notification of the message. For example, based on the fact that the content of the message includes at least a portion of the content set to display a new visual object, the electronic device (101) may determine, based on the fact that the content of the message includes at least a portion of the content set to display a new visual object, the electronic device (101) may determine, based on the fact that the content of the message includes at least a portion of the content set to display a new visual object, the new visual object (or a visual object to be generated based on the message) as a visual object to be displayed on the display (260). For example, based on the notification of the application that requested the notification being set to display a new visual object, the electronic device (101) can determine the new visual object (or a visual object to be created based on the message) as the visual object to be displayed on the display (260).

[0110] In one embodiment, the electronic device (101) may obtain a visual object (411) corresponding to a message. For example, the electronic device (101) may obtain a visual object (411) corresponding to a message through the GEN AI model (220). For example, the electronic device (101) may obtain a visual object (411) corresponding to a message based on a decision to display a new visual object (or a visual object to be generated based on the message) on the display (260). For example, the electronic device (101) may obtain a visual object (411) corresponding to a message based on inputting a message, content included in the message, a summary corresponding to the content of the message, or a prompt corresponding to the content of the message into the GEN AI model (e.g., 220 of FIG. 2). In one embodiment, the summary corresponding to the content of the message may be obtained through the AI ​​model (230). A prompt corresponding to the content of the message can be obtained through a prompt generation model (e.g., 240 in Fig. 2).

[0111] In one embodiment, referring to FIG. 4A, the electronic device (101) may display a visual object (411) in a notification area (310) of a screen (301) displayed through a display (260). For example, the notification area (310) may be an area in which at least one other visual object (311, 313, 315) for indicating a status of the electronic device (101) (e.g., an application running in the background, a charging status, a communication status, a current time, and / or a location) is displayed. The GEN AI model (220) may analyze information about other states of the electronic device (101) other than the state of the electronic device (101) of the embodiment and generate information generated through the prompt generation model (240) as a visual object. The electronic device (101) may display a visual object generated through the GEN AI model (220). Other states of the electronic device (101) are not limited to the states of the electronic device (101) of the embodiment (e.g., applications running in the background, charging status, communication status, current time, and / or location). For example, information about other states of the electronic device (101) may be generated based on internal data of the electronic device (101) to determine the state of the electronic device (101) and inform the user of the state, such as an abnormal temperature rise of the electronic device (101) or a lost state of the electronic device (101).

[0112] For example, referring to FIG. 4A, the electronic device (101) may replace at least one of at least one other visual object (e.g., 311, 313, 315 of FIG. 3) displayed in the notification area (310) with the visual object (411). In one embodiment, the electronic device (101) may replace at least one other visual object (311, 313, 315) displayed in the notification area (310) (e.g., status bar) with the visual object (411) while a specified condition is met (e.g., for a specified time, while receiving a specified user input). In one embodiment, the electronic device (101) may display the visual object (411) and the content (or summary) (415) of the message together in the notification area (310) for a specified time. Depending on the embodiment, the visual object (411) may be a pre-stored image. According to an embodiment, the visual object (411) may be an image generated by a GEN AI model (220) within the electronic device.

[0113] For example, referring to FIG. 4b, the electronic device (101) may display the visual object (411) and at least one other visual object (311, 313, 315) together in the notification area (310) after replacing it with the visual object (411) and under a specified condition (e.g., after a specified time has elapsed or after obtaining a specified user input).

[0114] In one embodiment, the electronic device (101) may display a visual object (471) corresponding to a message in an area other than the notification area (310). For example, the electronic device (101) may display a visual object (471) corresponding to a message in an area where the icon (375) of the application that generated the message is located. For example, the electronic device (101) may display a visual object (471) corresponding to a message acquired through the GEN AI model (220) in an area where the icon (375) is located. In one embodiment, the electronic device (101) may display the visual object (471) at a location adjacent to the icon (375) of the application related to the message, based on acquiring the message. For example, referring to FIGS. 4A and 4B , the electronic device (101) may display the visual object (471) so as to overlap at least a portion of the icon (375). According to one embodiment, the visual object (471) may be positioned so that at least a portion of the icon (375) overlaps with the visual object (471). According to one embodiment, the visual object (471) may be positioned within at least a portion of the icon (375). According to one embodiment, the visual object (471) may be positioned behind the icon (375). The position where the visual object (471) is positioned is not limited to the embodiment, and the visual object (471) may be positioned close to at least a portion of the bottom, top, or left and right sides of the icon (375).

[0115] In one embodiment, referring to FIG. 4B, the electronic device (101) may display a visual object (475) indicating the number of times a message has been acquired (or the number of messages that the user has not checked). For example, based on the acquisition of a message, the electronic device (101) may display the visual object (475) indicating the number of times a message has been acquired (or the number of messages that the user has not checked) at a location adjacent to an icon (375) of an application related to the message. For example, the electronic device (101) may display the visual object (475) so as to overlap at least a portion of the icon (375). For example, the locations where the visual object (471) and the visual object (475) are displayed may be different from each other, but are not limited thereto. For example, the electronic device (101) may display the visual object (475) together with the visual object (411) in the notification area (310).

[0116] In FIGS. 4A and 4B , the electronic device (101) is illustrated as displaying a summary (415) at least temporarily based on the acquisition of a message, but this is merely an example. For example, the electronic device (101) may display only the visual object (411) and / or the visual object (475) without displaying the summary (415) based on the acquisition of a message.

[0117] In one embodiment, the visual object (411) displayed after displaying the summary (415) may be displayed differently compared to the visual object (411) displayed together with the summary (415). For example, the electronic device (101) may display the size of the visual object (411) displayed after displaying the summary (415) to be larger (or smaller) than the visual object (411) displayed together with the summary (415). For example, the electronic device (101) may display some characteristics (e.g., location, color, contrast, shape) of the visual object (411) displayed after displaying the summary (415) differently from the visual object (411) displayed together with the summary (415).

[0118] As described above, the electronic device (101) can indirectly inform the user of the content of the message by creating a new visual object corresponding to the message and displaying the created new visual object on the screen (301). Accordingly, the user can immediately recognize whether confirmation of the message is required.

[0119] FIG. 5A illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 5B illustrates an example of a screen displayed by an electronic device according to an embodiment.

[0120] FIGS. 5A and 5B may be described with reference to the electronic device (101) of FIG. 2. The screen (301) of FIGS. 5A and 5B may be displayed by the electronic device (101) after the screen (301) of FIG. 4B. The screen (301) of FIGS. 5A and 5B may be generated by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0121] In one embodiment, the electronic device (101) may obtain a user input for an icon (375) of an application for which a message notification exists. For example, the electronic device (101) may obtain a user input for an icon (375) that is displayed together with (or overlapped with) a visual object (471, or 475) indicating the presence of a message notification. For example, the user input may be an input for requesting display of a message. For example, the user input may be a long-press input for the icon. For example, the user input may be a double-tap input for the icon. For example, the user input may be a command for executing an application associated with the icon (375) by voice of the user.

[0122] For example, the electronic device (101) may display a user interface (510) corresponding to a message on the screen (301) without switching the screen (301) to the application screen based on the acquisition of a user input. For example, the electronic device (101) may display a user interface (510) corresponding to a message by overlaying it on the screen (301) based on the acquisition of a user input. Referring to FIG. 5A, the user interface (510) may include a visual object (511) indicating that it is a summary, information (513) about the sender who sent the message, and a summary (515) of the message. However, the present invention is not limited thereto. The user interface (510) may include the content of the message instead of the summary (515) of the message. In one embodiment, when the user interface (510) includes the content of the message, the visual object (511) indicating that it is a summary may not be displayed.

[0123] For example, the electronic device (101) may display the user interface (510) on the screen (301) until a specified condition is met. For example, the electronic device (101) may determine that the specified condition is met based on the elapse of a specified time after displaying the user interface (510). However, the present invention is not limited thereto. For example, the electronic device (101) may determine that the specified condition is met based on the acquisition of user input for an area other than the user interface (510) after displaying the user interface (510).

[0124] For example, referring to FIG. 5b, the electronic device (101) may stop (or change) displaying visual objects (411, 471, 475) related to a message on the screen (301) based on displaying the user interface (510).

[0125] According to an embodiment, the electronic device (101) may, while displaying the user interface (510), display the content of the message instead of the summary (515) of the message based on an input to the user interface (510). For example, displaying the content of the message instead of the summary (515) of the message may include the electronic device (101) changing the content displayed on the user interface (510). For example, displaying the content of the message instead of the summary (515) of the message may include the electronic device (101) switching from the screen (301) to the screen of the application and then displaying the content of the message on the screen of the application (e.g., FIG. 6b).

[0126] FIG. 6A illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 6B illustrates an example of a screen displayed by an electronic device according to an embodiment.

[0127] FIGS. 6A and 6B may be described with reference to the electronic device (101) of FIG. 2. The screens (601, 603) of FIGS. 6A and 6B may be displayed by the electronic device (101) after the screen (301) of FIG. 4B. The screens (601, 603) of FIGS. 6A and 6B may be generated by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0128] In one embodiment, the electronic device (101) may obtain a user input for an icon (e.g., 375 of FIG. 3) of an application for which a message notification exists. For example, the electronic device (101) may obtain a user input for an icon (375) that is displayed together with (or overlapped with) a visual object (e.g., 471 or 475 of FIG. 4B) indicating the presence of a message notification. For example, the user input may be an input for requesting execution of the application (or switching to a screen of the application). For example, the user input may be a press input for the icon. For example, the user input may be a tap input for the icon. For example, an input for requesting execution of the application (or switching to a screen of the application) may be distinguished from an input for requesting display of a message without executing the application (or switching to a screen of the application).

[0129] For example, the electronic device (101) may switch the screen (301) to the screen (601) of the application based on the user input obtained. For example, the electronic device (101) may display a list of messages on the screen (601). Referring to FIG. 6A, each message included in the list of messages displayed on the screen (601) of the application may be displayed through the visual object areas (611, 621, 631) and the content areas (615, 625, 635). In one embodiment, the visual object areas (611, 621, 631) may display visual objects (613, 623, 633) corresponding to the content (or summary) of the message. In one embodiment, the visual objects (613, 623, 633) may be visual objects generated through the GEN AI model (220). In one embodiment, the content area (615, 625, 635) may display a summary of the message and a visual object (617, 627, 637) indicating that it is a summary. However, this is not limited thereto. The content area (615, 625, 635) may include the content of the message instead of the summary of the message. In one embodiment, when the content area (615, 625, 635) includes the content of the message, the visual object (617, 627, 637) indicating that it is a summary may not be displayed.

[0130] In one embodiment, the electronic device (101) may display a screen for displaying the content of a message in response to a user input for selecting a message from a list of messages. For example, referring to FIG. 6B, the electronic device (101) may, in response to a user input for selecting an advertisement message on the screen (601), switch the screen (601) for displaying the content of the advertisement message to the screen (603). For example, the content (640) of the advertisement message may be displayed on the screen (603). For example, referring to FIG. 6B, based on the display of the screen (603), the electronic device (101) may stop (or change) the display of visual objects (411) related to the advertisement message on the screen (603).

[0131] FIG. 7 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0132] FIG. 7 may be described with reference to the electronic device (101) of FIG. 2. The screens (701, 703, 705) of FIG. 7 may only illustrate the notification area (310) of the screen (301). The screens (701, 703, 705) of FIG. 7 may be displayed by the electronic device (101) after the screen (301) of FIG. 4B. The screens (701, 703, 705) of FIG. 7 may be generated by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0133] FIG. 7 may illustrate a situation in which one application of an electronic device (101) continuously receives messages. For example, a situation in which one application continuously receives messages may include a situation in which two or more messages are received while the user does not check the messages.

[0134] For example, the electronic device (101) may display a visual object representing each of two or more messages based on the receipt of two or more messages. For example, if two or more messages are obtained (or generated) through the same application, the electronic device (101) may display a visual object representing each of the two or more messages along with an icon of the application.

[0135] For example, referring to FIG. 7, the electronic device (101) may display a screen (701) including a visual object (411) including a visual object (713) representing an application and a visual object (715) representing the content of a message.

[0136] Thereafter, in response to obtaining a new message, the electronic device (101) may generate a visual object (731) representing the content of the new message using the GEN AI model (220). In response to obtaining a new message, the electronic device (101) may display a screen (703) including a visual object (713) representing an application, a visual object (715) representing the content of the message, and a visual object (730) including a visual object (731) representing the content of the new message.

[0137] Thereafter, in response to obtaining a new message, the electronic device (101) may generate a visual object (751) representing the content of the new message using the GEN AI model (220). In response to obtaining a new message, the electronic device (101) may display a screen (705) including a visual object (713) representing an application, a visual object (715) representing the content of the message, and a visual object (750) including visual objects (731, 751) representing the content of the new message.

[0138] In some embodiments, based on the user confirming one of the messages, the display of the visual object corresponding to the confirmed message may be discontinued. For example, based on the user confirming the message for the visual object (731), the electronic device (101) may display a screen including a visual object that includes a visual object (713) representing the application, a visual object (715) representing the content of the message, and a visual object (751) representing the content of the new message. For example, based on the user confirming the message for the visual object (715), the electronic device (101) may display a screen including a visual object (713) representing the application, and visual objects (731, 751) representing the content of the new message.

[0139] In some embodiments, the electronic device (101) may display only a visual object representing the most recently received message among two or more messages based on the receipt of two or more messages. For example, the electronic device (101) may replace the visual object (715) with a visual object (731) based on the receipt of a new message after displaying the visual object (715). For example, replacing the visual object (715) with the visual object (731) may include displaying only the visual object (731) without displaying the visual object (715).

[0140] FIG. 8A illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 8B illustrates an example of a screen displayed by an electronic device according to an embodiment.

[0141] FIGS. 8A and 8B may be described with reference to the electronic device (101) of FIG. 2. The screen (301) of FIGS. 8A and 8B may be displayed by the electronic device (101) after the screen (705) of FIG. 7. The screen (301) of FIGS. 8A and 8B may be generated by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0142] In one embodiment, the electronic device (101) may obtain a user input (810) directed to a designated area (e.g., the notification area (310)) while displaying a visual object (750) in the designated area. For example, the user input (810) directed to the notification area (310) may be an input that moves from the notification area (310) to an area other than the notification area (310). For example, the user input (810) directed to the notification area (310) may be a drag input (or swipe input) that moves downward in the notification area (310). However, the present invention is not limited thereto. For example, the user input (810) directed to the notification area (310) may be a tap input (or double tap input) to the notification area (310).

[0143] In one embodiment, the electronic device (101) may display a user interface (801) indicating a list of notifications on the screen (301) based on a user input (810) obtained. In one embodiment, the electronic device (101) may display the user interface (801) so that the user interface (801) is positioned on the screen (301) to display a list of a plurality of visual objects (750) displayed in the notification area (310) based on a user input (810) directed toward the notification area (310). For example, the user interface (801) may include a list of notifications (841, 843, 845) corresponding to visual objects (e.g., visual objects (715, 731, 751) of FIG. 7). For example, each of the notifications (841, 843, 845) may include a visual object corresponding to the notification, a summary, and a visual object indicating that it is a summary.

[0144] For example, in the user interface (801), visual objects (311, 313) displayed in the notification area (310) may be displayed in different forms and / or at different locations. For example, in the user interface (801), a visual object (811) indicating date and / or time information may be displayed instead of the visual object (311). For example, in the user interface (801), a visual object (831) indicating an application running in the background and / or a function of the running application may be displayed instead of the visual object (313). However, the present invention is not limited thereto. For example, in the user interface (801), visual objects (315) displayed in the notification area (310) may be displayed in the same form and at the same location.

[0145] According to an embodiment, the electronic device (101) may obtain user input related to the user interface (801). For example, the electronic device (101) may stop displaying the user interface (801) based on obtaining the user input related to the user interface (801). For example, stopping displaying the user interface (801) may include returning to a previous screen (301).

[0146] According to an embodiment, the electronic device (101) may obtain a user input related to at least one notification among the notifications (841, 843, 845) of the user interface (801). For example, based on obtaining a user input related to the at least one notification, the electronic device (101) may stop displaying the at least one notification on the user interface (801). Thereafter, after returning to the screen (301), the display of the visual object representing the at least one notification whose display has been stopped may disappear. For example, based on obtaining a user input for a notification (845) while the user interface (801) is displayed, the electronic device (101) may display a visual object (730) instead of displaying a visual object (750) on the screen (301) to be displayed thereafter. For example, the visual object (730) may be a form in which the visual object (751) for the notification (845) disappears from the visual object (750).

[0147] According to an embodiment, the electronic device (101) may obtain a user input related to at least one of the notifications (841, 843, 845) of the user interface (801). For example, the user input related to at least one of the notifications (841, 843, 845) may be an input for requesting execution of an application (or switching to a screen of an application) related to the notifications (841, 843, 845). In one embodiment, the electronic device (101) may display a screen (e.g., screen (601) of FIG. 6B) for indicating the contents of the selected notification in response to a user input for selecting at least one of the notifications (841, 843, 845) of the user interface (801).

[0148] FIG. 9 illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0149] FIG. 9 may be described with reference to the electronic device (101) of FIG. 2. The screen (901) of FIG. 9 may be a screen (e.g., a lock screen) indicating a locked state of the electronic device (101). The screen (901) of FIG. 9 may be displayed based on the electronic device (101) transitioning to a locked state while the screen (705) of FIG. 7 is displayed. The screen (901) of FIG. 9 may be generated by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0150] In one embodiment, the electronic device (101) may transition to a locked state. For example, the electronic device (101) may transition to the locked state based on an input being applied to a button for transitioning to the locked state. For example, the electronic device (101) may transition to the locked state based on no user input being obtained for a specified time period for transitioning to the locked state.

[0151] In one embodiment, the electronic device (101) may display a lock screen (901) in a locked state. For example, the electronic device (101) may display the lock screen (901) in a locked state based on an input applied to a button for displaying the lock screen (901). For example, the lock screen (901) may include a list of notifications (941, 943, 945) corresponding to visual objects (e.g., visual objects 715, 731, 751 of FIG. 7). For example, each of the notifications (941, 943, 945) may include a visual object corresponding to the notification, a summary, and a visual object indicating that it is a summary. In one embodiment, the size of the visual object for the notifications displayed on the lock screen (901) may be larger than the size of the visual object for the notifications displayed in the notification area (310).

[0152] For example, on the lock screen (901), visual objects (311, 313) displayed in the notification area (310) may be displayed in different forms and / or at different locations. For example, on the lock screen (901), a visual object (911) indicating date and / or time information may be displayed instead of the visual object (311). For example, on the lock screen (901), the display location of a visual object (313) indicating an application running in the background and / or a function of the running application may be displayed at the display location of the visual object (311).

[0153] FIG. 10 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0154] FIG. 10 may be described with reference to the electronic device (101) of FIG. 2. The screen (301) of FIG. 10 may be generated by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0155] States (1001, 1003, 1005, 1007) of FIG. 10 may illustrate an animation for displaying a visual object (411) for a message in a designated area (e.g., notification area (310)) based on acquiring a message.

[0156] In one embodiment, in state (1001), the electronic device (101) may obtain a message. In one embodiment, in state (1001), the electronic device (101) may determine, based on obtaining the message, the display of a visual object (411) corresponding to the message.

[0157] In one embodiment, in state (1003), the electronic device (101) may display a visual object (411) in a designated area (e.g., notification area (310)) based on obtaining a message. In one embodiment, the electronic device (101) may change the size of the designated area (e.g., notification area (310)) at least temporarily to provide a visual effect indicating that a message has been obtained to the user. In one embodiment, the electronic device (101) may change the size of the visual object (411) displayed in the designated area (e.g., notification area (310)) to provide a visual effect indicating that a message has been obtained to the user.

[0158] For example, in state (1005), the electronic device (101) may enlarge a designated area (e.g., notification area (310)) based on obtaining a message. For example, the electronic device (101) may enlarge a designated area (e.g., notification area (310)) in a designated direction (e.g., downward direction) (1031) based on obtaining a message. For example, the designated direction may be a direction perpendicular to a length direction of the designated area (e.g., width direction) (1035). In one embodiment, the electronic device (101) may display a visual object (1011) in the designated area enlarged in the designated direction. In one embodiment, the electronic device (101) may enlarge the designated area in the designated direction and simultaneously enlarge the size of the visual object (411). For example, the size of a visual object (1011) displayed in a designated area enlarged in a designated direction may be larger than the size of at least one other visual object (311, 315) displayed in the designated area before being enlarged in the designated direction.

[0159] For example, in state (1007), the electronic device (101) can restore the enlarged designated area (e.g., notification area (310)) to its original size.

[0160] FIG. 11A illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 11B illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 11C illustrates an example of a screen displayed by an electronic device according to an embodiment. FIG. 11D illustrates an example of a screen displayed by an electronic device according to an embodiment.

[0161] The electronic device (1100) of FIGS. 11A to 11D may correspond to the electronic device (1801) illustrated in FIGS. 18A and 18B . The state (1101) of the electronic device (1100) of FIGS. 11A to 11D may correspond to the folded state of the electronic device (1801) illustrated in FIG. 18B . The electronic device (1100) of FIGS. 11A to 11D may include a display (1110) and cameras (1120).

[0162] In one embodiment, the display (1110) of the electronic device (1100) may correspond to the display (1835) of the electronic device (1801) as exemplified through FIGS. 18A and 18B . In one embodiment, the cameras (1120) of the electronic device (1100) may correspond to the cameras (1834) of the electronic device (1801) as exemplified through FIGS. 18A and 18B .

[0163] In one embodiment, referring to FIG. 11A, in a folded state, the electronic device (1100) may display one or more visual objects (1131, 1133, 1135) indicating a state of the electronic device (1100) (e.g., charging state, communication state, current time, and / or location).

[0164] In one embodiment, the electronic device (1100) may obtain a message. In one embodiment, the electronic device (1100) may display a notification of the message on the display (1110) based on a notification policy corresponding to the message.

[0165] For example, referring to FIG. 11B, the electronic device (1100) may display a user interface (1140) corresponding to a message based on acquiring the message. For example, the electronic device (1100) may display the user interface (1140) instead of one or more visual objects (1131, 1133, 1135) based on acquiring the message. For example, the user interface (1140) may include a visual object (1145) indicating a summary, information about the sender who sent the message (1141), and a summary of the message (1143).

[0166] For example, referring to FIGS. 11C and 11D , the electronic device (101) may display a visual object (1151) corresponding to the message and a content (or summary) (1155) of the message based on obtaining the message. For example, referring to FIG. 11C , the electronic device (101) may display a visual object (1151) and a content (or summary) (1155) of the message instead of one or more visual objects (1131, 1133, 1135) based on obtaining the message. For example, referring to FIG. 11D , the electronic device (101) may display a visual object (1151) and a content (or summary) (1155) of the message together with one or more visual objects (1131, 1133, 1135) based on obtaining the message. For example, the area of ​​a visual object (1151) and the content (or summary) (1155) of a message displayed together with one or more visual objects (1131, 1133, 1135) may be smaller than the area of ​​a visual object (1151) and the content (or summary) (1155) of a message displayed instead of one or more visual objects (1131, 1133, 1135).

[0167] According to an embodiment, the electronic device (101) may display the contents of a message differently depending on the state of the electronic device (101). For example, when the electronic device (101) is in a locked state, the electronic device (101) may display only the visual object (1151). For example, when the electronic device (101) is in an unlocked state, the electronic device (101) may display the contents (or summary) (1155) of the message together with the visual object (1151).

[0168] According to an embodiment, the electronic device (101) may turn on the display (1110) based on obtaining a user input while the display (1110) is in an off state. After the display (1110) is changed from an off state to an on state, the electronic device (101) may display an animation indicating that the GEN AI model (e.g., the GEN AI model (220) of FIG. 2) is operating on the display (1110). For example, the electronic device (101) may display an animation indicating that the GEN AI model (220) is operating while the GEN AI model (220) generates a visual object (1151) (or for a predetermined period of time). For example, the animation may be an animation that includes one or more frames of an intermediate process of generating the visual object (1151).

[0169] According to an embodiment, the electronic device (101) may, after displaying the screens of FIG. 11b or FIG. 11c, switch to a screen (e.g., the screen of FIG. 11d) that displays a visual object (1151) and the contents (or summary) (1155) of a message together with the objects (1131, 1133, 1135) displayed in FIG. 11a. For example, referring to FIG. 11d, the electronic device (101) may display a visual object (1151) that is smaller in size than the visual objects displayed in the screens of FIG. 11b or FIG. 11c. For example, the electronic device (101) may display some characteristics (e.g., location, color, contrast, shape) of a visual object (1151) displayed on the screen of FIG. 11d after displaying the screens of FIG. 11b or FIG. 11c differently from the visual object displayed on the screens of FIG. 11b or FIG. 11c.

[0170] FIG. 12 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0171] The electronic device (1200) of FIG. 12 may correspond to the electronic device (1901) illustrated in FIGS. 19A to 19D. The states (1201, 1205) of the electronic device (1200) of FIG. 12 may correspond to the first state (or reduced state) of the electronic device (1901) illustrated in FIGS. 19A and 19B. The state (1203) of the electronic device (1200) of FIG. 12 may correspond to the second state (or expanded state) of the electronic device (1901) illustrated in FIGS. 19C and 19D.

[0172] In one embodiment, referring to state (1201) of FIG. 12, in the first state, the electronic device (1200) may display one or more visual objects (311, 315, 411) representing a status (e.g., charging status, communication status, current time, and / or location) and / or a notification of the electronic device (1200) in a notification area (310) of a reduced display area (1221).

[0173] In one embodiment, the electronic device (1200) may obtain a user input for transitioning from a first state to a second state. For example, the user input for transitioning from the first state to the second state may be an input for requesting display of a message.

[0174] For example, the electronic device (1200) may transition from a first state to a second state based on obtaining a user input. For example, referring to state (1203) of FIG. 12, in the second state, the electronic device (1200) may display a notification (1240) corresponding to the message in the enlarged display area (1225). For example, the electronic device (1200) may display a notification (1240) corresponding to the message around (or above) an icon of a messaging application in the enlarged display area (1225) based on obtaining a user input. The notification (1240) may include a visual object indicating that it is a summary, information about the sender who sent the message, and a summary of the message.

[0175] For example, the electronic device (101) may display a notification (1240) on the screen until a specified condition is met. For example, the electronic device (101) may display the notification (1240) until it transitions from a second state to a first state.

[0176] For example, the electronic device (101) may transition from the second state to the first state. For example, referring to state (1205) of FIG. 12, in the first state, the electronic device (101) may stop (or change) the display of a visual object (411) related to a message in a reduced display area (1221). For example, referring to state (1205) of FIG. 12, in the first state, the electronic device (101) may stop (or change) the display of a visual object related to a message in an icon (1250) of a messaging application.

[0177] FIG. 13 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0178] The electronic device (1300) of FIG. 13 may be described with reference to the electronic device (101) of FIG. 2. The screens (1311, 1315) of FIG. 13 may be generated by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0179] States (1301, 1303, 1305, 1307) of FIG. 13 may illustrate animations for changing the display of an application's icon associated with a message based on obtaining a message (e.g., a call connection request).

[0180] In one embodiment, in state (1301), the electronic device (1300) may obtain a call connection request. In one embodiment, in state (1301), the electronic device (1300) may determine, based on obtaining a message, the display of a visual object corresponding to the call connection request.

[0181] In one embodiment, in state (1303), the electronic device (1300) may display a visual object (1333) around the icon (1331) of the call application based on obtaining a call connection request. In one embodiment, in state (1303), the electronic device (1300) may display the visual object (1333) so as to at least partially overlap the icon (1331) of the call application based on obtaining a call connection request. However, the present invention is not limited thereto. In one embodiment, in state (1303), the electronic device (1300) may display the visual object (1333) instead of the icon (1331) of the call application based on obtaining a call connection request.

[0182] In one embodiment, in state (1305), the electronic device (1300) may display a visual object (1340) indicating a missed call instead of the icon (1331) of the call application based on the occurrence of a missed call in response to a call connection request. However, the present invention is not limited thereto. In one embodiment, in state (1305), the electronic device (1300) may display a visual object (1340) around the icon (1331) of the call application based on the occurrence of a missed call. In one embodiment, in state (1305), the electronic device (1300) may display the visual object (1340) so as to at least partially overlap the icon (1331) of the call application based on the occurrence of a missed call.

[0183] According to one embodiment, the electronic device (1300) may generate a visual object (1340) based on inputting information (e.g., a facial image (e.g., a facial image included in a photo) and / or a name) corresponding to the person to whom the missed call was received into a GEN AI model (e.g., the GEN AI model (220)). According to one embodiment, the electronic device (1300) may display the generated visual object (1340). For example, the visual object (1340) may be an object representing a face generated by iconizing the face of the person to whom the missed call was received.

[0184] For example, in state (1307), the electronic device (1300) may display information about the call sender (e.g., Moon) and / or a visual object representing the call sender (e.g., a human face object) while displaying the screen (1315) of the call application in response to a call connection request.

[0185] According to an embodiment, the electronic device (1300) may display a visual object (1340) generated based on inputting information (e.g., a face image (e.g., a face image included in a photo) and / or a name) corresponding to the person receiving the missed call into a GEN AI model (e.g., a GEN AI model (220)) on a screen (e.g., a lock screen) displayed by the electronic device (1300) in a locked state.

[0186] FIG. 14 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0187] The electronic device (1400) of FIG. 14 may be described with reference to the electronic device (101) of FIG. 2. The screens (1411, 1413, 1415) of FIG. 14 may be generated by the electronic device (1400) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0188] Referring to state (1401) of FIG. 14, the electronic device (1400) can execute a recording application in the foreground. For example, the electronic device (1400) can display a screen (1411) of the recording application based on executing the recording application in the foreground.

[0189] For example, the electronic device (1400) may generate a visual object (1431) representing the content being recorded based on a voice signal acquired during recording. For example, the electronic device (1400) may generate a visual object (1431) representing the content being recorded through the GEN AI model (220). For example, referring to state (1403) of FIG. 14, the electronic device (1400) may display the visual object (1431) on the screen (1411) of the recording application. According to one embodiment, when the electronic device (1400) starts voice recording, it may summarize the content of the voice recording in real time. The electronic device (1400) may display text representing the content of the voice recording on the display. The electronic device (1400) may generate an image corresponding to the content of the voice recording by inputting the content of the voice recording being recorded in real time into the GEN AI model (e.g., the GEN AI model (220) of FIG. 2) in real time. For example, the electronic device (1400) may generate an image corresponding to the content of a voice recording by inputting at least a portion of text representing the content of the voice recording as a prompt input to the GEN AI model (220). According to one embodiment, the electronic device (1400) may generate an icon based on a summary of the recording content to enable a user to easily recognize the recording content based on an input for storing the recording content. The electronic device (1400) may utilize the icon based on the generated summary of the recording content as an icon for a file representing the recording content.

[0190] For example, the electronic device (1400) may display a visual object (1441) representing the content being recorded in the notification area (310) based on an input (e.g., a user input to the home button) to run the recording application in the background while recording. For example, referring to state (1405) of FIG. 14, the electronic device (1400) may display a visual object (1441) on the home screen (1415) while the recording application is running in the background.

[0191] For example, the electronic device (1400) may display a list of recorded contents (1451, 1453, 1455) after recording is completed. For example, the electronic device (1400) may display the list of recorded contents through visual objects representing the recorded contents (1451, 1453, 1455). For example, the visual object representing the recorded contents (1451) displayed in the state (1407) may be a visual object reduced from the visual object (1431) displayed in the state (1403).

[0192] FIG. 15 illustrates an example of an operation in which an electronic device displays an image transmitted by an external electronic device, according to one embodiment.

[0193] The electronic devices (1500, 1501) of FIG. 15 can be described with reference to the electronic device (101) of FIG. 2.

[0194] Referring to FIG. 15, an electronic device (1500) can transmit content (1520) to an electronic device (1501). For example, the content (1520) can be an image file, a video file, and / or an audio file.

[0195] In one embodiment, the electronic device (1501) may determine whether to display the content (1520). For example, the electronic device (1501) may determine not to display the content (1520) based on whether the content (1520) is restricted content (e.g., content including disallowed visual content and / or audio content). For example, the electronic device (1501) may determine not to display the content (1520) based on whether the content (1520) is restricted content (e.g., content including disallowed visual displays). However, the present invention is not limited thereto. For example, the electronic device (1501) may determine not to display the content (1520) based on whether the electronic device (1501) is determined to be in a locked state.

[0196] For example, the electronic device (1501) may display alternative content (1530) corresponding to the content (1520) based on a determination not to display the content (1520). For example, the electronic device (1501) may display alternative content (1530) to indicate that the content (1520) has been received. For example, the alternative content (1530) may be content generated through the GEN AI model (220) to include visual content and / or audio content that is not permitted based on the content (1520). According to one embodiment, the GEN AI model (e.g., the GEN AI model (220) of FIG. 2) may display text summarizing the content (1520), or may generate alternative content (1530) that has modified the content (1520) as at least one of an indicator, an icon, or a visual object. For example, when creating content (1530) as an indicator, the electronic device (1501) can display the content (1530) in the upper area (310) (e.g., status bar).

[0197] For example, the electronic device (1501) may display content (1520) based on obtaining an input from a user requesting display of the original (e.g., content (1520)) after displaying the content (1530).

[0198] According to an embodiment, the electronic device (1501) may display content differently depending on the state of the electronic device (1501). For example, the electronic device (1501) may display content (1530) when the electronic device (1501) is in a locked state. For example, the electronic device (1501) may display content (1530) instead of content (1520) when the electronic device (1501) is in an unlocked state. However, the present invention is not limited thereto. For example, the electronic device (1501) may display content (1520) when the electronic device (1501) is in an unlocked state.

[0199] FIG. 16 illustrates changes in a screen displayed by an electronic device according to one embodiment.

[0200] The electronic device (1600) of FIG. 16 may correspond to the electronic device (2000) exemplified through FIGS. 20A and 20B. The states (1601, 1603) of the electronic device (1600) of FIG. 16 may correspond to the fully folded state of the electronic device (2000) exemplified through FIG. 20A. The state (1605) of the electronic device (1600) of FIG. 16 may correspond to the unfolded state of the electronic device (2000) exemplified through FIG. 20B.

[0201] In one embodiment, referring to state (1601) of FIG. 16, in a fully folded state, the electronic device (1600) may display a user interface (1620) on the screen (1611). For example, the user interface (1620) may be displayed overlaid on the screen (1611) to indicate receipt of a message. For example, the user interface (1620) may include a visual object (1621) corresponding to the content (or summary) (1625) of the message. For example, the user interface (1620) may include the content (or summary) (1625) of the message.

[0202] In one embodiment, referring to state (1603) of FIG. 16, in the fully folded state, the electronic device (1600) may display a visual object (1635) corresponding to the content (or summary) (1625) of the message on the screen (1611) instead of the icon of the messaging application. However, the present invention is not limited thereto. For example, in the fully folded state, the electronic device (1600) may display a visual object (1635) corresponding to the content (or summary) (1625) of the message on the screen (1611) around the icon of the messaging application.

[0203] For example, based on the transition from a fully folded state to an unfolded state, the electronic device (1600) may display a list of user interfaces (1620, 1640) in a specific area (1650) of the display. For example, the user interfaces (1620, 1640) may include content (or summary) (1643, 1645) of each of the messages and / or a visual object (1641) corresponding to the content (or summary) (1643, 1645).

[0204] For example, based on the transition from a fully folded state to an unfolded state, the electronic device (1600) may display an icon of a messaging application instead of a visual object (1635) on the screen (1615).

[0205] Figure 17 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0206] FIG. 17 can be described with reference to FIGS. 1 to 16. The operations of FIG. 17 described below can be performed by the processor (120). For example, the operations of FIG. 17 described below can be performed by the electronic device (101) when at least one processor (120) including a processing circuit individually or collectively executes instructions stored in a memory (130) including one or more storage media.

[0207] Referring to FIG. 17, in operation 1710, the electronic device (101) may identify data. For example, the data may be related to the reception of an incoming call (e.g., a voice call and / or a video call), the reception of a conversation (or chat) (or email) of a messaging service, the occurrence of an error (e.g., an error in background operation, an error in authentication status), the occurrence of an event (e.g., a calendar event), location sharing, the occurrence of a missed call, navigation, progress status (e.g., progress status of background operation), the reception of a promotion (or advertisement), the occurrence of recommended information, or an event of a social network (e.g., sharing an update).

[0208] In operation 1720, the electronic device (101) may acquire a visual object based on data. The electronic device (101) may acquire the visual object to notify the user of the reception (or acquisition) of data. For example, the electronic device (101) may generate a visual object to notify the user of the reception (or acquisition) of data using the GEN AI model (220), the AI ​​model (230), and / or the prompt generation model (240). In one embodiment, the visual object to notify the user of the reception (or acquisition) of data may be a visual object that was not stored in the electronic device (101) (or the memory (130)) prior to the acquisition (or generation) (or occurrence) of the data.

[0209] In operation 1730, the electronic device (101) may display a visual object. For example, the electronic device (101) may display the visual object on the display (260). For example, the electronic device (101) may display the visual object in a designated area of ​​the screen of the display (260). For example, the designated area may be an area on the screen of the display (260) allocated to indicate that a message has been obtained (or generated). For example, the designated area may be located at the top and / or bottom of the screen of the display (260). For example, the designated area may be an area where at least one other visual object is displayed to indicate a status of the electronic device (101) (e.g., charging status, communication status, current time, and / or location). However, the present invention is not limited thereto. For example, the designated area may be an area that at least partially overlaps an area where an icon and / or widget of an application that requested the output of the message is displayed.

[0210] FIG. 18A illustrates an example of an unfolded state of an electronic device according to one embodiment. FIG. 18B illustrates an example of a folded state of an electronic device according to one embodiment.

[0211] Referring to FIGS. 18A and 18B , an electronic device (1801) may include a first housing (1810), a second housing (1820), and a hinge structure (or hinge assembly) (1860). In one embodiment, the first housing (1810) may be rotatably connected to the hinge structure (1860). The first housing (1810) may be rotatable relative to the second housing (1820) via the hinge structure (1860). In one embodiment, the second housing (1820) may be rotatably connected to the hinge structure (1860). The second housing (1820) may be rotatable relative to the first housing (1810) via the hinge structure (1860).

[0212] In one embodiment, the first housing (1810) can include a first side (1811), a second side (1812) facing away from the first side (1811), and a third side (1813) surrounding at least a portion of the first side (1811) and the second side (1812). In one embodiment, the first housing (1810) can provide a space for arranging components of the electronic device (1801). In one embodiment, the first housing (1810) can include a conductive material, a non-conductive material, or a combination thereof. The first side (1811), the second side (1812), and the third side (1813) of the first housing (1810) can be referred to as a front side, a back side, and a side side, respectively, of the first housing (1810).

[0213] In one embodiment, the second housing (1820) may include a first side (1821), a second side (1822) facing and spaced from the first side (1821), and a third side (1823) surrounding at least a portion of the first side (1821) and the second side (1822). In one embodiment, the second housing (1820) may provide a space for arranging components of the electronic device (1801). The first side (1821), the second side (1822), and the third side (1823) of the second housing (1820) may be referred to as a front side, a back side, and a side side of the second housing (1820), respectively.

[0214] In one embodiment, the hinge structure (1860) may be connected to the first housing (1810) and the second housing (1820), respectively. For example, the hinge structure (1860) may include a first hinge plate and a second hinge plate configured to be rotatable. The first hinge plate may be connected to the first housing (1810), and the first housing (1810) may be rotated by the first hinge plate. The second hinge plate may be connected to the second housing (1820), and the second housing (1820) may be rotated by the second hinge plate.

[0215] An electronic device (1801) according to one embodiment can be folded or unfolded about a folding axis (F) passing through a hinge structure (1860) depending on the rotation of the first housing (1810) and the second housing (1820). The hinge structure (1860) can be positioned between the first housing (1810) and the second housing (1820) so that the electronic device (1801) can be folded about the folding axis (F).

[0216] In one embodiment, the hinge structure (1860) may include a hinge cover (1865) for covering an internal structure (e.g., a hinge mechanism). The hinge cover (1865) may be exposed to the outside or covered by the first housing (1810) and the second housing (1820) depending on the degree to which the electronic device (1801) is folded. For example, while the electronic device (1801) is in a folded state (e.g., FIG. 18b), the hinge cover (1865) may be at least partially exposed through a space between the first housing (1810) and the second housing (1820). For example, while the electronic device (1801) is in an unfolded state (e.g., FIG. 18a), the hinge cover (1865) may be covered by the first housing (1810) and the second housing (1820).

[0217] According to one embodiment, an electronic device (1801) may include a first display (1830) (e.g., a display module (160) of FIG. 1) disposed within a space provided by a first housing (1810) and a second housing (1820). For example, the first display (1830) may be at least partially accommodated within a recess formed in a first surface (1811) of the first housing (1810) and a first surface (1821) of the second housing (1820). In one embodiment, the first display (1830) may include a first flat part (1831) aligned with the first housing (1810), a second flat part (1832) spaced from the first flat part (1831) and aligned with the second housing (1820), and a folding part (1833) aligned with the hinge structure (1860) and extending from the first flat part (1831) to the second flat part (1832). The first display (1830) may be referred to as a foldable display or a flexible display. The first flat part (1831), the second flat part (1832), and the folding part (1833) may form a surface of the first display (1830). The surface of the first display (1830) may at least partially form a first surface (1811) of the first housing (1810) and a first surface (1821) of the second housing (1820). The first planar portion (1831), the second planar portion (1832), and the folding portion (1833) may be referred to as a first region, a second region, and a folding region of the first display (1830), respectively.

[0218] In one embodiment, the electronic device (1801) may include a second display (1835) disposed within the first housing (1810). The second display (1835) may be visible through a second side (1812) of the first housing (1810).

[0219] An electronic device (1801) according to one embodiment may include a plurality of cameras (e.g., a camera module (180) of FIG. 1). For example, the electronic device (1801) may include cameras (1834, 1836). In one embodiment, the camera (1834) may be positioned within the first housing (1810) so as to acquire an image through a portion of the second surface (1812). In one embodiment, the camera (1836) may be positioned below the first flat portion (1831) of the first display (1830). The camera (1836) may be aligned with an opening that at least partially penetrates the first flat portion (1831) and may acquire an image through the hole. The camera (1836) may be positioned within a screen display area of ​​the first display (1830), but is not limited thereto.

[0220] Hereinafter, states of the electronic device (1801) will be described with reference to FIGS. 18A and 18B. The electronic device (1801) according to an embodiment may include an unfolded state (e.g., FIG. 18A), a folded state (e.g., FIG. 18B), and an intermediate state. The electronic device (1801) may vary between the unfolded state and the folded state, and the intermediate state may be a state between the unfolded state and the folded state. In an embodiment, the angle formed by the first housing (1810) and the second housing (1820) may vary depending on the state of the electronic device (1801).

[0221] First, referring to FIG. 18A, in the unfolded state, the first housing (1810) and the second housing (1820) can form a first angle. For example, but not limited to, the first angle can be about 180 degrees. The first flat surface (1831), the second flat surface (1832), and the folding surface (1833) of the first display (1830) can form a substantially flat surface. A first direction in which the first surface (1811) (or the first flat surface (1831)) of the first housing (1810) faces and a second direction in which the first surface (1821) (or the second flat surface (1832)) of the second housing (1820) faces can face substantially the same direction.

[0222] Referring to FIG. 18B, in the folded state of the electronic device (1801), the first housing (1810) and the second housing (1820) can be folded to face each other by rotating about the folding axis (F). The first housing (1810) and the second housing (1820) can be overlapped to form a second angle smaller than the first angle. For a non-limiting example, the second angle can be about 0 degrees. The folding portion (1833) of the first display (1830) can be bent to correspond to the second angle. The first surface (1811) of the first housing (1810) can face the first surface (1821) of the second housing (1820). The first housing (1810) and the second housing (1820) can be in at least partial contact, but are not limited thereto. The first direction in which the first surface (1811) of the first housing (1810) faces and the second direction in which the first surface (1821) of the second housing (1820) faces may be opposite to each other. In the folded state, at least a portion of the first display (1830) may not be visible from the outside of the electronic device (1801), and the second display (1835) may be visible from the outside of the electronic device (1801).

[0223] FIG. 19A is a top plan view of an exemplary electronic device (1901) in a first state.

[0224] Referring to FIG. 19A, an electronic device (1901) may, according to one embodiment, include a first housing part (1910), a second housing part (1920) movable relative to the first housing part (1910) in a first direction (1961) parallel to the y-axis or in a second direction (1962) parallel to the y-axis and opposite to the first direction (1961), and a display (1930).

[0225] For example, the electronic device (1901) may be in the first state. For example, within the first state, the second housing part (1920) may be movable relative to the first housing part (1910) in a first direction (1961) among the first direction (1961) and the second direction (1962). For example, within the first state, the second housing part (1920) may not be movable relative to the first housing part (1910) in the second direction (1962).

[0226] For example, within the first state, the display (1930) may provide a smaller display area than the display areas of another state (e.g., the second state). For example, within the first state, the display area may correspond to an area (1930a). For example, although not shown in FIG. 19A, within the first state, an area of ​​the display (1930) other than the display area (1930a) (e.g., area 1930b of FIG. 19C) may be included within the first housing part (1910). For example, within the first state, the area (e.g., area 1930b of FIG. 19C) may be covered by the first housing part (1910). For example, within the first state, the area may be rolled into the first housing part (1910). For example, within the first state, the region (1930a) may include a planar portion, unlike the region including a curved portion. However, this is not limited thereto. For example, the region (1930a) may include a curved portion extending from the planar portion and positioned within an edge portion within the first state.

[0227] For example, the first state may be referred to as a slide-in state or a closed state in that at least a portion of the second housing part (1920) is positioned within the first housing part (1910). For example, the first state may be referred to as a reduced state in that it provides the display area with the smallest size, but is not limited thereto.

[0228] For example, the first housing part (1910) may include a first image sensor (1950-1) within the camera module (180 of FIG. 1) that is exposed through a portion of the area (1930a) and faces a third direction (1963) parallel to the z-axis. For example, although not illustrated in FIG. 19A, the second housing part (1920) may include one or more second image sensors within the camera module (180) that are exposed through a portion of the second housing part (1920) and faces a fourth direction (1964) parallel to the z-axis and opposite to the third direction (1963). For example, the one or more second image sensors may be exemplified through the description of FIG. 19B.

[0229] FIG. 19b is a bottom view of an exemplary electronic device within a first state.

[0230] Referring to FIG. 19B, within the first state, one or more second image sensors (1950-2) disposed within the second housing part (1920) may be positioned within a structure disposed within the first housing part (1910) for the one or more second image sensors (1950-2). For example, light from outside the electronic device (1901) may be received by the one or more second image sensors (1950-2) through the structure within the first state. For example, since the one or more second image sensors (1950-2) are positioned within the structure within the first state, the one or more second image sensors (1950-2) may be exposed through the structure within the first state. For example, the structure may be implemented in various ways. For example, the structure may be an opening or a notch. For example, the structure may be an opening (1912a) in a plate (1912) of a first housing part (1910) that surrounds at least a portion of a second housing part (1920). However, the present invention is not limited thereto. For example, in the first state, one or more second image sensors (1950-2) included in the second housing part (1920) may be covered by at least a portion of the plate (1912) of the first housing part (1910).

[0231] According to one embodiment, the first state can be changed to the second state.

[0232] For example, the first state (or the second state) can be changed to the second state (or the first state) through one or more intermediate states between the first state and the second state.

[0233] For example, the first state (or the second state) may be changed to the second state (or the first state) based on a predefined user input. For example, the first state (or the second state) may be changed to the second state (or the first state) in response to a user input to a physical button exposed through a part of the first housing part (1910) or a part of the second housing part (1920). For example, the first state (or the second state) may be changed to the second state (or the first state) in response to a touch input to an executable object displayed within the display area. For example, the first state (or the second state) may be changed to the second state (or the first state) in response to a touch input having a contact point on the display area and having a pressing strength greater than or equal to a reference strength. For example, the first state (or the second state) may be changed to the second state (or the first state) in response to a voice input received through a microphone of the electronic device (1901). For example, the first state (or the second state) may be changed to the second state (or the first state) in response to an external force applied to the first housing part (1910) and / or the second housing part (1920) to move the second housing part (1920) with respect to the first housing part (1910). For example, the first state (or the second state) may be changed to the second state (or the first state) in response to a user input identified from an external electronic device (e.g., earbuds or a smart watch) connected to the electronic device (1901). However, the present invention is not limited thereto.

[0234] The above second state can be illustrated through the descriptions of FIGS. 19c and 19d.

[0235] Figure 19c is a plan view of an exemplary electronic device within the second state.

[0236] Referring to FIG. 19C, the electronic device (1901) may be in the second state. For example, within the second state, the second housing part (1920) may be movable relative to the first housing part (1910) in a second direction (1962) among the first direction (1961) and the second direction (1962). For example, within the second state, the housing may cause the volume of the electronic device (1901) to decrease as the second housing part (1920) moves in the second direction (1962) among the first direction (1961) and the second direction (1962). For example, within the second state, the second housing part (1920) may not move relative to the first housing part (1910) in the first direction (1961).

[0237] According to one embodiment, within the second state, the display (1930) may provide the display area having the largest size. For example, within the second state, the display area may correspond to an area (330c) including an area (1930a) and an area (1930b). For example, an area (1930b) that was included within the first housing part (1910) within the first state may be exposed within the second state. According to one embodiment, as the second housing part (1920) moves in the first direction (1961) within the first state, at least a portion of the display (1930) (e.g., area (1930b)) may be exposed to the outside so that the user can view it. For example, within the second state, area (1930a) may include a flat portion. However, the present invention is not limited thereto. For example, region (1930a) may include a curved portion extending from the planar portion and positioned within the edge portion. In one embodiment, within the second state, region (1930b) may include a planar portion among the planar portion and the curved portion, unlike region (1930a) within the first state. However, the present invention is not limited thereto. For example, region (1930b) may include a curved portion extending from the planar portion of region (1930b) and positioned within the edge portion.

[0238] In one embodiment, the second state may be referred to as a slide-out state or an open state in that at least a portion of the second housing part (1920) is positioned outside the first housing part (1910). For example, the second state may be referred to as an expanded state in that it provides the display area having the largest size, but is not limited thereto.

[0239] In one embodiment, the first image sensor (1950-1) facing the third direction (1963, e.g., toward the rear of the electronic device (1901)) may be moved together with the area (1930a) according to the movement of the second housing part (1920) in the first direction (1961) when the state of the electronic device (1901) changes from the first state to the second state. For example, although not shown in FIG. 19C, one or more second image sensors (1950-2) facing the fourth direction (1964, e.g., toward the front of the electronic device (1901)) may be moved according to the movement of the second housing part (1920) in the first direction (1961) when the state of the electronic device (1901) changes from the first state to the second state. For example, the relative positional relationship between one or more second image sensors (1950-2) and the structure illustrated in the description of FIG. 5B may change according to the movement of one or more second image sensors (1950-2). For example, the change in the relative positional relationship may be illustrated in FIG. 19D.

[0240] FIG. 19d is a bottom view of an exemplary electronic device (1901) within a second state.

[0241] Referring to FIG. 19D, within the second state, one or more second image sensors (1950-2) may be positioned outside the structure. For example, within the second state, one or more second image sensors (1950-2) may be positioned outside the opening (1912a) in the plate (1912). For example, because the one or more second image sensors (1950-2) are positioned outside the opening (1912a) within the second state, the one or more second image sensors (1950-2) may be exposed within the second state. For example, because the one or more second image sensors (1950-2) are positioned outside the structure within the second state, the relative positional relationship within the second state may be different from the relative positional relationship within the first state.

[0242] In one embodiment, when the electronic device (1901) does not include the structure such as the opening (1912a), one or more second image sensors (1950-2) within the second state may be exposed, unlike one or more second image sensors (1950-2) within the first state. For example, one or more second image sensors (1950-2) within the first state may not be exposed through the opening (1912a) and may be covered by the first housing part (1910) and / or covered by the plate (1912).

[0243] FIG. 20A illustrates an example of an unfolded state of an electronic device according to one embodiment. FIG. 20B illustrates an example of a fully folded state of an electronic device according to one embodiment.

[0244] Referring to FIG. 20A, the electronic device (2000) can be unfolded in a first state (2001a). The electronic device (2000) can include a first housing (2010), a second housing (2020), and a third housing (2030). The first housing (2010) can include a first surface (2010a). The second housing (2020) can include a second surface (2020a). The third housing (2030) can include a third surface (2030a). The first state (2001a) can be a state in which the first surface (2010a), the second surface (2020a), and the third surface (2030a) are oriented in a substantially same first direction (e.g., the z-axis direction). The first state (2001a) may be referred to as an unfolded state, in which the first housing (2010), the second housing (2020), and the third housing (2030) are unfolded. Within the first state (2001a), the first housing (2010), the second housing (2020), and the third housing (2030) may form a substantially flat surface. For example, the first surface (2010a), the second surface (2020a), and the third surface (2030a) may form a flat surface because the first housing (2010), the second housing (2020), and the third housing (2030) include a substantially flat surface.

[0245] The electronic device (2000) may include a first hinge structure (2002 (2002a, 2002b)) and a second hinge structure (2003 (2003a, 2003b)). The first hinge structure (2002) may include a plurality of first hinge structures (2002a, 2002b). The second hinge structure (2003) may include a plurality of second hinge structures (2003a, 2003b). The first hinge structures (2002a, 2002b) may be disposed between a first housing (2010) and a second housing (2020). The first hinge structures (2002a, 2002b) can rotatably connect the second housing (2020) to the first housing (2010). For example, through the first hinge structures (2002a, 2002b), the second housing (2020) can rotate with respect to the first housing (2010) about the first folding axis (f3). Through the rotation of the second housing (2020), a first angle (Θ1) between the first housing (2010) and the second housing (2020) can be approximately 0 degrees to 180 degrees. The second hinge structures (2003a, 2003b) can be arranged between the first housing (2010) and the third housing (2030). The second hinge structures (2003a, 2003b) can rotatably connect the third housing (2030) to the first housing (2010). For example, through the second hinge structures (2003a, 2003b), the third housing (2030) can rotate with respect to the first housing (2010) about the second folding axis (f4). Through the rotation of the third housing (2030), the first angle (Θ1) between the first housing (2010) and the third housing (2030) can be approximately 0 to 180 degrees.

[0246] The first hinge structures (2002a, 2002b) may be surrounded by a first hinge cover (2050). One (2002a) of the first hinge structures (2002a, 2002b) may be disposed at one end of the first hinge cover (2050), and the other (2002b) may be disposed at the other end of the first hinge cover (2050). The second hinge structures (2003a, 2003b) may be surrounded by a second hinge cover (2060). One (2003a) of the second hinge structures (2003a, 2003b) may be disposed at one end of the second hinge cover (2060), and the other (2003b) may be disposed at the other end of the second hinge cover (2060).

[0247] The electronic device (2000) may further include a display (2010). The display (2010) may be disposed on one surface formed by the first housing (2010), the second housing (2020), and the third housing (2030). The display (2010) may be disposed on the first surface (2010a), the second surface (2020a), and the third surface (2030a). The display (2010) may include a first display area (2040a), a second display area (2040b), and a third display area (2040c). The first display area (2040a) may be disposed on the first surface (2010a) of the first housing (2010). The first display area (2040a) may be an area that is coupled to the first surface (2010a) and is not deformable. The second display area (2040b) may be arranged on the second surface (2020a) of the second housing (2020). The second display area (2040b) may be an area that is coupled to the second surface (2020a) and is not deformed. The third display area (2040c) may be arranged on the third surface (2030a) of the third housing (2030). The third display area (2040c) may be an area that is coupled to the third surface (2030a) and is not deformed. The first display area (2040a), the second display area (2040b), and the third display area (2040c) may be referred to as planar areas in terms of their substantially flat surfaces.

[0248] The display (2010) may further include a fourth display area (2040d) and a fifth display area (2040e). The fourth display area (2040d) may be disposed on the first hinge cover (2050). The fourth display area (2040d) may be coupled with the first hinge cover (2050) or the first hinge structures (2002a, 2002b). For example, the fourth display area (2040d) may be supported by a hinge plate (not shown) included in the first hinge structures (2002a, 2002b). The fourth display area (2040d) may be deformed as the second housing (2020) rotates about the first folding axis (f3) with respect to the first housing (2010).

[0249] The fifth display area (2040e) may be arranged on the second hinge cover (2060). The fifth display area (2040e) may be coupled with the second hinge cover (2060) or the second hinge structures (2003a, 2003b). For example, the fifth display area (2040e) may be supported by a hinge plate (not shown) included in the second hinge structures (2003a, 2003b). The fifth display area (2040e) may be deformed as the third housing (2030) rotates about the second folding axis (f4) with respect to the first housing (2010).

[0250] The fourth display area (2040d) may be wider than the area of ​​the fifth display area (2040e). For example, the first distance (p1), which is the width of the fourth display area (2040d), may be longer than the second distance (p2), which is the width of the fifth display area (2040e). When the electronic device (2000) is converted to a folded state, the radius of curvature of the fourth display area (2040d) may be larger than the radius of curvature of the fifth display area (2040e).

[0251] The electronic device (2000) may further include first magnets (2001a, 201b). The first magnets (2010a, 2010b) may be disposed within the second housing (2020). For example, the first magnets (2010a) may be disposed on a side surface of the second housing (2020). The first magnets (2010a) may be disposed closer to a side surface of the second housing (2020) facing the first hinge cover (2050) than to the other side surface facing the side surface. The first magnets (2010a) may at least partially overlap an inactive area disposed along an edge of a second display area (2040b) when the display (2010) is viewed from above. The first magnets (2001a, 201b) can be arranged to face the second hinge structures (2003a, 2003b) when the second housing (2020) rotates and folds along the first folding axis (f3).

[0252] Referring to FIG. 20b, the electronic device (2000) can be folded in a second state (2001b). The second state (2001b) may be a state in which at least one of the first surface (2010a), the second surface (2020a), and the third surface (2030a) faces a different direction. The third display area (2040c) corresponding to the third surface (2030a) may face substantially the same direction as the direction (e.g., the -z-axis direction) in which the second display area (2040b) corresponding to the second surface (2020a) faces. The third display area (2040c) may face a different direction from the direction in which the first display area (2040a) corresponding to the first surface (2010a) faces. For example, the direction in which the third display area (2040c) faces (e.g., the -z-axis direction) may be opposite to the direction in which the first display area (2040a) faces (e.g., the +z-axis direction). The third display area (2040c) may face the first display area (2040a). The second state (2001b) may be referred to as a folded state in that the first housing (2010), the second housing (2020), and the third housing (2030) are folded. Within the second state (2001b), the first housing (2010), the second housing (2020), and the third housing (2030) may face each other. For example, within the second state (2001b), the first housing (2010), the third housing (2030), and the second housing (2020) can be stacked in a first direction (e.g., the z-axis direction).

[0253] During the transition from the first state (2001a) to the second state (2001b), the second housing (2020) can rotate about the first folding axis (f3) with respect to the first housing (2010) via the first hinge structure (2002). Within the second state (2001b), the second housing (2020) can face the third housing (2030). For example, within the second state (2001b), the second display area (2040b) disposed in the second housing (2020) can face the rear surface (2031) of the third housing (2030).

[0254] Through the second hinge structure (2003), the third housing (2030) can rotate with respect to the first housing (2010) about the second folding axis (f4). In the second state (2001b), the third housing (2030) can face the first housing (2010). For example, in the second state (2001b), the third display area (2040c) disposed in the third housing (2030) can face the first display area (2040a) disposed in the first housing (2010). The side surface (2032) of the third housing (2030) can face the fourth display area (2040d).

[0255] When looking at the first hinge cover (2050) from above in the second state (2001b), the overlapping area of ​​the display (2010) and the first hinge structure (2002) may be wider than the overlapping area of ​​the display (2010) and the second hinge structure (2003) when looking at the second hinge cover (2060) from above. The first distance (p1), which is the width of the first hinge cover (2050) corresponding to the fourth display area (2040d), may be longer than the second distance (p2), which is the width of the second hinge cover (2060) corresponding to the fifth display area (2040e) (e.g., the fifth display area (2040e) of FIG. 11a). The difference between the first distance (p1) and the second distance (p2) may correspond to the thickness of the second housing (2020).

[0256] Based on the difference between the first distance (p1) and the second distance (p2), the first foldable housing among the second housing (2020) and the third housing (2030) can be determined. For example, the third housing (2030) can first rotate with respect to the first housing (2010) about the second folding axis (f4). After the third housing (2030) is folded, the second housing (2020) can rotate with respect to the first housing (2010) about the first folding axis (f3). Since the width of the second hinge structure (2003) is narrower than the width of the first hinge structure (2002), the third housing (2030) can be folded to face the first housing (2010). For example, as the width of the first hinge cover (2050) is wider than the width of the second hinge cover (2060), the third housing (2030) can be folded to face the first housing (2010) based on the operation of the second hinge structure (2003) within the second hinge cover (2060). As the width of the first hinge structure (2002) is wider than the width of the second hinge structure (2003), the second housing (2020) can be folded to face the rear surface (2031) of the third housing (2030). For example, since the width of the first hinge cover (2050) is wider than the width of the second hinge cover (2060), the second housing (2030) can be folded to face the rear side (2031) of the third housing (2030) based on the operation of the first hinge structure (2002) within the first hinge cover (2050).

[0257] According to one embodiment, the first reinforcing member can be aligned with at least one of the first hinge structure (2002) and the second hinge structure (2003). The first reinforcing member can face at least one of the first hinge structure (2002) and the second hinge structure (2003). For example, the first reinforcing member can include a plurality of first reinforcing members aligned with the first hinge structure (2002) and the second hinge structure (2003). For example, the first reinforcing member can include a plurality of first reinforcing members aligned with the fourth display area (2040d) and the fifth display area (2040e).

[0258] According to the above-described embodiment, the electronic device (2000) can provide a display (2010) that can be folded at least once by including a plurality of hinge structures (2002, 2003). Through the widths of the different hinge structures (2002, 2003), the display (2010) can be folded multiple times.

[0259] As described above, the electronic device (101) may include a display (260), a communication circuit (290), at least one processor (120) including a processing circuit, and a memory (130) storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain a message transmitted by an external electronic device (201) through the communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: obtain a visual object (411) representing the content of the message from a generative artificial intelligence (AI) model (220) and display the visual object in a designated area (310) of a screen displayed through the display to indicate that the message has been obtained.

[0260] The above-mentioned designated area may be located at the top of the screen of the display. The above-mentioned designated area may display at least one other visual object for indicating the status of the electronic device.

[0261] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, based on obtaining the message, replace the at least one other visual object (311) displayed in the designated area with the content of the message and the visual object. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the at least one other visual object together with the visual object in the designated area after a designated time after replacing the content of the message and the visual object.

[0262] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: enlarge the designated area in a designated direction based on obtaining the message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in the designated area enlarged in the designated direction. A size of the visual object displayed in the designated area enlarged in the designated direction may be greater than a size of the at least one other visual object displayed in the designated area before being enlarged in the designated direction.

[0263] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain a summary summarizing the content of the message from another generative AI model based on obtaining the message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the summary (510) instead of the content in a different area of ​​the screen of the display, distinct from the designated area. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in the designated area.

[0264] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display an icon (375) of an application associated with the message in the designated area. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: display the visual object at a location adjacent to the icon in the designated area, based on obtaining the message.

[0265] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, while displaying the visual object: display an application screen (601) of an application related to the message through the display in response to a first user input for the icon. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, when individually or collectively executed by the at least one processor, display a visual representation representing the content of the message through the display, positioned on the screen, in response to a second user input for the icon, distinct from the first user input.

[0266] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: obtain another message transmitted by another external electronic device through the communication circuitry while displaying the visual object. The other message may be related to the application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: obtain another visual object representing the content of the other message from the generative AI model based on obtaining the other message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the other visual object at another location that is at least partially different from the location and adjacent to the icon in the designated area.

[0267] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: obtain another message transmitted by another external electronic device through the communication circuitry while displaying the visual object. The other message may be related to the application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: obtain another visual object representing the content of the other message from the generative AI model based on obtaining the other message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to replace the visual object displayed at the location with the other visual object.

[0268] The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to display an icon of an application associated with the message in the designated area. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to: replace the icon displayed in the designated area with the visual object based on obtaining the message.

[0269] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: obtain a user input directed to the designated area while displaying the visual object in the designated area. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a user interface (801) on the screen for displaying a list of a plurality of visual objects displayed in the designated area, based on the user input directed to the designated area. The user interface may include a summary that summarizes the visual objects included in the list and the content of the message corresponding to the visual object.

[0270] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in the designated area in response to determining that the content of the message satisfies a designated condition based on obtaining the message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to forgo displaying the visual object in response to determining that the content of the message does not satisfy a designated condition.

[0271] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object of a first size based on obtaining the message: determining that the screen indicates a locked state of the electronic device; The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object of a second size different from the first size based on determining that the screen indicates an unlocked state of the electronic device.

[0272] As described above, the method can be performed by an electronic device including a display and a communication circuit. The method can include an operation of obtaining a message transmitted by an external electronic device through the communication circuit. The method can include an operation of obtaining a visual object representing the content of the message from a generative artificial intelligence (AI) model based on obtaining the message, and an operation of displaying the visual object in a designated area of ​​a screen displayed through the display to indicate that the message has been obtained.

[0273] The above-mentioned designated area may be located at the top of the screen of the display. The above-mentioned designated area may display at least one other visual object for indicating the status of the electronic device.

[0274] The method may include: obtaining a summary summarizing the content of the message from another generative AI model based on the message obtained. The method may include displaying the summary instead of the content in a different area of ​​the screen of the display, distinct from the designated area. The method may include displaying the visual object in the designated area.

[0275] The method may include an action of displaying an icon of an application related to the message in the designated area. The method may include an action of displaying the visual object in a location adjacent to the icon in the designated area based on obtaining the message.

[0276] The method may include an action of displaying an icon of an application related to the message in the designated area. The method may further include an action of replacing the icon displayed in the designated area with the visual object based on obtaining the message.

[0277] The method may include: an operation of obtaining a user input directed to the designated area while displaying the visual object in the designated area. The method may include an operation of displaying a user interface for displaying a list of a plurality of visual objects displayed in the designated area, such that the user interface is positioned on the screen based on the user input directed to the designated area. The user interface may include a summary that summarizes the visual objects included in the list and the content of the message corresponding to the visual object.

[0278] The method may include, based on obtaining the message: an action of displaying the visual object in the designated area in response to determining that the content of the message satisfies a designated condition. The method may include an action of forgoing displaying the visual object in response to determining that the content of the message does not satisfy a designated condition.

[0279] A non-transitory computer readable storage medium as described above may store a program including instructions. The instructions, when individually or collectively executed by at least one processor of an electronic device including a display (260) and a communication circuit (290), may cause the electronic device to obtain a message transmitted by an external electronic device (201) through the communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: obtain a visual object (411) representing the content of the message from a generative artificial intelligence (AI) model (220) and display the visual object in a designated area (310) of a screen displayed through the display to indicate that the message has been obtained.

[0280] As described above, the electronic device (101) may include a display (260), a communication circuit (290), at least one processor (120) including a processing circuit, and a memory (130) storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive a message transmitted by an external electronic device (201) via the communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain summary information using a machine learning model based on at least a portion of the message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the summary information in a first portion via the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate a visual object (411) representing the content of the summary information using the machine learning model. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in a second portion through the display.

[0281] The second portion may be positioned at the top of the screen of the display. The second portion may display at least one other visual object for indicating the status of the electronic device.

[0282] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object by replacing the at least one other visual object (311) displayed in the second portion with the visual object, based on at least a portion of the message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the at least one other visual object together with the visual object in the second portion after a specified time after replacing the visual object with the visual object.

[0283] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: enlarge the second portion in a specified direction based on at least a portion of the message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in the second portion enlarged in the specified direction. A size of the visual object displayed in the second portion enlarged in the specified direction may be greater than a size of the at least one other visual object displayed in the second portion before being enlarged in the specified direction.

[0284] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display an icon (375) of an application associated with the message in the second portion. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: display the visual object in the second portion at a location adjacent to the icon, based on at least a portion of the message.

[0285] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, while displaying the visual object: display an application screen (601) of an application related to the message through the display in response to a first user input for the icon. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, when individually or collectively executed by the at least one processor, display a visual representation representing the content of the message through the display, the visual representation being positioned on a screen distinct from the application screen, in response to a second user input for the icon, the visual representation being distinct from the first user input.

[0286] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device, while displaying the visual object, to: receive another message transmitted by another external electronic device via the communication circuitry, wherein the other message may be related to the application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device, based on at least a portion of the other message: to obtain another visual object representing the content of the other message from the machine learning model. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the other visual object at another location, at least in part different from the location, and adjacent to the icon in the second portion.

[0287] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: receive, through the communication circuitry, another message transmitted by another external electronic device while displaying the visual object. The other message may be related to the application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: obtain, from the machine learning model, another visual object representing the content of the other message based on at least a portion of the other message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the other visual object by replacing the visual object displayed at the location with the other visual object.

[0288] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display an icon of an application associated with the message in the second portion. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object by: replacing the icon displayed in the second portion with the visual object, based on at least a portion of the message.

[0289] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: receive a user input directed to the second portion while displaying the visual object in the second portion. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a user interface (801) on the display for displaying a list of a plurality of visual objects displayed in the second portion, based on at least a portion of the user input directed to the second portion. The user interface may include a summary that summarizes the visual objects included in the list and the content of the message corresponding to the visual object.

[0290] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in the second portion in response to determining that the content of the message satisfies a specified condition based on at least a portion of the message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to forgo displaying the visual object in response to determining that the content of the message does not satisfy a specified condition.

[0291] The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object of a first size based on at least a portion of the message: determining that the screen of the display indicates a locked state of the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object of a second size different from the first size based on determining that the screen indicates an unlocked state of the electronic device.

[0292] As described above, a method may be performed by an electronic device including a display and a communication circuit. The method may include receiving a message transmitted by an external electronic device through the communication circuit. The method may include: obtaining summary information based on at least a portion of the message using a machine learning model. The method may include displaying the summary information in a first portion through the display. The method may include generating a visual object (411) representing the content of the summary information using the machine learning model. The method may include displaying the visual object in a second portion through the display.

[0293] The second portion may be positioned at the top of the screen of the display. The second portion may display at least one other visual object for indicating the status of the electronic device.

[0294] The method may include an action of displaying the visual object by replacing the at least one other visual object (311) displayed in the second portion with the visual object, based on at least a portion of the message. The method may include an action of displaying the at least one other visual object together with the visual object in the second portion after a specified time period has elapsed since the replacement with the visual object.

[0295] The method may include: an action of enlarging the second portion in a specified direction based on at least a portion of the message. The method may include an action of displaying the visual object in the second portion enlarged in the specified direction. The size of the visual object displayed in the second portion enlarged in the specified direction may be larger than the size of at least one other visual object displayed in the second portion before being enlarged in the specified direction.

[0296] The method may include an action of displaying an icon (375) of an application related to the message in the second portion. The method may include an action of displaying the visual object in a location adjacent to the icon in the second portion, based on at least a portion of the message.

[0297] The method may include: receiving a user input directed to the second portion while displaying the visual object in the second portion. The method may include displaying a user interface (801) on the display so that the user interface displays a list of a plurality of visual objects displayed in the second portion, based on at least a portion of the user input directed to the second portion. The method may include an summary that summarizes the visual objects included in the list and the content of the message corresponding to the visual object.

[0298] The method may include: displaying the visual object in the second portion in response to determining that the content of the message satisfies a specified condition, based on at least a portion of the message. The method may include forgoing displaying the visual object in response to determining that the content of the message does not satisfy a specified condition.

[0299] A non-transitory computer readable storage medium as described above may store a program including instructions. The instructions, when individually or collectively executed by at least one processor of an electronic device including a display (260) and a communication circuit (290), may cause the electronic device to receive a message transmitted by an external electronic device (201) via the communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain summary information using a machine learning model based on at least a portion of the message. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the summary information in a first portion via the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate a visual object (411) representing the content of the summary information using the machine learning model. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in a second portion through the display.

[0300] As described above, the electronic device (101) may include a display (260), a communication circuit (290), at least one processor (120) including a processing circuit; and a memory (130) storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive a message transmitted by an external electronic device (201) via the communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display at least a portion of the message on a first portion via the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate a visual object (411) representing a summary of the message using a generative artificial intelligence (AI) model based on at least a portion of the message. The above instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in the second portion through the display.

[0301] As described above, the method can be performed by an electronic device including a display and a communication circuit. The method can include an operation of receiving a message transmitted by an external electronic device (201) through the communication circuit. The method can include an operation of displaying at least a portion of the message on a first portion through the display. The method can include an operation of generating a visual object (411) representing a summary of the message using a generative artificial intelligence (AI) model based on at least a portion of the message. The method can include, through the display,

[0302] A non-transitory computer readable storage medium as described above may store a program including instructions. The instructions, when individually or collectively executed by at least one processor of an electronic device including a display (260) and a communication circuit (290), may cause the electronic device to receive a message transmitted by an external electronic device (201) via the communication circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display at least a portion of the message on a first portion via the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate a visual object (411) representing a summary of the message using a generative artificial intelligence (AI) model based on at least a portion of the message. The above instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in the second portion through the display.

[0303] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0304] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0305] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0306] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0307] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0308] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device (101), Display (260), Communication circuit (290), At least one processor (120) comprising a processing circuit; and A memory (130) storing instructions and including one or more storage media, wherein the instructions, when individually or collectively executed by the at least one processor, the electronic device, Through the above communication circuit, a message transmitted by an external electronic device (201) is received, Based on at least a portion of the above message, a machine learning model is used to obtain summary information, Through the above display, the summary information is displayed in the first part, Using the above machine learning model, a visual object (411) representing the content of the summary information is created, Causing the visual object to be displayed in the second part through the above display, Electronic devices.

2. In claim 1, The second part is located at the top of the screen of the display, The second part, wherein at least one other visual object for indicating the status of the electronic device is displayed, Electronic devices.

3. In claim 1 or claim 2, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on at least part of the above message: By replacing the at least one other visual object (311) displayed in the second part with the visual object, the visual object is displayed, After a specified time after replacing the visual object with the visual object, causing the second part to display at least one other visual object together with the visual object. Electronic devices.

4. In any one of claims 1 to 3, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on at least part of the above message: Enlarge the above second part in the specified direction, Causing the visual object to be displayed in the second portion enlarged in the specified direction; The size of the visual object displayed in the second portion enlarged in the specified direction is larger than the size of at least one other visual object displayed in the second portion before being enlarged in the specified direction. Electronic devices.

5. In any one of claims 1 to 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Display the icon (375) of the application related to the above message in the second part, Based on at least part of the above message: Causing the visual object to be displayed at a location adjacent to the icon in the second part, Electronic devices.

6. In claim 5, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While displaying the above visual object: In response to a first user input for the above icon, display an application screen (601) of an application related to the message through the display, In response to a second user input for the icon, which is distinct from the first user input, a visual indication indicating the content of the message is caused to be displayed through the display on a screen distinct from the application screen. Electronic devices.

7. In claim 5, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While displaying the above visual object: Through the above communication circuit, another message transmitted by another external electronic device is received, wherein the other message is related to the application, Based on at least some of the other messages above: Obtaining another visual object representing the content of the other message from the above machine learning model, causing said other visual object to be displayed at a different location adjacent to said icon in said second part, at least in part different from said location; Electronic devices.

8. In claim 5, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While displaying the above visual object: Through the above communication circuit, another message transmitted by another external electronic device is received, wherein the other message is related to the application, Based on at least some of the other messages above: Obtaining another visual object representing the content of the other message from the above machine learning model, By replacing the visual object displayed at the above location with another visual object, causing the other visual object to be displayed, Electronic devices.

9. In any one of claims 1 to 8, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Display the icon of the application related to the above message in the second part, Based on at least part of the above message: By replacing the icon displayed in the second part with the visual object, causing the visual object to be displayed, Electronic devices.

10. In any one of claims 1 to 9, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While displaying the visual object in the second part above: Receiving user input directed to the second part, Causing a user interface (801) to be positioned on the display to display a list of a plurality of visual objects displayed in the second portion based on at least a portion of the user input directed to the second portion, The user interface includes a summary that summarizes the visual objects included in the list and the contents of the message corresponding to the visual objects. Electronic devices.

11. In any one of claims 1 to 10, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on at least part of the above message: In response to determining that the content of the above message satisfies the specified condition, display the visual object in the second part, In response to determining that the content of the above message does not satisfy the specified condition, causing the display of the visual object to be forgo, Electronic devices.

12. In any one of claims 1 to 12, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on at least part of the above message: Displaying the visual object of the first size based on the screen of the display being determined to indicate a locked state of the electronic device; Causing the display of the visual object of a second size different from the first size, based on the determination that the screen indicates an unlocked state of the electronic device; Electronic devices.

13. A method for an electronic device including a display and a communication circuit, An operation of receiving a message transmitted by an external electronic device through the above communication circuit, and Based on at least part of the above message: An action of obtaining summary information using a machine learning model based on at least a portion of the above message; An action of displaying the summary information in the first part through the above display, An operation of generating a visual object (411) representing the contents of the summary information using the machine learning model, and Through the above display, including an action of displaying the visual object in the second part; method.

14. In claim 13, The second part is located at the top of the screen of the display, The second part, wherein at least one other visual object for indicating the status of the electronic device is displayed, method.

15. In claim 13 or claim 14, Based on at least part of the above message: An operation of displaying the visual object by replacing at least one other visual object (311) displayed in the second part with the visual object, and After a specified time after replacing the visual object with the above, an action is included to display the at least one other visual object together with the visual object in the second part. method.

Images