Electronic device, method, and non-transitory computer-readable storage medium for providing a summary of content

Abstract

This electronic device may identify first information associated with a first application and second information associated with a second application from among a plurality of applications, at least based on determining that time information of the electronic device corresponds to a designated time. Each of the first information and the second information may be obtained during a designated period corresponding to the time information. The electronic device may generate, through a machine learning model, first content including a first image and a first text by using the first information, and second content including a second image and a second text by using the second information. The electronic device may determine priority of the first content and the second content on the basis of the time information. The electronic device may simultaneously display the first content and the second content through a touchscreen display on the basis of the priority.

Description

Electronic device, method, and non-transient computer-readable storage medium for providing a summary of content

[0001] The present disclosure relates to an electronic device, a method, and a non-transient computer-readable storage medium for providing a summary of content.

[0002] Based on natural language processing (NLP) technology, electronic devices are being developed that use artificial intelligence to understand or / or respond to human language activities. Electronic devices based on NLP technology can output natural language sentence(s) that are understandable to humans. Electronic devices based on NLP technology can process human utterances (e.g., speech containing natural language sentence(s)) and / or text inputs (e.g., text containing natural language sentence(s)) to execute function(s) that correspond to human intent.

[0003] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. None of the foregoing shall be claimed as prior art related to the present disclosure, nor shall it be used to determine prior art.

[0004] According to one embodiment, an electronic device may include a touchscreen display, a memory comprising one or more storage media for storing instructions, and at least one processor comprising a processing circuit. The at least one processor may be configured to cause the electronic device to identify first information of a first application and second information of a second application among a plurality of applications, at least based on the electronic device determining that time information of the electronic device corresponds to a specified time. Each of the first information and the second information may be acquired during a specified period corresponding to the time information. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause, through a machine learning model, to determine a first content including a first image and a first text using the first information, and a second content including a second image and a second text using the second information. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first content and the second content to determine the priority based on the time information. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the first content and the second content to be displayed simultaneously through the touchscreen display based on the priority.

[0005] According to one embodiment, an electronic device may include a display, a memory comprising one or more storage media for storing instructions, and at least one processor comprising a processing circuit. The instructions may cause the electronic device to identify messages generated based on the execution of software applications when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to determine priorities corresponding to each of the messages when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to obtain text expressing a summary of at least one of the messages using the determined priorities when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to display visual objects each containing the messages arranged according to the determined priorities, together with the obtained text when executed individually or collectively by the at least one processor.

[0006] In one embodiment, a method of an electronic device including a touchscreen display may be provided. The method may include an operation of identifying first information of a first application and second information of a second application among a plurality of applications, at least based on determining that time information of the electronic device corresponds to a specified time. Each of the first information and the second information may be acquired during a specified period corresponding to the time information. The method may include an operation of generating, through a machine learning model, a first content including a first image and a first text using the first information, and a second content including a second image and a second text using the second information. The method may include an operation of determining the priority of the first content and the second content based on the time information. The method may include an operation of simultaneously displaying the first content and the second content through the touchscreen display based on the priority.

[0007] In one embodiment, a non-transient computer-readable storage medium for storing instructions may be provided. The instructions may cause the electronic device, when executed by an electronic device including a display, to identify messages generated based on the execution of software applications. The instructions may cause the electronic device, when executed by the electronic device, to determine priorities corresponding to each of the messages. The instructions may cause the electronic device, when executed by the electronic device, to obtain text expressing a summary of at least one of the messages using the determined priorities. The instructions may cause the electronic device, when executed by the electronic device, to display visual objects each containing the messages arranged according to the determined priorities, together with the obtained text.

[0008] According to one embodiment, an electronic device may include a display, a memory comprising one or more storage media for storing instructions, and at least one processor comprising a processing circuit. The instructions may cause the electronic device to identify at least one cluster of a plurality of images when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to identify a first portion of images having a time difference exceeding a reference time difference among the plurality of images included in the cluster, based on identifying a cluster of a plurality of images when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to identify a second portion of images included in the first portion by using the timings of the images of the first portion when executed individually or collectively by the at least one processor. The instructions may cause the electronic device to obtain text expressing a summary of the images of the second portion when executed individually or collectively by the at least one processor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the acquired text to be displayed in relation to the cluster.

[0009] According to one embodiment, an electronic device may include a touchscreen display, a memory comprising one or more storage media for storing instructions, and at least one processor comprising a processing circuit. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to identify time information and location information of the electronic device. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to identify a first content and a second content among a plurality of contents acquired within a specified period based on the first metadata of the first content and the second metadata of the second content, depending on the identification of the time information and the location information satisfying a specified condition. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause text information to be generated through a machine learning model stored in memory, based at least on the first content, the second content, the first metadata, and the second metadata. The machine learning model may be trained to generate the text information based on at least one content including an image, video, text, sound, or drawing. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause at least a portion of the first content and the second content to be displayed on a first portion through the touchscreen display, and text corresponding to the generated text information to be displayed on a second portion different from the first portion.

[0010] In one embodiment, a method of an electronic device including a display may be provided. The method may include an operation of identifying at least one cluster of a plurality of images. Based on identifying a cluster of a plurality of images, the method may include an operation of identifying a first portion of images having a time difference exceeding a reference time difference among the plurality of images included in the cluster. The method may include an operation of identifying a second portion of images included in the first portion using the timings of the images of the first portion. The method may include an operation of obtaining text expressing a summary of the images of the second portion. The method may include an operation of displaying the obtained text in relation to the cluster.

[0011] In one embodiment, a non-transient computer-readable storage medium for storing instructions may be provided. The instructions may cause the electronic device, when executed by an electronic device including a touchscreen display, to identify time information and location information of the electronic device. The instructions may cause the electronic device, when executed by the electronic device, to identify a first content and a second content among a plurality of contents acquired within a specified period based on the first metadata of the first content and the second metadata of the second content, at least based on determining that the time information and the location information correspond to a specified condition. The instructions may cause the electronic device, when executed by the electronic device, to generate text information through a machine learning model based at least on the first content, the second content, the first metadata, and the second metadata. The machine learning model may be trained to generate the text information based on at least one content including an image, video, text, sound, or drawing. When the instructions are executed by the electronic device, the electronic device may cause the device to display at least a portion of the first content and the second content in a first portion and display text corresponding to the text information in a second portion different from the first portion through the touchscreen display.

[0012] According to one embodiment, an electronic device may include a display, a memory comprising one or more storage media for storing instructions, and at least one processor comprising a processing circuit. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause to identify a first text expressing a summary of at least one content. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause to generate a second text having a length shorter than a reference length of a widget object based on the first text. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause to display a widget object containing the second text on a home screen through the display. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause to determine a reference time length for maintaining the display of the widget object containing the second text, based on the priority of the at least one content and the number of accesses to the at least one content while displaying the widget object containing the second text. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause to identify the time length for displaying the widget object containing the second text. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause to change the text within the widget object from the second text to the third text, at least based on determining that the time length is longer than the reference time length.

[0013] In one embodiment, a method of an electronic device including a display may be provided. The method may include an action of identifying a first text that expresses a summary of at least one content. The method may include an action of generating a second text having a length shorter than a reference length of a widget object based on the first text. The method may include an action of displaying a widget object containing the second text on a home screen through the display. The method may include an action of determining a reference time length for maintaining the display of the widget object containing the second text based on the priority of the at least one content and the number of accesses to the at least one content while displaying the widget object containing the second text. The method may include an action of identifying a time length for displaying the widget object containing the second text. The method may include an action of changing text within the widget object from the second text to a third text based at least on determining that the time length is longer than the reference time length.

[0014] According to one embodiment, an electronic device may include a display, a memory comprising one or more storage media for storing instructions, and at least one processor comprising a processing circuit. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to identify a first text expressing a summary of at least one first content. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to obtain a second text from the first text having a length shorter than the reference length of a widget object. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the obtained second text to be displayed within the widget object based on displaying a home screen containing the widget object. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the second content to identify a priority based on identifying the second content while displaying the acquired second text. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the text within the widget object to change from the second text to a third text expressing a summary of the second content, based on identifying the priority of the second content that is higher than the priority of the at least one first content.

[0015] The aforementioned and other aspects, features, and advantages of some embodiments of the present disclosure will become more apparent from the following detailed description, which is discussed together with the accompanying drawings:

[0016] FIG. 1 is a diagram illustrating exemplary states of an electronic device according to various embodiments;

[0017] FIG. 2 is a block diagram illustrating an exemplary configuration of an electronic device according to various embodiments;

[0018] FIGS. 3a, 3b, 3c, and 3d are block diagrams illustrating exemplary operations performed by an electronic device to process content provided by a software application;

[0019] FIGS. 4a, 4b, 4c, 4d, 4e, and 4f include diagrams and flowcharts illustrating exemplary operations of an electronic device according to various embodiments;

[0020] FIG. 5 is a signal flow diagram illustrating exemplary operations of an electronic device according to various embodiments;

[0021] FIG. 6 is a diagram illustrating an example of a document object generated based on the execution of a software application of an electronic device according to various embodiments;

[0022] FIG. 7 is a diagram illustrating an exemplary screen displayed by an electronic device to obtain context information related to a user according to various embodiments;

[0023] FIG. 8 is a diagram illustrating an exemplary briefing screen displayed by an electronic device according to various embodiments;

[0024] FIG. 9 is a diagram illustrating an exemplary operation of an electronic device that displays a widget object connected to a briefing screen through a lock screen;

[0025] FIG. 10 is a diagram illustrating exemplary states of an electronic device for acquiring feedback data regarding contents included in a briefing screen;

[0026] FIGS. 11a, FIGS. 11b, and FIGS. 11c are diagrams illustrating exemplary states of a briefing screen displayed by an electronic device according to various embodiments;

[0027] FIGS. 12a and 12b are diagrams illustrating exemplary operations of an electronic device for generating a layout of content and / or widget objects to be displayed on a briefing screen using document objects provided by a software application according to various embodiments;

[0028] FIGS. 13a and 13b are diagrams illustrating exemplary states of a multi-foldable electronic device displaying a briefing screen according to various embodiments;

[0029] FIG. 14 is a diagram illustrating an exemplary briefing screen displayed by an electronic device having the form factor of a tablet PC (personal computer) according to various embodiments;

[0030] FIG. 15 is a diagram illustrating exemplary states of an electronic device for displaying summary content for user-generated content (e.g., images and / or videos) according to various embodiments;

[0031] FIG. 16 is a diagram illustrating an exemplary state of an electronic device displaying a briefing screen according to various embodiments;

[0032] FIG. 17 is a block diagram illustrating an exemplary configuration of an electronic device according to various embodiments;

[0033] FIG. 18 is a flowchart illustrating exemplary operations of an electronic device according to various embodiments;

[0034] FIG. 19 is a flowchart illustrating exemplary operations of an electronic device according to various embodiments;

[0035] FIG. 20 is a flowchart illustrating exemplary operations of an electronic device according to various embodiments;

[0036] FIG. 21 is a diagram illustrating the exemplary operation of an electronic device for determining the weights of each of a plurality of images according to various embodiments;

[0037] FIG. 22 is a diagram illustrating an exemplary operation of an electronic device that generates briefing content using images included in a cluster, according to various embodiments;

[0038] FIGS. 23a and 23b are diagrams illustrating exemplary layouts of images included in briefing content according to various embodiments;

[0039] FIG. 24 is a diagram illustrating exemplary states of an electronic device for displaying briefing content according to various embodiments;

[0040] FIG. 25 is a diagram illustrating exemplary states of an electronic device for editing briefing content according to various embodiments;

[0041] FIG. 26 is a diagram illustrating exemplary states of an electronic device displaying briefing content in landscape mode according to various embodiments;

[0042] FIG. 27 is a diagram illustrating the operation of an electronic device that displays a widget object based on the content of a briefing screen according to various embodiments;

[0043] FIG. 28 is a flowchart illustrating exemplary operations of an electronic device according to various embodiments;

[0044] FIG. 29 is a diagram illustrating the operation of an electronic device displaying a widget object according to various embodiments;

[0045] FIGS. 30a and 30b are diagrams illustrating exemplary operation of an electronic device displaying a widget object having a variable size according to various embodiments;

[0046] FIGS. 31a and 31b are diagrams illustrating exemplary states of a multi-foldable electronic device displaying a widget object according to various embodiments;

[0047] FIG. 32 is a diagram illustrating exemplary states of a rollable electronic device displaying a widget object according to various embodiments;

[0048] FIG. 33 is a diagram illustrating widget objects displayed on the home screen and the lock screen, respectively, by an electronic device according to various embodiments;

[0049] FIG. 34 is a diagram illustrating the operation of an electronic device and / or an external electronic device that displays a visual object linked to a widget object according to various embodiments;

[0050] FIG. 35 is a diagram illustrating an example of an electronic device in a network environment according to various embodiments; and

[0051] FIG. 36 is a diagram illustrating an exemplary configuration of an exemplary AI system according to various embodiments.

[0052] Hereinafter, various embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings.

[0053] The various embodiments of the present disclosure and the terms used therein are not intended to limit the technology described in the present disclosure to specific embodiments and should be understood to include various modifications, equivalents, and / or substitutions. In connection with the description of the drawings, similar reference numerals may be used for similar components. A singular expression may include a plural expression unless the context clearly indicates otherwise. In the present disclosure, expressions such as “A or B,” “at least one of A and / or B,” “A, B or C,” or “at least one of A, B and / or C” may include all possible combinations of items listed together. Expressions such as “first,” “second,” “first,” or “second” may modify the components, regardless of order or importance, and are used to distinguish one component from another without limiting the components. When it is mentioned that a certain (e.g., 1st) component is “(functionally or telecommunicationally) connected” or “connected” to another (e.g., 2nd) component, said certain component may be directly connected to said other component or connected through another component (e.g., 3rd component).

[0054] FIG. 1 is a diagram illustrating exemplary states (191, 192, 193, 194) of an electronic device (101) according to various embodiments. The electronic device (101) of the present disclosure may be referred to as a mobile device, user equipment (UE) (or user terminal), multifunction device, portable communication device, and / or portable device. Exemplary hardware component(s) included in the electronic device (101) are described in more detail below with reference to FIG. 2, FIG. 17, and / or FIG. 35.

[0055] According to one embodiment, an electronic device (101) may display or visualize content stored in the electronic device (101) (e.g., content generated and / or stored by a software application executed by the electronic device (101)). The electronic device (101) may provide a summary (summarization or summary) of the content(s) stored in the electronic device (101). The terms “summarization” and “summary” may be used interchangeably herein. The summary may include insights (e.g., text for summarization, description, and / or suggestion) regarding the content stored in the electronic device (101). The summary of the content provided by the electronic device (101) may be generated based on personalized data (e.g., user’s interests and / or feedback) of the user of the electronic device (101) (e.g., user who owns the electronic device (101)). The present disclosure may include a description of an electronic device (101), a method, and / or a non-transient computer-readable storage medium for providing insights into stored content (e.g., a summary, description, and / or suggestion of said content).

[0056] Referring to FIG. 1, exemplary states (191, 192, 193, 194) of an electronic device (101) that provides various contents through a display (110) are illustrated. State (191) may be an exemplary state of the electronic device (101) that displays a lock screen. State (192) may be an exemplary state of the electronic device (101) that displays a home screen (or launcher screen). State (193) may be an exemplary state of the electronic device (101) that displays a screen based on the execution of a specific software application (e.g., a web browser). State (194) may be an exemplary state of the electronic device (101) that displays a screen including contents provided from software applications, such as a web browser, and a summary of said contents. A state (194) may be an exemplary state of an electronic device (101) that displays a screen including the above contents and content generated using the above contents (e.g., AI-generated content). In the present disclosure, the screen displayed in state (194) may be referred to as a briefing screen in terms of briefing the contents. In the present disclosure, the screen displayed in state (194) may be referred to as a smart suggestion screen.

[0057] Referring to state (194) of FIG. 1, the electronic device (101) may display content arranged (or curated) based on personalized data and / or context (e.g., current time, location, and / or user's current state). The screen displayed through the display (110) in state (194) may include content arranged based on artificial intelligence. In terms of displaying content arranged based on artificial intelligence, the screen displayed in state (194) may be referred to as an AI space.

[0058] Referring to the state (194) of FIG. 1, the electronic device (101) may display card objects (151, 152, 153, 154) corresponding to content provided by various software applications. In this disclosure, the term “card object” may be used interchangeably with terms such as “content object,” “document content,” “document object,” “document,” and / or “card.” In some descriptions, a card object may be referred to as a visual object. Referring to FIG. 1, an exemplary state (194) is shown that displays a briefing screen including a card object (151) provided by a software application providing weather-related information (e.g., a weather application), a card object (152) provided by a software application for coupons and / or shopping, and a card object (153) provided by a software application for managing schedule information (e.g., a calendar application).

[0059] As shown in the state (194) of FIG. 1, by displaying a briefing screen in which content provided from multiple software applications is aggregated, the electronic device (101) can collectively provide the user with information derived from different sources (e.g., the multiple software applications). In an exemplary state (194) in which card objects (151, 152, 153, 154) are arranged along the vertical direction (155) of the display (110), the electronic device (101) can move or scroll the card objects (151, 152, 153, 154) (collectively) based on a touch gesture (or touch input) performed on the display (110) along the vertical direction (155) (e.g., a drag gesture and / or swipe gesture performed on the display (110) along the vertical direction (155). For example, if the size of the display area (or active area) of the display (110) is insufficient to display content such as card objects (151, 152, 153, 154), the electronic device (101) may support or assist in navigating the content based on scrolling. According to one embodiment, the electronic device (101) may (dynamically) determine and / or change the order of the card objects (151, 152, 153, 154) displayed on the display (110) to display content suitable for the user before other content. For example, the electronic device (101) may display content suitable for the user's situation, inferred based on location and / or time, over other content.An exemplary operation of an electronic device (101) for displaying a briefing screen using content generated from multiple software applications and / or an exemplary operation of an electronic device (101) for determining the order of said content (e.g., the order of card objects (151, 152, 153, 154) within the briefing screen) is described in more detail below with reference to FIGS. 2 through 8.

[0060] Referring to the state (194) of FIG. 1, the electronic device (101) may display text (e.g., texts (141, 142, 143)) expressing a summary of said content, along with card objects (151, 152, 153, 154) each containing said content obtained from a plurality of software applications. For example, as with texts (141, 142), the electronic device (101) may display a greeting based on said content and / or state (e.g., state of the electronic device (101) and / or user).

[0061] For example, text (141) may be (arbitrarily) selected from predefined texts based on an event, context, and / or time. The predefined texts may include “Time is running out!”, “Don’t miss it!”, “It’s time to leave!”, “Have a good night”, and / or “Keep up the good work this afternoon.” If the electronic device (101) identifies an event valid at the current time (e.g., an event related to a travel schedule and / or movement schedule), it may display text (141) containing a message related to said event regardless of context and time. If the electronic device (101) does not identify an event valid at the current time, it may display text (141) containing a message based on the user’s context (e.g., location, and / or user’s condition). If neither the event nor the context is identified, the electronic device (101) may display text (141) containing a message based on the current time.

[0062] For example, text (142) may be referred to as a main insight message. The electronic device (101) may display text (142) expressing a summary of important content among the content, along with card objects (151, 152, 153, 154) corresponding to different content. The electronic device (101) may group the content according to the number of content items. The electronic device (101) may generate a summary for each of the grouped content items. For example, the electronic device (101) that identifies content related to a golf schedule (e.g., reminder notifications, SMS messages, and / or schedules) may display text (142) expressing a summary of the content (e.g., “You had a productive day today! You have a golf schedule tomorrow morning, so you should check your alarm and get some good rest.”).

[0063] For example, in an exemplary state (194) in which a briefing screen is displayed in the morning, the electronic device (101) may display text (142) containing a greeting related to the morning (e.g., “Start a lively day.”). Referring to FIG. 1, the electronic device (101) may display text (143) expressing a description and / or summary of at least one of the card objects (151, 152, 153, 154). The description and / or summary included in the text (143) may relate to the priorities of the card objects (151, 152, 153, 154) and / or the order of display within the briefing screen. For example, text (143) may include a summary of the two card objects (151, 152) positioned at the top of the display (110) (e.g., “Today’s temperature is 20°C. Cloudy weather is expected. Please be sure to use the coffee coupon expiring tomorrow after the afternoon meeting!”). To provide insights to a user viewing a briefing screen containing card objects (151, 152, 153, 154), the electronic device (101) may display texts (141, 142, 143).

[0064] Referring to FIG. 1, states (191, 192, 193) of an electronic device (101) that are different from a state (194) that displays a briefing screen are illustrated. In the state (191) that displays a lock screen, the electronic device (101) may display a widget object (111) referred to as the Now Bar. The lock screen may include a screen displayed prior to user authentication (e.g., authentication based on a password, PIN (personal identification number), unlock pattern, fingerprint, iris, face, and / or voice). The state of the electronic device (101) that displays the lock screen may be referred to as the lock state. An embodiment is illustrated in which the widget object (111) is displayed along with shortcut icons (e.g., icons (112, 113)) associated with functions allowed in the lock state (e.g., emergency call function and / or camera function), but the position of the widget object (111) within the lock screen is not limited thereto. The widget object (111) can be placed on the lock screen as well as on the AOD (always on display) screen.

[0065] Referring to FIG. 1, in a state (192) of displaying a home screen, the electronic device (101) may display a widget object (121). In the present disclosure, the widget objects (111, 121) may be referred to as a Now Bar, a Now Brief widget, and / or a Now widget. The home screen may include widget objects (122, 123) provided from each of the software applications as well as the widget object (121). The home screen may include an icon (124) corresponding to the software application. The home screen may be displayed based on user authentication performed on the lock screen. The home screen may be referred to as a launcher screen.

[0066] Referring to FIG. 1, in a state (193) in which a specific software application (e.g., a web browser) is running, the electronic device (101) may display a screen (e.g., a web browser screen) provided by said specific software application. While displaying the screen provided by said specific software application, the electronic device (101) may (continue) display a navigation bar (125). In state (193), the electronic device (101) may display a pop-up menu referred to as an edge panel (130) based on a touch input performed at a portion adjacent to the edge of the display (110). For example, the electronic device (101) may display the edge panel (130) based on a drag gesture performed along the horizontal direction of the display (110) starting at a position adjacent to the right edge of the display (110). The edge panel (130) may include icons (131, 132) for executing at least one of a plurality of software applications installed on the electronic device (101). The edge panel (130) may include options (133, 134) for editing software application(s) registered in the edge panel (130) (e.g., registered to display icons within the edge panel (130)).

[0067] As with the states (192, 193) of FIG. 1, the state of the electronic device (101) for which user authentication has been completed may be referred to as the unlocked state. In the unlocked state, the electronic device (101) may display icons (e.g., recent apps button, home button, and / or back button) for switching screens displayed on the display (110) on a part of the display (110) referred to as the navigation bar (125).

[0068] In the states (191, 192, 193) of FIG. 1, the electronic device (101) may identify or receive user input for displaying a briefing screen. For example, based on user input (e.g., a tap gesture of tapping the display (110)) for selecting a widget object (111), a widget object (121), and / or an icon (131) within the edge panel (130), the electronic device (101) may switch to a state (194) for displaying a briefing screen. For example, based on receiving user input related to a widget object (111), the electronic device (101) may perform authentication for the user of the electronic device (101). Based on the above authentication, the electronic device (101) may switch to a state (194) that displays a briefing screen (e.g., a briefing screen including texts (141, 142, 143), and card objects (151, 152, 153, 154). The present disclosure is not limited thereto, and the electronic device (101) may switch to the state (194) without the above authentication based on user input related to a widget object (111).

[0069] According to one embodiment, an electronic device (101) may display text related to content(s) to be displayed through the briefing screen on a widget object linked to the briefing screen, such as widget objects (111, 121). Referring to FIG. 1, in an exemplary state (191) in which a widget object (111) is displayed in the morning, the electronic device (101) may display text related to the morning time (e.g., “Morning Briefing”) within the widget object (111). Referring to FIG. 1, in an exemplary state (192) in which a widget object (121) is displayed in the morning, the electronic device (101) may display a greeting based on the current time (e.g., “Good morning.”) within the widget object (121). The text included in the widget objects (111, 121) may include content related to text generated to be displayed on the briefing screen (e.g., texts (141, 142, 143)). An exemplary operation of an electronic device (101) that generates text contained in a widget object (e.g., widget objects (111, 121)) linked to a briefing screen is described in more detail below with reference to FIG. 9.

[0070] As described above, according to one embodiment, an electronic device (101) may display to a user contents stored in the electronic device (101) (e.g., contents related to card objects (151, 152, 153, 154)) in an order based on priority. Before displaying a briefing screen containing the contents (e.g., a screen displayed within a state (194)), the electronic device (101) may display a summary of the contents and / or an insight message (or insight text) based on the contents using a widget object (e.g., widget objects (111, 121)). For example, before displaying a briefing screen containing the contents, the electronic device (101) may prioritize displaying to the user, among the contents, content important to the user through the widget object. In the above example, the electronic device (101) may display text through a widget object to guide and / or recommend user actions related to the content. To infer content important to the user, the electronic device (101) may include hardware and / or software for processing content obtained from software applications.

[0071] Below, with reference to FIG. 2, hardware and / or software included in the electronic device (101) for managing content will be described in more detail.

[0072] FIG. 2 is a block diagram illustrating an exemplary configuration of an electronic device (101) according to various embodiments. The electronic device (101) of FIG. 2 may include the electronic device (101) of FIG. 1. The electronic device (101) may have a form factor of a bar-type smartphone (291), as well as a laptop PC (personal computer) (294), a foldable-type smartphone (292), a sliderable (or rollable)-type smartphone, a head-mounted display (HMD) device (293) (or head-wearable electronic device), a watch, an electronic control unit (ECU) in a vehicle (e.g., an electric vehicle, EV), a tablet PC, and / or other suitable computing device (e.g., a desktop PC).

[0073] Referring to FIG. 2, the electronic device (101) may include a processor (210), a memory (220), and / or a display (110). The processor (210) may be electrically and / or operatively coupled to the memory (220) and / or the display (110). Electrical coupling of the electronic components may include a state in which a wired signal path (or a connection for wireless communication) for transmitting a signal is established between the electronic components. Operatory coupling of the electronic components may include a state in which the electronic components are directly coupled (or indirectly coupled) so that one of the electronic components controls another electronic component. Referring to FIG. 2, an electrical connection between the processor (210), the memory (220), and the display (110), based on the electronic components and referred to as a communication bus (202), is schematically illustrated. Through the communication bus (202), the processor (210), memory (220), and display (110) can be communicated together.

[0074] Referring to FIG. 2, the processor (210) of the electronic device (101) may include circuits (e.g., processing circuits and / or cores) for performing operations on data (e.g., arithmetic operations and / or logical operations). A binary code (e.g., instructions) representing said operations may be input to the processor (210). The processor (210) may include a central processing unit (CPU), a graphic processing unit (GPU), and / or a neural processing unit (NPU). The processor (210) may be referred to as an application processor (AP) and / or a system on a chip (SoC). The processor (210) may have a structure for loading (or fetching) and / or executing multiple instructions simultaneously (e.g., a multi-core structure based on a combination of multiple core circuits such as a dual core, quad core, hexa core, or octa core). In an electronic device (101) comprising at least one processor (210), the at least one processor (210) may perform the operations of the present disclosure individually or collectively. For example, the at least one processor (210) may perform the operations of FIGS. 4a and 4b individually and / or collectively by executing instructions stored in memory (220). Accordingly, the processor (210) may include various processing circuits and / or a plurality of processors. For example, as used herein, the term “processor” or “model” (e.g., machine learning model) comprising the claims may include various processing circuits comprising at least one processor, and one or more of the at least one processor may be configured to perform the various functions described herein individually and / or collectively in a distributed manner.As used herein, where “processor,” “at least one processor,” “model,” “at least one model,” “machine learning model,” and “one or more processors” are described as being configured to perform many functions, these terms cover, by example but not limitingly, situations where one processor and / or model performs some of the mentioned functions and other processor(s) and / or model(s) perform the remainder of the mentioned functions, and also situations where one processor and / or model can perform all of the mentioned functions. Additionally, at least one processor may include a combination of processors performing the various mentioned / disclosed functions, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform the various functions. Similarly, at least one model may include a combination of processors and / or processing circuits performing the various mentioned / disclosed functions, for example, in a distributed manner. At least one processor and / or model may execute programs to achieve or perform the various functions.

[0075] The memory (220) of FIG. 2 may include a circuit for storing data (or instructions) that are input to or output from the processor (210). The memory (220) may include volatile memory, such as random-access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM). Non-volatile memory may be referred to as storage. Volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). Non-volatile memory may include, for example, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disk, solid state drive (SSD), and embedded multimedia card (eMMC). The memory (220) may include one or more storage media (e.g., the volatile memory and / or non-volatile memory described above) distributedly located in the electronic device (101). The processor (210) of the electronic device (101) may execute instructions in the memory (220) within the electronic device (101) to perform functions and / or operations (e.g., the operations of FIG. 4a and / or FIG. 4b) indicated by said instructions.

[0076] A display (110) of an electronic device (101) may include a circuit for visualizing information provided from a processor (210). The display (110) may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or light emitting diodes (LEDs). The LEDs may include organic LEDs (OLEDs). The present disclosure is not limited thereto, and the display (110) may include electronic paper. A display area (or active area) of the display (110) may include a light-emitting area formed by pixels (e.g., active pixels) of the display (110). The display (110) may include a sensor (e.g., a touch sensor) for detecting an external object (e.g., a user's finger) on the display (110). The sensor may be included in the display (110) in the form of a panel (e.g., a touch sensor panel). The display (110) including the above sensor may be referred to as a touchscreen display.

[0077] In one embodiment, software applications (240) may be installed on an electronic device (101). The state in which the software applications are installed on the electronic device (101) may include a state in which information for operating the software applications (e.g., instructions and / or resources for executing said instructions) is stored in memory (220). Referring to FIG. 2, non-limiting examples of software applications (240) installed on the electronic device (101) include a calendar application (241), a messenger (e.g., instant message) application (242), a weather application (243), and / or a shopping application (244). The present disclosure is not limited thereto, and software applications (240) may include a my file application for managing files stored in memory (220), a web browser application, a routine application for task automation, a smart things application for executing functions related to IoT (internet of things) devices, a reminder application for notifications, a gallery application for managing images and / or videos stored in memory (220), a wallet application for digital payments, and / or a health application for managing health information.

[0078] In one embodiment, software applications (240) may be configured to register and / or store content (e.g., content representing each of the card objects (151, 152, 153, 154) of FIG. 1) in a document database (250). A processor (210) may execute at least one of the software applications (240) to register or store content in the document database (250). The document database (250) may be a database for managing content having a format based on a document schema (230) (or document data structure or document format). In the present disclosure, the database may include a combination of program(s) for supporting functions related to organized information (e.g., adding, deleting, changing, and / or searching) and hardware for executing said program (e.g., a processor (210) and / or memory (220)). The document schema (230) is information for defining information (e.g., fields, variables, attributes, and / or parameters) included in the content, and may indicate that content including information such as Table 1 can be stored in the document DB (250).

[0079] Variable Name (or Attribute Name) Description ID An identifier and / or index uniquely assigned to each of the contents included in the document DB (250) name Name of the content deviceIcon Icon of the device corresponding to the content deviceName Name of the device corresponding to the content deviceNumber Number of activated devices corresponding to the content cardArctColor Color of the card object corresponding to the content cardFontColor Color of the text of the card object corresponding to the content title Title text of the card object corresponding to the content insightMessageTitle Title of the insight text to be displayed with the content insightMessageDescription Description of the insight text displayed with the content creationTimestampMillis Timestamp indicating the time the content was created (unit: milliseconds) documentTtlMills Validity period of the content (unit: milliseconds) ImportantTimeFrames Importance of the content ImportantContexts Contexts corresponding to the content (The value of the corresponding variable is the context information of the electronic device (101) to be described later (Can be compared and used to determine the importance of the content) ValidTimeFrames Time intervals in which the content will be displayed ValidContexts Contexts in which the content is valid (the value of the corresponding variable can be compared with context information of the electronic device (101), which will be described later, to determine whether the content will be displayed) StartTimeMillis Start time of the content EndTimeMillis End time of the content DailyTime Time zone for the start time and / or end time of the content (e.g., early morning, morning, lunch, afternoon, evening, night, late night)

[0080] When content provided by at least one of the software applications (240) is stored in the document DB (250), the processor (210) can execute the smart suggestion application (260). For example, instructions of the smart suggestion application (260) can be connected to the document DB (250) as a callback function. The processor (210) that has stored the content in the document DB (250) can execute the instructions of the smart suggestion application (260) defined as the callback function.

[0081] A smart suggestion application (260) may be installed on an electronic device (101) to display a briefing screen of FIG. 1 (e.g., a screen displayed via a display (110) in the state (194) of FIG. 1) and / or widget objects (e.g., widget objects (111, 121) of FIG. 1). The smart suggestion application (260) may be executed to generate a personalized screen (e.g., the briefing screen shown in FIG. 1) based on the context (e.g., time, location, and / or behavior) of the user of the electronic device (101). To execute the personalized screen, the smart suggestion application (260) may be configured to utilize a document DB (250) and / or a language model (255). Referring to FIG. 2, the functions of the smart suggestion application (260) may be illustrated in blocks. The functions of the smart suggestion application (260) are not limited to the functions illustrated in the blocks of FIG. 2. The smart suggestion application (260) can be referred to as a briefing application (e.g., Now Brief application) in terms of providing a briefing screen.

[0082] The smart suggestion application (260) may include an AI suggester (270) for determining the priorities of the contents and / or generating text expressing a summary of the contents. The AI ​​suggester (270) may include at least one of a UI generator (272) for creating a briefing screen and / or widget object, a rank determiner (274) for determining the priorities of the contents, a feedback DB (276) for storing feedback data for the contents, and / or a document generator (278) for creating and / or registering the contents in a document DB (250), each of which may include various processing circuits and / or executable program instructions.

[0083] The smart suggestion application (260) can generate, store, and / or manage personalized data (265). The personalized data (265) may include data used for determining priorities of content and / or summarizing content based on the AI ​​suggester (270). The personalized data (265) may include data related to the user's activities of the electronic device (101) (e.g., staying, moving, exercising, sleeping, taking photos, eating, making calls, listening to music, watching videos, playing games, making reservations, and / or making payments). Personalized data (265) may include environmental context such as time, date, location, and / or weather, activity and / or behavioral context of the user of the electronic device (101), device context of the electronic device (101) (e.g., state of charge (SOC) of the battery of the electronic device (101), software application execution history (e.g., app usage)), context of content stored in the electronic device (101) (e.g., content context) (e.g., upcoming events, and / or coupon expiration dates), and / or data representing characteristics of the user of the electronic device (101) (e.g., preferences of said user). Personalized data (265) may include data for retrieval-augmented generation (RAG).

[0084] An electronic device (101) may include a context engine (280) for identifying and / or inferring contexts related to the electronic device (101) (e.g., spatial context, behavioral context, and / or temporal context). For example, a processor (210) running the context engine (280) may acquire or manage spatial context information, which is information about places where the user of the electronic device (101) is repeatedly located (e.g., home, workplace, other places frequently visited, car, entry and / or exit from a specific place). To acquire spatial context information, the processor (210) may acquire information related to a global navigation satellite system (GNSS), connectivity of the electronic device (101), and / or a point of interest (POI).

[0085] A processor (210) that executes the context engine (280) can obtain or manage behavioral context information, which is information about the user's actions of the electronic device (101) (e.g., functions of the electronic device (101) that are repeatedly executed by the user) and / or current state (e.g., going to work, driving, parking, sleeping, waking up, exercising, etc.). To obtain behavioral context information, the processor (210) can obtain sensor data and / or health information from the electronic device (101) and / or other devices connected to the electronic device (101) (e.g., devices wearable by the user, such as a watch and / or ring).

[0086] A processor (210) that executes a context engine (280) can acquire or manage temporal context information, which is information about a user's repetitive actions of an electronic device (101) (e.g., actions primarily performed at a specific time). To acquire temporal context information, the processor (210) can acquire spatial context information, behavioral context information, sensor data of the electronic device (101), and / or connectivity information of the electronic device (101). The user's repetitive actions indicated by the temporal context information may include a routine before going to work, a routine before going to bed, and / or a routine after exercising.

[0087] Referring to FIG. 2, a language model (255) for natural language processing (NLP) may be installed in an electronic device (101). The language model (255) may be used interchangeably with terms such as machine learning model, trained model, artificial intelligence model, neural network, and / or deep learning model in this disclosure. A trained model may include a computational model defined to simulate the neural activity of an organism, instructions representing said computational model, and / or a set of parameters used to define said computational model. For example, a trained model may include nodes referred to as artificial neurons and / or perceptrons, and weights assigned to connections between said nodes. For example, nodes of a trained model based on a feedforward neural network (FNN) may be included in an input layer, one or more hidden layers, and an output layer, respectively. The above weights may define a weighted sum between nodes included in each of the layers, such as an input layer, a hidden layer, and / or an output layer. A set of the above weights may be stored in memory (220). The nodes of the trained model may be arranged according to a structure such as a convolutional neural network (CNN), a recurrent neural network (RNN), a long-short term memory (LSTM), and / or a transformer. In the view that it is installed on an electronic device (101) owned by a user, the language model (255) may be referred to as an on-device model.

[0088] According to one embodiment, the processor (210) can obtain or generate personalized text (e.g., personalized suggestion message) using a language model (255) based on the execution of a smart suggestion application (260). For example, the processor (210) can obtain or generate personalized text from the language model (255) based on executing the smart suggestion application (260) based on the callback function. For example, the processor (210) can obtain personalized text based on the contents stored in the document DB (250) by executing the language model (255) at a specified time (e.g., evening time and / or late night time). For example, the processor (210) can generate personalized text by executing the language model (255) using weather information and / or schedule information. The texts (141, 142, 143) of FIG. 1 may be examples of personalized text obtained using a language model (255). To obtain personalized text by executing the language model (255), the electronic device (101) may use content(s) stored in the document DB (250). For example, if multiple contents are stored in the document DB (250), the electronic device (101) may obtain personalized text based on the content having a relatively high priority from the language model (255) by using the priorities of the multiple contents. For example, the electronic device (101) may obtain text linked to the contents stored in the document DB (250) by using the language model (255).

[0089] Below, with reference to FIGS. 3A, FIGS. 3B, FIGS. 3C, and FIGS. 3D, an exemplary operation of a processor (210) that executes a smart proposal application (260) is described in more detail.

[0090] FIGS. 3a, 3b, 3c, and 3d are diagrams illustrating exemplary operations performed by an electronic device to process content provided by a software application according to various embodiments. The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations of the electronic device described with reference to FIGS. 3a through 3d.

[0091] In FIGS. 3a, 3b, 3c, and 3d, respectively, programs of the electronic device (101) described with reference to FIG. 2 (e.g., software applications (240), and / or smart suggestion applications (260)) are illustrated. In FIG. 3a, an exemplary operation of the electronic device storing content (e.g., document(s) (312)) in a document DB (250) is illustrated. In FIG. 3b, an exemplary operation of the electronic device determining priorities of the content stored in the document DB (250) is illustrated. In FIG. 3c, an exemplary operation of the electronic device creating and / or displaying a user interface (UI) for the content using the determined priorities is illustrated. In FIG. 3d, an exemplary operation of the electronic device creating and / or determining personalized data (265) is illustrated.

[0092] As described above with reference to FIG. 2, content generated based on the execution of at least one of the software applications (240) may be stored in the document DB (250). An electronic device that has executed at least one of the software applications (240) may generate or store content according to conditions defined by each software application and / or requests of the smart proposal application (260). The document(s) (312) stored in the document DB (250) may include at least one of the attributes defined in Table 1. The document(s) (312) of FIG. 3a may be stored in the form of a list within the document DB (250). The document DB (250) may include information about the format and / or schema of the information that may be stored within the document DB (250) (e.g., schema type (311)).

[0093] An example is illustrated in which content (e.g., document(s) (312)) provided from software applications (240) is stored in a document DB (250), but the present disclosure is not limited thereto. For example, an electronic device that executes a smart suggestion application (260) can generate content to be stored in the document DB (250). For example, the electronic device can execute a document generator (278) to check the user's context (e.g., spatial context information, behavioral context information, and / or temporal context information of a context engine (280)). The electronic device can generate content based on the checked context. For example, based on the execution of the document generator (278), the electronic device can generate content including text that suggests the user's behavior.

[0094] Referring to FIG. 3a, a time-to-leave (TTL) suggestor (314), a travel suggestor (315), and / or a birthday suggestor (316) are illustrated as functions of a document generator (278) capable of generating content that suggests user actions. By executing the TTL suggestor (314), the electronic device can generate content that suggests a move according to the next schedule following the user's current schedule. By executing the TTL suggestor (314), the electronic device can calculate the time required to move to the location of the next schedule. Using the calculated time, the electronic device can generate content that includes text suggesting the move and is scheduled to be displayed based on the calculated time.

[0095] Referring to FIG. 3a, by executing a travel proposer (315), the electronic device can generate content related to a trip scheduled by the user. By executing a travel proposer (315), the electronic device can identify the user's travel schedule using the user's schedule information (e.g., schedule information included in the user's behavioral context information generated by the context engine (280)). The electronic device can generate content including information related to the identified travel schedule (e.g., information about the travel destination).

[0096] Referring to FIG. 3a, by executing a birthday proposer (316), the electronic device can identify the birthday of the user of the electronic device and / or another user associated with said user (e.g., another user registered in contacts or having a follow relationship through SNS (social network service)). Based on identifying a birthday that corresponds to or is adjacent to the current date (e.g., the current date identified by the device information of the electronic device), the electronic device can generate content associated with said birthday.

[0097] Referring to FIG. 3a, content generated based on the execution of a document generator (278) may be stored in a document repository (313) and / or a document DB (250). The document repository (313) may include a buffer defined for the exchange of content between the document DB (250) and a smart suggestion application (260) and / or a program managing said buffer. For example, when a callback function associated with the document DB (250) is executed (e.g., when a new document is stored in the document DB (250), and / or when the callback function is executed based on an update of the document DB (250)), the electronic device may store or copy the content of the document DB (250) (e.g., document(s) (312)) in the document repository (313).

[0098] Referring to FIG. 3b, the electronic device can execute a rank determiner (274) to determine the priorities of the contents of the document DB (250). The time identifier (325), context identifier (326), and / or update scheduler (327) of FIG. 3b may represent functions that determine the execution conditions of the rank determiner (274). For example, the electronic device can execute the rank determiner (274) at a timing scheduled by the update scheduler (327). For example, by executing the update scheduler (327), the electronic device can schedule the execution of the rank determiner (274) and / or the smart suggestion application (260) at a specific time (e.g., between 18:00 and 20:00 and / or between 21:00 and 23:00). For example, by running an update scheduler (327), the electronic device can schedule the execution of a rank determiner (274) and / or a smart suggestion application (260) based on changes in the user's context, which are indicated by the personal data (265) and / or the context information of the context engine (280).

[0099] For example, an electronic device that executes a time identifier (325) may determine whether to change the priorities of the contents according to the current time indicated by system information (e.g., device information (323)). For example, an electronic device that executes a context identifier (326) may determine whether to change the priorities of the contents according to changes in the user's context indicated by the context engine (280). The electronic device may execute an event identifier (324) to identify updates to system information (e.g., weather (321), calendar (322), and / or device information (323)) and / or personalized data (265). An electronic device that identifies the updates may execute a rank determiner (274) and / or a document generator (278) according to the updates. Referring to FIG. 3b, device information (323) illustrated as system information may include various states of the electronic device, such as the battery status (e.g., SOC), audio mode (e.g., vibration mode and / or silent mode), do not disturb mode, and / or dark mode. The system information may be used for the execution of the document generator (278) and / or UI generator (272), as well as the rank determiner (274).

[0100] For example, the operation of determining priorities based on the rank determiner (274) may be performed when the document DB (250) is updated, or when the context of the electronic device and / or user represented by the context engine (280) is changed. The embodiments are not limited thereto, and the operation of determining priorities based on the rank determiner (274) may be performed when a briefing screen is generated according to the execution of the smart suggestion application (260).

[0101] In one embodiment, the priorities of each content determined by executing the rank determiner (274) may be determined by the importance and / or urgency of the content as well as by context information and / or system information (e.g., weather (321), calendar (322), and / or device information (323)) generated by the context engine (280). The electronic device may determine or change the priorities of the content by using spatial context information (e.g., information indicating the user's current location, such as home and / or work), behavioral context information (e.g., information indicating the user's activity, such as sleep, going to work, or travel), and / or system information, the current time indicated by the current time, user preferences (e.g., cold start preference) and / or feedback stored in the feedback DB (276).

[0102] In one embodiment, the electronic device can determine the priorities of the contents according to the order of Table 2.

[0103] Sequence Description 1. The electronic device can determine whether the content is valid at the current time by using the time information of the content. For example, if creationTimestampMillis + documentTtlMillis of Table 1 is after the current time, the corresponding content may be ignored. 2. The electronic device can determine whether to display the content by comparing the context information identified by the context engine (280) with the context corresponding to the content (e.g., the context included in ValidContexts of Table 1). For example, if the context corresponding to the content does not match the context information identified by the context engine (280), the content may not be displayed. 3. The electronic device can determine the priorities of the content by using the priorities included in each of the content. 4. The electronic device can change the priority by using the period set in each of the content (e.g., the period indicated by ImportantTimeFrames of Table 1). For example, if the current time of the electronic device falls within a set period of specific content, the electronic device may increase the priority of said specific content.5 If content having the same priority is identified among the content, the electronic device may change the priority of at least one of the content using context information identified by the context engine (280) and the sizes of the intersections of the contexts of each of said content.6 If content having the same priority is identified among the content, the electronic device may change the priority according to the time difference between the times set for each of the content and the current time. For example, the priority of the content having the time closest to the current time may be increased.

[0104] The order in which the electronic device performs the operations of Table 2 to determine the priorities of the contents is not limited to the order of Table 2. As described above with reference to Table 2, the electronic device may determine whether to display the content and / or the priority of the content by using the current time indicated by the device information (323) and the time information of the content. For example, the content may be displayed on a briefing screen (e.g., a briefing screen generated by the smart suggestion application (260)) within the valid time period set by the content.

[0105] In one embodiment, the electronic device executing the rank determiner (274) can determine or calculate the scores of each of the contents as the rank score of Equation 1.

[0106]

[0107] The Priority in Equation 1 may be a priority assigned to the content, as a floating-point number between 0 and 1. The coefficients listed in Equation 1 (e.g., 0.5 and / or 0.25) may be changed according to the embodiment. The ImportantDuration in Equation 1 may be a floating-point number between 0 and 1 determined by comparing the time information set by the content with the current time. For example, if the current time corresponds to the time information set by the content (e.g., the current time is included within the time interval defined by the time information), the ImportantDuration may be set to 1. For example, if the current time does not correspond to the time information set by the content, the ImportantDuration may be changed according to the temporal distance between the current time and the time interval defined by the time information. For example, the ImportantDuration may be calculated as in Equation 2.

[0108]

[0109] ImportantContext in Equation 1 is a floating-point number between 0 and 1 that may represent the size of the intersection between context information generated by the context engine (280) and the context set by the content. Valid in Equation 1 is an integer between 0 and 1 that may be set to 1 when the valid time and / or valid context set by the content matches the current time and / or current context of the electronic device.

[0110] An electronic device that has determined the priorities of the contents by executing a rank determiner (274) can store the contents in a document repository (313) according to the priorities. After the contents are stored in the document repository (313), the electronic device can generate a briefing screen (or information indicating the layout of the briefing screen). The electronic device that executed the rank determiner (274) can transmit the contents stored in the document repository (313) to a UI generator (272) in an order based on the priorities of the contents (e.g., return).

[0111] Referring to FIG. 3c, by executing a UI generator (272), the electronic device may generate or display a UI associated with at least one of the contents (e.g., a briefing screen displayed in state (194) of FIG. 1 and / or widget objects (111, 121) displayed in states (191, 192). The UI manager (331) may correspond to the function of generating visual objects representing each of the contents (e.g., card objects (151, 152, 153, 154) of FIG. 1). By executing the UI manager (331), the electronic device may determine the layout of the visual objects representing the contents. For example, the electronic device may determine the layout of the visual objects by using the size of at least a portion of the display on which the visual objects are to be displayed. An electronic device that executes the UI manager (331) can obtain text (e.g., texts (141, 142, 143) of FIG. 1) expressing a summary of the content(s) to be displayed through the briefing screen using a text generator (332). The text may be referred to as an insight message and / or insight text.

[0112] Referring to FIG. 3c, the text generator (332) may correspond to the function of executing a language model (255) to generate text expressing a summary of content(s). By executing the text generator (332), the electronic device may generate a prompt (or prompt sentence(s)) to be input into the language model (255). For example, a prompt generated based on the text generator (332) may include weather (e.g., yesterday's and / or today's lowest and / or highest temperatures, weather type) and / or the current time as information to be input into the language model (255). For example, a prompt generated based on the text generator (332) may include content (or texts of said content) arranged according to priorities. Table 3 shows an exemplary prompt generated based on the text generator (332).

[0113] "You are a helpful AI assistant specializing in concise summary. You excel at prioritizing information and creating coherent, concise summaries. Follow the steps below to summarize the information. / n"+" <input> / n" +"==replace== / n" +" <instructions> / n" +"1. Prioritize Information: Consider the order in which the information is presented. Information appearing earlier should be given higher priority in the summary. / n" +"2. Select Key Information: Choose the top two most important pieces of information based on the prioritization in step 1." +"3. Concise Summarization: Condense the selected information into one clear and concise sentence as briefly as possible. Avoid unnecessary details or repetition. / n" +"4. Ensure Coherence: Maintain consistency and logical flow throughout the summary. The sentence should connect seamlessly and form a cohesive unit. / n" +"5. Use Conjunctions: Utilize appropriate conjunctions (e.g., / "and, / " / "but, / " / "because, / " / "therefore / ") to create smooth transitions and enhance the overall coherence of the summary. / n" +" <output> / n" +"- Adopt a Friendly, Professional Tone: Maintain a tone that is both approachable and professional. Avoid overly casual or overly formal language. / n" +"- Write in ==replace:Language==. / n"

[0114] Referring to Table 3, the prompt may include a natural language sentence indicating the style of text output from the language model (255) (e.g., "You are a helpful AI assistant specializing in concise summarization. You excel at prioritizing information and creating coherent, concise summaries." and / or "Adopt a Friendly, Professional Tone: Maintain a tone that is both approachable and professional. Avoid overly casual or overly formal language."). Referring to Table 3, the prompt may include text indicating the language of text to be output from the language model (255) (e.g., ""- Write in ==replace:Language==."). Referring to Table 3, the prompt may include a natural language sentence instructing to generate text using at least one piece of content that has a higher priority than other pieces of content (e.g., "Consider the order in which the information is presented. Information appearing earlier should be given higher priority in the summary.").

[0115] Visual objects (e.g., card objects (151, 152, 153, 154) of FIG. 1) and / or text expressing a summary of the content (e.g., texts (141, 142, 143) of FIG. 1) generated by executing the UI manager (331) can be stored in a view storage (333). Within the view storage (333), the visual objects and / or the text can be stored or bound based on the format of a view object (e.g., a view object defined by the Android operating system). For example, an electronic device can connect or bind the view object(s) representing the visual objects and / or the text to an object corresponding to a briefing screen (e.g., an activity object).

[0116] Referring to FIG. 3c, the view model (334) may be a function for generating a UI of an electronic device (e.g., full screen UI (335), home widget UI (336), lock screen UI (337), and / or feedback UI (338)) from view objects stored in the view repository (333). The full screen UI (335) may correspond to a briefing screen that occupies the entire display area of ​​the display (110). The home widget UI (336) may correspond to a widget object located on the home screen (e.g., widget object (121) of FIG. 1). The lock screen UI (337) may correspond to a widget object located on the lock screen (e.g., widget object (111) of FIG. 1). The widget objects may be used as entry points for the full screen UI (335) (e.g., briefing screen). The text contained in the widget object may be text generated using a language model (255). Text generated using the UI manager (331) and / or text generator (332) may be used to change the text of the widget object. For example, the home widget UI (336) and / or lock screen UI (337) may be a shortcut UI (e.g., an icon and / or shortcut) for quickly executing the full screen UI (335).

[0117] The feedback UI (338) may correspond to a UI for receiving feedback on visual object(s) displayed through the briefing screen (or feedback on the content contained in said visual object). The feedback UI (338) may be included at least partially in the full-screen UI (335). User input received through the feedback UI (338) may cause changes and / or updates to the feedback DB (276).

[0118] A system UI (339) may be used to display the UI of an electronic device. The system UI (339) may correspond to a function for displaying a lock screen and / or a home screen as at least part of the operating system and / or system software of the electronic device. To display a full screen UI (335), a home widget UI (336), and / or a lock screen UI (337), the electronic device may execute the system UI (339).

[0119] As described above, the electronic device may determine the priority of the plurality of contents based on generating a plurality of contents including a first content and a second content. The electronic device may generate summary text for some of the plurality of contents. For example, the priority of some of the plurality of contents may be higher than the priority of the remaining contents. The electronic device may display the summary text through a display and may display a plurality of contents arranged according to the priority below the summary text (e.g., full screen UI (335)). The present disclosure is not limited thereto, and the electronic device may display the summary text below any one of the plurality of contents. The electronic device may determine or change the order of the summary text and the plurality of contents within the display according to at least one of the plurality of contents.

[0120] Referring to FIG. 3d, a block diagram is illustrated to explain the operation of an electronic device that generates personalized data (265). According to one embodiment, the electronic device can identify or infer user behavior (341) using schedule information and / or sensor data from a sensor. When a user runs, the electronic device can identify user behavior (341) using location information of the electronic device and / or information indicating the user's health status. The electronic device that has identified the behavior (341) can determine content (342) being output by the electronic device as content linked to the behavior (341). For example, when a user runs while listening to music being output through the electronic device, the electronic device can determine the music as content linked to the behavior (341).

[0121] Referring to FIG. 3d, the electronic device can identify or determine a time pattern (343), a place pattern (344), and / or an activity (345) associated with a behavior (341). The time pattern (343) may represent a temporal characteristic of the user's behavior (341) that is performed repeatedly. The place pattern (344) may represent a characteristic of the user's location and / or movement path. The activity (345) may represent a characteristic associated with the user's behavior (341) (e.g., listening to music).

[0122] Referring to FIG. 3d, the electronic device may generate or determine a time context (347) using a time pattern (343). For example, in a case where a user running is identified, the electronic device may generate a time context (347) to check information related to running (e.g., weather and / or wearing information of a wearable device such as a watch) before running. The electronic device may use a spatial context (348) to check whether the current location corresponds to a place frequently visited by the user. For example, in the above case, the electronic device may generate a spatial context (348) indicating that the current location of the electronic device is a place where the user frequently performs running. The electronic device may generate an action context (349) indicating detailed actions of the user running using information about an activity (345). For example, in the above case, the electronic device may generate an action context (349) indicating content (342) (e.g., music) output by the electronic device.

[0123] Referring to FIG. 3d, the electronic device may analyze content (342) to obtain or generate content analysis results (346). The content analysis results (346) may include information about the content being output by the electronic device (in the above case, the name, genre, and / or singer of the music). The content analysis results (346) may include information generated by the electronic device in conjunction with the action (341) (e.g., distance traveled, and / or measured calories). The electronic device may generate preference information (350) using the information about the activity (345) and the content analysis results (346). The preference information (350) may represent the user's preference related to the action (341) (e.g., content preferred by the user). For example, in the above case, the preference information (350) may include data about the genre of music and / or singer preferred by the user who is running.

[0124] Referring to FIG. 3d, the electronic device may acquire or generate memory information (351) by utilizing an activity (345) and a content analysis result (346). The memory information (351) may include a user action (e.g., running in the above case) that is triggered by the activity (345) and content associated with said action (e.g., music in the above case). The memory information (351) may include an engram of the user action.

[0125] Referring to FIG. 3d, the time context (347), spatial context (348), behavioral context (349), preference information (350), memory information (351), or any combination thereof may be stored in the personalized data (265).

[0126] Hereinafter, the operation of an electronic device that executes a smart proposal application (260), as described with reference to FIGS. 2 and FIGS. 3a to 3d, will be described in more detail with reference to FIGS. 4a to 4f.

[0127] FIGS. 4a, 4b, 4c, 4d, 4e, and 4f include diagrams and flowcharts illustrating exemplary operations of an electronic device according to various embodiments. The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIGS. 2 may perform operations described with reference to FIGS. 4a and / or FIGS. 4f. The order in which the operations of FIGS. 4a and / or FIGS. 4b are performed is not limited to the order shown in FIGS. 4a and / or FIGS. 4b. For example, the electronic device (101) and / or the processor (210) of FIGS. 2 may perform the operations of FIGS. 4a and / or FIGS. 4b in a different order than the order shown in FIGS. 4a and / or FIGS. 4b. For example, the electronic device (101) and / or processor (210) of FIG. 2 may substantially simultaneously perform at least two of the operations of FIG. 4a and / or FIG. 4b (e.g., multitasking and / or multithreading). The operations of FIG. 4a and / or FIG. 4b may be performed by the electronic device that executes the smart proposal application (260) of FIG. 2.

[0128] Referring to FIG. 4a, within operation (410), an electronic device according to one embodiment can identify a plurality of messages. The plurality of messages of operation (410) may include content generated based on the execution of software applications. The plurality of messages of operation (410) may include content generated based on the execution of the smart proposal application (260) and / or document generator (278) of FIG. 2. The plurality of messages of operation (410) may be stored in the document DB (250) of FIG. 2. Examples of the plurality of messages of operation (410) are described in more detail later with reference to FIG. 6.

[0129] Referring to FIG. 4a, within an operation (420), an electronic device according to one embodiment may determine priorities corresponding to each of a plurality of messages. The priorities may be determined or obtained using the time, location of the electronic device, the SOC of the battery of the electronic device, or schedule information stored in the memory. The operation (420) may include an operation performed based on the execution of the rank determiner (274) of FIG. 3b.

[0130] Referring to FIG. 4a, within operation (430), an electronic device according to one embodiment may obtain text expressing a summary of at least one of a plurality of messages using determined priorities. For example, the electronic device may obtain or generate text expressing a summary of at least one of the messages of operation (410) using priorities determined based on operation (420). For example, the electronic device may obtain a prompt (e.g., a prompt included in Table 3) containing the messages arranged according to the priorities. By running a trained model (e.g., the language model (255) of FIG. 2) using the prompt, the electronic device may obtain text of operation (430).

[0131] Referring to FIG. 4a, within operation (440), an electronic device according to one embodiment may generate information for displaying a screen containing text and visual objects each containing a plurality of messages. For example, the electronic device may generate layout information for an execution screen (e.g., a briefing screen displayed in state (194) of FIG. 1) containing text and the visual objects obtained based on operation (430). The layout information may be generated using a priority determined based on operation (420). For example, the order of the visual objects within the execution screen may correspond to the order of priorities of the messages corresponding to the visual objects (e.g., descending order).

[0132] Referring to FIG. 4a, within an operation (450), an electronic device according to one embodiment may display a screen based on generated information. For example, the electronic device may display visual objects each containing the messages arranged according to the priority determined based on the operation (420), along with text obtained based on the operation (430). While displaying the screen of the operation (450), the electronic device may receive user input related to any one of the visual objects included in the screen. Based on the user input, the electronic device may display a screen provided by a software application corresponding to the visual object related to the user input.

[0133] The screen of the operation (450) may be displayed directly based on generating information of the operation (440). The present disclosure is not limited thereto, and the electronic device may display a widget object and / or an icon (e.g., icon (131) of FIG. 1) associated with the screen of the operation (450), such as the widget objects (111, 121) of FIG. 1. Based on user input associated with the widget object and / or the icon, the electronic device may display the screen of the operation (450) through a display (e.g., display (110) of FIG. 1 and / or FIG. 2). A briefing screen displayed in the state (194) of FIG. 1 and / or a briefing screen described with reference to FIG. 8 may be an example of the screen of the operation (450).

[0134] Referring to FIG. 4b, within operation (461), an electronic device according to one embodiment can identify first information of a first application and second information of a second application acquired during a specified period. The electronic device can perform operation (461) of FIG. 4b based on determining that the time information of the electronic device corresponds to a specified time. For example, the electronic device can identify information generated within a specified period by various applications installed on the electronic device. Each of the first information and the second information may be acquired during a specified period corresponding to the time information. The specified time may be a time scheduled by the update scheduler (327) of FIG. 3b (e.g., a time between 18:00 and 20:00 and / or a time between 21:00 and 23:00). If the time information of the electronic device corresponds to the specified time, the electronic device may perform the operations of FIG. 4b using a dedicated process and / or a dedicated thread. The present disclosure is not limited thereto, and the electronic device may perform at least one of the operations of FIG. 4b prior to the specified time (in advance).

[0135] Referring to FIG. 4b, within operation (463), an electronic device according to one embodiment may generate a first content including a first image and a first text using first information, and a second content including a second image and a second text using second information. For example, the electronic device may generate or acquire the first content and the second content using a trained model (e.g., the language model (255) of FIG. 2). If the electronic device acquires information from various applications based on operation (461), the electronic device may perform operation (463) using information corresponding to each of the applications to acquire content corresponding to each of the applications. Although an embodiment has been described in which the electronic device acquires a first image along with a first text using the first information, the present disclosure is not limited thereto, and the electronic device may acquire or generate information different from the first image (e.g., video).

[0136] Referring to FIG. 4b, within operation (465), an electronic device according to one embodiment may determine the priority of the first content and the second content generated based on operation (463). For example, the electronic device may determine the priority of the first content and the second content based on the time information of the electronic device. For example, the electronic device may determine the priority of operation (465) using the user's state and / or context estimated by the time information.

[0137] Referring to FIG. 4b, within operation (467), an electronic device according to one embodiment may simultaneously display the first content and the second content through a touchscreen display (e.g., the display (110) of FIG. 1) based on the priority of operation (465). For example, the electronic device may display the first content and the second content side-by-side or sequentially within a screen displayed through the display.

[0138] Referring to FIGS. 4c, 4d, 4e, and 4f, timing figures (471, 472, 473, 474) are shown, representing exemplary content generated by an electronic device performing the operation of FIG. 4a and / or FIG. 4b. In the timing figures (471, 472, 473, 474), late night may represent the time interval from midnight to 6:00 AM, early morning may represent the time interval from 6:00 AM to 8:00 AM, morning may represent the time interval from 8:00 AM to 10:00 AM, late morning may represent the time interval from 10:00 AM to 12:00 AM, lunch may represent the time interval from 12:00 AM to 2:00 PM, afternoon may represent the time interval from 2:00 PM to 6:00 PM, evening may represent the time interval from 6:00 PM to 10:00 PM, and night may represent the time interval from 10:00 PM to midnight.

[0139] Referring to the timing diagram (471) of FIG. 4c, the electronic device may provide a summary of content, referred to as a morning brief, in the early morning. The electronic device may provide a summary of content, referred to as an evening brief, in the evening. Within the time interval between early morning and evening, the electronic device may add the current weather to the summary of content, referred to as the morning brief. The electronic device may display content related to news, playlists, major schedules (e.g., schedules including travel time, such as time to leave), coupons (e.g., coupons expiring in 3 to 1 day), story recommendations, safe walking messages, and / or missed calls within the corresponding time interval illustrated in the timing diagram (471). The electronic device may display content related to energy saving, repetitive actions, daily activities, and train / bus tickets within the corresponding time interval illustrated in the timing diagram (471), depending on the display conditions of said content.

[0140] Referring to the timing diagram (472) of FIG. 4d, the electronic device may provide content based on schedule information. For example, within a time interval between early morning and evening, the electronic device may display content for sending a birthday card to a user on a specific birthday and / or providing a birthday gift. Within a time interval between early morning and late morning, the electronic device may display content including notifications related to anniversaries within one week. The electronic device may display content related to urgent weather alerts (e.g., short-term precipitation), reminders set as recurring alerts, and / or sports events, depending on the display conditions. Weather-related content may be displayed based on the context identified by the electronic device (e.g., weather and / or commuting).

[0141] Referring to the timing diagram (473) of FIG. 4e, the electronic device may display content related to health information, such as drinking water, within a time interval between early morning and late morning. The electronic device may display content for recommending content (e.g., content of a video streaming service) within a time interval between early morning and evening. The electronic device may display content for phone recommendations (e.g., calling a specific user) within a time interval between lunch and evening. The electronic device may display content related to providing tips, blood pressure results, weight results, medication checks, recurring reminders, and / or sports games, depending on the display conditions. The timing diagram (473) may represent content generated and / or displayed by an electronic device for providing mixed reality (e.g., the HMD device (293) of FIG. 2).

[0142] Referring to the timing diagram (474) of FIG. 4f, if the electronic device identifies a travel schedule, it may display content for preparing the travel schedule (e.g., suggestions for setting up Find My Device, location sharing recommendations, travel preparation content, and / or setting a departure alarm) on a date three to one day prior to the travel schedule. On the date the travel schedule begins (e.g., D-day), the electronic device may provide content regarding a boarding pass, travel preparation content, recommendations for useful apps, recommendations for language packs, airport arrival TTL, and / or local weather. During the travel schedule, the electronic device may provide content related to current location weather, travel preparation content, exchange rate information, language packs, charging recommendations (e.g., wearable device and / or electronic device), and / or recommended place information.

[0143] The time intervals of FIGS. 4c, 4d, 4e, and 4f are exemplary and may be changed according to various embodiments. The order of contents output by the electronic device and / or the text included in the contents may be displayed differently depending on the user based on personalization information and is not limited to the timing figures (471, 472, 473, 474) of FIGS. 4c, 4d, 4e, and 4f.

[0144] Hereinafter, with reference to FIG. 5, information exchanged to perform the operation of FIG. 4a and / or FIG. 4b is described in more detail in terms of programs executed by an electronic device.

[0145] FIG. 5 is a signal flow diagram illustrating exemplary operations of an electronic device according to various embodiments. The electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations described with reference to FIG. 5. The operations of the electronic device described with reference to FIG. 5 may be related to the operations described with reference to FIG. 3a to 3d, FIG. 4a, and / or FIG. 4b.

[0146] Referring to FIG. 5, an electronic device that has executed a smart suggestion application (260) may obtain or collect content (515) from software applications (240). The content (515) may be content stored in the document DB (250) of FIG. 2. The electronic device may obtain content (515) by requesting content (515) from software applications (240) and / or by identifying that content (515) is stored in the document DB. The content (515) may include information managed by the software application that created the content (515). For example, content created based on the execution of a calendar application (e.g., the calendar application (241) of FIG. 2) may include information about a schedule. For example, content generated based on the execution of a messenger application (e.g., the messenger application (242) of FIG. 2) may include at least one unread message. For example, content generated based on the execution of a weather application (e.g., the weather application (243) of FIG. 2) may include information related to the weather. Content (515) may include information for displaying visual objects such as the card objects (151, 152, 153, 154) of FIG. 1. Content (515) may have attributes and / or data structures described based on Table 1. Document objects (630, 640) described with reference to FIG. 6 may be an example of content (515) of FIG. 5.

[0147] Referring to FIG. 5, an electronic device that has executed a smart suggestion application (260) may request to execute a rank determiner (274) to determine the priority of content (515) (operation (520)). Based on the execution of the rank determiner (274), the electronic device may perform the operation described with reference to FIG. 3b to determine or obtain the priority of content (515). By executing the rank determiner (274), the electronic device may identify content sorted according to priorities (or rank score of Equation 1) (operation (525)). Content sorted according to priorities may be stored in the document repository (313) of the smart suggestion application (260) (operation (530)). Based on the notification (535) of the document repository (313), the electronic device may identify that the content has been stored in the document repository (313).

[0148] Referring to FIG. 5, an electronic device running a smart suggestion application (260) can input a prompt (540) (e.g., the exemplary prompt in Table 3) into a language model (255). The prompt (540) may include information identified by the electronic device, such as content (515) and / or weather, such as "Generate a departure guidance message including the route to the ABC Building, the location for the 3:00 PM meeting. The current weather is clear, 25°C." The text (545) obtained from the language model (255) may include natural language sentence(s) based on the prompt (540) (e.g., "Please travel in 30 minutes to depart for the 3:00 PM meeting. The current weather is clear, and the estimated arrival time is 2:50 PM.").

[0149] Referring to FIG. 5, an electronic device running a smart suggestion application (260) can run a UI manager (331) using text (545) and content (action (550)). By running the UI manager (331), the electronic device can create a view model (555) for displaying a briefing screen and / or widget objects (e.g., widget objects (111, 121) of FIG. 1). Based on the view model (555), the electronic device can display widget objects (e.g., action (560)) or display content (515) (e.g., action (570)). The content (515) can be displayed in response to user input (565) for displaying the briefing screen. An electronic device performing action (570) can display an insight message (e.g., text (545)) related to the content (515) along with the content (515).

[0150] FIG. 6 is a diagram illustrating an example of a document object generated based on the execution of a software application of an electronic device according to various embodiments. The electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operation described with reference to FIG. 6. The operation of the electronic device described with reference to FIG. 6 may be related to the smart suggestion application (260) described with reference to FIG. 3a to 3d and / or the operation (410) of FIG. 4a.

[0151] Referring to FIG. 6, document objects (630, 640) generated in each of the reservation application (610) and / or health application (620), which are examples of software applications (240), are illustrated. Based on the execution of the reservation application (610), the electronic device may generate a document object (630) representing reservation information managed by the reservation application (610). The electronic device may store or register the generated document object (630) in the document DB (250). For example, the electronic device may store information for visualizing the document object (630) in the document DB (250) based on the data structure described with reference to Table 1. Similarly, based on the execution of the health application (620), the electronic device may generate a document object (640) containing health information. The document object (640) may include graphic objects to enhance the user experience, such as icons (645), along with text and / or graphs representing health information. Information for displaying the document object (640) may be stored in the document DB (250).

[0152] Document objects (630, 640) stored in the document DB (250) may be maintained within the document DB (250) for a specified period (e.g., 24 hours). For example, the lifecycle of the document objects (630, 640) may be 24 hours or less. The present disclosure is not limited thereto, and the document objects (630, 640) may be maintained within the document DB (250) for a period exceeding the specified period. Using the document objects (630, 640) stored in the document DB (250), the electronic device may display briefing screens and / or widget objects.

[0153] FIG. 7 is a diagram illustrating an exemplary screen displayed by an electronic device (101) to obtain context information related to a user according to various embodiments. Referring to FIG. 7, an exemplary screen displayed by the electronic device (101) of FIG. 1 and FIG. 2 is illustrated. In order to obtain personalized data (e.g., personalized data (265) of FIG. 2 and / or context information of the context engine (280)) through a display (110), the electronic device (101) may display the screen of FIG. 7.

[0154] Referring to FIG. 7, the screen displayed through the display (110) may include visual objects (710, 720, 730, 740, 750, 760) for obtaining personalized data. A visual object (710) may be displayed to receive information about the current status of the user of the electronic device (101). A visual object (720) may be displayed to receive places where the user of the electronic device (101) frequently stays (e.g., home and / or workplace). A visual object (730) may be displayed to receive places that the user of the electronic device (101) periodically visits (e.g., other places different from home and / or workplace). A visual object (740) may be displayed to check on the family of the user of the electronic device (101). A visual object (750) may be displayed to identify other users living with the user of the electronic device (101). A visual object (760) can be displayed to check the schedule and / or events of the user of the electronic device (101).

[0155] While displaying a screen containing visual objects (710, 720, 730, 740, 750, 760), the electronic device (101) can obtain personalized data from the user. The personalized data (265) of FIG. 2 may include data obtained through the screen of FIG. 7. Using the personalized data, the electronic device (101) can determine or obtain priorities of content generated by software applications of the electronic device (101) (e.g., software applications (240) of FIG. 2).

[0156] FIG. 8 is a diagram illustrating an exemplary briefing screen displayed by an electronic device (101) according to various embodiments. The electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operation of the electronic device (101) described with reference to FIG. 8. The operation of the electronic device (101) described with reference to FIG. 8 may be related to the operation (450) of FIG. 4a and / or the operation (570) of FIG. 5.

[0157] Referring to FIG. 8, exemplary states (194, 801) of an electronic device (101) displaying a briefing screen are illustrated. The briefing screen may include at least a portion of a UI (810) in which card objects (151, 152, 153, 154) and texts (141, 142, 143) are arranged. Information indicating the layout of the UI (810) may be generated based on the operation described with reference to FIGS. 1 through 5. For example, the order of the card objects (151, 152, 153, 154) within the UI (810) may be related to the priorities of the contents corresponding to each of the card objects (151, 152, 153, 154). For example, texts (141, 142, 143) may be generated or obtained from a language model (e.g., language model (255) of FIG. 2) that has received at least one of the contents. For example, the priorities may be determined based on the current time of the electronic device (101). For example, within a UI (810) generated in the morning, a card object (151) corresponding to content provided by a weather application may be positioned above other card objects (152, 153, 154).

[0158] Referring to FIG. 8, in state (194), the electronic device (101) can display texts (141, 142, 143) and card objects (151, 152, 153) adjacent to the top of the UI (810) through the electronic device (101). State (194) may be a state in which a briefing screen is first displayed according to user input. In state (194), the electronic device (101) can identify a scroll input (e.g., a drag gesture and / or a swipe gesture) that starts at any point (p) of the display (110) and is performed along a direction (890) substantially parallel to the vertical direction of the display (110). Based on the scroll input, the electronic device (101) can change the portion of the UI (810) displayed through the display (110). The state (801) of FIG. 8 may be the state of the electronic device (101) after receiving the scroll input. The direction (890) facing upward on the display (110) is shown, but the direction of the scroll input is not limited to this. For example, based on a scroll input performed along the downward direction of the display (110), the electronic device (101) may change a portion of the UI (810) displayed through the display (110).

[0159] In the state (801) of FIG. 8, the electronic device (101) may display visual objects (152, 153, 154) adjacent to the bottom of the UI (810). Along with the visual objects (152, 153, 154), the electronic device (101) may display UI objects (811, 812, 813) corresponding to functions related to the briefing screen, respectively. The UI object (811) may be displayed to receive feedback on the content included in the briefing screen. For example, based on user input related to the UI object (811), the electronic device (101) may display the screen of FIG. 10 (e.g., the screen displayed in state (1002)). The UI object (812) may be displayed to receive feedback on the briefing screen. A UI object (813) may be displayed to obtain personalized data used to determine the priorities of the content used to display the briefing screen. For example, based on user input associated with the UI object (813), the electronic device (101) may display the screen of FIG. 7.

[0160] FIG. 9 is a diagram illustrating an exemplary operation of an electronic device that displays a widget object (911) connected to a briefing screen through a lock screen according to various embodiments. The electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operation described with reference to FIG. 9. The operation of the electronic device (101) described with reference to FIG. 9 may be related to the operation (450) of FIG. 4a and / or the operations (560, 570) of FIG. 5.

[0161] Referring to FIG. 9, an exemplary state (901) of an electronic device (101) that displays a lock screen is illustrated. The electronic device (101), having obtained text (143) expressing a summary of contents, may display a widget object (911) on the lock screen containing text (e.g., "Have a nice day") that has a shorter length than said text (143). The text displayed on the widget object (911) may express a summary of the text (143). Within state (901), based on user input related to the widget object (911), the electronic device (101) may display a briefing screen containing the text (143) through the display (110), as in state (194). Based on said user input, the electronic device (101) may perform user authentication. Based on user authentication, the electronic device (101) may display or output a briefing screen through the display (110), such as in state (194). The present disclosure is not limited thereto, and the electronic device (101) may switch to state (194) without authentication based on user input associated with a widget object (911).

[0162] A widget object (911) may include text determined based on the execution of the smart suggestion application (260) of FIG. 2. For example, in the morning, a widget object (911) containing a greeting based on the morning time (e.g., "Have a good day"), such as the status (901), may be displayed on the lock screen. For example, in the afternoon, the electronic device (101) may display a widget object (912) containing text based on the afternoon time (e.g., "Have a pleasant afternoon") on the lock screen. For example, in the evening, the electronic device (101) may display a widget object (913) containing a greeting related to the evening time (e.g., "Have a good evening") on the lock screen. For example, in the night time, the electronic device (101) may display a widget object (914) containing a greeting corresponding to the night time (e.g., "Sweet dreams") on the lock screen.

[0163] The text contained in the widget object (911) may include a greeting based on the current time as well as text expressing a summary of the content displayed through the briefing screen. For example, if text containing a description of a coupon expiring today is generated, such as text (143), the electronic device (101) may display a suggestion related to the description (e.g., "Use the coupon today.") through the widget object (911). By using the text displayed through the widget object (911), the electronic device (101) may output information intended to be provided first through the briefing screen to the user of the electronic device (101) before the briefing screen is displayed.

[0164] FIG. 10 is a diagram illustrating exemplary states of an electronic device (101) for obtaining feedback data for contents included in a briefing screen according to various embodiments. The electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operation described with reference to FIG. 10. The operation of the electronic device (101) described with reference to FIG. 10 may be related to the operation (450) of FIG. 4a and / or the operation (570) of FIG. 5.

[0165] Referring to FIG. 10, an exemplary state (801) of an electronic device (101) displaying a briefing screen is illustrated. In the state (801) of FIG. 10, the electronic device (101) may receive user input related to a UI object (811). The state (1002) of FIG. 10 may be an exemplary state of the electronic device (101) displaying a screen based on the user input.

[0166] Referring to the state (1002) of FIG. 10, the electronic device (101) may display a portion of the UI (1010). The UI (1010) may include card objects (151, 152, 153, 154) corresponding to content obtained from software applications (e.g., software applications (240) of FIG. 2), and UI objects (1011, 1012, 1021, 1022, 1031, 1032, 1041, 1042) for obtaining feedback on said content. For example, the UI objects (1011, 1012) may be displayed to obtain feedback (e.g., positive feedback and / or negative feedback) on the card object (151). For example, UI objects (1021, 1022) may include buttons (e.g., like button and / or dislike button) for obtaining feedback on content related to the card object (152). For example, UI objects (1031, 1032) may be displayed to obtain feedback on content corresponding to the card object (153). For example, UI objects (1041, 1042) placed at a location linked to the card object (154) may be displayed to receive feedback on content included in the card object (154).

[0167] Referring to the UI (1010) of FIG. 10, a visual object (1050) for receiving feedback on a briefing screen may be included in the UI (1010). The visual object (1050) may include UI objects (1051) for obtaining an evaluation of the briefing screen and / or a text box (1052) for receiving text about the briefing screen. The visual object (1050) may include a UI object (1053) for completing feedback based on the UI (1010) and / or a UI object (1054) for canceling feedback based on the UI (1010).

[0168] Referring to FIG. 10, within a state (1002) that displays at least a portion of a UI (1010), an electronic device (101) can obtain feedback regarding a briefing screen. In response to user input related to a UI object (1053), the electronic device (101) can store data representing the feedback obtained from the user within the state (1002). The data may be stored in the feedback DB (276) of FIG. 2. The data may include at least one of the creation time, type, user score, keyword (e.g., a keyword included in at least one of the UI objects (1051) selected by the user), and / or text entered through a text box (1052) of the content corresponding to the data. The data may be stored in the feedback DB (276) of FIG. 2 or transmitted to a server connected to the electronic device (101).

[0169] Feedback obtained through the state (1002) and / or UI (1010) can be used to determine and / or adjust the priorities of the contents. For example, when determining priorities based on the operation (420) of FIG. 4a and / or the operation (525) of FIG. 5, the electronic device (101) can identify the feedback.

[0170] FIGS. 11a, FIGS. 11b, and FIGS. 11c are diagrams illustrating exemplary states of a briefing screen displayed by an electronic device according to various embodiments. The electronic device (101) and / or processor (210) of FIGS. 1 and 2 may perform the operations described with reference to FIGS. 11a through 11c. The operations of the electronic device (101) described with reference to FIGS. 11a through 11c may be related to the operations (450) of FIG. 4a and / or the operations (570) of FIG. 5.

[0171] Referring to FIG. 11a, the state (1101) of an electronic device (101) displaying an exemplary briefing screen is illustrated. For example, the electronic device (101), having identified content announcing a schedule at a specific location (e.g., information generated based on the execution of the calendar application (241) of FIG. 2), may determine the priority of said content to be higher than the priority of other content. Using said priority, the electronic device (101) may display a briefing screen containing text expressing a summary of said content (e.g., "It is time to depart.").

[0172] The content displayed through the briefing screen may be changed. After state (1101), at evening time, the electronic device (101) may create a UI (1120) using the content created up to evening time (e.g., content stored in the document DB (250) of FIG. 2). The UI (1120) may include texts (1121, 1122, 1124) expressing a summary of the content, and card objects (1123, 1125) corresponding to the content, respectively. The order of the card objects (1123, 1125) within the UI (1120) may correspond to a descending order of priorities of the content, determined based on the current time of the electronic device (101) (e.g., evening time) and / or context information of the electronic device (101). The UI (1120) may be displayed through the display (110) as at least part of the briefing screen. The UI (1120) may include content related to the travel itinerary, as described with reference to FIG. 11c.

[0173] Referring to FIG. 11a, an electronic device (101) that identifies content related to a travel schedule can determine the priority of the content by comparing the time information of the content with the current time of the electronic device (101). For example, an electronic device (101) that determines the priority of the content to be higher than the priority of other content can generate a UI (1130) including a card object (1133) corresponding to the content and texts (1131, 1132, 1134) expressing a summary of the content. The UI (1130) can be displayed through a display (110) as at least part of a briefing screen.

[0174] Referring to FIG. 11a, the electronic device (101) may display at least one of UI objects (1151, 1152) within a briefing screen. A UI object (1151) including an exclamation mark icon may be displayed to indicate that at least a portion of the briefing screen (e.g., a summary of content(s) provided through the briefing screen) was generated using an artificial intelligence model. For example, in response to an input indicating the selection of a UI object (1151), the electronic device (101) may display a pop-up window superimposed on the briefing screen indicating that the briefing screen contains content based on an artificial intelligence model.

[0175] Referring to FIG. 11a, a UI object (1152) including a gear-shaped icon may be displayed to change (or customize) setting values ​​associated with a briefing screen. For example, in response to an input indicating the selection of the UI object (1152), the electronic device (101) may display a screen for changing said setting values, such as the state (1102) of FIG. 11b. The screen displayed in the state (1102) of FIG. 11b may be displayed by an input other than the input associated with the UI object (1152) (e.g., an input received through a setting application).

[0176] Referring to FIG. 11b, a screen displayed in state (1102) may be displayed to receive setting values ​​related to the condition for displaying the briefing screen (e.g., whether to display the briefing screen without unlocking) and permission(s) related to the briefing screen. A screen displayed in state (1102) may include an item (e.g., "Suggest contents") for selecting content(s) to be displayed through the briefing screen. In response to an input indicating the selection of said item, the electronic device (101) may display a screen displayed in state (1103) of FIG. 11b. In state (1103) of FIG. 11b, the electronic device (101) may include items corresponding to each of the software applications installed on the electronic device (101), and UI objects (e.g., radio buttons and / or switches) for selecting whether to display content generated by each software application on the briefing screen. In state (1103), in response to an input selecting a specific item (e.g., time to leave), the electronic device (101) may switch to state (1104) and display a screen for selecting detailed options for said specific item. For example, in state (1104), the electronic device may display a screen for selecting a software application allowed to generate said content among software applications capable of generating said content (e.g., four map applications) associated with said specific item.

[0177] Referring to FIG. 11c, a state (1105) of an electronic device (101) that displays content related to a travel itinerary through a briefing screen is shown. The content may be included in the UI (1120) of FIG. 11a. The electronic device (101) may display content including images and / or videos related to the travel itinerary in the evening (e.g., the evening time period described with reference to FIG. 4c through 4f). For example, within the state (1105), the electronic device (101) may display content including images (1151) related to the travel itinerary along with other content. The present disclosure is not limited thereto, and the electronic device (101) may generate or display content including a summary of the images and / or videos obtained during the travel itinerary on the last day of the travel itinerary.

[0178] Referring to FIG. 11c, the image (1151) displayed in state (1105) may correspond to the best image among the images and / or videos acquired during the travel itinerary. The best image may be determined by the selection of the user and / or artificial intelligence model regarding the images and / or videos. Along with the image (1151), the electronic device (101) may display text related to the image (1151) and / or the travel itinerary. In state (1105), based on an input indicating the selection of the image (1151) and / or content including the image (1151), the electronic device (101) may switch to the state (1106) of FIG. 11c.

[0179] In the state (1106) of FIG. 11c, the electronic device (101) may provide a detailed view of images and / or videos related to the travel itinerary. In the state (1106) of FIG. 11c, the electronic device (101) may list images and / or videos within the area (1161) of the detailed view. The electronic device (101) may display time information for the images and / or videos displayed in the area (1161) (e.g., text indicating that the images and / or videos were acquired on the first day of the travel itinerary), and / or icon(s) representing person(s) identified through the images and / or videos in the area (1162).

[0180] In the state (1106) of FIG. 11c, the electronic device (101) may display information about places visited during a travel itinerary and / or places surrounding said places within the area (1163) of the detailed view. The order of the areas (1161, 1162, 1163) is not limited to the exemplary state (1106) of FIG. 11c. The electronic device (101) may display other information, such as tomorrow's schedule, as well as information contained in the areas (1161, 1162, 1163), through the display (110).

[0181] FIGS. 12a and FIGS. 12b are diagrams illustrating exemplary operations of an electronic device for generating a layout of content (e.g., card object (1223)) and / or widget object (1230) to be displayed on a briefing screen using a document object provided by a software application according to various embodiments. The electronic device (101) and / or processor (210) of FIGS. 1 and 2 may perform the operations of the electronic device described with reference to FIGS. 12a and / or FIGS. 12b. The operations of the electronic device described with reference to FIGS. 12a and / or FIGS. 12b may be related to the operations (450) of FIG. 4a and / or the operations (570) of FIG. 5.

[0182] Referring to FIG. 12a, an exemplary state of an electronic device that has created a document object (1210) based on the execution of a health application (620) is illustrated. An electronic device that has identified the document object (1210) through a document DB (250) can create a UI (1220) including a card object (1223) corresponding to the document object (1210) based on the execution of a smart suggestion application (260). The electronic device can create a UI (1220) including text (1222) expressing a summary of the document object (1210). An exemplary UI (1220) in which the text (1222) is placed below the card object (1223) is illustrated, but the present disclosure is not limited thereto. The electronic device (101) can display a card object (1223) that maintains the layout of the document object (1210). The present disclosure is not limited thereto, and the layout of the card object (1223) may differ from the layout of the document object (1210) depending on the resolution, size, and / or visual effects applied to the card object (1223) of the UI (1220). Along with text (1222), the electronic device may add text (1221) to the UI (1220) that expresses a greeting based on the contents and / or time within the document DB (250) containing the document object (1210). The UI (1220) may be displayed through a briefing screen.

[0183] Referring to FIG. 12a, an electronic device that identifies a document object (1210) can identify text based on the document object (1210) (e.g., "Good morning. Energy score 92 points"). The electronic device can display the identified text through a widget object (1230). The widget object (1230) can be displayed through the lock screen (e.g., Now Bar) and / or through at least a portion of the home screen. The text placed on the widget object (1230) may have a shorter length than the texts (1221, 1222) displayed through the UI (1220).

[0184] Referring to FIG. 12b, an exemplary state of an electronic device is illustrated in which content (e.g., briefing object (154)) based on the execution of a moment application (1250) is identified. The moment application (1250) may be configured to perform operations described in more detail below with reference to FIGS. 15 through 26. An embodiment in which the moment application (1250) is installed independently of the smart proposal application (260) is illustrated, but the present disclosure is not limited thereto. For example, the moment application (1250) may be included in the smart proposal application (260). An electronic device that identifies that the briefing object (154) is stored in the document DB (250) may execute the smart proposal application (260) to perform calculations defined by the language model (255). By performing the above calculations, the electronic device can obtain priorities for contents of the document DB (250) including a briefing object (154), or obtain text expressing a summary of said contents (e.g., "Evening briefing, picnic at Namsan"). The electronic device can display a widget object (1251) containing said text. The briefing object (154) can be displayed through a display as at least part of the briefing screen.

[0185] Below, exemplary layouts of briefing screens according to the form factor of an electronic device are described in more detail with reference to FIG. 13a, FIG. 13b, and / or FIG. 14.

[0186] FIGS. 13a and FIGS. 13b are diagrams illustrating exemplary states of a multi-foldable electronic device (1300) displaying a briefing screen according to various embodiments. The electronic device (101) of FIG. 2 may include a multi-foldable electronic device (1300) described with reference to FIG. 13a and / or FIG. 13b. The multi-foldable electronic device (1300) described with reference to FIG. 13a and / or FIG. 13b may perform the operation of the electronic device described with reference to FIG. 1 through FIG. 12b.

[0187] Referring to FIG. 13a and / or FIG. 13b, a multi-foldable electronic device (1300) may include housing parts (1311, 1312, 1313) connected via rotatable hinge assemblies. A first housing part (1311) may be rotatably coupled to a second housing part (1312). A second housing part (1312) may be rotatably coupled to a third housing part (1313). The multi-foldable electronic device (1300) may include a flexible display (1309) extending from the first housing part (1311) across the second housing part (1312) to the third housing part (1313). The state of the multi-foldable electronic device (1300) can be distinguished according to the folding and / or unfolding of the housing parts (1311, 1312, 1313).

[0188] Referring to FIG. 13a, a state (1301) included in a folded state (or fully folded state) of a multi-foldable electronic device (1300) is illustrated. In the folded state, the rear side of the first housing part (1311) (e.g., one side of the first housing part (1311) opposite to the front side where the flexible display (1309) is placed) may face the front side of the third housing part (1313) (e.g., one side of the third housing part (1313) where the flexible display (1309) is placed). In the folded state, the rear of the second housing part (1312) (e.g., one side of the second housing part (1312) opposite to the front where the flexible display (1309) is placed) may face the rear of the third housing part (1313) (e.g., one side of the third housing part (1313) opposite to the front where the flexible display (1309) is placed).

[0189] In the exemplary state (1301) of FIG. 13a, a first portion of the flexible display (1309) located on the first housing part (1311) may be activated with respect to the remaining portions of the flexible display (1309), and said remaining portions may be deactivated. For example, the multi-foldable electronic device (1300) may control the flexible display (1309) so that a black color fills said remaining portions. In the state (1301), the multi-foldable electronic device (1300) may display a briefing screen through said first portion. For example, at least a portion of the UI (810) may be displayed through said first portion. While displaying a briefing screen based on a UI (810) in which card objects (151, 152, 153, 154) are arranged in sequence, at least one of the housing parts (1311, 1312, 1313) of the multi-foldable electronic device (1300) may be rotated. For example, within state (1301), the first housing part (1311) may be rotated relative to the second housing part (1312).

[0190] The state (1302) of FIG. 13b may be included in the half-fold state of the multi-foldable electronic device (1300). For example, the multi-foldable electronic device (1300), having identified the rotation of the first housing part (1311) relative to the second housing part (1312) within the state (1301) of FIG. 13a, may switch to the state (1302) of FIG. 13b. In the half-fold state, the angle between the first housing part (1311) and the second housing part (1312) may be substantially 180°, and the angle between the second housing part (1312) and the third housing part (1313) may be substantially 360° with respect to one side on which the flexible display (1309) is placed. In the half-fold state, the portion of the flexible display (1309) located on the first housing part (1311) and the second housing part (1312) may have a flat shape.

[0191] Referring to FIG. 13b, in state (1302), the multi-foldable electronic device (1300) may display card objects (1321, 1323) corresponding to card objects (151, 152) having relatively high priorities in the UI (810) on a portion of the flexible display (1309) located on the first housing part (1311) and the second housing part (1312). The card object (1321) may be located on a portion of the flexible display (1309) located on the second housing part (1312), and the card object (1323) may be located on a portion of the flexible display (1309) located on the first housing part (1311). The sizes of the card objects (1321, 1323) may be larger than the sizes of the corresponding card objects (151, 152). In the state (1302) of FIG. 13b, together with card objects (1321, 1323), the multi-foldable electronic device (1300) can display texts (1322, 1324) expressing summaries of the contents of the card objects (1321, 1323). The texts (1322, 1324) can be obtained based on the execution of a language model based on the contents (e.g., the language model (255) of FIG. 2). In the state (1302) of FIG. 13b, the multi-foldable electronic device (1300) can display a card object (1321) having a relatively high priority in a relatively large size on a portion of the flexible display (1309) located on the second housing part (1312). In the state (1302) of FIG. 13b, the multi-foldable electronic device (1300) can display the remaining card objects (e.g., card object (1323)) on a portion of the flexible display (1309) located on the first housing part (1311), according to the size in the state (1301) and / or UI (810).

[0192] The state (1303) of FIG. 13b may be included in the unfolded state (or fully unfolded state) of the multi-foldable electronic device (1300). For example, the multi-foldable electronic device (1300), having identified the rotation of the third housing part (1313) relative to the second housing part (1312) within the state (1302) of FIG. 13b, may switch to the state (1303) of FIG. 13b. In the unfolded state, the angle between the first housing part (1311) and the second housing part (1312), and the angle between the second housing part (1312) and the third housing part (1313), may be substantially 180°. In the unfolded state, the entire flexible display (1309) may have a flat shape.

[0193] Referring to FIG. 13b, in state (1303), the multi-foldable electronic device (1300) can display card objects (1321, 1323, 1325) corresponding to card objects (151, 152, 153) having relatively high priorities within the UI (810) through the flexible display (1309). A card object (1321) located on the part of the flexible display (1309) located on the third housing part (1313) can correspond to a card object (151) included in the UI (810). A card object (1323) located on the part of the flexible display (1309) located on the second housing part (1312) can correspond to a card object (152) included in the UI (810). A card object (1325) located on a portion of the flexible display (1309) located on the first housing part (1311) may correspond to a card object (153) included in the UI (810). Together with the card objects (1321, 1323, 1325), the multi-foldable electronic device (1300) may display texts (1322, 1324, 1326) expressing summaries of the contents of the card objects (1321, 1323, 1325). The texts (1322, 1324, 1326) may be obtained based on the execution of a language model based on the contents (e.g., the language model (255) of FIG. 2).

[0194] FIG. 14 is a diagram illustrating an exemplary briefing screen displayed by an electronic device (1400) having a form factor of a tablet PC (personal computer) according to various embodiments. The electronic device (101) of FIG. 2 may include the electronic device (1400) described with reference to FIG. 14. The electronic device (1400) described with reference to FIG. 14 may perform the operation of the electronic device described with reference to FIG. 1 to FIG. 12b. With reference to FIG. 14, an example of a briefing screen displayed by the electronic device (1400) is illustrated. The briefing screen may include a portion (1410) where a card object (151) and / or texts (141, 142, 143) are located. The card object (151) may include content having the highest priority determined based on the operation described with reference to FIG. 1 to FIG. 12b. The texts (141, 142, 143) may include a summary of multiple contents, including content corresponding to the card object (151).

[0195] In the briefing screen, parts (1421, 1422) that are different from part (1410) may be referred to as padding areas. Based on a swipe gesture and / or a drag gesture in the padding area, the electronic device (1400) may scroll the briefing screen displayed through part (1410). An embodiment in which part (1410) is positioned in the center of the display based on parts (1421, 1422) is illustrated, but the position of part (1410) within the display is not limited thereto. For example, the electronic device (1400) may display a briefing screen including a card object (151) across the entire display area of ​​the display. In the above example, the electronic device (1400) may display content having the highest priority among the contents of the briefing screen in the central part of the display, and display the remaining content in the remaining part.

[0196] As described above, an electronic device according to one embodiment may display content generated by software applications along with text expressing a summary of said content. A screen containing the content and text may be referred to as a briefing screen. Within the briefing screen, said content may be arranged according to the priorities of each of said content. said priorities may be determined according to the status information of the electronic device, the status information of the user identified by the electronic device, and / or the importance of said content. The text expressing a summary of said content may be generated using a portion of said content that has a relatively high priority among said content.

[0197] FIG. 15 is a diagram illustrating exemplary states (1501, 1502, 1503, 1504) of an electronic device (101) that displays summary content for user-generated content (e.g., images and / or videos) according to various embodiments. The electronic device (101) of FIG. 15 may include the electronic device (101) of FIG. 1 and / or FIG. 2. An exemplary hardware configuration of the electronic device (101) of FIG. 15 is described in more detail below with reference to FIG. 17.

[0198] Referring to FIG. 15, within a state (1501) of displaying a briefing screen, the electronic device (101) may display texts (1121, 1122, 1124) and a card object (1123). The card object (1123) may include media content stored in the electronic device (101), such as images (1511, 1512), e.g., images and / or videos such as photographs. According to one embodiment, the electronic device (101) may identify user activities related to said media content using the media content stored in the electronic device (101). The electronic device (101) may generate or display text (1124) expressing a summary of the identified activity. The text (1124) and / or card object (1123) may be referred to as briefing content in terms of content summarizing the user's activity. The electronic device (101) can classify media content (e.g., grouping and / or clustering) using the location, time, and / or context of the user who acquired each media content (e.g., home and / or work) where each media content was acquired. Briefing content may correspond to a cluster and / or group of media content generated by classifying the media content. The operation of the electronic device (101) described with reference to FIGS. 15 through 26 may be performed to generate briefing content corresponding to a cluster of media content.

[0199] Referring to FIG. 15, in a state (1501) in which a briefing screen is displayed, the electronic device (101) may receive user input related to briefing content (e.g., a card object (1123) containing images (1511, 1512) and / or text (1124)). The user input may include a tap gesture (or a double tap gesture) on a portion of the display (110) in which the briefing content is displayed. Based on the user input, the electronic device (101) may provide a detailed view of the briefing content, as in state (1502). In state (1502), the electronic device (101) may display a screen for exploring a plurality of images included in a cluster corresponding to the briefing content. In state (1502), the electronic device (101) can display images (1511, 1512) having larger sizes than the images (1511, 1512) included in the briefing screen that were displayed in state (1501).

[0200] In the exemplary state (1502) of FIG. 15, the electronic device (101) may display images (1511, 1512) within a cluster corresponding to briefing content based on a scroll gesture. The scroll gesture may include a drag gesture and / or a swipe gesture performed along the horizontal direction (1521) of the display (110). Based on the scroll gesture, the electronic device (101) may change the image (1511) displayed through the display (110) to an image (1512) located next to the image (1511). In the state (1502), the electronic device (101) may display a visual object (1522) for switching to a state (1501) prior to the state (1502). In state (1502), the electronic device (101) may provide a grid view of images in a cluster (e.g., a view having the form of a two-dimensional grid) including images (1511, 1512). For example, based on user input related to a visual object (1523), the electronic device (101) may switch to state (1503). The images (1511, 1512) displayed in state (1502) may be arranged based on a carousel view.

[0201] In the state (1503) of FIG. 15, the electronic device (101) may display a screen containing card objects (1531, 1532) corresponding to each of the clusters. In each of the card objects (1531, 1532), images within the corresponding cluster may be arranged based on the form of a two-dimensional grid. In the state (1503), the electronic device (101) may display a UI object (1533) for creating and / or recommending clusters and briefing content based on said clusters. In the state (1503), the electronic device (101) may display a UI object (1534) for adding clusters.

[0202] In the exemplary state (1504) of FIG. 15, the electronic device (101) may provide a calendar view (or monthly view). The electronic device (101) may display, in the calendar view (1541) corresponding to a specific month, a representative image within a cluster of images acquired on each of the dates of said specific month in the form of a thumbnail object. The image of the thumbnail object may be not only a representative image within a cluster but also an image automatically generated based on a generative artificial intelligence model. In addition to the thumbnail object, the electronic device (101) may display the number of cluster(s) of images acquired on said date in the calendar view (1541). Based on the input for said thumbnail object, the electronic device (101) may provide a detail view of the cluster corresponding to said thumbnail object, as in state (1502). Based on an input for selecting a specific date of the calendar view (1541), the electronic device (101) may display clusters of images acquired on the specific date, such as in the state (1503). Based on an input for selecting a date in which no clusters were generated, the electronic device (101) may display a screen (e.g., an exemplary screen shown in FIG. 25) for generating clusters of images acquired on the selected date and / or briefing content for said clusters. The calendar view (1541) may be provided through a calendar application (e.g., the calendar application (241) of FIG. 2).

[0203] In the exemplary state (1504) of FIG. 15, the electronic device (101) can change the month corresponding to the calendar view (1541) based on a drag gesture and / or a swipe gesture performed on the calendar view (1541). For example, based on a drag gesture and / or a swipe gesture performed along the horizontal direction of the display (110), the electronic device (101) can change the month corresponding to the calendar view (1541). For example, based on a drag gesture performed along the left direction of the display (110), the electronic device (101) can increase the month corresponding to the calendar view (1541). For example, based on a drag gesture performed along the right direction of the display (110), the electronic device (101) can decrease the month corresponding to the calendar view (1541). Within the calendar view (1541), the electronic device (101) may apply a visual effect (e.g., dimming) indicating that cluster and / or briefing content cannot be generated on dates after today's date.

[0204] According to one embodiment, a software application for generating briefing content may be installed on an electronic device (101). An electronic device (101) that executes a smart suggestion application (e.g., the smart suggestion application (260) of FIG. 2) executed to display a briefing screen of a state (1501) may provide a notification related to the briefing content based on identifying the briefing content generated by the software application. The notification may be provided in the form of widget objects (111, 121) of FIG. 1.

[0205] According to one embodiment, an electronic device (101) can identify time information and / or location information of the electronic device (101). By identifying time information and location information satisfying specified conditions, the electronic device (101) can identify a first content and a second content among a plurality of contents acquired within a specified period, based on the first metadata of the first content and the second metadata of the second content. The plurality of contents acquired within a specified period may include images and / or videos. The electronic device (101) can generate at least one text information using a machine learning model based at least on the first content, the second content, the first metadata, and the second metadata. The at least one text information may express a summary of the first content and / or the second content. As in the states (1501, 1502) of FIG. 15, the electronic device (101) can display at least a portion of the first content and the second content in a first portion of the display (110). The electronic device (101) can display text corresponding to at least one generated text information in a second portion different from the first portion.

[0206] As described above, according to one embodiment, an electronic device (101) can identify at least one cluster of a plurality of images. The electronic device (101) that has identified a cluster containing a plurality of images can identify a portion of the plurality of images included in the cluster (e.g., images (1511, 1512)) by using time differences between the plurality of images included in the cluster. The electronic device (101) can obtain or generate text (1124) expressing a summary of the portion of the plurality of images. The electronic device (101) can display the obtained text (1124) in relation to the cluster. The text (1124) can represent user actions related to the images included in the cluster (e.g., images (1511, 1512)). The electronic device (101) can display the text (1124) together with the portion of the images included in the cluster (e.g., states (1501, 1502)).

[0207] FIG. 16 is a diagram illustrating an exemplary state (1601) of an electronic device (101) that displays a briefing screen according to various embodiments. The electronic device (101) of FIG. 15 can perform the operation of the electronic device (101) described with reference to FIG. 16. With reference to FIG. 16, an exemplary state (1601) of an electronic device (101) that displays a briefing screen generated based on the operation described with reference to FIG. 1 to FIG. 14 is illustrated.

[0208] Referring to FIG. 16, within a state (1601), the electronic device (101) may display a visual object (1610) for checking whether to generate briefing content (e.g., card object (1123) and / or text (1124) described with reference to FIG. 15) based on media content (e.g., images and / or videos) stored in the electronic device (101) within a briefing screen. The visual object (1610) may take the form of a dialog box included in the briefing screen. A visual object (1610) may include a UI object (1611) for receiving input that allows the creation of briefing content, along with text that guides the creation of briefing content (e.g., "Turn on the Daily Life category to see memorable moments in Now brief. To provide content about Daily Life, we will access my photos, videos, audio files, and calendar events."), and a UI object (1612) for receiving input that forgoes the creation of said briefing content. An electronic device (101) that receives user input associated with the UI object (1612) may stop displaying the visual object (1610) within the briefing screen.

[0209] In the state (1601) of FIG. 16, an electronic device (101) that receives user input related to a UI object (1611) can generate or display briefing content using media content stored in the electronic device (101). For example, the electronic device (101) can identify time information and location information of the electronic device (101). The electronic device (101) that has identified time information and / or location information satisfying specified conditions can identify a first content and a second content among the content acquired within a specified period based on the first metadata of the first content (e.g., metadata including time information of the first content) and the second metadata of the second content (e.g., metadata including time information of the second content). The electronic device (101) can generate or obtain at least one text information using a machine learning model based on the first content, the second content, the first metadata, and the second metadata. The electronic device (101) can display at least a portion of the first content and the second content on a first portion of the display (110) (e.g., the portion where the card object (1123) of FIG. 15 is placed). The electronic device (101) can display text corresponding to the generated at least one text information on a second portion different from the first portion (e.g., the portion where the text (1124) of FIG. 15 is placed).

[0210] FIG. 17 is a block diagram illustrating an exemplary configuration of an electronic device (101) according to various embodiments. Referring to FIG. 17, the electronic device (101) may have a form factor of a bar-type smartphone (291), as well as a foldable-type smartphone (292), an HMD device (293), and / or a laptop PC (294). The electronic device (101) may include a processor (210), memory (220), and / or a display (110). The hardware of the electronic device (101) of FIG. 17 may correspond to the hardware of the electronic device (101) of FIG. 2. Among the descriptions of the hardware of FIG. 17, descriptions that overlap with the descriptions of the hardware of FIG. 2 may not be repeated.

[0211] Referring to FIG. 17, software applications (240) installed in an electronic device (101) are illustrated. The software applications (240) of FIG. 17 may correspond to the software applications (240) of FIG. 2. In one embodiment, based on the software applications (240), media content stored in the electronic device (101) (e.g., images and / or videos obtained by running a camera application) may be stored in memory (220). According to one embodiment, a processor (210) of the electronic device (101) may run a moments application (1250) to identify cluster(s) of media content stored in memory (220). Based on identifying the clusters of media content, the processor (210) that ran the moments application (1250) may obtain or generate a summary of said clusters. To obtain text expressing the above summary, the processor (210) may execute a language model (255) and / or an image recognition model (1760). The language model (255) of FIG. 17 may correspond to the language model (255) of FIG. 2. In the view that it is installed in an electronic device (101) owned by a user, the language model (255) and / or the image recognition model (1760) may be referred to as an on-device model. The operation of the electronic device (101) that executed the Moments application (1250) will be described in more detail later with reference to FIG. 18.

[0212] Referring to FIG. 17, the boxes included in the Moments application (1250) may represent functions supported by the Moments application (1250). For example, the finder (1752) may correspond to the function of the Moments application (1250) of classifying (e.g., clustering) media content (e.g., images and / or videos) stored in the memory (220) of the electronic device (101) according to criteria including location, context, and / or time, and may include various circuits and / or executable program instructions. An exemplary operation of the electronic device (101) executing the finder (1752) is described in more detail later with reference to FIG. 19.

[0213] For example, the selector (1754) may correspond to the function of a moment's application (1250) for identifying and / or filtering at least one media content to be used to obtain text expressing a summary of the cluster from a specific cluster of media content, and may include various circuits and / or executable program instructions. An exemplary operation of the electronic device (101) executing the selector (1754) is described in more detail below with reference to FIG. 20.

[0214] For example, the filter (1756) may correspond to the function of the Moments application (1250) for verifying at least one media content identified based on the selector (1754) (e.g., verification of images and / or videos based on harmfulness, violence, obscenity, and / or mood) and may include various circuits and / or executable program instructions.

[0215] For example, the writer (1758) may correspond to the function of a moment's application (1250) that executes a language model (255) using at least one verified media content based on a filter (1756) and may include various circuits and / or executable program instructions. For example, the electronic device (101) may obtain text expressing a summary of the at least one media content from the language model (255). In the language model (255), the electronic device (101) may input or apply metadata (e.g., time and / or location) of the at least one media content along with the verified at least one media content.

[0216] In one embodiment, the electronic device (101) may (automatically) execute a Moments application (1250) at a specific time and / or at a specific place. Based on the execution of the Moments application (1250), the electronic device (101) may obtain a cluster of media content and text expressing a summary of the media content included in the cluster. The briefing content including the cluster and / or the text may be generated based on the user's activity identified by the electronic device (101), such as payment and / or exercise. The briefing content may be generated based on the user's health information (e.g., heart rate, sleep time, and / or ECG (electrocardiogram)) and / or audio signals (e.g., music) output by the electronic device (101).

[0217] As described above, according to one embodiment, an electronic device (101) may generate or acquire briefing content including at least one of the images included in a cluster and / or text expressing a summary of said cluster. The electronic device (101) may store said briefing content in memory (220). For example, said briefing content may be stored in the document DB (250) of FIG. 2. While displaying the home screen, the electronic device (101) may display a widget object based at least on said briefing content (e.g., a widget object referred to as Now Bar and / or widget objects (111, 121) of FIG. 1). The electronic device (101) may display said text and at least one of the images included in said cluster through the display (110) based on user input associated with said widget object (e.g., states (1501, 1502, 1503) of FIG. 15).

[0218] FIG. 18 is a flowchart illustrating exemplary operations of an electronic device according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, and / or the processor (210) of FIG. 17 may perform the operations of FIG. 18. The order in which the operations of FIG. 18 are performed may differ from the exemplary order of FIG. 18. For example, the electronic device (101) and / or the processor (210) of FIG. 17 may perform the operations of FIG. 18 in an order different from the order shown in FIG. 18. For example, the electronic device (101) and / or the processor (210) of FIG. 17 may perform at least two of the operations of FIG. 18 substantially simultaneously. The operations of FIG. 18 may be performed by an electronic device that executes the Moments application (1250) of FIG. 17. Although an exemplary operation of the electronic device for an image is described, the electronic device can also perform an operation similar to that of FIG. 18 for a video.

[0219] Referring to FIG. 18, in operation (1810), an electronic device according to one embodiment can identify at least one cluster associated with a plurality of images. The plurality of images in operation (1810) may each correspond to files based on JPEG (joint photographic experts group), PNG (portable network graphics), and / or HEIF (high efficiency image file format). For example, the electronic device can perform operation (1810) by executing the finder (1752) of FIG. 17. The electronic device can perform operation (1810) using the locations and / or times when each of the plurality of images was captured. Information indicating said locations and / or said times may be included in the metadata of the plurality of images. The electronic device can perform operation (1810) using the context at the time when the plurality of images were captured (e.g., context information identified based on the context engine (280) of FIG. 2). An exemplary operation of an electronic device for identifying at least one cluster based on operation (1810) is described in more detail below with reference to FIG. 19.

[0220] Referring to FIG. 18, in operation (1820), an electronic device according to one embodiment can identify a portion of images included in a cluster by using metadata of the images included in the cluster. The metadata may have a data structure of EXIF ​​(exchangeable image file format). The electronic device can perform operation (1820) by executing the selector (1754) of FIG. 17. An exemplary operation of the electronic device for identifying a portion of images included in a cluster based on operation (1820) is described in more detail below with reference to FIG. 20 and / or FIG. 21.

[0221] Referring to FIG. 18, within operation (1830), an electronic device according to one embodiment may obtain text expressing a summary of a portion of images included in a cluster. The electronic device may obtain the text of operation (1830) by executing the language model (255) of FIG. 17. To obtain the text of operation (1830), the electronic device may execute the image recognition model (1760) of FIG. 17 to obtain text regarding the portion of images identified based on operation (1820). By executing the language model (255) of FIG. 17 using the text, the electronic device may obtain the text of operation (1830). An exemplary prompt provided to the language model for obtaining the text of operation (1830) is described in more detail below with reference to FIG. 22. Because, instead of all images included in the cluster being input into the language model, only a portion of the images identified based on the action (1820) is input into the language model, the electronic device can acquire the text of the action (1830) more quickly. In order to acquire a summary of the images and / or the cluster using the portion of the images included in the cluster, the electronic device may select representative image(s) for the cluster from among the plurality of images based on the action (1820).

[0222] Referring to FIG. 18, within operation (1840), an electronic device according to one embodiment may display text obtained in relation to a cluster. For example, the electronic device may generate or store briefing content including text obtained based on operation (1830). The briefing content may be displayed along with other card objects within a briefing screen, as in state (1501) of FIG. 15. The electronic device may provide or display a detail view of the briefing content, as in state (1502) of FIG. 15.

[0223] FIG. 19 is a diagram illustrating exemplary operations of an electronic device according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, and / or the processor (210) of FIG. 17 may perform the operations of FIG. 19. The operations of the electronic device described with reference to FIG. 19 may be related to the finder (1752) of FIG. 17 (or the moment application (1250) including the finder (1752)) and / or the operations (1810) of FIG. 18. The order in which the operations of FIG. 19 are performed is not limited to the order shown in FIG. 19. For example, the electronic device (101) of FIG. 17 and / or the processor (210) may perform the operations of FIG. 19 in a different order than the order shown in FIG. 19. For example, the electronic device (101) and / or processor (210) of FIG. 17 can perform at least two of the operations of FIG. 19 substantially simultaneously.

[0224] Referring to FIG. 19, within operation (1910), an electronic device according to one embodiment may acquire media content (e.g., images, videos). The electronic device may identify media content acquired during one day (e.g., the current date), one week (e.g., a week including the current date), and / or one month (e.g., a month including the current date). The electronic device may identify metadata corresponding to the media content. For example, using the metadata, the electronic device may identify media content acquired during the period. For example, the electronic device may identify media content between the time when the briefing content was last created and the current time. Using the media content acquired based on operation (1910), the electronic device may perform the remaining operations of FIG. 19. Operation (1910) may be performed by executing the collector (1901) of the finder (1752).

[0225] Referring to FIG. 19, within operation (1920), an electronic device according to one embodiment can determine clusters of acquired media content. For example, by using at least one of the time or location of each of the media content stored in memory (e.g., memory (220) of FIG. 17), the electronic device can identify or determine at least one cluster of said media content. For example, the electronic device can classify the media content using time intervals referred to as morning, afternoon, and / or evening. For example, the electronic device can classify the media content using the locations of the electronic device at the time when the media content was stored (e.g., home, work, or other locations identified by the electronic device). For example, if a user has recorded and / or captured media content at different locations, the electronic device can identify or acquire clusters of media content(s) corresponding to each of said locations. Operation (1920) can be performed by executing the cluster (1902) of the finder (1752).

[0226] Referring to FIG. 19, within operation (1930), an electronic device according to one embodiment can determine the order of clusters. For example, the electronic device can determine the order of clusters by using the occurrence times and / or occurrence order of events corresponding to each of the clusters. For example, the electronic device can determine the order of clusters by using the size of the time interval corresponding to the clusters (e.g., the time interval between the creation time of the first media content created among the media content included in the clusters and the creation time of the last media content created). For example, the electronic device can determine the order of clusters by using the number of media content included in each of the clusters. For example, the electronic device can identify or determine the order of clusters according to the type of events corresponding to each of the clusters. The order of clusters determined based on operation (1930) may be the order of displaying briefing content corresponding to each of the clusters.

[0227] Referring to FIG. 19, in operation (1940), an electronic device according to one embodiment can verify clusters. For example, the electronic device can compare the number of media contents of each cluster with a threshold. For example, for a cluster containing media contents below the threshold, the electronic device can discard or remove the cluster. For example, the electronic device can refrain from or stop generating briefing content for a cluster containing media contents below the threshold. With a cluster containing media contents exceeding the threshold, the electronic device can execute a selector (1754) or perform the operations of FIG. 20.

[0228] FIG. 20 is a flowchart illustrating exemplary operations of an electronic device according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, and / or the processor (210) of FIG. 17 may perform the operations of FIG. 20. The operations of the electronic device described with reference to FIG. 20 may be related to the selector (1754) (or moment application (1250)) of FIG. 17 and / or the operation (1820) of FIG. 18. The order in which the operations of FIG. 20 are performed is not limited to the order shown in FIG. 20. For example, the electronic device (101) of FIG. 17 and / or the processor (210) may perform the operations of FIG. 20 in a different order than the order shown in FIG. 20. For example, the electronic device (101) and / or processor (210) of FIG. 17 can perform at least two of the operations of FIG. 20 substantially simultaneously.

[0229] Referring to FIG. 20, in operation (2010), an electronic device according to one embodiment may arrange media contents using chronological order. The media contents of operation (2010) may be included in a cluster obtained by executing the finder (1752) of FIG. 17 (or by performing the operations of FIG. 19). The electronic device may obtain or determine the chronological order of each of the media contents included in a specific cluster.

[0230] Referring to FIG. 20, in operation (2015), according to one embodiment, an electronic device may filter a portion of media content acquired by the electronic device. For example, the electronic device may remove screenshots and / or media content downloaded via the Internet (e.g., mail server and / or messenger server) from the cluster by using the metadata of each of the media content. For example, the electronic device may extract or identify media content captured using a camera (e.g., a camera included in the electronic device). Using the media content acquired using the camera identified based on operation (2015), the electronic device may perform the remaining operations of FIG. 20.

[0231] Referring to FIG. 20, in operation (2020), an electronic device according to one embodiment may filter media content(s) that are captured in succession. For example, the electronic device may not select at least one media content acquired with a time difference of less than a threshold time difference (e.g., 5 seconds) as candidate media content to be used to acquire text expressing a summary of the cluster. For example, among the media content acquired based on a continuous shooting mode, the electronic device may not select the remaining media content that is different from one media content as candidate media content, or may remove it from the cluster. For example, the electronic device may compare the media content and not select substantially similar media content as candidate media content, or may remove it from the cluster.

[0232] Referring to FIG. 20, in operation (2025), an electronic device according to one embodiment may assign weights to media contents using a time difference. For the remaining media contents within a cluster that are different from the media contents excluded from the cluster based on operations (2015, 2020), the electronic device may perform operation (2025). Before performing operation (2025), the electronic device may initialize weights (or scores) corresponding to each of the media contents.

[0233] By performing operation (2025), the electronic device may assign weights and / or scores to media contents included in a cluster according to the time differences between the media contents. For example, the electronic device may assign a first score to media contents having a first time difference, and may assign a second score less than the first score to media contents having a second time difference longer than the first time difference. For example, the electronic device may assign relatively large weights to media contents having a relatively small time difference. In other words, the electronic device that has identified media contents having a relatively small time difference may identify the user's intention to capture the media contents at the time the media contents are captured.

[0234] Referring to FIG. 20, in operation (2030), an electronic device according to one embodiment may change the weights of media content based on person(s) corresponding to the media content. For example, the electronic device may change each of the assigned weights based on operation (2025) using the size of the area associated with the person within the corresponding media content. For example, the electronic device may change the weights corresponding to the media content using the number of person(s) identified from the media content and / or the size of the area associated with the person within the media content. In the above example, the weights may be increased in proportion to the number and / or the size. In the above example, the weights may be increased based on the multiplication of the number and the size.

[0235] Referring to the operations (2020, 2025) of FIG. 20, the electronic device can identify or determine a portion of media content to be used to generate briefing content from the media content by utilizing the timings at which the media content was acquired. For example, based on operation (2020), the electronic device can identify the remaining media content excluding the media content that was captured in succession. In the above example, based on operation (2025), the electronic device can acquire a portion of the media content captured with a relatively small time difference among the remaining media content. Using the acquired portion, the electronic device can perform the remaining operations of FIG. 20 for generating briefing content.

[0236] Referring to FIG. 20, in operation (2035), an electronic device according to one embodiment may change the weights of media content using tags of media content. One or more tags may be assigned to media content based on object recognition. In the present disclosure, tags may include keywords representing the category and / or subject of media content (e.g., keywords such as food, mountain, river, exercise, group photo, and / or landscape). The electronic device may change each of the weights determined based on operations (2025, 2030) using at least one tag assigned to the corresponding media content. For example, the weight of the media content may be changed using preset weights corresponding to each of the tags. For example, the electronic device may combine the weights corresponding to each of the tags assigned to the specific media content with the weight corresponding to the specific media content (e.g., weighted sum).

[0237] Referring to FIG. 20, in operation (2040), an electronic device according to one embodiment may check (e.g., determine) whether the number of filtered media contents exceeds zero. For example, the electronic device may check the number of media contents in a cluster from which at least one media content has been removed based on operations (2015, 2020). If the number of media contents is zero or less (2040-No), the electronic device may perform operation (2065). If the number of media contents exceeds zero (2040-Yes), the electronic device may perform operation (2045).

[0238] Referring to FIG. 20, in operation (2045), an electronic device according to one embodiment can identify at least one media content using weights. For example, the electronic device can identify a portion of media content included in a cluster using the weights of each media content determined based on operations (2025, 2030, 2035). For example, the electronic device can identify two or three media contents having the highest weight based on the descending order of the weights.

[0239] Referring to FIG. 20, within operation (2050), an electronic device according to one embodiment can verify at least one identified media content. For example, the electronic device can check whether at least one media content identified based on operation (2045) depicts a violent, sexually explicit, or unethical scene. If at least one media content depicts a violent, sexually explicit, or unethical scene, the electronic device can remove said at least one media content from the cluster or exclude it from candidate media content to be used to generate a summary for said cluster.

[0240] In one embodiment, the electronic device may perform an operation (2050) using metadata corresponding to the media content (e.g., tag(s) assigned to the media content represented by the metadata). For example, if the tag(s) corresponding to the media content correspond to a designated tag for verification of the operation (2050), the electronic device may remove the media content from the cluster. A list of tag(s) for filtering the media content (e.g., a block list) may be stored in the electronic device.

[0241] For verification of operation (2050), the image recognition model (1760) of FIG. 17 may be executed. For example, an electronic device may execute the image recognition model to obtain text expressing a description of at least one media content of operation (2045). Based on identifying at least one word (e.g., filtering keywords) from the text set for verification of operation (2050), the electronic device may remove the at least one media content from the cluster.

[0242] Referring to FIG. 20, in operation (2055), an electronic device according to one embodiment may check whether the number of verified media contents corresponds to a reference number. The reference number of operation (2055) may be 3. If, based on operation (2050), the number of verified media contents corresponds to the reference number (2055-Yes), the electronic device may perform operation (2060). If, based on operation (2050), the number of verified media contents does not correspond to the reference number (2055-No), the electronic device may (again) perform at least one of operations (2040, 2045, 2050, 2055, 2065).

[0243] Referring to FIG. 20, within operation (2060), an electronic device according to one embodiment may generate briefing content using verified media content. For example, the electronic device may execute the language model (255) of FIG. 17 using a reference number of media content of operation (2055). For example, the electronic device may generate or obtain briefing content using a reference number of media content of operation (2055) and metadata of said media content. The briefing content may include text expressing a summary of said media content. The briefing content may be linked with at least one media content filtered based on operations (2015, 2020).

[0244] Referring to FIG. 20, in operation (2065), an electronic device according to one embodiment may refrain from or stop generating briefing content corresponding to the cluster.

[0245] Below, with reference to FIG. 21, an exemplary operation of an electronic device that assigns weights to each of the media contents based on operations (2025, 2030, 2035) is described in more detail.

[0246] FIG. 21 is a diagram illustrating an exemplary operation of an electronic device for determining weights of each of a plurality of images according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, and / or the processor (210) of FIG. 17 may perform the operation of the electronic device described with reference to FIG. 21. The operation of the electronic device described with reference to FIG. 21 may be related to the operation of the electronic device of FIG. 20.

[0247] Referring to FIG. 21, images, which are media contents included in a cluster, may be arranged according to the time order in which each of the images was captured. An electronic device may filter the images (2112) by performing the operations (2015, 2020) of FIG. 20. For example, the electronic device may filter the images (2112) that are taken in succession in each of time intervals a to u having a specified time length (e.g., about 5 seconds). Among the images included in the cluster, the electronic device may assign weights to images (2111) that are different from the images (2112).

[0248] In the state (2101) of FIG. 21, the electronic device may initialize the weights of all images (2111) to 0. The numbers written on the images (2111) indicated by boxes may represent the weight (or score) assigned to each of the images (2111). In the state (2101), the electronic device may perform the operation (2025) of FIG. 20 to determine the weights of the images (2111) using the time difference between the images. The state (2102) of FIG. 21 may be a state in which a weight based on the time difference is assigned to the corresponding image. Referring to the exemplary state (2102) of FIG. 21, images (2121, 2122) having a small time difference from other images may have higher weights than other images.

[0249] In the state (2102) of FIG. 21, the electronic device may determine weights corresponding to each of the images by using whether a person is captured in each of the images. The state (2103) of FIG. 21 may be a state in which weights are adjusted according to whether a person is captured in the image. Referring to the exemplary state (2103) of FIG. 21, the weights of the images (2131) in which a person is captured may be increased, and the weights of the remaining images may be maintained.

[0250] In the state (2103) of FIG. 21, the electronic device may change or determine the weight of at least one of the images using the tags of each of the images. The state (2104) of FIG. 21 may be a state in which the weight of the image is adjusted using the tags. Referring to the state (2104) of FIG. 21, the weight of the images (2141) to which a tag indicating that food has been captured is assigned may be increased, and the weights of the remaining images may be maintained.

[0251] In state (2104) of FIG. 21, the electronic device may determine the image with the highest weight as the image to be used to generate a summary for the cluster. For example, the electronic device may determine the image (2151) with a weight of 11 as the image to be used to generate a summary for the cluster. In state (2105) after selecting the image (2151), the electronic device may initialize the weight corresponding to the image (2151) to 0. In state (2105), the electronic device may reduce the weights of images adjacent to the image (2151). In state (2105), the electronic device may determine the image with the highest weight as the image to be used to generate a summary for the cluster. For example, the electronic device may determine the image (2161) with a weight of 9 as the image to be used to generate a summary for the cluster. The state (2106) of FIG. 21 is a state after selecting an image (2161), in which the electronic device can initialize the weight corresponding to the image (2161) to 0 and reduce the weights of images adjacent to the image (2161). After the state (2106), the electronic device can obtain or generate text expressing a summary of the cluster using the images (2151, 2161).

[0252] As described above, the electronic device may determine, among the images included in the cluster, images (2151, 2161) to be used to generate a natural language summary associated with the cluster. Although the operation of the electronic device to select two images (2151, 2161) has been described, the number of images extracted by the electronic device to generate a natural language summary is not limited thereto. Although the operation of the electronic device to reduce the weights of images (2151, 2161) and other images adjacent to images (2151, 2161) (on the time axis) while selecting images (2151, 2161) has been described, the present disclosure is not limited thereto. For example, the electronic device may select or extract a specified number (e.g., two to three) of images having relatively high weights (or having weights exceeding a threshold) within state (2104) without changing the weights.

[0253] FIG. 22 is a diagram illustrating an exemplary operation of an electronic device that generates briefing content (2230) using images included in a cluster according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, and / or the processor (210) of FIG. 17 may perform the operation of the electronic device described with reference to FIG. 22. The operation of the electronic device described with reference to FIG. 22 may be related to the writer (1758) of FIG. 17 and / or the operation (1830) of FIG. 18.

[0254] Referring to FIG. 22, images (2210) identified from a cluster are illustrated. Images (2210) including image (1511) may be selected or extracted from a plurality of images within the cluster based on the operation described with reference to FIG. 18 through FIG. 21. An embodiment in which three images (2210) are extracted from a plurality of images within the cluster is illustrated, but the present disclosure is not limited thereto. An electronic device may execute an image recognition model (1760) using images (2210) and a prompt (2201). The prompt (2201) may include natural language sentence(s) for generating descriptive text for each of the images (2210), such as "Describe the image in 3 sentences in English." By executing the image recognition model (1760), the electronic device may obtain descriptive texts (2220) corresponding to each of the images (2210). For example, the descriptive text (2221) may include natural language sentence(s) to describe the image (1511).

[0255] Referring to FIG. 22, the electronic device can execute a language model (255) using a description text (2221) and / or a prompt (2202). Table 4 may show an exemplary prompt (2202) that is input into the language model (255).

[0256] I took the photos for me today. When you see my photos, what would you say about my day Your reply should be conversational as if an acquaintance was talking to me.<photo information> - Scene 1* description : {image description}* taken time : {hh:mm:ss}- Scene 2- description : {image description}* taken time : {hh:mm:ss}- Scene 3* description : {image description}* taken time : {hh:mm:ss}- Write shortly and concisely in 3 sentences.Result {"title": "Graceful Moments in Water", "description": "Your backstroke captured such a serene and precise The calm water and clear skies really highlight your grace. The sunlight shimmering on the surface adds a peaceful touch to the whole scene."}

[0257] Referring to Table 4, descriptive texts (2220) may be inserted into the {image description} of the prompt (2202). The taken time in Table 4 may indicate the times when each of the images (2210) was captured. Referring to Table 4, the prompt (2202) may include a command to generate summary text for the images (2210) (e.g., "Write shortly and concisely in 3 sentences."). The prompt (2202) may include text (e.g., "result") indicating the format of the text to be obtained from the language model (255).

[0258] By executing a language model (255) using descriptive texts (2220) and / or a prompt (2202), the electronic device can obtain text expressing a summary of images (2210). The electronic device can generate or obtain briefing content (2230) linked to a cluster containing the text and images (2210). The briefing content (2230) can be registered or stored in the document DB (250) of FIG. 2.

[0259] As described above, the electronic device may generate or obtain a natural language summary for said cluster by using some of the images included in the cluster (e.g., images (2210)). The electronic device may identify or extract a few images (2210) representing said cluster based on the operation described with reference to FIGS. 19 through 21. Using said images (2210), the electronic device may obtain or generate a natural language summary for said cluster by executing an on-device model, an image recognition model (1760) and / or a language model (255). Although an exemplary operation of the electronic device generating briefing content (2230) using both models (e.g., image recognition model (1760) and language model (255)) has been described, the present disclosure is not limited thereto. For example, a model may be used to generate explanatory texts (2220) and / or natural language summaries.

[0260] Below, with reference to FIG. 23a, FIG. 23b, and / or FIG. 24, an exemplary operation of an electronic device displaying briefing content (2230) is described in more detail.

[0261] FIGS. 23a and 23b are diagrams illustrating exemplary layouts of images included in briefing content according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, and / or the processor (210) of FIG. 17 may perform the operation of the electronic device (101) described with reference to FIG. 23a and / or FIG. 23b. The operation of the electronic device (101) described with reference to FIG. 23a and / or FIG. 23b may be related to the smart suggestion application (260) of FIG. 2, the moments application (1250) of FIG. 17, and / or the operation (1840) of FIG. 18.

[0262] Referring to FIG. 23a and / or FIG. 23b, exemplary states (2301, 2302, 2303, 2304, 2305, 2306) of an electronic device (101) displaying briefing content (e.g., briefing content (2230) of FIG. 22) generated based on the operation described with reference to FIG. 15 through FIG. 22 are illustrated. For example, the states (2301, 2302, 2303, 2304, 2305, 2306) of FIG. 23a and / or FIG. 23b may be described as exemplary states of an electronic device (101) including a briefing screen containing briefing content.

[0263] Referring to FIG. 23a, the state (2301) of an electronic device (101) displaying a card object (2310) corresponding to briefing content is illustrated. For example, the electronic device (101) may display a briefing screen containing a card object (2310). Within the briefing screen, another card object (2315) may be positioned below the card object (2310). Based on the operation described with reference to FIG. 1 through 14, the electronic device (101) may display a briefing screen containing text expressing a summary of the content corresponding to the card objects (2310, 2315).

[0264] Referring to the exemplary state (2301) of FIG. 23a, the card object (2310) may include at least one image (e.g., image (2311)) within a cluster corresponding to briefing content. If the cluster includes multiple images, the electronic device (101) may display the image (2311) superimposed on other images on the card object (2310). On the image (2311), the electronic device (101) may display text (e.g., "dinner") expressing a summary of the briefing content. While displaying the card object (2310) containing the image (2311), the electronic device (101) may receive user input to search for images within the cluster within the card object (2310). For example, the user input may be identified based on a drag gesture and / or a swipe gesture performed along the horizontal direction (2319) of the display (110), starting from a point (p) on the image (2311). Based on identifying the user input within the state (2301) of FIG. 23a, the electronic device (101) may display the image (2312) following the image (2311) through the display (110), as in the state (2302) of FIG. 23a.

[0265] Referring to FIG. 23b, exemplary states (2303, 2304, 2305, 2306) are illustrated in which images (2311, 2312) are displayed along with text included in the briefing content (e.g., "There are so many delicious moments. It’s really nice to see everyone sitting around the table. You prepared the food well, and the atmosphere is really nice.") through the briefing screen. For example, as in state (2303), the electronic device (101) may display at least two images among the cluster images (2311, 2312) corresponding to the briefing content in a superposition. In state (2303), the electronic device (101) may display a map image (2331) indicating the location where the cluster images containing the images (2311, 2312) were captured, along with the images (2311, 2312). For example, as in state (2304), the electronic device (101) can display images (2311, 2312, 2343) within a cluster corresponding to the briefing content based on a cloud-shaped closed curve. For example, as in state (2305), the electronic device (101) can display images (2311, 2312, 2343) within a cluster corresponding to the briefing content together with a map image (2331). Referring to the exemplary state (2305) of FIG. 23b, the images (2311, 2312, 2343) and the map image (2331) can be arranged in a grid form within the briefing screen. For example, within state (2306), the electronic device (101) can display images (2311, 2312) within the cluster and display a map image (2331) based on a circular closed curve.

[0266] In the briefing screen, the order in which media content included in the cluster is displayed is not limited to the exemplary layouts of FIG. 23a and / or FIG. 23b. For example, the electronic device (101) may determine the order using an order set by the user. For example, the electronic device (101) may display a video included in the cluster through the briefing screen. For example, the electronic device (101) may repeatedly play at least a portion of the video (e.g., loop). The map image (2331) may include a pin object representing a location associated with the images within the cluster. Within the map image (2331), the pin object may be aligned to the center of the map image (2331). The map image (2331) may include a name representing the location.

[0267] FIG. 24 is a diagram illustrating exemplary states (2401, 1502) of an electronic device (101) displaying briefing content according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, and / or the processor (210) of FIG. 17 may perform the operation of the electronic device (101) described with reference to FIG. 24. The operation of the electronic device (101) described with reference to FIG. 24 may be performed based on the execution of the Moments application (1250) of FIG. 17. The operation of the electronic device (101) described with reference to FIG. 24 may be related to the operation (1840) of FIG. 18.

[0268] Referring to FIG. 24, a state (2401) is shown that displays a home view provided for the execution of the Moments application (1250) of FIG. 17. In state (2401), the electronic device (101) may display a UI object for switching to the state (1504) of FIG. 15. In state (2401), the electronic device (101) may display card object(s) corresponding to briefing content(s) generated during a specified period (e.g., today's date). In the exemplary state (2401) of FIG. 24, the electronic device (101) may display text expressing a summary of the cluster (e.g., "It must have been a really fun day! Looking at the photos, it is really nice to see you laughing and chatting while grilling delicious meat.") along with images (1511, 1512) included in the cluster. Along with the text above, the electronic device (101) may display text related to the time (e.g., text expressing the time and / or date) and / or place (e.g., text including a place name and / or address) when the images (1511, 1512) were acquired. The electronic device (101) may further display text indicating the time when the briefing content including the cluster and the text was generated and / or the location associated with the cluster.

[0269] Referring to the exemplary state (2401) of FIG. 24, the electronic device (101) may display a UI object (2414) associated with a list of briefing contents. Based on user input indicating a selection of the UI object (2414), the electronic device (101) may display a popup menu (2430). The popup menu (2430) may include a list of briefing contents generated during a specified period. Through the popup menu (2430), the electronic device (101) may receive user input to determine and / or select briefing contents to be displayed through the display (110).

[0270] Referring to FIG. 24, an electronic device (101) that identifies user input (e.g., input based on a tap gesture and / or a double tap gesture) for at least one of the images (1511, 1512) can provide a detailed view of briefing content including the images (1511, 1512), as in the state (1502) of FIG. 24. Among the descriptions of the state (1502) of FIG. 24, descriptions that overlap with the descriptions of the state (1502) of FIG. 15 may not be repeated.

[0271] In the state (1502) of FIG. 24, the electronic device (101) may display text expressing a summary of images (1511, 1512) (or a cluster containing images (1511, 1512). In the state (1502) of FIG. 24, the electronic device (101) may display the time of the cluster and / or the creation time of the briefing content. In the state (1502) of FIG. 24, the electronic device (101) may display location information of the cluster.

[0272] Referring to the exemplary state (1502) of FIG. 24, the electronic device (101) may display a UI object (2421) for creating story content corresponding to said specific cluster, along with a detail view of said specific cluster. The story content may be a video summary of said cluster, which is content set to sequentially play images and / or videos included in said cluster. Based on user input related to the UI object (2421), the electronic device (101) may display a pop-up window (2440) on the display (110). The pop-up window (2440) may include a UI object (2441) for confirming the creation of the story content. The pop-up window (2440) may include a UI object (2442) for stopping the creation of the story content. For example, based on user input related to a UI object (2441), the electronic device (101) may generate or store story content, which is a video summary of a cluster containing images (1511, 1512). For example, based on user input related to a UI object (2442), the electronic device (101) may stop displaying a pop-up window (2440), stop generating story content, or refrain from doing so. In the above example, the story content generated by the electronic device (101) may be stored in the memory of the electronic device (101) (e.g., memory (220) of FIG. 17). The story content may be played by a software application for browsing and / or sharing media content, including a gallery application.

[0273] FIG. 25 is a diagram illustrating exemplary states (1503, 2501, 2502) of an electronic device (101) for editing briefing content according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, and / or the processor (210) of FIG. 17 may perform the operation of the electronic device (101) described with reference to FIG. 25. The operation of the electronic device (101) described with reference to FIG. 25 may be performed based on the execution of the Moments application (1250) of FIG. 17.

[0274] Referring to FIG. 25, in a state (1503) in which card objects (1531, 1532) corresponding to each briefing content are displayed, the electronic device (101) may receive user input for editing a specific briefing content. The user input may include, for example, a long-press input for a card object (1531). The user input may include an input for selecting an item for editing the briefing content from a pop-up menu displayed based on the long-press input. Based on the user input, the electronic device (101) may display an editing screen for the briefing content, such as in state (2501).

[0275] Referring to FIG. 25, in a state (2501) of displaying an editing screen, the electronic device (101) may display images within a cluster corresponding to briefing content through a portion (2513). The thumbnail objects of the images displayed through the portion (2513) may include UI objects for receiving feedback on each image (e.g., a like icon and / or an icon for removing from the cluster). For example, a UI object for selecting a representative image among the images within the cluster (e.g., a like icon) may be displayed on the thumbnail object. For example, a UI object for removing a specific image from the cluster (e.g., a minus icon) may be displayed on the thumbnail object.

[0276] In the exemplary state (2501) of FIG. 25, the electronic device (101) may display text included in the briefing content through a portion (2514). The text may represent or express a summary of the images within the briefing content obtained using the language model (255) of FIG. 17. The electronic device (101) may display UI objects (2515, 2516) for changing the text displayed through the portion (2514). The UI object (2515) may correspond to a function for changing the text displayed through the portion (2514) by executing the language model (255) of FIG. 17 or the language model of a server connected to the electronic device (101). The UI object (2516) may correspond to a function for editing images within the cluster corresponding to the briefing content or for creating other briefing content.

[0277] Referring to FIG. 25, an exemplary state (2502) of an electronic device (101) for displaying a screen for creating and / or editing briefing content is shown. In state (2502), the electronic device (101) may display a text box (2524) for obtaining text different from the text displayed through part (2514). In state (2502), the electronic device (101) may display a text box (2523) for obtaining the title of the briefing content. In state (2502), the electronic device (101) may display a virtual keyboard (2525) for entering text into the text boxes (2523, 2524). In the state (2502) of FIG. 25, based on an input indicating the selection of a visual object (2522) containing designated text such as "Save", the electronic device (101) may generate or save briefing content associated with text boxes (2523, 2524) and / or images within a cluster. The present disclosure is not limited thereto, but based on an input indicating the selection of a UI object (2521) in the state (2502) of FIG. 25, the electronic device (101) may refrain from or stop saving text that was entered in the state (2502). The briefing content may be visualized within the briefing screen, such as card objects (1531, 1532). To generate the briefing content, the state information of the electronic device (101), including weather information as well as text entered in the text boxes (2523, 2524), may be used.

[0278] FIG. 26 is a diagram illustrating exemplary states (2601, 2602) of an electronic device (101) displaying briefing content in landscape mode according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, and / or the processor (210) of FIG. 17 may perform the operation of the electronic device (101) described with reference to FIG. 26. The operation of the electronic device (101) described with reference to FIG. 26 may be performed based on the execution of the Moments application (1250) of FIG. 17. The operation of the electronic device (101) described with reference to FIG. 26 may be related to the operation (1840) of FIG. 18.

[0279] The layout of the screen containing the briefing content may be divided into landscape mode or portrait mode depending on the orientation of the electronic device (101). In portrait mode, the horizontal and vertical directions of the screen displayed through the display (110) may correspond to the horizontal and vertical directions of the display (110). Within portrait mode, among the horizontal or vertical directions of the display (110) of the electronic device (101), the vertical direction may correspond to the direction of gravitational acceleration. In landscape mode, the horizontal and vertical directions of the screen displayed through the display (110) may correspond to the vertical and horizontal directions of the display (110), respectively. Within landscape mode, among the horizontal or vertical directions of the electronic device (101), the horizontal direction may correspond to the direction of gravitational acceleration.

[0280] In the exemplary state (2601) of FIG. 26, the electronic device (101) may display a detail view of briefing content for a cluster containing images (2611). In the state (2601), the electronic device (101) may display a UI object (2612) for displaying other briefing content, a UI object (2613) for creating story content for the briefing content displayed in the state (2601), and / or a UI object (2614) for displaying a grid view such as the state (1503) of FIG. 15 and / or the state (2501) of FIG. 25. The electronic device (101) may display a UI object (2414) for changing the briefing content displayed in the state (2601) (e.g., a UI object linked to the popup menu (2430) of FIG. 24). An exemplary arrangement (2601) of images (2611) based on a carousel view is shown, but the present disclosure is not limited thereto.

[0281] In the exemplary state (2602) of FIG. 26, the electronic device (101) may display a screen containing images (2621) arranged based on a grid view. In the state (2602), the electronic device (101) may display or provide a detail view of briefing content for a cluster containing images (2621). In the state (2602), the electronic device (101) may display a UI object (2622) for creating story content, and a UI object (2623) for displaying images (2621) based on a carousel view, as in the state (2601).

[0282] As described above, according to one embodiment, an electronic device (101) may generate text expressing a summary of media content within the electronic device (101), including images and / or videos. The electronic device (101) may generate or display briefing content including said text and said media content. In order to execute a language model (e.g., the language model (255) of FIG. 2 and / or FIG. 17) using limited resources, the electronic device (101) may identify a specified number of media content among media content within a cluster related to a specific event. By executing the language model using the identified media content, the electronic device (101) may generate or store a natural language summary of said specified number of media content and briefing content including said natural language summary using relatively few resources.

[0283] FIG. 27 is a diagram illustrating an exemplary operation of an electronic device (101) that displays widget objects (e.g., widget objects (2710, 2720, 2730, 2740, 2750, 2760) based on the content of a briefing screen. The electronic device (101) of FIG. 27 may include the electronic device (101) of FIG. 1 and / or FIG. 2, and / or the electronic device (101) of FIG. 15 and / or FIG. 17. An exemplary hardware structure of the electronic device (101) of FIG. 27 is described in more detail below with reference to FIG. 2.

[0284] Referring to FIG. 27, an exemplary state (1101) of an electronic device (101) displaying a briefing screen is illustrated. The briefing screen of FIG. 27 may be displayed by the electronic device (101) running the smart suggestion application (260) of FIG. 2. In a state different from the state (1101) displaying a briefing screen containing content(s) (e.g., a state displaying a home screen (or launcher screen) and / or a lock screen, such as the states (191, 192) of FIG. 1), the electronic device (101) may provide a summary of the content(s) included in the briefing screen. The summary may include natural language sentence(s) summarized using personalized data, as described above with reference to FIG. 1 through 14 (e.g., in FIG. 27, "Please leave at 1:33 PM to arrive on schedule.").

[0285] In one embodiment, the electronic device (101) may provide a summary of the content(s) included in the briefing screen using the exemplary widget objects (2710, 2720, 2730, 2740, 2750, 2760) illustrated in FIG. 27. Referring to FIG. 27, widget objects (2710, 2720, 2730, 2740, 2750, 2760) having various widths and heights are illustrated. The unit width (w) and unit height (h) may correspond, respectively, to the width and height of a single icon on the home screen. The present disclosure is not limited thereto, but the unit width (w) and unit height (h) may correspond, respectively, to the width and height of a unit slot and / or unit grid used to align widget objects and / or icons on the home screen.

[0286] According to one embodiment, the electronic device (101) may generate an image, text, or any combination thereof representing a summary of content(s) included in a briefing screen, depending on the size of the widget object placed on the home screen and / or lock screen. The widget objects (2710, 2720, 2730, 2740) of FIG. 27 may each include exemplary summaries obtained based on content indicating a travel schedule included in the briefing screen.

[0287] For example, when displaying a widget object (2710) having the smallest size (e.g., unit width (w) and unit height (h)), the electronic device (101) may display text of a first length (e.g., "Move on") based on the width (w) and height (h) of the widget object (2710). Along with the text of the first length, the electronic device (101) may display an icon located below the text (e.g., an icon having the shape of a vehicle). When displaying a widget object having a relatively small size, such as the widget object (2710), the electronic device (101) may display an icon that is reduced or cropped according to the size of the widget object.

[0288] For example, when displaying a widget object (2720) having a larger size than the widget object (2710) (e.g., width of 2 × w and unit height (h)), the electronic device (101) can display text of a second length (e.g., "Leave now") that is longer than the first length through the widget object (2720). Along with the text of the second length, within the widget object (2720), the electronic device (101) can display an icon (2721) located next to the text of the second length.

[0289] For example, when displaying a widget object (2730) having a size larger than that of a widget object (2720) (e.g., width of 4 × w and height of 2 × h), the electronic device (101) may embed text of a third length, which is longer than the second length, within the widget object (2730). The text of the third length may include text expressing a summary of the travel schedule (e.g., "It's time to leave") as well as text expressing a summary of other content of the briefing screen (e.g., "take-out coffee"). Within the widget object (2730), one or more icons may be displayed in addition to the text of the third length.

[0290] For example, Table 5 may include exemplary texts within a widget object (2720) generated using text displayed on a briefing screen. The text within the widget object (2720) illustrated in Table 5 may be obtained using a language model or using a mapping table based on the relationships in Table 5.

[0291] Text within the text widget object (2720) of the current time briefing screen Text within the Now bar (e.g., widget objects (3331, 3321) of FIG. 33) Dawn (04:00-06:00) Get ready for the new day. Early bird A new day is here Hello early bird (morning specialized) Weather It's sunny outside. Enjoy a bright start to your day. Sunny morning Early morning (06:00-09:00) Start your day with this briefing. Good morning Good morning Have a refreshing morning. Late morning (09:00-12:00)Start your day with this briefing.Morning briefMorning briefEarly afternoon (12:00- 15:00)Enjoy the rest of your day.Good afternoonGood afternoonMidday briefMidday briefLate afternoon (15:00-18:00)Enjoy the rest of your day.Good dayHave a good dayHope your day is going as planned. Evening (18:00-22:00)Here's a recap of your day.Good eveningGood eveningHere's what happened today.Evening briefEvening briefEvening check-inNight (22:00-04:00)Enjoy a peaceful and restful night.Night recapLate night recapNight owlTonight's briefTravel themeMake special memories and have a safe journey.Travel insightsTravel insightsEnjoy your tripTTLCheck your route and drive safely.Time to go Time to go Leave now Leave now While commuting Here are some things to check before you leave. For your commute Info Recommendations Check brief Urgent Check Brief ready Useful Recommendations New updates General Situation View briefing.

[0292] For example, when displaying a widget object (2740) having a larger size than the widget object (2730) (e.g., width of 4 × w and height of 4 × h), the electronic device (101) may display text (e.g., "Suggested route" and / or "It will take 12 mins to the nearest Cafe") representing a summary of the content(s) included in the briefing screen through the widget object (2740). The electronic device (101) may display a UI object (2741) for executing a software application (e.g., a navigation application to assist the movement of the user of the electronic device (101)) related to the summary being displayed through the widget object (2740) along with the text within the widget object (2740). Based on receiving user input related to the UI object (2741), the electronic device (101) may execute the software application. The electronic device (101) can display a screen provided by the software application through the display (110).

[0293] As described above with reference to the widget objects (2710, 2720, 2730, 2740), the electronic device (101) can generate or display text having a length based on the size of the widget object. After displaying the widget object containing the text, the electronic device (101) can estimate whether the information contained in the widget object (e.g., information expressed by the text) has been recognized by the user of the electronic device (101). Based on the estimate, the electronic device (101) can change or maintain the information contained in the widget object. An exemplary operation in which the electronic device (101) changes and / or maintains the information contained in the widget object is described in more detail below with reference to FIGS. 28 through 34.

[0294] Referring to FIG. 27, exemplary widget objects (2750, 2760) displayed by an electronic device (101) are illustrated. The electronic device (101) may display a widget object containing summaries of different contents of a briefing screen (e.g., content including an energy score based on health information, and content including weather information), such as widget object (2750). Based on displaying a widget object having a size capable of providing summaries of multiple contents, such as widget object (2750), the electronic device (101) may display summaries of multiple contents through said widget object. The electronic device (101) may display a summary of briefing content based on an image and / or video stored in the electronic device (101) (e.g., briefing content generated based on the operation described with reference to FIG. 15 through 26), such as widget object (2760), through the widget object. An electronic device (101) that receives user input related to a widget object (e.g., widget objects (2710, 2720, 2730, 2740, 2750, 2760)) can switch to a state that displays a briefing screen (e.g., a screen containing at least one content corresponding to text included in the widget object), as in the state (1101) of FIG. 27.

[0295] As described above, according to one embodiment, an electronic device (101) can identify a first text expressing a summary of at least one piece of content. The first text (e.g., "Depart at 1:33 PM to arrive on time.") can be displayed along with the at least one piece of content on a briefing screen. The electronic device (101) can obtain a second text from the first text having a length shorter than the reference length of the widget object. The electronic device (101) can display the obtained second text within the widget object based on displaying a home screen containing the widget object. While displaying the obtained second text within the widget object, the electronic device (101) can identify the time length of displaying the widget object containing the second text. If the above time length is longer than the reference time length associated with the priority of the at least one content, the electronic device (101) may change the text within the widget object from the second text to a third text (e.g., a text that expresses a summary of other content and is shorter than the reference length). While displaying the widget object containing the second text, based on user input associated with the widget object, the electronic device (101) may display a screen (e.g., a briefing screen) containing the first text and the at least one content through the display (110).

[0296] FIG. 28 is a flowchart illustrating exemplary operation of an electronic device according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, the electronic device (101) of FIG. 27, and / or the processor (210) of FIG. 2 may perform the operations of FIG. 28. The order in which the operations of FIG. 28 are performed may differ from the exemplary order of FIG. 28. For example, the electronic device (101) of FIG. 25 and / or the processor (210) of FIG. 2 may perform the operations of FIG. 28 in an order different from the order shown in FIG. 28. For example, the electronic device (101) of FIG. 25 and / or the processor (210) of FIG. 2 may perform at least two of the operations of FIG. 28 substantially simultaneously. The operations of FIG. 28 may be performed by an electronic device that executes the smart proposal application (260) of FIG. 2.

[0297] Referring to FIG. 28, within an operation (2810), an electronic device according to one embodiment can identify at least one content. The at least one content may be generated from software applications executed by the electronic device. The at least one content of the operation (2810) may be content stored in the document DB (250) of FIG. 2.

[0298] Referring to FIG. 28, within an operation (2820), an electronic device according to one embodiment may identify a first text expressing a summary of at least one content. For example, the electronic device may execute a language model (e.g., the language model (255) of FIG. 2) to identify the first text of the operation (2820). The first text may be used to display a summary of the at least one content within a briefing screen.

[0299] Referring to FIG. 28, in operation (2830), an electronic device according to one embodiment can obtain a second text having a length smaller than the reference length of a widget object from a first text. The electronic device can obtain a second text having a length smaller than the reference length of a widget object by using the main information expressed by the first text. The reference length may be related to the size of the widget object. For example, the reference length may be proportional to the size of the widget object. If the size of the widget object is large (or the reference length is long), the electronic device can obtain or generate a second text of operation (2830) by using the main information and additional information expressed by the first text. Since the reference length is related to the size of the widget object, the second text obtained based on operation (2830) may have a length suitable for display through the widget object.

[0300] Referring to FIG. 28, within operation (2840), an electronic device according to one embodiment may display a widget object containing a second text. For example, based on displaying a home screen containing the widget object, the electronic device may display the second text obtained based on operation (2830) within the widget object. While displaying the widget object containing the second text, if user input related to the widget object is received, the electronic device may display or output a screen containing the at least one content and the first text (e.g., a briefing screen displayed in state (1101) of FIG. 11a).

[0301] Referring to FIG. 28, within operation (2850), an electronic device according to one embodiment can identify the length of time during which a widget object is displayed. For example, the electronic device can identify or check the length of time during which a widget object including a second text is displayed based on operation (2840).

[0302] Referring to FIG. 28, within operation (2860), according to one embodiment, an electronic device may check whether the time length identified based on operation (2850) is shorter than a reference time length based on the priority of at least one content. If the time length of operation (2850) is shorter than the time length of operation (2860) (2860-Yes), the electronic device may maintain displaying a widget object containing a second text. If the time length of operation (2850) is equal to or longer than the time length of operation (2860) (2860-No), the electronic device may perform operation (2870).

[0303] Referring to FIG. 28, within operation (2870), an electronic device according to one embodiment may change the text of a widget object from a second text to a third text. The third text may include a default text assigned to the widget object (e.g., text indicating the current time). The third text may express a summary of other content that is different from at least one content identified based on operation (2810). The length of the third text may be equal to or smaller than the reference length of operation (2830).

[0304] Referring to FIG. 28, a widget object containing a second text may continue to be displayed while the time length of operation (2850) is shorter than the time length of operation (2860). While displaying the widget object containing the second text, the electronic device may change (e.g., decrease) the priority (or importance) of at least one content corresponding to the second text according to the time length during which the widget object is displayed. For example, the electronic device may determine or change the priority of the at least one content based on the rank score of Equation 1. For example, the electronic device may gradually decrease the priority of the at least one content corresponding to the second text included in the widget object according to the size of the widget object and / or the time length during which the widget object is displayed. For example, the electronic device may determine or change the priority of the at least one content corresponding to the second text according to the user's preference for the at least one content corresponding to the second text (e.g., preference measured based on the number of accesses).

[0305] While displaying a widget object containing a second text, other content different from at least one content of the operation (2810) may be generated or identified. An electronic device that identifies the other content may identify the priority of the other content. If the priority of the other content is lower than the priority of the at least one content corresponding to the second text, the electronic device may maintain the display of the second text within the widget object. If the priority of the other content is higher than the priority of the at least one content corresponding to the second text, the electronic device may change the second text displayed within the widget object to a fourth text associated with the other content. Upon receiving user input associated with a widget object containing the fourth text, the electronic device may display a briefing screen through a display in which the other content is positioned above the at least one content.

[0306] As described above, an electronic device according to one embodiment can generate text expressing a summary of at least one piece of content. The length of the text may be related to the size of a widget object. By using text having a length suitable for the size of the widget object, the electronic device can automatically generate or display a summary of at least one piece of content. While displaying the text, the electronic device can change or maintain the text based on the user's recognizability of the text and / or the generation of other content.

[0307] FIG. 29 is a diagram illustrating exemplary operations of an electronic device (101) displaying a widget object according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, the electronic device (101) of FIG. 27, and / or the processor (210) of FIG. 2 may perform the operations of FIG. 29. For example, the operations of the electronic device (101) described with reference to FIG. 29 may be related to the operations of FIG. 28.

[0308] Referring to FIG. 29, an exemplary state (2901) of an electronic device (101) displaying a home screen is illustrated. The home screen may include widget objects (2921, 2912, 2913) provided from different software applications and / or an icon (2914) for executing the software application. An exemplary state (2901) of an electronic device (101) displaying a widget object (2912) provided from a weather application and a widget object (2913) provided from a search application is illustrated, but the type, number, and / or category of widget objects that can be displayed through the home screen is not limited thereto.

[0309] Referring to the exemplary state (2901) of FIG. 29, the electronic device (101) may display a widget object (2921) containing text based on the operation described with reference to FIG. 27 and FIG. 28. The widget object (2921) may include first text (e.g., "20 mins cake factory") expressing a summary of first content (e.g., content generated based on a calendar application) for announcing a travel schedule. While displaying the widget object (2921) containing the first text, the electronic device (101) may calculate or change the priority of the first content (e.g., a rank score calculated based on Equation 1) using the time length of displaying the widget object (2921). The priority of Equation 1 may decrease according to the time length of the widget object (2921).

[0310] In one embodiment, the maximum time length for which a widget object (2921) containing the first text is displayed may be shorter than the reference time length based on the priority. For example, if the time length for which the widget object (2921) is displayed is equal to or longer than the reference time length, the electronic device (101) may display a widget object (2922) containing basic text (e.g., text expressing time and / or date). The widget object (2922) may be displayed at the location within the home screen where the widget object (2921) was displayed. The size of the widget object (2922) may be equal to or similar to the size of the widget object (2921).

[0311] In one embodiment, a widget object (2921) containing a first text may be displayed until user input associated with the widget object (2921) is received. Based on receiving the user input, the electronic device (101) may display a briefing screen (e.g., a briefing screen displayed via the display (110) in the state (1101) of FIG. 27). After receiving the user input, based on displaying a home screen, the electronic device (101) may display a widget object (2922) containing a basic text as a replacement of the widget object (2921).

[0312] In one embodiment, while displaying a widget object (2921) containing a first text, the electronic device (101) may track or identify the user's gaze. For example, the electronic device (101) may include a camera positioned on one side where the display (110) is located (e.g., the front side of the electronic device (101)). Using images and / or videos obtained from the camera, the electronic device (101) may identify or detect the user's gaze while viewing the display (110). Using information indicating the user's gaze based on the camera, the electronic device (101) may identify or determine whether the user is gazing at the widget object (2921). Based on identifying the gaze associated with the widget object (2921) using the information, the electronic device (101) may perform an action associated with the widget object (2921) (e.g., displaying a briefing screen). Based on identifying a gaze associated with a widget object (2921) using the above information, the electronic device (101) may change the widget object (2921) (e.g., change it to a widget object (2922) containing basic text). Based on identifying a gaze associated with a widget object (2921) using the above information, the electronic device (101) may perform the illustrated operation (e.g., display a briefing screen and / or change the widget object (2921) to a widget object (2922)) based on whether the gaze is maintained for a specified period (e.g., a period of about 5 seconds).

[0313] In one embodiment, during a reference time length corresponding to the first content, the electronic device (101) may display a widget object (2921) containing a first text based on the first content, as well as a widget object (2923) containing a second text based on the first content. The widget object (2923) may be displayed as a replacement for the widget object (2921) at a location within the home screen where the widget object (2921) is displayed. For example, if the electronic device (101) does not receive user input related to the widget object (2921) for a time length less than the reference time length after displaying the widget object (2921), the widget object (2921) displayed on the home screen may be changed to the widget object (2923). If the sum of the time length during which the widget object (2923) was displayed and the time length during which the widget object (2921) was displayed is equal to or longer than the reference time length, the electronic device (101) can display a widget object (2922) containing basic text.

[0314] In one embodiment, during a reference time length corresponding to the first content, the electronic device (101) may change or maintain the widget object (2921) based on user input related to the widget object (2921). For example, within a state (2901) in which a widget object (2921) containing first text related to a travel schedule is displayed, the electronic device (101) may change or reduce the priority of the first content related to the first text based on user input running a software application (e.g., a navigation application) related to the travel schedule. Based on the changed priority, the electronic device (101) may change the widget object (2921) displayed on the home screen to another widget object (e.g., a widget object (2922) containing basic text and / or a widget object (2923)).

[0315] Although an embodiment has been described of providing a summary of content(s) using text and / or icons within widget objects (e.g., widget objects (2921, 2922, 2923)) displayed on the home screen, the present disclosure is not limited thereto. For example, the electronic device (101) may display or insert a summary of content(s) in a widget object within the lock screen, referred to as Now Bar. An exemplary operation of the electronic device (101) displaying a summary of content(s) using a widget object within the lock screen is described in more detail below with reference to FIG. 33.

[0316] Referring to FIG. 29, within a home screen containing various objects including a widget object (2921) (e.g., widget objects (2912, 2913) and / or an icon (2914)), an empty area may exist in an area adjacent to the widget object (2921) (the upper part of the widget object (2921) in the exemplary state (2901) of FIG. 29). According to one embodiment, the electronic device (101) may change the size of the widget object (2921) (e.g., enlarge and / or reduce) based on the importance of the content corresponding to the text contained in the widget object (2921) and / or the empty area adjacent to the widget object (2921).

[0317] Below, with reference to FIG. 30a and / or FIG. 30b, an exemplary operation of an electronic device (101) that changes the size of a widget object (2921) is described in more detail.

[0318] FIGS. 30a and FIGS. 30b are diagrams illustrating exemplary operations of an electronic device (101) displaying a widget object having a variable size according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, the electronic device (101) of FIG. 27, and / or the processor (210) of FIG. 2 may perform the operations of the electronic device (101) described with reference to FIG. 30a and / or FIG. 30b. The operations of the electronic device (101) described with reference to FIG. 30a and / or FIG. 30b may be related to the operations of FIG. 28.

[0319] Referring to FIG. 30a, a state (2901) of an electronic device (101) that displays a home screen including a widget object (2921) is shown. The state (2901) of FIG. 30a may correspond to the state (2901) of FIG. 29. In a state (2901) that displays a first text expressing a summary of content representing a movement schedule, the electronic device (101) may determine the size of the widget object (2921) according to the priority of said content. For example, in a state (2901) that displays a widget object (2921) having a first size (e.g., a width of 2 × w and a height of h) with respect to a unit width (w) and a unit height (h) of the home screen, the electronic device (101) may determine whether to increase, maintain, or decrease the first size of the widget object (2921).

[0320] Referring to FIG. 30a, while displaying a home screen containing a widget object (2921) of a first size, the electronic device (101) may change the size of the widget object (2921) to a second size larger than the first size according to the priority of the content corresponding to the first text. In the state (3002) of FIG. 30a, the electronic device (101) may display a widget object (3021) having a second size (e.g., a width of 2 × w and a height of 2 × h). For example, if the priority of the content representing a travel schedule increases according to the time interval of the travel schedule (e.g., the time interval when the user must depart), the electronic device (101) may change the widget object (2921) of the first size to a widget object (3021) of the second size. On a widget object (3021) of the second size, the electronic device (101) can display text related to the content (e.g., "Check the location of 20 mins cake factory A.").

[0321] Referring to FIG. 30a, within a state (3002) of displaying a second-sized widget object (3021), the electronic device (101) may display UI objects (e.g., icons (3022, 3023)) for running a software application associated with the widget object (3021). Based on displaying a widget object (3021) that is larger than the widget object (2921), the electronic device (101) may add a second text (e.g., text containing a natural language sentence such as "Check the location of A") that is longer than the first text contained in the widget object (2921) to the widget object (3021). For example, an icon (3022) may be displayed to run a calling application. For example, an icon (3023) may be placed on the widget object (3021) to run a messenger application. Based on receiving user input related to a widget object (3021) within state (3002), the electronic device (101) may reduce the priority of content related to the widget object (3021) or display a widget object (2921) of a first size, such as in state (3901).

[0322] Referring to the states (2901, 3002) of FIG. 30a, the electronic device (101) can enlarge the size of the widget object (2921) according to the positional relationship between the widget object (2921) and the other object, because other objects (e.g., widget objects (2912, 2913) and / or icons (2914)) as well as the widget object (2921) are placed within the home screen. In the exemplary state (2901) of FIG. 30a, the electronic device (101), having identified an empty area in the upper part of the widget object (2921), can display a second-sized widget object (3021) occupying the upper part. The electronic device (101) can enlarge a widget object (2921) on a home screen using information indicating the positional relationship of objects including a widget object (2921), and can determine the position of the enlarged widget object (2921) (e.g., widget object (3021)).

[0323] In one embodiment, the home screen may include switchable pages (or areas referred to as page views and / or containers). In a state (3002) in which a widget object (3021) is displayed through a specific page view, the electronic device (101) may create or add a page different from the page on which the widget object (3021) is placed in order to display a widget object having a larger size than the widget object (3021). The electronic device (101) may display a widget object (3031) having a larger size than the widget object (3021) on the created page. The state (3003) of FIG. 30a may be a state in which the home screen including the widget object (3031) is displayed. For example, when the priority of content corresponding to a widget object (3021) increases, the electronic device (101) may switch to a state (3003) to display a widget object (3031) having a larger size than the widget object (3021). An exemplary case in which the size of the widget object (2921) increases sequentially based on the states (2901, 3002, 3003) is illustrated, but the present disclosure is not limited thereto, and the electronic device (101) may directly switch from a state (2901) displaying a widget object (2921) of a first size to a state (3003) displaying a widget object (3031).

[0324] Referring to FIG. 30a, in a state (e.g., states (2901, 3002, 3003)) in which a widget object (e.g., widget objects (2921, 3021, 3031)) containing text expressing a summary of specific content is displayed, the electronic device (101) can determine the priority of the content and / or a reference time length (e.g., the reference time length of FIG. 28) used to display the text by using the time and / or size in which the widget object is displayed through the display (110). For example, as the larger the size of the widget object, the greater the likelihood that the widget object will be recognized by the user, the electronic device (101) can reduce the reference time length or / or increase the rate (e.g., rate of change) of reducing the priority according to the time length in which the widget object is displayed. The present disclosure is not limited thereto, and the electronic device (101) may visually highlight the widget object by changing the color of the widget object and / or applying a visual effect (e.g., a blinking effect based on a periodic change of color) to the widget object.

[0325] Referring to FIG. 30b, an exemplary state (3004) of an electronic device (101) that displays a home screen including a widget object (2921) is shown. In state (3004), the electronic device (101) may display the widget object (2921) and text (e.g., "Brief") indicating the name of the widget object (2921) on the home screen. In state (3004) that displays a widget object (2921) of a first size, the electronic device (101) may decide whether to change the size of the widget object (2921) to a second size that exceeds the first size, according to the priority of the content. If the electronic device (101) decides to change the size of the widget object (2921) to the second size, it may switch to state (3005) of FIG. 30b.

[0326] Referring to the state (3005) of FIG. 30b, the electronic device (101) can display a widget object (3051) that has been expanded to the position where text indicating the name of the widget object (2921) was displayed. Through the widget object (3051) having a second size larger than the first size of the widget object (2921), the electronic device (101) can provide a summary of the content(s). For example, if the electronic device (101) identifies a summary longer than the summary displayed in the widget object (2921), it can use the widget object (3051) to display text and / or an image expressing the identified summary.

[0327] In one embodiment, the electronic device (101) can change the corner radius of a widget object (2921). Referring to FIG. 30b, in a state (3004) in which a widget object (2921) having a first corner radius is displayed, the electronic device (101) can display a first text. In the state (3004) of FIG. 30b, if the electronic device (101) identifies a second text longer than the first text, it can display a widget object (3051) having a second corner radius smaller than the first corner radius. The electronic device (101) can display the second text within the widget object (3051). By changing the corner radius, the electronic device (101) can display longer text (or shorter text) or graphic objects while maintaining the width and height of the widget object (e.g., widget objects (2921, 3051)).

[0328] Below, with reference to FIG. 31a, FIG. 31b, and / or FIG. 32, an exemplary operation of an electronic device (101) having a form factor different from a bar-type smartphone is described in more detail.

[0329] FIGS. 31a and 31b are diagrams illustrating exemplary states (3191, 3192) of a multi-foldable electronic device (3100) displaying a widget object (2921) according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, the electronic device (101) of FIG. 27, and / or the processor (210) of FIG. 2 may perform the operation of the multi-foldable electronic device (3100) described with reference to FIG. 31a and / or FIG. 31b. The operation of the multi-foldable electronic device (3100) described with reference to FIG. 31a and / or FIG. 31b may be related to the operations of FIG. 28.

[0330] A multi-foldable electronic device (3100) described with reference to FIG. 31a and / or FIG. 31b may include housing parts (3101, 3102, 3103) connected via rotatable hinge assemblies. A first housing part (3101) may be rotatably coupled to a second housing part (3102). A second housing part (3102) may be rotatably coupled to a third housing part (3103). The multi-foldable electronic device (3100) may include a flexible display (3108) extending from the first housing part (3101) across the second housing part (3102) to the third housing part (3103). The state of the multi-foldable electronic device (3100) can be distinguished according to the folding and / or unfolding of the housing parts (3101, 3102, 3103).

[0331] Referring to FIG. 31a, states (3191, 3192) of the multi-foldable electronic device (3100) included in a folded state (e.g., a fully folded state) of the multi-foldable electronic device (3100) are illustrated. The folded state may include a state in which the flexible display (3108) is not visible as the housing parts (3101, 3102, 3103) are folded. The multi-foldable electronic device (3100) may include a cover display (3109) located on the rear side opposite to the front side where the flexible display (3108) is positioned (e.g., the rear side of the third housing part (3103)). In the present disclosure, the flexible display (3108) and the cover display (3109) may be referred to as the first display and the second display, respectively.

[0332] In the state (3191) of FIG. 31a, the multi-foldable electronic device (3100) may display a home screen through the cover display (3109). Referring to FIG. 31a, an exemplary state (3191) for displaying a home screen similar to the state (2901) of FIG. 29 and / or FIG. 30a is shown. In the state (3191), the multi-foldable electronic device (3100) may display a widget object (2921) containing text expressing a summary of at least one content. The text may be generated based on the operation described with reference to FIG. 27 and FIG. 28.

[0333] In the state (3191) of FIG. 31a, the multi-foldable electronic device (3100) may change or maintain the size of the widget object (2921) using the priority of at least one content (e.g., a priority based on the rank score of Equation 1). For example, the multi-foldable electronic device (3100) that identifies that the priority has increased (e.g., increased beyond a threshold) may display a widget object (3021) having a larger size than the widget object (2921), as in state (3192). The widget object (3021) may include icons (3022, 3023) as described with reference to FIG. 30a. Although an exemplary operation of increasing the size of the widget object (2921) on a specific page of the home screen has been described, the present disclosure is not limited thereto. For example, the multi-foldable electronic device (3100) can add a new page to the home screen. In the above example, the multi-foldable electronic device (3100) can display a widget object (2921) or a widget object having a larger size than the widget object (2921) (e.g., the widget object (3031) of FIG. 30a) on the added page.

[0334] According to one embodiment, a multi-foldable electronic device (3100) can identify a shape of the multi-foldable electronic device (3100) that changes according to the rotation of housing parts (3101, 3102, 3103) (e.g., rotation to fold and / or unfold at least two of the housing parts (3101, 3102, 3103). According to said shape, the multi-foldable electronic device (3100) can switch from the folded state shown in FIG. 31a to another state.

[0335] Referring to FIG. 31b, a state (3193) included in the half-fold state of the multi-foldable electronic device (3100) and a state (3194) included in the unfolded state (or fully unfolded state) of the multi-foldable electronic device (3100) are shown.

[0336] In the half-fold state, the angle between the first housing part (3101) and the second housing part (3102) may be substantially 180º, and the angle between the second housing part (3102) and the third housing part (3103) may be substantially 0º. Referring to the exemplary state (3193) of FIG. 31b, in the half-fold state, a portion of the flexible display (3108) placed on the second housing part (3102) may face the portion of the flexible display (3108) placed on the third housing part (3103). Referring to the exemplary state (3193) of FIG. 31b, a portion placed on the first housing part (3101) may be visible on the flexible display (3108) placed on the front surface of the housing parts (3101, 3102, 3103). In other words, in the half-fold state, the remaining part that is different from the part of the flexible display (3108) placed on the first housing part (3101) may be invisible. In the half-fold state, the multi-foldable electronic device (3100) can disable the cover display (3109) and display a screen through the part of the flexible display (3108) located on the first housing part (3101).

[0337] Referring to the exemplary state (3194) of FIG. 31b, in the unfolded state, all angles between the housing parts (3101, 3102, 3103) may be 180º. In the unfolded state, the entire flexible display (3108) may have a flat shape. In the unfolded state, the multi-foldable electronic device (3100) may disable the cover display (3109) and display a screen through the entire display area of ​​the flexible display (3108).

[0338] Referring to FIG. 31b, within a state (3193) included in a half-fold state, the multi-foldable electronic device (3100) can display a home screen on a portion of the flexible display (3108) located on the first housing part (3101). Similar to the state (3191) of FIG. 31a, the multi-foldable electronic device (3100) can display a home screen including a widget object (2921). Referring to FIG. 31b, within a state (3194) included in an unfolded state, the size of the home screen can be larger than the size of the remaining states (3191, 3192, 3193).

[0339] In one embodiment, the multi-foldable electronic device (3100) may change the size of the widget object (2921) or enlarge it according to the size of the home screen and / or the priority of the content. For example, based on transitioning from a state (3193) contained in a half-fold state to a state (3194) contained in an unfolded state, the multi-foldable electronic device (3100) may identify that the size of the home screen has increased to the size of the entire display area of ​​the flexible display (3108). Upon identifying that the size of the home screen has increased, the multi-foldable electronic device (3100) may enlarge the widget object (2921) using an empty area within the home screen. For example, the multi-foldable electronic device (3100) may determine whether to enlarge the widget object (2921) in the unfolded state according to the priority of the content corresponding to the text displayed through the widget object (2921).

[0340] The state (3194) of FIG. 31b may be an exemplary state of a multi-foldable electronic device (3100) displaying a widget object (3140), which is an enlarged version of the widget object (2921), depending on the decision to enlarge the widget object (2921). An exemplary state (3194) of a multi-foldable electronic device (3100) is shown in which a widget object (3140) having a larger size than the widget object (2921) is displayed on a portion of a flexible display (3108) located on a second housing part (3102) and a third housing part (3103). The multi-foldable electronic device (3100) may display card objects (3414, 3144) corresponding to different contents, respectively, within the widget object (3140). The card object (3414) may include icons (3142, 3143) for executing software application(s) related to content corresponding to the card object (3414). The card object (3144) may include an icon (3145) for executing software application related to content corresponding to the card object (3144). In response to a touch input to a part of a widget object (3140) different from the icons (3142, 3143, 3145), the multi-foldable electronic device (3100) may display a briefing screen (e.g., a briefing screen displayed in the state (1101) of FIG. 27). The multi-foldable electronic device (3100) can reduce or maintain the size of the widget object (3140) according to the priority of the content displayed through the widget object (3140) and / or the time interval set to display said content.

[0341] As in the states (3193, 3194) of FIG. 31b, when both displays of the multi-foldable electronic device (3100) (e.g., flexible display (3108) and / or cover display (3109)) are visible, the multi-foldable electronic device (3100) can activate both displays. Among the activated displays, a widget object (2921) containing text expressing a summary of content may be displayed on a specific display. For example, the multi-foldable electronic device (3100) displaying the widget object (2921) on the flexible display (3108) may display text describing the identified content on the cover display (3109) when changing the text of the widget object (2921) displayed through the flexible display (3108) based on identifying the content. In the above example, the text displayed through the cover display (3109) may be displayed through a status bar and / or a pop-up window, similar to the visual object (3411) of FIG. 34.

[0342] FIG. 32 is a diagram illustrating exemplary states (3291, 3292) of a rollable electronic device (3200) displaying a widget object (2921) according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, the electronic device (101) of FIG. 27, and / or the processor (210) of FIG. 2 may perform the operation of the rollable electronic device (3200) described with reference to FIG. 32. The operation of the rollable electronic device (3200) described with reference to FIG. 32 may be related to the operations of FIG. 28.

[0343] A rollable electronic device (3200) described with reference to FIG. 32 may include a first housing part (3201) and a second housing part (3202) that can be inserted into or withdrawn from the first housing part (3201). The rollable electronic device (3200) may include a flexible display (3209) extending from the first housing part (3201) to the second housing part (3202). When the second housing part (3202) is inserted into the first housing part (3201), at least a portion of the flexible display (3209) may be inserted into the first housing part (3201). When the second housing part (3202) is withdrawn from the first housing part (3201), at least a portion of the flexible display (3209) can be withdrawn from the first housing part (3201).

[0344] Referring to FIG. 32, a state (3291) is illustrated in which the second housing part (3202) is retracted into the first housing part (3201). The retracted state may be referred to as a coiled state and / or a retracted state. In state (3291), the rollable electronic device (3200) may display a home screen including a widget object (2921) through a portion of the flexible display (3209) visible through the housing parts (3201, 3202). The home screen may include other widget objects (2912) different from the widget object (2921). Through the widget object (2921), the rollable electronic device (3200) may display text expressing a summary of at least one content.

[0345] In the exemplary state (3291) of FIG. 32, the rollable electronic device (3200) may receive an input to change the state of the rollable electronic device (3200) from a contracted state to an extended state. The input may include inputs related to a button of the rollable electronic device (3200), a user’s speech, and / or a visual object displayed through the flexible display (3209). Referring to FIG. 32, a state (3292) is shown, which is a state switched from state (3291) based on the input. In the state (3292) included in the extended state, at least a portion of the second housing part (3202) that was inserted into the first housing part (3201) in the contracted state may be withdrawn out of the first housing part (3201). Because the second housing part (3202) is withdrawn at least partially from the first housing part (3201), the size of the visible flexible display (3209) may be larger than the size of the visible flexible display (3209) in state (3291). The extended state of the rollable electronic device (3200) including state (3292) may be referred to as an unrolled state and / or a withdrawn state.

[0346] Referring to FIG. 32, a rollable electronic device (3200) that identifies a transition from a state (3291) included in an incoming state to a state (3292) included in an outgoing state may identify an increase in the size of a visible area (e.g., a display area and / or an active area) of a flexible display (3209) based on said transition. In the increased area, the rollable electronic device (3200) may display a home screen having an increased size. Referring to FIG. 32, within the state (3292) of displaying a home screen having an increased size, the rollable electronic device (3200) may display a widget object (3021) having a larger size than a widget object (2921). The widget object (3021) may be displayed as determined by increasing the size of the widget object (2921). The rollable electronic device (3200) can determine whether to increase the size of the widget object (2921) by using the priority of the content associated with the widget object (2921) (e.g., associated with the widget object (2921) to display text contained in the widget object (2921)). The widget object (3021) may have a larger size than the widget object (2921) and may be positioned to occupy an empty area added to the flexible display (3209) within the state (3292) included in the pull-out state. Through the widget object (3021), the rollable electronic device (3200) may display icons (3022, 3023) for executing software application(s) associated with the content. Based on user input for the icon (3022), the rollable electronic device (3200) may execute a call application. Based on user input for the icon (3023), the rollable electronic device (3200) can run a messenger application.

[0347] Although an exemplary operation of a rollable electronic device (3200) has been described in which the size of a widget object (2921) is increased by the size of an expanded flexible display (3209) when transitioning from an inlet state (e.g., state (3291)) to an inlet state (e.g., state (3292)), the present disclosure is not limited thereto. For example, the rollable electronic device (3200) may reduce the size of a widget object (3021) that occupies a portion of the flexible display (3209) when transitioning from an inlet state (e.g., state (3292)) to an inlet state (e.g., state (3291)).

[0348] FIG. 33 is a diagram illustrating widget objects (2720, 2740, 3311, 3331, 3321) displayed on the home screen and lock screen, respectively, by an electronic device according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, the electronic device (101) of FIG. 27, and / or the processor (210) of FIG. 2 may perform the operation of the electronic device (101) described with reference to FIG. 33. The operation of the electronic device (101) described with reference to FIG. 33 may be related to the operations of FIG. 28.

[0349] Referring to FIG. 33, exemplary widget objects (2720, 2740) displayed based on at least one piece of content are illustrated. An electronic device (101) may display any one of the widget objects (2720, 2740) on a home screen according to the priority of the at least one piece of content. For example, in one embodiment in which a widget object (2720) of a first size is displayed based on a first priority, the electronic device (101) may display a widget object (2740) of a second size larger than the first size based on identifying content of a second priority higher than the first priority. The widget objects (2720, 2740) may include text expressing a summary of the corresponding content. Widget objects (2720, 2740) may include UI objects (e.g., icons (2721) and / or UI objects (2741)) for running software applications related to corresponding content.

[0350] An electronic device (101) displaying a widget object (2740) of a second size may reduce the size of the widget object (2740) based on a time interval set by user input related to the widget object (2740) and / or content related to the widget object (2740). For example, upon receiving the user input and / or based on the expiration of the time interval, the electronic device (101) may change the size of the widget object (2740) from the second size to the first size. For example, the electronic device (101) may stop displaying the widget object (2740) and display a widget object (2720) of the first size.

[0351] Referring to FIG. 33, lock screens are illustrated by an electronic device (101) that displays widget objects (2720, 2740) respectively. For example, an electronic device (101) that displays a second-sized widget object (2740) may switch to a state (3301) that displays a lock screen containing a widget object (3311) based on identifying that the state of the electronic device (101) has changed to a locked state. In the state (3301), the electronic device (101) may display a widget object (3311) that includes text expressing a summary of the content related to the widget object (2740). The widget object (3311) may be referred to as Now Bar.

[0352] Referring to FIG. 33, within a state (3301) in which a widget object (3311) is displayed, the electronic device (101) may change the widget object (3311) using the time length during which the widget object (3311) is displayed and / or the priority of the content associated with the widget object (3311). For example, if, within state (3301), the widget object (3311) is displayed for a period exceeding the reference time length of the content, and / or if the priority of the content is reduced (e.g., reduced below a threshold priority), the electronic device (101) may display a widget object (3321) having a reduced size, as in state (3302). The widget object (3321) may contain text of a shorter length than the text contained in the widget object (3311). The text contained in the widget object (3321) may be a summary version of the text contained in the widget object (2740) and / or the widget object (3311), obtained based on the execution of the language model.

[0353] Referring to FIG. 33, an electronic device (101) displaying a widget object (2720) can switch to a state (3303) displaying a lock screen containing a widget object (3331) based on identifying that the state of the electronic device (101) has changed to a locked state. In the state (3303), the electronic device (101) can display text (e.g., "Leave Now") expressing a summary of the content related to the widget object (2720) through the widget object (3331). The size of the widget object (3331) may be the same as the size of the widget object (3321) displayed through the display (110) in the state (3302).

[0354] As described above, the size of a widget object displayed on a lock screen (e.g., widget objects (3311, 3321, 3331)) may be related to the importance of the content associated with the widget object (e.g., proportional). The more a summary of content with a higher priority is displayed, the electronic device (101) may display a lock screen containing a widget object with a larger size. Since priority is related to the length of time the widget object is displayed (e.g., inversely proportional), the electronic device (101) may gradually reduce the size of the widget object within the lock screen that is displayed with a larger size based on high priority. For example, in state (3301), if the length of time the widget object (3311) is displayed exceeds a threshold time length, the electronic device (101) may switch to state (3302) and display a widget object (3321), which is a reduced version of the widget object (3311).

[0355] The operation of an electronic device (101) that displays widget objects (e.g., widget objects (3311, 3321, 3331)) on a lock screen can be performed similarly with respect to an AOD screen. For example, an electronic device (101) that has identified high-priority content may display a widget object containing a summary of said content through the lock screen, as well as display a widget object containing said summary through the AOD screen. In the above example, the priority may be reduced depending on the length of time the widget object is displayed. Based on the reduced priority, the electronic device (101) may stop displaying the widget object on the AOD screen. After stopping displaying the widget object on the AOD screen, the electronic device (101) may reduce the size of the widget object included on the lock screen, and / or stop displaying said widget object through said lock screen.

[0356] FIG. 34 is a diagram illustrating exemplary operation of an electronic device (101) and / or an external electronic device (1400) that displays a visual object associated with a widget object (3420) according to various embodiments. The electronic device (101) of FIG. 2, the electronic device (101) of FIG. 17, the electronic device (101) of FIG. 27, and / or the processor (210) of FIG. 2 may perform the operation of the electronic device (101) described with reference to FIG. 34. The operation of the electronic device (101) described with reference to FIG. 34 may be related to the operations of FIG. 28.

[0357] Referring to FIG. 34, exemplary states (3401, 3402) of an electronic device (101) displaying a home screen including a widget object (3420) are illustrated. In the states (3401, 3402), the electronic device (101) may obtain or generate text expressing a summary of said at least one content based on identifying said at least one content. The electronic device (101) may display a widget object (3420) including said obtained text.

[0358] As described above, the home screen may include page views that can be switched by the user. If the home screen includes multiple page views, a widget object (3420) may be positioned in a specific page view. Referring to FIG. 34, an exemplary state (3401) is shown that displays a first page view of the home screen. If the widget object (3420) is positioned in a second page view next to the first page view, the widget object (3420) may not be displayed through the display (110) within the state (3401). Within the state (3401) that displays a first page view different from the second page view containing the widget object (3420), the electronic device (101) that has obtained text to be included in the widget object (3420) may display a visual object (3411) associated with said text. For example, a visual object (3411) may be displayed on a part of the display (110) referred to as the status bar (e.g., a part adjacent to the top edge of the display (110)). For example, the visual object (3411) may be included in the status bar or may take the form of a pop-up window (or toast notification) nested on the home screen. For example, the visual object (3411) may take the form of a widget object referred to as the now bar (e.g., the widget objects (3311, 3321, 3331) of FIG. 33).

[0359] In a state (3401) that displays a first page view different from a second page view containing a widget object (3420), the electronic device (101) may (temporarily) display a visual object (3411) for a specified period (e.g., a period between about 1 second and about 10 seconds). Upon expiration of the specified period, the electronic device (101) may stop displaying the visual object (3411). Upon identifying user input related to the visual object (3411) (e.g., a tap gesture for the visual object (3411)), the electronic device (101) may display a screen containing content related to the widget object (3420) (e.g., a briefing screen displayed in the state (1101) of FIG. 27) through the display (110).

[0360] Referring to FIG. 34, in state (3401), the electronic device (101) may receive input for switching a page view of the home screen displayed through the display (110). The input may include a drag gesture (or swipe gesture) that starts at a point (p) on the home screen and is performed along the horizontal direction (3412) of the display (110). Upon identifying the input, the electronic device (101) may display a second page view next to the first page view, as in state (3402) of FIG. 34. In the state (3402) of displaying the second page view, the electronic device (101) may display a widget object (3420) included in the second page view.

[0361] When a user is logged into multiple electronic devices (e.g., electronic device (101) and electronic device (1400) having the form of a tablet PC), an electronic device (101) managing a widget object (3420) for displaying text expressing a summary of at least one piece of content may transmit a signal to the electronic device (1400) to display a notification regarding said text. For example, if the content associated with the widget object (3420) changes, or if the text contained in the widget object (3420) changes, the electronic device (101) may transmit text expressing a summary of said content to the electronic device (1400). Upon receiving said text, the electronic device (1400) may display a visual object (3430) containing said text on a display (1410). Similar to the visual object (3411), the visual object (3430) may be included in a status bar or may take the form of a pop-up window superimposed on a screen displayed through the display (1410). Based on user input related to the visual object (3430), the electronic device (1400) may display a screen (e.g., a briefing screen) containing content related to the text. Based on identifying user input related to the visual object (3430), the electronic device (1400) may transmit a signal indicating the user input to the electronic device (101). Upon receiving the signal, the electronic device (101) may change the priority of the content corresponding to the widget object (3420) (e.g., decrease).

[0362] As described above, according to one embodiment, an electronic device (101) may display a widget object comprising text expressing a summary of at least one content. The widget object may be placed on the home screen, lock screen, and / or AOD screen of the electronic device (101). The electronic device (101) may retain or change the text included in the widget object according to the priority of the at least one content. The priority of the at least one content may be changed according to the duration of time the widget object is displayed and / or user input regarding the widget object. The electronic device (101) may enlarge, maintain, or reduce the size of the widget object according to the priority of the at least one content.

[0363] FIG. 35 is a block diagram of an electronic device (3501) in a network environment (3500) according to various embodiments. Referring to FIG. 35, in the network environment (3500), the electronic device (3501) may communicate with an electronic device (3502) through a first network (3598) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (3504) or a server (3508) through a second network (3599) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (3501) may communicate with the electronic device (3504) through a server (3508). According to one embodiment, the electronic device (3501) may include a processor (3520), memory (3530), input module (3550), sound output module (3555), display module (3560), audio module (3570), sensor module (3576), interface (3577), connection terminal (3578), haptic module (3579), camera module (3580), power management module (3588), battery (3589), communication module (3590), subscriber identification module (3596), or antenna module (3597). In various embodiments, at least one of these components (e.g., connection terminal (3578)) may be omitted from the electronic device (3501), or one or more other components may be added. In various embodiments, some of these components (e.g., sensor module (3576), camera module (3580), or antenna module (3597)) may be integrated into a single component (e.g., display module (3560)).

[0364] The processor (3520) can, for example, execute software (e.g., program (3540)) to control at least one other component (e.g., hardware or software component) of the electronic device (3501) connected to the processor (3520) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (3520) can store commands or data received from other components (e.g., sensor module (3576) or communication module (3590)) in volatile memory (3532), process the commands or data stored in volatile memory (3532), and store the resulting data in non-volatile memory (3534). According to one embodiment, the processor (3520) may include a main processor (3521) (e.g., a central processing unit or an application processor) or an auxiliary processor (3523) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (3501) includes a main processor (3521) and an auxiliary processor (3523), the auxiliary processor (3523) may be configured to use lower power than the main processor (3521) or to be specialized for a designated function. The auxiliary processor (3523) may be implemented separately from the main processor (3521) or as part thereof. Thus, the processor (3520) may include various processing circuits and / or multiple processors. For example, as used herein, the term “processor” or “model” (e.g., machine learning model) comprising claims may include various processing circuits including at least one processor, and at least one of the processors may be configured to perform the various functions described herein individually and / or collectively in a distributed manner.As used herein, where “processor,” “at least one processor,” “model,” “at least one model,” “machine learning model,” and “one or more processors” are described as being configured to perform many functions, these terms cover, by example but not limitingly, situations where one processor and / or model performs some of the mentioned functions and other processor(s) and / or model(s) perform the remainder of the mentioned functions, and also situations where one processor and / or model can perform all of the mentioned functions. Additionally, at least one processor may include a combination of processors performing the various mentioned / disclosed functions, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform the various functions. Similarly, at least one model may include a combination of processors and / or processing circuits performing the various mentioned / disclosed functions, for example, in a distributed manner. At least one processor and / or model may execute programs to achieve or perform the various functions.

[0365] The auxiliary processor (3523) may control at least some of the functions or states associated with at least one component of the electronic device (3501) (e.g., display module (3560), sensor module (3576), or communication module (3590)) on behalf of the main processor (3521) while the main processor (3521) is in an inactive (e.g., sleep) state, or together with the main processor (3521) while the main processor (3521) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (3523) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (3580) or communication module (3590)). According to one embodiment, the auxiliary processor (3523) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (3501) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (3508)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0366] The memory (3530) can store various data used by at least one component of the electronic device (3501) (e.g., processor (3520) or sensor module (3576)). The data may include, for example, input data or output data for software (e.g., program (3540)) and related commands. The memory (3530) may include volatile memory (3532) or non-volatile memory (3534).

[0367] The program (3540) may be stored as software in memory (3530) and may include, for example, an operating system (3542), middleware (3544), or an application (3546).

[0368] The input module (3550) can receive commands or data to be used for a component of the electronic device (3501) (e.g., processor (3520)) from outside the electronic device (3501) (e.g., user). The input module (3550) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0369] The sound output module (3555) can output a sound signal to the outside of the electronic device (3501). The sound output module (3555) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0370] The display module (3560) can visually provide information to an external (e.g., user) of the electronic device (3501). The display module (3560) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (3560) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0371] The audio module (3570) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (3570) can acquire sound through the input module (3550) or output sound through the sound output module (3555) or an external electronic device (e.g., electronic device (3502)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (3501).

[0372] The sensor module (3576) can detect the operating state of the electronic device (3501) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (3576) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0373] The interface (3577) may support one or more specified protocols that can be used for the electronic device (3501) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (3502)). According to one embodiment, the interface (3577) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0374] The connection terminal (3578) may include a connector through which the electronic device (3501) can be physically connected to an external electronic device (e.g., electronic device (3502)). According to one embodiment, the connection terminal (3578) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0375] The haptic module (3579) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (3579) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0376] The camera module (3580) can capture still images and video. According to one embodiment, the camera module (3580) may include one or more lenses, image sensors, image signal processors, or flashes.

[0377] The power management module (3588) can manage the power supplied to the electronic device (3501). According to one embodiment, the power management module (3588) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0378] The battery (3589) can supply power to at least one component of the electronic device (3501). According to one embodiment, the battery (3589) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0379] The communication module (3590) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (3501) and an external electronic device (e.g., electronic device (3502), electronic device (3504), or server (3508)), and the performance of communication through the established communication channel. The communication module (3590) may include one or more communication processors that operate independently of the processor (3520) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (3590) may include a wireless communication module (3592) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (3594) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (3504) via a first network (3598) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (3599) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (3592) can identify or authenticate the electronic device (3501) within a communication network such as the first network (3598) or the second network (3599) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (3596).

[0380] The wireless communication module (3592) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (3592) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (3592) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (3592) can support various requirements specified in the electronic device (3501), external electronic device (e.g., electronic device (3504)), or network system (e.g., second network (3599)). According to one embodiment, the wireless communication module (3592) can support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0381] An antenna module (3597) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (3597) may include an antenna comprising a radiator comprising a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (3597) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (3598) or a second network (3599), may be selected from the plurality of antennas, for example, by a communication module (3590). A signal or power may be transmitted or received between the communication module (3590) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (3597).

[0382] According to various embodiments, the antenna module (3597) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0383] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0384] According to one embodiment, commands or data may be transmitted or received between the electronic device (3501) and an external electronic device (3504) through a server (3508) connected to a second network (3599). Each of the external electronic devices (3502, or 3504) may be the same or a different type of device as the electronic device (3501). According to one embodiment, all or part of the operations performed on the electronic device (3501) may be performed on one or more of the external electronic devices (3502, 3504, or 3508). For example, if the electronic device (3501) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (3501) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (3501). The electronic device (3501) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (3501) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (3504) may include an Internet of Things (IoT) device. The server (3508) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (3504) or server (3508) may be included within the second network (3599). The electronic device (3501) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0385] Some of the operations described above may be executed (or performed) through an artificial intelligence (AI) system, which will be described in more detail later with reference to FIG. 36.

[0386] FIG. 36 is a diagram illustrating an exemplary configuration of an AI system according to various embodiments. Referring to FIG. 36, the AI ​​system (3600) may include an input / output interface (3610) (e.g., including circuits), an AI framework (3620), a generative AI model (3630) (e.g., including various circuits and / or executable program instructions), and / or a knowledge repository (3690) (e.g., memory).

[0387] The input / output interface (3610) can receive input and may include various circuits. The input may include user input and / or data obtained or generated by an electronic device (e.g., the electronic device (101) and / or the electronic device (3501) described above). The above data may include images, videos, and / or sensor data generated by at least one processor of the electronic device (e.g., at least one processor (210) or processor (3520)) (e.g., illumination data around the electronic device obtained from a sensor or sensor hub (e.g., auxiliary processor (3523)), posture data (or orientation data) of the electronic device, temperature inside the electronic device (e.g., temperature of the display (110) and / or processor (210)), size information of the display area of ​​the display (110), and / or images obtained through an image sensor of the electronic device (e.g., included in the camera module (3580)). The user input may include natural language, touch data obtained through a touch circuit included in the display (110) (e.g., used to identify input from a finger and / or stylus), images displayed (and / or to be displayed) on the display (110), and / or videos. By example, without limitation, the user input may include input / output along with context information. It may be received by an interface (3610). The context information may be described as additional information obtained in relation to the user input. The context information may be related to the state at the time the user input is received (e.g., the state of the electronic device and / or the state around the electronic device (e.g., user state)). For example, the context information may include information about one or more software applications executed within the electronic device at the time the user input is received.For example, the above situation information may include information about the location of the electronic device (or the location of the user of the electronic device) at the time the user input is received. For example, the user input may be integrated with the situation information. For example, the user input with the situation information integrated as the input may be received by the input / output interface (3610).

[0388] The input / output interface (3610) may transmit (or provide) an output. The output may include a result (or result information) generated or obtained by the AI ​​system (3600) based on at least part of the input. The format of the output may vary. For example, the output may include natural language. For example, the output may include content (e.g., media content and / or multimedia content). For example, the output may include actions related to the user of the electronic device. For example, the output may have a format according to the user settings of the electronic device.

[0389] The input / output interface (3610) can be described as a user question / response interface (3610).

[0390] The AI ​​framework (3620) can be used to obtain information (or data) about the input from the input / output interface (3610) and to control one or more components related to the AI ​​system (3600) using the obtained information.

[0391] For example, a prompt design component (3621) within an AI framework (3620) (e.g., including various circuits and / or executable program instructions) can generate or acquire prompts for a generative AI model (3630) (e.g., including a large language model (LLM) or a large multimodal model (LMM)) using the acquired information. For example, the prompt design component (3621) may be described as an AI component that uses a learning algorithm and / or a neural network to provide prompts that are enhanced over time. For example, the prompt design component (3621) can generate or acquire prompts by accessing a knowledge component (e.g., a knowledge repository (3690)) containing user preference data, a prompt library, and / or prompt examples using the acquired information. The generated prompts may be provided to the generative AI model (3630) (e.g., including an LLM or LMM).

[0392] For example, an API / plugin management component (3622) within an AI framework (e.g., including various circuits and / or executable program instructions) may be used to support communication for additional information requested (or induced) in relation to the prompt provided (or to be provided) to the generative AI model (3630). For example, the API / plugin management component (3622) may be used to create or establish a channel for communication with various data sources (e.g., knowledge repository (3690)). For example, the API / plugin management component (3622) may support access to at least some of the data sources. For example, the API / plugin management component (3622) may be used to request another component (e.g., application / service component (3680)) that performs feedback (or response) according to the prompt. As a non-limiting example, information obtained (or generated) through the API / plugin management component (3622) may be provided to the prompt design component (3621) for the generation of a prompt. As a non-limiting example, information obtained (or generated) through the API / plugin management component (3622) may be provided to the generative AI model (3630).

[0393] For example, an improvement component (3623) within the AI ​​framework (3620) can at least partially tune (or adjust) (or change) the result (e.g., content) obtained (or output) from the generative AI model (3630). For example, the improvement component (3623) can determine or verify whether the content obtained from the generative AI model (3630) is related to the input. For example, the improvement component (3623) can determine or verify whether the content obtained from the generative AI model (3630) contains biased content. For example, the improvement component (3623) can determine or verify whether the content obtained from the generative AI model (3630) contains harmful content. For example, the improvement component (3623) can support or assist in performing additional processing to improve the content obtained from the generative AI model (3630). For example, the improvement component (3623) may support providing a hint to the user to improve the content.

[0394] A generative AI model (3630) can be described as an artificial intelligence neural network that generates feedback in response to a prompt. For example, the feedback may include additional data and / or information relative to the prompt, but relative to the prompt. For example, the feedback may include new content relative to the prompt. For example, the generative AI model (3630) may include a model that generates images and / or a model that generates language. For example, the model that generates images may include a generative adversarial network (GAN) and / or a variational autoencoder (VAE). For example, the model that generates images may include a diffusion-based generative model (e.g., a transformer VAE). For example, the model that generates language may include CHAT-GPT 3 and / or CHAT-GPT 4. For example, the generative AI model (3630) may include an LMM that generates the feedback by recognizing text, images, and / or voice.

[0395] As an example without limitation, the AI ​​framework (3620) and / or generative AI model (3630) may be included within an AI module (e.g., including a processing circuit) within the electronic device. For example, the AI ​​module may be operatively coupled with at least one processor of the electronic device (e.g., at least one processor (210) or processor (3520)). For example, the AI ​​module may be operatively coupled with a display driving circuit of the electronic device. For example, the AI ​​module may be operatively coupled with a sensor hub of the electronic device for one or more sensors within the electronic device.

[0396] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, a consumer electronics device, or something similar. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0397] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” said component may be connected to said other component directly (e.g., by wire), wirelessly, or through a third component.

[0398] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, or any combination thereof, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0399] Various embodiments of the present document may be implemented as software (e.g., program (3540)) comprising one or more instructions stored in a storage medium (e.g., internal memory (3536) or external memory (3538)) readable by a machine (e.g., electronic device (3501)). For example, a processor (e.g., processor (3520)) of the machine (e.g., electronic device (3501)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, a 'non-transient' storage medium is a tangible device and may not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily in the storage medium.

[0400] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0401] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components ...

Claims

1. In an electronic device, Touchscreen display; Memory comprising one or more storage media for storing instructions; and It includes at least one processor including a processing circuit, and At least one processor is configured to execute instructions individually or collectively, and the electronic device: At least based on determining that the time information of the electronic device corresponds to a specified time, the first information of a first application and the second information of a second application among a plurality of applications are identified, and each of the first information and the second information is acquired during a specified period corresponding to the time information; Through a machine learning model, a first content including a first image and a first text using the first information, and a second content including a second image and a second text using the second information are generated; Based on the above time information, determine the priority of the first content and the second content; and Causing the first content and the second content to be displayed simultaneously through the touchscreen display based on the above priority, Electronic device.

2. In Claim 1, At least one processor, individually or collectively, the electronic device: Generate summary text using the first content, wherein the first priority of the first content is higher than the second priority of the second content; and Configured to cause the summary text to be displayed in a first part and the second content sorted according to the priority to be displayed in a second part below the first part through the touchscreen display. Electronic device.

3. In Claim 1, At least one processor, individually or collectively, the electronic device: Identifying location information of the above electronic device; Based at least on determining that the above time information corresponds to a different designated time and the above location information corresponds to a designated location, the first information of the first application among the plurality of applications is refrained from being identified, and the third information of the third application is identified; Generate the first content using the third information above; and Configured to cause determining the priority of the first content and the second content based on the time information and the location information above. Electronic device.

4. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Using the machine learning model above, at least one message based on the time information, the first information, and the second information is generated; Causing to display at least one message on the upper portion of the first content and the second content through the touchscreen display, Electronic device.

5. In Claim 4, At least one processor, individually or collectively, the electronic device: At least based on determining that the state of the electronic device corresponds to a lock screen state, a first graphic object including text associated with a portion of the at least one message, or a content having a higher priority among the first content and the second content, is displayed at a first location on the lock screen through the touchscreen display; At least based on determining that the state of the electronic device corresponds to a home screen state, configured to cause a second graphic object, comprising a portion of the at least one message or other text associated with the content having a high priority, to be displayed at a second location on the home screen through the touchscreen display. The size of the second graphic object is different from the size of the first graphic object. Electronic device.

6. In Claim 5, At least one processor, individually or collectively, the electronic device: Receive input related to the first graphic object or the second graphic object through the touchscreen display; Configured to cause the first content and the second content to be displayed according to the priority through the touchscreen display in response to the above user input, Electronic device.

7. In Claim 6, At least one processor, individually or collectively, the electronic device: Receiving other inputs to enter the above lock screen state; Configured to cause the home screen, which includes a third graphic object corresponding to a fourth application running in the background of the electronic device, to be displayed via the touchscreen display in response to the above other input, Electronic device.

8. In Claim 1, At least one processor, individually or collectively, the electronic device: While displaying the first content and the second content, receiving feedback input for the first content; Configured to cause determining the priority based on the above feedback user input, Electronic device.

9. In Claim 1, At least one processor, individually or collectively, the electronic device: Using the machine learning model above, generate personalized information based on images and text stored in the memory; Based at least on the above personalized information, context information is determined using the first information and the second information; Performing the generation of the first content and the second content based on the above context information; and Causing to determine the priority of the first content and the second content based on the above context information and the above time information, Electronic device.

10. In Claim 1, At least one processor, individually or collectively, the electronic device: Receive input for the first content through the touchscreen display; Configured to cause the UI (user interface) of the first application corresponding to the first content to be displayed through the touchscreen display in response to the above input, Electronic device.

11. In an electronic device, display; Memory comprising one or more storage media for storing instructions; and It includes at least one processor including a processing circuit, and At least one processor, individually or collectively, the electronic device: Identify at least one message generated based on the execution of at least one software application; Determining priorities corresponding to each of the above at least one message; Using the above-determined priorities, obtain text expressing a summary of at least one message; and Causing to display visual objects each comprising at least one message arranged according to the determined priority, together with the acquired text, Electronic device.

12. In claim 11, the at least one message is the first messages, and At least one processor, individually or collectively, the electronic device: Generating a second message using information about the user of the electronic device; and Configured to determine and cause priorities corresponding to the first messages and the second messages, respectively. Electronic device.

13. In Claim 11, At least one processor, individually or collectively, the electronic device: Receiving input related to any one of the above visual objects; and Based on the above input, configured to cause to display a screen provided by a software application corresponding to a visual object associated with the above input. Electronic device.

14. In Claim 11, At least one processor, individually or collectively, the electronic device: Based on obtaining the text of the first length, a widget object including text of a second length shorter than the first length is displayed on the lock screen, and the text of the second length represents a summary of the text of the first length; and Configured to cause the visual objects, each comprising the messages arranged according to the determined priority, together with the text of the first length, based on the input associated with the above widget object, Electronic device.

15. In Claim 14, At least one processor, individually or collectively, the electronic device: Based on the above input, perform authentication for the user of the electronic device; and Based on the above authentication, configured to cause a screen including the above text and the above visual objects to be displayed, Electronic device.

Images