Electronic device and method for providing user interface therefor

Abstract

An electronic device according to an embodiment of the present disclosure may be configured to: identify at least one of user personal information stored in a memory of the electronic device and a user input inputted to the electronic device; generate at least one prompt on the basis of at least one of the user personal information and the user input; generate a first user interface for guiding a recommended operation by inputting the at least one prompt to an artificial intelligence model; and provide the generated first user interface through a display of the electronic device.

Description

Electronic device and method for providing a user interface therefor

[0001] The present disclosure relates to an electronic device and a method for providing a user interface for the electronic device.

[0002] Recently, services that recommend content relevant to a user's electronic device usage patterns have become widespread. Electronic devices can recommend various content based on a user's usage history (e.g., user data). For example, content may include news, movies, and / or music. To improve the accuracy of content recommendation services, methods for selecting content with high user interest are being discussed.

[0003] Electronic devices can display a UI containing content of interest to the user. The UI containing content of interest to the user may include a UI for executing applications such as products and / or games, or a widget that induces an action on the electronic device. The electronic device may display notifications related to the content.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0005] An electronic device according to one embodiment may include a display, at least one processor electrically connected to the display, and a memory electrically connected to the at least one processor and storing instructions. The instructions, when executed by the at least one processor, may cause the electronic device to identify at least one of user personal information stored in the memory or a user input input to the electronic device, generate at least one prompt based on at least one of the user personal information or the user input, input the at least one prompt into an artificial intelligence model, thereby generating a first user interface that guides a recommended action, and provide the generated first user interface through the display.

[0006] A method of an electronic device according to one embodiment may include an operation of identifying at least one of user personal information stored in a memory of the electronic device or a user input inputted into the electronic device, an operation of generating at least one prompt based on at least one of the user personal information and the user input, an operation of generating a first user interface that guides a recommended action by inputting the at least one prompt into an artificial intelligence model, and an operation of providing the generated first user interface through a display of the electronic device.

[0007] A non-transitory computer-readable recording medium storing instructions according to one embodiment may store instructions that, when executed by a processor of an electronic device, cause the processor to perform an operation of identifying at least one of user personal information stored in a memory of the electronic device or a user input inputted into the electronic device, an operation of generating at least one prompt based on at least one of the user personal information or the user input, an operation of generating a first user interface that guides a recommended action by inputting the at least one prompt into an artificial intelligence model, and an operation of providing the generated first user interface through a display of the electronic device.

[0008] Figure 1 is a block diagram showing the configuration of an electronic device according to one embodiment.

[0009] Figures 2a and 2b are flowcharts illustrating the operation of an electronic device according to one embodiment.

[0010] Figures 3a to 3f illustrate the configuration of modules of an electronic device according to one embodiment.

[0011] FIG. 4 illustrates the data format of data passed to the prompt manager, according to one embodiment.

[0012] FIGS. 5A and 5B illustrate a user interface displayed on a display based on user personal information, according to one embodiment.

[0013] FIGS. 6A through 6C illustrate a user interface displayed on a display based on user personal information or user input, according to one embodiment.

[0014] FIG. 7 is a block diagram of an electronic device within a network environment according to one embodiment.

[0015] Figure 8 illustrates an artificial intelligence system according to one embodiment.

[0016] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0017] Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that various modifications, equivalents, and / or alternatives of the embodiments of the present invention are included.

[0018] Figure 1 is a block diagram showing the configuration of an electronic device according to one embodiment.

[0019] Referring to FIG. 1, an electronic device (10) according to one embodiment may include a processor (100), a display (110), a memory (120), and a communication circuit (130). The electronic device (10) of FIG. 1 may correspond, for example, to the electronic device (701) of FIG. 7. The configurations of the electronic device (10) described below with reference to FIG. 1 are merely examples, and the embodiments of the present disclosure are not limited thereto. For example, the electronic device (10) may not include at least some of the configurations illustrated in FIG. 1 (e.g., the communication circuit (130)). For example, the electronic device (10) may further include other configurations (e.g., the configuration of the electronic device (701) of FIG. 7) in addition to the configurations illustrated in FIG. 1.

[0020] In one embodiment, the processor (100) may be electrically or operatively connected to a display (110), memory (120), and communication circuitry (130). "Operatively connected" between components may mean that the components are functionally connected or communicatively connected. For example, operatively connected components may exchange data with each other. For example, one component may transmit a control signal to another component operatively connected thereto, either directly or via another component, thereby causing the other component to perform a function.

[0021] According to one embodiment, the processor (100) may include at least one processor. The processor (100) may include one chip or one chipset. In the present disclosure, the processor (100) may be referred to as a hardware component having an architecture by at least one processing circuit. For example, the processor (100) may be disposed (or positioned) on a substrate (e.g., a printed circuit board) located within the electronic device (10) and may communicate with other components of the electronic device (10) through at least one conductive path formed on the substrate.

[0022] According to one embodiment, the processor (100) can control various components constituting the electronic device (10). In one example, the processor (100) can execute instructions stored in the memory (120). For example, the processor (100) can generate a user interface using a machine learning module and display the generated new user interface on at least a portion of the display (110). In one example, the processor (100) can use the communication circuit (130) to transmit and receive data for prompt generation. For example, the processor (100) can receive data for prompt generation from an external device (e.g., a server) using the communication circuit (130). The processor (100) of FIG. 1 may correspond to, for example, the processor (720) of FIG. 7.

[0023] According to one embodiment, the display (110) can display images and / or videos. The display (110) can include a plurality of pixels and wiring for driving each pixel. In one example, the display (110) can include a flexible display and / or a rigid display. For example, the flexible display can include a foldable display or a rollable display. The display (110) can be viewed, for example, through the front side or the back side of the foldable electronic device. The display (110) of FIG. 1 can correspond to, for example, the display module (760) of FIG. 7.

[0024] According to one embodiment, the memory (120) may store instructions executed by the processor (100). For example, the memory (120) may at least temporarily store data received from an external electronic device or a network. In one example, the memory (120) may store data associated with a prompt necessary to provide recommendation information to a user. A detailed description of the data allocated to the memory and / or the relationship between the allocated data will be described later with reference to FIGS. 3A to 3F. The memory (120) of FIG. 1 may correspond, for example, to the memory (730) of FIG. 7 .

[0025] According to one embodiment, the communication circuit (130) may include at least one circuit for transmitting and receiving data. The communication circuit (130) may include at least one circuit configured to perform conversion of transmitted and received data. In one example, the communication circuit (130) may include at least one antenna module for communicating with an external device (e.g., a server) for transmitting and receiving data. The communication circuit (130) of FIG. 1 may correspond to, for example, the communication module (790) of FIG. 7.

[0026] Figures 2a and 2b are flowcharts illustrating the operation of an electronic device according to one embodiment.

[0027] Referring to FIGS. 1 and 2A, an electronic device (10) (e.g., a processor (100) of the electronic device (10)) may generate a first user interface (UI) by identifying user personal information and / or user input, generating at least one prompt based on the identified user personal information and / or user input, and inputting the generated at least one prompt into an artificial intelligence model. The electronic device (10) may display the generated first user interface on at least a portion of a display (110). The artificial intelligence model may correspond to, for example, a generative artificial intelligence (AI) model (850) of FIG. 8.

[0028] According to one embodiment, the processor (100) may identify at least one of user personal information or user input in operation 201. In one example, the processor (100) may identify user personal information stored in the memory (120) of the electronic device (10). For example, the processor (100) may identify user personal information recorded in at least one of a calendar, notepad, gallery, or address book application of the electronic device (10). For example, the user personal information recorded in the calendar application may include data related to at least one of a title, date, time, location, or attendees of an event. In one example, the processor (100) may search for user personal information stored in the memory (120) of the electronic device (10) within a specified time range. For example, the processor (100) may search for user personal information stored in the memory (120) for the past year.

[0029] According to one embodiment, the processor (100) can identify a user input inputted into the electronic device (10). In one example, the processor (100) can identify a user input inputted into an input interface (e.g., a search window) displayed on at least a portion of the display (110) of the electronic device (10). For example, the processor (100) can identify text entered by a user into a search window displayed on a screen (e.g., a home screen) of the electronic device (10). In one example, the processor (100) can identify a user input inputted based on a user interface displayed on at least a portion of the display (110) of the electronic device (10). For example, the processor (100) can identify a user input inputted into a widget displayed on at least a portion of the display (110).

[0030] According to one embodiment, the processor (100) may collect user personal information and / or terminal information of the electronic device (10) stored in the memory (120) of the electronic device (10) periodically or based on the occurrence of a specified event. For example, the processor (100) may periodically collect user schedule information recorded in a calendar application. For example, the processor (100) may analyze the cycle in which the user activates a certain application of the electronic device (10) to collect information related to the user's application usage pattern. For example, the processor (100) may store information on user input that the user has previously input into the electronic device (10). In one example, the processor (100) may identify user personal information and / or user input based on the periodically collected user personal information and / or terminal information.

[0031] According to one embodiment, the processor (100) may generate at least one prompt based on at least one of user personal information or user input at operation 203. In one example, the processor (100) may identify data suitable for prompt generation from the identified user personal information. For example, the processor (100) may identify text (e.g., video conference, 60th birthday party, or overseas business trip) corresponding to a user event (e.g., meeting, anniversary, or business trip) among user personal information stored in the user's calendar application, and data corresponding to the date, time, and / or location of the scheduled event. In one example, the processor (100) may identify data suitable for prompt generation from the identified user input. For example, the processor (100) may identify text (e.g., meeting, wedding anniversary, business partner, bank, or volume) corresponding to a user event (e.g., meeting, anniversary, business trip, application search, or device setting) among user inputs entered in a search box of a home screen, and data corresponding to the date, time, and / or location of the scheduled event. Detailed operations for identifying data suitable for prompt generation from user personal information and / or user input are described later in FIG. 4.

[0032] According to one embodiment, the processor (100) may generate at least one prompt using a prompt generation algorithm. In one example, the prompt generation algorithm may correspond to an algorithm stored in the memory (120) or an algorithm stored in an external device. In one example, the prompt generation algorithm may include an algorithm implemented by a generative artificial intelligence model. In one example, the prompt generation algorithm may generate a prompt based on data identified by the processor (100). For example, if the processor (100) identifies data such as 'father', '70th birthday party', and 'September 19th' from user personal information and / or user input, the prompt generation algorithm may generate a prompt such as 'Collect action information related to father (e.g., call mother)', 'Collect application information related to 70th birthday party (e.g., restaurant reservation application)', or 'Collect widget information related to September 19th (e.g., user interface displaying the weather on September 19th)'. The detailed operation of generating a prompt is described later in FIG. 3d and FIG. 5a.

[0033] According to one embodiment, the prompt generation algorithm may select applications, actions, widgets, and / or terminal states related to the user personal information and / or the user input based on data identified by the processor (100) from the user personal information and / or the user input, and may generate a prompt requesting widget configuration based on the selected data. In one example, the prompt generation algorithm may generate a prompt requesting to collect applications, actions, widgets, and / or terminal states related to the user personal information and / or the user input, and may generate a prompt requesting widget configuration based on the collected applications, actions, widgets, and / or terminal states based on the generated prompt.

[0034] According to one embodiment, the processor (100) may generate a first user interface by inputting at least one prompt to an artificial intelligence model at operation 205. In one example, the artificial intelligence model may include an artificial neural network based on machine learning. For example, the artificial intelligence model may include a generative neural network (hereinafter, a generative adversarial network (GAN)), a variational autoencoder (VAE), or a style GAN. In one example, the artificial intelligence model may generate a user interface based on the prompt generated by the processor (100). For example, if the prompt "Collect application information related to the 70th birthday party" is input to the artificial intelligence model, the artificial intelligence model may collect restaurant reservation applications and flower delivery applications. In one example, the artificial intelligence model may generate a user interface based on the collected data. For example, if an AI model is prompted with the message, "Place the collected application information on the home screen," the AI ​​model can generate a user interface in which the applications most relevant to the 70th birthday party are placed on the home screen in order.

[0035] According to one embodiment, the processor (100) may display a user interface on at least a portion of the display (110) at operation 207. In one example, the processor (100) may display a user interface generated by an artificial intelligence model on the display at operation 205. For example, the artificial intelligence model may collect applications related to the 70th birthday party based on a prompt such as 'Collect application information related to the 70th birthday party', and may generate a user interface configured to correspond to the home screen of the electronic device (10) based on a prompt such as 'Place the collected application information on the home screen', with the applications related to the 70th birthday party. For example, the processor (100) may display a user interface generated in the form of a 4x2 widget on the display so that the applications related to the 70th birthday party correspond to the configuration of the home screen. In one example, the processor (100) may display a user interface generated by an artificial intelligence model stored in the memory (120) on at least a portion of the display (110). In one example, the processor (100) may receive a user interface generated by an artificial intelligence model stored in an external server device (e.g., server (708) of FIG. 7). The processor (100) may display the received user interface on at least a portion of the display (110).

[0036] Referring to FIG. 2b, the electronic device (10) (e.g., the processor (100) of the electronic device (10)) may identify user personal information and / or user input, generate at least one prompt based on the identified user personal information and / or user input, input the generated at least one prompt into an artificial intelligence model to generate a first user interface, and then determine whether additional information is needed, thereby displaying a second user interface generated based on the first user interface or the additional information on at least a portion of the display (110).

[0037] According to one embodiment, the processor (100) may identify at least one of user personal information or user input at operation 211. In one example, the processor (100) may identify user personal information stored in the memory (120) of the electronic device (10). For example, the processor (100) may identify user personal information recorded in a calendar, notepad, gallery, or address book application of the electronic device (10). For example, the user personal information recorded in the gallery application may include data related to at least one of the shooting date, time, location, or object (e.g., at least one object captured in the photo) of a photo stored in the gallery application.

[0038] According to one embodiment, the processor (100) can identify a user input inputted into the electronic device (10). In one example, the processor (100) can identify a user input inputted into the electronic device (10). For example, the processor (100) can identify text entered by a user into a search window displayed on a home screen of the electronic device (10). For example, the processor (100) can identify a user input entered into a widget displayed on at least a portion of the display (110). In one example, the user input may include a voice input, a gesture, or a movement pattern of the electronic device (10) (e.g., a shaking motion or a turning motion of the electronic device (10).

[0039] According to one embodiment, the processor (100) may generate at least one prompt based on at least one of user personal information or user input at operation 213. In one example, the processor (100) may identify data suitable for prompt generation from the identified user personal information. For example, the processor (100) may identify, among the user personal information stored in the user's notepad application, text (e.g., airport, exam admission ticket, or graduation) corresponding to a user event (e.g., travel, exam, or graduation), data corresponding to a scheduled event date, time, and / or location. According to one embodiment, the processor (100) may identify data suitable for prompt generation from the identified user input. For example, the processor (100) may identify, among the user voice inputs inputted to the electronic device, voice data (e.g., airport, exam admission ticket, or graduation) corresponding to a user event (e.g., travel, exam, or graduation), and voice data corresponding to a scheduled event date, time, and / or location.

[0040] In one embodiment, the processor (100) may use an artificial intelligence model to identify data suitable for prompt generation from user personal information and / or user input. For example, the processor (100) may analyze photos stored in a gallery application using an artificial intelligence model to identify keywords corresponding to the weather, season, person, or location captured in the photos. In one example, the processor (100) may utilize the identified keywords as data suitable for prompt generation. For example, the processor (100) may analyze photos stored in the gallery application using an artificial intelligence model and identify keywords such as "winter" and "animal" from the photos stored in the gallery application. The processor (100) may utilize the identified "winter" and "animal" keywords to generate the prompt.

[0041] In one embodiment, the processor (100) may generate at least one prompt using a prompt generation algorithm. In one example, the prompt generation algorithm may correspond to an algorithm stored in the memory (120) or an algorithm stored in an external device. In one example, the prompt generation algorithm may include an algorithm implemented by a generative artificial intelligence model. In one example, the prompt generation algorithm may generate a prompt based on data identified by the processor (100).

[0042] According to one embodiment, the prompt may be generated at a time when at least one of user personal information or user input is identified, or at least at a time after the time when the user input is identified. For example, when a user input such as “I’m going to OO Land tomorrow, what should I do?” is input into the electronic device (10), the processor (100) may immediately generate a prompt such as “Collect widget information related to OO Land.” For example, when schedule information is input into a calendar application, the processor (100) may generate a prompt at a time corresponding to the input schedule information. For example, when data such as “May 5 OO Land” is stored in the calendar application, the processor (100) may generate a prompt such as “Collect application information related to OO Land” at a time corresponding to one week after the time when the data is stored, or one day before May 5 (e.g., May 4).

[0043] According to one embodiment, the processor (100) may generate a first user interface by inputting at least one prompt to an artificial intelligence model at operation 215. In one example, the artificial intelligence model may include an artificial neural network based on machine learning. In one example, referring to FIG. 2A together, operations 201 to 205 of FIG. 2A and operations 211 to 215 of FIG. 2B may correspond. In one example, operations 201 to 205 of FIG. 2A and operations 211 to 215 of FIG. 2B may include common operations, and for the sake of convenience of explanation, a detailed description of the common operations may be omitted.

[0044] According to one embodiment, the processor (100) may determine, at operation 217, whether additional information is required to generate a user interface. In one example, if the data included in the first user interface is insufficient, the processor (100) may determine that additional information is required. For example, if the number of recommended applications included in the first user interface is less than a predetermined number (e.g., 3), the processor (100) may set a user personal information reference period stored in the electronic device (10) to a longer period. In one example, the processor (100) may use the first user interface to determine whether the user requires additional information. For example, the processor (100) may include an interface for receiving additional input of companion information in the first user interface related to the user's travel itinerary. For example, the processor (100) may include an interface for receiving additional input of gift information for the birthday person, preference information for the birthday person, budget information for the birthday itinerary, and / or location information in the first user interface related to the birthday itinerary. For example, the processor (100) may include, in a first user interface related to shopping, an interface for receiving additional input of store information, alternative product information, and / or price information not included in the first user interface.

[0045] According to one embodiment, the processor (100) may display the generated user interface on at least a portion of the display (110) in operation 219. In one example, the processor (100) may display the user interface generated by the artificial intelligence model stored in the memory (120) on at least a portion of the display (110). In one example, the processor (100) may receive the user interface generated by the artificial intelligence model stored in an external server device (e.g., server (708) of FIG. 7). The processor (100) may display the received user interface on at least a portion of the display (110). In one example, when a second user interface generated as an additional prompt is generated, the processor (100) may display the additional user interface on at least a portion of the display (110).

[0046] According to one embodiment, the processor (100) may change the configuration of the generated user interface based on the display (110) environment. For example, when the generated user interface is displayed on the home screen of the electronic device (10), the processor (100) may adjust the color and / or size of the generated user interface based on the background color and / or size of the home screen. For example, the processor (100) may adjust the arrangement of application icons included in the generated user interface and / or the arrangement order of the action recommendation user interface.

[0047] According to one embodiment, if additional information is needed to generate a user interface (e.g., yes in operation 217), the processor (100) may generate an additional user interface and identify at least one of additional user personal information or additional user input in operation 221. In one example, after generating the first user interface, the processor (100) may generate an additional user interface to prompt the user for additional user personal information and / or additional user input. For example, in relation to the first user interface related to an anniversary, the additional user interface may include a user interface asking whether the anniversary location has changed. In one example, the processor (100) may identify the additional user personal information and / or additional user input. In one example, the operations performed by the processor (100) in operation 221 may include the operations performed in operation 211.

[0048] According to one embodiment, the processor (100) may generate an additional prompt based on at least one of additional user personal information or additional user input at operation 223, and may generate a second user interface based on the additional prompt. In one example, the processor (100) may generate at least one prompt based on the additional user personal information and / or additional user input identified at operation 221. In one example, the operations performed by the processor (100) at operation 223 may include the operations performed at operations 213 to 215.

[0049] The order of the operations described above with respect to FIGS. 2A and 2B is merely exemplary and embodiments of the present disclosure are not limited thereto. For example, at least some of the operations may be performed in a different order than that of FIG. 2A or 2B, or may be performed substantially concurrently with other operations of FIG. 2A or 2B. At least some of the operations described above with respect to FIGS. 2A and 2B may be omitted.

[0050] According to one embodiment, the user's personal information may include at least one of the user's schedule information, date information, time information, location information, photo information, memo information stored in the memory (120), or data received from an application installed in the electronic device (10). In one example, the user input may include at least one of the user's schedule information, date information, time information, location information, product information, attendee information, or interface information (e.g., search window, home screen widget) into which the user input is entered.

[0051] An electronic device (10) according to one embodiment may generate an additional user interface for generating an additional prompt. In one example, the electronic device (10) may identify at least one of additional user personal information or additional user input stored in a memory (120) based on the additional user interface, and may generate at least one additional prompt based on the identified at least one of the additional user personal information or additional user input. In one example, the electronic device (10) may generate a second user interface that guides a recommended action by inputting the additional prompt into an artificial intelligence model, and may provide the generated second user interface through the display (110).

[0052] In one embodiment, at least one prompt may cause the artificial intelligence model to collect at least one of application, action, widget, or resolution information associated with at least one of user personal information or user input. In one example, the at least one prompt may cause the artificial intelligence model to generate the first user interface based on at least one of the collected application, action, widget, or resolution information.

[0053] Figures 3a to 3f illustrate the configuration of modules of an electronic device according to one embodiment.

[0054] Referring to FIG. 3A, the electronic device (10) may include a data reference module (3000), a data control module (3100), an input field module (3200), a trigger generation module (3300), a UI generation module (3400), and / or a UI output module (3500). In one example, the electronic device (10) may be configured to implement a software structure. For example, the software structure may be implemented by instructions stored in a memory (120) being executed by a processor (100). Components within the software structure may be referred to as software modules (e.g., applications, programs, or threads). For example, the software structure may include a data reference module (3000), a data control module (3100), an input field module (3200), a trigger generation module (3300), a UI generation module (3400), and / or a UI output module (3500).

[0055] According to one embodiment, the data reference module (3000) may store data corresponding to the application (3020) and / or the system (3040). In one example, the data reference module (3000) may provide data that may be utilized for prompt generation to the data control module (3100). In one example, the data reference module (3000) may store data stored in the application (3020) and / or data related to the system (3040) settings of the electronic device (10). For example, the data reference module (3000) may store user address book data stored in a messenger application and periodic airplane mode setting record data of the system (3040). In one example, the application (3020) may include at least one data generated while the application (3020) is running in the electronic device (10). In one example, the system (3040) may include at least one data stored in the memory (120) of the electronic device (10). In one example, the application (3020) of FIG. 3A may include data corresponding to, for example, the application / service module (840) of FIG. 8. In one example, the system (3040) of FIG. 3A may include data corresponding to, for example, the database (830) of FIG. 8.

[0056] In one embodiment, the data control module (3100) may collect data required for prompt generation from the data reference module (3000). In one example, the data control module (3100) may collect user personal information stored in the memory (120) of the electronic device (10) from the data reference module (3000). In one example, the data control module (3100) may periodically collect system information of the electronic device (10) stored in the memory (120) from the data reference module (3000).

[0057] According to one embodiment, the input field module (3200) may collect user input data input into the electronic device (10). In one example, the input field module (3200) may collect user input data input into a search window displayed in at least a portion of the display (110) of the electronic device (10). In one example, the input field module (3200) may identify the input user input based on a widget displayed in at least a portion of the display (110). In one example, the user input may include a voice input, a gesture, or a change in the positional state of the electronic device (10) by the user (e.g., a motion of shaking or turning over the electronic device (10).

[0058] According to one embodiment, the trigger generation module (3300) may generate data suitable for prompt generation from data collected by the data control module (3100) and / or the input field module (3200). In one example, the data suitable for prompt generation may correspond to a trigger. In one example, the trigger may correspond to data that has the potential to generate a user interface among user personal information and / or data included in user input. For example, the trigger generation module (3300) may identify, among user voice inputs input into an electronic device, voice data corresponding to a user event (e.g., travel, exam, or graduation) (e.g., airport, exam admission ticket, or graduation ceremony), an event start date, an event progress time, and / or an event occurrence location, and may generate the identified data as a trigger. For example, the trigger generation module (3300) may identify, among user inputs input into an electronic device, data corresponding to a user event (e.g., periodic overseas business trips) (e.g., airplane mode setting input occurring in the first week of every month), and generate the identified data as a trigger.

[0059] In one embodiment, the UI generation module (3400) may include a prompt manager (3420) and / or an app / action set generator (3440). In one example, the UI generation module (3400) may generate a prompt based on a trigger received from the trigger generation module (3300). In one example, the prompt manager (3420) may generate at least one prompt using a prompt generation algorithm. In one example, the prompt generation algorithm may correspond to an algorithm stored in the memory (120) or an algorithm stored in an external device. In one example, the prompt generation algorithm may generate a prompt using a generative artificial intelligence model. In one example, the prompt manager (3420) may generate a prompt based on a trigger received from the trigger generation module (3300). In one example, the app / action set generator (3440) may generate a list of applications and / or a UI for executing an action (e.g., switching to sleep mode, launching a camera application, or accessing a uniform resource locator (URL)) of the electronic device (10) in response to a prompt.

[0060] According to one embodiment, the UI generation module (3400) can generate an application / action set based on a prompt generated by the prompt manager (3420). In one example, the application / action set can correspond to a user interface including a user interface that displays recommended applications to a user and / or a user interface that controls the operation of the electronic device (10). In one example, the app / action set generator (3440) can generate a user interface corresponding to the application / action set by inputting a prompt received from the prompt manager (3420) into a generative artificial intelligence model.

[0061] According to one embodiment, the UI output module (3500) may display the user interface received from the UI generation module (3400) on at least a portion of the display (110) of the electronic device (10). In one example, the UI output module (3500) may display the user interface on at least a portion of the display (110) based on user personal information and / or user input. For example, when a user input occurs in a search window of a home screen, the UI output module (3500) may display the user interface received from the UI generation module (3400) on a lower display area of ​​the search window of the home screen where the user input is entered. In one example, the UI output module (3500) may convert the user interface based on a display environment in which the user interface is displayed. For example, when the generated user interface is displayed on the home screen of the electronic device (10), the UI output module (3500) may adjust the color and / or the size of the generated user interface based on the background color of the home screen and the size of the home screen.

[0062] Referring to FIG. 3B, the data control module (3100) may include a data receiver (3120), a data handler (3140), and / or a database (3160). In one example, the data control module (3100) may receive data corresponding to an application (3020) and / or a system (3040) of an electronic device (10) from a data reference module (3000). In one example, the data control module (3100) may receive data from a server (3060).

[0063] In one embodiment, the data receiver (3120) may collect useful data that can be used to generate a user interface. In one example, the data receiver (3120) may collect data stored in the application (3020) from the application (3020), data related to the status of the electronic device (10) from the system (3040) of the electronic device (10) (e.g., Bluetooth connection status or WiFi wireless fidelity connection status), and data related to a user account from the server (3060). In one example, the data receiver (3120) may control the conditions of the data received based on a pre-specified period, a pre-specified action, or a pre-specified reception restriction setting (e.g., not receiving address book data).

[0064] According to one embodiment, the database (3160) may store data received by the data receiver (3120). In one example, the data stored in the database (3160) may include data in text format, data in voice format, and / or data in gesture format.

[0065] According to one embodiment, the data handler (3140) may reference data stored in the database (3160). In one example, the data handler (3140) may extract at least one of the data stored in the database (3160). In one example, the data handler (3140) may transfer the data referenced in the database (3160) to at least one module (e.g., the trigger generation module (3300)) included in an external device or electronic device (10). For example, the data handler (3140) may transfer the data referenced in the database (3160) to the trigger generator (3320) of the trigger generation module (3300).

[0066] Referring to FIG. 3C, the trigger generation module (3300) may include a trigger generator (3320) and / or a trigger filter (3340). In one example, the trigger generator (3320) may receive data for trigger generation from the data control module (3100) and / or the input field module (3200). In one example, the trigger generator (3320) may receive data corresponding to user personal information from the data handler (3140) of the data control module (3100). In one example, the trigger generator (3320) may receive data corresponding to user input from the input field module (3200).

[0067] In one embodiment, the trigger generator (3320) can generate a trigger based on data received from the data control module (3100) and / or the input field module (3200). In one example, the trigger generator (3320) can identify data suitable for prompt generation among the data received from the data control module (3100) and / or the input field module (3200). In one example, the trigger generator (3320) can generate the identified data as a trigger. For example, if the trigger generation module (3300) receives a user input of 'What should I prepare for the meeting next week?' from the input field module (3200), the trigger generator (3320) can identify text data of 'next week,' 'meeting,' 'what,' and 'prepare' from the user input, and generate the identified text data as a trigger.

[0068] In one embodiment, the trigger filter (3340) can filter the generated triggers. In one example, the trigger filter (3340) can delete triggers that are not related to the triggers generated by the trigger generator (3320) or delete triggers that contain harmful content. In one example, the criteria for filtering the generated triggers by the trigger filter (3340) can be preset or updated by an external device (e.g., a server).

[0069] Referring to FIG. 3D , the UI generation module (3400) may include a prompt manager (3420) and / or an app / action set generator (3440). In one example, the prompt generator (3421) may include application-related prompts (3422), action-related prompts (3423), widget-related prompts (3424), user / device-related prompts (3425), and / or UI configuration-related prompts (3426). In one example, the prompt manager (3420) of the UI generation module (3400) may receive a trigger generated from the trigger generation module (3300). In one example, the prompt manager (3420) may be referred to as a software module distinct from the UI generation module (3400). For example, the prompt manager (3420) can receive data from the trigger generation module (3300) and transmit the data generated by the prompt manager (3420) to the UI generation module (3400).

[0070] In one embodiment, the prompt manager (3420) may generate a prompt based on a trigger received from the trigger generation module (3300). In one example, the prompt manager (3420) may generate at least one prompt using the prompt generator (3421). In one example, the prompt may correspond to a prompt in the form of a request for data related to the trigger. In one example, the prompt generator (3421) may generate a prompt corresponding to the trigger based on a prompt generation algorithm. For example, the prompt generator (3421) may generate a prompt saying, "Collect application information related to winter" based on the trigger "winter."

[0071] In one embodiment, the prompts generated by the prompt generator (3421) may include application-related prompts (3422), action-related prompts (3423), widget-related prompts (3424), user / device-related prompts (3425), and / or UI configuration-related prompts (3426).

[0072] According to one embodiment, the prompt generator (3421) may generate at least one prompt associated with the received trigger according to a prompt generation algorithm. For example, the prompt generator (3421) may generate an app-related prompt (3422) associated with the received trigger, an action-related prompt (e.g., launching a call application of the electronic device (10) or a widget pop-up) associated with the received trigger (3423), a widget-related prompt (3424) associated with the received trigger, a user / device-related prompt (3425) associated with the received trigger, and / or a UI configuration-related prompt (3426) associated with the received trigger.

[0073] According to one embodiment, the user / device related prompt (3425) may include a prompt requesting the collection of data regarding the screen resolution and / or screen mode of the electronic device (10), a prompt requesting the collection of data regarding the WiFi or Bluetooth connection status of the electronic device (10).

[0074] According to one embodiment, the UI configuration related prompt (3426) associated with the trigger may include a prompt requesting to adjust the user interface in response to the home screen, if the trigger is generated based on a home screen. For example, if the trigger is generated based on a user input entered on the home screen and the grid of the current home screen is 4x5, the UI configuration related prompt (3426) may include a prompt requesting to arrange the collected application information in a 4x2 array and then arrange the collected widget information in a 4x3 array. For example, if the grid of the current home screen is 4x5, the UI configuration related prompt (3426) may include a prompt requesting to arrange the collected application information and the collected widget information in a 4x5 array in response to the grid arrangement of the home screen of the current electronic device (10).

[0075] In one embodiment, the UI configuration related prompt (3426) associated with the trigger may include a prompt requesting adjustment of the user interface in response to the search window, if the trigger is generated based on a search window. For example, if the trigger is generated based on user input entered in the search window, the UI configuration related prompt (3426) may include a prompt requesting that eight pieces of collected action information be selected and arranged in a list format. For example, if the trigger is generated based on user input entered in the search window, the UI configuration related prompt (3426) may include a prompt requesting that eight pieces of collected action information be arranged in a list format at the bottom of the search window displayed in at least a portion of the display (110).

[0076] In one embodiment, the prompt generator (3421) may generate a prompt to generate a user interface that determines whether additional user personal information and / or additional user input is required. For example, the prompt generator (3421) may generate a prompt that says, "Generate a user interface that determines whether additional information is required." In one example, the prompt generator (3421) may generate the prompt that says, "Generate a user interface that determines whether additional information is required," regardless of the trigger received from the trigger generation module (e.g., 3300 of FIG. 3A ).

[0077] Referring to FIG. 3E, the UI generation module (3400) may include a prompt manager (3420) and / or an app / action set generator (3440). In one example, the app / action set generator (3440) may include a generative artificial intelligence module (3442) and / or a recommended text / UI database (3444). In one example, the UI generation module (3400) may transfer a prompt generated from the prompt manager (3420) to the app / action set generator (3440). The generative artificial intelligence module (3442) of FIG. 3E may correspond to, for example, the data generation artificial intelligence model (850) of FIG. 8.

[0078] An artificial intelligence model according to one embodiment may correspond to a generative artificial intelligence module (3442). In one example, the artificial intelligence model (e.g., 3442) may be a generative artificial intelligence model including at least one of a GAN, a VAE, or a style GAN. In one example, the artificial intelligence model (e.g., 3442) may be an artificial intelligence model stored in the memory (120) or an artificial intelligence model stored in an external server device.

[0079] In one embodiment, the generative artificial intelligence module (3442) can generate a user interface based on a prompt generated from the prompt manager (3420). In one example, the generative artificial intelligence module (3442) can receive data from an application (3427), a system (3428), and / or a server (3429). In one example, the generative artificial intelligence module (3442) can generate a user interface based on the prompt input and data received from the application (3427), the system (3428), and / or the server (3429). The application (3427), the system, and the server (3429) of FIG. 3E may correspond to, for example, the application (3020), the system (3040), and the server (3060) of FIG. 3B .

[0080] In one embodiment, the generative artificial intelligence module (3442) may collect data related to the prompt from an application (3427), a system (3428), and / or a server (3429) based on the input prompt. The generative artificial intelligence module (3442) may then configure and generate a user interface corresponding to an application / action set of the electronic device (10) based on the received prompt and the collected data.

[0081] In one embodiment, the generative artificial intelligence module (3442) may include a module corresponding to a GAN, a VAE, or a style GAN. In one example, the generative artificial intelligence module (3442) may correspond to an artificial intelligence module stored in the electronic device (10) or an artificial intelligence module stored in an external device. In one example, the generative artificial intelligence module (3442) may correspond to the generative AI model (850) of FIG. 8.

[0082] In one embodiment, the generative artificial intelligence module (3442) may reference a recommendation text / UI database (3444) during the process of generating a user interface. In one example, the recommendation text / UI database (3444) may store data that may be referenced in the format of the results generated by the generative artificial intelligence module (3442). In one example, the results generated by the generative artificial intelligence module (3442) may be stored in the recommendation text / UI database (3444).

[0083] Referring to FIG. 3F, the UI output module (3500) may display the user interface received from the UI generation module (3400) on the home screen (3520), the search screen (3540), the background screen (3560), or the lock screen (3580), respectively. In one example, the UI output module (3500) may receive the user interface from the app / action set generator (3440) of the UI generation module (3400). In one example, the UI output module (3500) may display the received user interface on at least a portion of the display (110) based on the prompt that generated the received user interface.

[0084] According to one embodiment, the UI output module (3500) may determine a screen on which a user interface is displayed based on the output screen indicated by the prompt. For example, if a user voice input of “Tell me my schedule for tomorrow” occurs on the lock screen (3580), a first user interface displaying widget data related to tomorrow’s schedule may be generated, and the UI output module (3500) may display the first user interface on the lock screen (3580) of the electronic device (10). In one example, the UI output module (3500) may convert the user interface based on the screen on which the user interface is displayed. For example, if the generated user interface is displayed on an external display of a foldable electronic device, the UI output module (3500) may adjust the size and / or resolution of the user interface based on the size and / or resolution of the external display of the foldable electronic device. For example, the UI output module (3500) may adjust the size and / or resolution of the user interface based on the size and / or resolution of the internal display when the internal display is activated while the generated user interface is displayed on the external display of the foldable electronic device.

[0085] FIG. 4 illustrates the data format of data passed to the prompt manager, according to one embodiment.

[0086] Referring to FIG. 4, a trigger generation module (e.g., 3300 of FIG. 3A) may generate a trigger from received user personal information and / or user input. In one example, a trigger generated by the trigger generation module (e.g., 3300 of FIG. 3A) may be classified based on a preset data format. In one example, the preset data format may include classification criteria of "goal," "type," or "reference_data." In one example, the classification criteria of "reference_data" may include sub-classification criteria of "original_input_text," "date_time," "location," "attendee," "weather," "shopping," or "productivity." The classification criteria illustrated in FIG. 4 are merely examples, and other types of classification criteria may be preset and included in the data format. For example, the preset data format may further include sub-classification criteria of "event" and "transportation."

[0087] In one embodiment, data corresponding to "goal" may correspond to a trigger that indicates an output screen of a user interface. In one example, data corresponding to "goal" may be determined based on user personal information and / or the interface environment in which user input occurs (e.g., home screen, lock screen, speaker, widget, or search box). For example, if user input occurs on the home screen, a trigger called "create_homescreen" may be created, which is a trigger for creating a user interface on the home screen. For example, if user input occurs on the search box, a trigger called "create_finder_result" may be created, which is a trigger for creating a user interface corresponding to the search box.

[0088] In one example, data corresponding to "type" may correspond to a trigger indicating the purpose of the user interface. In one example, a recommended application / action may be determined based on the trigger corresponding to "type." In one example, if data matching a type set stored in the electronic device (10) is identified from user personal information and / or user input, the identified data may be determined as data corresponding to "type." For example, if schedule information or text containing schedule information is identified from user personal information and / or user input, data called "schedule" may be determined as data corresponding to "type." In this case, a trigger called "schedule" may be generated that can generate a schedule management application or a contact display widget. For example, if data related to music or media playback is identified from user personal information and / or user input, data called "play_media" may be determined as data corresponding to "type." In this case, a trigger called "play_media" can be created, which can display earphone connection information or a media playback application.

[0089] In one embodiment, data corresponding to "reference_data" may correspond to user personal information and / or user input. In one example, "reference_data" may correspond to data that can be referenced for generating a user interface. In one example, "reference_data" may include data corresponding to "original_input_text," "date_time," "location," "attendee," "weather," "shopping," and / or "productivity." In one example, sub-components of "reference_data" (e.g., "date_time," "location") may vary depending on the data corresponding to "type."

[0090] In one embodiment, the data corresponding to "original_input_text" may correspond to user personal information and / or user input. In one example, the data corresponding to "original_input_text" may include user personal information, voice input, a gesture, or a change in the positional state of the electronic device (10) by the user (e.g., shaking or flipping the electronic device (10)).

[0091] In one embodiment, the data corresponding to "date_time" may correspond to a trigger related to time information that can be referenced by the user interface. In one example, the data corresponding to "date_time" may be determined based on user personal information and / or time information included in user input. For example, if the schedule information stored in the electronic device (10) includes the text "10:00 AM, OO Land, Friend Kim OO," a trigger "18392739042" corresponding to the time information "10:00 AM" may be generated.

[0092] In one embodiment, data corresponding to "location" may correspond to a trigger related to location information that can be referenced by the user interface. In one example, data corresponding to "location" may be determined based on user personal information and / or location information included in user input. For example, if schedule information stored in the electronic device (10) includes the text "OO Land, 10:00 AM, Friend Kim OO," a trigger corresponding to the location information "OO Land" or "OO City, OO-dong (e.g., OO Land's address)" may be generated. In one example, data corresponding to "location" may include data recorded in the form of latitude and longitude.

[0093] In one embodiment, data corresponding to "attendee" may correspond to a trigger related to companion information that the user interface can reference. In one example, data corresponding to "attendee" may be determined based on user personal information and / or companion information included in user input. For example, if schedule information stored in the electronic device (10) includes the text "10:00 AM, Friend Kim OO," triggers corresponding to companion information such as "Kim OO," "010-XXXX-XXXX," or "kss@mail.com" may be generated.

[0094] In one embodiment, data corresponding to "weather" may correspond to a trigger related to weather information that can be referenced by the user interface. In one example, data corresponding to "weather" may be determined based on user personal information and / or weather information included in user input. For example, if the text "OO Land 10:00 AM" is included in the schedule information stored in the electronic device (10), a trigger called "sunny" corresponding to the weather information for OO Land at 10:00 AM may be generated. In one example, an artificial intelligence model may be used in the trigger generation process of the trigger generation module (e.g., 3300 of FIG. 3A). For example, the trigger generation module (e.g., 3300 of FIG. 3A) may use the artificial intelligence model to retrieve the address of OO Land, the date of visit, and the weather information corresponding to 10:00 AM from the user personal information of OO Land at 10:00 AM, and extract the corresponding data.

[0095] In one embodiment, data corresponding to "shopping" may correspond to a trigger related to shopping information that the user interface can reference. In one example, data corresponding to "shopping" may be determined based on user personal information and / or shopping information included in user input. For example, if schedule information stored in the electronic device (10) includes the text "OO Land 10:00 AM," a trigger called "OO Land" corresponding to the shopping information may be generated.

[0096] In one embodiment, data corresponding to "productivity" may correspond to a trigger associated with additional activity information that the user interface can reference. In one example, data corresponding to "productivity" may be determined based on user personal information and / or additional activity information included in user input. For example, if schedule information stored in the electronic device (10) includes the text "OO Land 10:00 AM," a trigger corresponding to the additional activity information, such as "camera" or "gallery," may be generated.

[0097] In one embodiment, data corresponding to "event" may correspond to a trigger related to event information that a user interface can reference. For example, if the text "Father's 70th birthday" is included in the schedule information stored in the electronic device (10), a trigger corresponding to the event information, such as "70th birthday" or "birthday," may be generated. In another example, data corresponding to "transportation" may correspond to a trigger related to transportation information that a user interface can reference. For example, if the text "OO Land" is included in the user input entered in the search box, a trigger corresponding to the transportation information, such as "train," "traffic situation," or "public transportation," may be generated.

[0098] According to one embodiment, user personal information and / or user input received by the trigger generation module (e.g., 3300) may be classified based on classification criteria included in the data format. In one example, the classified personal information and / or user input may correspond to a trigger. For example, if a user input "What should I do when I go to OO Land tomorrow?" is entered into a search box on the home screen, the data "What should I do when I go to OO Land tomorrow?" may be classified based on classification criteria included in the data format. The data "What should I do when I go to OO Land tomorrow?" may correspond to data such as "create_homescreen" for "goal", "schedule" for "type", "tomorrow" for "date_time", "OO Land" for "location", "attendee" for "Kim OO", and "sunny" for "weather", respectively. "create_homescreen", "schedule", "OO Land", "Kim OO", or "sunny" may each correspond to a trigger.

[0099] According to one embodiment, user personal information and / or user input received by the trigger generation module (e.g., 3300) may be reconstructed by the processor (100) based on a preset data format. In one example, user personal information and / or user input received by the trigger generation module (e.g., 3300) may be reconstructed into a JSON-based data format based on the preset data format. For example, user personal information and / or user input received by the trigger generation module (e.g., 3300) may be converted into a preset compressed file format.

[0100] FIGS. 5A and 5B illustrate a user interface displayed on a display based on user personal information, according to one embodiment.

[0101] Referring to FIG. 5A, the electronic device (10) may generate a user interface based on data stored in a user's schedule. In one example, referring to the calendar application execution screen (500) of the electronic device (10), the calendar application may store data regarding events such as September 17th, 8:00 AM, and the father's 70th birthday. In one example, September 17th, 8:00 AM, and the father's 70th birthday may correspond to user personal information transmitted from a data control module (e.g., 3100 of FIG. 3A) to a trigger generation module (e.g., 3300 of FIG. 3A).

[0102] According to one embodiment, referring to a screen (510) displaying a user interface of an electronic device (10), the user interface may include a user interface related to schedule guidance, a user interface (515) displaying a recommended application configuration, and a user interface (516) inducing an action of the electronic device (10). In one example, the user interface displayed on the screen (510) displaying the user interface may correspond to a user interface generated based on user personal information such as September 17th, 8:00 AM, and the father's 70th birthday.

[0103] According to one embodiment, a trigger generation module (e.g., 3300 of FIG. 3A) may generate triggers such as "September 17th", "8:00 AM", "father", and "70th birthday" based on user personal information such as September 17th, 8:00 AM, and father's 70th birthday. For example, the trigger generation module (e.g., 3300 of FIG. 3A) may extract triggers corresponding to "date_time" such as "September 17th" and "8:00 AM", extract triggers corresponding to "attendee" such as "father", and extract triggers corresponding to "event" such as "70th birthday" based on user personal information such as September 17th, 8:00 AM, and father's 70th birthday.

[0104] According to one embodiment, a prompt manager (e.g., 3420 of FIG. 3A) may receive a trigger from a trigger generation module (e.g., 3300 of FIG. 3A) to generate a prompt. For example, the prompt manager (e.g., 3420 of FIG. 3A) may generate prompts such as "Collect widget information related to September 17th," "Collect widget information related to 8:00 AM," "Collect widget information related to my 70th birthday," "Collect action information related to my father," and "Collect application information related to my 70th birthday" based on the trigger received from the trigger generation module (e.g., 3300 of FIG. 3A).

[0105] In one embodiment, when a prompt generated by a prompt manager (e.g., 3420 of FIG. 3A) is input to a generative artificial intelligence module (e.g., 3442 of FIG. 3E) of an app / action set generator (e.g., 3440 of FIG. 3A), a user interface corresponding to the prompt may be generated. For example, the generative artificial intelligence model (e.g., 3442 of FIG. 3E) may generate a user interface including the text, "Tomorrow is my father's 70th birthday. Traffic congestion is expected over the weekend, so you should leave earlier than usual," based on the input prompts.

[0106] According to one embodiment, in a user interface including the text "Tomorrow is my father's 70th birthday. Traffic congestion is expected over the weekend, so you need to leave earlier than usual," the data "my father's 70th birthday" (511) and "weekend" (512) may correspond to data generated based on schedule information stored in a calendar application, the data "traffic congestion expected" (513) may correspond to data generated based on date and time information displayed in the calendar application, and the data "you need to leave earlier than usual" (514) may correspond to data generated based on system (e.g., 3040 of FIG. 3A) or application (e.g., 3020 of FIG. 3A) execution history information of the electronic device (10) (e.g., a navigation application execution pattern record at 9:00 AM every day).

[0107] In one embodiment, when a prompt generated by a prompt manager (e.g., 3420 of FIG. 3A) is input to a generative artificial intelligence module (e.g., 3442 of FIG. 3E) of an app / action set generator (e.g., 3440 of FIG. 3A), a user interface corresponding to the prompt may be generated. For example, the generative artificial intelligence model (e.g., 3442 of FIG. 3E) may generate a user interface (515) that recommends related applications based on the input prompts.

[0108] According to one embodiment, a user interface (515) for recommending related applications may be generated based on a prompt such as "Collect application information related to the age of 70." In one example, the user interface (515) for recommending related applications may include an interface that lists currently installed applications and uninstalled applications. For example, the user interface (515) for recommending related applications may recommend applications a and b installed on the electronic device (10). For example, the user interface (515) for recommending related applications may recommend application c that is not installed on the electronic device (10). In one example, the user interface (515) for recommending related applications may include a user interface that induces installation of application c. In one example, a generative artificial intelligence module (e.g., 3442 of FIG. 3E) may identify applications a, b, and c as recommended applications based on a prompt received from a prompt manager (e.g., 3420 of FIG. 3E). A user interface (515) for recommending related applications may include a user interface that displays installed applications (e.g., applications a and b) among applications a, b, and c identified by a generative artificial intelligence module (e.g., 3442 of FIG. 3e) as images with solid borders, and displays uninstalled applications (e.g., application c) as images with dotted borders.

[0109] According to one embodiment, when a prompt generated by a prompt manager (e.g., 3420 of FIG. 3A) is input to a generative artificial intelligence module (e.g., 3442 of FIG. 3E) of an app / action set generator (e.g., 3440 of FIG. 3A), a user interface corresponding to the prompt may be generated. For example, the generative artificial intelligence model (e.g., 3442 of FIG. 3E) may generate a user interface (516) that induces an action of the electronic device (10) based on the input prompts.

[0110] According to one embodiment, a user interface (516) for inducing an action of the electronic device (10) may be generated based on the prompts “Collect action information related to father” and / or “Collect action information related to 70th birthday.” In one example, the user interface (516) for inducing an action of the electronic device (10) may include an action for executing an application or changing a setting of the electronic device (10). For example, the user interface (516) for inducing an action of the electronic device (10) may include a user interface for displaying an instruction related to 70th birthday (e.g., “Be sure to bring the gift you purchased from the d application before leaving”) and / or a user interface for displaying a purchase history confirmation link of the d application (e.g., an internet shopping mall application). For example, the user interface (516) for inducing an action of the electronic device (10) may include a user interface for displaying an instruction related to father (e.g., “Call your mother before leaving?”) and / or a user interface for connecting a call to your mother through an e application (e.g., a phone application).

[0111] Referring to FIG. 5B, the electronic device (10) may generate a different user interface depending on the time based on data stored in the user's schedule. In one example, referring to the calendar application execution screen (520) of the electronic device (10), the calendar application may store data regarding a schedule called September 17, 8:00 AM, and OO Land. In one example, September 17, 8:00 AM, and OO Land may correspond to user personal information transmitted from a data control module (e.g., 3100 of FIG. 3A) to a trigger generation module (e.g., 3300 of FIG. 3A).

[0112] According to one embodiment, the electronic device (10) may display a user interface including applications and / or actions corresponding to a date one month prior to (e.g., August 17) of a reference date (e.g., September 17) based on user personal information (e.g., calendar application storage information), on at least a portion of the display (110). In one example, referring to a screen (530) on which a user interface is displayed, the user interface may include a user interface (532) related to a valet parking service available when visiting OO Land, a user interface (534) displaying an application for making a reservation at OO Land, and a user interface (536) inducing an action for entering companion information. In one example, the user interface displayed on the screen (530) on which the user interface is displayed may correspond to a user interface available one month prior to (e.g., August 17, 8:00 AM), based on user personal information of September 17, 8:00 AM, and OO Land.

[0113] According to one embodiment, the electronic device (10) may display a user interface including an application and / or action corresponding to a week (e.g., September 10) prior to a reference date (e.g., September 17) based on user personal information (e.g., calendar application storage information), on at least a portion of the display (110). In one example, referring to a screen (540) on which a user interface is displayed, the user interface may include a user interface (542) related to the weather of OO Land, and a user interface (544) that induces an action to convey a message related to a schedule to companions (e.g., sending a group text message saying "Remember OO Land next week" based on companion information). In one example, the companion information may correspond to companion information added based on companion information stored in the schedule information and / or a user interface (e.g., 536) that induces an action to input companion information. In one example, the user interface displayed on the screen (540) displaying the user interface may correspond to the user interface available a week ago (e.g., 8:00 a.m. on September 10) based on the user personal information of OO Land, 8:00 a.m. on September 17.

[0114] According to one embodiment, the electronic device (10) may display a user interface including an application and / or action corresponding to a reference date (e.g., September 17) on at least a portion of the display (110) based on user personal information (e.g., calendar application storage information). In one example, referring to a screen (550) on which a user interface is displayed, the user interface may include a user interface (552) displaying an application related to OO Land. In one example, the user interface displayed on the screen (550) on which the user interface is displayed may correspond to a user interface available on the reference date of the user personal information (e.g., September 17) based on the user personal information of September 17, 8:00 AM, and OO Land.

[0115] According to one embodiment, the user interface (552) displayed on the screen (550) displaying the user interface may include an a application for checking event information of OO Land, a b application for checking traffic information of OO Land, a c application for checking meal order information for 8:00 AM, and / or a d application for recording biological movement information for September 17. For example, the user interface (552) displayed on the screen (550) displaying the user interface may include a URL for checking event information of OO Land and / or a user interface for inducing a call connection action to a service center of OO Land.

[0116] According to one embodiment, the time at which the user interface is generated (e.g., one month ago, one week ago, reference date) illustrated in FIG. 5B is only an example and is not limited to this example. For example, the electronic device (10) may display, on at least a portion of the display (110), a user interface (e.g., 532) related to a valet parking service available when visiting OO Land and / or a user interface (544) that induces an action to convey a message related to the schedule to companions (e.g., sending a group text message saying "Remember OO Land next week" based on companion information) one week after the time at which the data stored in the user's schedule is stored (e.g., June 17). For example, the electronic device (10) may display a user interface (534) for displaying an application for OO Land reservation and / or a user interface (542) related to the weather of OO Land on at least a portion of the display (110) at a time input by the user (e.g., September 10, 10 days before the reference date, or one month after the time when data stored in the user schedule is stored). According to one embodiment, the user interfaces (e.g., 532, 534, 536, 542, 544, and / or 552) of FIG. 5B may correspond to a trigger generated by a trigger generation module (e.g., 3300 of FIG. 3A), a prompt generated by a prompt manager (e.g., 3420 of FIG. 3A), and / or a user interface generated by a generative artificial intelligence module (e.g., 3442 of FIG. 3E). The operation of each of the trigger generation module (e.g., 3300 in FIG. 3a), the prompt manager (e.g., 3420 in FIG. 3a), and / or the generative artificial intelligence module (e.g., 3442 in FIG. 3e) is substantially the same as that described in FIG. 5a, and thus, redundant descriptions are omitted.

[0117] FIGS. 6A through 6C illustrate a user interface displayed on a display based on user personal information or user input, according to one embodiment.

[0118] Referring to FIG. 6A, the electronic device (10) may generate a user interface based on a user input. In one example, the electronic device (10) may display a home screen (600) displaying a user interface for inducing a home screen configuration, a home screen (610) displaying a user interface for inducing a user input, and / or an application and / or action set display screen (620) on at least a portion of the display (110) based on the user input. In one example, the home screen (600) displaying a user interface for inducing a home screen configuration, the home screen (610) displaying a user interface for inducing a user input, and the application and / or action set display screen (620) may be sequentially displayed on at least a portion of the display (110) based on the user input. For example, based on a user input entered into a home screen (600) displaying a user interface that induces a home screen configuration, a home screen (610) displaying a user interface that induces a user input may be displayed in at least a portion of the display (110), and based on a user input entered into the home screen (610) displaying a user interface that induces a user input, an application and / or action set display screen (620) may be displayed in at least a portion of the display (110).

[0119] According to one embodiment, a home screen (600) displaying a user interface for guiding home screen configuration may include a user interface for guiding a user's home screen configuration. For example, the user interface for guiding home screen configuration may confirm the user's intention to create a home screen based on an interface including text confirming whether to create a home screen. For example, the home screen (600) displaying a user interface for guiding home screen configuration may include a user interface titled "Automatic home screen configuration." The electronic device (10) may display a home screen (610) displaying a user interface for guiding user input based on a user's touch input corresponding to the user interface titled "Automatic home screen configuration."

[0120] According to one embodiment, a home screen (610) displaying a user interface for prompting user input may include a user interface for prompting user input. For example, the user interface for prompting user input may include an input window for user input. In one example, the user input entered into the input window may include text input, voice input, or input in file format. For example, the home screen (610) displaying a user interface for prompting user input may receive a text input from the user, such as, "I'm going to OO Land tomorrow. What should I do?"

[0121] According to one embodiment, the application and / or action set display screen (620) may include a screen in which a user interface generated based on a user input is displayed on at least a portion of the display (110). In one example, when a text input from a user such as "What should I do when I go to OO Land tomorrow?" is received, the electronic device (10) may extract a trigger based on the input "What should I do when I go to OO Land tomorrow?", generate a prompt using the extracted trigger, and input the generated prompt into a generative artificial intelligence model (e.g., 3442 of FIG. 3e), thereby generating a user interface. In one example, the electronic device (10) may display the generated user interface on at least a portion of the display (110).

[0122] According to one embodiment, with reference to the application and / or action set display screen (620), the user interface may include a recommended application list (622), a user interface (624) displaying at least a portion of a calendar application, a user interface (626) indicating the current date and time, and / or a user interface (628) displaying at least a portion of a weather application. In one example, the user interface included in the application and / or action set display screen (620) may correspond to a user interface generated based on a user input such as “What should I do when I go to OO Land tomorrow?” The user interface included in the application and / or action set display screen (620) is merely a user interface according to one embodiment, and the arrangement configuration of the user interfaces is not limited to this example. For example, the application and / or action set display screen (620) may place the recommended application list (622) at the bottom of the user interface (624) displaying at least a portion of the calendar application. For example, the application and / or action set display screen (620) may include a user interface displaying at least a portion of a gallery application.

[0123] According to one embodiment, the trigger generation module (e.g., 3300 of FIG. 3A) may generate triggers called "tomorrow" and "OOland" based on a user input saying "What should I do when I go to OOland tomorrow?" In one example, the trigger generation module (e.g., 3300 of FIG. 3A) may additionally generate triggers based on user personal information stored in the electronic device (10) together with the user input. In one example, the trigger called "A" may be generated based on the contents of an exchange of messages related to OOland with A stored in an application (e.g., 3427 of FIG. 3E). For example, the trigger generation module (e.g., 3300 of FIG. 3A) may extract "tomorrow" as a trigger corresponding to "date_time" and "OOland" as a trigger corresponding to "location" based on the user input saying "What should I do when I go to OOland tomorrow?" For example, a trigger generation module (e.g., 3300 in FIG. 3a) can extract a trigger "A" corresponding to "attendee" based on the contents of an OO land-related message exchange with A stored in an application (e.g., 3427 in FIG. 3e).

[0124] According to one embodiment, a prompt manager (e.g., 3420 of FIG. 3A) may receive a trigger from a trigger generation module (e.g., 3300 of FIG. 3A) to generate a prompt. For example, the prompt manager (e.g., 3420 of FIG. 3A) may generate prompts such as "Collect widget information related to tomorrow (e.g., September 17)", "Collect widget information related to OO Land", "Collect application information related to A", and "Collect application information related to OO Land" based on the trigger received from the trigger generation module (e.g., 3300 of FIG. 3A).

[0125] In one embodiment, when a prompt generated by a prompt manager (e.g., 3420 of FIG. 3A) is input to a generative artificial intelligence module (e.g., 3442 of FIG. 3E) of an app / action set generator (e.g., 3440 of FIG. 3A), a user interface corresponding to the prompt may be generated. For example, the generative artificial intelligence model (e.g., 3442 of FIG. 3E) may generate a list of recommended applications (622) based on the input prompts.

[0126] According to one embodiment, a recommended application list (622) may be generated based on the prompts “Collect application information related to A” and “Collect application information related to OO Land.” In one example, the recommended application list (622) may include applications a, d, and g, which are applications related to A (e.g., chat application, address book application). In one example, the recommended application list (622) may include applications b, c, e, f, and h, which are applications related to OO Land (e.g., OO Land application, discount coupon collection application). In one example, the recommended application list (622) may recommend an application that is not installed. In one example, the recommended application list (622) may include a user interface that induces installation of an application that is not installed.

[0127] According to one embodiment, when a prompt generated by a prompt manager (e.g., 3420 of FIG. 3A) is input to a generative artificial intelligence module (e.g., 3442 of FIG. 3E) of an app / action set generator (e.g., 3440 of FIG. 3A), a user interface corresponding to the prompt may be generated. For example, the generative artificial intelligence model (e.g., 3442 of FIG. 3E) may generate a user interface including a widget of the electronic device (10) based on the input prompts.

[0128] According to one embodiment, a user interface (624) including at least one widget may be generated based on a prompt such as “Collect widget information related to tomorrow (e.g., September 17th)” and / or “Collect widget information related to OO Land.” In one example, the user interface including at least one widget may include a user interface that crops at least a portion of the screen of the application and displays it in a pop-up form, or an user interface that edits and displays the collected data. For example, the user interface including at least one widget may include a user interface that displays at least a portion of a calendar application related to OO Land (e.g., an OO Land schedule information portion of the user interface (624)) and / or a user interface that displays at least a portion of a calendar application related to tomorrow (e.g., September 17th) (e.g., a September 17th schedule information portion of the user interface (624) or an upcoming holiday schedule information portion on September 17th). For example, a user interface including at least one widget may include a user interface (628) that displays content associated with OO Land.

[0129] Referring to FIG. 6B, the electronic device (10) may generate a user interface based on user personal information. In one example, the electronic device (10) may display a home screen (630) displaying a user interface for inducing home screen configuration and / or an application and / or action set display screen (640) on at least a portion of the display (110) based on the user personal information. In one example, the home screen (630) displaying a user interface for inducing home screen configuration and the application and / or action set display screen (640) may be sequentially displayed on at least a portion of the display (110) based on a user input. For example, the application and / or action set display screen (640) may be displayed on at least a portion of the display (110) based on a user input entered on the home screen (630) displaying a user interface for inducing home screen configuration.

[0130] According to one embodiment, a home screen (630) displaying a user interface for guiding home screen configuration may include a user interface for guiding a user's home screen configuration. For example, the user interface for guiding home screen configuration may include an interface that displays identified schedule information (e.g., an OO Land visit schedule recorded in a messaging application) based on user personal information, and includes a text for confirming whether to create a home screen. For example, the home screen (630) displaying a user interface for guiding home screen configuration may include a user interface for "Yes" and / or "No." The electronic device (10) may display an application and / or action set display screen (640) based on a user's touch input corresponding to the "Yes" user interface.

[0131] According to one embodiment, referring to FIG. 6A together, a home screen (630) displaying a user interface for inducing a home screen configuration of FIG. 6B may include at least one configuration of a home screen (600) displaying a user interface for inducing a home screen configuration of FIG. 6A. In one example, a home screen (600) displaying a user interface for inducing a home screen configuration of FIG. 6A may include a user interface for inducing a user input for referencing a home screen configuration. Correspondingly, a home screen (630) displaying a user interface for inducing a home screen configuration of FIG. 6B may include a user interface for inducing a home screen configuration based on information identified in user personal information (e.g., an OO Land visit schedule recorded in a messaging application).

[0132] According to one embodiment, the application and / or action set display screen (640) may include a screen in which a user interface generated based on user personal information is displayed on at least a portion of the display (110). In one example, the electronic device (10) may extract a trigger based on user personal information stored in the electronic device (e.g., travel information recorded in a calendar application, business trip information stored in a messenger application), generate a prompt using the extracted trigger, and input the generated prompt into a generative artificial intelligence model (e.g., 3442 of FIG. 3E), thereby generating a user interface. In one example, the electronic device (10) may display the generated user interface on at least a portion of the display (110).

[0133] According to one embodiment, with reference to the application and / or action set display screen (640), the user interface may include a recommended application list (642), a user interface (644) displaying at least a portion of a calendar application, a user interface (646) indicating the current date and time, and a user interface (648) displaying at least a portion of a weather application. The user interfaces included in the application and / or action set display screen (640) are merely user interfaces according to one embodiment, and the arrangement and configuration of the user interfaces are not limited to this example. For example, the application and / or action set display screen (640) may include a user interface displaying at least a portion of a photo application, and / or a user interface displaying at least a portion of a messenger application. In one example, the user interfaces included in the user interface display screen (640) may correspond to a user interface generated based on user personal information stored in the electronic device (10) (e.g., travel information recorded in a calendar application).

[0134] According to one embodiment, referring to FIG. 6A together, the application and / or action set display screen (620) of FIG. 6A and the application and / or action set display screen (640) of FIG. 6B may include the same or similar configurations. For example, a prompt generated in response to a user input on the home screen (610) of FIG. 6A and a prompt generated in response to user personal information referenced on the home screen (630) of FIG. 6B may be the same or similar. For example, the application and / or action set display screen (620) of FIG. 6A and the application and / or action set display screen (640) of FIG. 6B may include the same or similar user interfaces generated based on the same or similar prompts. In one example, if the user input for the home screen (610) of FIG. 6A and the user personal information referenced in the home screen (630) of FIG. 6B are different, the application and / or action set display screen (620) of FIG. 6A and the application and / or action set display screen (640) of FIG. 6B may include different configurations.

[0135] According to one embodiment, a trigger generation module (e.g., 3300 of FIG. 3A) may generate triggers such as "September 17" and "OO Land" based on user personal information stored in the electronic device (10) (e.g., travel information recorded in a calendar application). In one example, the trigger generation module (e.g., 3300 of FIG. 3A) may additionally generate triggers based on user personal information stored in the electronic device (10). For example, a trigger such as "driving" may be generated based on a user's navigation application execution pattern recorded in the electronic device (10) (e.g., executing a navigation application at 10:00 AM every day). For example, a trigger generation module (e.g., 3300 of FIG. 3A) may extract a trigger corresponding to "date_time", "September 17," and a trigger corresponding to "location", "OO Land," based on user personal information stored in the electronic device (10) (e.g., travel information recorded in a calendar application). For example, a trigger generation module (e.g., 3300 of FIG. 3A) may extract a trigger corresponding to "productivity", "driving," based on a user's navigation application execution pattern recorded in the electronic device (10).

[0136] According to one embodiment, a prompt manager (e.g., 3420 of FIG. 3A) may receive a trigger from a trigger generation module (e.g., 3300 of FIG. 3A) to generate a prompt. For example, the prompt manager (e.g., 3420 of FIG. 3A) may generate prompts such as "Collect widget information related to September 17," "Collect widget information related to OO Land," "Collect application information related to driving," and "Collect application information related to OO Land" based on the trigger received from the trigger generation module (e.g., 3300 of FIG. 3A).

[0137] In one embodiment, when a prompt generated by a prompt manager (e.g., 3420 of FIG. 3A) is input to a generative artificial intelligence module (e.g., 3442 of FIG. 3E) of an app / action set generator (e.g., 3440 of FIG. 3A), a user interface corresponding to the prompt may be generated. For example, the generative artificial intelligence model (e.g., 3442 of FIG. 3E) may generate a list of recommended applications based on the input prompts.

[0138] In one embodiment, a recommended application list (642) may be generated based on the prompts “Collect application information related to driving” and “Collect application information related to OO Land.” In one example, the recommended application list (642) may include applications b, c, g, and h, which are applications related to driving (e.g., gas station application, navigation application). In one example, the recommended application list (642) may include applications a, d, e, and f, which are applications related to OO Land (e.g., photo editing application, accommodation reservation application). In one example, the recommended application list (642) may recommend an application that is not installed. In one example, the recommended application list (642) may include a user interface that induces installation of an application that is not installed.

[0139] According to one embodiment, when a prompt generated by a prompt manager (e.g., 3420 of FIG. 3A) is input to a generative artificial intelligence module (e.g., 3442 of FIG. 3E) of an app / action set generator (e.g., 3440 of FIG. 3A), a user interface corresponding to the prompt may be generated. For example, the generative artificial intelligence model (e.g., 3442 of FIG. 3E) may generate a user interface including a widget of the electronic device (10) based on the input prompts.

[0140] According to one embodiment, a user interface (644) including at least one widget may be generated based on the prompts “Collect widget information related to September 17th” and / or “Collect widget information related to OO Land.” In one example, the user interface including at least one widget may include a user interface that crops at least a portion of the screen of the application and displays it in a pop-up form, or an edited and displayed collected data. For example, the user interface including at least one widget may include a user interface that displays at least a portion of a calendar application related to OO Land (e.g., an OO Land schedule information portion of the user interface (644)) and / or a user interface that displays at least a portion of a calendar application related to tomorrow (e.g., September 17th) (e.g., a schedule information portion of September 17th, or an upcoming holiday schedule information portion of September 17th) of the user interface (644).

[0141] According to one embodiment, a user interface including at least one widget may include a user interface displaying at least a portion of a messenger application related to OO Land (e.g., an OO Land schedule conversation portion of the messenger application), a user interface (646) indicating a current date and time for comparison with an OO Land schedule, and / or a user interface (648) displaying at least a portion of a weather application related to September 17. For example, a user interface including at least one widget may include a user interface displaying content related to OO Land (e.g., current weather of OO Land, address of OO Land of the user interface (648)).

[0142] Referring to FIG. 6C, the electronic device (10) may generate a user interface based on a user input. In one example, the electronic device (10) may display a search window screen (650), a user input screen for the search window (660), and / or a user interface display screen (670) on at least a portion of the display (110). In one example, the search window screen (650), the user input screen for the search window (660), and the user interface display screen (670) may be sequentially displayed on at least a portion of the display (110) based on the user input. For example, when the user input is completed on the user input screen (660) for the search window, the user interface display screen (670) may be displayed on at least a portion of the display (110).

[0143] According to one embodiment, a user input screen (660) for a search window may include a user interface that prompts user input. For example, the user interface prompting user input may include a search window where user input is made. In one example, the user input entered into the search window may include text input, voice input, or input in file format. For example, a home screen (610) displaying a user interface prompting user input may receive a text input from a user, such as, "I'm going to OO Land tomorrow. What should I do?"

[0144] According to one embodiment, the user interface display screen (670) may include a screen in which a user interface generated based on a user input is displayed on at least a portion of the display (110). In one example, referring also to FIG. 6A, the user interface display screen (670) of FIG. 6C may include at least one component of the application and / or action set display screen (620) of FIG. 6A. In one example, the application and / or action set display screen (620) of FIG. 6A may include a user interface generated based on a user input for a home screen (610) on which a user interface for inducing a user input is displayed. Correspondingly, the user interface display screen (670) of FIG. 6C may include a user interface generated based on a user input entered into a user input screen (660) for a search window.

[0145] According to one embodiment, referring to FIG. 6A together, the user interface included in the user interface display screen (670) of FIG. 6C may correspond to the user interface included in the application and / or action set display screen (620) of FIG. 6A. For example, the user interface included in the user interface display screen (670) of FIG. 6C and the user interface included in the application and / or action set display screen (620) of FIG. 6A may display the same or similar user interfaces because they have received a common text input, “What should I do when I go to OO Land tomorrow?” In one example, the creation operation of the user interface included in the user interface display screen (670) of FIG. 6C may correspond to the creation operation of the user interface included in the application and / or action set display screen (620) of FIG. 6A.

[0146] According to one embodiment, referring also to FIG. 6A, the user interface included in the user interface display screen (670) of FIG. 6C may include a different configuration form than the user interface included in the application and / or action set display screen (620) of FIG. 6A. In one example, the user input of FIG. 6A is a user input for a home screen (610) on which a user interface for inducing a user input of a home screen is displayed, whereas the user input of FIG. 6C is a user input for a search window. Therefore, in FIG. 6A, the trigger generation module (e.g., 3300 of FIG. 3A) may create a trigger called "create_homescreen" for "goal". On the other hand, in FIG. 6C, the trigger generation module (e.g., 3300 of FIG. 3A) may create a trigger called "create_finder_result" for "goal". In one example, the user interface included in the user interface display screen (670) of FIG. 6c may have a form in which interfaces are arranged corresponding to a search window by a prompt corresponding to a trigger called “create_finder_result.”

[0147] FIG. 7 is a block diagram of an electronic device within a network environment according to one embodiment.

[0148] Referring to FIG. 7, FIG. 7 is a block diagram of an electronic device (701) within a network environment (700) according to various embodiments. Referring to FIG. 7, in the network environment (700), the electronic device (701) may communicate with the electronic device (702) via a first network (798) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (704) or the server (708) via a second network (799) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (701) may communicate with the electronic device (704) via the server (708). According to one embodiment, the electronic device (701) may include a processor (720), a memory (730), an input module (750), an audio output module (755), a display module (760), an audio module (770), a sensor module (776), an interface (777), a connection terminal (778), a haptic module (779), a camera module (780), a power management module (788), a battery (789), a communication module (790), a subscriber identification module (796), or an antenna module (797). In some embodiments, the electronic device (701) may omit at least one of these components (e.g., the connection terminal (778)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (776), the camera module (780), or the antenna module (797)) may be integrated into one component (e.g., the display module (760)).

[0149] The processor (720) may, for example, execute software (e.g., a program (740)) to control at least one other component (e.g., a hardware or software component) of the electronic device (701) connected to the processor (720) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (720) may store commands or data received from other components (e.g., a sensor module (776) or a communication module (790)) in a volatile memory (732), process the commands or data stored in the volatile memory (732), and store result data in a non-volatile memory (734). According to one embodiment, the processor (720) may include a main processor (721) (e.g., a central processing unit or an application processor) or an auxiliary processor (723) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (721). For example, when the electronic device (701) includes the main processor (721) and the auxiliary processor (723), the auxiliary processor (723) may be configured to use less power than the main processor (721) or to be specialized for a given function. The auxiliary processor (723) may be implemented separately from the main processor (721) or as a part thereof.

[0150] The auxiliary processor (723) may control at least a portion of functions or states associated with at least one component (e.g., a display module (760), a sensor module (776), or a communication module (790)) of the electronic device (701), for example, on behalf of the main processor (721) while the main processor (721) is in an inactive (e.g., sleep) state, or together with the main processor (721) while the main processor (721) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (723) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (780) or a communication module (790)). In one embodiment, the auxiliary processor (723) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (701) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (708)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, the artificial intelligence model may include a software structure.

[0151] The memory (730) can store various data used by at least one component (e.g., the processor (720) or the sensor module (776)) of the electronic device (701). The data can include, for example, software (e.g., the program (740)) and input data or output data for commands related thereto. The memory (730) can include a volatile memory (732) or a non-volatile memory (734).

[0152] The program (740) may be stored as software in the memory (730) and may include, for example, an operating system (742), middleware (744), or an application (746).

[0153] The input module (750) can receive commands or data to be used in a component of the electronic device (701) (e.g., a processor (720)) from an external source (e.g., a user) of the electronic device (701). The input module (750) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0154] The audio output module (755) can output audio signals to the outside of the electronic device (701). The audio output module (755) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0155] The display module (760) can visually provide information to an external party (e.g., a user) of the electronic device (701). The display module (760) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (760) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0156] The audio module (770) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (770) can acquire sound through the input module (750), output sound through the sound output module (755), or an external electronic device (e.g., electronic device (702)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (701).

[0157] The sensor module (776) can detect the operating status (e.g., power or temperature) of the electronic device (701) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (776) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0158] The interface (777) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (701) with an external electronic device (e.g., the electronic device (702)). In one embodiment, the interface (777) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0159] The connection terminal (778) may include a connector through which the electronic device (701) may be physically connected to an external electronic device (e.g., the electronic device (702)). In one embodiment, the connection terminal (778) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0160] The haptic module (779) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (779) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0161] The camera module (780) can capture still images and videos. According to one embodiment, the camera module (780) may include one or more lenses, image sensors, image signal processors, or flashes.

[0162] The power management module (788) can manage the power supplied to the electronic device (701). According to one embodiment, the power management module (788) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0163] A battery (789) may power at least one component of the electronic device (701). In one embodiment, the battery (789) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0164] The communication module (790) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (701) and an external electronic device (e.g., electronic device (702), electronic device (704), or server (708)), and the performance of communication through the established communication channel. The communication module (790) may operate independently from the processor (720) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (790) may include a wireless communication module (792) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (794) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (704) via a first network (798) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (799) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (792) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (796) to verify or authenticate the electronic device (701) within a communication network such as the first network (798) or the second network (799).

[0165] The wireless communication module (792) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency communications (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (792) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (792) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (792) may support various requirements specified in the electronic device (701), an external electronic device (e.g., the electronic device (704)), or a network system (e.g., the second network (799)). According to one embodiment, the wireless communication module (792) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0166] The antenna module (797) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (797) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (797) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (798) or the second network (799), may be selected from the plurality of antennas, for example, by the communication module (790). A signal or power may be transmitted or received between the communication module (790) and the external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (797).

[0167] According to various embodiments, the antenna module (797) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0168] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0169] According to one embodiment, commands or data may be transmitted or received between the electronic device (701) and an external electronic device (704) via a server (708) connected to a second network (799). Each of the external electronic devices (702 or 704) may be the same or a different type of device as the electronic device (701). According to one embodiment, all or part of the operations executed in the electronic device (701) may be executed in one or more of the external electronic devices (702, 704, or 708). For example, when the electronic device (701) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (701) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (701). The electronic device (701) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (701) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (704) may include an Internet of Things (IoT) device. The server (708) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (704) or the server (708) may be included in the second network (799).The electronic device (701) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0170] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0171] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0172] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0173] Various embodiments of the present document may be implemented as software (e.g., a program (740)) including one or more instructions stored in a storage medium (e.g., an internal memory (736) or an external memory (738)) readable by a machine (e.g., an electronic device (701)). For example, a processor (e.g., a processor (720)) of the machine (e.g., an electronic device (701)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0174] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0175] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0176] Figure 8 illustrates an artificial intelligence system according to one embodiment.

[0177] Referring to FIGS. 1 and 8, according to one embodiment, the electronic device (10) may be configured to implement an artificial intelligence system (800). For example, the artificial intelligence system (800) may be implemented by instructions stored in the memory (120) being executed by the processor (100). Components within the artificial intelligence system (800) may be referred to as software modules (e.g., applications, programs, or threads). The components of the artificial intelligence system (800) illustrated in FIG. 8 are merely an example, and the embodiments of the present disclosure are not limited thereto. For example, at least some of the components of the artificial intelligence system (800) illustrated in FIG. 8 may be implemented in an external device (e.g., a server, an external terminal device) communicatively connected to the electronic device (10). The electronic device (10) may implement the artificial intelligence system (800) by exchanging data with the external device using the communication circuit (130).

[0178] For example, the artificial intelligence system (800) may include a user interface (810), an artificial intelligence framework (820), a database (830), an application / service module (840), and / or a generative AI model (850). As described above, the components of the artificial intelligence system (800) may be implemented by the electronic device (10), or at least some of the components may be implemented by the electronic device (10).

[0179] The user interface (810) may be referred to as a software interface between the artificial intelligence framework (820) and the user. For example, the user interface (810) may obtain input (e.g., user input and / or context information) using the hardware configuration (e.g., interface, sensor, and / or camera) of the electronic device (10). The user interface (810) may transmit the obtained input to the artificial intelligence framework (820). The user interface (810) may be configured to output output information obtained from the artificial intelligence framework (820).

[0180] In one example, the user interface (810) may be configured to process multi-modal input. For example, the user interface (810) may receive at least one of text (e.g., natural language), images, sounds, or videos as input. In one example, the input may include input to the user interface (e.g., menu selection). For example, the user interface (810) may convert the acquired input into an input in a format supported by the artificial intelligence framework (820) and then transmit the converted input to the artificial intelligence framework (820).

[0181] In one example, the user interface (810) may transmit context information to the artificial intelligence framework (820). For example, the context information may be transmitted to the artificial intelligence framework (820) along with an input. For example, the context information may include various additional information at the time the input is received (e.g., information about the currently running application, location information, surrounding environment information acquired using a sensor, and / or information stored in the memory (120).

[0182] In one example, the user interface (810) may be configured to output the results of the artificial intelligence framework (820). For example, the user interface (810) may provide the results in the form of natural language, a specified content format, and / or a user-requested action. For example, the user interface (810) may be configured to output output information using the display (110) and / or a speaker. In one example, the user interface (810) may be configured to output the output information using visual information, auditory information, and / or tactile information.

[0183] According to one embodiment, the artificial intelligence framework (820) may be configured to receive user input and coordinate and control each component or module necessary to perform the user's intention based on the user input (e.g., a user query). For example, the artificial intelligence framework (820) may include a prompt design module (821), an application programming interface (API) / plugin management module (823), and / or a modification module (825).

[0184] For example, input (e.g., user input and / or context information) received from the user interface (810) may be transmitted to the prompt design module (821). The prompt design module (821) may be used to generate prompts suitable for inputting the input into a large language model (LLM) or a large multi-modal model (LMM). For example, the prompt design module (821) may include an artificial intelligence component that uses a machine learning algorithm or a neural network. For example, the prompt design module (821) may generate a prompt from the input using the artificial intelligence component.

[0185] For example, LLM can refer to an artificial neural network-based language model that has learned a large amount of text data through pre-training. LLMs can contain significantly more parameters (e.g., over 10 billion) than conventional language models. For example, LLMs can utilize a transformer artificial neural network structure based on an attention mechanism.

[0186] The attention mechanism is a technology that helps artificial intelligence models focus (attention) on important parts of input data. The attention mechanism can be utilized to predict output data by predicting the degree to which a portion of time-series input data (e.g., input data such as voice or video, or input data of a neural network layer) contributes to the intermediate or final output of the neural network. Recurrent neural networks (RNNs), which sequentially process each element of a sequence, exhibit poor prediction performance when there is information dependency between long time-series distances. However, the attention mechanism can consider information dependency between long time-series distances by controlling the degree of weight concentration (e.g., attention) within the context of all or part of the input data.

[0187] For example, a transformer may be configured with an encoder-decoder structure. The encoder may process input data and output compressed information (e.g., a contextual representation), and the decoder may process the compressed information and output token-by-token data. Each of the encoder and decoder may include an independent attention network, or a cross-attention network connecting the encoder and decoder.

[0188] For example, LLM training may include pre-training and / or fine-tuning. Pre-training may refer to the process of teaching the LLM general linguistic knowledge using a large amount of text data. For example, pre-training may involve self-supervised learning, which predicts the next word in a text string using previous word sequences. Fine-tuning may refer to the process of training the LLM to be suitable for a specific domain (e.g., chatbot, translation, summarization, Q&A) or task. For example, the LLM may be further supervised (or adaptively trained) using a dataset tailored to the domain's purpose based on a pre-trained model. The LLM may also perform tasks based on prompts (e.g., text input containing natural language). For example, fine-tuning may be omitted from LLM training.

[0189] To enhance the performance of a user-defined task, prompts can be selected for input into the LLM. Examples of tasks and / or guidance for performing them can be additionally provided as prompts, similar to in-context learning, zero-shot learning, and / or few-shot learning.

[0190] The term "LLM" can refer to the language neural network model itself, but can also refer to models for LLM-based applications (e.g., chatbots, translation, summarization, text classification, and sentence generation). For example, LLM-based chatbots like ChatGPT or LLM-based translators can also be referred to as "LLMs." Publicly available LLMs include BERT (bidirectional encoder representations from transformers) and GPT (generative pre-trained transformers).

[0191] "LLM" may also include an inference engine utilizing the LLM neural network model. For example, "entering an input prompt into the LLM" may mean "entering the input prompt into an inference engine based on the LLM." For example, "the output of the LLM for the input prompt" may refer to the output information of the last neural network layer of the LLM obtained when the input prompt is entered into the LLM-based inference engine.

[0192] The prompt design module (821) may be configured to generate prompts based on input and / or a database (830). For example, the database (830) may store user preference data, a prompt library, and / or prompt examples. For example, the prompt design module (821) may generate prompts using information stored in the database (830). As described below, the prompt design module (821) may use information obtained using the API / plugin management module (823) to generate prompts. The generated prompts may be passed to a generative AI model (850) (e.g., a large language model (LMM) or a large multi-modal model (LMM)).

[0193] The API / plug-in management module (823) may be configured to exchange data with an external entity of the artificial intelligence framework (820). For example, the API / plug-in management module (823) may create a channel for communication with an external entity of the artificial intelligence framework (820) (e.g., an operating system and / or an application) via an API. The API / plug-in management module (823) may access various data sources to acquire data via the created channel. The data acquired by the API / plug-in management module (823) may be used to generate a prompt by the prompt design module (821). The data acquired by the API / plug-in management module (823) may be used as an input for the generative AI model (850). In one example, when data (e.g., user input) is required in the process of generating a result of the artificial intelligence framework (820), the API / plug-in management module (823) may acquire the data using an application and / or service of the application / service module (840).

[0194] In one example, the application / service module (840) may include at least one application and / or at least one service. For example, the at least one service may include an operating system service. The applications and / or services of the application / service module (840) may communicate with the API / plugin management module (823) via an API or a plug-in. The API / plugin management module (823) may transmit data instructing a specified operation of the application / service module (840) to the application or service module via the API or plug-in.

[0195] In one embodiment, the modification module (825) can fine-tune the output from the generative AI model (850). For example, the modification module (825) can filter content generated by the generative AI model (850). The modification module (825) can be configured to remove or filter biased content, harmful content, content with low relevance to the prompt, and / or aversive content from the output results. In one example, the modification module (825) can identify a correlation (e.g., a correlation) between the output results of the generative AI model (850) and the user's intention (e.g., an intention identified from user input and / or context information). If the correlation between the output results and the user's intention is low, the modification module (825) can perform additional operations. For example, the modification module (825) can obtain additional input from the user to obtain a result with higher relevance. To prevent repetition of additional procedures, the modification module (825) can generate a hint and provide the generated hint to the user.

[0196] According to one embodiment, a generative AI model (850) may be referred to as an artificial intelligence neural network that generates new types of data (e.g., data that includes information not included in the input information) from user input information. The generative AI model (850) may include a model that generates images and / or a model that generates language. The model that generates images may include, for example, a generative adversarial network (GAN), a variational auto encoder (VAE), and / or a diffusion-based generative model that uses a VAE and a transformer architecture. The model that generates language may include a model trained to output statistically most appropriate output values ​​based on input values. For example, the model that generates language may include a model such as CHAT-GPT 3 or CHAT-GPT 4. The generative AI model (850) may include a large language model (LMM) or a large multi-modal model (LMM).

Claims

1. In electronic devices, display; At least one processor electrically connected to the display; and A memory electrically connected to at least one processor and storing instructions, When the above instructions are executed by the at least one processor, the electronic device: Identifying at least one of the user's personal information stored in the memory or the user's input entered into the electronic device; generating at least one prompt based on at least one of said user personal information or said user input; By inputting at least one of the above prompts into an artificial intelligence model, a first user interface is generated that guides a recommended action, An electronic device that provides the first user interface generated above through the display.

2. In paragraph 1, An electronic device, wherein the user's personal information includes at least one of the user's schedule information, date information, time information, location information, photo information, memo information stored in the memory, or data received from an application installed in the electronic device.

3. In any one of paragraphs 1 and 2, An electronic device wherein the user input includes at least one of user schedule information, date information, time information, location information, product information, attendee information, or interface information into which the user input was entered.

4. In any one of paragraphs 1 to 3, When the above instructions are executed by the at least one processor, the electronic device, An electronic device that generates an additional user interface for generating additional prompts.

5. In paragraph 4, When the above instructions are executed by the at least one processor, the electronic device, Based on said additional user interface, identifying at least one of additional user personal information or additional user input stored in said memory, An electronic device configured to generate at least one additional prompt based on at least one of the identified additional user personal information or the additional user input.

6. In paragraph 5, When the above instructions are executed by the at least one processor, the electronic device, By inputting the above additional prompts into the artificial intelligence model, a second user interface is generated that guides the recommended action, An electronic device that provides the second user interface generated above through the display.

7. In any one of paragraphs 1 to 6, An electronic device wherein said at least one prompt causes said artificial intelligence model to collect at least one of an application, an action, a widget, or resolution information associated with at least one of said user personal information or said user input.

8. In paragraph 7, An electronic device wherein said at least one prompt causes said artificial intelligence model to generate said first user interface based on at least one of said collected application, action, widget, or resolution information.

9. In any one of paragraphs 1 to 8, An electronic device, wherein the artificial intelligence model is a generative artificial intelligence model including at least one of a generative adversarial neural network (GAN), a variational autoencoder (VAE), or a style GAN.

10. In any one of paragraphs 1 to 9, An electronic device wherein the artificial intelligence model is an artificial intelligence model stored in the memory or an artificial intelligence model stored in an external server device.

11. In the method of an electronic device, An action of identifying at least one of user personal information stored in the memory of said electronic device or user input entered into said electronic device; An action to generate at least one prompt based on at least one of said user personal information or said user input; An action of generating a first user interface that guides a recommended action by inputting at least one of the above prompts into an artificial intelligence model, and A method comprising an action of providing the generated first user interface through a display of the electronic device.

12. In paragraph 11, A method wherein the user's personal information includes at least one of the user's schedule information, date information, time information, photo information, memo information stored in the memory, or data received from an application installed on the electronic device.

13. In any one of paragraphs 11 to 12, A method wherein the user input includes at least one of the user's schedule information, date information, time information, location information, product information, attendee information, or interface information into which the user input was entered.

14. In any one of paragraphs 11 to 13, A method comprising the action of generating an additional user interface for generating an additional prompt.

15. In paragraph 14, An operation of identifying at least one of additional user personal information or additional user input stored in the memory based on said additional user interface; A method further comprising the action of generating at least one additional prompt based on at least one of the identified additional user personal information or the additional user input.

Images