Fast execution method using input field and electronic device therefor

Abstract

An embodiment of the present invention may comprise: a display (160); a memory (130) storing instructions; and a processor (120). The instructions stored in the memory, when executed by the processor, cause the electronic device to: display an input field in response to a first user input calling the input field; acquire a second user input that is input to the input field; display the acquired second user input as text in the input field; and analyze the content of the text and control at least one actionable item for processing the analyzed content so that the actionable item is displayed together with at least a portion of the text via the display, wherein the at least one actionable item may include at least one of an actionable object of an application, an actionable object providing a function in the application, an action preview based on generative artificial intelligence (AI), or a setting object of the electronic device.

Description

A method for rapid execution using input fields and an electronic device thereof

[0001] Various embodiments of the present invention disclose a fast execution method using an input field and an electronic device thereof.

[0002] With the advancement of digital technology, various types of electronic devices, such as mobile terminals, personal digital assistants (PDAs), electronic notebooks, smartphones, tablet PCs (personal computers), and wearable devices, are becoming widely used. These electronic devices are constantly undergoing improvements in their hardware and / or software to support and enhance their functionality.

[0003] For example, an electronic device can use voice recognition technology to control the execution of an electronic device or application through a user's voice commands, or perform functions using a web-based service. Alternatively, the electronic device can connect to a wireless input / output device (e.g., earphones, headphones) via short-range wireless communication such as Bluetooth, and output the sound of music or videos through the wireless input / output device. Alternatively, an electronic device (e.g., a smartphone) can connect to a wearable display device (e.g., AR glasses) to provide extended reality (XR) content such as virtual reality (VR), augmented reality (AR), and / or mixed reality (MR).

[0004] In one embodiment, a method and device may be disclosed that allows a user to call an input field anytime and anywhere, and analyzes the content entered by the user into the input field to provide at least one actionable object that can correspond to various search contents.

[0005] According to an embodiment of the present disclosure, an electronic device (101) includes a display (160), a memory (130) for storing instructions, and a processor (120), and the instructions stored in the memory, when executed by the processor, cause the electronic device to display an input field in response to a first user input calling the input field, acquire a second user input inputted into the input field, display the acquired second user input as text in the input field, analyze the content of the text, and control at least one execution item for processing the analyzed content to be displayed through the display together with at least a part of the text, and the at least one execution item may include at least one of an execution object of an application, an execution object providing a function within an application, an execution preview based on generative artificial intelligence (AI), or a setting object of the electronic device.

[0006] According to one embodiment of the present disclosure, a method of operating an electronic device includes an operation of displaying an input field in response to a first user input calling an input field, an operation of acquiring a second user input inputted into the input field, an operation of displaying the acquired second user input as text in the input field, and an operation of analyzing the content of the text and controlling at least one execution item for processing the analyzed content to be displayed together with at least a part of the text through a display of the electronic device, wherein the at least one execution item may include at least one of an execution object of an application, an execution object providing a function within an application, an execution preview based on generative artificial intelligence (AI), or a setting object of the electronic device.

[0007] According to one embodiment, a method for calling an input field may be provided so that a user can call an input field anytime, anywhere for quick execution.

[0008] According to one embodiment, various execution objects (or action objects) can be provided to quickly execute a desired function by predicting the user's intention based on the content entered in the input field.

[0009] According to one embodiment, by analyzing words, numbers, sentences, or long texts entered in an input field and providing corresponding subsequent items, it is possible to help the user quickly perform a desired function.

[0010] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0011] FIG. 2 is a diagram illustrating an example of providing an execution object in an electronic device according to one embodiment.

[0012] FIG. 3 is a flowchart illustrating an operating method of an electronic device according to one embodiment.

[0013] FIG. 4A is a diagram illustrating an example of providing an execution object by calling an input field on a home screen of an electronic device according to one embodiment.

[0014] FIG. 4b is a diagram illustrating an example of providing an execution object on an application execution screen of an electronic device according to one embodiment.

[0015] FIG. 5A is a diagram illustrating an example of changing an execution object in an electronic device according to one embodiment.

[0016] FIG. 5b is a diagram illustrating an example of performing a desired function according to selection of an execution object in an electronic device according to one embodiment.

[0017] FIG. 6 is a flowchart illustrating a method for providing an execution object corresponding to a user input in an electronic device according to one embodiment.

[0018] FIG. 7A is a diagram illustrating an example of providing weather information based on user input in an electronic device according to one embodiment.

[0019] FIG. 7b is a diagram illustrating an example of providing health information based on user input in an electronic device according to one embodiment.

[0020] FIG. 7c is a diagram illustrating an example of providing a timer based on user input in an electronic device according to one embodiment.

[0021] FIG. 7d is a diagram illustrating an example of controlling settings of an electronic device based on user input in an electronic device according to one embodiment.

[0022] FIG. 8A is a diagram illustrating an example of providing an execution object related to Internet access according to user input in an electronic device according to one embodiment.

[0023] FIG. 8b is a diagram illustrating an example of providing coupon information as an execution object according to user input in an electronic device according to one embodiment.

[0024] FIG. 8c is a diagram illustrating an example of providing an execution object related to a call record according to a user input in an electronic device according to one embodiment.

[0025] FIG. 8d is a diagram illustrating an example of providing exercise information to an execution object according to user input in an electronic device according to one embodiment.

[0026] FIG. 9A is a diagram illustrating an example of providing consumption expenditure information as an execution object in an electronic device according to one embodiment.

[0027] FIG. 9b is a diagram illustrating an example of providing an execution object related to message transmission in an electronic device according to one embodiment.

[0028] FIG. 9c is a diagram illustrating an example of providing an execution object related to inputting dietary information in an electronic device according to one embodiment.

[0029] FIG. 9d is a diagram illustrating an example of providing an execution object related to a memo in an electronic device according to one embodiment.

[0030] FIG. 10 is a flowchart illustrating a method for providing different execution objects depending on user input in an electronic device according to one embodiment.

[0031] FIGS. 11A and 11B are drawings illustrating an example of providing different execution objects depending on input content in an electronic device according to one embodiment.

[0032] FIGS. 12A to 12C are drawings illustrating an example of executing a desired function through an execution object provided according to a user input in an electronic device according to one embodiment.

[0033] FIGS. 13A to 13C are diagrams illustrating an example of providing an execution object according to a user input in an electronic device according to one embodiment.

[0034] FIGS. 14A and 14B are diagrams illustrating an example of classifying task types in an electronic device according to one embodiment.

[0035] FIGS. 15A and 15B are diagrams illustrating an example of analyzing an image and providing an execution object in an electronic device according to one embodiment.

[0036] FIGS. 16A and 16B are diagrams illustrating an example of providing a preview of a list of applications for processing text in an electronic device according to one embodiment.

[0037] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0038] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0039] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0040] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0041] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0042] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0043] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., an object), or a digital pen (e.g., a stylus pen).

[0044] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0045] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0046] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0047] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0048] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) to an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0049] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0050] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0051] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0052] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0053] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0054] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0055] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0056] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0057] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0058] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0059] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0060] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0061] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish the corresponding component from other corresponding components and do not limit the corresponding components in any other respect (e.g., importance or order). When a component (e.g., a first) is referred to as "coupled" or "connected" to another (e.g., a second) component, with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0062] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0063] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0064] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0065] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0066] FIG. 2 is a diagram illustrating an example of providing an execution object in an electronic device according to one embodiment.

[0067] Referring to FIG. 2, an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may provide a first user interface (210) including an input field (201) and a keypad (or a virtual keypad (SIP, soft input panel)) (203). The electronic device (101) may detect a user input that calls the input field (201) and display the first user interface (210) on a display (e.g., the display module (160) of FIG. 1) in response to the detected user input. The input field (201) may be an item (or field) for receiving text from a user. The electronic device (101) may provide a keypad (203) for inputting text into the input field (201). The electronic device (101) may receive text from a user through the keypad (203). According to one embodiment, the electronic device (101) can receive (or acquire) a voice from a user, convert the received voice into text, and input it into an input field (201).

[0068] An electronic device (101) can acquire user input entered into an input field (201) and display the acquired user input as text. The electronic device (101) can analyze the content of the displayed text and display at least one action item for processing the analyzed content together with at least a portion of the text. The electronic device (101) can display a second user interface (230) or a third user interface (250) on a display module (160) to process the analyzed content.

[0069] The second user interface (230) may include a first text (231), a first execution item (233), and a second execution item (235). The first text (231) may be content entered by a user into an input field (201). The first execution item (233) may include an icon of an application capable of transmitting the first text (231). For example, the first execution items (233) may be plural and may include an icon of a first messenger application (e.g., Messages), an icon of a second messenger application (e.g., Telegram), or an icon of a third messenger application. When at least one of the first execution items (233) is selected, the electronic device (101) may provide an execution screen of the messenger application in which the first text (231) is entered into an input field of the messenger application. The electronic device (101) analyzes the content of the first text (231) and provides an execution screen of a messenger application in which a person to send the first text (231) is set, or allows the user to select a person to send the first text (231) through the execution screen of the application.

[0070] The second execution item (235) may include an icon of an application capable of posting the first text (231). For example, the second execution items (235) may be multiple and may include an icon of a first posting application (e.g., Instagram), an icon of a second posting application (e.g., Twitter), or an icon of a third posting application. When at least one of the second execution items (235) is selected, the electronic device (101) may provide an execution screen of the posting application in which the first text (231) is entered in an input field of the posting application. Since the first text (231) is shorter than a specified length, the electronic device (101) may determine that the intention is greater to transmit the content of the first text (231) than to post it, and may display the first execution item (233) above the second execution item (235) for user convenience.

[0071] The third user interface (250) may include a second text (251), a third action item (253), and a fourth action item (255). The second text (251) may be additional content input by a user following the first text (231) in the input field (201). The third action item (253) may include an icon of an application capable of posting the second text (251). The fourth action item (255) may include an icon of an application capable of transmitting the second text (251). Since the second text (251) is longer than the first text (231), the electronic device (101) may determine that the intention is greater to post the content of the second text (251) than to transmit it, and may display the third action item (253) above the fourth action item (255) for user convenience.

[0072] According to an embodiment of the present disclosure, an electronic device (101) includes a display (160), a memory (130) for storing instructions, and a processor (120), and the instructions stored in the memory, when executed by the processor, cause the electronic device to display an input field in response to a first user input calling the input field, acquire a second user input inputted into the input field, display the acquired second user input as text in the input field, analyze the content of the text, and control at least one execution item for processing the analyzed content to be displayed through the display together with at least a part of the text, and the at least one execution item may include at least one of an execution object of an application, an execution object providing a function within an application, an execution preview based on generative artificial intelligence (AI), or a setting object of the electronic device.

[0073] The above instructions, when executed by the processor, may cause the electronic device to extract parameters from the text, generate search results using the extracted parameters, determine an application list by a view constraint filter, generate an execution preview of an application included in the application list, and provide the generated execution preview.

[0074] The instructions, when executed by the processor, may cause the electronic device to analyze a user intent based on real-time updating of text entered into the input field, and to add or change at least one action item displayed on the display in response to the analyzed user intent.

[0075] The instructions, when executed by the processor, may cause the electronic device to change the target task to a second execution item based on a third user input within the plurality of execution items when a first execution item is set as the target task within the plurality of execution items.

[0076] The instructions, when executed by the processor, may cause the electronic device to transmit the text as input to an application of an execution item selected by a user from the at least one execution item, and, in response to selection of the execution item, display an execution screen of an application that has processed the transmitted text on the display.

[0077] The instructions, when executed by the processor, may cause the electronic device to transmit the text as input to a setting screen of the electronic device or user personal information corresponding to an execution item selected by the user from the at least one execution item, and, in response to selection of the execution item, display the setting screen of the electronic device or user personal information that processed the transmitted text on the display.

[0078] The above instructions, when executed by the processor, may cause the electronic device to analyze the at least one execution item and display an action object of an application for additional user settings for the at least one execution item.

[0079] The instructions, when executed by the processor, may cause the electronic device to convert speech of the at least one action item into text, analyze the converted text to extract data-validating information, and display an action object of an application for additional user settings for the at least one action item based on the data-validating information. For example, the data-validating information may include core keywords related to the user's intent obtained based on the input text analysis results.

[0080] The above instructions, when executed by the processor, may cause the electronic device to collect data stored in a memory of the electronic device and an application installed in the electronic device based on the content of the acquired text, analyze the collected data, and provide analysis result information as the at least one execution item.

[0081] The above instructions, when executed by the processor, may cause the electronic device to interoperate with an external server to compose a response corresponding to the content of the acquired text and provide it as at least one execution item.

[0082] The above instructions, when executed by the processor, may cause the electronic device to search for data on the Internet based on the content of the acquired text and provide the searched data as Internet result information as the at least one execution item.

[0083] The above instructions, when executed by the processor, may cause the electronic device to select an image captured by the second user input and obtain and display text from the selected captured image.

[0084] Figure 3 is a flowchart (300) illustrating an operating method of an electronic device according to one embodiment.

[0085] Referring to FIG. 3, in operation 301, a processor (e.g., the processor 120 of FIG. 1) of an electronic device (e.g., the electronic device 101 of FIG. 1) according to an embodiment may display an input field. The processor (120) may detect a first user input for calling the input field, and display the input field on a display (e.g., the display module (160) of FIG. 1) in response to the detected user input. When providing the input field, the processor (120) may also provide a keypad for entering text into the input field. For example, the processor (120) may provide the input field when receiving a specified user input for calling the input field on a home screen. Alternatively, the processor (120) may provide the input field when receiving a specified user input for calling the input field on an execution screen of an application. The designated user input that calls the above input field may be a drag (or swipe) upwards from the lower bezel area of ​​the electronic device (101) where the display is placed on the home screen.

[0086] In operation 303, the processor (120) may acquire a second user input entered into the input field. The user input may be acquired through a keypad provided together with the input field. Alternatively, the processor (120) may receive voice as the user input and convert the received voice into text using speech recognition technology (speech to text).

[0087] In operation 305, the processor (120) may display the user input as text in the input field. The processor (120) may display the user input as text in the input field as it is acquired. The processor (120) may convert the user's voice into text and display the converted text in the input field.

[0088] In operation 307, the processor (120) may analyze the content of the text. The processor (120) may analyze whether the text contains numbers, whether the length of the text is greater than a reference value (or a specified length), and whether the text is an input for a conversation or an input for a search. The processor (120) may analyze the content of the text by linking with an external server (e.g., server (108) of FIG. 1) or by using an artificial intelligence function stored in a memory (e.g., memory (130) of FIG. 1). The processor (120) may analyze the content of the text to identify an application for processing the content of the text, identify a specific function within the application, or identify a setting of the electronic device (101).

[0089] In operation 309, the processor (120) may provide at least one execution item for processing the content of the analyzed text. The at least one execution item may include a visual object configured to be executable for text processing. For example, the at least one execution item may include at least one of an execution object of an application (e.g., a button, a menu, an item), an execution object providing a function within an application, an execution preview based on generative artificial intelligence (AI), or a setting object of the electronic device. The processor (120) may search for a function for processing the content of the analyzed text in an Internet (or website) application. The processor (120) may display the at least one execution item or at least a portion of the text on the display module (160). When a user input is detected that drags an input field included in an execution screen of an application in a specified direction, for example, an upward or downward direction, the processor (120) may provide at least one execution item for processing the content of the analyzed text.

[0090] According to one embodiment, the processor (120) may analyze the user's intent based on real-time updates of text input into the input field. The user may continuously input text into the input field. As the content of the input text changes, the processor (120) may analyze the user's intent corresponding to the content of the text in real-time. The processor (120) may add or change at least one action item displayed on the display in response to the analyzed user intent.

[0091] According to one embodiment, when a first execution item is set as a target task among a plurality of execution items, the processor (120) may change the target task to a second execution item based on a user input (e.g., swipe, scroll) within the plurality of execution items. The plurality of execution items may include execution items that can be grouped into the same category that provide the same function. The target task may refer to an item on which a cursor is currently positioned among the plurality of execution items. For example, when three execution items are displayed in a horizontal or vertical overlap manner and the first execution item is displayed first, the first execution item may be set as the target task. The processor (120) may change the target task to a second or third execution item based on a user input of swiping among the plurality of execution items.

[0092] According to one embodiment, the processor (120) may transmit the text as an input to an application of an execution item selected by the user from the at least one execution item, and in response to selection of the execution item, display an execution screen of an application that has processed the transmitted text on the display module (160). For example, when the text "Shall we meet tomorrow?" is input into an input field and a first execution item is selected, the processor (120) may display an execution screen of a message application that has input the text into an input field of a message application corresponding to the first execution item.

[0093] According to one embodiment, the processor (120) may input the text into the settings or user personal information of the electronic device corresponding to the execution item selected by the user from the at least one execution item, and in response to the selection of the execution item, display the settings screen of the electronic device or the user's personal information that has processed the transmitted text on the display module (160). For example, when the text "the battery is low" is input into the input field, the processor (120) may analyze the user's intention (e.g., power saving) based on the analysis result of the text, and provide an execution item that can turn on the battery power saving mode among the settings of the electronic device (101), or provide an execution item that controls (e.g., forcefully stops) a background running application.

[0094] According to one embodiment, the processor (120) may analyze the at least one execution item and display an action object of the application for the user's additional settings (or execution) of the at least one execution item. The action object of the application may refer to a visual object that can execute a specific function (or task) within the application. For example, if the at least one execution item is a coupon image, the processor (120) may display a notification registration object that can read the expiration date of the coupon and register an expiration date notification as the action object of the application.

[0095] According to one embodiment, the processor (120) may collect data stored in the memory (e.g., the memory (130) of FIG. 1) of the electronic device (101) and in an application installed in the electronic device based on the content of the acquired text, analyze the collected data, and provide analysis result information as the at least one action item. For example, if the processor (120) receives text input such as “summarize conversations from the morning,” the processor (120) may search for a morning call history stored in the memory (130) or a phone application, convert a call recording corresponding to the searched morning call history into text, and provide the converted text as analysis result information. Alternatively, the processor (120) may analyze the converted text to extract data validity information, and display an action object (e.g., a calendar registration object, a note registration object) of an application for the user’s additional settings based on the data validity information for the at least one action item. For example, the data validity information may include a core keyword related to the user’s intention obtained based on the input text analysis result.

[0096] According to one embodiment, the processor (120) may link with an external server (e.g., server (108) of FIG. 1) to compose a response corresponding to the content of the acquired text (e.g., compose a response using artificial intelligence) and provide it as at least one execution item.

[0097] FIG. 4A is a diagram illustrating an example of providing an execution object by calling an input field on a home screen in an electronic device according to one embodiment.

[0098] Referring to FIG. 4A, an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may receive a designated user input (401) that calls up an input field on a home screen (410). For example, the designated user input (401) may be a drag (or swipe) upwards from a lower bezel area of ​​the electronic device (101) where a display is arranged on the home screen. Based on detection of the designated user input (401) on the home screen (410), the electronic device (101) may display a first user interface (420) including an input field (421) on a display (e.g., the display module (160) of FIG. 1). The first user interface (420) may include an input field (421). The electronic device (101) may detect a user input (423) that selects an input field (421) within the first user interface (420). The electronic device (101) may provide a second user interface (430) when a user input (423) is detected. The second user interface (430) may include an input field (431) and a keypad (433). The electronic device (101) may receive text in the input field (431) through the keypad (433). Alternatively, the electronic device (101) may receive a user voice, convert the received user voice into text, and input and display the converted text in the input field (431).

[0099] The electronic device (101) may provide a third user interface (440) based on text entered into the input field (431). The third user interface (440) may include at least one action item (445) together with at least a portion of the text (443) entered into the input field (441). When one action item (447) among the at least one action item (445) is selected, the electronic device (101) may provide a fourth user interface (450). The fourth user interface (450) may display the selected action item (453) for a predetermined period of time. The electronic device (101) may display the input field (451) and the selected action item (453) in a floating manner, and then provide a fifth user interface (460) after a predetermined period of time (e.g., N seconds) has elapsed. The fifth user interface (460) may be a screen where the input fields and the display of selected execution items have disappeared, for example, a home screen.

[0100] FIG. 4b is a diagram illustrating an example of providing an execution object on an application execution screen of an electronic device according to one embodiment.

[0101] Referring to FIG. 4B, the electronic device (101) may display an application (e.g., a messenger application) execution screen (470) and receive a user input (473) entered into an input field (471) included in the application execution screen (470). The electronic device (101) may display the acquired user input (473) as text (e.g., cake) in the input field. When the electronic device (101) detects a user input (483) of dragging the input field (481) in a specified direction, for example, an upward or downward direction, in the sixth user interface (480), the electronic device (101) may analyze the content of the text corresponding to the user input (483). The electronic device (101) may provide a seventh user interface (490) including at least one execution item for processing the content of the analyzed text. The seventh user interface (490) may include at least a portion (491) of the text or the at least one execution item (493). When at least one of the execution items is selected in the seventh user interface (490), the electronic device (101) may provide one of the execution screens of the application in which the text is processed as input, the settings screen of the electronic device (101), or the user's personal information as the selected execution item.

[0102] FIG. 5A is a diagram illustrating an example of changing an execution object in an electronic device according to one embodiment.

[0103] Referring to FIG. 5A, an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may provide a user interface (500) including a plurality of execution items (510, 550) based on text entered in an input field. A first plurality of execution items (510) may be an execution object of an application for transmitting text. A second plurality of execution items (550) may be an execution object of an application for posting text. For example, the first plurality of execution items (510) may be three execution items (502, 503, 504) that may be displayed overlapping in a specified direction, for example, a horizontal or vertical direction. The first plurality of execution items (510) may be items that can be grouped into the same category group. Execution items that overlap in one direction may be items that are determined to be in the same category group and that provide the same function (e.g., send on, post on) for the same input text. For the same text, if different functions are provided, they can be displayed separately without being grouped and without overlapping applications.

[0104] The electronic device (101) can change the target task based on a user input (501) of swiping the first plurality of execution items (510). If the first execution item (502) is displayed first, the first execution item (502) may be set as the target task. The electronic device (101) can change the target task to the second execution item (503) or the third execution item (504) based on a user input (501) of swiping on the first plurality of execution items (510). For example, the electronic device (101) can receive a user input (530) of selecting an input field after swiping (521) the plurality of execution items (520) to the left. The second plurality of execution items (550) can be displayed such that three execution items (553, 555, 557) overlap in a specified direction, for example, in a horizontal or vertical direction. The electronic device (101) can change the target task based on a user input (551) swiping a second plurality of execution items (550).

[0105] FIG. 5b is a diagram illustrating an example of performing a desired function according to selection of an execution object in an electronic device according to one embodiment.

[0106] Referring to FIG. 5B, the electronic device (101) may provide (e.g., display on a display) a second user interface (550) including a plurality of action items (553, 555) based on a first text (551) entered in an input field. For example, the electronic device (101) may display the first text (551) entered as “2 o’clock meeting” in the input field and analyze the content of the first text (551). The electronic device (101) may obtain the first text (551) through a keypad or a user’s voice. The electronic device (101) may analyze the content of the first text (551) to identify that the first text (551) includes a number (e.g., 2), time information (e.g., 2 o’clock), and the word “meeting.” The electronic device (101) can analyze the contents of the first text (551) by linking with an external server (e.g., server (108) of FIG. 1) or by using an artificial intelligence function stored in a memory (e.g., memory (130) of FIG. 1).

[0107] The electronic device (101) may provide a plurality of execution items (553, 555) for processing the contents of the first text (551) analyzed above. The first execution item (553) may be for registering (or recording, saving) the 2 o'clock meeting in a schedule (e.g., a schedule application), and the second execution item (555) may be for saving (or recording, registering) the 2 o'clock meeting in a note (e.g., a note application). When the first execution item (553) is selected in the second user interface (550), the electronic device (101) may register the 2 o'clock meeting in the schedule application as today's date and provide a third user interface (560) that notifies that the schedule has been added to the execution screen of the application.

[0108] According to one embodiment, the electronic device (101) may provide a fourth user interface (570) including a plurality of execution items (573, 575) based on a second text (571) entered in an input field. For example, the electronic device (101) may display the second text (571) entered as “010-1234” in the input field and analyze the content of the second text (571). The electronic device (101) may obtain the second text (571) through a keypad or a user’s voice. The electronic device (101) may analyze the content of the second text (571) to recognize (or identify) that the second text (571) includes numbers (e.g., 0, 1, 2, 3, 4) and that the user’s intent is a contact number or a phone number. The electronic device (101) can analyze the contents of the second text (571) by linking with the server (108) or by using an artificial intelligence function stored in the memory (130).

[0109] The electronic device (101) may provide a plurality of execution items (573, 575) for processing the contents of the analyzed second text (571). The third execution item (573) may be for sending (or scheduling) a message (e.g., a message application) to a counterparty whose phone number is 010-1234, and the fourth execution item (575) may be for registering (or making a call) a phone number (e.g., a phone application, a contact application) whose phone number is 010-1234. When the fourth execution item (575) is selected in the fourth user interface (570), the electronic device (101) may register (or input) the second text (571) as a phone number in the contact application, and provide a fifth user interface (580) for receiving an additional input of the counterparty's name from the user in the contact application to notify that a new phone number has been added (or registered). Alternatively, the electronic device (101) may not only input the second text (571) into the input field, but also. By analyzing the situation (or context, usage history) before and after entering the second text (571), the other party's name can be identified and automatically entered into the other party's name field when adding a phone number. Although only 010-1234 is displayed as the second text (571) in the drawing, the user can enter the entire phone number and then select the fourth execution item (575) to register a new phone number.

[0110] FIG. 6 is a flowchart illustrating a method for providing an execution object corresponding to a user input in an electronic device according to one embodiment. FIG. 6 may illustrate in detail operations 307 and 309 of FIG. 3.

[0111] Referring to FIG. 6, in operation 601, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may obtain a user input from an input field. The user input may be obtained through a keypad provided together with the input field when the input field is provided. Alternatively, the processor (120) may receive voice as the user input and convert the received voice into text using voice recognition technology. The processor (120) may display the user input as text in the input field as it is entered.

[0112] Although the drawing illustrates that operation 603 is performed before operations 607, 609, 615, and 619, operation 607 is performed before operations 609, 615, and 619, operation 609 is performed before operations 615, 619, and operation 615 is performed before operation 619, operations 603, 607, 609, 615, and 619 may be performed in parallel (e.g., simultaneously) or sequentially without regard to order. The order of operations 603, 607, 609, 615, and 619 does not limit the present invention.

[0113] In operation 603, the processor (120) can determine whether a number has been entered as text. The processor (120) can determine whether the text entered as the user input contains a number. If the text contains a number, the processor (120) can perform operation 605, and if the text does not contain a number, the processor (120) can perform operation 607.

[0114] If the text includes a number, in operation 605, the processor (120) may provide an execution object associated with registering a schedule or phone number. The processor (120) may analyze the content of the text and provide an execution object associated with registering a schedule or phone number as at least one execution item for processing the content of the analyzed text. If the user inputs a number, the processor (120) may determine that the user's intention is to add (or register) or change a phone number, or to add (or register) or change a schedule. The processor (120) may analyze the content of the text input in real time and provide an execution object that enables the user to quickly perform a desired function (or a function to be processed). The processor (120) may receive a user's selection of an execution object from the provided execution objects and provide an execution screen (e.g., a schedule registration screen, a phone number registration screen) of an application that has processed the text as an input.

[0115] If the text does not contain numbers, in operation 607, the processor (120) can determine whether the text is an input for a conversation. The processor (120) can analyze the content of the text by linking with an external server (e.g., server (108) of FIG. 1) or using an artificial intelligence function stored in a memory (e.g., memory (130) of FIG. 1) to determine whether the text is an input for a conversation. If the text is an input for a conversation, the processor (120) can perform operation 609, and if the text is not an input for a conversation, the processor (120) can perform operation 615.

[0116] If the above text is an input for a conversation, in operation 609, the processor (120) can determine whether the length of the text is less than or equal to a reference value. The processor (120) can analyze the content of the text, and if the length of the text is less than or equal to a reference value (e.g., 40 bytes, 80 bytes), can perform operation 611, and if the length of the text exceeds the reference value, can perform operation 613.

[0117] If the length of the text is less than or equal to the reference value, in operation 611, the processor (120) may provide an execution object associated with content transmission. For example, the processor (120) may provide at least one of an icon of a first messenger application, an icon of a second messenger application, or an icon of a third messenger application for transmitting text as an execution object. The processor (120) may receive an execution item from the user from the provided execution object and input the text into an input field of an execution screen of the selected messenger application to provide the selected text.

[0118] If the length of the above text exceeds the reference value, in operation 613, the processor (120) may provide an execution object associated with the content posting. For example, the processor (120) may provide at least one of an icon of a first posting application for posting text, an icon of a second posting application, or an icon of a third posting application as an execution object. The processor (120) may receive an execution item from the user from the provided execution object and input the text into an input field of an execution screen of the selected posting application to provide the selected text.

[0119] If the text is not an input for conversation, in operation 615, the processor (120) can determine whether the text is an input for document writing. The processor (120) can analyze the content of the text in conjunction with the server (108) or by using an artificial intelligence function stored in the memory (130) to determine whether the text is an input for document writing. If the text is an input for document writing, the processor (120) can perform operation 617, and if the text is not an input for document writing, the processor (120) can perform operation 619.

[0120] If the above text is an input for document creation, in operation 617, the processor (120) may provide an execution object associated with document creation. For example, the execution object may include at least one of a first document creation application (e.g., Word), a second document creation application (e.g., PowerPoint), a third document creation application (e.g., Excel), or a fourth document creation application (e.g., a note application). The processor (120) may receive an execution item from the user from the provided execution object, and input the text into an input field of an execution screen of the selected document creation application to provide the selected text.

[0121] If the text above is not an input for document creation, in operation 619, the processor (120) can determine whether the text is an input for search. The processor (120) can analyze the content of the text in conjunction with the server (108) or by using an artificial intelligence function stored in the memory (130) to determine whether the text is an input for search. If the text is an input for search, the processor (120) can perform operation 621, and if the text is not an input for search, the processor (120) can perform operation 623.

[0122] If the above text is an input for a search, in operation 621, the processor (120) may provide an execution object related to the search. For example, the execution object may include at least one of a first search application (e.g., Google), a second search application (e.g., search within an electronic device), or a third search application. The processor (120) may receive a selection of an execution item from the user in the provided execution object, and provide a screen for entering the text in an input field of an execution screen of the selected search application, or provide a search result obtained by searching the text using the search application.

[0123] If the above text is not an input for search, in operation 623, the processor (120) may determine the user's intent and provide an execution object. The processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or memory (130) to determine the intent of the user who entered the text. The processor (120) may provide an execution object based on the determination result.

[0124] FIG. 7A is a diagram illustrating an example of providing weather information based on user input in an electronic device according to one embodiment.

[0125] Referring to FIG. 7A, a processor (e.g., the processor 120 of FIG. 1) of an electronic device (e.g., the electronic device 101 of FIG. 1) according to an embodiment may provide a first user interface (710) that inputs “today’s weather” as a user input (701) into an input field. The first user interface (710) may include an input field and a keypad (or a virtual keypad). The processor (120) may obtain the user input (701) in the input field through the keypad or user voice in the first user interface (710) and display text (e.g., “today’s weather”) corresponding to the user input (701). The processor (120) may provide a second user interface (715) that analyzes the text. The second user interface (715) may include (display) a visual object that indicates that text analysis is in progress. The processor (120) may analyze the content of the text by linking with an external server (e.g., server (108) of FIG. 1) or using an artificial intelligence function stored in the memory of the electronic device (101) (e.g., memory (130) of FIG. 1) to analyze (or identify) the intention of the user who entered the text.

[0126] The processor (120) may provide a third user interface (720) that provides at least one action item for processing the analyzed text (e.g., today's weather). The third user interface (720) may include text (e.g., today's weather), an action item (721), or a keypad. In the drawing, there is one action item (721), but there may be multiple action items (721). The processor (120) may detect a user input (723) for selecting an action item (721) in the third user interface (720). The action item (721) may be an action item for indicating today's weather (e.g., a widget of a weather application).

[0127] The processor (120) may provide a fourth user interface (725) based on user input (723). The fourth user interface (725) may be an execution screen of a weather application that displays today's weather (e.g., temperature, humidity) in at least one of text, image, and video.

[0128] FIG. 7b is a diagram illustrating an example of providing health information based on user input in an electronic device according to one embodiment.

[0129] Referring to FIG. 7B, the processor (120) may provide a fifth user interface (730) that inputs “How much did you walk today?” as a user input (731) in an input field. The fifth user interface (730) may include an input field and a keypad. The processor (120) may obtain the user input (731) in the input field through the keypad or the user voice in the fifth user interface (730) and display text corresponding to the user input (731) (e.g., “How much did you walk today?”). The processor (120) may provide a sixth user interface (735) that analyzes the text. The processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or the memory (130) to analyze the intention of the user who input the text.

[0130] The processor (120) may provide a seventh user interface (740) that provides at least one action item for processing the analyzed text (e.g., “How much did you walk today?”). The seventh user interface (740) may include text (e.g., “How much did you walk today?”), an action item (741), or a keypad. The action item (741) may be an action item (e.g., a widget of a health application) for indicating the number of steps taken today. In the drawing, there is only one action item (741), but there may be multiple action items (741). The processor (120) may detect a user input (743) for selecting an action item (741) in the seventh user interface (740). The processor (120) may provide an eighth user interface (745) based on the user input (743). The eighth user interface (745) may be a running screen of a health application that displays health information (e.g., number of steps today, number of steps per week, calories burned) in the form of at least one of text, image, and video.

[0131] FIG. 7c is a diagram illustrating an example of providing a timer based on user input in an electronic device according to one embodiment.

[0132] Referring to FIG. 7C, the processor (120) may provide a ninth user interface (750) that inputs “timer for 10 minutes” as a user input (751) in an input field. The ninth user interface (750) may include an input field and a keypad. The processor (120) may obtain the user input (751) in the input field through the keypad or the user voice in the ninth user interface (750) and display text (e.g., timer for 10 minutes) corresponding to the user input (751). The processor (120) may provide a tenth user interface (755) that analyzes the text. The processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or the memory (130) to analyze the intention of the user who input the text.

[0133] The processor (120) may provide an eleventh user interface (760) that provides at least one action item for processing the analyzed text (e.g., "Time me for 10 minutes"). The eleventh user interface (760) may include text (e.g., "Time me for 10 minutes"), an action item (761), or a keypad. In the drawing, there is one action item (761), but there may be multiple action items (761). The eleventh user interface (760) may further include a menu (e.g., a time setting, a confirmation object, a cancel object) for controlling the action item (761). The processor (120) may provide an action item (761) with a timer set to 10 minutes with text (e.g., "Time me for 10 minutes"). The processor (120) may start a timer based on a user input selecting a start object in the eleventh user interface (760) and provide a twelfth user interface (765). The 12th user interface (765) may be a running screen of a timer (or clock, alarm) application that displays at least one of text, image, and video.

[0134] FIG. 7d is a diagram illustrating an example of controlling settings of an electronic device based on user input in an electronic device according to one embodiment.

[0135] Referring to FIG. 7D , the processor (120) may provide a thirteenth user interface (770) that inputs “I don’t have a battery right now” as a user input (771) in an input field. The thirteenth user interface (770) may include an input field and a keypad. The processor (120) may obtain the user input (771) in the input field through the keypad or the user voice in the thirteenth user interface (770) and display text corresponding to the user input (771) (e.g., “I don’t have a battery right now”). The processor (120) may provide a fourteenth user interface (775) that analyzes the text. The processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or the memory (130) to analyze the intention of the user who input the text.

[0136] The processor (120) may provide a fifteenth user interface (780) that provides at least one action item for processing the analyzed text (e.g., "I have no battery now"). The fifteenth user interface (780) may include text (e.g., "I have no battery now"), an action item (e.g., a power saving mode control item of the electronic device (101)), or a keypad. The fifteenth user interface (780) may include a menu (e.g., a toggle object) that controls the action item. The processor (120) may provide an action item for changing the battery of the electronic device (101) to a power saving mode based on the text (e.g., "I have no battery now"). The processor (120) may activate (e.g., turn on) the power saving mode based on a user input that selects a toggle object in the fifteenth user interface (780) and provide a sixteenth user interface (785). The 16th user interface (785) may be a settings screen of the electronic device (101) that activates or deactivates the power saving mode.

[0137] FIG. 8A is a diagram illustrating an example of providing an execution object related to Internet access according to user input in an electronic device according to one embodiment.

[0138] Referring to FIG. 8A, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may provide a first user interface (810) that inputs “WWW.” as a user input into an input field. The first user interface (810) may include an input field and a keypad. The processor (120) may obtain a user input (e.g., WWW.) into the input field through the keypad or user voice in the first user interface (810) and display text (e.g., WWW.) corresponding to the user input. The processor (120) may provide a second user interface (815) that analyzes the text. The processor (120) may analyze the content of the text by linking with an external server (e.g., server (108) of FIG. 1) or using an artificial intelligence function stored in the memory of the electronic device (101) (e.g., memory (130) of FIG. 1) to analyze the intention of the user who entered the text.

[0139] The processor (120) may provide a third user interface (820) that provides at least one execution item for processing the analyzed text (e.g., WWW.). The third user interface (820) may include text (e.g., WWW.) or a plurality of execution items (e.g., a plurality of Internet access icons) (821). The processor (120) may detect a user input for selecting at least one execution item in the third user interface (820). The processor (120) may provide an execution screen of at least one Internet access application based on the detected user input.

[0140] FIG. 8b is a diagram illustrating an example of providing coupon information as an execution object according to user input in an electronic device according to one embodiment.

[0141] Referring to FIG. 8B, the processor (120) may provide a fourth user interface (830) in which a user input (831) of “organize mobile coupons I received” is input into an input field. The fourth user interface (830) may include an input field and a keypad. The processor (120) may obtain a user input (831) in the input field through the keypad or user voice in the fourth user interface (830) and display text corresponding to the user input (831) (e.g., “organize mobile coupons I received”). The processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or the memory (130) to analyze the intention of the user who input the text.

[0142] The processor (120) may provide a fifth user interface (835) that provides at least one action item for processing the analyzed text (e.g., organizing mobile coupons I received). The fifth user interface (835) may include at least a portion of the text (e.g., “mobile coupons I received”) or a plurality of action items (839). The plurality of action items (839) are provided based on the analysis result and may be related to coupon images stored in the electronic device (101). The processor (120) may detect a user input (833) for selecting one action item (837) in the fifth user interface (835). The processor (120) may enlarge and display the selected action item (837) within the fifth user interface (835) based on the user input (833). When the selected action item (837) is selected once more, the processor (120) may provide a sixth user interface (840). The sixth user interface (840) may be an execution screen of a gallery application that displays coupon information (e.g., coupon name, barcode) in at least one of text, image, and video. The processor (120) may provide an execution screen (845) of an application for registering a reminder when a reminder registration object is selected on an execution item (837) selected in the fifth user interface (835).

[0143] FIG. 8c is a diagram illustrating an example of providing an execution object related to a call record according to a user input in an electronic device according to one embodiment.

[0144] Referring to FIG. 8C, the processor (120) may provide a seventh user interface (850) in which a user input (851) of “summarize the conversation I had this morning” is input into an input field. The seventh user interface (850) may include an input field and a keypad. The processor (120) may obtain the user input (851) in the input field through the keypad or the user voice in the seventh user interface (850) and display text corresponding to the user input (851) (e.g., “summarize the conversation I had this morning”). The processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or the memory (130) to analyze the intention of the user who input the text.

[0145] The processor (120) may provide an eighth user interface (855) that provides at least one action item for processing the analyzed text (e.g., organizing the conversation I had this morning). The eighth user interface (855) may include at least a portion of the text (e.g., “I had a conversation this morning…”) and / or a plurality of action items. The plurality of action items are provided based on the analysis results, and may be, for example, information converted into text from conversations stored in an electronic device during a specified time (this morning). The processor (120) may detect a first user input (853) that selects at least one action item in the eighth user interface (855). Based on the first user input (853), the processor (120) may display call history information (859) of the selected action item in the eighth user interface (855). For example, the processor (120) may convert conversations related to car mileage into text using voice recognition technology and display the converted text as call history information (859).

[0146] According to one embodiment, the processor (120) may analyze the converted text to extract data validity information, and based on the data validity information, display an action object of the application for the user to further configure at least one of the execution items. For example, the data validity information may include core keywords related to the user's intent obtained based on the input text analysis results.

[0147] The eighth user interface (855) may further include an action object (857) of the application for setting an alarm for an execution item. When a user input (858) for selecting the action object (857) of the application is detected, the processor (120) may provide a ninth user interface (860). The ninth user interface (860) may be a first execution screen of an alarm application related to automobile insurance mileage. When a user input (861) for selecting automobile insurance mileage is detected in the ninth user interface (860), the processor (120) may provide a second execution screen (865) of the alarm application for registering (or saving) a schedule for checking the refund amount of automobile insurance mileage.

[0148] FIG. 8d is a diagram illustrating an example of providing exercise information to an execution object according to user input in an electronic device according to one embodiment.

[0149] Referring to FIG. 8D, the processor (120) may provide a tenth user interface (870) that inputs “yesterday’s exercise analysis” as a user input into an input field. The tenth user interface (870) may include an input field and a keypad. The processor (120) may obtain a user input (871) in the input field through the keypad or the user’s voice in the tenth user interface (870) and display text (e.g., “yesterday’s exercise analysis”) corresponding to the user input (871). The processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or the memory (130) to analyze the intention of the user who input the text.

[0150] The processor (120) may provide an eleventh user interface (880) that provides at least one action item (883) for processing the analyzed text (e.g., yesterday's exercise analysis). The eleventh user interface (880) may include text (e.g., yesterday's exercise analysis) or multiple action items (e.g., view step count, view calories). According to one embodiment, the processor (120) may analyze the text to extract data validity information, and display an action object of an application for the user's additional settings for the at least one action item based on the data validity information. For example, the data validity information may include core keywords related to the user's intention obtained based on the input text analysis results.

[0151] The eleventh user interface (880) may further include an application action object (881) for viewing the results of an execution item. When a user input (885) selecting the application action object (881) is detected, the processor (120) may provide a twelfth user interface (890) including exercise analysis information. The twelfth user interface (890) may include text (e.g., “Yesterday’s exercise analysis”) or exercise analysis information (e.g., “Yesterday’s exercise amount is last week’s exercise amount”). The exercise analysis information may be personal information of the user and may be composed of at least one of text, an image, or a video.

[0152] FIG. 9A is a diagram illustrating an example of providing consumption analysis information as an execution object in an electronic device according to one embodiment.

[0153] Referring to FIG. 9A, a processor (e.g., the processor 120 of FIG. 1) of an electronic device (e.g., the electronic device 101 of FIG. 1) according to an embodiment may provide a first user interface (910) in which a user input (911) “Is this month’s consumption high?” is input into an input field. The first user interface (910) may include an input field and a keypad. The processor (120) may obtain the user input (911) in the input field through the keypad or the user voice in the first user interface (910) and display text (e.g., “Is this month’s consumption high?”) corresponding to the user input. The processor (120) may analyze the content of the text by linking with an external server (e.g., the server (108) of FIG. 1) or by using an artificial intelligence function stored in a memory (e.g., the memory (130) of FIG. 1) of the electronic device (101) to determine the intention of the user who input the text.

[0154] The processor (120) may provide a second user interface (915) that provides at least one action item for processing the analyzed text (e.g., “Is this month’s consumption high?”). The second user interface (915) may include text (e.g., “Is this month’s consumption high?”) or a plurality of action items (912, 914). The first action item (912) may represent a consumption graph for this month, and the second action item (914) may represent a consumption category. In addition, the processor (120) may analyze the text to extract data validity information, and based on the data validity information, display an action object of an application for a user to make additional settings for the at least one action item. The second user interface (915) may further include an action object (916) of an application for viewing the analysis result of the action item. When a user input (913) selecting an action object (916) of an application is detected, the processor (120) may provide a third user interface (920) including consumption analysis information. The third user interface (920) may include text (e.g., “Is this month’s consumption high?”) or consumption analysis information (e.g., this month’s consumption is higher than last month’s consumption…). The consumption analysis information may be composed of at least one of text, an image, or a video, which is personal information of the user.

[0155] FIG. 9b is a diagram illustrating an example of providing an execution object related to message transmission in an electronic device according to one embodiment.

[0156] Referring to FIG. 9B, the processor (120) may provide a fourth user interface (930) that inputs “Jiyeon, the results of this industry-academia project…” as a user input (931) in an input field. The fourth user interface (930) may include an input field and a keypad. The processor (120) may obtain the user input (931) in the input field through the keypad or the user’s voice in the fourth user interface (930) and display text corresponding to the user input (e.g., “Jiyeon, the results of this industry-academia project…”). The processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or the memory (130) to analyze the intention of the user who input the text.

[0157] The processor (120) may provide a fifth user interface (940) that provides at least one execution item for processing the analyzed text (e.g., Jiyeon, this industry-academia project...). The fifth user interface (940) may include text (e.g., Jiyeon, this industry-academia project...) or a plurality of execution items (941, 943, 945). In addition, the processor (120) may receive a user input (946) for selecting one of the plurality of execution items (941, 943, 945). When at least one execution item is selected, the processor (120) may provide an execution screen (950) of an application corresponding to the selected execution item. The execution screen (950) of the application may be an execution screen of a message application that transmits text (e.g., Jiyeon, this industry-academia project...) to a target object (e.g., Jiyeon). The processor (120) can analyze text, set a target to transmit the text (e.g., delay), and transmit the input text to the target.

[0158] FIG. 9c is a diagram illustrating an example of providing an execution object related to inputting dietary information in an electronic device according to one embodiment.

[0159] Referring to FIG. 9C, the processor (120) may provide a sixth user interface (960) in which a user input (961) such as “2 apples, 1 ABC juice…” is input into an input field. The sixth user interface (960) may include an input field and a keypad. The processor (120) may obtain the user input (961) in the input field through the keypad or the user voice in the sixth user interface (960) and display text corresponding to the user input (e.g., 2 apples, 1 ABC juice…). The processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or the memory (130) to analyze the intention of the user who input the text.

[0160] The processor (120) may provide a seventh user interface (965) that provides at least one action item for processing the analyzed text (e.g., 2 apples, 1 ABC juice, etc.). The seventh user interface (965) may include text (e.g., 2 apples, 1 ABC juice, etc.) or a plurality of action items (963, 967). In addition, the processor (120) may receive a user input (968) for selecting one of the plurality of action items (963, 967). When at least one action item is selected, the processor (120) may provide an execution screen (970) of an application corresponding to the selected action item. The execution screen (970) of the application may be an execution screen of a note application that registers text (e.g., 2 apples, 1 ABC juice, etc.) in diet information. The processor (120) can analyze the text to identify an application to store (or register) the text, and store the text in a specific item (e.g., diet information) within the identified application.

[0161] FIG. 9d is a diagram illustrating an example of providing an execution object related to a memo in an electronic device according to one embodiment.

[0162] Referring to FIG. 9D, the processor (120) may provide an eighth user interface (980) that inputs “2 kg of beef, vegetables, …” as a user input (981) in an input field. The eighth user interface (980) may include an input field and a keypad. The processor (120) may obtain the user input (981) in the input field through the keypad or the user voice in the eighth user interface (968) and display text (e.g., 2 kg of beef, vegetables, …”) corresponding to the user input. The processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or the memory (130) to analyze the intention of the user who input the text.

[0163] The processor (120) may provide a ninth user interface (985) that provides at least one action item for processing the analyzed text (e.g., 2 kg of beef, vegetables, …). The ninth user interface (985) may include text (e.g., 2 kg of beef, vegetables, …) or a plurality of action items (983, 987). In addition, the processor (120) may receive a user input (989) for selecting one of the plurality of action items (983, 987). The processor (120) may provide an execution screen (990) of an application corresponding to the selected action item in response to the user input (989). The execution screen (990) of the application may be an execution screen of an application that configures a shopping checklist with the input text (e.g., 2 kg of beef, vegetables, …) and generates and registers a reminder. The processor (120) can analyze the text to identify an application to store (or register) the text, and store the text as a specific item (e.g., shopping information) or a new note within the identified application.

[0164] FIG. 10 is a flowchart (1000) illustrating a method for providing different execution objects according to user input in an electronic device according to one embodiment. FIG. 10 may be a detailed illustration of operations 307 and 309 of FIG. 3.

[0165] Referring to FIG. 10, in operation 1001, a processor (e.g., processor (120) of FIG. 1) of an electronic device (e.g., electronic device (101) of FIG. 1) according to an embodiment may obtain a user input from an input field. The user input may be obtained through a keypad provided together with the input field when the input field is provided. Alternatively, the processor (120) may receive voice as the user input and convert the received voice into text using voice recognition technology. The processor (120) may display the user input as text in the input field as it is entered.

[0166] In operation 1003, the processor (120) can analyze the user's intent. The processor (120) can analyze the user's intent as the user input is input. The processor (120) can analyze the content of the text by linking with an external server (e.g., server (108) of FIG. 1) or using an artificial intelligence function stored in a memory (e.g., memory (130) of FIG. 1), and can analyze the user's intent based on the analysis result.

[0167] In operation 1005, the processor (120) may provide first execution items. The processor (120) may provide the first execution items based on the analyzed user intent.

[0168] At operation 1007, the processor (120) may determine whether the user input continues. If the user input continues, the processor (120) may perform operation 1009, and if the user input does not continue, the processor (120) may perform operation 1013.

[0169] If the user input continues, in operation 1009, the processor (120) may analyze the user's intent by further considering the additionally entered user input. Similarly to operation 1003, the processor (120) may analyze the content of the text using an artificial intelligence function stored in the server (108) or memory (130), and analyze the user's intent based on the analysis result.

[0170] In operation 1011, the processor (120) may provide second execution items. The processor (120) may provide second execution items based on the analyzed user intent. The first execution items and the second execution items may be different, or some execution items may overlap.

[0171] In operation 1013, the processor (120) may detect a user input for selecting an execution item. The user input may be for selecting at least one execution item from among a plurality of first execution items or second execution items.

[0172] In operation 1015, the processor (120) may display an execution screen corresponding to the selected execution item. The processor (120) may transmit the acquired user input to an application or setting screen corresponding to the selected execution item, and process the user input as an input of the application or setting screen. The execution screen may be an execution screen of an application in which the user input is processed as an input. For example, the execution screen of the application may be a messenger application that transmits the content of the user input to a target audience. The target audience may be set based on the user input. The execution screen may be a setting screen of the electronic device (101) in which the user input is processed as an input. For example, the setting screen of the electronic device (101) may be a setting screen for connecting to the Internet (e.g., Wi-Fi) or changing the display mode.

[0173] FIGS. 11A and 11B are drawings illustrating an example of providing different execution objects depending on input content in an electronic device according to one embodiment.

[0174] Referring to FIG. 11A, a processor (e.g., a processor (120) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1) according to an embodiment may display a first user interface (1110) on a display (e.g., a display module (160) of FIG. 1). The first user interface (1110) may include an input field, a keypad, or at least one execution item (1111, 1113). The processor (120) may analyze content input into the input field in real time and display at least one execution item corresponding to the analysis result. When an execution item (1111) to be saved in a note is selected in the first user interface (1110), the processor (120) may provide a second user interface (1115). The second user interface (1115) may display the input text (1117) as a pop-up. After providing the second user interface (1115), the processor (120) may provide an execution screen (1120) of a note application that registers user input in a note after a certain period of time.

[0175] Referring to FIG. 11B, the processor (120) may display a third user interface (1130) on the display module (160). The third user interface (1130) may include an input field, a keypad, or an execution item. The processor (120) may analyze a user input (1131) (e.g., 'settings') entered into the input field in real time and display execution items (e.g., first execution items) (1133) corresponding to the analysis result. After providing the third user interface (1130), if the user continues to input text into the input field, the processor (120) may provide a fourth user interface (1140). The processor (120) may additionally provide the fourth user interface (1140) in response to a second user input (1141) (e.g., 'setting color inversion') that is input. The fourth user interface (1140) displays a second user input (1141) entered into an input field and may include a keypad or a plurality of action items (e.g., second action items) (1143). The fifth user interface (1150) displays a third user input (1151) entered into an input field and may include a keypad or a plurality of action items (e.g., second action items) (1153).

[0176] FIGS. 12A to 12C are drawings illustrating an example of executing a desired function through an execution object provided according to a user input in an electronic device according to one embodiment.

[0177] Referring to FIG. 12A, a processor (e.g., a processor (120) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1) according to an embodiment may display a first user interface (1210) on a display (e.g., a display module (160) of FIG. 1). The first user interface (1210) may include an input field and a keypad. The processor (120) may analyze text (1201) input into the input field of the first user interface (1210) in real time. The processor (120) may provide a second user interface (1215) based on the result of analyzing the text (1201). The second user interface (1215) may include an input field, a plurality of execution items, an action object of an application corresponding to the execution items, and a keypad.

[0178] The action object of the above application may refer to a specific function (or task) within the application. For example, if the at least one execution item is a coupon image, the processor (120) may read the expiration date of the coupon and display an alarm object capable of notifying the expiration date as the action object of the application. The processor (120) may receive a user input (1213, 1217) for selecting action objects (1211, 1215) of multiple applications included in the second user interface (1215) from the user. The processor (120) may provide a third user interface (1220) in response to the user input (1213, 1217) for selecting action objects (1211, 1215) of multiple applications. The third user interface (1220) may include items (1221, 1222) for setting respective expiration dates corresponding to the multiple execution items (1211, 1215).

[0179] Referring to FIG. 12B, the processor (120) may display a fourth user interface (1230) on the display module (160). The fourth user interface (1230) may include an input field and a keypad. The processor (120) may analyze text (1231) entered into the input field of the fourth user interface (1230) in real time. The processor (120) may provide a fifth user interface (1235) based on the result of analyzing the text (1231). The fifth user interface (1235) may include an input field, a plurality of execution items (1233, 1237, 1238), and a keypad. The 5th week industry-academia project (1238) may be a file (pdf) stored in the electronic device (101), and may be a file searched in the electronic device (101) related to 'industry-academia project result report' among the texts (1231). Multiple action items (12333, 1237) can consist of text (e.g., Send to Sanhak / Jiyeon, Sanhak project) or images (e.g., an icon of an application).

[0180] The processor (120) may receive a user input (1236) for selecting a first execution item (1233) and a second execution item (1237) included in a fifth user interface (1235) from a user. For example, the user input (1236) may be a multi-touch input for substantially simultaneously selecting the first execution item (1233) and the second execution item (1237). The processor (120) may provide a sixth user interface (1240) corresponding to the selected execution items (1233, 1237). The sixth user interface (1240) may include an execution screen (1241) of a message application corresponding to the first execution item (1233) and an execution screen (1243) of a schedule application corresponding to the second execution item (1237). When multiple execution items are selected, the processor (120) may provide execution screens of multiple applications in a multi-window. The execution screen (1241) of the message application may be to send the text (1231) to the transmission target, "Jiyeon", based on the text (1231). The execution screen (1243) of the schedule application may be to register (or save) the date of the industry-academia project as the third week of June based on the text (1231).

[0181] Referring to FIG. 12C, the processor (120) may display a seventh user interface (1250) on the display module (160). The seventh user interface (1250) may include an input field and a keypad. The processor (120) may analyze text (1251) entered into the input field of the seventh user interface (1250) in real time. The processor (120) may provide an eighth user interface (1260) based on the result of analyzing the text (1251). The eighth user interface (1260) may include an input field, a plurality of execution items (1263, 1265), and a keypad. The plurality of execution items (1263, 1265) may be composed of at least one of text, an image, and a video. The plurality of action items (1263, 1265) may be action items configured using AI that analyzes text input from a user, such as a question-type text "Invent a new type of color and describe what it looks like," and generates an answer to the question as a result of the analysis. The user may select at least one action item among the plurality of action items (1263, 1265) included in the eighth user interface (1260) and perform a desired function.

[0182] FIGS. 13A to 13C are diagrams illustrating an example of providing an execution object according to a user input in an electronic device according to one embodiment.

[0183] Referring to FIG. 13A, a processor (e.g., a processor (120) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1) according to an embodiment may display a first user interface (1310) on a display (e.g., a display module (160) of FIG. 1). The third user interface (1310) may include an input field on a home screen. The processor (120) may obtain a first user input (1311) through the input field of the first user interface (1310). The processor (120) may display the obtained first user input (1311) as text and detect a second user input (1313) of swiping the right side of the input field from the outside to the inside. Upon detecting the second user input (1313), the processor (120) may analyze the first user input (1311) and provide a second user interface (1320). The second user interface (1320) may include an input field in which a first user input (1311) is displayed, a plurality of first execution items (1321), and a plurality of second execution items (1323). The plurality of first execution items (1321) may include execution screens (e.g., preview screens) of a plurality of posting applications for processing the first user input (1311). The plurality of second execution items (1323) may include images searched for by the first user input (1311). The searched images may be search images through posting applications (e.g., the target application, the Instagram application (1322)) displayed as a group in the input field.

[0184] Alternatively, the processor (120) may analyze the first user input (1311) upon detecting the second user input (1313) and provide a third user interface (1330). The processor (120) may search the content of the first user input (1311) through various search application groups and then provide search results. The third user interface (1330) may include an input field in which the first user input (1311) is displayed, a plurality of third execution items (1331), and a plurality of fourth execution items (1333). The plurality of third execution items (1331) may include icons of a plurality of posting applications for processing the first user input (1311). The plurality of fourth execution items (1333) may include a plurality of web pages searched for by the first user input (1311). The plurality of web pages may include images searched for through a posting application (e.g., a Twitter application).

[0185] Referring to FIG. 13B, the processor (120) may display a fourth user interface (1340) on the display module (160). The fourth user interface (1340) may include an input field displaying text (e.g., “Seochon”), a plurality of first execution items (1343), and a plurality of second execution items (1345). The plurality of first execution items (1343) may include execution screens (e.g., preview screens) of a plurality of posting applications for processing the text (e.g., “Seochon”). The plurality of second execution items (1345) may include images searched for by the text. Alternatively, the processor (120) may provide a fifth user interface (1350) when a third user input (1341) is detected in the fourth user interface (1340). The third user input (1341) may be an input of swiping a plurality of application icons from bottom to top. In this case, the processor (120) may provide a fifth user interface (1350) including a plurality of application icons and execution items of different types of applications. The fifth user interface (1350) may include an input field displaying text, a plurality of third execution items (1353), and a plurality of fourth execution items (1355). The plurality of third execution items (1353) may include icons of a plurality of web search applications for processing text. The plurality of fourth execution items (1355) may include web pages searched for by text.

[0186] Alternatively, the processor (120) may provide a sixth user interface (1360) when a fourth user input (1351) is detected in the fifth user interface (1360). The fourth user input (1351) may be an input of swiping a plurality of third execution items (1353) from right to left. In this case, the processor (120) may provide a sixth user interface (1360) that changes the target task of the plurality of third execution items (1353). The sixth user interface (1360) may include an input field in which text is displayed, a plurality of third execution items (1361), and a plurality of fifth execution items (1363). The target task of the plurality of third execution items of the fifth user interface (1350) may be a first web search application, and the target task of the plurality of third execution items (1361) of the sixth user interface (1360) may be a second web search application. The plurality of fifth execution items (1363) are web pages searched for text, and may include web pages other than the plurality of fourth execution items.

[0187] Referring to FIG. 13C, the processor (120) may display a seventh user interface (1370) on the display module (160). The seventh user interface (1370) may obtain a user input (1371) through an input field displayed on a home screen. The seventh user interface (1370) may display text (e.g., "Dali") corresponding to the user input (1371). The processor (120) may analyze the user input (1381) entered into the input field and provide an eighth user interface (1380). The eighth user interface (1380) may display the user input (1381) as text in the input field, and may include a first execution item (1383), a second execution item (1385), a third execution item (1387), and a fourth execution item (1389) corresponding to the user input (1381). The first execution item (1383), the second execution item (1385), the third execution item (1387), and the fourth execution item (1389) may be execution objects of an exercise or health application that processes user input (1381). The eighth user interface (1380) may provide a plurality of execution items (1383 to 1389) in the form of pop-ups.

[0188] FIGS. 14A and 14B are diagrams illustrating an example of classifying task types in an electronic device according to one embodiment.

[0189] Referring to FIG. 14A, a processor (e.g., processor (120) of FIG. 1) of an electronic device (e.g., electronic device (101) of FIG. 1) according to an embodiment may provide different UI components (elements) and result screens depending on the task type determined based on the analysis results of text entered in an input field. For example, if the task type is information confirmation, the processor (120) may configure (or generate) a UI component as an information widget or slice.

[0190] When the task type is information confirmation, the processor (120) may determine the UI component as an information widget based on the analysis result of the text (1413) entered in the input field (1411), and provide a first result screen (1410) including a first information widget (14155). Alternatively, when the task type is information confirmation, the processor (120) may determine the UI component as a slice based on the analysis result of the text (1433) entered in the input field (1431), and provide a second result screen (1430) including a plurality of slices (1435, 1437). When the task type is a quick task, the processor (120) may determine the UI component as an interactive widget based on the analysis result of the text (1453) entered in the input field (1451), and provide a third result screen (1450) including a plurality of interactive widgets (1455, 1456, 1457).

[0191] Referring to FIG. 14B, when the task type is a search information and data task, the processor (120) may determine a UI component as a template based on the analysis result of the text (1473) entered in the input field (1471), and provide a fourth result screen (1470) including a plurality of template items (1475, 1477). When the task type is a creation task, the processor (120) may determine a UI component as a task shortcut based on the analysis result of the text (1493) entered in the input field (1491), and provide a fifth result screen (1490) including a plurality of shortcut items (1495, 1497, 1499).

[0192] FIGS. 15A and 15B are diagrams illustrating an example of analyzing an image and providing an execution object in an electronic device according to one embodiment.

[0193] Referring to FIG. 15A, a processor (e.g., processor (120) of FIG. 1) of an electronic device (e.g., electronic device (101) of FIG. 1) according to an embodiment of the present invention may provide an execution object by triggering an action of capturing an image (e.g., a photo of a Daejeon cafe) in addition to text input through a keypad and user voice according to a user's multimodal input method. The processor (120) may provide a first user interface (1510) including a captured image (1511). The processor (120) may extract text (1512, 1515) related to the image from the image (1511). For example, the text (1512, 1515) may include metadata within the image (1511), text extracted using OCR, or text collectible within the electronic device (101) related to the image (1511) (e.g., object names within the image, internet search history, conversations shared regarding the image). The processor (120) may analyze the extracted text using on-device AI or a server. For example, the screen for extracting and analyzing the text (1512, 1515) related to the image (1511) may be the same as the second user interface (1530).

[0194] The processor (120) can analyze text and images from a captured image (1511) or a stored image that the user inputs as input. For example, the processor (120) can recognize the content as recommending a Daejeon cafe, and can interpret the extracted text (1512, 1515) as a place, recommended content, and content that is meaningful to the user because it was captured. Accordingly, the processor (120) can be connected to a map application that is connected to the text (1512, 1515) included in the content, i.e., the place, and can provide an execution object to enable the performance of consecutive tasks, such as moving to an itinerary that leads to a trip after saving the map.

[0195] The processor (120) may suggest an appropriate action based on the text analysis result (e.g., a list of Daejeon cafes) and provide an execution object (1533). When a user input (1531) for selecting an execution object (1533) is detected in the second user interface (1530), the processor (120) may provide related, continuous additional actions based on the execution result of the selected execution object (1533). For example, the processor (120) may provide a third user interface (1550). The third user interface (1550) may provide a first additional action (1551), a second additional action (1553), a third additional action (1555), and a fourth additional action (1556) based on the execution result of the selected execution object (1533).

[0196] The first additional action (1551), the second additional action (1553), and the third additional action (1555) may be an execution result screen showing a list of 10 Daejeon cafes saved on the map, which is a result of executing an execution object (Save the places on map) that saves cafes included in the list of Daejeon cafes on the map. The fourth additional action (1556) may be a suggestion for creating a travel schedule, and may be a sequential suggestion for an action that includes a visit plan for the Daejeon cafes in the travel schedule as an additional action for the Daejeon cafes.

[0197] When a user input (1557) selecting a fourth additional action (1556) is detected in the third user interface (1550), the processor (120) may provide a fourth user interface (1570).

[0198] Referring to FIG. 15B, the fourth user interface (1570) may include a first execution object (1571) and a second execution object (1573). When a user input (1575) selecting Add to calendar is detected in the fourth user interface (1570), the processor (120) may provide a fifth user interface (1590). The fifth user interface (1590) may include a first execution object (1591) and a second execution object (1593).

[0199] FIGS. 16A and 16B are diagrams illustrating an example of providing a preview of a list of applications for processing text in an electronic device according to one embodiment.

[0200] Referring to FIG. 16A, a processor (e.g., a processor (120) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1) according to an embodiment may analyze text using generative artificial intelligence (AI) and provide preview images (1621, 1623, 1625) of a determined application list (1627) for processing text based on the text analysis result. The processor (120) may analyze text using generative AI in a first user interface (1610). The processor (120) may generate a preview image based on the analyzed text and provide a second user interface (1620). The operation of generating preview images using generative AI can construct preview images (1621, 1623, 1625) of executable applications by filtering input text, extracted parameters (1601, 1602, 1603) (or data validity information), search results (1605, 1606, 1607, 1608, 1609) using parameters (1601, 1602, 1603), and view constraints based on priority, without directly executing the specified applications.

[0201] The preview provided in the second user interface (1620) is a preview of applications included in the application list determined based on the text analysis results, and may include, for example, an execution screen (1621) of a message application, an execution screen (1623) of a calendar application, and an execution screen (1625) of an email application. When a user input selecting the execution screen (1621) of the message application is detected, the processor (120) may provide a third user interface (1630). The third user interface (1630) may be an execution screen of the message application.

[0202] The second user interface (1620) may include a view type (1604) of a preview list of determined applications. The view type (1604) may be provided in the form of a grid type or a list type, and when a user input for selecting the view type (1604) is received, the view type (1604) may be changed.

[0203] Referring to FIG. 16b, the generative AI (1650) may include a prompt generation unit (1660) and a preview generation unit (1670). The prompt generation unit (1660) extracts parameters (1661) (e.g., main keywords, data validity information) from text entered through an input field, searches for on-device data related to the parameters using the extracted parameters, generates search results (1663), provides the search results (1663) to all applications included in the list of applications installed in the electronic device (101) (e.g., App list (1665)), and provides a preview to the preview generation unit (1670) based on view constraints (1667) (e.g., priority of usage pattern history, number of specified views, etc.). The App list (1665) included in the prompt generation unit (1660) may include applications installed (local) in the electronic device (101) and applications executable via a server (remote). The preview generation unit (1670) may configure a preview of executable applications.

[0204] According to one embodiment of the present disclosure, a method of operating an electronic device includes an operation of displaying an input field in response to a first user input calling an input field, an operation of acquiring a second user input inputted into the input field, an operation of displaying the acquired second user input as text in the input field, and an operation of analyzing the content of the text and controlling at least one execution item for processing the analyzed content to be displayed together with at least a part of the text through a display of the electronic device, wherein the at least one execution item may include at least one of an execution object of an application, an execution object providing a function within an application, an execution preview based on generative artificial intelligence (AI), or a setting object of the electronic device.

[0205] The above controlling operation may include an operation of extracting parameters from the text, an operation of generating search results using the extracted parameters, an operation of determining an application list by a view constraint filter, an operation of generating an execution preview of an application included in the application list, and an operation of providing the generated execution preview.

[0206] The method may further include an operation of analyzing a user intent based on real-time updating of text entered in the input field, and an operation of adding or changing at least one action item displayed on the display in response to the analyzed user intent.

[0207] The method may further include an action of changing the target task to a second execution item based on a third user input within the plurality of execution items when a first execution item is set as a target task among the plurality of execution items.

[0208] The method may further include an action of transmitting the text as an input to an application of an execution item selected by a user from at least one of the execution items, and an action of displaying an execution screen of an application that has processed the transmitted text on the display in response to selection of the execution item.

[0209] The method may further include an action of transmitting the text as an input to settings or user personal information of an electronic device corresponding to an execution item selected by a user from the at least one execution item, and an action of displaying a settings screen of the electronic device that has processed the transmitted text or user personal information on the display in response to selection of the execution item.

[0210] The method may further include analyzing the at least one execution item and displaying an action object of the application for the user's additional settings for the at least one execution item.

[0211] The method may further include converting speech of at least one execution item into text, analyzing the converted text to extract data validity information, and displaying an action object of an application for a user to make additional settings for the at least one execution item based on the data validity information.

[0212] The method may further include an operation of collecting data stored in a memory of the electronic device and an application installed in the electronic device based on the content of the acquired text, and an operation of analyzing the collected data and providing analysis result information as at least one execution item.

[0213] The above method may further include an operation of composing a response corresponding to the content of the acquired text by linking with an external server and providing it as at least one execution item.

[0214] The method may further include an action of searching for data on the Internet based on the content of the acquired text, and an action of providing the searched data as Internet result information as at least one execution item.

[0215] The method may further include an action of selecting an image captured by the second user input, and an action of obtaining and displaying text from the selected captured image.

[0216] The various embodiments of the present invention disclosed in this specification and drawings are merely specific examples presented to facilitate easy explanation of the technical content of the present invention and aid understanding thereof, and are not intended to limit the scope of the present invention. Therefore, the scope of the present invention should be interpreted to include all modifications or variations derived based on the technical concept of the present invention, in addition to the embodiments disclosed herein.

Claims

1. In an electronic device (101), display (160); Memory (130) for storing instructions; and Contains a processor (120), The instructions stored in the above memory, when executed by the processor, cause the electronic device to: Display an input field in response to a first user input that calls the input field; Obtain the second user input entered into the above input field, Display the second user input obtained above as text in the above input field, Controlling the display to display at least one execution item for analyzing the content of the text and processing the analyzed content together with at least a part of the text; At least one of the above execution items is: An electronic device comprising at least one of an execution object of an application, an execution object providing a function within the application, an execution preview based on generative artificial intelligence, or a settings object of the electronic device.

2. In the first paragraph, when the instructions are executed by the processor, the electronic device, Extract parameters from the above text, Generate search results using the above extracted parameters, Determine the application list by view constraint filter, Generate an execution preview of the applications included in the above application list, An electronic device providing a preview of the above generated execution.

3. In the first paragraph, when the instructions are executed by the processor, the electronic device, Analyze user intent based on real-time updates of text entered in the input field above, An electronic device that adds or changes at least one action item displayed on the display in response to the analyzed user intent.

4. In the first paragraph, when the instructions are executed by the processor, the electronic device, An electronic device that changes the target task to a second execution item based on a third user input within a plurality of execution items when a first execution item among the plurality of execution items is set as the target task.

5. In the first paragraph, when the instructions are executed by the processor, the electronic device, Passing the text as input to the application of the execution item selected by the user from at least one of the above execution items, An electronic device that, in response to selection of the above execution item, causes the execution screen of the application that processed the transmitted text to be displayed on the display.

6. In the first paragraph, the instructions, when executed by the processor, cause the electronic device to: Transmitting said text as input to the settings of the electronic device or user personal information corresponding to the action item selected by the user from at least one of said action items, An electronic device that, in response to selection of the above execution item, causes the electronic device to display the settings screen of the electronic device that processed the transmitted text or the user's personal information on the display.

7. In the first paragraph, the instructions, when executed by the processor, cause the electronic device to: An electronic device that analyzes at least one of the above execution items and displays an action object of an application for the user's additional settings for the at least one execution item.

8. In the first paragraph, the instructions, when executed by the processor, cause the electronic device to: Converting the speech of at least one of the above execution items into text, Analyze the above converted text to extract valid data information, An electronic device that displays an action object of an application for the user to further configure at least one of the execution items based on the above data validity information.

9. In the first paragraph, the instructions, when executed by the processor, cause the electronic device to: Collecting data stored in the memory of the electronic device and the application installed on the electronic device based on the content of the text obtained above, An electronic device that analyzes the collected data and provides analysis result information as at least one action item.

10. In the first paragraph, the instructions, when executed by the processor, cause the electronic device to: An electronic device that links with an external server to compose a response corresponding to the content of the acquired text and provides it as at least one execution item.

11. In the first paragraph, the instructions, when executed by the processor, cause the electronic device to: Search for data on the Internet based on the content of the text obtained above, An electronic device that provides the searched data as Internet result information with at least one execution item.

12. In the first paragraph, the instructions, when executed by the processor, cause the electronic device to: Select the image captured by the second user input above, An electronic device for obtaining and displaying text from the selected captured image.

13. In the operating method of an electronic device (101), An action to display an input field in response to a first user input that invokes the input field; An action to obtain a second user input entered into the above input field; An action of displaying the acquired second user input as text in the input field; and An action is included to analyze the content of the text and control at least one execution item for processing the analyzed content to be displayed together with at least a part of the text through the display of the electronic device. At least one of the above execution items is: A method comprising at least one of an execution object of an application, an execution object providing a function within the application, an execution preview based on generative artificial intelligence, or a settings object of the electronic device.

14. In the 13th paragraph, the controlling operation is: An action to extract parameters from the above text; An action of generating search results using the above extracted parameters; The action of determining the list of applications by a view constraint filter; An action to generate an execution preview of an application included in the above application list; and A method comprising an action providing a preview of the execution generated above.

15. In paragraph 13, An action to analyze user intent based on real-time updates of text entered into the above input field; and A method further comprising an action of adding or changing at least one action item displayed on the display in response to the analyzed user intent.

Images