Electronic device, method, and non-transitory computer-readable storage medium for determining linked function on basis of context information

Abstract

This electronic device may comprise: a display; a memory storing instructions; and at least one processor including processing circuitry. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: on the basis of execution of a message application, display a screen including a message through the display; determine a linked application corresponding to the message by providing, to an application determination model in the electronic device, context information generated on the basis of at least one message in the message application and application use information of the electronic device; identify, from the at least one message, a keyword to be used in the linked application by providing information of the linked application and the context information to a keyword extraction model in the electronic device; display, through the display, a visual object corresponding to the linked application on the screen; and in response to a user input to the visual object, execute the linked application using the keyword.

Description

Electronic device, method, and non-transitory computer-readable storage medium for determining a linking function based on context information

[0001] The present disclosure relates to an electronic device, a method, and a non-transitory computer-readable storage medium for determining a linking function based on context information.

[0002] Recently, the proliferation of various types of electronic devices, such as smartphones, tablet PCs, wireless earphones, head-mounted devices (HMDs), and / or smartwatches, has increased. These electronic devices may include displays. These displays can display visual objects. These visual objects can correspond to the execution of applications.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0004] An electronic device is provided. The electronic device may include a display. The electronic device may include a memory comprising one or more storage media for storing instructions. The electronic device may include at least one processor comprising processing circuitry. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a screen including a message through the display based on the execution of a message application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine an associated application corresponding to the message by providing context information generated based on at least one message in a message application and application usage information of the electronic device to an application determination model within the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify at least one keyword to be used in the associated application in the at least one message by providing information of the associated application and the context information to a keyword extraction model within the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a visual object corresponding to the associated application on a screen through the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to execute the associated application using the at least one keyword in response to a user input with respect to the associated visual object.

[0005] A method is provided. The method can be performed in an electronic device having a display. The method can include an operation of displaying a screen including a message through the display based on the execution of a message application. The method can include an operation of determining an associated application corresponding to the message by providing context information generated based on at least one message in a message application and application usage information of the electronic device to an application determination model within the electronic device. The method can include an operation of identifying at least one keyword to be used in the associated application in the at least one message by providing information on the associated application and the context information to a keyword extraction model within the electronic device. The method can include an operation of displaying a visual object corresponding to the associated application on a screen through the display. The method can include an operation of executing the associated application using the at least one keyword in response to a user input for the visual object.

[0006] A non-transitory computer-readable storage medium is provided. The non-transitory computer-readable storage medium may store one or more programs. The one or more programs may include instructions that, when executed by an electronic device having a display, cause the electronic device to display a screen including a message through the display based on the execution of a message application. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to determine an associated application corresponding to the message by providing context information generated based on at least one message in a previous message application and application usage information of the electronic device to an application determination model within the electronic device. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to identify at least one keyword to be used in the associated application from the at least one message by providing information on a previous associated application and the context information to a keyword extraction model within the electronic device. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to display a visual object corresponding to the linked application on the screen through the display. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to execute the linked application using the at least one keyword in response to a user input for the visual object.

[0007] FIG. 1 illustrates an example of an electronic device including modules for determining a linking function based on context information.

[0008] Figure 2 is a simplified block diagram of an exemplary electronic device.

[0009] FIG. 3 illustrates an example of an electronic device that displays a visual object corresponding to a linked function while displaying a lock screen.

[0010] FIG. 4 illustrates an example of an electronic device that displays a visual object corresponding to a linked function while displaying a notification screen.

[0011] FIG. 5 illustrates an example of an electronic device that performs a screen capture function while displaying a visual object corresponding to a linked function.

[0012] FIG. 6 illustrates an example of an electronic device displaying a visual object corresponding to a linking function in a messaging application.

[0013] FIG. 7 illustrates an example of an electronic device that refrain from displaying visual objects corresponding to linked functions in a messaging application.

[0014] FIG. 8 illustrates an example of the operation of an electronic device displaying a visual object while refraining from displaying a visual object corresponding to a linking function in a messaging application.

[0015] Figure 9 illustrates an example of an electronic device that executes a linkage function.

[0016] Figure 10 illustrates an example of the operations of an electronic device running a linked application in a messaging application.

[0017] FIG. 11 illustrates an example of an electronic device that displays a visual object corresponding to a linking function while performing a text copy function.

[0018] Fig. 12 illustrates an example of a foldable type electronic device that displays a visual object corresponding to a linking function.

[0019] FIG. 13 illustrates an example of an electronic device displaying visual objects corresponding to linked functions in a multi-window.

[0020] FIG. 14 illustrates an example of a wearable electronic device that displays visual objects corresponding to linked functions.

[0021] FIG. 15 is a block diagram of an electronic device within a network environment (1500) according to various embodiments.

[0022] It will be understood that like reference numerals throughout the drawings refer to like parts, components, and structures.

[0023] The terms used in this disclosure are used only to describe specific embodiments and may not be intended to limit the scope of other embodiments. The singular expression may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by those of ordinary skill in the art described in this disclosure. Terms defined in general dictionaries among the terms used in this disclosure may be interpreted as having the same or similar meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined in this disclosure. In some cases, even if a term is defined in this disclosure, it cannot be interpreted to exclude embodiments of the present disclosure.

[0024] The various embodiments of the present disclosure described below illustrate a hardware-based approach as an example. However, since the various embodiments of the present disclosure include techniques utilizing both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

[0025] In the following description, terms referring to data (e.g., data, information, data set, context information, keyword, user preference information, application usage information, information of associated application), terms referring to input (e.g., input, user input, tap input, double-tap input, swipe input, scroll input, drag-and-drop input), terms referring to objects (e.g., visual object, executable object), terms referring to instructions (e.g., instruction, program, algorithm, application, function, associated application, associated function), terms referring to network entities, terms referring to components of a device, etc. are examples for convenience of explanation. Therefore, the present disclosure is not limited to the terms described below, and other terms having equivalent technical meanings may be used. In addition, terms such as '... part', '... device', '... object', '... body', etc. used below may mean at least one shape structure or a unit that processes a function.

[0026] In addition, in the present disclosure, expressions such as "more than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled, but this is merely a description for expressing an example and does not exclude descriptions such as "more than" or "less than." A condition described as "more than" may be replaced with "more than," a condition described as "less than" may be replaced with "less than," and a condition described as "more than and less than" may be replaced with "more than and less than." In addition, hereinafter, "A" to "B" mean at least one of elements from A (including A) to B (including B). hereinafter, "C" and / or "D" mean at least one of "C" or "D," that is, including {"C", "D", "C" and "D"}.

[0027] An electronic device (e.g., the electronic device 101 of FIG. 1) can execute various functions. The electronic device can execute the functions in response to user input. According to one embodiment, the electronic device can display a visual object corresponding to at least one executable second function after executing a first function. The at least one second function of the electronic device can be a designated function. For example, the at least one second function can be a function designated according to the first function. The at least one second function can be different from a function desired by a user of the electronic device. The user of the electronic device can input user inputs to the electronic device to execute a desired function on the electronic device. The user of the electronic device can feel increased inconvenience as the number of user inputs required to execute a desired function on the electronic device increases. To reduce the inconvenience experienced by the user of the electronic device, a method for providing an associated function based on context information in an electronic device can be described in the present disclosure.

[0028] In the present disclosure, a technology may be described in which an electronic device (e.g., the electronic device (101) of FIG. 1) determines and provides an associated function based on context information. The associated function may be described as a function expected to be performed by a user on the electronic device based on context. The associated function may be referred to by terms such as candidate function, suggested function, expected function, and associated application. According to embodiments of the present disclosure, an electronic device may provide a user with a function that the user wants to execute on the electronic device by providing the associated function. A method for an electronic device to provide an associated function based on context information is described and exemplified in more detail with reference to drawings (e.g., FIGS. 1 to 15) of the present disclosure.

[0029] FIG. 1 illustrates an example of an electronic device (101) including modules for determining a linking function based on context information.

[0030] Referring to FIG. 1, the electronic device (101) may include a context information recognition module (111), a linked function management module (113), a linked function determination module (115), a user preference information storage (117), a keyword extraction module (119), and a data set storage. The context information recognition module (111), the linked function management module (113), the linked function determination module (115), and the keyword extraction module (119) may determine a linked function based on context information through an algorithm (or instructions) stored in a memory (e.g., the memory (220) of FIG. 2). The context information may be referred to as background information or summary information.

[0031] The context information recognition module (111) can recognize a context occurring in the electronic device (101). The context information recognition module (111) can generate context information. The context information recognition module (111) may be referred to as a context aware module. The context information recognition module may be referred to as a context information generation module. The context information recognition module (111) can generate context information based on data (e.g., text, image, video) provided from a function (e.g., a set of instructions, an application, a program, a service, an API) executing in the electronic device (101). For example, the context information recognition module (111) can generate context information based on text and / or images included in a notification of an application of the electronic device (101). For example, the context information recognition module (111) can generate context information based on a message in a message application. For example, the context information recognition module (111) can generate context information based on a captured image in the electronic device (101). For example, the context information recognition module (111) can identify text within an image by applying an optical character recognition (OCR) function to the image. The context information recognition module (111) can generate context information based on the identified text. For example, the context information recognition module can generate context information using an artificial intelligence model (e.g., a large language model, a large vision model). The electronic device (101) can provide context information to the linked function management module (113) using the context information recognition module (111).

[0032] The linked function management module (113) can manage the operation of the function determination module (115) and the operation of the keyword extraction module (119). The linked function management module (113) can be referred to as a manager. The linked function management module (113) can receive context information from the context information recognition module (111). The electronic device (101) can provide context information to the linked function determination module (115) using the linked function management module (113). The linked function management module (113) can receive information on the linked function from the linked function determination module (115). The electronic device (101) can provide context information and information on the linked function to the keyword extraction module (119) using the linked function management module (113). The linked function management module (113) can receive a keyword corresponding to the linked function from the keyword extraction module (119). The electronic device (101) can store context information, information on linked functions, and keywords in a data set storage (121) using a linked function management module (113). The electronic device (101) can store a data set in the data set storage (121) based on the context information, information on linked functions, and keywords. The linked function management module (113) can use the data set stored in the data set storage (121).

[0033] The linked function determination module (115) can receive context information from the linked function management module (113). The linked function determination module (115) may be referred to as an action n planner. The linked function determination module (115) can utilize user preference information in the user preference information storage (117). The electronic device (101) can determine a linked function corresponding to the context information based on the context information and the user preference information by using the linked function determination module (115). The linked function determination module (115) can determine a linked function corresponding to the context information based on performing natural language processing on the context information and the user preference information. For example, the linked function determination module (115) may include a function determination model. The function determination model may be referred to as an application determination model. For example, the function determination model may be implemented in the form of a multi-model composed of a plurality of models. For example, the function determination model may include a large vision model (LVM). For example, a feature decision model may include a multi-modal model.

[0034] In one embodiment, the feature decision model may include a large language model (LLM). A large language model may be referred to as a language model comprised of an artificial neural network pre-trained on a large amount of text data. A large language model may include more than ten times as many parameters (e.g., more than 100 billion parameters) as a conventional general language model. The large language model may use a transformer artificial neural network structure based on an attention mechanism. An attention mechanism is a technology that helps an artificial intelligence model focus on important parts within input data. The attention mechanism may be used to predict output data by predicting the degree to which at least a portion of time-series input data (e.g., input data such as voice or video, or input data of some layers of a neural network) contributes to the intermediate or final output of the neural network. The recurrent neural network (RNN) structure, which sequentially processes each element of a sequence, has poor prediction performance when there is information dependency between long time series distances, but the attention mechanism can consider information dependency between long time series distances by controlling the degree of weight concentration within the overall (or partial) context of the input data.

[0035] A large language model, or transformer, may include an encoder-decoder structure. The encoder processes input data and outputs compressed information (e.g., an attention mechanism), and the decoder processes the compressed information and outputs token-based data. The encoder and decoder may each include an independent attention network, or a cross-attention network connecting the encoder and decoder.

[0036] Large-scale language models can be trained in two stages: pre-training and fine-tuning. Pre-training involves training a large-scale language model to process massive amounts of text data and acquire general linguistic knowledge. For example, this could involve self-supervised learning, where the model predicts the next word using a sequence of previous words in a text sequence. Fine-tuning involves training a large-scale language model to fit a specific domain (e.g., chatbot, translation, summarization, Q&A) or task. Based on the pre-trained model, additional supervised learning (or adaptive learning) can be performed using a dataset tailored to the domain's purpose. Large-scale language models can perform tasks with text inputs containing natural language, called prompts. For example, large-scale language models can include BERT (bidirectional encoder representations from transformer) and GPT (generative pre-trained transformer). The term 'LLM (Large Language Model)' can refer to the neural network model itself, but can also mean the model of an LLM-based application (e.g., chatbot, translation, summarization, text classification, sentence generation). For example, an LLM-based chatbot such as chatGPT can also be referred to as an LLM. 'LLM' can also include an inference engine that uses the LLM neural network model. For example, "inputting an input prompt into an LLM" can be referred to as "inputting an input prompt into an inference engine based on an LLM." A large language model can be referred to as a large language model, and an LLM (large language model). For example, a large language model can perform natural language processing.For example, large language models can perform natural language understanding.

[0037] The electronic device (101) can determine a linked function by providing context information and user preference information to a function determination model within the linked function determination module (115). The linked function can be described as a candidate function expected to be performed by a user in the electronic device (101) based on the context. The linked function can be presented as a personalized function to the user based on user preference information. The linked function can be referred to by terms such as candidate function, suggested function, expected function, and linked application. The electronic device (101) can transmit information on the linked function to the linked function management module (113) using the linked function determination module (115).

[0038] The user preference information storage (117) can store user preference information. The user preference information storage (117) can be referred to as user preference data. The user preference information storage (117) can be included in the memory (e.g., the memory (220)) of the electronic device (101). The user preference information stored in the user preference information storage (117) can be used by the linked function determination module (115). The electronic device (101) can determine a user-customized linked function by using the user preference information in the linked function determination module (115). The user preference information can include relationship information between functions of the electronic device (101). For example, the relationship information between functions of the electronic device (101) can include order information of functions executed by the user on the electronic device (101). For example, the relationship information between functions of the electronic device (101) can indicate the execution frequency of a first function, a second function, and a second function following the first function. User preference information may include application usage information of the electronic device (101). The application usage information of the electronic device (101) may include usage frequency information of an application within the electronic device (101). The application usage information of the electronic device (101) may include usage time information of an application within the electronic device (101). The application usage information of the electronic device (101) may include relationship information of an application of the electronic device (101). The relationship information of an application may include information of an application executed by a user after executing a specific function (or a specific application) on the electronic device (101).

[0039] The keyword extraction module (119) can receive information and context information of the linked function from the linked function management module (113). The electronic device (101) can identify a keyword using the keyword extraction module (119). The keyword extraction module (119) can identify a keyword based on information and context information of the linked function. The keyword extraction module (119) can be referred to as a keyword extractor. A keyword can be described as information required for a linked function. A keyword can be represented as information used when executing a linked function in the electronic device (101). The keyword extraction module (119) can extract a keyword within context information. The keyword extraction module (119) can include a keyword extraction model. The electronic device (101) can identify or obtain a keyword by providing information and context information of the linked function to the keyword extraction model within the keyword extraction module (119). For example, if the context information includes the content of a hotel reservation, the associated function may be a phone application, and the keyword may be the hotel's phone number within the context information. For example, if the context information includes the content of a hotel reservation, the associated function may be a calendar application, and the keyword may be the check-in date within the context information. The keyword extraction model may be implemented in the form of a multi-model composed of multiple models. For example, the keyword extraction model may include a large vision model (LVM). For example, the keyword extraction model may include a multi-modal model. For example, the keyword extraction model may include a large language model (LLM). The electronic device (101) may transmit keywords to the associated function management module (113) using the keyword extraction module (119).

[0040] The data set storage (121) can store a data set generated based on context information, information on linked functions, and keywords. The data set can be described as data in which context information, information on linked functions, and keywords are combined. The data set storage (121) can be included in a memory (e.g., memory (220)) of the electronic device (101). The data set storage (121) can be referred to as suggestion list data. The electronic device (101) can store a data set in the data set storage (121) using the linked function management module (113). The linked function management module (113) can use the data set stored in the data set storage (121). The electronic device (101) can use the data set stored in the data set storage (121). When executing a linked function, the electronic device (101) can use the data set.

[0041] Figure 2 is a simplified block diagram of an exemplary electronic device (101).

[0042] Referring to FIG. 2, an electronic device (101) (e.g., the electronic device (101) of FIG. 1, the electronic device (1501) of FIG. 15) may include at least one processor (200), a display (210), and a memory (220). The electronic device (101) may be one of various forms of mobile devices, such as smartphones having various form factors (e.g., a bar-type smartphone, a foldable-type smartphone, or a rollable-type smartphone), tablets, cellular phones, wearable devices, head-mounted devices (HMDs), virtual reality (VR) glasses, augmented reality (AR) glasses, smart watches, and other similar computing devices. The electronic device (101) may be referred to as a user device, a multi-function device, or a portable device.

[0043] At least one processor (200) may include a hardware component for processing data based on executing instructions. The hardware component for processing data may include, for example, a central processing unit (CPU) (e.g., including processing circuitry). For example, the hardware component for processing data may include a graphic processing unit (GPU) (e.g., including processing circuitry). For example, the hardware component for processing data may include a display processing unit (DPU) (e.g., including processing circuitry). For example, the hardware component for processing data may include a neural processing unit (NPU) (e.g., including processing circuitry). At least one processor (200) may include one or more cores. For example, at least one processor (200) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core.

[0044] The display (210) may include hardware components of the electronic device (101) used to display an image. For example, the display (210) may include light-emitting elements and circuits (e.g., transistors) that control the light-emitting elements to emit light. For example, each of the light-emitting elements may include an organic light emitting diode (OLED) or a micro LED. However, the present invention is not limited thereto. For example, the display (210) may include a liquid crystal display (LCD). For example, the display (210) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0045] The memory (220) may include a hardware component for storing data and / or instructions input to and / or output from at least one processor (200). The memory (220) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disc, and embedded multimedia card (EMMC).

[0046] The electronic device (101) can utilize the context information recognition module (111), the linked function management module (113), the linked function determination module (115), and the keyword extraction module (119) of FIG. 1 through algorithms (or instructions) stored in the memory (220). The memory (220) can include the user preference information storage (117) and the data set storage (121) of FIG. 1.

[0047] The electronic device (101) illustrated in the description of FIG. 2 can execute at least some of the operations illustrated in the description of FIGS. 3 to 14. The operations illustrated in the description of FIGS. 3 to 14 can be performed, executed, or caused by (or within) the electronic device (101) under the control of at least one processor (200).

[0048] FIG. 3 illustrates an example of an electronic device (101) displaying a visual object corresponding to an associated function while displaying a lock screen.

[0049] Referring to FIG. 3, the electronic device (101) may display a lock screen through the display (210). The lock screen may include notifications (e.g., notifications (310) and (320)) of an application of the electronic device (101). For example, the notifications of the application may include at least a portion of a message of a messaging application. For example, the notifications of the application may include a summary of a message of a messaging application. For example, the notifications of the application may include a missed call notification of a calling application. However, the present invention is not limited thereto.

[0050] The electronic device (101) can perform the operations illustrated in FIG. 1 based on a notification of an application (e.g., notification (310), notification (320)). The electronic device (101) can generate context information based on the notification of the application by using a context information recognition module (e.g., context information recognition module (111)). For example, the context information can be represented as notification information of an application for which preprocessing has been performed. The electronic device (101) can determine a linked function by using a linked function determination module (e.g., linked function determination module (115)). The electronic device (101) can identify a keyword by using a keyword extraction module (e.g., keyword extraction module (119)). The electronic device (101) can store a data set in a data set storage (e.g., data set storage (121)) by using a linked function management module (e.g., linked function management module (113)). The data set can be generated based on context information, information on linked functions, and keywords.

[0051] The electronic device (101) may display a lock screen including a visual object corresponding to a linked function on the display (210) based on receiving a specified input while displaying the lock screen.

[0052] According to one embodiment, the electronic device (101) may reduce the size of the notification (310) and display a pop-up window (340) through the display (210) based on receiving an input (330) on the notification (310) of the application. The input (330) may be represented as an input in which a contact point on the display (210) moves from one point to a different point. For example, the input (330) may include a swipe (or scroll). For example, the input (330) may include a swipe right and a swipe left. The pop-up window (340) may include a visual object (350). The visual object (350) may correspond to a linked function (or linked application). For example, a first visual object (350-1) may correspond to a first linked function. The electronic device (101) may execute a first linked function in response to receiving a specified user input (e.g., a tap input) on the first visual object (350-1). For example, the electronic device (101) may execute an application of the electronic device (101) by executing the first linked function. For example, the second visual object (350-2) may correspond to the second linked function. The electronic device (101) may execute the second linked function in response to receiving a specified user input (e.g., a tap input) on the second visual object (350-2).

[0053] According to one embodiment, the electronic device (101) may display a pop-up window (341) through the display (210) based on receiving an input (331) on a notification (310) of an application. The input (331) may be represented as an input in which a contact point on the display (210) moves from one point to a different point in a direction perpendicular to the input (330). For example, the input (331) may include a swipe (or scroll). For example, the input (331) may include a swipe up and a swipe down. The pop-up window (341) may correspond to the notification (310) and the pop-up window (340). The pop-up window (341) may include a visual object (350). The electronic device (101) may execute a first associated function in response to receiving a designated user input (e.g., a tap input) on the first visual object (350-1). The electronic device (101) may execute a second linked function in response to receiving a designated user input (e.g., a tap input) on the second visual object (350-2).

[0054] FIG. 4 illustrates an example of an electronic device (101) that displays a visual object corresponding to an associated function while displaying a notification screen.

[0055] Referring to FIG. 4, the electronic device (101) can display a notification screen through the display (210). While displaying a screen (e.g., a home screen, a menu screen), the electronic device (101) can display the notification screen through the display (210) based on receiving a slide-down input (or swipe-down input) for the top bar within the screen. The notification screen can include a notification of an application of the electronic device (101) (e.g., notification (410), notification (420)). For example, the notification of the application can include at least a portion of a message of a message application. For example, the notification of the application can include a summary of a message of a message application. For example, the notification of the application can include a schedule notification of a calendar application. However, the present invention is not limited thereto.

[0056] The electronic device (101) can perform the operations illustrated in FIG. 1 based on a notification of an application (e.g., notification (410), notification (420)). The electronic device (101) can generate context information based on the notification of the application by using a context information recognition module (e.g., context information recognition module (111)). For example, the context information can be represented as notification information of an application for which preprocessing has been performed. The electronic device (101) can determine a linked function by using a linked function determination module (e.g., linked function determination module (115)). The electronic device (101) can identify a keyword by using a keyword extraction module (e.g., keyword extraction module (119)). The electronic device (101) can store a data set in a data set storage (e.g., data set storage (121)) by using a linked function management module (e.g., linked function management module (113)). The data set can be generated based on context information, information on linked functions, and keywords.

[0057] The electronic device (101) may display a notification screen including a visual object corresponding to a linked function on the display (210) based on receiving a specified input while displaying the notification screen.

[0058] According to one embodiment, the electronic device (101) may reduce the size of the notification (410) and display a pop-up window (440) through the display (210) based on receiving an input (430) on the notification (410) of the application. The input (430) may correspond to the input (330) of FIG. 3 . The input (430) may be represented as an input in which a contact point on the display (210) moves from one point to a different point. For example, the input (430) may include a swipe (or scroll). For example, the input (430) may include a swipe right and a swipe left. The pop-up window (440) may include a visual object (450). The visual object (450) may correspond to a linked function (or linked application). For example, a first visual object (450-1) may correspond to a first linked function. The electronic device (101) may execute a first linked function in response to receiving a specified user input (e.g., a tap input) on the first visual object (450-1). For example, the electronic device (101) may execute an application of the electronic device (101) by executing the first linked function. For example, the second visual object (450-2) may correspond to the second linked function. The electronic device (101) may execute the second linked function in response to receiving a specified user input (e.g., a tap input) on the second visual object (450-2).

[0059] According to one embodiment, the electronic device (101) may display a pop-up window (441) through the display (210) based on receiving an input (431) on a notification (410) of an application. The input (431) may correspond to the input (331) of FIG. 3. The input (431) may be represented as an input in which a contact point on the display (210) moves from one point to a different point in a direction perpendicular to the input (430). For example, the input (431) may include a swipe (or scroll). For example, the input (431) may include a swipe up and a swipe down. The pop-up window (441) may correspond to the notification (410) and the pop-up window (440). The pop-up window (441) may include a visual object (450). The electronic device (101) may execute a first linked function in response to receiving a specified user input (e.g., a tap input) on a first visual object (450-1). The electronic device (101) may execute a second linked function in response to receiving a specified user input (e.g., a tap input) on a second visual object (450-2).

[0060] FIG. 5 illustrates an example of an electronic device (101) that displays a visual object corresponding to an associated function while performing a screen capture function.

[0061] Referring to FIG. 5, a state (500) may be represented as a state in which the electronic device (101) performs a screen capture function. The electronic device (101) may perform the operations illustrated in FIG. 1 based on a captured image. The electronic device (101) may generate context information based on the captured image using a context information recognition module (e.g., a context information recognition module (111)). For example, the context information may be generated by performing preprocessing on the captured image. The electronic device (101) may determine a linked function using a linked function determination module (e.g., a linked function determination module (115)). The linked function may be generated based on context information and user preference information. The electronic device (101) may identify a keyword using a keyword extraction module (e.g., a keyword extraction module (119)). An electronic device (101) can store a data set in a data set storage (e.g., a data set storage (121)) using a linkage function management module (e.g., a linkage function management module (113)). The data set can be generated based on context information, information on linkage functions, and keywords.

[0062] The electronic device (101) may display a pop-up window (e.g., a pop-up window (510), a pop-up window (520)) through the display (210) based on performing a screen capture function in a state (500). The pop-up window may include a visual object. The visual object may correspond to a linked function. The visual object within the pop-up window may vary depending on user preference information, even though the context information is the same.

[0063] According to one embodiment, the electronic device (101) may display a pop-up window (510) through the display (210) based on first user preference information. The first user preference information may include information indicating that a message application is frequently executed after a screen capture function is performed on the electronic device (101). The first user preference information may include information on the time at which the message application is used on the electronic device (101). The first user preference information may include information indicating that a social network service (SNS) application is frequently executed after a screen capture function is performed on the electronic device (101). The electronic device (101) may display a pop-up window (510) including a visual object corresponding to the message application and a visual object corresponding to the SNS application through the display (210) based on the first user preference information. As a non-limiting example, the electronic device (101) may include a visual object corresponding to an editing function of a captured image and a visual object corresponding to a sharing function of a captured image.

[0064] According to one embodiment, the electronic device (101) may display a pop-up window (520) through the display (210) based on second user preference information. The second user preference information may include information indicating that the frequency of executing the diary application after the screen capture function is performed on the electronic device (101) is high. The second user preference information may include information indicating that the execution time of the diary application on the electronic device (101) is high. The electronic device (101) may display a pop-up window (520) including a visual object corresponding to the diary application through the display (210) based on the second user preference information. As a non-limiting example, the electronic device (101) may include a visual object corresponding to an editing function of a captured image and a visual object corresponding to a sharing function of a captured image.

[0065] The electronic device (101) can determine different link functions based on user preference information, even when context information is the same. In other words, the electronic device (101) can determine a link function customized for the user. The electronic device (101) can provide the user with a customized link function. By providing the user with a customized link function, the user experience of the electronic device (101) can be enhanced.

[0066] FIG. 6 illustrates an example of an electronic device (101) that displays a visual object corresponding to an associated function in a messaging application.

[0067] Referring to FIG. 6, state (601) may be represented as a state in which the electronic device (101) executes a message application. In state (601), the electronic device (101) may display a message (610) through the display (210).

[0068] In state (601), the electronic device (101) can perform the operations illustrated in FIG. 1 based on at least one message (e.g., message (610)) of the message application. The electronic device (101) can generate context information based on at least one message (e.g., message (610)) of the message application using a context information recognition module (e.g., context information recognition module (111)). For example, the context information can be represented as text in at least one message (e.g., message (610)) of the message application on which preprocessing has been performed. The electronic device (101) can determine a linked function (or linked application) using a linked function determination module (e.g., linked function determination module (115)). The electronic device (101) can identify keywords (e.g., keyword (611), keyword (612)) using a keyword extraction module (e.g., keyword extraction module (119)). An electronic device (101) can store a data set in a data set storage (e.g., a data set storage (121)) using a linkage function management module (e.g., a linkage function management module (113)). The data set can be generated based on context information, information on linkage functions, and keywords.

[0069] In one embodiment, the message (610) may include a request for a remittance by a specified date. The electronic device (101) may determine a calendar application and a banking application as associated applications. The electronic device (101) may display visual objects (621) and (622) through the display (210). The electronic device (101) may display visual objects (621) and (622) below the message (610) on the screen. The visual object (621) may correspond to the calendar application. The electronic device (101) may execute a calendar application using a keyword (611) (e.g., a specified date) in response to a user input (e.g., a tap input) for the visual object (621). The calendar application using the keyword (611) will be described and exemplified in more detail with reference to FIG. 9. The visual object (622) may correspond to the banking application. The electronic device (101) may execute a banking application using a keyword (612) (e.g., an account number) in response to a user input to the visual object (622). For example, the electronic device (101) may display a banking application user interface displaying the keyword (612) through the display (210) in response to a user input (e.g., a tap input) to the visual object (622).

[0070] State (602) can be represented as a state subsequent to state (601). State (602) can be described as a state subsequent to the electronic device (101) transmitting and receiving a message using a message application in state (601). Message (640) can be represented as a message subsequent to message (610).

[0071] In state (602), the electronic device (101) may perform the operations illustrated in FIG. 1 based on at least one message (e.g., including message (610) and message (640)) of the message application. The electronic device (101) may generate context information based on at least one message (e.g., including message (610) and message (640)) of the message application using a context information recognition module (e.g., context information recognition module (111)). For example, the context information may be represented as text in at least one message (e.g., including message (610) and message (640)) of the preprocessed message application. The electronic device (101) may determine a linked function (or linked application) using a linked function determination module (e.g., linked function determination module (115)). The electronic device (101) may identify a keyword (e.g., keyword (612)) using a keyword extraction module (e.g., keyword extraction module (119)). An electronic device (101) can store a data set in a data set storage (e.g., a data set storage (121)) using a linkage function management module (e.g., a linkage function management module (113)). The data set can be generated based on context information, information on linkage functions, and keywords.

[0072] According to one embodiment, the message (640) may include "Please remit this month's meeting fee to the account I informed you of last time!". The message (640) may include a request for remittance. The electronic device (101) may determine a banking application as a linked function based on context information generated based on at least one message (e.g., including message (610) and message (640)) in the message application. The electronic device (101) may display visual objects (641) and (642) through the display (210). The electronic device (101) may display visual objects (641) and (642) below the message (640) on the screen. The visual object (641) may correspond to a first banking application. The visual object (642) may correspond to a second banking application. For example, the user preference information storage (e.g., the user preference information storage (117)) of the electronic device (101) may include application usage information indicating that the number of executions of the first banking application is greater than the number of executions of the second banking application. For example, the electronic device (101) may display a visual object (641) to the left of a visual object (642) based on the application usage information.

[0073] The message (640) may not include an account number. The electronic device (101) may identify a keyword (e.g., an account number) within context information generated based on at least one message in a message application (e.g., including message (610) and message (640)). For example, the electronic device (101) may identify a keyword (613) (e.g., an account number) within the message (610). The electronic device (101) may display a first banking application user interface on which the keyword (613) is displayed through the display (210) in response to a user input (e.g., a tap input) to the visual object (641). The electronic device (101) may display a second banking application user interface on which the keyword (613) is displayed through the display (210) in response to a user input (e.g., a tap input) to the visual object (642).

[0074] The electronic device (101) can identify a keyword (613) in a previous message (610) of a message (640) because it identifies a keyword in context information generated based on at least one message in the message application. The electronic device (101) can extract a keyword from at least one message in the message application even if there is no keyword in the screen displayed through the display (210).

[0075] According to one embodiment, the electronic device (101) may execute an artificial intelligence (AI) assistant application having a chat user interface similar to the user interface of the message application illustrated in FIG. 6. The electronic device (101) may provide a response message to a user's message using the AI ​​assistant application. Based on the response message, the electronic device (101) may perform the operations illustrated in FIG. 1. The electronic device (101) may determine a linked application corresponding to the response message. The electronic device (101) may display a visual object corresponding to the linked application within the chat user interface.

[0076] FIG. 7 illustrates an example of an electronic device (101) that refrain from displaying a visual object corresponding to an associated function in a messaging application.

[0077] Referring to FIG. 7, in state (701), the electronic device (101) may display a message (710) through the display (210) while executing a message application. The message (710) may include "See you on January 1st." The electronic device (101) may generate context information about a promise to meet based on at least one message (e.g., message (710)) of the message application. The electronic device (101) may determine a calendar application as a linked application (or linked function) based on the context information and user preference information (e.g., application usage information). The electronic device (101) may display a visual object (711) corresponding to the linked function (e.g., calendar application) through the display (210). The electronic device (101) may refrain from displaying a visual object (711) based on receiving a specified user input (or a specified gesture) while displaying the visual object (711) through the display (210).

[0078] According to one embodiment, in state (701), the electronic device (101) may receive an input (720) while displaying a visual object (711) through the display (210). The input (720) may be represented as an up-scroll input and a down-scroll input after the up-scroll input. The electronic device (101) may change the state (701) to state (702) based on receiving the input (720) while displaying the visual object (711) through the display (210). In response to receiving the up-scroll input while displaying the visual object (711) through the display (210), the electronic device (101) may display a screen including a message prior to the message (710) through the display (210). In response to receiving the down-scroll input after receiving the up-scroll input, the electronic device (101) may display a screen including the message (710) through the display (210).

[0079] In state (702), the electronic device (101) can display a screen including a message (710) through the display (210). The electronic device (101) can refrain from or bypass the display of the visual object (711). By refraining from displaying the visual object (711), the electronic device (101) can provide the user with a screen of state (702) that is less complex than the screen of state (701).

[0080] According to one embodiment, in state (701), the electronic device (101) can transmit a response message to the message (710) while displaying a visual object (711) through the display (210). The electronic device (101) can receive an input (730) on the executable object (712) after text to be included in the response message is input. The electronic device (101) can transmit the response message in response to the input (730) on the executable object (712). In response to the input (730) on the executable object (712), the electronic device (101) can change the state (701) to the state (703).

[0081] In state (703), the electronic device (101) can display a screen including a response message through the display (210). The electronic device (101) can stop displaying the visual object (711) in state (703) based on receiving an input (730) on the executable object (712) in state (701). The electronic device (101) can refrain from or bypass displaying the visual object (711). By stopping displaying the visual object (711), the electronic device (101) can provide the user with a screen in state (703) that is less complex than the screen in state (701).

[0082] FIG. 8 illustrates an example of the operation of an electronic device (101) that displays a visual object while refraining from displaying a visual object corresponding to an associated function in a message application.

[0083] Referring to FIG. 8, a state (801) may represent a state in which the electronic device (101) refrain from, suspends, or bypasses displaying a visual object (e.g., visual object (820)) corresponding to a linked function. The state (801) may correspond to the state (702) of FIG. 7. The state (801) may correspond to the state (703) of FIG. 7. The electronic device (101) may receive an input (811) on a message (810). The input (811) may be referred to as a user input. For example, the input (811) may include a long press. For example, the input (811) may include a double tap. Based on receiving the input (811) on the message (810), the electronic device (101) may change the state (801) to the state (802).

[0084] In state (802), the electronic device (101) can display a visual object (820) through the display (210). The visual object (820) can correspond to the visual object (711) of FIG. 7. The electronic device (101) can display the visual object (820) through the display (210) using a data set generated based on context information, information on linked functions, and keywords. The electronic device (101) can use a data set stored in a data set storage (e.g., data set storage (121)) by performing the operations exemplified in FIG. 1. The electronic device (101) can display the visual object (820) through the display (210) by reusing the data set stored in the data set storage (121).

[0085] Figure 9 illustrates an example of an electronic device (101) that executes an associated function.

[0086] Referring to FIG. 9, in state (901), the electronic device (101) may display a message (910) through the display (210) while executing a message application. The message (910) may include the contents of a hotel reservation guide. The electronic device (101) may determine a calendar application and a web browser application as linked applications by performing the operations exemplified in FIG. 1. The electronic device (101) may identify keywords (911), (912), and (913).

[0087] According to one embodiment, in state (901), the electronic device (101) may display a screen including keywords (911), keywords (912), and keywords (913) through the display (210). The screen may include an emphasis effect for the keywords (e.g., keywords (911), keywords (912), and keywords (913)). For example, the emphasis effect may include an underline for the keywords. For example, the emphasis effect may include markup for the keywords. For example, the emphasis effect may include italics for the keywords. For example, the emphasis effect may include boldface for the keywords.

[0088] According to one embodiment, the electronic device (101) may, in response to an input (e.g., a tap input) on a visual object (e.g., the visual object (914), the visual object (915)), display a screen including an emphasis effect for a keyword to be used in the visual object through the display (210). For example, the electronic device (101) may, in response to an input on the visual object (914), display a screen including an emphasis effect for a keyword (911) and an emphasis effect for a keyword (912) through the display (210). For example, the electronic device (101) may, in response to an input on the visual object (915), display a screen including an emphasis effect for a keyword (913) through the display (210).

[0089] According to one embodiment, in state (901), the electronic device (101) may display a visual object (914) through the display (210). The visual object (914) may correspond to a calendar application. The electronic device (101) may change from state (901) to state (902) in response to an input (e.g., a tap input) on the visual object (914). State (902) may represent a state in which the electronic device (101) executes the calendar application. The electronic device (101) may execute the calendar application using keywords (911) and (912) in response to an input on the visual object (914). In state (902), the electronic device (101) may display a screen including a user interface of the calendar application through the display (210). The screen including the user interface of the calendar application may include text (921) and text (922). The text (921) may be identical to or correspond to the keyword (911). The electronic device (101) may use the keyword (911) as text (921) in the calendar application. For example, the text (921) may be displayed as the title of an event in the calendar application. The text (922) may be identical to or correspond to the keyword (912). The electronic device (101) may use the keyword (912) as text (922) in the calendar application. For example, the text (922) may be displayed as the start time and end time of an event in the calendar application. The electronic device (101) may reduce the number of inputs required to save an event in the calendar application by executing the calendar application that uses the keyword (911) and the keyword (912) in response to an input on the visual object (914). The electronic device (101) can enhance the user experience of the electronic device (101) by executing a calendar application that utilizes keywords (911) and keywords (912) in response to input on a visual object (914).

[0090] According to one embodiment, in state (901), the electronic device (101) may display a visual object (915) through the display (210). The visual object (915) may correspond to a web browser application. The electronic device (101) may change from state (901) to state (903) in response to an input (e.g., a tap input) on the visual object (915). State (903) may represent a state in which the electronic device (101) executes a web browser application. The electronic device (101) may execute a web browser application using a keyword (913) in response to an input on the visual object (915). In state (903), the electronic device (101) may display a screen including a user interface of the web browser application through the display (210). The screen including the user interface of the web browser application may include text (930). The text (930) may be identical to or correspond to the keyword (913). The electronic device (101) can utilize the keyword (913) as text (930) in a web browser application. For example, the text (930) can be expressed as a web address (or a uniform resource locator (URL)). The electronic device (101) can reduce the number of inputs required to visit a website by executing a web browser application that utilizes the keyword (913) in response to an input on the visual object (915). The electronic device (101) can enhance the user experience of the electronic device (101) by executing a web browser application that utilizes the keyword (913) in response to an input on the visual object (915).

[0091] FIG. 10 illustrates an example of operations of an electronic device (101) executing an associated application in a message application.

[0092] In operation 1001, the electronic device (101) (e.g., at least one processor (200)) may display a screen including a message (e.g., message (610), message (640), message (710), message (910)) through a display (e.g., display (210)) based on execution of a message application. For example, the message application may include a first party application, a second party application, and a third party application.

[0093] In operation 1003, the electronic device (101) (e.g., at least one processor (200)) may determine a linked application corresponding to a message by providing context information generated based on at least one message in a message application and application usage information of the electronic device to an application determination model within the electronic device. The electronic device (101) may generate context information based on at least one message in the message application by using a context information recognition module (e.g., a context information recognition module (111)). The electronic device (101) may use application usage information of the electronic device (101) stored in a user preference information storage (e.g., a user preference information storage (117)). The electronic device (101) may provide context information and application usage information to a function determination model within a linked function determination module (e.g., a linked function determination module (115)). The function determination model may be referred to as an application determination model.

[0094] In operation 1005, the electronic device (101) (e.g., at least one processor (200)) can identify at least one keyword (e.g., keyword (611), keyword (612), keyword (911), keyword (912), keyword (913)) to be used in the associated application in at least one message by providing information and context information of the associated application to a keyword extraction model within the electronic device (101). The electronic device (101) can utilize the keyword extraction model within a keyword extraction module (e.g., keyword extraction module (119)).

[0095] In operation 1007, the electronic device (101) (e.g., at least one processor (200)) may display a visual object (e.g., visual object (621), visual object (622), visual object (641), visual object (642), visual object (711), visual object (914), visual object (915)) corresponding to the linked application on the screen through the display (210). For example, the electronic device (101) may display a visual object corresponding to the linked application under a message. For example, the electronic device (101) may display a pop-up window including a visual object corresponding to the linked application on the screen.

[0096] In one embodiment, if the messaging application is a third-party application, the electronic device (101) may display the visual object in a layer different from the user interface layer of the messaging application. The electronic device (101) may display the visual object in the different layer overlapping the user interface.

[0097] In operation 1009, the electronic device (101) (e.g., at least one processor (200)) may execute an associated application utilizing at least one keyword in response to a user input (e.g., a tap input) for a visual object.

[0098] FIG. 11 illustrates an example of an electronic device (101) that displays a visual object corresponding to an associated function while performing a text copy function.

[0099] Referring to FIG. 11, a state (1101) may be represented as a state in which the electronic device (101) performs a text copy function. The electronic device (101) may display a pop-up window (1120) through the display (210) in response to a user input for text (1110). For example, the user input may include a long press input. The pop-up window (1120) may include an executable object (1121) corresponding to the copy function of the text (1110). In response to the input (1120) for the executable object (1121), the electronic device (101) may copy the text (1110) to the clipboard.

[0100] The electronic device (101) can perform the operations illustrated in FIG. 1 based on text (1110). The electronic device (101) can generate context information based on the text (1110) using a context information recognition module (e.g., context information recognition module (111)). For example, the context information can be generated by performing preprocessing on the text (1110). The electronic device (101) can determine a linked function using a linked function determination module (e.g., linked function determination module (115)). The linked function can be generated based on context information and user preference information. The electronic device (101) can identify a keyword using a keyword extraction module (e.g., keyword extraction module (119)). The electronic device (101) can store a data set in a data set storage (e.g., data set storage (121)) using a linked function management module (e.g., linked function management module (113)). Data sets can be generated based on contextual information, information on linked features, and keywords.

[0101] The electronic device (101) may change from a state (1101) to a state (1102) in response to an input (1120) for an executable object (1121). In the state (1102), the electronic device (101) may display a pop-up window (1140) through the display (210). The pop-up window (1140) may include a visual object (1141) corresponding to a linked function. For example, the electronic device (101) may display a visual object (1141-1) corresponding to a messenger application through the display (210) according to user preference information indicating that the messenger application is frequently executed after performing a text copy function. For example, the electronic device (101) may display a visual object (1141-2) corresponding to a web browser application through the display (210) according to user preference information indicating that the web browser application is frequently executed after performing a text copy function. For example, the electronic device (101) may display a visual object (1141-3) corresponding to the translation application through the display (210) according to user preference information indicating a high number of executions of the translation application.

[0102] The electronic device (101) can change from state (1101) to state (1103) in response to an input (1120) for an executable object (1122). State (1103) can be described as a state in which the electronic device (101) displays a user interface of a clipboard through the display (210). In state (1103), the electronic device (101) can display a visual object (1150) and a pop-up window (1140) through the display (210). The visual object (1150) can correspond to text (1110). For example, the visual object (1150) can represent text (1110). For example, the electronic device (101) can execute a paste function of the text (1110) in response to a user input for the visual object (1150). The pop-up window (1140) may include a visual object (1141) corresponding to the linked function. The electronic device (101) may, in state (1103), reuse a data set stored in the data set storage (121) to display the pop-up window (1140) (or visual object (1140)) through the display (210).

[0103] The electronic device (101) can display a visual object (1160) and a pop-up window (1170) through the display (210) in a state (1103). The visual object (1160) can represent text copied before the text (1110). For example, the visual object (1160) can include an account number copied before the text (1110). The electronic device (101) can reuse a data set stored in the data set storage (121) to display a pop-up window (1170) (or a visual object (1171)) through the display (210). The pop-up window (1170) can include a visual object (1171). For example, the visual object (1171) can correspond to a linking function of the copied account number. For example, the first visual object (1171-1) can correspond to a first banking application. For example, the second visual object (1171-2) may correspond to a second banking application. For example, the user preference information storage of the electronic device (101) may include application usage information indicating that the number of executions of the first banking application is greater than the number of executions of the second banking application. For example, based on the application usage information, the electronic device (101) may display the first visual object (1171-1) to the left of the second visual object (1171-2).

[0104] FIG. 12 illustrates an example of a foldable type electronic device (101) that displays a visual object corresponding to a linking function. The electronic device (101) of FIG. 12 may be represented as a foldable type electronic device (101). The electronic device (101) may further include a first housing (1205), a second housing (1206), and a hinge structure (1207). The first housing (1205) may be rotatable relative to the second housing (1206) about a folding axis. The hinge structure (1207) may rotatably connect the first housing (1205) and the second housing (1206). The hinge structure (1207) may be disposed between the first housing (1205) and the second housing (1206) of the electronic device (101) so that the electronic device (101) may be bent, curved, or folded. The hinge structure (1207) may include a first hinge plate and a second hinge plate. The first hinge plate may be connected to a first housing (1205). The second hinge plate may be connected to a second housing (1206). The first hinge plate may be rotatable relative to the second hinge plate about a folding axis. The hinge structure (1207) may be capable of changing the electronic device (101) into an unfolded state, such as state (1204), or a fully folded state, such as state (1201). When the electronic device (101) is in a fully folded state, the first housing (1205) and the second housing (1206) may face each other and thus be folded or overlapped.

[0105] The electronic device (101) may include a first display (210-1) and a second display (210-2). The second display (210-2) may include a flexible display. The first display (210-1) may be disposed on a first surface of the first housing (1205). The second display (210-2) may be disposed on a second surface of the first housing (1205) and a third surface of the second housing (1206). The second surface of the first housing (1205) may be displayed as an opposite surface to the first surface of the first housing (1205).

[0106] Referring to FIG. 12, the operations of the electronic device (101) exemplified in states (1201) and (1202) may correspond to the operations of the electronic device (101) exemplified in FIG. 3. In state (1201), the electronic device (101) may be represented as a fully folded state. The fully folded state may be referred to as a folded state. The electronic device (101) may display a notification screen through the first display (210-1). The notification screen may include a notification of an application of the electronic device (101) (e.g., notification (1211), notification (1212)). For example, the notification of the application may include at least a portion of a message of a message application. For example, the notification of the application may include a summary of a message of a message application. For example, the notification of the application may include a schedule notification of a calendar application. However, the present invention is not limited thereto. The electronic device (101) can perform the operations illustrated in FIG. 1 based on a notification (e.g., notification (1211), notification (1212)) of an application. The electronic device (101) can display a notification screen including a visual object corresponding to a linked function on the first display (210-1) based on receiving an input (1213) while displaying the notification screen. The electronic device (101) can change from a state (1201) to a state (1202) in response to an input (1213) on the notification (1211) of the application. The input (1213) can correspond to the input (330) of FIG. 3.

[0107] In state (1202), the electronic device (101) may display a pop-up window including a visual object (1221) and a visual object (1222) through the first display (210-1) based on receiving an input (1213) on a notification (1211) of an application. For example, the visual object (1221) may correspond to a first linked application. The electronic device (101) may execute the first linked application based on receiving a specified user input (e.g., a tap input) on the visual object (1221). For example, the visual object (1222) may correspond to a second linked application. The electronic device (101) may execute the second linked application based on receiving a specified user input (e.g., a tap input) on the visual object (1222). The electronic device (101) can change the state (1202) to the state (1203) in response to an input (1223) to the visual object (1221).

[0108] In state (1203), the electronic device (101) can display a screen (1230) through the first display (210-1). The screen (1230) can include text such as "Please open the screen to check." The electronic device (101) can guide the user to change the state (1203) to state (1204) by displaying the screen (1230). The electronic device (101) can guide the user to change the fully folded state of the electronic device (101) to the unfolded state by displaying the screen (1230). The electronic device (101) can guide the user to use the second display (210-2) having a larger size than the first display (210-1) by displaying the screen (1230).

[0109] In state (1204), the electronic device (101) may be represented in an unfolded state. The unfolded state may be referred to as a folded-out state or a fully folded out state. The electronic device (101) may display a screen (1240) through the second display (210-2). The screen (1240) may include a user interface of a first associated application corresponding to a visual object (1221).

[0110] FIG. 13 illustrates an example of an electronic device (101) that displays visual objects corresponding to a linking function in a multi-window. The electronic device (101) of FIG. 13 may be represented as a foldable type electronic device (101). The electronic device (101) may include a display (210). The display (210) may include a flexible display. The electronic device (101) may further include a first housing (1305), a second housing (1306), and a hinge structure (1307). The first housing (1305) may be rotatable relative to the second housing (1306) about a folding axis. The hinge structure (1307) may rotatably connect the first housing (1305) and the second housing (1306). A hinge structure (1307) may be disposed between a first housing (1305) and a second housing (1306) of the electronic device (101) to enable the electronic device (101) to be bent, curved, or folded. The hinge structure (1307) may include a first hinge plate and a second hinge plate. The first hinge plate may be connected to the first housing (1305). The second hinge plate may be connected to the second housing (1306). The first hinge plate may be rotatable relative to the second hinge plate about a folding axis. The hinge structure (1307) may be capable of changing the electronic device (101) into an unfolded state or a fully folded state. The electronic device (101) may be represented as being in an unfolded state in states (1301), (1302), and (1303).

[0111] Referring to FIG. 13, in state (1301), the electronic device (101) can display a screen (1320) through the display (210). The screen (1320) may correspond to the screen displayed by the electronic device (101) in state (901) of FIG. 9. The screen (1320) may be displayed in the first housing (1305). For example, the electronic device (101) may display the screen (1320) in a portion of the display (210) corresponding to the first housing (1305). The screen (1320) may include a visual object (1311) and a visual object (1312). The visual object (1311) may be associated with a first associated application corresponding to a message. The visual object (1312) may be associated with a second associated application corresponding to the message. The electronic device (101) can receive an input (1315) for a visual object (1312). The electronic device (101) can change a state (1301) to a state (1302) in response to the input (1315) for the visual object (1312). The input (1315) can include a drag-and-drop input. After receiving the drag input for the visual object (1312), the electronic device (101) can receive a drop input in an area other than an area of ​​the screen (1320) within the display (210).

[0112] In state (1302), the electronic device (101) can display a screen (1320) and a screen (1321) through the display (210). The screen (1320) can be displayed in the first housing (1305). For example, the electronic device (101) can display the screen (1320) in a part of the display (210) corresponding to the first housing (1305). The screen (1321) can be displayed in the second housing (1306). For example, the electronic device (101) can display the screen (1321) in another part of the display (210) corresponding to the second housing (1306). The electronic device (101) can perform a multi-window function. The screen (1321) can include a user interface of a second linked application corresponding to a visual object (1312). The screen (1321) may correspond to the screen displayed by the electronic device (101) in state (903) of FIG. 9. The electronic device (1302) may display an executable object for a text copy function on the screen (1321). The electronic device (1302) may perform the text copy function on the screen (1321) in response to an input (1325) for the executable object. The electronic device (1302) may change the state (1302) to state (1303) in response to the input (1325) for the executable object. Changing the state of the electronic device (101) from state (1302) to state (1303) may correspond to changing from state (1101) to state (1102) as illustrated in FIG. 11.

[0113] In state (1303), the electronic device (101) can display a screen (1321) including a visual object (1331) and a visual object (1332) through the display (210). The screen (1321) including the visual object (1331) and the visual object (1332) can be displayed in the second housing (1306). The visual objects (e.g., the visual object (1331), the visual object (1332)) in the screen (1321) can be associated with an associated application corresponding to the copied text. The associated application corresponding to the visual object (1331) in the screen (1321) can be different from the associated application corresponding to the visual object (e.g., the visual object (1311), the visual object (1312)) in the screen (1320).

[0114] According to one embodiment, a first linked application corresponding to a visual object (1332) in a screen (1321) may be identical to a second linked application corresponding to a visual object (1312) in a screen (1320). Even if the first linked application corresponding to a visual object (1332) and the second linked application corresponding to a visual object (1312) are identical, a first keyword used in the first linked application and a second keyword used in the second linked application may be different.

[0115] Although Fig. 13 illustrates performing a multi-window function in a foldable type electronic device (101), this is merely exemplary. The operations illustrated in Fig. 13 can be performed in a bar type electronic device (101) that provides a multi-window function.

[0116] FIG. 14 illustrates an example of a wearable electronic device (101) that displays a visual object corresponding to a linked function. The electronic device (101) may include a wearable device, a head mounted device (HMD) device, virtual reality (VR) glasses, and augmented reality (AR) glasses.

[0117] Referring to FIG. 14, a user may wear an electronic device (101). The electronic device (101) may display a screen (1410) through a display (e.g., a display (210)). The screen (1410) may provide the user with augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality. Augmented reality, virtual reality, and mixed reality may be referred to as extended reality (XR).

[0118] The electronic device (101) may include a camera (not shown). The electronic device (101) may use the camera to obtain images and / or videos to be transmitted to the eyes of the user of the electronic device (101). The electronic device (101) may obtain images and / or videos through the camera in response to user input (e.g., motion input, gesture input, voice input, gaze input). The electronic device (101) may analyze objects included in the images (or videos) obtained through the camera, and display a screen (e.g., screen (1410)) including virtual objects (or visual objects) corresponding to objects to be provided with extended reality (e.g., augmented reality, virtual reality, mixed reality) among the analyzed objects on the display (210). While the electronic device (101) displays a screen (e.g., screen (1410)) including virtual objects, the electronic device (101) may display visual objects corresponding to linked functions on the display (210) according to context information of the virtual objects.

[0119] The screen (1410) may include a visual object (1420) corresponding to an external object (1402). The electronic device (101) may perform the operations illustrated in FIG. 1 based on the visual object (1420) (or the external object (1402)). The electronic device (101) may generate context information based on the visual object (1420) using a context information recognition module (e.g., a context information recognition module (111)). For example, the context information may be represented as information of a visual object (1420) on which preprocessing has been performed. For example, the context information may include text data (e.g., “Seoul Station”) generated by applying OCR to the visual object (1420). The electronic device (101) may determine a linked function based on the context information and user preference information using a linked function determination module (e.g., a linked function determination module (115)). For example, the user preference information may include data related to text data (e.g., “Seoul Station”). For example, user preference information may include data regarding a search history for restaurants near Seoul Station using a web browser application. For example, user preference information may include data regarding an appointment to meet at Seoul Station. The electronic device (101) may identify keywords using a keyword extraction module (e.g., keyword extraction module (119)). For example, the keywords may include "Seoul Station." The electronic device (101) may store a data set in a data set repository (e.g., data set repository (121)) using a linkage function management module (e.g., linkage function management module (113)). The data set may be generated based on context information, information about linkage functions, and keywords.

[0120] The screen (1410) displayed by the electronic device (101) may include a visual object (1430). For example, the first visual object (1430-1) may correspond to a calendar application. The electronic device (101) may execute the calendar application in response to an input to the first visual object (1430). For example, the electronic device (101) may display a list of appointments corresponding to a keyword (e.g., "Seoul Station") within the calendar application through the display (210). For example, the second visual object (1430-2) may correspond to a web browser application. The electronic device (101) may execute the web browser application in response to an input to the second visual object (1430-2). For example, the electronic device (101) may display a screen in which a keyword (e.g., "Seoul Station") is searched in the web browser application through the display (210).

[0121] FIG. 15 is a block diagram of an electronic device (1501) (e.g., electronic device (101)) within a network environment (1500) according to various embodiments.

[0122] Referring to FIG. 15, in a network environment (1500), an electronic device (1501) may communicate with an electronic device (1502) via a first network (1598) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (1504) or a server (1508) via a second network (1599) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1501) may communicate with the electronic device (1504) via the server (1508). According to one embodiment, the electronic device (1501) may include a processor (1520), a memory (1530), an input module (1550), an audio output module (1555), a display module (1560), an audio module (1570), a sensor module (1576), an interface (1577), a connection terminal (1578), a haptic module (1579), a camera module (1580), a power management module (1588), a battery (1589), a communication module (1590), a subscriber identification module (1596), or an antenna module (1597). In some embodiments, the electronic device (1501) may omit at least one of these components (e.g., the connection terminal (1578)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1576), camera module (1580), or antenna module (1597)) may be integrated into a single component (e.g., display module (1560)).

[0123] The processor (1520) may, for example, execute software (e.g., a program (1540)) to control at least one other component (e.g., a hardware or software component) of the electronic device (1501) connected to the processor (1520) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1520) may store commands or data received from other components (e.g., a sensor module (1576) or a communication module (1590)) in a volatile memory (1532), process the commands or data stored in the volatile memory (1532), and store result data in a non-volatile memory (1534). According to one embodiment, the processor (1520) may include a main processor (1521) (e.g., a central processing unit or an application processor) or an auxiliary processor (1523) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1521). For example, when the electronic device (1501) includes the main processor (1521) and the auxiliary processor (1523), the auxiliary processor (1523) may be configured to use less power than the main processor (1521) or to be specialized for a given function. The auxiliary processor (1523) may be implemented separately from the main processor (1521) or as a part thereof.

[0124] The auxiliary processor (1523) may control at least a portion of functions or states associated with at least one component (e.g., the display module (1560), the sensor module (1576), or the communication module (1590)) of the electronic device (1501), for example, on behalf of the main processor (1521) while the main processor (1521) is in an inactive (e.g., sleep) state, or together with the main processor (1521) while the main processor (1521) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1523) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1580) or a communication module (1590)). In one embodiment, the auxiliary processor (1523) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1501) where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1508)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0125] The memory (1530) can store various data used by at least one component (e.g., the processor (1520) or the sensor module (1576)) of the electronic device (1501). The data can include, for example, software (e.g., the program (1540)) and input data or output data for commands related thereto. The memory (1530) can include volatile memory (1532) or non-volatile memory (1534).

[0126] The program (1540) may be stored as software in memory (1530) and may include, for example, an operating system (1542), middleware (1544), or an application (1546).

[0127] The input module (1550) can receive commands or data to be used in a component of the electronic device (1501) (e.g., a processor (1520)) from an external source (e.g., a user) of the electronic device (1501). The input module (1550) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0128] The audio output module (1555) can output audio signals to the outside of the electronic device (1501). The audio output module (1555) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0129] The display module (1560) can visually provide information to an external party (e.g., a user) of the electronic device (1501). The display module (1560) may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the device. In one embodiment, the display module (1560) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0130] The audio module (1570) can convert sound into an electrical signal, or vice versa. According to one embodiment, the audio module (1570) can acquire sound through the input module (1550), output sound through the sound output module (1555), or an external electronic device (e.g., electronic device (1502)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1501).

[0131] The sensor module (1576) can detect the operating status (e.g., power or temperature) of the electronic device (1501) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1576) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0132] The interface (1577) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1501) with an external electronic device (e.g., the electronic device (1502)). In one embodiment, the interface (1577) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0133] The connection terminal (1578) may include a connector through which the electronic device (1501) may be physically connected to an external electronic device (e.g., the electronic device (1502)). In one embodiment, the connection terminal (1578) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0134] The haptic module (1579) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1579) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0135] The camera module (1580) can capture still images and videos. In one embodiment, the camera module (1580) may include one or more lenses, image sensors, image signal processors, or flashes.

[0136] The power management module (1588) can manage the power supplied to the electronic device (1501). According to one embodiment, the power management module (1588) can be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

[0137] A battery (1589) may power at least one component of the electronic device (1501). In one embodiment, the battery (1589) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0138] The communication module (1590) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1501) and an external electronic device (e.g., electronic device (1502), electronic device (1504), or server (1508)), and the performance of communication through the established communication channel. The communication module (1590) may operate independently from the processor (1520) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1590) may include a wireless communication module (1592) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1594) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1504) via a first network (1598) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1599) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network or a wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1592) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1596) to verify or authenticate the electronic device (1501) within a communication network such as the first network (1598) or the second network (1599).

[0139] The wireless communication module (1592) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimizing terminal power and connecting multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency communications (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1592) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1592) may support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1592) may support various requirements specified in the electronic device (1501), an external electronic device (e.g., the electronic device (1504)), or a network system (e.g., the second network (1599)). According to one embodiment, the wireless communication module (1592) may support a peak data rate (e.g., 20 Gbps or more) for eMBB implementation, a loss coverage (e.g., 164 dB or less) for mMTC implementation, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC implementation.

[0140] The antenna module (1597) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1597) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1597) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1598) or the second network (1599), may be selected from the plurality of antennas by, for example, the communication module (1590). A signal or power may be transmitted or received between the communication module (1590) and the external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1597).

[0141] According to various embodiments, the antenna module (1597) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0142] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0143] According to one embodiment, commands or data may be transmitted or received between the electronic device (1501) and an external electronic device (1504) via a server (1508) connected to a second network (1599). Each of the external electronic devices (1502 or 1504) may be the same or a different type of device as the electronic device (1501). According to one embodiment, all or part of the operations executed in the electronic device (1501) may be executed in one or more of the external electronic devices (1502, 1504, or 1508). For example, when the electronic device (1501) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1501) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1501). The electronic device (1501) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1501) may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1504) may include an Internet of Things (IoT) device. The server (1508) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1504) or server (1508) may be included within the second network (1599). The electronic device (1501) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0144] In an embodiment according to the present disclosure, an electronic device (e.g., electronic device (101)) can generate context information based on data of a function executed in the electronic device (101). The electronic device (101) can determine an associated function (or associated application) based on the generated context information and user preference information. The associated function (or associated application) can be described as a function (or application) that is expected to be performed by a user in the electronic device (101) based on the context information. Since the associated function is based on user context information and user preference information, it can be customized for the user. The electronic device (101) can enhance the user experience of the electronic device (101) by displaying a visual object corresponding to the customized associated function through a display (e.g., display (210)).

[0145] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0146] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary knowledge in the technical field to which the present disclosure pertains.

[0147] As described above, an electronic device may include a display. The electronic device may include a memory that stores instructions and includes one or more storage media. The electronic device may include at least one processor including processing circuitry. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a screen including a message through the display based on the execution of a message application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine an associated application corresponding to the message by providing context information generated based on at least one message in a message application and application usage information of the electronic device to an application determination model within the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify at least one keyword to be used in the associated application in the at least one message by providing information of the associated application and the context information to a keyword extraction model within the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a visual object corresponding to the associated application on a screen through the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to execute the associated application using the at least one keyword in response to a user input with respect to the associated visual object.

[0148] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive an up-scroll input while displaying the screen on the message application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a second screen including a previous message on the display in response to the up-scroll input. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive a down-scroll input while displaying the second screen on the message application. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a third screen including the message on the display in response to the down-scroll input. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to refrain from displaying the visual object on the third screen.

[0149] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive an input on an executable object for transmitting a response message to the message within the screen while displaying the visual object via the display on the screen. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to stop displaying the visual object based on receiving the input.

[0150] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to store a data set in the memory based on information of the message, information of the associated application, and information of the at least one keyword. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive a user input specified in the message while ceasing display of the visual object. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object through the display using the data set based on receiving the specified user input. The specified user input may include a double tap.

[0151] According to one embodiment, the screen may include a keyword corresponding to the message and an emphasis effect for the keyword.

[0152] According to one embodiment, the emphasis effect may include at least one of an underline for the keyword, a markup for the keyword, or a bold for the keyword.

[0153] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in a layer different from a layer of a user interface of the message application and overlapping the user interface, if the message application is a third party application.

[0154] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a pop-up window including the visual object on the screen.

[0155] A method performed on an electronic device having a display as described above may include an operation of displaying a screen including a message through the display based on execution of a message application. The method may include an operation of determining an associated application corresponding to the message by providing context information generated based on at least one message in a message application and application usage information of the electronic device to an application determination model within the electronic device. The method may include an operation of identifying at least one keyword to be used in the associated application in the at least one message by providing information on the associated application and the context information to a keyword extraction model within the electronic device. The method may include an operation of displaying a visual object corresponding to the associated application on the screen through the display. The method may include an operation of executing the associated application using the at least one keyword in response to a user input for the visual object.

[0156] In one embodiment, the method may include receiving an up-scroll input while displaying the screen on the message application. The method may include displaying a second screen including a previous message through the display in response to the up-scroll input. The method may include receiving a down-scroll input while displaying the second screen on the message application. The method may include displaying a third screen including the message through the display in response to the down-scroll input. The method may include refraining from displaying the visual object on the third screen.

[0157] In one embodiment, the method may include receiving an input on an executable object for transmitting a response message to the message within the screen while displaying the visual object on the screen through the display. The method may include an operation of ceasing the display of the visual object based on receiving the input.

[0158] According to one embodiment, the electronic device may include a memory. The method may include an operation of storing a data set in the memory based on information of the message, information of the associated application, and information of the at least one keyword. The method may include an operation of receiving a user input specified in the message while the display of the visual object is stopped. The method may include an operation of displaying the visual object through the display using the data set based on receiving the specified user input. The specified user input may include a double tap.

[0159] According to one embodiment, the screen may include a keyword corresponding to the message and an emphasis effect for the keyword.

[0160] According to one embodiment, the emphasis effect may include at least one of an underline for the keyword, a markup for the keyword, or a bold for the keyword.

[0161] According to one embodiment, the method may include, when the messaging application is a third party application, displaying the visual object in a layer different from a layer of a user interface of the messaging application and overlapping the user interface.

[0162] According to one embodiment, the method may include an action of displaying a pop-up window including the visual object on the screen.

[0163] In a computer-readable storage medium having one or more programs stored thereon, as described above, the one or more programs may include instructions that, when executed by an electronic device having a display, cause the electronic device to display a screen including a message through the display based on execution of a message application. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to determine an associated application corresponding to the message by providing context information generated based on at least one message in a previous message application and application usage information of the electronic device to an application determination model within the electronic device. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to identify at least one keyword to be used in the associated application from the at least one message by providing information on a previous associated application and the context information to a keyword extraction model within the electronic device. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to display a visual object corresponding to the linked application on the screen through the display. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to execute the linked application using the at least one keyword in response to a user input for the visual object.

[0164] According to one embodiment, the one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to receive an up-scroll input while displaying the screen on the message application. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to display a second screen including a previous message on the display in response to the up-scroll input. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to receive a down-scroll input while displaying the second screen on the message application. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to display a third screen including the message on the display in response to the down-scroll input. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to refrain from displaying the visual object on the third screen.

[0165] According to one embodiment, the one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to receive an input on an executable object for transmitting a response message to the message within the screen while displaying the visual object via the display on the screen. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to stop displaying the visual object based on receiving the input.

[0166] According to one embodiment, the electronic device may include a memory. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to store a data set in the memory based on information of the message, information of the associated application, and information of the at least one keyword. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to receive a user input specified in the message while ceasing display of the visual object. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to display the visual object through the display using the data set based on receiving the specified user input. The specified user input may include a double tap.

[0167] According to one embodiment, the screen may include a keyword corresponding to the message and an emphasis effect for the keyword.

[0168] According to one embodiment, the emphasis effect may include at least one of an underline for the keyword, a markup for the keyword, or a bold for the keyword.

[0169] According to one embodiment, the one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to display the visual object in a layer different from a layer of a user interface of the message application and overlapping the user interface, if the message application is a third party application.

[0170] According to one embodiment, the one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to display a pop-up window containing the visual object on the screen.

[0171] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0172] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0173] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0174] Various embodiments of the present document may be implemented as software (e.g., a program (1540)) including one or more commands stored in a storage medium (e.g., a memory (220), an internal memory (1536), an external memory (1538)) readable by a machine (e.g., an electronic device (101), an electronic device (1501)). For example, a processor (e.g., at least one processor (200), a processor (1520)) of the machine (e.g., an electronic device (101), an electronic device (1501)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0175] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0176] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; A memory storing instructions and including one or more storage media; and At least one processor comprising a processing circuit, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the execution of the message application, a screen containing the message is displayed through the display, By providing context information generated based on at least one message in the message application and application usage information of the electronic device to an application decision model in the electronic device, a linked application corresponding to the message is determined, By providing information of the linked application and the context information to a keyword extraction model within the electronic device, at least one keyword to be used in the linked application is identified in the at least one message, Displaying a visual object corresponding to the linked application on the above screen through the display, and In response to user input for said visual object, causing said associated application to be executed using said at least one keyword, Electronic devices.

2. In claim 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Receive an up-scroll input while displaying the above screen on the above message application, In response to the above up-scroll input, display a second screen including the previous message through the display, Receiving a down scroll input while displaying the second screen on the above message application, In response to the above down scroll input, a third screen including the above message is displayed through the display, and Causing to refrain from displaying the visual object on the third screen, Electronic devices.

3. In claim 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While displaying the visual object on the screen through the display, receiving an input on an executable object for transmitting a response message to the message within the screen, and Based on receiving said input, causing the display of said visual object to be stopped, Electronic devices.

4. In claim 3, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the information of the above message, the information of the above linked application, and the information of the at least one keyword, store a data set in the memory, While suspending the display of the above visual object, receiving the user input specified in the above message, and Based on receiving the specified user input, causing the visual object to be displayed through the display using the data set, and The above specified user input includes a double tap, Electronic devices.

5. In claim 1, The above screen includes a keyword corresponding to the message and an emphasis effect for the keyword. Electronic devices.

6. In claim 5, The above emphasis effect includes at least one of underlining for the keyword, markup for the keyword, or bolding for the keyword. Electronic devices.

7. In claim 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: If the above message application is a third party application, causing the visual object to be displayed in a layer different from the layer of the user interface of the above message application and overlapping the user interface, Electronic devices.

8. In claim 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Causing a pop-up window containing the above visual object to be displayed on the screen; Electronic devices.

9. A method performed in an electronic device having a display, Based on the execution of the message application, an action of displaying a screen containing a message through the display; An operation of determining a linked application corresponding to the message by providing context information generated based on at least one message in the message application and application usage information of the electronic device to an application decision model within the electronic device, An operation of identifying at least one keyword to be used in the linked application in the at least one message by providing information of the linked application and the context information to a keyword extraction model within the electronic device; An action of displaying a visual object corresponding to the linked application on the above screen through the display, and In response to a user input for said visual object, comprising an action of executing said linked application using said at least one keyword; method.

10. In claim 9, An action of receiving an up-scroll input while displaying the above screen on the above message application, An action of displaying a second screen including a previous message through the display in response to the above up-scroll input; An action of receiving a down scroll input while displaying the second screen on the above message application, In response to the above down scroll input, an action of displaying a third screen including the above message through the display, and Further comprising an action of refraining from displaying the visual object on the third screen; method.

11. In claim 9, An operation of receiving an input on an executable object for transmitting a response message to the message within the screen while displaying the visual object through the display on the screen, and Further comprising an action of stopping display of the visual object based on receiving the input. method.

12. In claim 11, The electronic device comprises a memory, The above method, An operation of storing a data set in the memory based on information of the message, information of the linked application, and information of at least one keyword; While stopping the display of the above visual object, an action of receiving user input specified in the above message, and Further comprising an action that causes the visual object to be displayed through the display using the data set based on receiving the user input, and The above specified user input includes a double tap, method.

13. In claim 9, The above screen includes a keyword corresponding to the message and an emphasis effect for the keyword. method.

14. In claim 13, The above emphasis effect includes at least one of underlining for the keyword, markup for the keyword, or bolding for the keyword. method.

15. In a non-transitory computer-readable storage medium storing one or more programs, The above one or more programs, when executed by an electronic device having a display, Based on the execution of the message application, a screen containing the message is displayed through the display, By providing context information generated based on at least one message in the message application and application usage information of the electronic device to an application decision model in the electronic device, a linked application corresponding to the message is determined, By providing information of the linked application and the context information to a keyword extraction model within the electronic device, at least one keyword to be used in the linked application is identified in the at least one message, Displaying a visual object corresponding to the linked application on the above screen through the display, and In response to user input for said visual object, execute said linked application using said at least one keyword; comprising instructions causing the electronic device to operate; Non-transitory computer-readable storage medium.

Images