Electronic device and method for providing emoji related to message of message application

Abstract

Provided are an electronic device and method for providing an emoji related to a message of a message application. The method for providing an emoji related to a message of a message application comprises the operations of: acquiring at least one text input into an execution screen of the message application; acquiring information indicating an input intention of the at least one text and a word included in the at least one text by analyzing the at least one text; and identifying at least one emoji corresponding to the information indicating the input intention and the word, and a display attribute of the at least one emoji, wherein the display attribute of the at least one emoji includes an attribute related to movement of the at least one emoji.

Description

Electronic device and method for providing emojis related to messages in a messaging application

[0001] The present disclosure relates to an electronic device and method for providing emojis related to messages in a messaging application.

[0002] As mobile electronic devices become more widespread and related technologies develop, mobile electronic devices provide users with a variety of functions, including multimedia playback, gaming, and Internet functions, in addition to simple calling and text messaging functions.

[0003] In particular, messaging technology can provide the ability to transmit messages that include not only text but also multimedia such as photos and videos. Furthermore, messaging technology can send emojis, expressed as a single image or multiple image frames, along with messages. Users using messaging applications can effectively convey their intentions and emotional states by using emojis.

[0004] According to one embodiment, the method comprises: executing the message application installed on an electronic device; obtaining text input into an input window of an execution screen of the message application (210); identifying words included in the text (220); obtaining first information indicating the meaning of the text by analyzing the text (220); identifying whether the first information is related to movement of at least one of a person or an object (230); identifying second information corresponding to properties for an animation effect related to movement of the emoji and the emoji within the execution screen based on the first information and a word related to the intensity of the movement among the words, wherein the second information includes information on a start position, an end position, and a movement speed for displaying the emoji; displaying the emoji at the start position related to a message bubble provided within the execution screen of the message application and including the text based on the second information (250); displaying the emoji through the animation effect in which the emoji moves from the start position related to the message bubble within the execution screen of the message application based on the second information; A method for providing an emoji related to a message of a message application executed by an electronic device (1000) including a text may be provided. In addition, the method may include an operation of transmitting the text, the emoji, and the second information to another electronic device through the message application.

[0005] According to one embodiment, there is provided a communication interface (4190); a display (4160); a memory (4130) for storing commands; And one or more processors (4120); wherein the instructions, when executed by the one or more processors, cause the electronic device to: execute the message application, obtain text entered in an input window of an execution screen of the message application, identify words included in the text, analyze the text to obtain first information indicating the meaning of the text, identify whether the first information is related to movement of at least one of a person or an object, and identify second information corresponding to properties for an animation effect related to movement of the emoji and the emoji within the execution screen based on the first information and a word related to the intensity of the movement among the words, wherein the second information includes information about a start position, an end position, and a movement speed for displaying the emoji, and based on the second information, display the emoji at the start position related to a message bubble provided within the execution screen of the message application and including the text, and based on the second information, display the emoji through the animation effect in which the emoji moves from the start position related to the message bubble within the execution screen of the message application, and An electronic device may be provided that transmits the second information regarding the text entered in the input window, the emoji, and the animation effect of the emoji to another electronic device through the message application.

[0006] According to one embodiment, the method comprises: executing the message application installed on an electronic device; obtaining text input into an input window of an execution screen of the message application (210); identifying words included in the text (220); obtaining first information indicating the meaning of the text by analyzing the text (220); identifying whether the first information is related to movement of at least one of a person or an object (230); identifying second information corresponding to properties for an animation effect related to movement of the emoji and the emoji within the execution screen based on the first information and a word related to the intensity of the movement among the words, wherein the second information includes information on a start position, an end position, and a movement speed for displaying the emoji; displaying the emoji at the start position related to a message bubble provided within the execution screen of the message application and including the text based on the second information (250); displaying the emoji through the animation effect in which the emoji moves from the start position related to the message bubble within the execution screen of the message application based on the second information; A computer-readable recording medium having recorded thereon a program for executing a method of providing an emoji related to a message of a message application executed by an electronic device (1000), including the program, may be provided.

[0007] According to one embodiment, a method for an electronic device to provide an emoji related to a message of a message application may be provided, including: obtaining at least one text input into an execution window of the message application; analyzing the at least one text to obtain information indicating an input intent of the at least one text and a word included in the at least one text; identifying whether the information indicating the input intent obtained from the at least one text is related to movement; identifying at least one emoji corresponding to the information indicating the input intent and the word and a display attribute of the at least one emoji based on the information indicating the input intent being related to the movement, wherein the display attribute of the at least one emoji includes an attribute related to movement of the at least one emoji; displaying the at least one emoji at a preset position within an execution screen of the message application; and moving the at least one emoji based on the identified attribute.

[0008] FIG. 1 is a drawing showing an example of an emoji being moved and displayed within an execution screen of a message application displayed on a screen of an electronic device according to one embodiment.

[0009] FIG. 2 is a flowchart of a method for an electronic device to move and display an emoji within an execution screen of a message application according to one embodiment.

[0010] FIG. 3 is a flowchart of a method for an electronic device according to one embodiment to identify emojis and display properties of emojis related to text within an execution screen of a message application based on an NLU model.

[0011] FIG. 4 is a flowchart of a method for an electronic device according to one embodiment to identify emojis and display properties of emojis related to text within an execution screen of a message application based on a generative AI model.

[0012] FIG. 5 is a flowchart of a method for an electronic device to determine display properties related to movement of an emoji according to one embodiment.

[0013] FIG. 6 is a diagram showing examples of emojis according to one embodiment.

[0014] FIG. 7 is a diagram illustrating an example in which, according to one embodiment, the display movement of an emoji begins around a message object based on the location at which a word corresponding to the emoji is displayed within a message object containing text.

[0015] FIG. 8 is a diagram showing examples of emojis displayed around words corresponding to emojis according to one embodiment.

[0016] FIG. 9 is a diagram showing an example of an emoji moving around a word corresponding to the emoji according to one embodiment.

[0017] FIG. 10 is a diagram illustrating an example in which an emoji is displayed at least partially overlapping a message object around a word corresponding to the emoji according to one embodiment.

[0018] FIG. 11 is a diagram illustrating an example of an emoji moving along the edge of a message object according to one embodiment.

[0019] FIG. 12 is a diagram illustrating an example of an emoji being moved away from or closer to a message object according to one embodiment.

[0020] FIG. 13 is a diagram illustrating an example of an emoji moving across a message object according to one embodiment.

[0021] FIG. 14 is a diagram illustrating an example of an emoji being moved within a message object according to one embodiment.

[0022] FIG. 15 is a diagram illustrating an example of an emoji being moved between message objects according to one embodiment.

[0023] FIG. 16 is a flowchart of a method for an electronic device to determine display properties regarding deformation of an emoji according to one embodiment.

[0024] FIG. 17 is a drawing for explaining an example of a deformed emoji according to one embodiment.

[0025] FIG. 18 is a diagram illustrating an example of an emoji that is transformed based on the context of a message according to one embodiment.

[0026] FIG. 19 is a drawing for explaining an example of determining the size of an emoji when a preset word is repeated according to one embodiment.

[0027] FIG. 20 is a diagram showing an example of changing the size of an emoji within the execution screen of a message application according to the repetition of a preset word according to one embodiment.

[0028] FIG. 21 is a drawing showing an example in which a plurality of emojis are displayed transformed according to a time cycle according to one embodiment.

[0029] FIG. 22 is a drawing showing an example in which an emoji is displayed partially overlapping a message object as its size changes according to one embodiment.

[0030] FIG. 23 is a drawing showing an example of emojis displayed in multiple message objects moving to come into contact with each other according to one embodiment.

[0031] FIG. 24 is a drawing showing an example of an emoji changing while moving according to one embodiment.

[0032] FIG. 25 is a drawing showing an example in which the size of an emoji is changed according to one embodiment, then changed to another emoji, and then the changed emoji disappears.

[0033] FIG. 26 is a diagram showing an example of an emoji with a specific animation effect being displayed and then disappearing according to one embodiment.

[0034] FIG. 27 is a diagram showing an example of an emoji of a specific animation effect being changed to another emoji and the changed other emoji disappearing according to one embodiment.

[0035] FIG. 28 is a flowchart of a method for an electronic device to display multiple emojis based on multiple texts according to one embodiment.

[0036] FIG. 29 is a diagram illustrating an example of an electronic device according to one embodiment of the present invention that associates and displays multiple emojis based on multiple texts.

[0037] FIG. 30 is a diagram illustrating an example of an electronic device according to one embodiment of the present invention that associates and displays multiple emojis based on multiple texts.

[0038] FIG. 31 is a diagram illustrating an example in which an electronic device according to one embodiment determines display properties of an emoji based on multiple properties of text.

[0039] FIG. 32 is a flowchart of a method for an electronic device to display an emoji based on a user input for a list of recommended emojis according to one embodiment.

[0040] FIG. 33 is a diagram illustrating an example of an electronic device displaying and changing an emoji based on a user input on an execution screen of a message application according to one embodiment.

[0041] FIG. 34 is a diagram illustrating an example of an electronic device displaying and changing an emoji based on a user input on an execution screen of a message application according to one embodiment.

[0042] FIG. 35 is a diagram illustrating an example of an electronic device removing an emoji displayed on a running screen of a message application based on a user input and displaying another emoji according to one embodiment.

[0043] FIG. 36 is a diagram illustrating an example of an electronic device rotating an emoji and changing the size and image properties of an emoji based on user input on an execution screen of a message application according to one embodiment.

[0044] FIG. 37 is a diagram illustrating an example of an electronic device changing the movement properties of an emoji based on a user input on an execution screen of a message application according to one embodiment.

[0045] FIG. 38 is a diagram illustrating an example of an electronic device according to one embodiment providing a new image combining the characteristics of multiple emojis.

[0046] FIG. 39 is a diagram illustrating an example of an electronic device changing text within a message object into at least one emoji according to one embodiment.

[0047] FIG. 40 is a diagram illustrating an example in which the number of emojis displayed in relation to text by an electronic device according to one embodiment changes depending on the size of the message object.

[0048] FIG. 41A is a side view illustrating an example of a first state of a foldable electronic device including a plurality of hinge structures according to one embodiment.

[0049] FIG. 41b is a perspective view illustrating an example of a first state of a foldable electronic device including a plurality of hinge structures according to one embodiment.

[0050] FIG. 41c is a side view illustrating an example of a second state of a foldable electronic device including a plurality of hinge structures according to one embodiment.

[0051] FIG. 41d is a perspective view illustrating an example of a second state of a foldable electronic device including a plurality of hinge structures according to one embodiment.

[0052] FIG. 41e is a side view illustrating an example of a third state of a foldable electronic device including a plurality of hinge structures according to one embodiment.

[0053] FIG. 41F is a perspective view illustrating an example of a third state of a foldable electronic device including a plurality of hinge structures according to one embodiment.

[0054] FIG. 42 is a drawing showing an example of displaying an execution screen of a message application as the folding state of an electronic device changes according to one embodiment.

[0055] FIG. 43 is a drawing showing an example in which an execution screen of an application related to a message is additionally displayed as the folding state of an electronic device changes according to one embodiment.

[0056] FIG. 44 is a block diagram of an electronic device within a network environment according to various embodiments.

[0057] FIG. 45 is a block diagram of an electronic device according to various embodiments.

[0058] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0059] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, for the purpose of clearly explaining the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar parts are designated with similar reference numerals throughout the specification.

[0060] The terms used in this disclosure are described as currently common terms, taking into account the functions mentioned herein. However, these terms may mean various other terms depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Therefore, the terms used in this disclosure should not be interpreted solely based on their names, but rather based on the meanings of the terms and the overall content of this disclosure.

[0061] Additionally, while terms such as first, second, etc. may be used to describe various components, the components should not be limited by these terms. These terms are used to distinguish one component from another.

[0062] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the cases where the parts are "directly connected" but also the cases where the parts are "electrically connected" with other elements intervening. Furthermore, when a part is said to "include" a component, this does not exclude other components, but rather includes other components, unless otherwise stated.

[0063] The phrases “in one embodiment” and the like appearing in various places throughout this disclosure do not necessarily all refer to the same embodiment.

[0064] An embodiment of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various hardware and / or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a given function. Furthermore, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented by algorithms that execute on one or more processors. Furthermore, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and / or data processing. Terms such as “mechanism,” “element,” “means,” and “configuration” may be used broadly and are not limited to mechanical and physical configurations.

[0065] Additionally, the connecting lines or connecting members between components depicted in the drawings are merely exemplary representations of functional connections and / or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that may be replaced or added.

[0066] The present disclosure will be described in detail with reference to the attached drawings below.

[0067] FIG. 1 is a drawing showing an example of an emoji being moved and displayed within an execution screen of a message application displayed on a screen of an electronic device according to one embodiment.

[0068] Referring to FIG. 1, an electronic device (1000) according to one embodiment can display an execution screen (10) of a message application, and can display messages (12, 13) input by a user into the electronic device (1000) and messages (14) received from another electronic device (not shown) within the execution screen (10). The electronic device (1000) can interpret the meaning of the messages (12, 13, 14) displayed within the execution screen and the context of the conversation, and display at least one emoji (16, 17) within the execution screen (10) based on the interpretation result. The electronic device (1000) can determine at least one emoji (16, 17) based on the meaning of the messages (12, 13, 14) displayed within the execution screen, and can determine the display attribute of the at least one emoji (16, 17). For example, the electronic device (1000) may determine display properties related to movement of at least one emoji (16, 17), and display at least one emoji (16, 17) according to an animation effect that moves the at least one emoji (16, 17) according to the determined display properties. For example, the electronic device (1000) may determine display properties related to deformation of at least one emoji (16, 17), and display at least one emoji (16, 17) according to an animation effect that moves the at least one emoji (16, 17) according to the determined display properties.

[0069] According to one embodiment, the electronic device (1000) may be, but is not limited to, a smartphone, a tablet PC, a PC, a smart TV, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a micro server, a global positioning system (GPS) device, an e-book reader, a digital broadcasting terminal, a navigation device, a kiosk, an MP3 player, a digital camera, a home appliance, and other mobile or non-mobile computing devices. In addition, the electronic device (100) may be a wearable device such as a watch, glasses, a hair band, and a ring, having communication and data processing functions. However, the electronic device (100) is not limited thereto, and the electronic device (100) may include any type of device capable of displaying a message acquired through a network.

[0070] FIG. 2 is a flowchart of a method for an electronic device to move and display an emoji within an execution screen of a message application according to one embodiment.

[0071] In operation 210, the electronic device (1000) may obtain at least one text input into the execution screen of the message application. According to one embodiment, the electronic device (1000) may obtain a message received from another electronic device (not shown) through the message application and a message input into the electronic device (1000) by a user. For example, a message input into the electronic device (1000) by a user may be input through an input window in the execution screen of the message application. The electronic device (1000) may obtain at least one text included in the obtained message. For example, the message application may be an application that provides a conversation service between a user of the electronic device (1000) and a user of another electronic device (not shown).

[0072] In operation 220, the electronic device (1000) may obtain information indicating the meaning of at least one text and words included in the at least one text by analyzing at least one text. According to one embodiment, the electronic device (1000) may identify the meaning of the at least one text, input intent, and words included in the at least one text based on natural language interpretation of the at least one text. For example, the electronic device (1000) may analyze the at least one text using a natural language understanding (NLU) model. For example, the electronic device (1000) may analyze the at least one text using a generative AI model that utilizes natural language interpretation technology.

[0073] According to one embodiment, the electronic device (1000) may obtain information (e.g., intent) representing the meaning of at least one text and / or words included in at least one text using a natural language understanding (NLU) model. According to one embodiment, the electronic device (1000) may use, for example, NLU technology and / or artificial intelligence technology to understand the meaning of at least one text displayed on an execution screen of a message application. According to one embodiment, the electronic device (1000) may analyze text using, for example, an NLU model and obtain an intent related to a user's intention based on the analysis result. For example, the electronic device (1000) may input at least one text into the NLU model and obtain an intent output from the NLU model. The NLU model may be a model trained to obtain an intent corresponding to the text by interpreting the text to understand the meaning of the conversation. The intent may be information representing the user's input intent for the text. According to one embodiment, the NLU model may be an artificial intelligence model trained for natural language interpretation, but is not limited thereto.

[0074] For example, the electronic device (1000) can determine a user's intent from text by performing syntactic analysis or semantic analysis using an NLU model. In one embodiment, the electronic device (1000) can parse text into units of morphemes, words, or phrases using the NLU model, and infer the meaning of words extracted from the parsed text by using linguistic features (e.g., grammatical elements) of the parsed morphemes, words, or phrases. In addition, the electronic device (1000) can determine an intent corresponding to the meaning of the inferred word by comparing the meaning of the inferred word with predefined intents provided by the NLU model.

[0075] According to one embodiment, the electronic device (1000) may obtain intents and parameters output from an NLU model. An intent is information determined by interpreting text using the NLU model and may represent a user's input intent. For example, an intent may be information indicating a conversational intent that the user wishes to convey to the other party. An intent may include not only information indicating the user's input intent (hereinafter, "intent information") but also a numerical value corresponding to the information indicating the user's input intent. The numerical value may represent a probability that the text is related to information indicating a specific intent. When multiple pieces of information indicating the user's intent are acquired as a result of interpreting text using the NLU model, the intent information with the largest numerical value corresponding to each piece of intent information may be determined as the intent. In addition, a parameter may be variable information for determining detailed actions intended by the user in relation to the intent. The parameter may include words related to the detailed actions intended by the user. A parameter is information related to an intent, and multiple parameters may correspond to a single intent. Parameters can include variable information that determines the user's intended detailed actions, as well as numerical values ​​indicating the probability that text is related to that variable information. When interpreting text using a natural language understanding model, multiple variable information items representing parameters can be obtained. In this case, the variable information with the largest numerical value corresponding to each variable information item can be determined as the parameter.

[0076] For example, if the text is “I’ll take a taxi to Seoul Station quickly,” the intent could be “Move by public transportation,” and the parameters could include “Seoul Station,” “taxi,” and “quickly.” Furthermore, if the text is “I’ll run quickly and get there!! I think I can get there within 5 minutes!!,” the intent could be “Run and get there,” and the parameters could include “quickly” and “5 minutes.” However, the intents and parameters acquired using the NLU model are not limited thereto. The intent can be set to include more specific content than the intents exemplified above.

[0077] According to one embodiment, the electronic device (1000) may acquire words from at least one text. For example, the words acquired from the at least one text may include words related to the movement of an emoji and words related to the intensity of the movement of the emoji. For example, words related to a predetermined meaning and a predetermined intent for determining the selection and display properties of an emoji may be acquired from the at least one text. For example, the electronic device (1000) may identify whether a word with a preset meaning and / or intent for determining the selection and display properties of an emoji is included among the words included in the at least one text. According to one embodiment, the electronic device (1000) may also acquire parameters acquired using an NLU model as specific words.

[0078] For example, if the text is “I’ll take a taxi to Seoul Station quickly,” the electronic device (1000) can acquire “taxi” and “quickly” as specific words. For example, “quickly” may be a word related to the intensity of movement. Also, for example, if the text is “I’ll run quickly and get there!! I think I can get there within 5 minutes!!,” the electronic device (1000) can acquire “quickly” and “5 minutes” as specific words. For example, “quickly” and “5 minutes” may be words related to the intensity of movement.

[0079] According to one embodiment, the electronic device (1000) can interpret the meaning of each sentence included in a message within an execution screen, for example. Furthermore, for example, the electronic device (1000) can interpret the meaning of each message within the execution screen. In this case, the electronic device (1000) can interpret the meaning of multiple sentences within a message. Furthermore, for example, the electronic device (1000) can interpret the intent of a conversation based on the messages by interpreting the meaning of multiple messages within the execution screen. According to one embodiment, the electronic device (1000) can obtain an intent and a specific word related to the user's intent based on the result of at least one of the above interpretations.

[0080] In operation 230, the electronic device (1000) can identify whether at least one text is related to movement based on information indicating the meaning of at least one text.

[0081] According to one embodiment, an electronic device (1000) can use an NLU model to identify whether an intent obtained from at least one text is related to movement. For example, an intent related to movement may be an intent related to the movement of a person and / or an object. For example, if an intent includes a word related to movement, the electronic device (1000) can determine that the intent corresponding to at least one text is related to movement.

[0082] For example, if the text is “I’ll take a taxi to Seoul Station quickly,” the intent may be “movement using transportation,” and the electronic device (1000) can determine that the intent is related to movement based on “movement” included in the intent and that the text “I’ll take a taxi to Seoul Station quickly.” is related to movement.

[0083] Also, for example, if the text is “I’ll run quickly and get there!! I think I can get there within 5 minutes!!”, the intent may be “I’ll run and get there”, and the electronic device (1000) can determine that the intent is related to movement based on “run” and “move” included in the intent and that the text “I’ll run quickly and get there!! I think I can get there within 5 minutes!!” is related to movement.

[0084] An electronic device (1000) according to one embodiment can identify whether at least one text contains a word related to movement. For example, if at least one text contains a word related to movement, the electronic device (1000) can determine that the input intent of at least one text is related to movement.

[0085] In operation 230, it is described as identifying whether an intent obtained from at least one text is related to movement, but this is not limited thereto. For example, it may be possible to identify whether an intent obtained from at least one text is related to a change in emotion and / or facial expression. In this case, the display properties of an emoji related to a change in emotion and / or facial expression may be determined.

[0086] In operation 240, the electronic device (1000) may determine at least one emoji and display properties of at least one emoji corresponding to at least one of the information or words representing the meaning of at least one text. According to one embodiment, the electronic device (1000) may determine at least one emoji and display properties of at least one emoji corresponding to the intent and a specific word based on whether the intent obtained from the NLU model is related to movement.

[0087] According to one embodiment, emojis and display properties of emojis corresponding to intents and words may be preset. For example, categories of emojis corresponding to intents and words, display properties related to emoji transformations, and display properties related to emoji movement may be preset.

[0088] According to one embodiment, the electronic device (1000) can identify a category of emojis based on an intent and a word, and select at least one emoji from among the emojis within the identified category. The electronic device (1000) can select one or more emojis based on display properties regarding variations of the emoji, which will be described later.

[0089] According to one embodiment, the electronic device (1000) may determine display properties of an emoji based on an intent and a word. According to one embodiment, the display properties of the emoji may include display properties related to deformation of the emoji and display properties related to movement of the emoji.

[0090] Display properties relating to the transformation of an emoji may include, for example, display properties relating to changes in the shape of the emoji, and / or display properties relating to changes from the display of an emoji to the display of another emoji. Examples of display properties relating to the transformation of an emoji are described in more detail in FIGS. 16 to 27 .

[0091] Display properties related to the movement of an emoji may include, for example, display properties related to the movement of an emoji within the execution screen of a messaging application, such as display properties related to the movement path of the emoji (e.g., the start position, end position, and movement trajectory of the emoji) and / or the movement speed. Additionally, the movement speed of the emoji may be determined based on words related to the intensity of the movement of the emoji within the text.

[0092] An example of a method for identifying emojis and display properties of emojis according to one embodiment is described in more detail in FIG. 3 . Furthermore, an example of determining display properties related to the movement of emojis according to one embodiment is described in more detail in FIG. 5 . Furthermore, examples of display properties related to the movement of emojis according to one embodiment are described in more detail in FIGS. 9 to 15 .

[0093] According to one embodiment, the electronic device (1000) can perform operations 220 to 240 together by using a generative AI model. A method by which the electronic device (1000) identifies display properties of an emoji from text by using the generative AI model will be described in more detail later in FIG. 4.

[0094] In operation 250, the electronic device (1000) may display at least one emoji at a preset location within the execution screen of the message application. In operation 260, the electronic device (1000) may move the display location of the at least one emoji based on the identified display properties. According to one embodiment, the electronic device (1000) may move and display the emoji within the execution screen of the message application based on the display properties of the emoji. For example, the electronic device (1000) may move and display the emoji based on the display properties related to the movement of the emoji. In addition, for example, the electronic device (1000) may move and display the emoji while deforming it based on the display properties related to the deformation of the emoji and the display properties related to the movement of the emoji.

[0095] According to one embodiment, the electronic device (1000) may transmit information regarding text, emoji, and animation effects of the emoji inputted in the execution screen of the message application to another electronic device (not shown) through the message application. In this case, the other electronic device (not shown) may display the emoji together with the text according to the animation effect through the execution screen of the message application running on the other electronic device (not shown) based on the information regarding the text, emoji, and animation effects of the emoji.

[0096] In the above, the electronic device (1000) has been described as using an NLU model to interpret the meaning of text included in a message and to select and display emojis, but is not limited thereto. For example, the electronic device (1000) may select, move, and display emojis based on words included in the text. In this case, the category of the emoji, the emoji, and / or the display properties of the emoji may be preset in response to at least one word included in the text. In addition, for example, the electronic device (1000) may use an AI model, such as a generative AI (artificial intelligence) model, to interpret the meaning of the text or identify emojis and display properties of emojis from the text. An example of identifying emojis and display properties of emojis from text using a generative AI model will be described in more detail with reference to FIG. 4.

[0097] FIG. 3 is a flowchart of a method for an electronic device according to one embodiment to identify emojis and display properties of emojis related to text within an execution screen of a message application based on an NLU model.

[0098] The operations of FIG. 3 may correspond to identification numbers 220 to 240 of FIG. 2.

[0099] In operation 310, the electronic device (1000) may input at least one text to the NLU model. According to one embodiment, the electronic device (1000) may input at least one text to the NLU model based on a message within the execution screen of a message application. For example, the electronic device (1000) may interpret the meaning of each sentence included in a message within the execution screen by inputting the sentence to the NLU model.

[0100] Additionally, for example, the electronic device (1000) can interpret the meaning of each message by inputting sentences included in each message within the execution screen into the NLU model.

[0101] Additionally, for example, the electronic device (1000) may interpret the intent of a conversation based on multiple messages by inputting multiple sentences contained in multiple messages within the execution screen into an NLU model. In this case, the electronic device (1000) may input a preset number of recently input messages from among the multiple messages within the execution screen into the NLU model, but is not limited thereto.

[0102] In operation 320, the electronic device (1000) can obtain an intent indicating an input intention of at least one text and words included in at least one text.

[0103] According to one embodiment, the electronic device (1000) may use an NLU model that receives at least one text as input to acquire intents and words related to at least one text. In this case, the words may include, but are not limited to, parameters output from the NLU model and / or words extracted from the text. For example, the words extracted from the at least one text may be words acquired without using the NLU model.

[0104] For example, if each sentence included in a message within an execution screen is input to an NLU model, the electronic device (1000) can obtain intents and words related to each sentence.

[0105] Additionally, for example, when sentences included in a message are input into an NLU model for each message in the execution screen of the electronic device (1000), the electronic device (1000) can obtain intents and words related to the message for each message.

[0106] Additionally, for example, when multiple sentences included in multiple messages within an execution screen are input to an NLU model, the electronic device (1000) can obtain intents and words related to the multiple messages.

[0107] In operation 330, the electronic device (1000) may determine whether an intent is related to movement. According to one embodiment, the electronic device (1000) may determine whether an intent related to at least one text is related to movement. For example, the intent related to movement may be an intent related to the movement of a person and / or an object. According to one embodiment, a specific word may be used as an auxiliary tool to determine whether the intent is related to movement.

[0108] According to one embodiment, when each sentence included in a message within an execution screen is input to an NLU model, the electronic device (1000) can determine, for each sentence, whether the intent related to the sentence is related to movement. In addition, the electronic device (1000) can identify, for each sentence within the message, whether the intent is related to movement.

[0109] According to one embodiment, when sentences contained in a message within a running screen are input to an NLU model, the electronic device (1000) can determine whether the intent of the message is related to movement, for each message. In addition, the electronic device (1000) can identify whether the message is related to movement, for each message.

[0110] Additionally, for example, when multiple sentences contained in multiple messages within an execution screen are input to an NLU model, the electronic device (1000) can identify whether the intents of the multiple messages are related to movement. Furthermore, the electronic device (1000) can identify that the topic of the conversation through the messages is related to movement.

[0111] If it is determined in operation 330 that the intent is related to movement, in operation 340, the electronic device (1000) may select an emoji corresponding to an emoji category related to at least one of the intent or words.

[0112] According to one embodiment, at least one emoji category matching at least one of the intents or words may be preset. For example, the electronic device (1000) may select at least one emoji category from among the emoji categories matching the intent and a specific word. Additionally, at least one emoji may be selected from among the emojis belonging to the selected emoji category.

[0113] For example, emoji categories may include, but are not limited to, facial expressions, people, bodies, plants and animals, food, sports, transportation, buildings, and weather. Furthermore, for example, an emoji category may include a supercategory and at least one subcategory. For example, the supercategory may be "expression," and the subcategories of "expression" may include "joy," "sadness," "laughter," and "crying."

[0114] For example, in the case where the intent “go by taxi” and specific words “weather,” “sunny,” and “Seoul Station” are acquired from the text “If the weather is clear, I will go to Seoul Station by taxi,” the electronic device (1000) can select at least one emoji from among the emojis in the “transportation” category, the emojis in the “weather” category, and the emojis in the “building” category from the intent “go by taxi.”

[0115] In operation 350, the electronic device (1000) may identify a display attribute related to a variation of an emoji corresponding to at least one of an intent or words. According to one embodiment, a criterion related to a variation of an emoji related to at least one of an intent or words may be preset, and the electronic device (1000) may identify a display attribute related to a variation of an emoji based on the preset criterion.

[0116] According to one embodiment, the display properties related to the transformation of an emoji may include display properties related to the size of the emoji and / or the number of times the size of the emoji changes. In this case, the electronic device (1000) may determine the size of the emoji and / or the number of times the size changes based on the intent and / or specific words. For example, the electronic device (1000) may identify words with the same meaning among the words included in the intent and specific words, and determine the size of the emoji based on the number of times the words with the same meaning are repeated. For example, if the word “too” is repeated among the words included in the intent and specific words, the size of the emoji may be determined based on the number of times the word is repeated. For example, the larger the number of times the word is repeated, the larger the size of the emoji to be displayed may be set. In addition, the electronic device (1000) may determine how many times the size of the emoji to be displayed will change based on the number of times the words are repeated.

[0117] According to one embodiment, the display properties related to the transformation of an emoji may include display properties related to the shape change of the emoji and / or the number of emojis. In this case, the electronic device (1000) may determine the display properties related to the shape change of the emoji and / or the number of emojis based on the intent and / or specific words. For example, the electronic device (1000) may identify words corresponding to the same upper category among the words included in the intent and specific words, and determine the display properties related to the shape change of the emoji and / or the change of the emoji based on the identified words. For example, from the text “I’m sad now, but when I feel better, I’ll go to Seoul Station,” the intent “Movement according to mood” may be acquired, and specific words such as “sadness,” “joy,” and “Seoul Station” may be acquired. In this case, the electronic device (1000) may determine the display properties of the emoji so that the shape of the emoji changes from a sad expression to a happy expression in the 'expression' category based on "sadness" and "joy." Alternatively, the electronic device (1000) may determine the display properties of the emoji so that the emoji changes from a sad expression to a happy expression.

[0118] In action 360, the electronic device (1000) can identify display properties regarding movement of an emoji corresponding to at least one of the intents or words.

[0119] According to one embodiment, criteria for movement of emojis related to intents and / or specific words may be preset, and the electronic device (1000) may identify display properties for movement of emojis according to the preset criteria.

[0120] According to one embodiment, the display properties related to the movement of an emoji may include display properties related to the movement path of the emoji (e.g., the start position, end position, and movement trajectory of the emoji) and / or the movement speed. In this case, the electronic device (1000) may determine the movement path of the emoji (e.g., the start position, end position, and movement trajectory of the emoji) and / or the movement speed based on an intent and / or a specific word.

[0121] The method by which the electronic device (1000) determines display properties regarding the movement of an emoji will be described in more detail in FIG. 5, which will be described later.

[0122] Although the electronic device (1000) has been described above as performing operations 340 to 360 as separate operations, this is not limited thereto. At least two or more of operations 340 to 360 may be performed together by the electronic device (1000).

[0123] If it is determined in operation 330 that the intent is not related to movement, in operation 370, the electronic device (1000) may select an emoji corresponding to an emoji category related to at least one of the intent or words, and in operation 380, the electronic device (1000) may identify a display attribute regarding a variation of the emoji corresponding to at least one of the intent or words. Since operation 370 corresponds to operation 340 and operation 380 corresponds to operation 350, descriptions of operations 370 and 380 will be omitted for convenience.

[0124] FIG. 4 is a flowchart of a method for an electronic device according to one embodiment to identify emojis and display properties of emojis related to text within an execution screen of a message application based on a generative AI model.

[0125] The operations of FIG. 4 may be performed by an electronic device in place of identification numbers 220 to 240 of FIG. 2.

[0126] In operation 410, the electronic device (1000) may input an input prompt including at least one text to the generative AI model.

[0127] According to one embodiment, the electronic device (1000) may generate an input prompt to be input to a generative AI model and provide the generated input prompt to the generative AI model. The generative AI model may include an AI model trained to select an emoji based on a conversation. A generative AI model may generally refer to an AI neural network that creates new types of data based on user input information. A generative AI model may include an image generation model and / or a language generation model. Representative models for generating images include a generative adversarial network (GAN) and a variational autoencoder (VAE), and examples include a VAE and a Diffusion-based generative model using a Transformer structure. A language generation model is a model trained to output the most statistically appropriate output based on an input value, and representative examples include models such as CHAT-GPT 3 and CHAT-GPT 4. In addition, there are also LMMs (large multimodal models) that can recognize various types of data input, such as text, images, and voice, and generate new data corresponding to them. For example, a generative AI model may be, but is not limited to, a generative model using a generative adversarial network (GAN), variational auto encoder (VAE), Diffusion, or Transformer architecture.

[0128] According to one embodiment, the electronic device (1901) may generate an input prompt that includes at least one text within the execution screen of a messaging application, information regarding criteria for selecting an emoji, and / or information regarding criteria for determining display properties of an emoji. For example, the input prompt may be generated in the form of a script containing sentences in natural language format. The input prompt may be generated in a format supported by the identified generative AI model.

[0129] For example, the electronic device (1901) may generate an input prompt such as “Recommend an emoji and display properties of the emoji that reflect the intent of the input message. The display properties of the emoji include display properties that change the shape of the emoji or move the emoji within the message window. The input message may be as follows: “I’ll run quickly and get there!! I think I can get there within 5 minutes!!””. However, examples of input prompts are not limited thereto, and various types of input prompts supported by the generative AI model may be generated.

[0130] In one embodiment, the input prompt may include at least one text within the message application launch screen. For example, the input prompt may include a single sentence within a message within the launch screen. Alternatively, for example, the input prompt may include a single message comprising multiple texts. Alternatively, for example, the input prompt may include multiple messages within the launch screen.

[0131] In operation 420, the electronic device (1000) may identify the display properties of the emoji and emojis recommended by the generative AI model. According to one embodiment, the electronic device (1000) may identify the display properties of the emoji and emojis recommended by the generative AI model based on the input prompt.

[0132] For example, if the input prompt includes a single sentence contained within a message within the execution screen, the electronic device (1000) can identify an emoji and the display properties of the emoji related to the input intent of the single sentence.

[0133] For example, if an input prompt includes a single message containing multiple texts, the electronic device (1000) can identify emojis and display properties of emojis related to the input intent of the single message containing multiple sentences.

[0134] For example, when an input prompt includes multiple messages within an execution screen, the electronic device (1000) can identify emojis and display properties of emojis related to the intent of a conversation based on the multiple messages.

[0135] FIG. 5 is a flowchart of a method for an electronic device to determine display properties related to movement of an emoji according to one embodiment.

[0136] The operations of Fig. 5 may correspond to identification number 360 of Fig. 2.

[0137] In operation 510, the electronic device (1000) may determine a starting position for displaying an emoji. According to one embodiment, the electronic device (1000) may determine a starting position for displaying an emoji based on an input intent (e.g., intent) of at least one text and / or a specific word within at least one text. The starting position for displaying an emoji may be a position related to a message object (e.g., a message bubble). For example, the electronic device (1000) may determine a starting position for displaying an emoji based on a position at which a specific word corresponding to the emoji is displayed within a message object (e.g., a message bubble). The message object may be an object on which the content of a message is displayed within an execution screen (e.g., a chat window) of a message application. For example, the message object may have a form of a message bubble or a message box containing the text of the message, but the form of the message object is not limited thereto.

[0138] For example, the electronic device (1000) can identify in which line a specific word corresponding to an emoji is displayed within a message object, and determine the start position of displaying the emoji based on the line on which the specific word is displayed.

[0139] For example, the electronic device (1000) can determine the start position of the display of the emoji depending on whether the message object is displayed on the right side of the execution screen of the message application (e.g., a message object of an outgoing message) or the message object is displayed on the left side (e.g., a message object of a received message).

[0140] For example, the electronic device (1000) may determine the start position of the display of an emoji so that it at least partially overlaps a specific word within a message object. For example, the electronic device (1000) may determine the start position of the display of an emoji so that the emoji at least partially overlaps the message object below the message object. For example, the electronic device (1000) may determine the start position of the display of an emoji so that the emoji at least partially overlaps the message object above the message object.

[0141] For example, the electronic device (1000) may determine the location around which a specific word is displayed within a message object as the starting location for displaying an emoji.

[0142] For example, the electronic device (1000) may determine the location outside the message object and around the edge of the message object as the start location for displaying the emoji. For example, a location outside the message object and spaced apart from the edge of the message object may be determined as the start location for displaying the emoji.

[0143] In operation 520, the electronic device (1000) may determine an end position for displaying an emoji. According to one embodiment, the electronic device (1000) may determine an end position for displaying an emoji based on an input intent (e.g., intent) of at least one text and / or a specific word included in at least one text. The end position for displaying an emoji may be a position where the movement of the displayed emoji ends.

[0144] For example, the electronic device (1000) can identify in which line a specific word corresponding to an emoji is displayed within a message object, and determine the end position of the display of the emoji based on the line on which the specific word is displayed.

[0145] For example, the electronic device (1000) can determine the end position of the display of the emoji depending on whether the message object is displayed on the right side of the execution screen of the message application (e.g., a message object of an outgoing message) or the message object is displayed on the left side (e.g., a message object of a received message).

[0146] For example, the electronic device (1000) may determine the end position of the display of an emoji so that it at least partially overlaps a specific word within a message object. For example, the electronic device (1000) may determine the end position of the display of an emoji so that the emoji at least partially overlaps the message object below the message object. For example, the electronic device (1000) may determine the end position of the display of an emoji so that the emoji at least partially overlaps the message object above the message object.

[0147] For example, the electronic device (1000) may determine the location around where a specific word is displayed within a message object as the end location of the display of the emoji.

[0148] For example, the electronic device (1000) may determine the end position of the display of the emoji as the location outside the message object and around the edge of the message object. For example, the end position of the display of the emoji may be determined as the location outside the message object and away from the edge of the message object.

[0149] For example, the electronic device (1000) may determine the surroundings of a message object and another message object as the end position of the display of the emoji. In this case, a message within the other message object may be a message that is related to the message within the message object.

[0150] In one embodiment, if the display of the emoji does not move, the end position of the display of the emoji may be the same as the start position.

[0151] In operation 530, the electronic device (1000) may determine a movement trajectory of the emoji. According to one embodiment, the electronic device (1000) may determine a movement trajectory of the emoji display based on an input intent (e.g., intent) of at least one text and / or a specific word included in at least one text. According to one embodiment, the electronic device (1000) may identify a motion attribute (e.g., running, jumping, etc.) related to movement based on an input intent (e.g., intent) of at least one text and / or a specific word included in at least one text, and determine a movement trajectory of the emoji display based on the motion attribute related to movement.

[0152] For example, the electronic device (1000) may determine a movement trajectory of an emoji representation such that the emoji moves along the edge of a message object. For example, the electronic device (1000) may determine a movement trajectory of an emoji representation such that the emoji has a specific movement trajectory at a portion of the edge of the message object. For example, the electronic device (1000) may determine a movement trajectory of an emoji representation such that the emoji moves from inside the message object to outside the message object. For example, the electronic device (1000) may determine a movement trajectory of an emoji representation such that the emoji moves within the message object. For example, the electronic device (1000) may determine a movement trajectory of an emoji representation such that the emoji moves from one message object to another in a parabolic or linear trajectory.

[0153] In action 540, the electronic device (1000) can determine the movement speed of the emoji.

[0154] According to one embodiment, the electronic device (1000) may determine the movement speed of an emoji display based on an input intent (e.g., intent) of at least one text and / or a specific word included in the at least one text. According to one embodiment, the electronic device (1000) may determine an intensity related to a user's movement based on an input intent (e.g., intent) of at least one text and / or a specific word within the at least one text, and determine the movement speed of the emoji display based on the determined intensity. For example, if the input intent (e.g., intent) of at least one text and / or a preset word within the at least one text includes a word related to the intensity of movement, the electronic device (1000) may determine the movement speed of the emoji display based on the meaning of the word related to the intensity of movement and whether it is repeated. For example, the speed of the emoji display may be determined based on words related to the intensity of movement, such as "hurry" or "quickly". For example, the speed of an emoji display may be determined based on the meaning of words related to the intensity of movement and / or whether words related to the intensity of movement are repeated.

[0155] FIG. 6 is a diagram showing examples of emojis according to one embodiment.

[0156] Referring to FIG. 6, emojis can be classified by emoji category. The emojis classified by emoji category can be stored within the electronic device (1000), or stored within a server (not shown) or another electronic device (not shown) accessible to the electronic device (1000).

[0157] For example, the classified emojis may include, but are not limited to, emojis in the 'expression' category (60), emojis in the 'people' category (61), emojis in the 'body' category (62), emojis in the 'plants and animals' category (63), emojis in the 'food' category (64), emojis in the 'sports' category (65), emojis in the 'weather' category (66), emojis in the 'sound movement' category (67), and emojis in the 'other' category (68).

[0158] For example, at least some of the emojis (60, 61, 62, 63, 64, 65, 66, 67, 68) may be static emojis whose shapes do not change. For example, at least some of the emojis (60, 61, 62, 63, 64, 65, 66, 67, 68) may be emojis that include an animated effect whose shapes change.

[0159] FIG. 7 is a diagram illustrating an example in which, according to one embodiment, the display movement of an emoji begins around a message object based on the location at which a word corresponding to the emoji is displayed within a message object containing text.

[0160] Referring to FIG. 7, the electronic device (1000) can identify in which line a preset word corresponding to an emoji is displayed within a message object (70), and determine the position where the display movement of the emoji will begin based on the line where the preset word is displayed. The message object may be an object in which the content of the message is displayed within the execution screen of a message application (e.g., a chat window). For example, the message object may have the form of a bubble or box containing the text of the message, but the form of the message object is not limited thereto.

[0161] For example, if the word “best” corresponding to the emoji (72) is located in the first line within the message object (70), the electronic device (1000) may display the emoji (72) around the upper border of the message object (70). For example, the electronic device (1000) may display the emoji (72) near the word “best” corresponding to the emoji (72). In addition, the electronic device (1000) may move the displayed emoji (72) away from the word “best” corresponding to the emoji (72). For example, the electronic device (1000) may move the emoji (72) toward the upper side of the message object (70).

[0162] For example, if the word “teolmulnage” corresponding to the emoji (74) is located on the last line in the message object (70), the electronic device (1000) can display the emoji (74) around the bottom border of the message object (70). For example, the electronic device (1000) can display the emoji (74) near the word “teolmulnage” corresponding to the emoji (74). In addition, the electronic device (1000) can move the displayed emoji (74) away from the word “teolmulnage” corresponding to the emoji (74). For example, the electronic device (1000) can move the emoji (74) toward the bottom of the message object (70).

[0163] For example, if the words “See you again soon” corresponding to the emoji (76) are located in the middle line between the first and last lines of the message object (70), the electronic device (1000) can display the emoji (76) around the left or right edge of the message object (70). For example, if the message object (70) is a message object displayed on the right side of the execution screen of a message application (e.g., a message object of an outgoing message), the electronic device (1000) can display the emoji (76) around the left edge of the message object (70). In addition, the electronic device (1000) can move the displayed emoji (76) away from the words “See you again soon” corresponding to the emoji (76). For example, the electronic device (1000) can move the emoji (76) towards the left side of the message object (70).

[0164] FIG. 8 is a diagram showing examples of emojis displayed around words corresponding to emojis according to one embodiment.

[0165] Referring to FIG. 8, the electronic device (1000) can display an emoji around a preset word corresponding to an emoji among words included in a message object.

[0166] Referring to the identification number 80 of FIG. 8, an emoji (80-4) may be displayed around the preset word “pretzel” within the message object (80-2). For example, the emoji (80-4) may be displayed around “pretzel” without overlapping with “pretzel”, but partially overlapping with the edge of the message object (80-2).

[0167] Referring to identification number 82 of FIG. 8, an emoji (82-4) may be displayed around a preset word “I” within a message object (82-2). For example, the emoji (82-4) may be displayed around “I” so as to partially overlap the edge of the message object (82-2) without overlapping with “I.”

[0168] Referring to the identification number 84 of FIG. 8, an emoji (84-4) may be displayed around the preset word “best” in the message object (84-2), and an emoji (94-6) may be displayed around the preset word “tearful.” For example, the emoji (84-4) may be displayed around “best” so as to partially overlap the edge of the message object (84-2) without overlapping with “best.” For example, the emoji (84-6) may be displayed around “tearful” so as to partially overlap with the edge of the message object (86-2) without overlapping with “tearful.”

[0169] FIG. 9 is a diagram showing an example of an emoji moving around a word corresponding to the emoji according to one embodiment.

[0170] Referring to FIG. 9, the electronic device (1000) can determine display properties related to the movement of the emoji in relation to the meaning of the word corresponding to the emoji.

[0171] Referring to the identification number 90 of FIG. 9, the electronic device (1000) can display an emoji (90-4) corresponding to a preset word “yoga” within a message object (90-2) by moving it. For example, the electronic device (1000) can display the emoji (90-4) by moving it up and down from a position spaced apart from the edge of the message object (90-2) to around “yoga” within the message object (90-2). In this case, considering the meaning of the preset word “yoga,” the display properties for the movement of the emoji (90-4) corresponding to “yoga” can be preset.

[0172] Referring to the identification number 92 of FIG. 9, the electronic device (1000) can display an emoji (92-4) corresponding to the preset word “jump” within the message object (92-2) by moving it. For example, the electronic device (1000) can display the emoji (92-4) by moving it from a position far from “jump” to a position closer to “jump” around the edge of the message object (90-2). In this case, considering the meaning of the preset word “jump,” the display properties for the movement of the emoji (92-4) corresponding to “yoga” can be preset.

[0173] Referring to the identification number 94 of FIG. 9, the electronic device (1000) can display an emoji (94-4) corresponding to the preset word “best” within the message object (94-2) by moving it. For example, the electronic device (1000) can display the emoji (94-4) by moving it from a position overlapping “best” within the message object (94-2) to a position not overlapping “best.” In this case, considering the meaning of the preset word “best,” the display properties for the movement of the emoji (94-4) corresponding to “best” can be preset.

[0174] FIG. 10 is a diagram illustrating an example in which an emoji is displayed at least partially overlapping a message object around a word corresponding to the emoji according to one embodiment.

[0175] Referring to FIG. 10, the electronic device (1000) can display an emoji so as to at least partially overlap a message object. The electronic device (1000) can display an emoji so as to at least partially overlap a message object, for example, based on the size of the emoji, the size of the execution screen of the message application, the size of the message object within the execution screen, the spacing between the message objects, and the size of the emoji. However, the present invention is not limited thereto, and the electronic device can display an emoji so as to at least partially overlap a message object based on various criteria.

[0176] Referring to the identification number 100 of FIG. 10, for example, the emoji (100-4) may be displayed so as to be partially overlapped and obscured by the message object (100-2) around the upper edge portion of the message object (100-2). In addition, the emoji (100-4) may be moved away from the upper edge portion of the message object (100-2). In addition, the emoji (100-4) may be moved so as to be partially overlapped on the message object (100-2) around the upper edge portion of the message object (100-2).

[0177] Referring to the identification number 102 of FIG. 10, for example, an emoji (102-4) corresponding to a preset word “pretzel” in a message object (100-2) may be displayed to overlap the preset word “pretzel” in the message object (100-2). In addition, the emoji (102-4) corresponding to “pretzel” may increase in size on “pretzel.” In addition, the emoji (102-4) that has increased in size may be moved to a position where it does not overlap with “pretzel.” However, the present invention is not limited thereto, and for example, the emoji (102-4) may also be moved from a position where it overlaps “pretzel” to a position where it does not overlap with “pretzel” as it increases in size.

[0178] FIG. 11 is a diagram illustrating an example of an emoji moving along the edge of a message object according to one embodiment.

[0179] Referring to FIG. 11, an emoji can move along various movement paths along the edge of a message object. The movement path of the emoji can be determined based on the input intent of the text within the message object and preset words within the message object.

[0180] Referring to identification number 110 of FIG. 11, for example, the electronic device (1000) can control the display of the emoji so that the emoji moves along the upper edge from the right to the left of the message object.

[0181] Referring to identification number 112 of FIG. 11, for example, the electronic device (1000) can control the display of the emoji so that the emoji moves along a closed curve of the edge of the message object.

[0182] Referring to identification number 114 of FIG. 11, for example, the electronic device (1000) may move the emoji so that the emoji moves from the left to the right along the upper edge of the message object. For example, the electronic device (1000) may control the display of the emoji so that the emoji moves while jumping multiple times.

[0183] Referring to identification number 116 of FIG. 11, for example, the electronic device (1000) can control the display of the emoji so that the emoji moves along the upper edge of the message object and then away from the edge of the message object.

[0184] Referring to identification number 118 of FIG. 11, for example, the electronic device (1000) can control the display of the emoji so that the emoji moves back and forth along the upper edge of the message object.

[0185] Referring to identification number 119 of FIG. 11, for example, if the input intent of the text includes an intent to change the user's movement direction, the electronic device (1000) may change the movement direction of the emoji. For example, the electronic device (1000) may control the display of the emoji so that after the emoji moves from one side of the message object away from the message object, the emoji moves toward the message object and along the upper edge of the message object.

[0186] FIG. 12 is a diagram illustrating an example of an emoji being moved away from or closer to a message object according to one embodiment.

[0187] Referring to FIG. 12, an emoji may move along a predetermined path to move away from or closer to the edge of a message object. The path of movement of the emoji may be determined based on the input intent of the text within the message object and preset words within the message object.

[0188] Referring to identification number 120 of FIG. 12, the electronic device (1000) can control the display of the emoji so that the emoji is displayed at a starting position spaced apart from the message object and then moves to an ending position around the edge of the message object.

[0189] Referring to identification number 122 of FIG. 12, the electronic device (1000) can control the display of the emoji so that the emoji is displayed at a starting position that partially overlaps the edge of the message object, then moves to a position away from the edge of the message object, and then moves to an ending position around the edge of the message object.

[0190] Referring to identification number 124 of FIG. 12, the electronic device (1000) can control the display of the emoji so that the emoji moves from a starting position away from the edge of the message object around one side of the message object to an ending position near the edge of the message object.

[0191] FIG. 13 is a diagram illustrating an example of an emoji moving across a message object according to one embodiment.

[0192] Referring to FIG. 13, an emoji can move along a predetermined path to move inside and outside a message object. The path of movement of the emoji can be determined based on the input intent of the text within the message object and preset words within the message object.

[0193] Referring to identification number 130 of FIG. 13, the electronic device (1000) can control the display of the emoji so that the emoji is displayed at a starting position spaced from one side of the message object and then moves across the interior of the message object to an ending position spaced from the other side of the message object.

[0194] Referring to identification number 132 of FIG. 13, the electronic device (1000) can control the display of the emoji so that the emoji moves across the interior of the message object multiple times.

[0195] FIG. 14 is a diagram illustrating an example of an emoji being moved within a message object according to one embodiment.

[0196] Referring to FIG. 14, an electronic device (1000) according to one embodiment may control the display of an emoji so that the emoji moves within a message object. In this case, the electronic device (1000) may determine the movement direction of the display of the emoji depending on the type of the message object. For example, if the message object is a message object of a received message, the electronic device (1000) may control the display of the emoji so that the emoji moves within the message object in a first direction. For example, if the message object is a message object of an outgoing message, the electronic device (1000) may control the display of the emoji so that the emoji moves within the message object in a second direction opposite to the first direction.

[0197] For example, when the electronic device (1000) moves an emoji related to a received message, the electronic device (1000) may control the display of the emoji so that the emoji moves from left to right within the message object (140) of the received message. In this case, as the emoji moves, the text within the message object (140) may be gradually displayed within the message object (140).

[0198] For example, when the electronic device (1000) moves an emoji related to an outgoing message, the electronic device (1000) may control the display of the emoji so that the emoji moves from right to left within the message object (140) of the outgoing message. In this case, as the emoji moves, the text within the message object (140) may be gradually displayed within the message object (140).

[0199] FIG. 15 is a diagram illustrating an example of an emoji being moved between message objects according to one embodiment.

[0200] Referring to FIG. 15, the electronic device (1000) can control the display of an emoji so that the emoji moves when the input intent of the text in the message object (150) is related to the user's movement. In this case, the electronic device (1000) can identify a message object (152) that includes a reply message to the message object (150). The electronic device (1000) can identify that the message object (150) and the message object (152) are related to the user's movement, and the electronic device (1000) can control the display of the emoji (154) so ​​that the emoji (154) related to the user's movement moves from the message object (150) to the message object (152). For example, the electronic device (1000) may control the display of the emoji (154) such that the emoji (154) moves along a parabolic path from around the top edge of the message object (150) to around the top edge of the message object (152).

[0201] FIG. 16 is a flowchart illustrating a method for an electronic device to determine display properties related to deformation of an emoji according to one embodiment. The operations of FIG. 16 may correspond to operations 240, 350, and / or 380.

[0202] In operation 1610, the electronic device (1000) may determine the number of emojis. According to one embodiment, the electronic device (1000) may determine the number of emojis to be displayed based on the input intent of at least one text and a specific word. For example, if there are multiple emoji categories (e.g., upper categories and / or lower categories) corresponding to preset words in at least one text, the electronic device (1000) may determine the number of emojis to be displayed as multiple. For example, if there are multiple input intents in at least one text, the electronic device (1000) may determine the number of emojis to be displayed as multiple. For example, if there are multiple specific words in at least one text, the electronic device (1000) may determine the number of emojis to be displayed as multiple.

[0203] In operation 1620, the electronic device (1000) may determine the size of an emoji. According to one embodiment, the electronic device (1000) may determine the size of an emoji based on the number of specific words that are repeated within at least one text. For example, if the same word is repeated within at least one text, the electronic device (1000) may determine the size of an emoji corresponding to the word based on the number of repetitions of the word. For example, if a word of the same category is repeated within at least one text, the electronic device (1000) may determine the size of an emoji corresponding to the word based on the number of repetitions of the word.

[0204] In operation 1630, the electronic device (1000) may determine the transformation time and display position of the emoji. According to one embodiment, the electronic device (1000) may determine the transformation time and display position of the emoji based on the input intent of at least one text and a specific word.

[0205] According to one embodiment, the electronic device (1000) may determine the transformation time of an emoji based on the number of emojis to be displayed through the transformation of the emoji. For example, the more emojis to be displayed through the transformation of the emoji, the shorter the transformation cycle of the emoji may be set by the electronic device (1000).

[0206] According to one embodiment, the electronic device (1000) may determine the transformation time of an emoji based on the number of emojis to be displayed through the transformation of the emoji and the length of the movement path. For example, the electronic device (1000) may set the transformation cycle of the emoji to be shorter as the number of emojis increases relative to the length of the movement path.

[0207] According to one embodiment, the electronic device (1000) may determine the display position of an emoji based on the meaning and / or position of a specific word corresponding to the emoji. For example, the electronic device (1000) may determine the display position of an emoji so that the emoji is displayed on or around a preset word within a message object. For example, the electronic device (1000) may determine the display position of an emoji so that the emoji at least partially overlaps a preset word or message object. Alternatively, the electronic device (1000) may determine the display position of an emoji so that the emoji is spaced apart from a preset word or message object.

[0208] FIG. 17 is a drawing for explaining an example of a deformed emoji according to one embodiment.

[0209] Referring to identification number 170 of FIG. 17, an emoji can be transformed through an animation effect. The animation effect of an emoji can include, but is not limited to, shape transformation, color transformation, or size transformation, for example. Furthermore, referring to identification number 172 of FIG. 17, an emoji transformation can be implemented by changing from one emoji to another.

[0210] FIG. 18 is a diagram illustrating an example of an emoji that is transformed based on the context of a message according to one embodiment.

[0211] Referring to FIG. 18, for example, an emoji may be displayed in a transformed form (180) depending on changes in the context of a message including at least one text. For example, if multiple categories correspond to the context of a message including at least one text, the emoji may be displayed in a transformed form. For example, if the context of a message including at least one text is the 'worry' category and the 'despair' category, which are subcategories within the expression category, the emoji may be transformed (180) to change from an emoji corresponding to the 'worry' category to an emoji corresponding to the 'despair' category.

[0212] For example, an emoji may be displayed transformed (182) as the time zone associated with a message containing at least one text changes. For example, as the time zone associated with a message containing at least one text changes from night to morning, an emoji may be displayed transformed (182) from an emoji in the 'night' category to an emoji in the 'morning' category.

[0213] For example, an emoji may be displayed in a transformed (184) manner as the emotion associated with a message containing at least one text changes. For example, as the emotion associated with a message containing at least one text changes from surprise, embarrassment, or astonishment, an emoji may be displayed in sequence as the emoji corresponding to the changing emotion changes (184).

[0214] FIG. 19 is a drawing for explaining an example of determining the size of an emoji when a preset word is repeated according to one embodiment.

[0215] Referring to Figure 19, for example, the size of an emoji may be determined based on the number of words corresponding to the same meaning among words contained in at least one text. For example, the size of an emoji may be determined based on the number of times a preset word is repeated in at least one text. Additionally, the size of an emoji may be determined based on the number of words that emphasize a preset word.

[0216] FIG. 20 is a diagram showing an example of changing the size of an emoji within the execution screen of a message application according to the repetition of a preset word according to one embodiment.

[0217] Referring to FIG. 20, for example, if the text in the first message object (200-1) includes one word “No,” an emoji corresponding to the word “No” may be displayed in the first size (200-7).

[0218] For example, if the text in the second message object (200-2) following the first message object (200-1) includes the word “no” twice, the accumulated number of “no” within the execution screen of the message application may be three. In this case, the emoji corresponding to the word “no” may be displayed in the second size (200-8). The second size (200-8) may be larger than the first size (200-7).

[0219] For example, if the text in the third message object (200-3) following the second message object (200-2) contains the word “no” three times, the accumulated number of “no” within the execution screen of the message application may be six. In this case, the emoji corresponding to the word “no” may be displayed in the third size (200-9). The third size (200-9) may be larger than the second size (200-8).

[0220] FIG. 21 is a drawing showing an example in which a plurality of emojis are displayed transformed according to a time cycle according to one embodiment.

[0221] Referring to FIG. 21, emojis related to at least one text within a message object (210-1) within the execution screen of a message application may be transformed according to a preset cycle. For example, at least one emoji related to the message object (210-1) may be transformed and displayed according to a cycle of N seconds.

[0222] FIG. 22 is a drawing showing an example in which an emoji is displayed partially overlapping a message object as its size changes according to one embodiment.

[0223] Referring to identification number 220-10 of FIG. 22, for example, the emoji (220-14) corresponding to the preset word “pretzel” within the message object (220-12) may be deformed so that the size of the emoji (220-14) gradually increases. In addition, as the size of the emoji (220-14) gradually increases, the display position of the emoji (220-14) may be moved from a position overlapping with “pretzel” to a position not overlapping with “pretzel.”

[0224] Referring to identification number 220-20 of FIG. 22, for example, the emoji (220-24) corresponding to the preset word “jump” in the message object (220-22) may be deformed so that the size of the emoji (220-24) gradually increases. In addition, based on “quickly” and “5 minutes” in the message object (220-22), a weight for “jump” may be determined, and the deformed size of the emoji (220-24) may be determined based on the determined weight.

[0225] FIG. 23 is a drawing showing an example of emojis displayed in multiple message objects moving to come into contact with each other according to one embodiment.

[0226] Referring to FIG. 23, for example, a palm emoji (230-2) corresponding to a preset word “fighting” in a first message object (230-1) may be displayed around the first message object (230-1). In addition, a palm emoji (230-3) may be displayed around a second message object (230-2) that includes a reply message to the first message object (230-1). Thereafter, the palm emoji (230-2) moves toward the second message object (230-3), and the palm emoji (230-3) moves toward the first message object (230-2), so that the palm emoji (230-2) and the palm emoji (230-3) may partially overlap each other. Additionally, as the palm emoji (230-2) overlaps with the palm emoji (230-3), an animation effect (230-4) representing a clapping hand effect may be displayed.

[0227] FIG. 24 is a drawing showing an example of an emoji changing while moving according to one embodiment.

[0228] Referring to identification number 240-10 of FIG. 24, for example, an emoji (240-15) corresponding to a preset word “jump” in a message object (240-11) and an emoji (240-16) corresponding to “sorry” may be displayed. For example, the display order of the emojis may be determined according to the display order of the preset words in the text in the message. For example, if “jump” is displayed before “sorry” in the message object (240-11), the emoji (240-15) corresponding to “jump” may be displayed first, and the emoji (240-15) may move from one side of the message object (240-11) across the message object (240-11) to a position spaced apart from the other side of the message object (240-11). Afterwards, the emoji corresponding to “jump” (240-15) may be changed to the emoji corresponding to “sorry” (240-16).

[0229] Referring to identification number 240-20 of FIG. 24, for example, an emoji (240-25) corresponding to a preset word “jump” in a first message object (240-21) may be displayed around the first message object (240-21). The electronic device (1000) may determine the movement speed of the emoji (240-25) based on “5 minutes” in the first message object (240-21). In addition, for example, a second message object (240-22) corresponding to a reply to the first message object (240-21) may be displayed. The electronic device (1000) may identify that the second message object (240-22) corresponds to a reply to the first message object (240-21) based on the input intent of the text in the second message object (240-22). The electronic device (1000) may set the end position of the movement of the emoji (240-25) to the vicinity of the second message object (240-22). In addition, the electronic device (1000) may change the movement speed of the emoji (240-21) based on the preset word “slowly” in the second message object (240-22). Thereafter, the emoji (240-25) may move from the vicinity of the first message object (240-21) to the vicinity of the second message object (240-22), and the movement speed of the emoji (240-25) may decrease.

[0230] Referring to identification number 240-30 of FIG. 24, for example, an emoji (240-35) corresponding to a preset word “run” in a message object (240-31) and an emoji (240-36) corresponding to “What is it?” may be displayed. For example, the display order of the emojis may be determined according to the display order of the preset words in the text in the message. For example, if “run” is displayed before “What is it?” in the message object (240-31), the emoji (240-35) corresponding to “run” may be displayed first and the emoji (240-35) may move from one side of the message object (240-31) toward the other side of the message object (240-31). Thereafter, the emoji (240-35) corresponding to “run” may be changed to the emoji (240-36) corresponding to “What is it?”

[0231] FIG. 25 is a drawing showing an example in which the size of an emoji is changed according to one embodiment, then changed to another emoji, and then the changed emoji disappears.

[0232] Referring to FIG. 25, when a preset message is input, the electronic device (1000) can control the display of the emoji so that the emoji is transformed and displayed and then disappears.

[0233] For example, “text message that disappears after 30 seconds” may be input into a message application, and the input message may be displayed within a message object (250-1). The electronic device (1000) may identify the “text message that disappears after 30 seconds” and display a bomb emoji (250-3) around the message object (250-1). In addition, the electronic device (1000) may increase the size of the bomb emoji (250-3) over time. Thereafter, the message within the message object (250-1) may be changed to “3…2…1” corresponding to a countdown action, and the bomb emoji (250-3) may be changed to an exploding emoji (250-4). Thereafter, the exploding emoji (250-4) may disappear. In addition, for example, in this case, the emoji may be displayed differently depending on the size or shape of the execution screen.

[0234] FIG. 26 is a diagram showing an example of an emoji with a specific animation effect being displayed and then disappearing according to one embodiment.

[0235] Referring to FIG. 26, when a preset message is input, the electronic device (1000) can control the display of the emoji so that it displays and then disappears an emoji with a specific animation effect.

[0236] For example, a message such as “text message that disappears after 30 seconds” may be input into a message application, and the input message may be displayed within a message object (260-1). The electronic device (1000) may identify the message as “text message that disappears after 30 seconds” and display an emoji (260-3) with an animated effect whose facial expression changes around the message object (260-1). Thereafter, the message within the message object (250-1) may be changed to “3…2…1” corresponding to a countdown motion, and the emoji (260-3) that changes according to the animated effect may disappear.

[0237] FIG. 27 is a diagram showing an example of an emoji of a specific animation effect being changed to another emoji and the changed other emoji disappearing according to one embodiment.

[0238] Referring to FIG. 27, when a preset message is input, the electronic device (1000) can control the display of the emoji so that the electronic device (1000) displays an emoji with a specific animation effect, changes the emoji to another image, and causes the changed other emoji to disappear.

[0239] For example, a “text message that disappears after 30 seconds” may be input into a message application, and the input message may be displayed within a message object (270-1). The electronic device (1000) may identify the “text message that disappears after 30 seconds” and display an emoji (270-3) providing a fire animation effect around the message object (270-1). Thereafter, the message within the message object (250-1) may be changed to “3…2…1” corresponding to a countdown action, and the emoji (270-3) providing the animation effect may be changed to a smoke-shaped emoji (270-4). Thereafter, the smoke-shaped emoji (270-4) may disappear.

[0240] FIG. 28 is a flowchart of a method for an electronic device to display multiple emojis based on multiple texts according to one embodiment.

[0241] In operation 2810, the electronic device (1000) may display a first emoji based on a first text. According to one embodiment, the electronic device (1000) may display a first emoji related to the first text within a first message object within an execution screen of a message application. The first message object may be a message object of an outgoing message or a message object of a received message.

[0242] According to one embodiment, the electronic device (1000) can obtain information indicating the input intent of the first text and specific words included in the first text by analyzing the first text. The electronic device (1000) can obtain information indicating the input intent of the first text and specific words included in the first text by using natural language interpretation technology. For example, the electronic device (1000) can obtain information indicating the input intent of the first text and preset words included in the first text by using an NLU model and / or a generative AI model, but is not limited thereto.

[0243] According to one embodiment, the electronic device (1000) may determine information indicating an input intent of a first text, a first emoji related to a specific word included in the first text, and a display attribute of the first emoji, and display the first emoji in a first message object including the first text.

[0244] In operation 2820, the electronic device (1000) may receive a second text. In one embodiment, the electronic device (1000) may receive a second text corresponding to the first text after the first text is displayed. The second text may be the text of an outgoing message or the text of an incoming message.

[0245] In operation 2830, the electronic device (1000) may select a second emoji that can interact with the first emoji from among the emojis associated with the second text. According to one embodiment, the electronic device (1000) may analyze the second text to select a second emoji that can interact with the first emoji from among the emojis associated with the second text. The emojis that can interact may be emojis that can provide a single animation effect through multiple emojis.

[0246] According to one embodiment, the electronic device (1000) can obtain information indicating the input intent of the second text and specific words included in the second text by analyzing the second text. The electronic device (1000) can obtain information indicating the input intent of the second text and specific words included in the second text by using natural language interpretation technology. For example, the electronic device (1000) can obtain information indicating the input intent of the second text and preset words included in the second text by using an NLU model and / or a generative AI model, but is not limited thereto.

[0247] According to one embodiment, the electronic device (1000) can identify that the second text is associated with the first text based on information indicating the input intent of the second text and specific words included in the second text. For example, if the first text is the text of an outgoing message and the second text is the text of a received message, the electronic device (1000) can identify that the second text corresponds to a reply to the first text. For example, if the first text is the text of an outgoing message and the second text is the text of an outgoing message, the electronic device (1000) can identify that the second text corresponds to a reply to the first text.

[0248] According to one embodiment, the electronic device (1000) may select a second emoji that can interact with the first emoji from among emojis related to the second text based on information indicating the input intent of the second text and a specific word included in the second text. In this case, the electronic device (1000) may select the second emoji by considering the information indicating the input intent of the first text, the specific word included in the first text, information indicating the input intent of the second text, and the specific word included in the second text. In addition, information regarding a set of emojis that provide interaction may be stored in advance in the electronic device (1000). For example, if the first emoji is a palm emoji that provides an animation effect of a high pipe, the electronic device (1000) may select another palm emoji from the set of emojis for the animation effect of the high pipe as the second emoji. For example, if the first emoji is a human emoji that provides an animation effect of stopping a person's movement, the electronic device (1000) may select an emoji representing stopping as the second emoji from the set of emojis for the animation effect of stopping a person's movement.

[0249] According to one embodiment, the electronic device (1000) may determine the display properties of the first emoji and the display properties of the second emoji based on the preset display properties for the animation effects provided by the first emoji and the second emoji. For example, the electronic device (1000) may determine the display properties related to deformation and movement of the first emoji and the display properties related to deformation and movement of the second emoji based on the preset display properties for the animation effects provided by the first emoji and the second emoji.

[0250] In operation 2840, the electronic device (1000) may display the first emoji and the second emoji in association. According to one embodiment, the electronic device (1000) may display the first emoji and the second emoji in association based on the display properties of the first emoji and the display properties of the second emoji. An example of displaying the first emoji and the second emoji in association will be described in more detail later in FIGS. 29 and 20 .

[0251] FIG. 29 is a diagram illustrating an example of an electronic device according to one embodiment of the present invention that associates and displays multiple emojis based on multiple texts.

[0252] Referring to FIG. 29, for example, the electronic device (1000) may display a first message object (290-1) including an outgoing message such as “No, already? I’ll run quickly. I think I can get there within 5 minutes!!! Wait~ See you later. I’m running.” on the execution screen of the message application. By analyzing the texts in the outgoing message, the electronic device (1000) may display a first emoji (290-5) of a running person moving around the first message object (290-1).

[0253] Afterwards, the electronic device (1000) can receive the received message “STOP!!! I’ll be waiting. It’s hot if you run~ Don’t run and come slowly.^^”. The electronic device (1000) can identify that the received message is a reply message regarding the sent message by analyzing the texts in the received message. In addition, the electronic device (1000) can select a second emoji (290-7) indicating stop that can provide interaction with the first emoji (290-5) among the emojis related to the texts in the received message by analyzing the texts in the received message. In addition, the electronic device (1000) can additionally select a third emoji (290-6) to be changed from the first emoji (290-5) based on the setting regarding the animation effect by the interaction between the first emoji (290-5) and the second emoji (290-7).

[0254] Additionally, the electronic device (1000) can determine the display properties of the first emoji (290-5), the display properties of the second emoji (290-7), and the display properties of the third emoji (290-6) based on the settings regarding the animation effect by the interaction between the first emoji (290-5) and the second emoji (290-7).

[0255] Thereafter, the electronic device (1000) may display a second message object (290-2) including a second text, and move and display a first emoji (290-5) from one side of the first message object (290-1) to one side of the second message object (290-2). Thereafter, the electronic device (1000) may display a second emoji (290-7) and a third emoji (290-6) around one side of the second message object (290-2), and cause the first emoji (290-5) moved to one side of the second message object (290-2) to disappear.

[0256] FIG. 30 is a diagram illustrating an example of an electronic device according to one embodiment of the present invention that associates and displays multiple emojis based on multiple texts.

[0257] Referring to FIG. 30, for example, the electronic device (1000) may display a first message object (300-1) including an outgoing message such as “Thank you for your hard work. Fighting tomorrow too!” within the execution screen of a message application. By analyzing texts within the outgoing message, the electronic device (1000) may display a first palm emoji (300-5) indicating a fighting gesture around the first message object (300-1).

[0258] Thereafter, the electronic device (1000) may receive a received message such as “Yes, yes. Of course!” The electronic device (1000) may analyze the texts in the received message to identify that the received message is a reply message regarding the sent message. In addition, the electronic device (1000) may analyze the texts in the received message to select a second emoji (300-6) that can provide interaction with the first emoji (300-5) among the emojis related to the texts in the received message. The second emoji (3000-6) may be a palm emoji for providing an animation effect of a high five.

[0259] Additionally, the electronic device (1000) may additionally select a third emoji (300-7) to be displayed in place of the first emoji (300-5) and the second emoji (300-6), based on settings regarding animation effects resulting from interactions between the first emoji (300-5) and the second emoji (300-6). The third emoji (300-7) may be an emoji in the shape of clapping hands.

[0260] Additionally, the electronic device (1000) can determine the display properties of the first emoji (300-5), the display properties of the second emoji (300-6), and the display properties of the third emoji (300-7) based on the settings regarding the animation effect by the interaction between the first emoji (300-5) and the second emoji (300-6).

[0261] Thereafter, the electronic device (1000) may display a second message object (300-2) including a second text, and move the first emoji (300-5) from the first message object (300-1) toward the second message object (290-2) and move the first message object (300-5) from the second message object (300-2), thereby causing the first emoji (300-5) and the second emoji (300-6) to meet between the first message object (300-1) and the second message object (290-2). Thereafter, when the first emoji (300-5) and the second emoji (300-6) meet each other, the electronic device (1000) may display a third emoji (300-7) instead of the first emoji (300-5) and the second emoji (300-6).

[0262] FIG. 31 is a diagram illustrating an example in which an electronic device according to one embodiment determines display properties of an emoji based on multiple properties of text.

[0263] Referring to identification number 3100 of FIG. 31, the electronic device (1000) may determine whether a preset word or input intent referring to movement is identified within the text. For example, preset words or input intent referring to movement may include “I’ll run,” “I’ll go,” and “I’ll run.” If a word or input intent referring to movement is not identified, the electronic device (1000) may not provide emojis and animation effects, as indicated by identification number 3102.

[0264] If a word or input intent referring to movement is identified, at identification number 3110, the electronic device (1000) may include preset words or input intents related to degree / intensity within the text, such as “really,” “fast,” and “very.” If words related to degree / intensity are not used repeatedly, at identification number 3112, the electronic device (1000) may provide a running emoji in the surrounding area of ​​the main word within the text.

[0265] If words related to degree / intensity are used repeatedly, the electronic device (1000) may provide a running emoji in the surrounding area of ​​the main word in the text. At identification number 3120, the electronic device (1000) may determine whether words or input intents of different categories are identified in the text. For example, words or input intents of different categories may include “I will fly,” “I will fly,” and “I will fly.” If words or input intents of different categories are not identified, the electronic device (1000) may increase the size of the running emoji at identification number 3122. The size of the emoji may be determined based on the number of times words related to degree / intensity are repeated.

[0266] If words or input intents of different categories are identified, the electronic device (1000) can identify a word or input intent indicating directionality within the text at identification number 3130, the electronic device (1000) can identify a word or input intent related to movement distance within the text at identification number 3132, and the electronic device (1000) can identify a word or input intent related to movement speed within the text at identification number 3134.

[0267] For example, words or input intents indicating directionality may include, but are not limited to, "towards you," "going in the opposite direction and then turning back," "in the opposite direction," and "turning around." For example, words or input intents related to travel distance may include, but are not limited to, "500 meters left," "300 meters," and "almost there." For example, words or input intents related to travel speed may include, but are not limited to, "I'll get there within 5 minutes," and "I'll get there as quickly as possible."

[0268] Thereafter, at identification number 3140, the electronic device (1000) may display at least one emoji based on at least one of directionality, movement distance, or movement speed.

[0269] FIG. 32 is a flowchart of a method for an electronic device to display an emoji based on a user input for a list of recommended emojis according to one embodiment.

[0270] The operations of Figure 32 may be performed after operation 240.

[0271] In operation 3210, the electronic device (1000) may display a list of recommended emojis. According to one embodiment, the electronic device (1000) may recommend to the user at least one emoji and the display properties of the at least one emoji determined in operation 240. The list of recommended emojis may include recommended emojis displayed according to the message object and the recommended display properties.

[0272] In operation 3220, the electronic device (1000) can identify an emoji selected by the user from a list of recommended emojis. The electronic device (1000) can identify the emoji selected by the user based on the user's selection input for the list of recommended emojis.

[0273] In operation 3230, the electronic device (1000) can display the selected emoji within a message window according to the display properties. The electronic device (1000) can display the selected emoji from the list of recommended emojis according to the display properties of the selected emoji. The electronic device (1000) can display the selected emoji together with a message object within the execution screen of the message application.

[0274] FIG. 33 is a diagram illustrating an example of an electronic device displaying and changing an emoji based on a user input on an execution screen of a message application according to one embodiment.

[0275] Referring to FIG. 33, according to one embodiment, an electronic device (1000) may receive a message text from a user through a message input window (330-10). The electronic device (1000) may display the text entered by the user in the message input window (330-10). The message input window (330-10) may include an object (330-12) for recommending an emoji for the text entered by the user.

[0276] According to one embodiment, when an object (330-12) in a message input window (330-10) is selected by a user, the electronic device (1000) may display a list (330-20) of recommended emojis within the execution screen of the message application. The list (330-20) of recommended emojis may include a list of emojis displayed together with the message object.

[0277] According to one embodiment, the list of recommended emojis (330-20) may include an object (330-21) for editing the recommended emojis. When the object (330-21) for editing the recommended emojis is selected by the user, a list of emojis (330-30) that can be selected by the user may be displayed.

[0278] According to one embodiment, the list of recommended emojis (330-20) may include an object (330-23) for selecting a recommended emoji. When the object (330-23) for selecting a recommended emoji is selected by the user, the selected recommended emoji (330-50) may be displayed within the execution screen of the message application. The selected recommended emoji (330-50) may be displayed together with a message object (330-40) containing text entered by the user.

[0279] According to one embodiment, when a user input of long-touching a recommended emoji (330-50) is received, the electronic device (1000) may provide a GUI for editing the recommended emoji (330-50). For example, the electronic device (1000) may display an object (330-52) for deleting the recommended emoji (330-50). For example, the electronic device (1000) may display an emoji list (330-30) for selecting another emoji.

[0280] FIG. 34 is a diagram illustrating an example of an electronic device displaying and changing an emoji based on a user input on an execution screen of a message application according to one embodiment.

[0281] Referring to FIG. 34, an electronic device (1000) according to one embodiment may display an object (330-60) for applying an edited emoji to a message object within a GUI for editing a recommended emoji (330-50). In addition, when the object (330-60) is selected, the electronic device (1000) may apply the edited emoji to the message object. An object (330-60) indicating that the message object has been edited may be displayed around the message object to which the edited emoji has been applied.

[0282] FIG. 35 is a diagram illustrating an example of an electronic device removing an emoji displayed on a running screen of a message application based on a user input and displaying another emoji according to one embodiment.

[0283] Referring to FIG. 35, an electronic device (1000) according to one embodiment may display an emoji (350-10), an object (350-12) for deleting the emoji (350-10), and an object (350-14) for displaying a list of emojis within the execution screen of a message application. When the object (350-12) is selected, the emoji (350-10) may be deleted. Additionally, when the object (350-14) is selected, a list of emojis may be displayed.

[0284] In one embodiment, the electronic device (1000) may display an object (350-16) for resetting the editing of the emoji (350-10). When the object (350-16) is selected, the electronic device (1000) may reset the editing operation and display a screen (350-20) including the message object and emoji prior to editing.

[0285] FIG. 36 is a diagram illustrating an example of an electronic device rotating an emoji and changing the size and image properties of an emoji based on a user input on an execution screen of a message application according to one embodiment.

[0286] Referring to FIG. 36, an electronic device (1000) according to one embodiment may display an object (360-12) for editing an emoji (360-10) and the size and image properties of the emoji (360-10) within the execution screen of a message application. When the object (360-12) is selected, a GUI for changing the size of the emoji or changing the image properties (e.g., contrast) of the emoji may be displayed, for example.

[0287] In one embodiment, when the emoji (360-10) is long-touched, an object (360-14) for rotating the emoji (360-10) may be displayed.

[0288] FIG. 37 is a diagram illustrating an example of an electronic device changing the movement properties of an emoji based on a user input on an execution screen of a message application according to one embodiment.

[0289] Referring to FIG. 37, an electronic device (1000) according to one embodiment may display an object (370-10) for editing the movement path of an emoji within the execution screen of a message application. When the object (370-10) is selected, a list (370-12) of recommended movement paths of the emoji may be displayed, for example.

[0290] According to one embodiment, the list of recommended movement paths (370-12) of emojis may include a GUI (370-14) for drawing a movement path based on a user's drawing input. The electronic device (1000) may edit or determine the movement path of the emoji based on the user's drawing input through the GUI (370-14). After receiving the user's drawing input, the electronic device (1000) may receive a user input for selecting an object (370-16) for applying the movement path determined based on the user's drawing input to the emoji. Upon receiving the user input for selecting the object (370-16), the electronic device (1000) may apply the movement path determined based on the user's drawing input to the emoji.

[0291] FIG. 38 is a diagram illustrating an example of an electronic device according to one embodiment providing a new image combining the characteristics of multiple emojis.

[0292] Referring to FIG. 38, an electronic device (1000) according to one embodiment can obtain a third emoji (380-14) by combining a first emoji (380-10) and a second emoji (380-12).

[0293] For example, the electronic device (1000) can identify the first emoji (380-10) and the second emoji (380-12) selected based on user input, and identify the emoji attributes of the first emoji (380-10) and the second emoji (380-12). For example, the emoji attribute of the first emoji (380-10) can be 'ghost', and the emoji attribute of the second emoji (380-12) can be 'bouquet'. Based on the emoji attributes of the first emoji (380-10) and the second emoji (380-12), the electronic device (1000) can generate the third emoji (380-14) or select it from among emojis stored in the memory. For example, the emoji attribute of the emoji (380-14) could be 'ghost holding flowers'.

[0294] FIG. 39 is a diagram illustrating an example of an electronic device changing text within a message object into at least one emoji according to one embodiment.

[0295] Referring to FIG. 39, an electronic device (1000) according to one embodiment can change text within a message object (390-10) into an emoji. For example, an object (390-12) for changing text into an emoji may be displayed around the message object (390-10). When the object (390-12) is selected by a user, the text within the message object (390-10) may be changed into a plurality of emojis. In this case, the plurality of emojis may be determined based on the input intent of the text within the message object (390-10) and preset words within the text.

[0296] An electronic device (1000) according to one embodiment can change an emoji within a message object (390-10) into text. For example, an object (390-14) for changing an emoji into text may be displayed around the message object (390-10). When the object (390-14) is selected by a user, multiple emojis within the message object (390-10) may be changed into text.

[0297] FIG. 40 is a diagram illustrating an example in which the number of emojis displayed in relation to text by an electronic device according to one embodiment changes depending on the size of the message object.

[0298] Referring to FIG. 40, an electronic device (1000) according to one embodiment may set the number of emojis to be displayed differently depending on the size of the message object (400-10). For example, a different number of emojis may be displayed around the message object (400-10) depending on the horizontal size of the message object (400-10).

[0299] A method for providing an emoji related to a message of a message application executed by an electronic device (1000) according to one embodiment comprises: executing the message application installed in the electronic device; obtaining a text input in an input window of an execution screen of the message application (210); identifying words included in the text (220); obtaining first information indicating the meaning of the text by analyzing the text (220); identifying whether the first information is related to movement of at least one of a person or an object (230); identifying second information corresponding to properties for an animation effect related to movement of the emoji and the emoji within the execution screen based on the first information and a word related to the intensity of the movement among the words, wherein the second information includes information about a start position, an end position, and a movement speed for displaying the emoji; displaying the emoji at the start position related to a message bubble provided within the execution screen of the message application and including the text based on the second information (250); And based on the second information, the method may include an operation of displaying the emoji through the animation effect in which the emoji moves from the starting position related to the message bubble within the execution screen of the message application. In addition, the method may include an operation of transmitting the text, the emoji, and the second information to another electronic device through the message application.

[0300] Additionally, the first information indicating the meaning of the text may include an intent obtained from a natural language understanding (NLU) model based on the text and parameters related to the intent.

[0301] Additionally, the emoji can be identified by identifying a category corresponding to the intent and the parameters and selecting the emoji related to the text from among a plurality of emojis corresponding to the identified category.

[0302] Additionally, the movement speed of the emoji can be determined based on the word related to the intensity of the movement.

[0303] In addition, the operation of displaying the emoji at the starting position may display the emoji around a first text including a word related to the emoji within the execution screen of the message application, and the operation of displaying the emoji through the animation effect may display the emoji so that the emoji moves from the message bubble including the first text to another message bubble including a second text related to the first text within the execution screen.

[0304] In addition, the action of displaying the emoji at the starting position may display the emoji around a first text including a word related to the emoji within the execution screen of the message application, and the action of displaying the emoji through the animation effect may display the emoji so that the emoji moves along the edge of the message bubble including the first text.

[0305] In addition, the method further includes an operation of displaying another emoji related to another text; wherein the other emoji is displayed around the other text and the emoji is displayed around the text, and the other emoji and the emoji can be displayed within the execution screen so that the other emoji and the emoji move and come into contact with each other.

[0306] In addition, the method further includes an operation of identifying the number of times a word related to the emoji is repeated in the text; and based on the number of times, the size of the emoji can be determined.

[0307] Additionally, the second information includes information about an attribute regarding deformation of the emoji identified based on at least one of the first information or the words, and the operation of displaying the emoji through the animation effect can display the emoji that is deformed according to the attribute regarding deformation of the emoji.

[0308] Additionally, the modification of the emoji may include changing the shape of the emoji.

[0309] Additionally, variations of the above emoji may include multiple emojis being displayed sequentially.

[0310] Additionally, the property related to the animation effect regarding the movement of the emoji may be determined based on at least one of a folding state of the electronic device or a size of an area of ​​a display exposed to the outside of the electronic device.

[0311] In addition, the method may further include, after the text is input, an operation of displaying a recommendation list recommending the emoji and the properties of the emoji to the user; an operation of identifying an item selected by the user among the items included in the recommendation list; and an operation of displaying the emoji corresponding to the selected item according to the emoji and the properties of the emoji corresponding to the selected item.

[0312] Additionally, based on the second information about the transmitted text, the emoji, and the animation effect of the emoji, the text and the emoji according to the animation effect can be displayed through the execution screen of the message application running on the other electronic device.

[0313] FIG. 41A is a side view illustrating an example of a first state of a foldable electronic device including a plurality of hinge structures according to one embodiment. FIG. 41B is a perspective view illustrating an example of a first state of a foldable electronic device including a plurality of hinge structures according to one embodiment.

[0314] According to one embodiment, the electronic device (1000) of FIGS. 1 to 40 may be a foldable electronic device (100-1).

[0315] According to one embodiment, a foldable electronic device (100-1) may include a first housing (110-1), a second housing (120-1), a third housing (130-1), a first hinge structure (140-1), a second hinge structure (150-1), and a flexible display (160-1). The first hinge structure (140-1) may be disposed between the first housing (110-1) and the second housing (120-1). The first hinge structure (140-1) may rotatably connect the first housing (110-1) and the second housing (120-1).

[0316] According to one embodiment, the second hinge structure (150-1) may be disposed between the second housing (120-1) and the third housing (130-1). The second hinge structure (150-1) may rotatably connect the second housing (120-1) and the third housing (130-1). The flexible display (160-1) may be disposed in at least the first housing (110-1), the second housing (120-1), and the third housing (130-1).

[0317] According to one embodiment, the flexible display (160-1) may be arranged to cross at least a portion of the first hinge structure (140-1) and the second hinge structure (150-1). The flexible display (160-1) may be folded or unfolded by the first hinge structure (140-1) and the second hinge structure (150-1).

[0318] According to one embodiment, the flexible display (160-1) may include a first region, a second region, and a third region. For example, the first region may be a region disposed in the first housing (110-1) within the entire region of the flexible display (160-1). For example, the second region may be a region disposed in the second housing (120-1) within the entire region of the flexible display (160-1). For example, the third region may be a region disposed in the third housing (130-1) within the entire region of the flexible display (160-1).

[0319] Referring to FIGS. 41A and 41B , the first state of the foldable electronic device (100-1) may include a state in which the foldable electronic device (100-1) is unfolded by the first hinge structure (140-1) and unfolded by the second hinge structure (150-1). For example, in the first state in which the foldable electronic device (100-1) is unfolded by the first hinge structure (140-1) and the second hinge structure (150-1), the first housing (110-1), the second housing (120-1), and the third housing (130-1) may be arranged substantially in parallel. For example, in the first state in which the foldable electronic device (100-1) is unfolded, the first region, the second region, and the third region of the flexible display (160-1) may be arranged substantially in parallel. For example, in a first state in which the foldable electronic device (100-1) is unfolded, the first region, the second region, and the third region of the flexible display (160-1) may be arranged to face a first direction (e.g., +z axis direction -1).

[0320] According to one embodiment, the foldable electronic device (100-1) can be sequentially unfolded by the second hinge structure (150-1) and the first hinge structure (140-1). For example, the second housing (120-1) and the third housing (130-1) can be rotated by the second hinge structure (150-1). For example, the first housing (110-1) and the second housing (120-1) can be rotated by the first hinge structure (140-1).

[0321] According to one embodiment, as the second housing (120-1) and the third housing (130-1) are rotated by the second hinge structure (150-1), the second region and the third region of the flexible display (160-1) may be arranged substantially parallel. For example, the second region and the third region may be arranged to face the first direction. For example, as the second housing (120-1) and the third housing (130-1) are rotated by the second hinge structure (150-1), the second region of the flexible display (160-1) may move away from the third region.

[0322] According to one embodiment, as the first housing (110-1) and the second housing (120-1) are rotated by the first hinge structure (140-1), the first region and the second region of the flexible display (160-1) may be arranged substantially parallel. For example, the first region and the second region may be arranged to face the first direction. For example, as the first housing (110-1) and the second housing (120-1) are rotated by the second hinge structure (150-1), the first region of the flexible display (160-1) may move away from the second region.

[0323] According to one embodiment, referring to FIGS. 41A and 41B, in the first state of the foldable electronic device (100-1), the first region, the second region, and the third region of the flexible display (160-1) may all be arranged to face the first direction.

[0324] FIG. 41C is a side view illustrating an example of a second state of a foldable electronic device including a plurality of hinge structures according to one embodiment. FIG. 41D is a perspective view illustrating an example of a second state of a foldable electronic device including a plurality of hinge structures according to one embodiment.

[0325] Referring to FIGS. 41C and 41D , the second state of the foldable electronic device (100-1) may include a state in which the foldable electronic device (100-1) is folded by the first hinge structure (140-1) and unfolded by the second hinge structure (150-1). The first housing (110-1) and the second housing (120-1) may be rotated by the first hinge structure (140-1). For example, in a state in which the foldable electronic device (100-1) is folded by the first hinge structure (140-1), the first housing (110-1) may overlap the second housing (120-1). For example, as the foldable electronic device (100-1) is folded by the first hinge structure (140-1), the first region of the flexible display (160-1) may come closer to the second region. For example, in a state where the foldable electronic device (100-1) is folded by the first hinge structure (140-1), the first region and the second region of the flexible display (160-1) may overlap. For example, the state where the first region and the second region overlap may include a state where the first region and the second region are arranged to face each other. For example, the state where the first region and the second region overlap may include a state where the first region is arranged to face the second direction (-z-axis direction-1) and the second region is arranged to face the first direction.

[0326] FIG. 41E is a side view illustrating an example of a third state of a foldable electronic device including a plurality of hinge structures according to one embodiment. FIG. 41F is a perspective view illustrating an example of a third state of a foldable electronic device including a plurality of hinge structures according to one embodiment.

[0327] Referring to FIGS. 41E and 41F, the third state of the foldable electronic device (100-1) may include a state in which, in the second state, the foldable electronic device (100-1) is folded by the first hinge structure (140-1) and folded by the second hinge structure (150-1). For example, in the third state, the third housing (130-1) may be arranged to overlap the first housing (110-1) and the second housing (120-1). For example, in the third state, the first housing (110-1), the second housing (120-1), and the third housing (130-1) may be arranged to overlap each other. For example, in the third state, the first region and the third region of the flexible display (160-1) may be arranged to face the first direction, and the second region may be arranged to face the second direction.

[0328] According to one embodiment, in the third state, the second housing (120-1) may be disposed between the first housing (110-1) and the third housing (130-1). In the third state, the first housing (110-1) may be disposed or accommodated within a space formed between the second housing (120-1) and the third housing (130-1) as the foldable electronic device (100-1) is folded by the second hinge structure (150-1). In order to form a space in which the first housing (110-1) may be disposed or accommodated, the width of the second hinge structure (150-1) may be wider than the width of the first hinge structure. For example, since the width of the second hinge structure (150-1) is wider than the width of the first hinge structure (140-1), the rotation radius of the second housing (120-1) or the third housing (130-1) by the second hinge structure (150-1) may be larger than the rotation radius of the first housing (110-1) or the second housing (120-1) by the first hinge structure (140-1).

[0329] According to one embodiment, the first housing (110-1) may include a sub-display (170-1). For example, the sub-display (170-1) may be disposed on the opposite side of the first housing (110-1) from the side where the flexible display (160-1) is disposed. In the third state of the foldable electronic device (100-1), the sub-display (170-1) disposed in the first housing (110-1) may be disposed to face the first direction.

[0330] FIG. 42 is a drawing showing an example of displaying an execution screen of a message application as the folding state of an electronic device changes according to one embodiment.

[0331] Referring to identification number 420-1 of FIG. 42, when the foldable electronic device (100-1) according to one embodiment is in the third state, the foldable electronic device (100-1) can display an execution screen of a message application on the sub-display (170-1).

[0332] Referring to the identification number 420-2 of FIG. 42, the foldable electronic device (100-1) according to one embodiment may change from a third state to a second state. When the foldable electronic device (100-1) changes from the third state to the second state, the foldable electronic device (100-1) may display an execution screen of a message application on an exposed area (e.g., the third area) of the display (160-1). According to one embodiment, the sub-display (170-1) of the foldable electronic device (100-1) may be deactivated, and at least a portion of the display (160-1) of the foldable electronic device (100-1) may be activated. In addition, the foldable electronic device (100-1) may display an execution screen of a message application on an exposed area (e.g., the third area) of the display (160-1). For example, the execution screen of the message application displayed on the sub display (170-1) may be the same as the execution screen of the message application displayed on the exposed area (e.g., the third area) of the display (160-1).

[0333] Referring to identification number 420-3 of FIG. 42, the foldable electronic device (100-1) according to one embodiment may change from a second state to a first state. When the foldable electronic device (100-1) changes from the second state to the first state, the foldable electronic device (100-1) may display an execution screen of a message application on the entire area of ​​the display (160-1). While the foldable electronic device (100-1) is in the first state, within the execution screen of the message application displayed on the entire area of ​​the display (160-1), the distance between the message object of the received message and the message object of the sent message may increase. For example, as the message object of the received message is displayed on the left periphery of the display (160-1) and the message object of the sent message is displayed on the right periphery of the display (160-1), the arrangement interval between the message object of the received message and the message object of the sent message may increase. In this case, the emoji may be displayed by moving between the message object of the sent message and the message object of the sent message with increased distance.

[0334] According to one embodiment, an example in which the execution screen of a message application is displayed as the folding state of the foldable electronic device (100-1) changes is not limited to FIG. 42. For example, the emoji displayed by moving in FIG. 24 may also be displayed by changing according to the folding state of the foldable electronic device (100-1) in FIG. 42. In this case, for example, the properties of the emoji and / or the properties related to the movement of the emoji may be determined differently according to the size and / or shape of the display exposed according to the folding state of the foldable electronic device (100-1). For example, the shape of the emoji, the size of the emoji, the movement trajectory of the emoji, and / or the movement speed of the emoji may be determined differently according to the size and / or shape of the display exposed according to the folding state of the foldable electronic device (100-1).

[0335] FIG. 43 is a drawing showing an example in which an execution screen of an application related to a message is additionally displayed as the folding state of an electronic device changes according to one embodiment.

[0336] Referring to identification number 430-1 of FIG. 43, when the foldable electronic device (100-1) according to one embodiment is in the third state, the foldable electronic device (100-1) can display an execution screen of a message application on the sub-display (170-1).

[0337] Referring to the identification number 430-3 of FIG. 43, the foldable electronic device (100-1) according to one embodiment may change to a first state. When the foldable electronic device (100-1) changes to the first state, the foldable electronic device (100-1) may display an execution screen of a message application on a portion of the display (160-1) and display an execution screen of an application related to a message on another portion of the display (160-1). For example, the foldable electronic device (100-1) may display an execution screen of a message application that was displayed on the sub-display (170-1) on a portion of the display (160-1) (e.g., a third portion). In addition, for example, the foldable electronic device (100-1) may display an execution screen of a map application related to a conversation content within the execution screen of the message application on another portion of the display (160-1) (e.g., a first portion and a second portion). For example, if the conversation content within the execution screen of a message application includes a user moving to a location where another user is located, the foldable electronic device (100-1) may identify the path the user will move based on the conversation content and display the user's movement path and the user's current location on a map within the execution screen of a map application. In this case, for example, the user's current location may be displayed as a human-shaped object displayed with a predetermined animation effect, but is not limited thereto.

[0338] According to one embodiment, although FIGS. 42 and 43 illustrate an example in which an execution screen of a message application is displayed depending on the folding state of the foldable electronic device (100-1), the present invention is not limited thereto. For example, in a case in which an electronic device whose display exposed area expands or contracts in a sliding manner displays an execution screen of a message application, the arrangement of message objects within the execution screen of the message application may be adjusted depending on the size of the exposed display area of ​​the electronic device. In addition, in this case, as the size of the exposed display area of ​​the electronic device increases, an execution screen of another application related to the message may be additionally displayed.

[0339] According to one embodiment, although FIGS. 42 and 43 illustrate an example in which an execution screen of a message application is displayed depending on the folding state when the foldable electronic device (100-1) is multi-folded, the present invention is not limited thereto. For example, the foldable electronic device (100-1) may be an electronic device that is folded by a single hinge structure, in which case the folded state of the foldable electronic device (100-1) may be similar to the identification number 420-1 of FIG. 42, and the unfolded state of the foldable electronic device (100-1) may be similar to and 420-3. In addition, in this case, the execution screen of the message application displayed while the foldable electronic device (100-1) is in the folded state may have different properties regarding the arrangement of message objects and the movement of emojis compared to the execution screen of the message application displayed when the foldable electronic device (100-1) is in the unfolded state.

[0340] FIG. 44 is a block diagram of an electronic device (4101) within a network environment (4100) according to various embodiments. Referring to FIG. 44, in the network environment (4100), the electronic device (4101) may communicate with the electronic device (4102) via a first network (4198) (e.g., a short-range wireless communication network), or may communicate with the electronic device (4104) or the server (4108) via a second network (4199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (4101) may communicate with the electronic device (4104) via the server (4108). According to one embodiment, the electronic device (4101) may include a processor (4120), a memory (4130), an input module (4150), an audio output module (4155), a display module (4160), an audio module (4170), a sensor module (4176), an interface (4177), a connection terminal (4178), a haptic module (4179), a camera module (4180), a power management module (4188), a battery (4189), a communication module (4190), a subscriber identification module (4196), or an antenna module (4197). In some embodiments, the electronic device (4101) may omit at least one of these components (e.g., the connection terminal (4178)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (4176), camera module (4180), or antenna module (4197)) may be integrated into a single component (e.g., display module (4160)).

[0341] The processor (4120) may, for example, execute software (e.g., a program (4140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (4101) connected to the processor (4120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (4120) may store commands or data received from other components (e.g., a sensor module (4176) or a communication module (4190)) in a volatile memory (4132), process the commands or data stored in the volatile memory (4132), and store result data in a non-volatile memory (4134). According to one embodiment, the processor (4120) may include a main processor (4121) (e.g., a central processing unit or an application processor) or an auxiliary processor (4123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (4121). For example, when the electronic device (4101) includes the main processor (4121) and the auxiliary processor (4123), the auxiliary processor (4123) may be configured to use less power than the main processor (4121) or to be specialized for a given function. The auxiliary processor (4123) may be implemented separately from the main processor (4121) or as a part thereof.

[0342] The auxiliary processor (4123) may control at least a portion of functions or states associated with at least one component (e.g., the display module (4160), the sensor module (4176), or the communication module (4190)) of the electronic device (4101), for example, on behalf of the main processor (4121) while the main processor (4121) is in an inactive (e.g., sleep) state, or together with the main processor (4121) while the main processor (4121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (4123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (4180) or a communication module (4190)). In one embodiment, the auxiliary processor (4123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (4101) where the artificial intelligence is performed, or can be performed through a separate server (e.g., server (4108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0343] The memory (4130) can store various data used by at least one component (e.g., the processor (4120) or the sensor module (4176)) of the electronic device (4101). The data can include, for example, software (e.g., the program (4140)) and input data or output data for commands related thereto. The memory (4130) can include volatile memory (4132) or non-volatile memory (4134).

[0344] The program (4140) may be stored as software in memory (4130) and may include, for example, an operating system (4142), middleware (4144), or an application (4146).

[0345] The input module (4150) can receive commands or data to be used in a component of the electronic device (4101) (e.g., a processor (4120)) from an external source (e.g., a user) of the electronic device (4101). The input module (4150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0346] The audio output module (4155) can output audio signals to the outside of the electronic device (4101). The audio output module (4155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0347] The display module (4160) can visually provide information to an external party (e.g., a user) of the electronic device (4101). The display module (4160) may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the device. In one embodiment, the display module (4160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0348] The audio module (4170) can convert sound into an electrical signal, or vice versa. According to one embodiment, the audio module (4170) can acquire sound through the input module (4150), output sound through the sound output module (4155), or an external electronic device (e.g., electronic device (4102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (4101).

[0349] The sensor module (4176) can detect the operating status (e.g., power or temperature) of the electronic device (4101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (4176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0350] The interface (4177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (4101) with an external electronic device (e.g., the electronic device (4102)). In one embodiment, the interface (4177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0351] The connection terminal (4178) may include a connector through which the electronic device (4101) may be physically connected to an external electronic device (e.g., the electronic device (4102)). In one embodiment, the connection terminal (4178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0352] The haptic module (4179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (4179) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0353] The camera module (4180) can capture still images and videos. In one embodiment, the camera module (4180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0354] The power management module (4188) can manage power supplied to the electronic device (4101). According to one embodiment, the power management module (4188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0355] A battery (4189) may power at least one component of the electronic device (4101). In one embodiment, the battery (4189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0356] The communication module (4190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (4101) and an external electronic device (e.g., electronic device (4102), electronic device (4104), or server (4108)), and the performance of communication through the established communication channel. The communication module (4190) may operate independently from the processor (4120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (4190) may include a wireless communication module (4192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (4194) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (4104) via a first network (4198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (4199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network or a wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (4192) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (4196) to verify or authenticate the electronic device (4101) within a communication network such as the first network (4198) or the second network (4199).

[0357] The wireless communication module (4192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimizing terminal power and connecting multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (4192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (4192) may support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (4192) may support various requirements specified in the electronic device (4101), an external electronic device (e.g., the electronic device (4104)), or a network system (e.g., the second network (4199)). According to one embodiment, the wireless communication module (4192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0358] The antenna module (4197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (4197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (4197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (4198) or the second network (4199), may be selected from the plurality of antennas by, for example, the communication module (4190). A signal or power may be transmitted or received between the communication module (4190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (4197).

[0359] According to various embodiments, the antenna module (4197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0360] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0361] According to one embodiment, commands or data may be transmitted or received between the electronic device (4101) and an external electronic device (4104) via a server (4108) connected to a second network (4199). Each of the external electronic devices (4102 or 4104) may be the same or a different type of device as the electronic device (4101). According to one embodiment, all or part of the operations executed in the electronic device (4101) may be executed in one or more of the external electronic devices (4102, 4104, or 4108). For example, when the electronic device (4101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (4101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (4101). The electronic device (4101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (4101) may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (4104) may include an Internet of Things (IoT) device. The server (4108) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (4104) or server (4108) may be included within the second network (4199). The electronic device (4101) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0362] An electronic device (4101) of FIG. 44 according to one embodiment may correspond to the electronic device (1000) of FIGS. 1 to 43. The electronic device (4101) may control components within the electronic device (4101) so that the processor (4120) performs the operations disclosed in FIGS. 1 to 43 by executing instructions stored in the memory (4130).

[0363] FIG. 45 is a block diagram of an electronic device according to various embodiments.

[0364] Referring to FIG. 45, the electronic device (1000) may include some of the components of the electronic device (4101). However, the components included in the electronic device (1000) are not limited thereto.

[0365] According to one embodiment, the electronic device (1000) may include a display module (1060), a communication module (1090), a processor (1020), and a memory (1030).

[0366] A display module (1060) according to one embodiment can visually provide information to an external device (e.g., a user) of an electronic device (1000). The display module (1060) according to one embodiment can correspond to the display module (4160) of FIG. 44. The display module (1060) can include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (1060) can include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0367] A communication module (1090) according to one embodiment may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1000) and an external electronic device (not shown), and the performance of communication through the established communication channel. The communication module (1090) according to one embodiment may correspond to the communication module (4190) of FIG. 41. The communication module (1090) may operate independently from the processor (1020) (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1090) may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (e.g., a local area network (LAN) communication module, or a power line communication module).

[0368] The memory (1030) according to one embodiment may store various data used by at least one component (e.g., processor (1020)) of the electronic device (1000). The memory (1030) according to one embodiment may correspond to the memory (4130) of FIG. 41. The data may include, for example, software (e.g., program) and input data or output data for commands related thereto. The memory (1030) may include volatile memory or non-volatile memory.

[0369] A processor (1020) according to one embodiment may control at least one other component (e.g., hardware or software component) of an electronic device (1000) connected to the processor (1020) by executing, for example, software (e.g., a program), and may perform various data processing or calculations. The processor (1020) according to one embodiment may correspond to the processor (4120) of FIG. 41. According to one embodiment, the processor (1020) may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith.

[0370] According to one embodiment, the processor (1020) can control the operations of the electronic device (1000) in FIGS. 1 to 43 by controlling components within the electronic device (1000).

[0371] According to one embodiment, the processor (1020) may obtain at least one text input into the execution screen of the message application. According to one embodiment, the processor (1020) may obtain a message received from another electronic device (not shown) through the message application and a message input into the electronic device (1000) by the user. The processor (1020) may obtain at least one text included in the obtained message. For example, the message application may be an application that provides a conversation service between a user of the electronic device (1000) and a user of another electronic device (not shown).

[0372] According to one embodiment, the processor (1020) may obtain information indicating an input intent of at least one text and specific words included in the at least one text by analyzing at least one text. According to one embodiment, the processor (1020) may identify the meaning of the at least one text, the input intent, and words included in the at least one text based on natural language interpretation of the at least one text. For example, the processor (1020) may analyze the at least one text using a natural language understanding (NLU) model. For example, the processor (1020) may analyze the at least one text using a generative AI model that utilizes natural language interpretation technology.

[0373] According to one embodiment, the processor (1020) may obtain information (e.g., intent) indicating an input intent of at least one text and / or a specific word included in at least one text using a natural language understanding (NLU) model. According to one embodiment, the processor (1020) may use, for example, NLU technology and / or artificial intelligence technology to identify a user's input intent for at least one text displayed on an execution screen of a message application. According to one embodiment, the processor (1020) may analyze a text using, for example, an NLU model and obtain an intent related to the user's intent based on the analysis result. For example, the processor (1020) may input at least one text into the NLU model and obtain an intent output from the NLU model. The NLU model may be a model trained to obtain an intent corresponding to the text by interpreting the text to understand the meaning of the conversation. The intent may be information indicating the user's input intent for the text. In one embodiment, the NLU model may be, but is not limited to, an artificial intelligence model trained for natural language interpretation.

[0374] For example, the processor (1020) may determine a user's intent from text by performing syntactic analysis or semantic analysis using an NLU model. In one embodiment, the processor (1020) may parse text into units of morphemes, words, or phrases using the NLU model, and infer the meaning of words extracted from the parsed text using linguistic features (e.g., grammatical elements) of the parsed morphemes, words, or phrases. In addition, the processor (1020) may determine an intent corresponding to the meaning of the inferred word by comparing the meaning of the inferred word with predefined intents provided by the NLU model.

[0375] According to one embodiment, the processor (1020) may obtain intents and parameters output from an NLU model. An intent is information determined by interpreting text using the NLU model and may represent a user's input intent. For example, an intent may be information indicating a conversational intent that the user wishes to convey to the other party. An intent may include not only information indicating the user's input intent (hereinafter, "intent information") but also a numerical value corresponding to the information indicating the user's input intent. The numerical value may represent a probability that the text is related to information indicating a specific intent. When multiple pieces of information indicating the user's intent are acquired as a result of interpreting text using the NLU model, the intent information with the largest numerical value corresponding to each piece of intent information may be determined as the intent. In addition, a parameter may be variable information for determining detailed actions intended by the user in relation to the intent. The parameter may include words related to the detailed actions intended by the user. A parameter is information related to an intent, and multiple parameters may correspond to a single intent. Parameters can include variable information that determines the user's intended detailed actions, as well as numerical values ​​indicating the probability that text is related to that variable information. When interpreting text using a natural language understanding model, multiple variable information items representing parameters can be obtained. In this case, the variable information with the largest numerical value corresponding to each variable information item can be determined as the parameter.

[0376] For example, if the text is “I’ll take a taxi to Seoul Station quickly,” the intent could be “Move by public transportation,” and the parameters could include “Seoul Station,” “taxi,” and “quickly.” Furthermore, if the text is “I’ll run quickly and get there!! I think I can get there within 5 minutes!!,” the intent could be “Run and get there,” and the parameters could include “quickly” and “5 minutes.” However, the intents and parameters acquired using the NLU model are not limited thereto. The intent can be set to include more specific content than the intents exemplified above.

[0377] According to one embodiment, the processor (1020) may obtain a certain word from at least one text. For example, a word associated with a predetermined meaning and a predetermined intent for determining the selection and display properties of an emoji may be obtained from at least one text. For example, the processor (1020) may identify whether a word with a predetermined meaning and / or intent is included among the words included in at least one text for determining the selection and display properties of an emoji. According to one embodiment, the processor (1020) may also obtain a parameter obtained using an NLU model as a certain word.

[0378] For example, if the text is “I’ll take a taxi to Seoul Station quickly,” the processor (1020) can obtain “taxi” and “quickly” as specific words. Also, for example, if the text is “I’ll run quickly and go!! I think I can get there within 5 minutes!!,” the processor (1020) can obtain “quickly” and “5 minutes” as specific words.

[0379] According to one embodiment, the processor (1020) may, for example, interpret the meaning of each sentence included in a message within an execution screen. Furthermore, for example, the processor (1020) may interpret the meaning of each message within the execution screen. In this case, the processor (1020) may interpret the meaning of multiple sentences within a message. Furthermore, for example, the processor (1020) may interpret the intent of a conversation based on the messages by interpreting the meaning of multiple messages within the execution screen. According to one embodiment, the processor (1020) may obtain an intent and a specific word related to the user's intent based on the result of at least one of the above interpretations.

[0380] According to one embodiment, the processor (1020) may identify whether at least one text is related to movement based on information indicating an input intent of at least one text.

[0381] According to one embodiment, the processor (1020) can use an NLU model to identify whether an intent obtained from at least one text is related to movement. For example, the intent related to movement may be an intent related to the movement of a person and / or an object. For example, if the intent includes a word related to movement, the processor (1020) can determine that the intent corresponding to at least one text is related to movement.

[0382] For example, if the text is “I’ll take a taxi to Seoul Station quickly,” the intent may be “movement using transportation,” and the processor (1020) can determine that the intent is related to movement based on “movement” included in the intent and that the text “I’ll take a taxi to Seoul Station quickly.” is related to movement.

[0383] Also, for example, if the text is “I’ll run quickly and get there!! I think I can get there within 5 minutes!!” and the intent can be “I’ll run and get there”, the processor (1020) can determine that the intent is related to movement based on “run” and “move” included in the intent and that the text “I’ll run quickly and get there!! I think I can get there within 5 minutes!!” is related to movement.

[0384] In one embodiment, the processor (1020) may identify whether at least one text contains a word related to movement. For example, if at least one text contains a word related to movement, the processor (1020) may determine that the input intent of the at least one text is related to movement.

[0385] While the processor (1020) according to one embodiment has been described as identifying whether an intent obtained from at least one text is related to movement, it is not limited thereto. For example, it may also identify whether an intent obtained from at least one text is related to a change in emotion and / or facial expression. In this case, the display properties of emojis related to the change in emotion and / or facial expression may be determined.

[0386] According to one embodiment, the processor (1020) may determine information indicating an input intent of at least one text, at least one emoji corresponding to a specific word, and a display attribute of the at least one emoji. According to one embodiment, the processor (1020) may determine the intent and at least one emoji corresponding to a specific word, and a display attribute of the at least one emoji, based on whether the intent obtained from the NLU model is related to movement.

[0387] According to one embodiment, emojis and display properties of emojis corresponding to intents and words may be preset. For example, categories of emojis corresponding to intents and words, display properties related to emoji transformations, and display properties related to emoji movement may be preset.

[0388] According to one embodiment, the processor (1020) may identify a category of emoji based on an intent and a word, and select at least one emoji from among emojis within the identified category. The processor (1020) may select one or more emojis based on display properties related to variations of the emoji, which will be described later.

[0389] According to one embodiment, the processor (1020) may determine display properties of an emoji based on the intent and the word. According to one embodiment, the display properties of the emoji may include display properties related to deformation of the emoji and display properties related to movement of the emoji.

[0390] According to one embodiment, the processor (1020) may perform operations to identify display properties of an emoji by analyzing text using a generative AI model.

[0391] In this case, the processor (1020) may input an input prompt including at least one text to the generative AI model. According to one embodiment, the processor (1020) may generate an input prompt to be input to the generative AI model and provide the generated input prompt to the generative AI model. The generative AI model may include an artificial intelligence model trained to select an emoji based on a conversation. A generative AI model may generally refer to an artificial intelligence neural network that creates a new type of data based on user input information. A generative AI model may include a model that generates an image and / or a model that generates a language. Representative models for generating images include a generative adversarial network (GAN) and a variational autoencoder (VAE), and examples include a diffusion-based generative model that uses a VAE and a Transformer structure. A model for generating a language is a model trained to output the most statistically appropriate output value based on an input value, and representative examples include models such as CHAT-GPT 3 and CHAT-GPT 4. There are also large multimodal models (LMMs) that can recognize various types of data input, such as text, images, and speech, and generate corresponding new data. For example, generative AI models can be, but are not limited to, generative models using generative adversarial networks (GANs), variational autoencoders (VAEs), diffusion, or transformer architectures.

[0392] According to one embodiment, the processor (1020) may generate an input prompt that includes at least one text within the execution screen of the messaging application, information regarding criteria for selecting an emoji, and / or information regarding criteria for determining display properties of the emoji. For example, the input prompt may be generated in the form of a script containing sentences in natural language format. The input prompt may be generated in a format supported by the identified generative AI model.

[0393] For example, the processor (1020) may generate an input prompt such as “Recommend an emoji and display properties of the emoji that reflect the intent of the input message. The display properties of the emoji include display properties that change the shape of the emoji or move the emoji within the message window. The input message may be as follows. “I’ll run quickly and go!! I think I can get there within 5 minutes!!””. However, examples of input prompts are not limited thereto, and various types of input prompts supported by the generative AI model may be generated.

[0394] In one embodiment, the input prompt may include at least one text within the message application launch screen. For example, the input prompt may include a single sentence within a message within the launch screen. Alternatively, for example, the input prompt may include a single message comprising multiple texts. Alternatively, for example, the input prompt may include multiple messages within the launch screen.

[0395] According to one embodiment, the processor (1020) may identify display attributes of emojis and emojis recommended by the generative AI model. According to one embodiment, the processor (1020) may identify display attributes of emojis and emojis recommended by the generative AI model based on an input prompt. For example, if the input prompt includes a single sentence contained in a message within an execution screen, the processor (1020) may identify display attributes of emojis and emojis related to the input intent of the single sentence. For example, if the input prompt includes a single message containing multiple texts, the processor (1020) may identify display attributes of emojis and emojis related to the input intent of the single message containing multiple sentences. For example, if the input prompt includes a single message within an execution screen, the processor (1020) may identify display attributes of emojis and emojis related to the intent of a conversation based on the multiple messages.

[0396] According to one embodiment, the processor (1020) may display at least one emoji at a preset location within the execution screen of the message application. The processor (1020) may move the display location of the at least one emoji based on the identified display properties. According to one embodiment, the processor (1020) may move and display the emoji within the execution screen of the message application based on the display properties of the emoji. For example, the processor (1020) may move and display the emoji based on display properties related to movement of the emoji. In addition, for example, the processor (1020) may move and display the emoji while transforming it based on display properties related to deformation of the emoji and display properties related to movement of the emoji.

[0397] Although the processor (1020) has been described above as using an NLU model and / or a generative AI model to interpret the meaning of text contained in a message and to select and display emojis, the present invention is not limited thereto. For example, the processor (1020) may select, move, and display emojis based on words contained in the text. In this case, the emoji category, emoji, and / or emoji display properties may be preset to correspond to at least one word contained in the text.

[0398] An electronic device (1000, 4101) for providing emojis related to messages of a messaging application according to one embodiment comprises: a communication interface (4190); a display (4160); a memory (4130) for storing commands; And one or more processors (4120); wherein the instructions, when executed by the one or more processors, cause the electronic device to: execute the message application, obtain text entered in an input window of an execution screen of the message application, identify words included in the text, analyze the text to obtain first information indicating the meaning of the text, identify whether the first information is related to movement of at least one of a person or an object, and identify second information corresponding to properties for an animation effect related to movement of the emoji and the emoji within the execution screen based on the first information and a word related to the intensity of the movement among the words, wherein the second information includes information about a start position, an end position, and a movement speed for displaying the emoji, and based on the second information, display the emoji at the start position related to a message bubble provided within the execution screen of the message application and including the text, and based on the second information, display the emoji through the animation effect in which the emoji moves from the start position related to the message bubble within the execution screen of the message application, and The second information regarding the text entered in the input window, the emoji, and the animation effect of the emoji can be transmitted to another electronic device through the message application.

[0399] In addition, the first information indicating the meaning of the text includes an intent and parameters related to the intent obtained from a natural language understanding (NLU) model based on the text, and the instructions, when executed by the one or more processors, cause the electronic device to: identify a category corresponding to the intent and the parameters, and select the emoji related to the text from among a plurality of emojis corresponding to the identified category, thereby identifying the emoji.

[0400] Additionally, the instructions, when executed by the one or more processors, may cause the electronic device to determine a movement speed of the emoji based on the word among the words related to the intensity of the movement.

[0401] Additionally, the instructions, when executed by the one or more processors, may cause the electronic device to: display the emoji in the vicinity of a first text including a word related to the emoji within the execution screen of the message application, and to cause the emoji to move from the message bubble including the first text to another message bubble including a second text related to the first text.

[0402] Additionally, the instructions, when executed by the one or more processors, may cause the electronic device to: display the emoji around a first text including a word related to the emoji within the execution screen of the message application, and display the emoji such that the emoji moves along an edge of the message bubble including the first text.

[0403] Additionally, the instructions, when executed by the one or more processors, may cause the electronic device to: display another emoji related to another text around the other text, and display the other emoji and the emoji within the execution screen such that the other emoji and the emoji move and come into contact with each other.

[0404] Additionally, the instructions, when executed by the one or more processors, may cause the electronic device to: identify the number of times a word related to the emoji is repeated within the text, and determine a size of the emoji based on the number of times.

[0405] According to one embodiment, the method comprises: executing a message application; obtaining text input into an input window of an execution screen of the message application (210); identifying words included in the text; obtaining first information indicating the meaning of the text by analyzing the text (220); identifying whether the first information is related to movement of at least one of a person or an object (230); identifying second information corresponding to properties for an animation effect related to movement of the emoji and the emoji within the execution screen based on the first information and a word related to the intensity of the movement among the words, wherein the second information includes information regarding a start position, an end position, and a movement speed for displaying the emoji; displaying the emoji at the start position related to a message bubble provided within the execution screen of the message application and including the text based on the second information (250); displaying the emoji through the animation effect in which the emoji moves from the start position related to the message bubble within the execution screen of the message application based on the second information; A computer-readable recording medium having recorded thereon a program for executing a method of providing emojis related to messages of a message application, the method comprising: transmitting the text, the emoji, and the second information about the animation effect of the emoji entered in the input window to another electronic device through the message application;

[0406] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0407] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0408] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0409] Various embodiments of the present document may be implemented as software (e.g., a program (4140)) including one or more instructions stored in a storage medium (e.g., an internal memory (4136) or an external memory (4138)) readable by a machine (e.g., an electronic device (4101)). For example, a processor (e.g., a processor (4120)) of the machine (e.g., an electronic device (4101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0410] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0411] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. A method for providing an emoji related to a message of a message application executed by an electronic device (1000), An action of executing the message application installed on the electronic device; An action (210) of obtaining text entered in an input window of the execution screen of the above message application; An action (220) to identify words contained within the above text; An operation (220) of obtaining first information indicating the meaning of the text by analyzing the text; An operation (230) of identifying whether the first information is related to the movement of at least one person or object; An operation of identifying second information corresponding to properties for an animation effect related to movement of the emoji and the emoji within the execution screen based on the first information and a word related to the intensity of the movement among the words, wherein the second information includes information about a start position, an end position, and a movement speed for displaying the emoji; An operation (250) of displaying the emoji at the start position related to the message bubble including the text provided within the execution screen of the message application based on the second information; An operation of displaying the emoji through the animation effect in which the emoji moves from the starting position related to the message bubble within the execution screen of the message application based on the second information; and An action of transmitting the text, the emoji, and the second information to another electronic device via the message application; A method comprising:

2. In paragraph 1, The first information indicating the meaning of the text includes an intent obtained from an NLU (natural language understanding) model based on the text and parameters related to the intent, A method in which the emoji is identified by identifying a category corresponding to the intent and the parameters and selecting the emoji related to the text from among a plurality of emojis corresponding to the identified category.

3. In paragraph 1, A method wherein the movement speed of the emoji is determined based on the word related to the intensity of the movement.

4. In paragraph 1, The action of displaying the emoji at the above starting position is to display the emoji around a first text containing a word related to the emoji within the execution screen of the message application, A method wherein the action of displaying the emoji through the animation effect is to display the emoji so that the emoji moves from the message bubble containing the first text to another message bubble containing a second text related to the first text within the execution screen.

5. In paragraph 1, The action of displaying the emoji at the above starting position is to display the emoji around a first text containing a word related to the emoji within the execution screen of the message application, A method wherein the action of displaying the emoji through the animation effect is to display the emoji so that the emoji moves along the edge of the message bubble including the first text.

6. In paragraph 1, An action that displays different emojis related to different text; Including more, The other emoji is displayed around the other text and the emoji is displayed around the text, A method wherein the other emoji and the emoji are displayed within the execution screen so that the other emoji and the emoji move and come into contact with each other.

7. In paragraph 1, An action to identify the number of times a word related to said emoji occurs within said text; Including more, A method wherein the size of the emoji is determined based on the above number of times.

8. In paragraph 1, The second information includes information about the property regarding the deformation of the emoji identified based on at least one of the first information or the words, A method wherein the action of displaying the emoji through the above animation effect is to display the emoji that is deformed according to the property regarding deformation of the emoji.

9. In paragraph 8, A method wherein the transformation of the emoji includes changing the shape of the emoji and sequentially displaying a plurality of emojis.

10. In paragraph 1, A method wherein the property related to the animation effect regarding the movement of the emoji is determined based on at least one of a folding state of the electronic device or a size of an area of ​​a display exposed to the outside of the electronic device.

11. In paragraph 1, After the above text is entered, an action of displaying a recommendation list recommending the emoji and the properties of the emoji to the user; An action to identify an item selected by the user from among the items included in the above recommendation list; and An action of displaying the emoji corresponding to the selected item according to the emoji corresponding to the selected item and the properties of the emoji; A method further comprising:

12. In paragraph 1, A method in which, based on the second information about the transmitted text, the emoji, and the animation effect of the emoji, the text and the emoji according to the animation effect are displayed through the execution screen of the message application running on the other electronic device.

13. In an electronic device (1000, 4101) providing emojis related to messages in a messaging application, Communication interface (4190); Display (4160); Memory (4130) for storing commands; and One or more processors (4120); Includes, The above instructions, when executed by the one or more processors, cause the electronic device to: Run the above message application, Obtain the text entered in the input window of the execution screen of the above message application, Identify the words contained within the above text, By analyzing the above text, first information indicating the meaning of the text is obtained, Identify whether the first information is related to the movement of at least one person or object, Based on the first information and the words related to the intensity of the movement among the words, second information corresponding to properties for an animation effect related to the movement of the emoji and the emoji within the execution screen is identified, wherein the second information includes information about a start position, an end position, and a movement speed for displaying the emoji, Based on the second information, displaying the emoji at the start position related to the message bubble provided within the execution screen of the message application and including the text; Based on the second information, displaying the emoji through the animation effect in which the emoji moves from the starting position related to the message bubble within the execution screen of the message application; An electronic device that transmits the second information regarding the text, the emoji, and the animation effect of the emoji entered in the input window to another electronic device through the message application.

14. In paragraph 13, The first information indicating the meaning of the text includes an intent obtained from an NLU (natural language understanding) model based on the text and parameters related to the intent, The above instructions, when executed by the one or more processors, cause the electronic device to: An electronic device that identifies the emoji by identifying a category corresponding to the intent and the parameters and selecting the emoji related to the text from among a plurality of emojis corresponding to the identified category.

15. In paragraph 13, The above instructions, when executed by the one or more processors, cause the electronic device to: An electronic device that determines the movement speed of the emoji based on the word related to the intensity of the movement among the words.

Images