Electronic device for providing recommended word via keyboard application

Abstract

This electronic device may comprise: a display; a memory storing instructions; and a processor. The instructions, when executed by the processor, may instruct the electronic device to: display an execution screen of an application on the display; display a software keyboard via the display together with the execution screen of the application in response to an event for text input, while the execution screen of the application is displayed; while displaying, on the display, the software keyboard including a first area including a plurality of character keys and a second area for displaying one or more recommended words, receive a user input for one or more character keys from among the plurality of character keys; display at least one character corresponding to the user input in an input field in the execution screen; and display at least one recommended word in the second area by using the at least one character and information about a chat partner indicated by the execution screen.

Description

An electronic device for providing suggested words through a keyboard application.

[0001] The present disclosure relates to an electronic device for providing recommended words through a keyboard application.

[0002] Keyboard applications allow users to input text on mobile devices like smartphones. They allow users to quickly and easily input desired characters. The input functionality of these keyboard applications can be utilized in a variety of applications, including messengers, social media, and document creation.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0004] According to one embodiment, an electronic device may include a display, a memory storing instructions, and a processor. The instructions, when executed by the processor, may cause the electronic device to display an execution screen of an application on the display. The instructions, when executed by the processor, may cause the electronic device to display a software keyboard through the display together with the execution screen of the application in response to an event for text input while the execution screen of the application is displayed. The instructions, when executed by the processor, may cause the electronic device to receive a user input for one or more of the plurality of character keys while displaying the software keyboard on the display, the software keyboard including a first region including a plurality of character keys and a second region for displaying one or more suggested words. The instructions, when executed by the processor, may cause the electronic device to display at least one character corresponding to the user input in an input field within the execution screen. The above instructions, when executed by the processor, may cause the electronic device to display at least one recommended word in the second area using the at least one character and information about the other party indicated by the execution screen.

[0005] According to one embodiment, an electronic device may include a display, a memory storing instructions, and a processor. The instructions, when executed by the processor, may cause the electronic device to display, through the display, a screen including an execution screen of an application and a keyboard interface. The instructions, when executed by the processor, may cause the electronic device to identify a counterparty represented by the execution screen using an analysis of the execution screen. The instructions, when executed by the processor, may cause the electronic device to: if the identified counterparty is a first counterparty: display a first suggested word within the keyboard interface in response to an input for a first text key received through the keyboard interface. The instructions, when executed by the processor, may cause the electronic device to: display, in response to an input to the first text key received through the keyboard interface, a second suggested word different from the first suggested word within the keyboard interface, if the identified counterpart is a second counterpart different from the first suggested word.

[0006] According to one embodiment, an electronic device may include a display, a memory storing instructions, and a processor. The instructions, when executed by the processor, may cause the electronic device to display an execution screen of an application through the display. The instructions, when executed by the processor, may cause the electronic device to display a software keyboard through the display in a portion of the entire display area of ​​the display in response to an event for text input while the execution screen is displayed on the display. The instructions, when executed by the processor, may cause the electronic device to detect a counterparty represented by the execution screen using an analysis of the execution screen: determine a keyboard usage pattern corresponding to the counterparty; and display at least one recommended word through the display using the keyboard usage pattern and at least one character received through the software keyboard.

[0007] According to one embodiment, a method of an electronic device including a display may include: displaying an execution screen of an application through the display; while the execution screen of the application is displayed, in response to an event for text input, displaying a software keyboard together with the execution screen of the application through the display; while displaying the software keyboard on the display, the software keyboard including a first area including a plurality of character keys and a second area for displaying one or more recommended words, receiving a user input for one or more character keys among the plurality of character keys; displaying at least one character corresponding to the user input in an input field within the execution screen; and displaying at least one recommended word in the second area using the at least one character and information about the other party indicated by the execution screen.

[0008] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0009] FIG. 2A illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0010] FIG. 2b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0011] FIG. 2c illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0012] FIG. 3A illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0013] FIG. 3b illustrates an example of a screen displayed by an electronic device according to one embodiment.

[0014] FIG. 4 illustrates examples of screens displayed by an electronic device according to one embodiment.

[0015] FIG. 5 illustrates examples of screens displayed by an electronic device according to one embodiment.

[0016] FIG. 6 is an exemplary block diagram of an electronic device according to one embodiment.

[0017] FIG. 7 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0018] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0019] FIG. 9 is an exemplary block diagram illustrating a generative artificial intelligence system according to one embodiment.

[0020] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0021] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0022] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0023] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0024] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0025] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0026] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0027] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0028] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0029] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0030] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0031] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0032] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0033] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0034] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0035] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0036] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, Wi-Fi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0037] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0038] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0039] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0040] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0041] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service by itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0042] FIGS. 2A, 2B, and 2C illustrate examples of screens displayed by an electronic device according to an embodiment. The electronic device (101) of FIGS. 2A, 2B, and 2C may be an example of the electronic device (101) of FIG. 1 . For example, the display (260) of the electronic device (101) may include at least a portion of the display module (160) of FIG. 1 . In FIGS. 2A, 2B, and 2C , examples of how the electronic device (101) provides recommended words through a keyboard application are illustrated. The keyboard application may be the keyboard application (650) of FIG. 6 .

[0043] Referring to FIG. 2A, the electronic device (101) may display an execution screen (210) of a first application (e.g., the first application (642) of FIG. 6) through a display (260). For example, the electronic device (101) may display the execution screen (210) within at least a portion of the display (260). The first application may include, for example, an interactive application in which a recipient (or counterpart) of a message exists, such as a message application.

[0044] In one embodiment, the execution screen (210) may include a first area (211), a second area (212), and a third area (213). The first area (211) may include a visual object (219) that represents information about the other party. For example, the visual object (219) may represent the name of the other party stored in the electronic device (101) (e.g., a contact application). The second area (212) may represent a history of messages sent and received between a user of the electronic device (101) and the other party. The third area (213) may include an input area (215) for entering text and a send button (217) for sending the text displayed in the input area (215) to the other party. In one embodiment, the first area (211) is shown as being located at the top of the execution screen (210), the third area (213) is shown as being located at the bottom of the execution screen (210), and the second area (212) is shown as being located between the first area (211) and the third area (213), but the layout of the execution screen (210) is not limited to the illustrated example.

[0045] According to one embodiment, the electronic device (101) may receive (or detect) an event for text input. For example, the electronic device (101) may receive an input to an input area (215) for text input.

[0046] Referring to FIG. 2B, according to an embodiment, the electronic device (101) may, in response to an event for text input, display a screen including an execution screen (210) of the first application and an execution screen (220) of a keyboard application through the display (260). For example, while the execution screen (210) of the first application is displayed on the display (260), the electronic device (101) may control the display (260) to display the execution screen (210) displayed in a first area of ​​the display (260) in a second area of ​​the display (260) and to display the execution screen (220) of the keyboard application in a third area of ​​the display (260), in response to an event for text input. For example, in response to the event for the text input, the electronic device (101) may display the execution screen (210) displayed in the first area in the second area, which is included in the first area and has a smaller size than the first area. In addition, the electronic device (101) may display the execution screen (220) of the keyboard application in the third area, which is included in the first area and has a smaller size than the first area. Alternatively, in response to the event for the text input, the electronic device (101) may display the execution screen (210) of the first application in the second area, which is identical to the first area, and may display the execution screen (220) of the keyboard application in the third area within the first area, overlapping the execution screen (210) of the first application (e.g., a floating keyboard). In one embodiment, displaying the execution screen (220) of the keyboard application may include launching and / or loading the keyboard application.

[0047] In one embodiment, the execution screen (220) of the keyboard application may include a first area (221) and a second area (222). The first area (221) may include visual objects (e.g., a plurality of character keys) corresponding to different characters. For example, the first area (221) may include key buttons corresponding to different characters. In one embodiment, the second area (222) may include visual objects (231, 232, 233) representing recommended words. Although not shown, the electronic device (101) may, in response to an input to the visual objects (231, 232, 233), display a word (or sentence) corresponding to the visual objects (231, 232, 233) on the input area (215) within the execution screen (210) of the first application.

[0048] Referring to FIG. 2C, according to one embodiment, an electronic device (101) may receive an input for a key button (or key image) (225) of the keyboard application. Based on the reception of an input for the key button (225), the electronic device (101) may display a character corresponding to the key button (225) on an input area (215) within an execution screen (210) of the first application.

[0049] In one embodiment, the electronic device (101) may display visual objects (241, 242, 243) representing recommended words associated with the characters corresponding to the key buttons (225) on the second area (222) of the execution screen (220) of the keyboard application. Although not shown, the electronic device (101) may display words (or sentences) corresponding to the visual objects (241, 242, 243) on the input area (215) of the execution screen (210) of the first application in response to inputs to the visual objects (241, 242, 243).

[0050] FIGS. 3A and 3B illustrate examples of screens displayed by an electronic device according to one embodiment. The electronic device (101) of FIGS. 3A and 3B may be an example of the electronic device (101) of FIG. 1.

[0051] The first application having the execution screen (310) illustrated in FIGS. 3A and 3B and the first application having the execution screen (210) illustrated in FIGS. 2A, 2B, and 2C may be identical to each other. For example, the first application having the execution screen (310) illustrated in FIGS. 3A and 3B may be an interactive application such as a message application.

[0052] With respect to the execution screen (310), input area (315), and execution screen (320) illustrated in FIGS. 3a and 3b, the descriptions of the execution screen (210), input area (215), and execution screen (220) of FIGS. 2a, 2b, and 2c may be applied in a substantially identical or corresponding manner.

[0053] Referring to FIG. 3a, in one embodiment, the execution screen (310) of the first application may include a visual object (319) representing a counterpart. The counterpart shown in the execution screen (310) may be different from the counterpart shown in the execution screen (210) of FIG. 2a.

[0054] In one embodiment, the second area (322) of the keyboard application may include visual objects (331, 332, 333) representing recommended words. According to one embodiment, the electronic device (101) may provide recommended words according to the counterpart of the interactive application. For example, the counterpart shown in the execution screen (210) of FIG. 2B may be 'girlfriend', and the recommended words corresponding to the counterpart may include 'I love you', 'Good night', and 'Dream of me'. In contrast, the counterpart shown in the execution screen (310) of FIG. 3A may be 'boss', and the recommended words corresponding to the counterpart may include 'boss', 'Good', and 'I am reporting to you'.

[0055] Referring to FIG. 3B, according to one embodiment, an electronic device (101) may receive an input for a key button (325) of the keyboard application. The electronic device (101) may display visual objects (341, 342, 343) representing recommended words associated with the character corresponding to the key button (325) on a second area (322) of an execution screen (320) of the keyboard application. In one embodiment, the character corresponding to the key button (325) may be the same as the character corresponding to the key button (225) of FIG. 2C.

[0056] According to one embodiment, the electronic device (101) may provide recommended words according to the counterpart of the interactive application, even if the same key button is input. For example, the counterpart shown in the execution screen (210) of FIG. 2c is 'girlfriend', and recommended words associated with the letter 'ㅅ' corresponding to the counterpart and input through the key button (225) may include 'I love you', 'Send me a picture', and 'I'll buy it for you'. In contrast, the counterpart shown in the execution screen (310) of FIG. 3b is 'boss', and recommended words associated with the letter 'ㅅ' corresponding to the counterpart and input through the key button (325) may include 'boss', 'at the office', and 'accident handling'. In one embodiment, the input of characters for providing recommended words has been described as being performed through input to a key button of the keyboard application (e.g., key button (325)), but is not limited thereto. For example, input of characters to provide the above recommended words can be performed through an external input device (e.g., a hardware keyboard) connected wirelessly or wired to the electronic device (101).

[0057] FIG. 4 illustrates examples of screens displayed by an electronic device according to an embodiment. The electronic device (101) of FIG. 4 may be an example of the electronic device (101) of FIG. 1. FIG. 4 illustrates examples of a method by which the electronic device (101) provides recommended words through a keyboard application. The keyboard application may be the keyboard application (650) of FIG. 6.

[0058] Referring to FIG. 4, the electronic device (101) may display an execution screen (410) of a second application (e.g., the second application (644) of FIG. 6) through the display (260). In one embodiment, the second application may be a different application from the first application described with reference to FIGS. 2A, 2B, 2C, 3A, and 3B. For example, the second application may be an SNS application. For example, the second application may be a non-interactive application in which there is no counterparty involved in text input.

[0059] According to one embodiment, the electronic device (101) may receive (or detect) an event for text input. For example, the electronic device (101) may receive an input for an input area (415) of an execution screen (410) of the second application. In response to receiving an input for the input area (415), the electronic device (101) may display an execution screen (420) of a keyboard application. In FIG. 4, for convenience of explanation, only the second area (422) among the first area (e.g., the first area (321) of FIG. 3b) and the second area (422) of the execution screen (420) of the keyboard application is illustrated.

[0060] In one embodiment, the electronic device (101) may display visual objects (431, 432, 433) representing recommended words through the display (260). For example, the electronic device (101) may display the visual objects (431, 432, 433) in a second area (422) of the execution screen (420) of the keyboard application. For example, the visual objects (431, 432, 433) may include texts related to the second application, such as '#ootd', '#salgucookie', and '#mungstagram'.

[0061] According to one embodiment, the electronic device (101) may provide recommended words according to the application. For example, the recommended words provided in the interactive application of FIG. 3A may include "boss," "well," and "reporting." In contrast, the recommended words provided in the non-interactive application of FIG. 4 may include #ootd, #salgucookie, and #mungstagram. The electronic device (101) may enhance user convenience by providing recommended words appropriate for the application.

[0062] According to one embodiment, the electronic device (101) may receive an input for a key button (not shown) of the keyboard application. Based on the reception of an input for the key button, the electronic device (101) may display a character corresponding to the key button on an input area (415) within an execution screen (410) of the second application. For example, if the key button corresponding to 'ㅅ' is input, 'ㅅ' may be displayed within the input area (415).

[0063] In one embodiment, the electronic device (101) may display visual objects (441, 442, 443) representing recommended words associated with the character corresponding to the key button on the second area (422) of the execution screen (420) of the keyboard application. For example, when the key button corresponding to 'ㅅ' is input, visual objects (441, 442, 443) including texts such as 'selfie', 'apricot cookie', and 'photographer' associated with the second application and the input character 'ㅅ' may be displayed.

[0064] FIG. 5 illustrates examples of screens displayed by an electronic device according to an embodiment. The electronic device (101) of FIG. 5 may be an example of the electronic device (101) of FIG. 1. FIG. 5 illustrates examples of a method for the electronic device (101) to provide recommended words through a keyboard application. The keyboard application may be the keyboard application (650) of FIG. 6.

[0065] Referring to FIG. 5, the electronic device (101) may display an execution screen (510) of a third application (e.g., the second application (644) of FIG. 6) through the display (260). In one embodiment, the third application may be a different application from the first application described with reference to FIGS. 2A, 2B, 2C, 3A, and 3B. For example, the third application may be a delivery application. For example, the third application may be a non-interactive application in which no other party is involved in text input. In one embodiment, the third application may be a different application from the second application described with reference to FIG. 4. Although the third application and the second application both belong to the non-interactive applications, the third application may be a delivery application and the second application may be an SNS application.

[0066] According to one embodiment, the electronic device (101) may receive (or detect) an event for text input. For example, the electronic device (101) may receive an input for an input area (515) of an execution screen (510) of the third application. In response to receiving an input for the input area (515), the electronic device (101) may display an execution screen (520) of a keyboard application. In FIG. 5, for convenience of explanation, only the second area (522) among the first area (e.g., the first area (321) of FIG. 3b) and the second area (522) of the execution screen (520) of the keyboard application is illustrated.

[0067] In one embodiment, the electronic device (101) may display visual objects (531, 532, 533) representing recommended words through the display (260). For example, the electronic device (101) may display the visual objects (531, 532, 533) in a second area (522) of the execution screen (520) of the keyboard application. For example, the visual objects (531, 532, 533) may include texts associated with the third application, such as 'McDonald's', 'Gwang-eo', and 'Sundae-guk'.

[0068] According to one embodiment, the electronic device (101) may provide recommended words according to the application. For example, the recommended words provided in the SNS application of FIG. 4 may include #ootd, #apricotcookie, and #mongstagram. In contrast, the recommended words provided in the delivery application of FIG. 5 may include "McDonald's," "flounder," and "sundaeguk." The electronic device (101) may enhance user convenience by providing recommended words appropriate for the application.

[0069] According to one embodiment, the electronic device (101) may receive an input for a key button (not shown) of the keyboard application. Based on the reception of an input for the key button, the electronic device (101) may display a character corresponding to the key button on an input area (515) within an execution screen (510) of the third application. For example, if the key button corresponding to 'ㅅ' is input, 'ㅅ' may be displayed within the input area (515).

[0070] In one embodiment, the electronic device (101) may display visual objects (541, 542, 543) representing recommended words associated with the character corresponding to the key button on the second area (522) of the execution screen (520) of the keyboard application. For example, when the key button corresponding to 'ㅅ' is input, visual objects (541, 542, 543) including texts such as 'Sundae Guk', 'Charcoal Fire', and 'Sugar Coffee' associated with the third application and the input character 'ㅅ' may be displayed.

[0071] FIG. 6 is an exemplary block diagram of an electronic device according to one embodiment.

[0072] Referring to FIG. 6, according to one embodiment, an electronic device (601) may include a processor (620), a display (660), and a memory (630). In one embodiment, the electronic device (601) may be an example of the electronic device (101) of FIG. 1. For example, the processor (620), the display (660), and the memory (630) of the electronic device (601) may each include the processor (120), the display module (160), and the memory (130) of the electronic device (101).

[0073] In one embodiment, the processor (620), the display (660), and / or the memory (630) may be electrically and / or operatively connected to one another by a communication bus. Hereinafter, operatively connecting the hardware components may mean that a direct connection, or an indirect connection, is established between the hardware components, either wired or wireless, such that a second hardware component is controlled by a first hardware component among the hardware components.

[0074] According to one embodiment, the processor (620) of the electronic device (601) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), and a field programmable gate array (FPGA). As an example, the hardware component for processing data may include a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing (DSP), a microcontroller (MCU), and / or a neural processing unit (NPU). The number of processors (620) may be one or more. For example, the processor (620) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core.

[0075] According to one embodiment, the display (660) of the electronic device (601) may output visualized information to the user. For example, the display (660) may be controlled by the processor (620) and / or the GPU to output visualized information to the user.

[0076] According to one embodiment, the memory (630) may include a hardware component for storing data and / or instructions input to and / or output from the processor (620). The memory (630) may include, for example, volatile memory such as random-access memory (RAM), and / or non-volatile memory such as read-only memory (ROM). The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disc, and embedded multimedia card (eMMC).

[0077] According to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by the processor (620) of the electronic device (601) may be stored in the memory (630) of the electronic device (601). A set of one or more instructions may be referred to as a program, firmware, an operating system, a process, a routine, a sub-routine, and / or an application. Hereinafter, when an application is installed in the electronic device (e.g., the electronic device (601)), it may mean that one or more instructions provided in the form of an application are stored in the memory (630), and that the one or more applications are stored in a format executable by the processor of the electronic device (e.g., a file having an extension designated by the operating system of the electronic device (601)). According to one embodiment, the electronic device (601) may execute one or more instructions stored in the memory (630) to perform the operations of FIGS. 7 and 8.

[0078] According to one embodiment, the programs installed in the electronic device (601) may include a screen analysis model (610), a first application (642), a second application (642), a keyboard application (650), and a keyboard operation recommendation model (670).

[0079] In one embodiment, the screen analysis model (610) may include a content capture service (625) provided as a framework service. The content capture service (625) may include a screen analysis model (610) for detecting changes in a screen displayed on a display (660), a view recognition module (624) for recognizing and analyzing a screen displayed on a display (260) by dividing the screen into framework view units, a text recognition module (626) for recognizing and extracting text displayed on the screen of the display (260), and a language detection module (628) for detecting a language corresponding to the extracted text.

[0080] In one embodiment, the screen analysis model (610) can detect an event, such as a change in the screen displayed on the display (260). The screen analysis model (610) can analyze the screen displayed on the display (260). For example, but not limited to, the screen analysis model (610) can analyze the screen displayed on the display (260) in response to detecting an event, such as a change in the screen.

[0081] For example, the screen analysis model (610) can identify whether the screen is a screen that can use the keyboard application (650) by using an analysis of the screen of the display (260). For example, the screen analysis model (610) can identify whether the screen is a screen that can use the keyboard application (650) by identifying whether a view area including a text input field exists among a plurality of view areas within the screen. For example, referring to FIG. 2A, the screen analysis model (610) can determine that the execution screen (210) is a screen that can use the keyboard application (650) by identifying the input area (215) within the third area (213). For example, referring to FIG. 3A, the screen analysis model (610) can determine that the execution screen (310) is a screen that can use the keyboard application (650) by identifying the input area (315) within the execution screen (310). For example, referring to FIG. 4, the screen analysis model (610) can determine that the execution screen (410) is a screen that can use the keyboard application (650) by identifying the input area (415) within the execution screen (410). Referring to FIG. 5, the screen analysis model (610) can determine that the execution screen (510) is a screen that can use the keyboard application (650) by identifying the input area (515) within the execution screen (510).

[0082] In one embodiment, the screen analysis model (610) may obtain information about the screen based on identifying the screen of the display (260) as a screen that can use the keyboard application (650). For example, the screen analysis model (610) may obtain information about the screen by analyzing the screen by the view area. The information about the screen may include, for example, information about the application displayed on the display (260), the other party represented by the screen, the content of the conversation with the other party represented by the screen, keyboard setting patterns, and keyboard input patterns.

[0083] For example, the screen analysis model (610) can obtain information indicating which application is displayed on the display (260) based on an analysis of the layout of the screen displayed on the display (260). For example, referring to FIG. 2A, the screen analysis model (610) can obtain information indicating that the first application corresponding to the execution screen (210) is a message application based on an analysis of the layout of the execution screen (210). For example, referring to FIG. 3A, the screen analysis model (610) can obtain information indicating that the first application corresponding to the execution screen (310) is a message application based on an analysis of the layout of the execution screen (310). For example, referring to FIG. 4, the screen analysis model (610) can obtain information indicating that the second application corresponding to the execution screen (410) is an SNS application based on an analysis of the layout of the execution screen (410). For example, referring to FIG. 5, the screen analysis model (610) can obtain information indicating that the third application corresponding to the execution screen (510) is a delivery application based on analysis of the layout of the execution screen (510).

[0084] For example, referring to FIG. 2A, the screen analysis model (610) can obtain information about the counterparty appearing on the execution screen (210) based on text extracted from a visual object (219) in a first area (211) of the execution screen (210). In one embodiment, the electronic device (601) can obtain information about the counterparty based on text (and / or emoji) extracted from the execution screen (210). For example, the electronic device (601) can determine the relationship with the counterparty by analyzing the conversation content in the second area (212) of the execution screen (210). For example, referring to FIG. 3A, the screen analysis model (610) can obtain information about the counterparty appearing on the execution screen (310) based on text extracted from a visual object (319) in the execution screen (310). The information about the other party may include at least one of the other party's phone number, address, the group to which the other party belongs, ID, and stored name. To obtain such information about the other party, previously stored contact information may be used in addition to text extracted from the application's execution screen. The contact information may include information stored in relation to a contact application. For example, the electronic device (601) may confirm contact information corresponding to text extracted from a visual object (319) to obtain information about the other party. The electronic device (601) may obtain at least a portion of the contact information identified as corresponding to the text extracted from the visual object (319) as information about the other party.

[0085] For example, referring to FIG. 2A, the screen analysis model (610) can obtain information about the user's keyboard setting pattern and keyboard input pattern for the counterpart represented by the execution screen (210) based on text (and / or emoji) extracted from a message in the second area (212) of the execution screen (210). For example, referring to FIG. 3A, the screen analysis model (610) can obtain information about the user's keyboard setting pattern and keyboard input pattern for the counterpart represented by the execution screen (310) based on text extracted from a message in the execution screen (310). The information about the keyboard setting pattern and the keyboard input pattern can be used to provide recommended words according to the counterpart.

[0086] Alternatively, at least some of the information about the application, the counterparty represented by the screen, the keyboard setting pattern and the keyboard input pattern may be provided by the first application (642) or the second application (644).

[0087] According to one embodiment, the first application (642) may include a messenger application of the electronic device (601). The second application (644) may include, but is not limited to, an SNS application, an application for providing a real-time streaming service, and a delivery application. For example, the first application (642) may be an interactive application in which a counterparty of the user controlling the electronic device (601) exists, and the second application (644) may be a non-interactive application in which the counterparty does not exist. In one embodiment, the first application (642) may be the first application corresponding to the execution screen (210) of FIGS. 2A, 2B, and 2C. In one embodiment, the first application (642) may be the first application corresponding to the execution screen (310) of FIGS. 3A and 3B. In one embodiment, the second application (644) may include the second application corresponding to the execution screen (410) of FIG. 4 and / or the third application corresponding to the execution screen (510) of FIG. 5.

[0088] In one embodiment, a keyboard application (650) used by a user to input characters may convert user input to key buttons into characters. In one embodiment, the electronic device (101) may obtain information about the user's keyboard setting pattern and keyboard input pattern using the keyboard application (650). In one embodiment, the keyboard application (650) may be referred to as a keyboard, a virtual keyboard, or a software keyboard.

[0089] In one embodiment, the keyboard motion recommendation model (670) may include an artificial intelligence model trained to provide recommended settings and recommended words (or sentences) based on information about the keyboard setting pattern and information about the keyboard input pattern. For example, the electronic device (601) or the keyboard motion recommendation model (670) may include at least one of the blocks of the artificial intelligence system of FIG. 9. For example, the electronic device (601) or the keyboard motion recommendation model (670) may include the generative AI model (930) of FIG. 9. In one embodiment, the keyboard application (650) may be operated based on the recommended settings and recommended words provided by the keyboard motion recommendation model (670). For example, referring to FIG. 2b, the electronic device (101) may, in response to an event for text input, display a keyboard application (650) having the recommended settings, and together with this, display visual objects (231, 232, 233) based on the recommended words. Alternatively, the operation of the electronic device (601) using the keyboard operation recommendation model (670) may be performed by a server external to the electronic device (601) (e.g., the server (108) of FIG. 1). In this case, the electronic device (601) may transmit information about the keyboard setting pattern and information about the keyboard input pattern to the server external to the electronic device (601). Thereafter, the electronic device (601) may receive information about recommended settings and recommended words based on the information about the keyboard setting pattern and information about the keyboard input pattern from the server external to the electronic device (601). Alternatively, the operation of the electronic device (601) using the screen analysis model (610) may be performed by a server external to the electronic device (601). In this case, the electronic device (601) may transmit an image corresponding to the screen being displayed to the external server and receive an analysis result for the image from the external server.

[0090] In one embodiment, the electronic device (101) can display a character corresponding to a key button received through a keyboard application (650) through a display (260). The electronic device (101) can transmit the character corresponding to the key button from the keyboard application (650) to a keyboard operation recommendation model (670). The electronic device (101) can obtain another recommended word associated with the key button from the keyboard operation recommendation model (670). The electronic device (101) can display the other recommended word through the display (260).

[0091] For example, referring to FIG. 2C, the electronic device (101) may receive an input for a key button (225) of a keyboard application (650) and display a character corresponding to the key button (225) on an input area (215) within an execution screen (210). The electronic device (101) may display visual objects (241, 242, 243) representing other recommended words associated with the character obtained using the character corresponding to the key button (225) within a second area (222) of the keyboard application (650).

[0092] For example, referring to FIG. 3B, the electronic device (101) may receive an input for a key button (325) of a keyboard application (650) and display a character corresponding to the key button (325) on an input area (315) within an execution screen (310). The electronic device (101) may display visual objects (341, 342, 343) representing other recommended words associated with the character obtained using the character corresponding to the key button (325) within a second area (322) of the keyboard application (650).

[0093] For example, referring to FIG. 4, the electronic device (101) may receive an input for a key button of a keyboard application (650) and display a character corresponding to the key button on an input area (415) within an execution screen (410). The electronic device (101) may display visual objects (441, 442, 443) representing other recommended words associated with the character obtained using the character corresponding to the key button, within a second area (422) of the keyboard application (650).

[0094] For example, referring to FIG. 5, the electronic device (101) may receive an input for a key button of a keyboard application (650) and display a character corresponding to the key button on an input area (515) within an execution screen (510). The electronic device (101) may display visual objects (541, 542, 543) representing other recommended words associated with the character obtained using the character corresponding to the key button, within a second area (522) of the keyboard application (650).

[0095] In one embodiment, the keyboard motion recommendation model (670) may include a personalized model generated based on information about the application, information about the conversation partner, information about the keyboard setting pattern, and information about the keyboard input pattern. For example, in the case of an interactive application such as the first application (642), the keyboard motion recommendation model (670) may be generated for each counterpart of the first application (642). For example, a keyboard motion recommendation model corresponding to a counterpart (e.g., a girlfriend) shown by the execution screen (210) of FIG. 2A and a keyboard motion recommendation model corresponding to a counterpart (e.g., a boss) shown by the execution screen (310) of FIG. 3A may be generated separately. For example, in the case of a non-interactive application such as the second application (644), the keyboard motion recommendation model (670) may be generated for each application. For example, a keyboard action recommendation model corresponding to the second application of FIG. 4 and a keyboard action recommendation model corresponding to the third application of FIG. 5 can be generated separately.

[0096] Through this, personalized keyboard settings and recommended words can be provided depending on the type of application using the keyboard application (650) and the conversation partner. For example, even if the keyboard application (650) is called from the same application, recommended words that are at least partially different from each other may be provided depending on the conversation partner, such as the visual objects (231, 232, 233) of FIG. 2B and the visual objects (331, 332, 333) of FIG. 3A. For example, even if the same key button of the keyboard application (650) is input from the same application (e.g., the key button (225) of FIG. 2C and the key button (325) of FIG. 3B), recommended words that are at least partially different from each other may be provided depending on the conversation partner, such as the visual objects (231, 232, 233) of FIG. 2B and the visual objects (331, 332, 333) of FIG. 3A. For example, different recommended words may be provided depending on the application, such as the visual objects (331, 332, 333) of FIG. 3a and the visual objects (431, 432, 433) of FIG. 4.

[0097] Table 1 below shows an example of data stored in the keyboard action recommendation model (670).

[0098] Specific ID, Contact Info, Package Info, Input Field Info, Last Access Time, Last Used Language, Settings Value, Touch History, Target Language, Source Language, Sentences, User Language model

[0099] Referring to Table 1 above, in one embodiment, a specific ID may include data related to a keyboard gesture recommendation model (670), including a last access time and a target language. The last access time may be the time when the keyboard gesture recommendation model (670) was last accessed. Since the keyboard gesture recommendation model (670) is personalized and generated for each application and counterpart, the number of keyboard gesture recommendation models (670) may become too large. Therefore, there may be a limit to the number of keyboard gesture recommendation models (670). When the limit is reached, the model with the oldest last access time may be deleted and a new model may be generated.

[0100] Contact information, including data related to the other party, may include the last spoken language and the source language. When conversing with the other party, a keyboard application with language settings corresponding to the other party's last spoken language can be invoked.

[0101] In one embodiment, the target language and the source language may be data stored for providing a translation keyboard.

[0102] The package information may include setting values ​​and sentences as data related to the keyboard application (650). The setting values ​​may be data that stores various setting values ​​of the keyboard application (650). For non-limiting examples, the setting values ​​may include setting values ​​for keyboard layouts such as QWERTY and Dvorak keyboards, setting values ​​for keyboard types such as English keyboards, Korean keyboards, and numeric keypads, and setting values ​​for shortcut keys. Through this, a keyboard application with stored setting values ​​suitable for the usage situation may be called.

[0103] In one embodiment, the sentences may include natural language sentences obtained through screen analysis as data used by the action recommendation model (670) to generate and continuously learn recommended words.

[0104] Input field information may include touch history and a user language model. The touch history can improve the accuracy of user input by storing values ​​for key button input points when the user uses the keyboard application (650) and reflecting these values ​​in the operation of the keyboard application (650). The user language model may be a learned user language model.

[0105] FIG. 7 is a flowchart illustrating the operation of an electronic device according to one embodiment. The operations of FIG. 7 may be performed by the electronic device (601) or processor (620) of FIG. 6.

[0106] Referring to FIG. 7, in operation 710, the electronic device (601) may display an execution screen of an application through a display. The execution screen may include, for example, execution screens (210, 310, 410, or 510).

[0107] In operation 720, the electronic device (601) can identify whether the screen being displayed through the display is a screen that can use a keyboard application. The description of operation 720 may be substantially identical to the description provided with reference to FIG. 6 . For example, the electronic device (601) can identify a view area including a text input field among a plurality of view areas within the screen being displayed through the display. In this case, the electronic device (601) can identify the screen as a screen that can use a keyboard application.

[0108] In operation 720, if the screen is identified as a screen that allows the use of a keyboard application, operation 730 may be performed, otherwise, operation 710 may be performed.

[0109] In operation 730, the electronic device (601) may acquire keyboard usage information by analyzing the screen displayed on the display. The description of operation 730 may be substantially identical to the description provided with reference to FIG. 6 . For example, the usage information may include information about an application, a counterparty displayed on the screen, a keyboard setting pattern, and a keyboard input pattern.

[0110] In operation 740, the electronic device (601) can determine whether a pre-stored keyboard operation recommendation model corresponding to the keyboard usage information exists. For example, but not limited to, the electronic device (601) can determine whether a pre-stored keyboard operation recommendation model corresponding to the keyboard usage information exists by comparing the keyboard usage information acquired in operation 730 with the keyboard usage information stored in a database. For example, the electronic device (601) can determine whether a pre-stored keyboard operation recommendation model corresponding to the user information exists by comparing the user information acquired in operation 730 with the user information stored in a database.

[0111] In operation 740, if it is determined that there is a pre-stored keyboard operation recommendation model corresponding to the keyboard usage information, operation 750 may be performed, and if not, operation 770 may be performed.

[0112] In operation 770, the electronic device (601) may generate a keyboard operation recommendation model based on the keyboard usage information. The generated keyboard operation recommendation model may be a personalized model for an application and / or the other party corresponding to the keyboard usage information.

[0113] In operation 750, the electronic device (601) may receive (or detect) an event for text input. For example, the event for text input may include an event in which the electronic device (601) receives an input for an input field within a screen being displayed through a display. For example, the event for text input may include an event in which the electronic device (601) receives an input through an external input device (e.g., a hardware keyboard) connected to the electronic device (601) by wire or wirelessly while a screen including the input field is displayed.

[0114] In operation 760, the electronic device (601) can load a keyboard operation recommendation model corresponding to the keyboard usage information and display a keyboard application using the keyboard operation recommendation model. The electronic device (601) can display a keyboard application corresponding to the keyboard setting pattern and keyboard input pattern output from the keyboard operation recommendation model.

[0115] FIG. 8 is a flowchart illustrating the operation of an electronic device according to an embodiment. The operations of FIG. 8 may be performed by the electronic device (601) or processor (620) of FIG. 6.

[0116] Referring to FIG. 8, in operation 810, the electronic device (601) may display an execution screen of an application on the display. The execution screen may include execution screens (210, 310, 410, or 510).

[0117] In operation 820, the electronic device (601) may display the execution screen and a software keyboard in response to an event for text input while the execution screen is displayed. For example, the electronic device (601) may control the display to display a software keyboard (e.g., the keyboard application (650) of FIG. 6) together with the execution screen of the application in response to an event for text input while the execution screen of the application is displayed on the display. For example, the software keyboard displayed in response to the event for text input may include at least an area for providing recommended words (e.g., the second area (222) of FIG. 2B or the second area (332) of FIG. 3A). For example, while an external input device (e.g., a hardware keyboard) is connected to the electronic device (601), the area for providing the recommended words of the software keyboard may be displayed, and the key pad of the software keyboard (e.g., the first area (221) of FIG. 2b or the first area (331) of FIG. 3a) may not be displayed, but is not limited thereto.

[0118] In operation 830, the electronic device (601) may display at least one character corresponding to the user input within the execution screen based on a user input received via a keyboard. The keyboard may include, for example, a software keyboard. The keyboard may include, for example, an external input device, such as a hardware keyboard, that is connected to the electronic device (601) wirelessly or by wire. For example, the electronic device (601) may display at least one character corresponding to the user input within an input field within the execution screen based on a user input received via the software keyboard for entering a character. As another example, the electronic device (601) may display at least one character corresponding to the user input within an input field within the execution screen based on a user input received via the external input device.

[0119] In operation 840, the electronic device (601) may display at least one recommended word based on identifying the user input, using the at least one character and the information about the other party displayed by the execution screen. For example, as illustrated in FIG. 2c, the electronic device (601) may display recommended words such as “I love you,” “Send me a picture,” and “I’ll buy it for you,” using the input character “ㅅ” and the information about the other party “girlfriend” displayed by the execution screen (210). For example, as illustrated in FIG. 3b, the electronic device (601) may display recommended words such as “boss,” “at the office,” and “accident handling,” using the input character “ㅅ” and the information about the other party “boss” displayed by the execution screen (310).

[0120] FIG. 9 is an exemplary block diagram illustrating a generative artificial intelligence system according to an embodiment. In FIG. 9, an exemplary artificial intelligence system is illustrated, including a user question response interface (910), an AI framework (920), a generative AI model (930), a knowledge repository (940), and an application / service component (950). According to an embodiment, a processor (e.g., the processor 120 of FIG. 1) of an electronic device (e.g., the electronic device 101 of FIG. 1) may execute one or more programs defined by the blocks of FIG. 9 to execute functions related to generative artificial intelligence.

[0121] In one embodiment, a User Query / Response Interface (910) can receive user input. The user input may be in the form of natural language, images, and / or videos. Context information may also be transmitted when the user input is transmitted. Context information may include various additional information at the time of user input. For example, information about the application currently being used by the user or the user's location information. Furthermore, the user input may be in a mixed form of natural language, images, sounds, and context information. Furthermore, the user input may be in a non-natural language form, such as selecting a menu. The User Query / Response Interface (910) can output the results of a generative artificial intelligence system to the user. The output may be in the form of natural language or specific content, and may also be provided in the form of an action requested by the user. The User Query / Response Interface (910) can output the results of a generative artificial intelligence system to the user. The output may be in the form of natural language or specific content, and may also be provided in the form of an action requested by the user.

[0122] The AI ​​framework (920) can receive user input and coordinate and control each component necessary to perform the user's intention based on the user's query. The AI ​​framework (920) can include a prompt design component (921), an API / plug-in management component (922), and a refinery component (923).

[0123] User input received from the user question response interface (910) can be transmitted to the prompt design component (921). The prompt design component (921) can be used to generate prompts suitable for inputting the user input into an LLM or LMM (Large Multimodal Model). The prompt design component (921) can be an AI component that uses a machine learning algorithm or a neural network to develop better prompts over time. The prompt design component (921) can access knowledge repositories (940) containing user preference data, a prompt library, and prompt examples based on the user input to generate prompts and transmit the generated prompts to the LLM or LMM.

[0124] The API / plugin management component (922) can communicate with external information when there is a request for additional information when passing user input as input to the generative model. The API / plugin management component (922) can establish a channel for communicating with the outside of the AI ​​framework (920) through an application programming interface (API) and can enable access to various data sources through the established channel. In addition, the API / plugin management component (922) can request an action through the API that ultimately performs the user input, rather than an intermediate result, when the action needs to be performed by the application / service component (950) (e.g., the program (140) or application (146) of FIG. 1). Information obtained from the outside can be used to generate a prompt in the prompt design component (921) together with the user input or can be passed as input to the generative model.

[0125] The refinement component (923) (or output modification component) can fine-tune the output from the generative AI model (930). For example, the refinement component (923) can verify whether the content generated through the LLM and / or LMM is irrelevant, biased, or harmful. In addition, the refinement component (923) can determine whether the content matches the user's desired result to some extent and, if necessary, can perform additional processing. The refinement component (923) can additionally configure and provide hints to the user to avoid unwanted output.

[0126] A generative AI model (930) may generally refer to an artificial intelligence neural network that creates new types of data based on user input information. The generative AI model (930) may include an image-generating model and / or a language-generating model. Representative models for generating images include a generative adversarial network (GAN) and a variational auto encoder (VAE), and examples include a diffusion-based generative model that uses a VAE and a transformer structure. A language-generating model is a model trained to statistically output the most appropriate output based on input values, and representative examples include models such as CHAT-GPT 3 and CHAT-GPT 4. In addition, there are also LMMs (large multimodal models) that can recognize various types of data input, such as text, images, and voice, and generate new data corresponding to them.

[0127] According to one embodiment, an electronic device (e.g., the electronic device (601) of FIG. 6) may include a display (e.g., the display (660) of FIG. 6), a memory (e.g., the memory (630) of FIG. 6) for storing instructions, and a processor (e.g., the processor (620) of FIG. 6). The instructions, when executed by the processor, may cause the electronic device to control the display, in response to an event for text input, while an execution screen (e.g., execution screens (210, 310, 410, or 510)) of an application (e.g., a first application (642) or a second application (644) of FIG. 6) is displayed on the display, to display the execution screen displayed on the entire display area of ​​the display on a portion of the display area of ​​the display, and to display a software keyboard (e.g., a keyboard application (650) of FIG. 6) on the remaining portion. The instructions, when executed by the processor, may cause the electronic device to display the software keyboard on the display, the software keyboard including a first region (e.g., first regions (221, 321, 421, or 521)) and a second region (e.g., second regions (222, 322, 422, or 522)) containing visual objects corresponding to different characters, while displaying at least one character corresponding to the user input within the execution screen based on a user input received through the remaining portion. The instructions, when executed by the processor, may cause the electronic device to display at least one word (e.g., visual objects (241, 242, 243, 341, 342, 343, 441, 442, 443, 541, 542, or 543)) in the second area based on identifying the user input and using information about the other party represented by the execution screen.

[0128] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to display, through the display, the at least one word within the execution screen of the application in response to an input to the second area in which the at least one word is displayed.

[0129] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to obtain a captured image of a screen displayed on the display, including the execution screen of the application. The instructions, when executed by the processor, may cause the electronic device to obtain information about the counterparty indicated by the execution screen by using analysis of the captured image.

[0130] The above instructions, when executed by the processor, may cause the electronic device to obtain the information about the counterparty using an artificial intelligence model trained to analyze an image based on a content capture service.

[0131] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to obtain the information about the counterparty in response to detecting that the execution screen of the application is a screen capable of inputting text.

[0132] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to display the at least one word in the second area using a keyboard input pattern corresponding to the information about the counterpart.

[0133] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to obtain keyboard setting pattern information corresponding to the information about the counterpart. The instructions, when executed by the processor, may cause the electronic device to display the software keyboard having settings corresponding to the keyboard setting pattern information in response to the event for text input.

[0134] In one embodiment, the settings may include language settings for the different characters of the software keyboard and arrangement settings of the visual objects corresponding to the different characters.

[0135] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to obtain the at least one word using an artificial intelligence model (e.g., the keyboard gesture recommendation model (670) of FIG. 6) trained to generate a recommended word corresponding to the information about the counterparty and based on input received via the software keyboard.

[0136] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to, in response to determining that the artificial intelligence model corresponding to the information about the counterpart is previously stored, load the pre-stored artificial intelligence model. The instructions, when executed by the processor, may cause the electronic device to, in response to determining that the artificial intelligence model corresponding to the information about the counterpart is not previously stored, generate the artificial intelligence model corresponding to the information about the counterpart.

[0137] In one embodiment, the execution screen of the application may include a chat screen with the counterpart. The instructions, when executed by the processor, may cause the electronic device to: if the counterpart is a first counterpart: display the at least one word in the second area based on an input to a first text key of the software keyboard (e.g., key button (225) of FIG. 2C). The instructions, when executed by the processor, may cause the electronic device to: if the counterpart is a second counterpart different from the first counterpart: display at least one other word different from the at least one word in the second area based on an input to the first text key of the software keyboard (e.g., key button (325) of FIG. 3B).

[0138] According to one embodiment, an electronic device (e.g., electronic device (601) of FIG. 6) may include a display (e.g., display (660) of FIG. 6), a memory (e.g., memory (630) of FIG. 6) for storing instructions, and a processor (e.g., processor (620) of FIG. 6). The instructions, when executed by the processor, may cause the electronic device to display an execution screen (e.g., execution screens (210, 310, 410, or 510)) of an application (e.g., first application (642) or second application (644) of FIG. 6) on the display. The instructions, when executed by the processor, may cause the electronic device to display, on the display, a software keyboard (e.g., the keyboard application (650) of FIG. 6) together with the execution screen of the application, in response to an event for text input while the execution screen of the application is displayed. The instructions, when executed by the processor, may cause the electronic device to receive a user input for one or more character keys among the plurality of character keys while displaying, on the display, the software keyboard, the first region including a plurality of character keys and a second region for displaying one or more suggested words. The instructions, when executed by the processor, may cause the electronic device to display, in an input field within the execution screen, at least one character corresponding to the user input.The instructions, when executed by the processor, may cause the electronic device to display at least one recommended word (e.g., visual objects (241, 242, 243, 341, 342, 343, 441, 442, 443, 541, 542, or 543)) in the second area using the at least one character and information about the other party indicated by the execution screen.

[0139] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to, in response to an input for selecting the at least one recommended word in the second area, display, through the display, a selected recommended word from among the at least one recommended word in the input field within the execution screen of the application.

[0140] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to obtain a captured image of a screen displayed on the display. The captured image may include the execution screen of the application and the conversation content with the other party displayed on the execution screen. The instructions, when executed by the processor, may cause the electronic device to obtain the information about the other party displayed on the execution screen by using an analysis of the captured image.

[0141] The above instructions, when executed by the processor, may cause the electronic device to obtain the information about the counterparty using an artificial intelligence model trained to analyze an image based on a content capture service.

[0142] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to obtain the information about the counterparty in response to detecting that the execution screen of the application is a screen capable of inputting text.

[0143] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to display the at least one recommended word in the second area using a keyboard input pattern corresponding to the information about the counterpart.

[0144] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to obtain keyboard setting pattern information corresponding to the information about the counterpart. The instructions, when executed by the processor, may cause the electronic device to display the software keyboard having settings corresponding to the keyboard setting pattern information in response to the event for text input.

[0145] In one embodiment, the settings may include language settings for the different characters of the software keyboard and arrangement settings of the visual objects corresponding to the different characters.

[0146] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to obtain the at least one recommended word using an artificial intelligence model (e.g., the keyboard gesture recommendation model (670) of FIG. 6) trained to generate a recommended word corresponding to the information about the counterparty and based on input received through the software keyboard.

[0147] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to, in response to determining that the artificial intelligence model corresponding to the information about the counterpart is previously stored, load the pre-stored artificial intelligence model. The instructions, when executed by the processor, may cause the electronic device to, in response to determining that the artificial intelligence model corresponding to the information about the counterpart is not previously stored, generate the artificial intelligence model corresponding to the information about the counterpart.

[0148] In one embodiment, the execution screen of the application may include a chat screen with the counterpart. The instructions, when executed by the processor, may cause the electronic device to: display the at least one recommended word in the second area based on an input to a first text key of the software keyboard (e.g., key button (225) of FIG. 2C), if the counterpart is a first counterpart. The instructions, when executed by the processor, may cause the electronic device to: display at least one other recommended word different from the at least one recommended word in the second area based on an input to the first text key of the software keyboard (e.g., key button (325) of FIG. 3B), if the counterpart is a second counterpart different from the first counterpart.

[0149] According to one embodiment, an electronic device (e.g., electronic device 601 of FIG. 6) may include a display (e.g., display 660 of FIG. 6), a memory (e.g., memory 630 of FIG. 6) for storing instructions, and a processor (e.g., processor 620 of FIG. 6). The instructions, when executed by the processor, may cause the electronic device to display, through the display, a screen including an execution screen of an application and a keyboard interface. The instructions, when executed by the processor, may cause the electronic device to identify a counterparty indicated by the execution screen using analysis of the execution screen. The instructions, when executed by the processor, may cause the electronic device to: if the identified counterparty is a first counterparty: display a first suggested word within the keyboard interface in response to an input for a first text key received through the keyboard interface. The instructions, when executed by the processor, may cause the electronic device to: display, in response to an input to the first text key received through the keyboard interface, a second suggested word different from the first suggested word within the keyboard interface, if the identified counterpart is a second counterpart different from the first suggested word.

[0150] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to control the display, in response to an event for text input while an execution screen of an application is displayed on the display, to display the execution screen displayed in the entire display area of ​​the display, in a portion of the display area of ​​the display, and to display the keyboard interface in the remaining portion.

[0151] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to determine a keyboard setting corresponding to the identified counterpart, and the instructions, when executed by the processor, may cause the electronic device to, in response to the event for text input, display, through the display, the keyboard interface having the keyboard setting.

[0152] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to identify a category of the application using an analysis of the execution screen, and the instructions, when executed by the processor, may cause the electronic device to: if the identified category is a non-interactive application in which the counterpart does not appear on the execution screen: display, in response to an input to the first text key received through the keyboard interface, a third recommended word different from the first recommended word and the second recommended word within the keyboard interface.

[0153] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to, in response to the input to the first text key, display text corresponding to the first text key within the execution screen of the application.

[0154] According to one embodiment, an electronic device (e.g., the electronic device (601) of FIG. 6) may include a display (e.g., the display (660) of FIG. 6), a memory (e.g., the memory (630) of FIG. 6) for storing instructions, and a processor (e.g., the processor (620) of FIG. 6). The instructions, when executed by the processor, may cause the electronic device to display an execution screen of an application through the display. The instructions, when executed by the processor, may cause the electronic device to display a software keyboard through the display in a portion of the entire display area of ​​the display in response to an event for text input while the execution screen is displayed on the display. The instructions, when executed by the processor, may cause the electronic device to detect a counterparty represented by the execution screen using an analysis of the execution screen, based on: determining a keyboard usage pattern corresponding to the counterparty; Using the above keyboard usage pattern and at least one character received through the software keyboard, at least one recommended word can be caused to be displayed through the display.

[0155] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to determine a keyboard setting corresponding to the counterpart represented by the execution screen based on an analysis of the execution screen. The instructions, when executed by the processor, may cause the electronic device to display, through the display, the software keyboard having the keyboard setting in response to the event for text input.

[0156] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to, in response to receiving the at least one character via the software keyboard, display the at least one character within an input field of the execution screen of the application.

[0157] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to display the at least one word within an input field of the execution screen of the application in response to an input for the at least one word displayed through the display.

[0158] According to one embodiment, a method of an electronic device (601) including a display (660) may include: displaying an execution screen of an application through the display (660); while the execution screen of the application is displayed, in response to an event for text input, displaying a software keyboard together with the execution screen of the application through the display (660); while displaying the software keyboard on the display (660), the software keyboard including a first area including a plurality of character keys and a second area for displaying one or more recommended words, receiving a user input for one or more character keys among the plurality of character keys; displaying at least one character corresponding to the user input in an input field within the execution screen; and displaying at least one recommended word in the second area using the at least one character and information about the other party indicated by the execution screen.

[0159] In one embodiment, the method may include: identifying a counterpart indicated by the execution screen; displaying a first recommended word within the keyboard interface based on an input to a first text key among the plurality of character keys when the identified counterpart is a first counterpart; and displaying a second recommended word, different from the first recommended word, within the second area in response to an input to the first text key when the identified counterpart is a second counterpart different from the first counterpart.

[0160] In one embodiment, the method may include: identifying a category of the application; and, if the identified category is a non-interactive application in which the counterpart does not appear on the execution screen, displaying a third recommended word, different from the first recommended word and the second recommended word, in the second area in response to an input to the first text key.

[0161] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0162] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0163] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0164] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0165] According to one embodiment, the method according to the various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0166] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; Memory for storing instructions; and Contains a processor, The above instructions, when executed by the processor, cause the electronic device to: Through the above display, the application's execution screen is displayed, While the execution screen of the above application is displayed, in response to an event for text input, a software keyboard is displayed together with the execution screen of the above application through the display; While displaying the software keyboard on the display, the software keyboard including a first area including a plurality of character keys and a second area for displaying one or more suggested words, receiving a user input for one or more of the plurality of character keys, Displaying at least one character corresponding to the user input in an input field within the above execution screen; Causing to display at least one recommended word in the second area by using the information about the counterpart indicated by the at least one character and the execution screen. Electronic devices.

2. In claim 1, The above instructions, when executed by the processor, cause the electronic device to: In response to an input for selecting at least one recommended word in the second area, causing the selected recommended word from among the at least one recommended word to be displayed in the input field within the execution screen of the application through the display. Electronic devices.

3. In claim 1, The above instructions, when executed by the processor, cause the electronic device to: Obtaining a capture image of the screen displayed on the display, wherein the capture image includes the execution screen of the application and the conversation content with the other party displayed by the execution screen, By using the analysis of the above captured image, causing the information about the counterparty displayed by the execution screen to be obtained, Electronic devices.

4. In claim 3, The above instructions, when executed by the processor, cause the electronic device to: Using an artificial intelligence model trained to analyze images based on a content capture service, causing said counterpart to obtain said information, Electronic devices.

5. In claim 4, The above instructions, when executed by the processor, cause the electronic device to: In response to detecting that the execution screen of the above application is a screen where text input is possible, causing the information about the other party to be acquired, Electronic devices.

6. In any one of claims 3 to 5, The above instructions, when executed by the processor, cause the electronic device to: Causing to display at least one recommended word in the second area by using a keyboard input pattern corresponding to the information about the other party. Electronic devices.

7. In any one of claims 3 to 5, The above instructions, when executed by the processor, cause the electronic device to: Obtain keyboard setting pattern information corresponding to the above information about the above counterpart, In response to said event for said text input, causing said software keyboard to be displayed having settings corresponding to said keyboard setting pattern information. Electronic devices.

8. In claim 7, The above settings are, Language settings for the different characters of the above software keyboard; and Including the arrangement setting of the visual objects corresponding to the different characters, Electronic devices.

9. In claim 3, The above instructions, when executed by the processor, cause the electronic device to: causing said at least one recommended word to be obtained by using an artificial intelligence model trained to respond to said information about said counterpart and to generate recommended words based on input received through said software keyboard; Electronic devices.

10. In claim 9, The above instructions, when executed by the processor, cause the electronic device to: In response to confirming that the artificial intelligence model corresponding to the information about the other party is previously stored, loading the previously stored artificial intelligence model, In response to determining that the artificial intelligence model corresponding to the information about the other party is not already stored, causing the artificial intelligence model corresponding to the information about the other party to be generated, Electronic devices.

11. In any one of claims 1 to 10, The execution screen of the above application includes a chat screen with the other party, The above instructions, when executed by the processor, cause the electronic device to: If the above counterparty is the first counterparty: Based on an input to the first text key of the software keyboard, displaying at least one suggested word in the second area; If the above counterparty is a second counterparty different from the above first counterparty: Causing, based on an input to the first text key of the software keyboard, to display at least one other suggested word different from the at least one suggested word in the second area; Electronic devices.

12. In claim 1, The above instructions, when executed by the processor, cause the electronic device to: By checking the contact information corresponding to the text information included in the above execution screen, information about the other party is obtained, The above contact information includes at least one of the other party's phone number, address, group, ID, and name. Electronic devices.

13. A method of an electronic device including a display, An action of displaying the execution screen of an application through the above display; An action of displaying a software keyboard together with the execution screen of the application through the display in response to an event for text input while the execution screen of the application is displayed; An operation of receiving a user input for one or more of the plurality of character keys while displaying the software keyboard on the display, the software keyboard including a first area including a plurality of character keys and a second area for displaying one or more suggested words; An action of displaying at least one character corresponding to the user input in an input field within the execution screen; and Including an action of displaying at least one recommended word in the second area using the information about the counterpart indicated by the at least one character and the execution screen. method.

14. In claim 13, An action to identify the counterparty as indicated by the above execution screen; If the identified counterparty is a first counterparty, an action of displaying a first recommended word within the keyboard interface based on an input to a first text key among the plurality of character keys; and If the identified counterparty is a second counterparty different from the first counterparty, an action is included to display a second recommended word different from the first recommended word in the second area in response to an input to the first text key. method.

15. In claim 13 or claim 14, An action that identifies the category of the above application; If the identified category is a non-interactive application in which the counterpart does not appear on the execution screen, an action is included to display a third recommended word different from the first recommended word and the second recommended word in the second area in response to an input to the first text key. method.

Images