Electronic device, method, and non-transitory computer-readable storage medium for recognizing user intent from speech input

Abstract

A processor of an electronic device is configured to: in response to execution of an assistant application, obtain screen context information generated on the basis of a screen displayed through a display and a user input for requesting an action of the electronic device; obtain application information from one or more applications on the basis of the screen context information generated on the basis of the screen displayed through the display and the user input for requesting the action of the electronic device; identify an activated subscriber identity module (SIM) from among a first SIM and a second SIM of the electronic device; in response to identifying that the activated SIM corresponds to the first SIM, display first content generated on the basis of profile information of the first SIM and the application information; and in response to identifying that the activated SIM corresponds to the second SIM, display second content generated on the basis of profile information of the second SIM and the application information.

Description

Electronic device, method, and non-transient computer-readable storage medium for recognizing user intent from voice input

[0001] The following descriptions relate to an electronic device, a method, and a non-transient computer-readable storage medium for recognizing user intent from voice input.

[0002] An electronic device can acquire voice input. The electronic device can provide content identified based on the user's voice input to the user. However, the content provided based on the voice input may differ from the content intended by the voice input.

[0003] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0004] An electronic device is provided. The electronic device may include a communication circuit. The electronic device may include a display. The electronic device may include at least one sensor. The electronic device may include a memory that stores instructions and includes one or more storage media. The electronic device may include at least one processor that includes a processing circuit. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to obtain screen context information generated based on a screen displayed through the display and user input to request an action of the electronic device in response to the execution of an assistant application. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to obtain application information from one or more applications based on the screen context information generated based on a screen displayed through the display and the user input to request an action of the electronic device. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to identify an active SIM among the first SIM (subscriber identity module) and the second SIM of the electronic device. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to display first content generated based on the profile information of the first SIM and the application information, upon identification that the active SIM corresponds to the first SIM.When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the second content generated based on the profile information of the second SIM and the application information, upon identification that the activation SIM corresponds to the second SIM.

[0005] A method is provided to be performed by an electronic device comprising a display and at least one sensor. The method may include an operation of obtaining screen context information generated based on a screen displayed through the display and user input for requesting an action of the electronic device in response to the execution of an assistant application. The method may include an operation of obtaining application information from one or more applications based on the screen context information generated based on a screen displayed through the display and the user input for requesting an action of the electronic device. The method may include an operation of identifying an active SIM among a first SIM (subscriber identity module) and a second SIM of the electronic device. The method may include an operation of displaying first content generated based on profile information of the first SIM and application information, upon identification that the active SIM corresponds to the first SIM. The method may include an operation of displaying second content generated based on profile information of the second SIM and application information, upon identification that the active SIM corresponds to the second SIM.

[0006] A non-transient computer-readable storage medium is provided for storing one or more programs. The one or more programs may include instructions that, when executed individually or collectively by at least one processor of an electronic device, cause the electronic device to obtain screen context information generated based on a screen displayed through the display and user input for requesting an action of the electronic device in response to the execution of an assistant application. The one or more programs may include instructions that, when executed individually or collectively by at least one processor of an electronic device, cause the electronic device to obtain application information from one or more applications based on the screen context information generated based on a screen displayed through the display and the user input for requesting an action of the electronic device. The one or more programs may include instructions that, when executed individually or collectively by at least one processor of an electronic device, cause the electronic device to identify an active SIM among a first SIM (subscriber identity module) and a second SIM of the electronic device. When the above one or more programs are executed individually or collectively by at least one processor of an electronic device, the electronic device may include instructions that cause the device to display a first content generated based on the profile information of the first SIM and the application information, upon identification that the activation SIM corresponds to the first SIM.When the above one or more programs are executed individually or collectively by at least one processor of an electronic device, the electronic device may include instructions that cause the device to display second content generated based on the profile information of the second SIM and the application information, upon identification that the activation SIM corresponds to the second SIM.

[0007] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0008] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0009] Figure 2 is a simplified block diagram of an electronic device.

[0010] Figure 3 is a schematic diagram of an exemplary artificial intelligence system.

[0011] Figure 4 illustrates examples of screens displayed based on user input.

[0012] FIG. 5 illustrates signaling between a processor of an electronic device and an artificial intelligence module for obtaining profile information for multiple SIMs.

[0013] Figure 6 illustrates signaling between a processor of an electronic device and an artificial intelligence module for acquiring screen context information.

[0014] FIG. 7 is a flowchart illustrating the operations of an electronic device for displaying content based on user input.

[0015] FIGS. 8a through 8c illustrate examples of screens that display messages to guide a user in generating content that responds to user input.

[0016] FIG. 9 is a flowchart illustrating the operations of an electronic device for displaying content that responds to user input.

[0017] FIG. 10 illustrates examples of screens that display content responding to user input.

[0018] FIG. 11 is a flowchart illustrating the operations of an electronic device for displaying content that responds to user input.

[0019] FIG. 12 is a flowchart illustrating the operations of an electronic device for displaying a message for network change.

[0020] FIG. 13 illustrates examples of screens displaying messages for network changes.

[0021] FIG. 14 is a flowchart illustrating the operations of an electronic device for displaying content that responds to user input.

[0022] FIG. 15a illustrates examples of screens that display messages to provide content that responds to user input.

[0023] FIG. 15b illustrates examples of screens that display a message to refrain from providing content that responds to user input.

[0024] FIG. 16 is a flowchart illustrating the operations of an electronic device for providing content that responds to user input while multiple screens are displayed through a display.

[0025] Figure 17 illustrates an example in which multiple screens are displayed.

[0026] FIG. 18 is a flowchart illustrating the operations of an electronic device for displaying content that responds to user input.

[0027] FIGS. 19a and FIGS. 19b illustrate examples of screens that display content responding to user input.

[0028] FIG. 20 is a flowchart illustrating the operations of an electronic device for displaying content that responds to user input.

[0029] FIG. 21 illustrates an example of a situation for providing content that responds to user input.

[0030] Figure 22 illustrates an example of a multi-persona according to an operating system.

[0031] FIG. 23 illustrates an example of multi-persona in a foldable device.

[0032] The terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit the scope of other embodiments. A singular expression may include a plural expression unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art described in this disclosure. Terms used in this disclosure that are defined in a general dictionary may be interpreted as having the same or similar meaning as they have in the context of the relevant technology, and are not to be interpreted in an ideal or overly formal sense unless explicitly defined in this disclosure. In some cases, even terms defined in this disclosure are not to be interpreted to exclude the embodiments of this disclosure.

[0033] In the various embodiments of the present disclosure described below, a hardware-based approach is described as an example. However, since the various embodiments of the present disclosure include techniques using both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

[0034] Additionally, in this disclosure, expressions of "greater than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled; however, this is merely for the purpose of expressing an example and does not exclude descriptions of "greater than" or "less than." Conditions described as "greater than" may be replaced with "greater than," conditions described as "less than" may be replaced with "less than," and conditions described as "greater than and less than" may be replaced with "greater than and less than." Furthermore, "A" to "B" below refer to at least one of elements from A (including A) to B (including B). Below, "C" and / or "D" refers to including at least one of "C" or "D," i.e., {"C", "D", "C" and "D"}.

[0035] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0036] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0037] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0038] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0039] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0040] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0041] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0042] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0043] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0044] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0045] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0046] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0047] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0048] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0049] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0050] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0051] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0052] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0053] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0054] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0055] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0056] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0057] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0058] Figure 2 is a simplified block diagram of an electronic device.

[0059] Referring to FIG. 2, the electronic device (101) of FIG. 2 may include a processor (210), a communication circuit (220), a display (230), a memory (240), and an artificial intelligence module (250). For example, the processor (210), the communication circuit (220), the display (230), the memory (240), and the artificial intelligence module (250) may be electrically and / or operably coupled with each other by a communication bus. Hereinafter, the operably coupled hardware components may mean that a direct or indirect connection between the hardware components is established via wired or wireless means so that a second hardware component is controlled by a first hardware component among the hardware components. Although the artificial intelligence module (250) illustrated in FIG. 2 is depicted as a hardware component, the present disclosure is not limited thereto. For example, the artificial intelligence module (250) may correspond to a software component. The hardware components illustrated in FIG. 2 are illustrated based on different blocks, but the present disclosure is not limited thereto. For example, some of the hardware components illustrated in FIG. 2 (e.g., at least some of the processor (210), communication circuit (220), display (230), memory (240), and / or artificial intelligence module (250)) may be included in a single integrated circuit such as a system on chip (SoC) or a system in package (SIP). The type and number of hardware components included in the electronic device (101) are not limited to those illustrated in FIG. 2. For example, the electronic device (101) may include only some of the hardware components illustrated in FIG. 2.

[0060] In one embodiment, the electronic device (101) may include a processor (210). The processor (210) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), and a field programmable gate array (FPGA). As an example, the hardware component for processing data may include a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing unit (DSP), a microcontroller (MCU), and / or a neural processing unit (NPU). The number of processors (210) may be one or more. For example, the processor (210) may have the structure of a multi-core processor, such as a dual core, a quad core, or a hexa core. The processor (210) of FIG. 2 can have substantially the same content as the processor (120) of FIG. 1 applied.

[0061] In one embodiment, the processor (210) may include various processing circuits and / or a plurality of processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits including at least one processor, and one or more of the at least one processor may be configured to perform the various functions described below in a distributed manner, individually and / or collectively. As used below, where “processor,” “at least one processor,” and “one or more processors” are described as being configured to perform various functions, these terms encompass, for example, but not limited to, situations where one processor performs some of the cited functions and other processor(s) perform other parts of the cited functions, and also situations where one processor can perform all of the cited functions. Additionally, the at least one processor may include a combination of processors that perform the enumerated / disclosed various functions, for example, in a distributed manner. The at least one processor may execute program instructions to achieve or perform the various functions.

[0062] In one embodiment, the electronic device (101) may include a communication circuit (220). The communication circuit (220) may include a circuit for supporting the transmission and / or reception of electrical signals between the electronic device (101) and an external electronic device (e.g., a wearable device) different from the electronic device (101). The communication circuit (220) may include at least one of a modem, an antenna, and an O / E (optic / electronic) converter. The communication circuit (220) may support the transmission and / or reception of electrical signals based on various types of communication means such as Ethernet, Bluetooth, BLE (Bluetooth Low Energy), ZigBee, LTE (Long Term Evolution), and 5G NR (New Radio). The specific details regarding the communication circuit (220) of FIG. 2 may be substantially the same as the details regarding the communication module (109) and / or antenna module (197) of FIG. 1.

[0063] In one embodiment, the electronic device (101) may include a display (230). The display (230) may include a display panel, a touch sensor, and / or a processing circuit. In one embodiment, the display panel may be used to display visual information (e.g., an image, a screen, an object, a UI (user interface), a GUI (graphic user interface), and / or a visual object). For example, the display panel may have a display area capable of receiving touch input. In one embodiment, the touch sensor may be used to obtain data about an external object located on the display panel. For example, the touch sensor may be located within or on the display panel to provide an area of ​​the display panel capable of receiving touch input. For example, the touch sensor may be configured to obtain data about contact points on at least a portion of said area. In one embodiment, the processing circuit may control the touch sensor. For example, the processing circuit may process signals or data obtained (or received) through the touch sensor. The specific details regarding the display (230) of FIG. 2 can be substantially applied in the same way as the details regarding the display module (160) of FIG. 1.

[0064] In one embodiment, the electronic device (101) may include a memory (240). The memory (240) may include a hardware component for storing data and / or instructions that are input to or output from the processor (210). For example, the memory (240) may include a volatile memory such as random-access memory (RAM) and / or a non-volatile memory such as read-only memory (ROM). The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, a hard disk, a compact disk, and an embedded multimedia card (eMMC).

[0065] In one embodiment, one or more instructions (or commands) representing operations and / or operations performed by the processor (210) of the electronic device (101) may be stored within the memory (240) of the electronic device (101). A set of one or more instructions may be referred to as a program, firmware, operating system, process, routine, sub-routine, and / or application. Hereinafter, being installed within the electronic device (101) may mean that one or more instructions provided in the form of an application are stored within the memory (240), and that one or more applications are stored in an executable format by the processor (201) of the electronic device (101). The specific details regarding the memory (240) of FIG. 2 may be substantially the same as the details regarding the memory (130) of FIG. 1.

[0066] In one embodiment, the electronic device (101) may include an artificial intelligence module (250). The artificial intelligence module (250) may be a unit (function code, separate device, circuit, or set of instructions) for performing functions. For example, the artificial intelligence module (250) may be a unit (function code, separate device, circuit, or set of instructions) for a screen artificial intelligence model, an LLM (large language model), an LVM (large vision model), and / or an LMM (large multimodal model). For example, the artificial intelligence module (250) may be referred to as an artificial intelligence model or another term having an equivalent technical meaning. The specific details regarding the artificial intelligence module (250) of FIG. 2 may be substantially the same as the details regarding the artificial intelligence system (300) of FIG. 3.

[0067] Figure 3 is a schematic diagram of an exemplary artificial intelligence system.

[0068] Referring to FIG. 3, an artificial intelligence (AI) system (300) may include an input / output interface (310), an AI framework (320), a generative AI model (330), and / or a knowledge repository (390). The artificial intelligence system of FIG. 3 may be replaced with an artificial intelligence model, an artificial intelligence module, or other terms having an equivalent technical meaning.

[0069] The input / output interface (310) can receive input. The input may include user input and / or data obtained or generated by an electronic device (e.g., the electronic device (101) described above). The above data may include images, videos, and / or sensor data generated by at least one processor of the electronic device (101) (e.g., at least one processor (120) or processor (210)) (e.g., illumination data around the electronic device (101) obtained from a sensor or sensor hub (e.g., auxiliary processor (123)), posture data (or orientation data) of the electronic device (101), temperature inside the electronic device (101) (e.g., display (230)) or temperature of at least one processor (210), size information of the display area of ​​the display (230). and / or images obtained through an image sensor of the electronic device (101) (e.g., included in a camera module (180)). The user input may include natural language, touch data obtained through a touch circuit included in the display panel (160) (e.g., used to identify input from a finger and / or stylus), images displayed (and / or to be displayed) on the display panel (160), and / or video may be included. As an example without limitation, the user input may be received by the input / output interface (310) along with context information. The context information may be described as additional information obtained in relation to the user input. The context information may be related to the state at the time the user input is received (e.g., the state of the electronic device (101) and / or the state around the electronic device (101) (e.g., user state). For example, the context information may include information about one or more software applications executed within the electronic device (101) at the time the user input is received.For example, the above situation information may include information about the location of the electronic device (101) (or the location of the user of the electronic device (101)) when the user input is received. For example, the user input may be integrated with the situation information. For example, the user input with the situation information integrated as the input may be received by the input / output interface (310).

[0070] The input / output interface (310) may transmit (or provide) output. The output may include results (or result information) generated or obtained by the AI ​​system (300) based on at least part of the input. The format of the output may vary. For example, the output may include natural language. For example, the output may include content (e.g., media content and / or multimedia content). For example, the output may include actions related to the user of the electronic device (101). For example, the output may have a format according to the user settings of the electronic device (101). For example, the input / output interface (310) may be described as a user question / response interface (310).

[0071] The AI ​​framework (320) can be used to obtain information (or data) about the input from the input / output interface (310) and to control one or more components related to the AI ​​system (300) using the obtained information.

[0072] For example, a prompt design component (321) within an AI framework (320) can generate or acquire prompts for a generative AI model (330) (e.g., including a large language model (LLM), a large vision model (LVM), and / or a large multimodal model (LMM)) using the acquired information. For example, the prompt design component (321) may be described as an AI component that uses a learning algorithm and / or a neural network to provide prompts that are enhanced over time. For example, the prompt design component (321) can generate or acquire prompts by accessing a knowledge component (e.g., a knowledge repository (390)) containing user preference data, a prompt library, and / or prompt examples using the acquired information. The generated prompts may be provided to the generative AI model (330) (e.g., including an LLM or LMM).

[0073] For example, an API / plugin management component (322) within the AI ​​framework (320) may be used to support communication for additional information requested (or induced) in relation to the prompt provided (or to be provided) to the generative AI model (330). For example, the API / plugin management component (322) may be used to create or establish channels for communication with various data sources (e.g., knowledge repository (390)). For example, the API / plugin management component (322) may support access to at least some of the data sources. For example, the API / plugin management component (322) may be used to request other components (e.g., application / service component (380)) that perform feedback (or response) according to the prompt. As an example without limitation, information obtained (or generated) through the API / plugin management component (322) may be provided to the prompt design component (321) for the creation of the prompt. As an example that is not limited, information obtained (or generated) through the API / plugin management component (322) can be provided to the generative AI model (330).

[0074] For example, an improvement component (323) within the AI ​​framework (320) can at least partially tune (or adjust) (or change) the result (e.g., content) obtained (or output) from the generative AI model (330). For example, the improvement component (323) can determine or verify whether the content obtained from the generative AI model (330) is related to the input. For example, the improvement component (323) can determine or verify whether the content obtained from the generative AI model (330) contains biased content. For example, the improvement component (323) can determine or verify whether the content obtained from the generative AI model (330) contains harmful content. For example, the improvement component (323) can support or assist in performing additional processing to improve the content obtained from the generative AI model (330). For example, the improvement component (323) may support providing a hint to the user to improve the content.

[0075] A generative AI model (330) can be described as an artificial intelligence neural network that generates feedback in response to a prompt. For example, the feedback may include additional data and / or information relative to the prompt, but may also include new content relative to the prompt. For example, the generative AI model (330) may include a model that generates images and / or a model that generates language. For example, the model that generates images may include a generative adversarial network (GAN) and / or a variational autoencoder (VAE). For example, the model that generates images may include a diffusion-based generative model (e.g., a transformer VAE). For example, the generative AI model (330) may include an LMM that generates the feedback by recognizing text, images, and / or speech.

[0076] As an example without limitation, an AI framework (320) and / or a generative AI model (330) may be included within an artificial intelligence module (250) (e.g., including a processing circuit) within the electronic device (101). For example, the artificial intelligence module (250) may be operatively coupled with at least one processor of the electronic device (101) (e.g., at least one processor (210) or processor (120)). For example, the artificial intelligence module (250) may be operatively coupled with a display driving circuit of the electronic device (101). For example, the artificial intelligence module (250) may be operatively coupled with a sensor hub of the electronic device (101) for one or more sensors within the electronic device (101).

[0077] Some of the operations described below may be executed (or performed) through the artificial intelligence system described with reference to FIG. 3.

[0078] FIG. 4 illustrates examples of screens displayed based on user input. FIG. 4 explains that the content intended by user input and the content displayed based on user input may be different.

[0079] Referring to FIG. 4, in a situation (410), an assistant application may be executed. The assistant application may be an AI-based application that enables interaction with the electronic device (101) based on user input (e.g., voice input). For example, the assistant application may output commands to perform actions of the electronic device (101) based on the user's voice input. In one example, the assistant application may be referred to as a voice recognition application, a voice assistant, a voice-based intelligent assistant, a voice recognition AI application, or other terms having an equivalent technical meaning. The assistant application may be executed based on input (e.g., voice call, pressing a physical button of the electronic device (101). The electronic device (101) may display a visual object (411) of the assistant application through a display (230) based on obtaining input for executing the assistant application. A visual object (411) may be intended to inform the user that the electronic device (101) is waiting for user input (e.g., voice input). However, the present disclosure is not limited thereto, and the assistant application may be executed while the visual object (411) is not displayed through the display (230). The electronic device (101) may obtain user input (e.g., voice input) while the assistant application is running. The electronic device (101) may display text (412) corresponding to the user input through the display (230). In the example illustrated in FIG. 4, the text (412) corresponding to the voice input may be "can you recommend a restaurant right now." However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto.

[0080] Referring to FIG. 4, in a situation (420), the electronic device (101) may display visual objects for applications to provide a response to a user's request based on user input (e.g., voice input). In the example illustrated in FIG. 4, the electronic device (101) may display a visual object (421) for a first application, a visual object (422) for a second application, a visual object (423) for a third application, a visual object (424) for a fourth application, a visual object (425) for a fifth application, a visual object (426) for a sixth application, and a visual object (427) for a seventh application. The electronic device (101) may obtain a touch input for one of the visual objects.

[0081] Referring to FIG. 4, in a situation (430), the electronic device (101) can execute an application corresponding to a visual object based on obtaining a touch input for one of the visual objects (e.g., a visual object (421) for the first application). The electronic device (101) can perform a search corresponding to user input (e.g., voice input) using the executed application. The electronic device (101) can display the search results obtained based on the search corresponding to user input (e.g., voice input) through a display (230). In the example illustrated in FIG. 4, the electronic device (101) can perform a search for 'right now restaurant' and display the search results through a display (230). The search results may include content (431) indicating information about 'right now restaurant' and content (432) indicating the location of 'right now restaurant'.

[0082] In the example illustrated in FIG. 4, the content intended by user input (e.g., voice input) may be content regarding a search for nearby restaurants that reflects the user's preferences. On the other hand, the content displayed based on user input may be content indicating the location of a restaurant named 'right now restaurant'. As described above, according to an assistant application that uses only user input (e.g., voice input), the content intended by user input and the content displayed based on user input may be different. If the content intended by user input and the content displayed based on user input are different, the user experience (UX) of the user using the assistant application may be reduced. Hereinafter, the present disclosure describes an electronic device, a method, and a non-transient computer-readable storage medium for providing hyper-personalized content by summarizing context information of a screen displayed through a display (230) and application information obtained by user input using profile information personalized by situation.

[0083] FIG. 5 illustrates signaling between a processor of an electronic device and an artificial intelligence module for obtaining profile information for multiple SIMs. Hereinafter, the electronic device (101) is described as including two SIMs (subscriber identity modules), but this is merely an example. The electronic device (101) may include one SIM or three or more SIMs.

[0084] Referring to FIG. 5, in operation 501, a processor (210) according to one embodiment may provide a first prompt to an artificial intelligence module (250) for requesting profile information for a plurality of SIMs (subscriber identity modules). The processor (210) may generate a first prompt for requesting profile information based on information of a first SIM, information of a second SIM, and / or personal information of a user of the electronic device (101). For example, the first SIM may be a physical SIM (pSIM) or an embedded SIM (eSIM). The information of the first SIM may include a mobile country code (MCC) and / or a mobile network code (MNC). For example, the second SIM may be a physical SIM (pSIM) or an embedded SIM (eSIM). The information of the second SIM may include an MCC and / or a MNC. For example, the personal information of a user of an electronic device (101) may include information about the user collected by the electronic device (101) in an on-device environment. In one example, the personal information of the user may include information about the user's height, weight, blood type, MBTI (Myers-Briggs type indicator), personality, hobbies, disposition, major, interests, occupation, ideal type, social network service (SNS) channels, and / or schedule. However, this is merely an example, and the present disclosure is not limited thereto. For example, the personal information may further include other information other than the examples described above. The electronic device (101) may provide a first prompt generated based on the information of the first SIM, the information of the second SIM, and / or personal information to the artificial intelligence module (250).The artificial intelligence module (250) can generate profile information for multiple SIMs according to the first prompt by using an LLM (large language model) (or an LMM (large multimodal model)).

[0085] In operation 502, a processor (210) according to one embodiment may obtain profile information for a plurality of SIMs from an artificial intelligence module (250). For example, the profile information for a plurality of SIMs may include profile information for a first SIM and profile information for a second SIM. For example, the profile information for the first SIM may represent a persona for summarizing information collected from one or more applications. In one example, if the MCC of the first SIM represents South Korea, the profile information for the first SIM may be a persona for activities within the country in light of the user's personal inclination. For example, the profile information for the second SIM may represent a persona for summarizing information collected from one or more applications. In one example, if the MCC of the second SIM represents a foreign country, the profile information for the second SIM may be a persona for activities within a foreign country in light of the user's personal inclination.

[0086] In operation 503, a processor (210) according to one embodiment may provide a second prompt to an artificial intelligence module (250) for requesting images corresponding to a plurality of SIMs. The processor (210) may generate a second prompt for requesting images corresponding to a plurality of SIMs based on profile information of a first SIM and profile information of a second SIM. The artificial intelligence module (250) may generate images according to the second prompt using a large vision model (LVM).

[0087] In operation 504, a processor (210) according to one embodiment may obtain images corresponding to a plurality of SIMs from an artificial intelligence module (250). For example, images corresponding to a plurality of SIMs may include an image of a first SIM and an image of a second SIM.

[0088] Figure 6 illustrates signaling between a processor of an electronic device and an artificial intelligence module for acquiring screen context information.

[0089] Referring to FIG. 6, in operation 601, a processor (210) according to one embodiment can identify the execution of an assistant application. For example, the processor (210) can obtain an input for executing the assistant application (e.g., voice call, press on a physical button of the electronic device (101). The processor (210) can execute the assistant application based on the input. The processor (210) can display a visual object indicating the execution of the assistant application through a display (230).

[0090] In operation 602, a processor (210) according to one embodiment may request screen context information from an artificial intelligence module (250). For example, the processor (210) may request screen context information from the artificial intelligence module (250) in response to the execution of an assistant application. The artificial intelligence module (250) may generate a prompt according to the screen displayed through the display (230) using a screen artificial intelligence model. The artificial intelligence module (250) may generate screen context information according to the prompt using a large language model (LMM) (or a large multimodal model). The screen context information may represent objects and / or situations of the screen displayed through the display (230). The screen context information may be used to estimate user intent.

[0091] In operation 603, a processor (210) according to one embodiment can obtain screen context information from an artificial intelligence module (250).

[0092] FIG. 7 is a flowchart illustrating the operations of an electronic device for displaying content based on user input. The operations of FIG. 7 may be performed by the electronic device (101) of FIG. 1 and FIG. 2. For example, at least some of the operations may be controlled by the processor (210) of the electronic device (101). In the following, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed. For example, at least two operations may be performed in parallel.

[0093] Referring to FIG. 7, in operation 701, an electronic device (101) according to one embodiment can identify whether there is a situation (or user intent) identified based on screen context information in response to the execution of an assistant application.

[0094] In one embodiment, the electronic device (101) may execute an assistant application based on input (e.g., voice call, pressing a physical button of the electronic device (101)). The assistant application may be an AI-based application that enables interaction with the electronic device (101) based on the user's voice input. For example, the assistant application may output commands to perform operations of the electronic device (101) based on user input (e.g., voice input). In one example, the assistant application may be referred to as a voice recognition application, a voice assistant, a voice-based intelligent assistant, a voice recognition AI application, or other terms having an equivalent technical meaning. The electronic device (101) may display a visual object of the assistant application through the display (230) in response to the execution of the assistant application. However, the present disclosure is not limited thereto. For example, an assistant application can run in the background without displaying visual objects.

[0095] In one embodiment, the electronic device (101) may generate (or obtain) screen context information in response to the execution of an assistant application. For example, the electronic device (101) may generate a prompt for generating screen context information in response to the execution of an assistant application. An artificial intelligence module (250) may be used to generate the prompt. In one example, a screen artificial intelligence model of the artificial intelligence module (250) may be used to generate the prompt based on a screen displayed through the display (230). However, this is merely an example, and the present disclosure is not limited thereto. For example, other artificial intelligence models capable of generating the prompt based on the analysis of the screen displayed through the display (230) may be used. The electronic device (101) may generate screen context information based on the generated prompt. An artificial intelligence module (250) may be used to generate screen context information based on the prompt. In one example, a large multimodal model (LMM) of an artificial intelligence module (250) may be used to generate screen context information. However, this is merely an example and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., a large language model (LLM)) may be used to generate screen context information. The screen context information may include information indicating objects and / or situations of a screen displayed through the display (230). The screen context information may be used to estimate user intent. In one example, when a screen captured using a camera (e.g., camera module (180)) of an electronic device (101) is displayed through the display (230), the screen context information may indicate objects displayed on the screen (e.g., restaurant signboards).In one example, when a screen for a shopping application is displayed through a display (230), the screen context information may represent an object (e.g., a bag) displayed on the screen. However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto.

[0096] In one embodiment, the electronic device (101) can identify whether there is a situation identified based on screen context information. In one example, when a screen captured using the camera (e.g., camera module (180)) of the electronic device (101) is displayed through the display (230), the electronic device (101) can identify that there is a situation (or user intent) for performing a search for an object (e.g., a restaurant sign) displayed on the screen. In one example, when a screen for a shopping application is displayed through the display (230), the electronic device (101) can identify that there is a situation (or user intent) for performing a search for an object (e.g., a bag) displayed on the screen. In one example, when the screen displayed through the display (230) is a home screen, the electronic device (101) can identify that there is no situation identified by the screen displayed through the display (230). However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto.

[0097] In operation 702, an electronic device (101) according to one embodiment may display a message generated based on profile information and screen context information of an active SIM (subscriber identity module) through a display (230). For example, the electronic device (101) may display a message generated based on profile information and screen context information of an active SIM through a display (230) upon identification that there is a situation identified based on screen context information.

[0098] In one embodiment, the electronic device (101) may generate (or acquire) profile information for a first SIM and profile information for a second SIM. The electronic device (101) may generate a prompt for generating profile information based on information of the first SIM, information of the second SIM, and / or personal information of the user of the electronic device (101). For example, the first SIM may be a physical SIM (pSIM) or an embedded SIM (eSIM). The information of the first SIM may include the mobile country code (MCC) and / or mobile network code (MNC) of the first SIM. In one example, the MCC of the first SIM may represent a first country (e.g., South Korea). However, this is merely an example and the present disclosure is not limited thereto. For example, the second SIM may be a physical SIM or an embedded SIM. The information of the second SIM may include the MCC and / or MNC of the second SIM. In one example, the MCC of the second SIM may represent a second country (e.g., the United States). However, this is merely an example and the present disclosure is not limited thereto. For example, the user's personal information may include information about the user collected by the electronic device (101) in an on-device environment. In one example, the user's personal information may include information about the user's height, weight, blood type, MBTI (Myers-Briggs type indicator), personality, hobbies, disposition, major, interests, occupation, ideal type, social network service (SNS) channels, and / or schedule. However, this is merely an example and the present disclosure is not limited thereto. For example, the personal information may further include other information other than the examples described above.The electronic device (101) can generate (or acquire) profile information for the first SIM and profile information for the second SIM based on the generated prompt. An artificial intelligence module (250) may be used to generate profile information based on the prompt. In one example, an LLM of the artificial intelligence module (250) may be used to generate profile information. However, this is merely an example and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., LMM) may be used to generate profile information. In one example, profile information for the first SIM and profile information for the second SIM may be generated as shown in [Table 1] below.

[0099] SIM Profile 1 Information - Enneagram Type 9 (The Pacifist) - Possesses high agreeableness and low extraversion in the Big Five personality model. - Tendency to prefer calm and stable information delivery. SIM Profile 2 Information - Enneagram Type 7 (The Pleasure Seeker) - Possesses high openness and high extraversion in the Big Five personality model. - Tendency to prefer new experiences and stimulation.

[0100] In one embodiment, the electronic device (101) can identify an active SIM among a first SIM and a second SIM. The first SIM and the second SIM may be configured based on a dual SIM dual standby (DSDS). For example, in a DSDS environment, only one of the first SIM and the second SIM may be active. The electronic device (101) can identify the SIM set as the default SIM among the first SIM and the second SIM as the active SIM. For example, the electronic device (101) can identify a SIM designated for a specific task as the active SIM. In one example, the electronic device (101) can identify a SIM designated for a voice call application as the active SIM while a voice call application is running. In one example, the electronic device (101) can identify a SIM designated for an SMS application as the active SIM while a short message service (SMS) application is running. However, this is merely an example and the present disclosure is not limited thereto.

[0101] In one embodiment, the electronic device (101) may display a message generated based on profile information and screen context information of the activated SIM through a display (230). For example, an artificial intelligence module (250) may be used to generate the message. In one example, an LLM of the artificial intelligence module (250) may be used to generate the message. However, this is merely an example and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., LMM) may be used to generate the message. For example, the message may be a message intended to guide the user regarding the situation appearing on the screen displayed through the display (230). For example, the message may be generated based on the situation appearing on the screen and the persona appearing in the profile information. In one example, if an object (e.g., a restaurant sign) is included on the screen displayed through the display and a first SIM for a first country (e.g., South Korea) is activated, the message may be, 'Would you like to recommend a regular dining place in Korea?' It may be, "I will find you a popular Korean restaurant nearby or a cafe you frequently visit." In one example, if an object (e.g., a restaurant sign) is included on a screen displayed via a display and a second SIM for a second country (e.g., the United States) is activated, the message may be, "Are you traveling? I will recommend popular local restaurants or restaurants that suit your taste near your current location." However, this is merely an example and the present disclosure is not limited thereto.

[0102] In operation 703, an electronic device (101) according to one embodiment may display a user input interface for obtaining user input through a display (230). The user input interface may include a user interface (UI) for inputting text and / or a UI for displaying text corresponding to voice input. For example, the electronic device (101) may display the user input interface through the display (230) upon identification that there is no situation identified based on screen context information. In another example, the electronic device (101) may display a message generated based on the profile information of the activated SIM and screen context information through the display (230), and then display the user input interface through the display (230).

[0103] FIGS. 8a through 8c illustrate examples of screens that display messages to guide a user in generating content that responds to user input.

[0104] Referring to FIG. 8a, in a situation (810), an electronic device (101) can run a camera application. The electronic device (101) can display a screen (811) captured using a camera (e.g., camera module (180)) through a display (230). The screen displayed through the display (230) may include an object (e.g., a restaurant sign).

[0105] In a situation (820), the electronic device (101) can obtain an input (e.g., voice call, press on a physical button of the electronic device (101)) for executing an assistant application. The electronic device (101) can execute the assistant application based on the input. The electronic device (101) can display a visual object (or voice input interface) (821) indicating the execution of the assistant application through the display (230). The electronic device (101) can generate screen context information in response to the execution of the assistant application. The screen context information may indicate an object contained in the screen (811) displayed through the display (230). Based on the screen context information, the electronic device (101) can identify that the user's intention in executing the assistant application is to search for a restaurant. The electronic device (101) can identify the profile information of the activated SIM. The mobile country code (MCC) of the activated SIM may represent the Republic of Korea. The electronic device (101) may display content generated based on screen context information and profile information of the activated SIM, a voice input interface (821), and a text input interface (828) through the display (230). The content displayed through the display (230) may include an image (822) representing the activated SIM, a message (823) for guiding the user, a visual object (824) for a first option selectable by the user, a visual object (825) for a second option selectable by the user, a visual object (826) for a third option selectable by the user, and a visual object (827) for a fourth option selectable by the user. However, the screen of the situation (820) illustrated in FIG. 8a is merely an example, and the present disclosure is not limited thereto.For example, the content displayed through the display (230) may include only some of the images (822), messages (823), visual objects (824), visual objects (825), visual objects (826), and visual objects (827).

[0106] In situation (830), the electronic device (101) may display a user input interface through a display (230) in response to identifying user input (e.g., touch input) for a text input interface (828). The user input interface may include a user interface (UI) (831) for displaying text corresponding to the text input and a user interface (832) for inputting text.

[0107] Referring to FIG. 8b, in a situation (840), the electronic device (101) can run a camera application. The electronic device (101) can display a screen captured using a camera (e.g., camera module (180)) through a display (230). The screen (841) displayed through the display (230) may include objects (e.g., people around a restaurant).

[0108] In situation (850), the electronic device (101) can obtain input for executing an assistant application (e.g., voice call, press on a physical button of the electronic device (101)). The electronic device (101) can execute the assistant application based on the input. The electronic device (101) can display a visual object (or voice input interface) (851) indicating the execution of the assistant application through the display (230). The electronic device (101) can generate screen context information in response to the execution of the assistant application. The screen context information may indicate an object contained in the screen (841) displayed through the display (230). Based on the screen context information, the electronic device (101) can identify that the user's intention in executing the assistant application is to search for a restaurant. The electronic device (101) can identify the profile information of the activation SIM. The MCC of the activation SIM may indicate the United States. The electronic device (101) can display content generated based on screen context information and profile information of the activation SIM, a voice input interface (851), and a text input interface (858) through a display (230). The content displayed through the display (230) may include an image (852) representing the activation SIM, a message (853) for guiding the user, a visual object (854) for a fifth option selectable by the user, a visual object (855) for a sixth option selectable by the user, a visual object (856) for a seventh option selectable by the user, and a visual object (857) for an eighth option selectable by the user. However, the screen of the situation (850) illustrated in FIG. 8b is merely an example, and the present disclosure is not limited thereto.For example, the content displayed through the display (230) may include only some of the images (852), messages (853), visual objects (854), visual objects (855), visual objects (856), and visual objects (857).

[0109] In situation (860), the electronic device (101) may display a user input interface through the display (230) in response to identifying user input (e.g., touch input) for the text input interface (858). The user input interface may include a UI (861) for displaying text corresponding to voice input and a UI (862) for inputting text.

[0110] Referring to FIG. 8c, in situation (870), the electronic device (101) may obtain input for executing an assistant application (e.g., voice call, press on a physical button of the electronic device (101)). The electronic device (101) may execute the assistant application based on user input. The electronic device (101) may display a visual object (or voice input interface) (871) indicating the execution of the assistant application through the display (230). The electronic device (101) may generate screen context information in response to the execution of the assistant application. The screen context information may indicate that there is no situation identified by the screen displayed through the display (230).

[0111] In a situation (880), the electronic device (101) may display a user input interface for obtaining user input through the display (230) upon identification that there is no situation identified by the screen displayed through the display (230). The user input interface may include a voice input interface (871) and a text input interface (881).

[0112] FIG. 9 is a flowchart illustrating the operations of an electronic device for displaying content that responds to user input. The operations of FIG. 9 may be performed by the electronic device (101) of FIG. 1 and FIG. 2. For example, at least some of the operations may be controlled by a processor (210) of the electronic device (101). In the following, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed. For example, at least two operations may be performed in parallel. For example, the operations of FIG. 9 may be performed in parallel with the operations of FIG. 7, or independently of the operations of FIG. 7, following the operations of FIG. 7.

[0113] Referring to FIG. 9, in operation 901, an electronic device (101) according to one embodiment can obtain application information based on user input (e.g., voice input) and screen context information.

[0114] In one embodiment, the electronic device (101) may generate (or obtain) screen context information in response to the execution of an assistant application. For example, the electronic device (101) may generate a prompt for generating screen context information in response to the execution of an assistant application. An artificial intelligence module (250) may be used to generate a prompt based on a screen displayed through the display (230). In one example, a screen artificial intelligence model of the artificial intelligence module (250) may be used to generate a prompt based on a screen displayed through the display (230). However, this is merely an example, and the present disclosure is not limited thereto. For example, other artificial intelligence models capable of generating a prompt based on the analysis of a screen displayed through the display (230) may be used. The electronic device (101) may generate screen context information based on the generated prompt. An artificial intelligence module (250) may be used to generate screen context information based on the prompt. In one example, a large multimodal model (LMM) of the artificial intelligence module (250) may be used to generate screen context information. However, this is merely an example and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., a large language model (LLM)) may be used to generate screen context information. The screen context information may include information indicating objects and / or situations of the screen displayed through the display (230). The screen context information may be used to estimate user intent.In one example, when a screen captured using a camera (e.g., camera module (180)) of an electronic device (101) is displayed through a display (230), the screen context information may represent an object displayed on the screen (e.g., a restaurant sign). In one example, when a screen for a shopping application is displayed through a display (230), the screen context information may represent an object displayed on the screen (e.g., a bag). However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto.

[0115] In one embodiment, the electronic device (101) may acquire application information based on user input (e.g., voice input) and screen context information. The user input and screen context information may indicate user intent. For example, the user's apparent intent may be identified based on the user input and screen context information. For example, the electronic device (101) may generate commands (or codes) for data requests based on the user input and screen context information. In one example, the commands (or codes) may be implemented in the form of a schema. However, this is merely an example and the present disclosure is not limited thereto. The electronic device (101) may provide commands (or codes) to one or more applications. For example, the electronic device (101) may acquire application information while the user interfaces (UIs) of one or more applications are not displayed through the display (230) by providing commands (or codes) to one or more applications. Application information may refer to information collected based on user intent appearing in the user input and screen context information. In one example, the function of obtaining application information may be referred to as an app intent. In one example, application information may be referred to as contextual information or other terms having an equivalent technical meaning. In one example, application information may include restaurant information searched based on the user's current location, the user's schedule information, information regarding the user's internet search history and preferences, restaurant information shared on social network services (SNS), and / or restaurant review information. However, this is merely an example and the present disclosure is not limited thereto. Application information may include only some of the above information or may further include other information that can be collected from applications.

[0116] In operation 902, an electronic device (101) according to one embodiment can identify whether the active SIM among the first SIM (subscriber identity module) and the second SIM corresponds to the first SIM.

[0117] In one embodiment, the electronic device (101) can identify an active SIM among a first SIM and a second SIM. For example, the first SIM and the second SIM may be configured based on a dual SIM dual standby (DSDS). For example, in a DSDS environment, only one of the first SIM and the second SIM may be active. The electronic device (101) can identify the SIM set as the default SIM among the first SIM and the second SIM as the active SIM. For example, the electronic device (101) can identify a SIM designated for a specific task as the active SIM. In one example, the electronic device (101) can identify a SIM designated for a voice call application as the active SIM while a voice call application is running. In one example, the electronic device (101) can identify a SIM designated for an SMS application as the active SIM while a short message service (SMS) application is running. However, this is merely an example and the present disclosure is not limited thereto.

[0118] In operation 903, an electronic device (101) according to one embodiment may display a first content generated based on profile information and application information of a first SIM through a display (230). For example, the electronic device (101) may display a first content generated based on profile information and application information of a first SIM through a display (230) according to identification that the active SIM is the first SIM.

[0119] In one embodiment, the electronic device (101) can identify profile information of the first SIM. The profile information of the first SIM may represent a persona for summarizing application information. The profile information of the first SIM may be information generated based on the information of the first SIM and / or the user's personal information. For example, the information of the first SIM may include a mobile country code (MCC) indicating a country and / or a mobile network code (MNC) indicating a carrier. For example, the user's personal information may include information about the user collected by the electronic device (101) in an on-device environment. In one example, if the MCC of the first SIM indicates a first country (e.g., South Korea), the profile information of the first SIM may represent a persona for activities within the country in light of the user's personal inclination.

[0120] In one embodiment, the electronic device (101) may display a first content generated based on the profile information and application information of the first SIM through a display (230). An artificial intelligence module (250) may be used to generate the first content based on the profile information and application information of the first SIM. In one example, a large language model (LLM) of the artificial intelligence module (250) may be used to generate the first content. However, this is merely an example, and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., a large multimodal model (LMM)) may be used to generate the first content. The first content may be a summary of application information according to the persona represented by the profile information of the first SIM.

[0121] In operation 904, an electronic device (101) according to one embodiment may display second content generated based on profile information and application information of the second SIM through a display (230). For example, the electronic device (101) may display second content generated based on profile information and application information of the second SIM through a display (230) according to identification that the active SIM is the second SIM.

[0122] In one embodiment, the electronic device (101) can identify profile information of the second SIM. The profile information of the second SIM may represent a persona for summarizing application information. The profile information of the second SIM may be information generated based on the information of the second SIM and / or the user's personal information. For example, the information of the second SIM may include an MCC representing a country and / or an MNC representing a carrier. For example, the user's personal information may include information about the user collected by the electronic device (101) in an on-device environment. In one example, if the MCC of the first SIM represents a second country (e.g., the United States), the profile information of the second SIM may represent a persona for when the user is active in the United States in light of the user's personal inclination.

[0123] In one embodiment, the electronic device (101) may display second content generated based on profile information and application information of the second SIM through a display (230). An artificial intelligence module (250) may be used to generate second content based on profile information and application information of the second SIM. In one example, an LLM of the artificial intelligence module (250) may be used to generate second content. However, this is merely an example, and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., LMM) may be used to generate second content. The second content may be a summary of application information according to the persona represented by the profile information of the second SIM.

[0124] FIG. 10 illustrates examples of screens that display content responding to user input.

[0125] Referring to FIG. 10, in situation (1010), the active SIM (subscriber identity module) may be the first SIM. The MCC (mobile country code) of the first SIM may represent the Republic of Korea. The electronic device (101) may receive input for executing an assistant application (e.g., voice call, pressing a physical button of the electronic device (101)). The electronic device (101) may execute the assistant application based on the input. The electronic device (101) may display a visual object (1015) indicating the execution of the assistant application through the display (230). The electronic device (101) may generate screen context information in response to the execution of the assistant application. The electronic device (101) may obtain application information using one or more applications based on voice input and screen context information. Application information may refer to information collected based on user intent (e.g., restaurant recommendations) appearing in voice input and screen context information. The electronic device (101) may display first content generated based on the profile information and application information of the first SIM through a display (230). The first content may be a summary of application information according to a first persona represented by the profile information of the first SIM. The first content displayed through the display (230) may include an image (1011) representing the first SIM, a message (1012) containing information summarized according to the first persona, a shortcut (1013) for running a map application, and a shortcut (1014) for running an internet application. However, the screen of the situation (1010) illustrated in FIG. 10 is merely an example, and the present disclosure is not limited thereto.For example, the first content displayed through the display (230) may include only some of the image (1011), message (1012), shortcut (1013), and shortcut (1014).

[0126] Referring to FIG. 10, in situation (1020), the active SIM may be a second SIM. The MCC of the second SIM may represent the United States. The electronic device (101) may obtain an input for executing an assistant application (e.g., voice call, press on a physical button of the electronic device (101)). The electronic device (101) may execute an assistant application based on the input. The electronic device (101) may display a visual object (1025) indicating the execution of the assistant application through a display (230). The electronic device (101) may generate screen context information in response to the execution of the assistant application. The electronic device (101) may obtain application information using one or more applications based on voice input and screen context information. Application information may refer to information collected based on user intent (e.g., restaurant recommendation) appearing in voice input and screen context information. The electronic device (101) can display second content generated based on profile information and application information of the second SIM through a display (230). The second content may be a summary of application information according to a second persona represented by the profile information of the second SIM. The second content displayed through the display (230) may include an image (1021) representing the second SIM, a message (1022) containing information summarized according to the second persona, a visual object (1023) for a first option selectable by the user, and a visual object (1024) for a second option selectable by the user. However, the screen of the situation (1020) illustrated in FIG. 10 is merely an example, and the present disclosure is not limited thereto.For example, the second content displayed through the display (230) may include only some of the images (1021), messages (1022), visual objects (1203), and visual objects (1024).

[0127] FIG. 11 is a flowchart illustrating the operations of an electronic device for displaying content that responds to user input. The operations of FIG. 11 may be performed by the electronic device (101) of FIG. 1 and FIG. 2. For example, at least some of the operations may be controlled by a processor (210) of the electronic device (101). In the following, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed. For example, at least two operations may be performed in parallel.

[0128] Referring to FIG. 11, in operation 1101, an electronic device (101) according to one embodiment can identify whether there is a situation identified based on screen context information in response to the execution of an assistant application.

[0129] In one embodiment, the electronic device (101) may execute an assistant application based on input (e.g., voice call, pressing a physical button of the electronic device (101)). The assistant application may be an AI-based application that enables interaction with the electronic device (101) based on the user's voice input. For example, the assistant application may output commands to perform operations of the electronic device (101) based on user input (e.g., voice input). In one example, the assistant application may be referred to as a voice recognition application, a voice assistant, a voice-based intelligent assistant, a voice recognition AI application, or other terms having an equivalent technical meaning. The electronic device (101) may display a visual object of the assistant application through the display (230) in response to the execution of the assistant application. However, the present disclosure is not limited thereto. For example, the assistant application may run in the background without displaying visual objects. The electronic device (101) may receive user input that triggers a specific action of the electronic device (101) while the assistant application is running.

[0130] In one embodiment, the electronic device (101) may generate (or obtain) screen context information in response to the execution of an assistant application. For example, the electronic device (101) may generate a prompt for generating screen context information in response to the execution of an assistant application. An artificial intelligence module (250) may be used to generate the prompt. In one example, a screen artificial intelligence model of the artificial intelligence module (250) may be used to generate the prompt based on a screen displayed through the display (230). However, this is merely an example, and the present disclosure is not limited thereto. For example, other artificial intelligence models capable of generating the prompt based on the analysis of the screen displayed through the display (230) may be used. The electronic device (101) may generate screen context information based on the generated prompt. An artificial intelligence module (250) may be used to generate screen context information based on the prompt. In one example, a large multimodal model (LMM) of an artificial intelligence module (250) may be used to generate screen context information. However, this is merely an example and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., a large language model (LLM)) may be used to generate screen context information. The screen context information may include information indicating objects and / or situations of a screen displayed through the display (230). The screen context information may be used to estimate user intent. In one example, when a screen captured using a camera (e.g., camera module (180)) of an electronic device (101) is displayed through the display (230), the screen context information may indicate objects displayed on the screen (e.g., restaurant signboards).In one example, when a screen for a shopping application is displayed through a display (230), the screen context information may represent an object (e.g., a bag) displayed on the screen. However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto.

[0131] In one embodiment, the electronic device (101) can identify whether there is a situation identified based on screen context information. In one example, when a screen captured using the camera (e.g., camera module (180)) of the electronic device (101) is displayed through the display (230), the electronic device (101) can identify that there is a situation (or user intent) for performing a search for an object (e.g., a restaurant sign) displayed on the screen. In one example, when a screen for a shopping application is displayed through the display (230), the electronic device (101) can identify that there is a situation (or user intent) for performing a search for an object (e.g., a bag) displayed on the screen. In one example, when the screen displayed through the display (230) is a home screen, the electronic device (101) can identify that there is no situation identified by the screen displayed through the display (230). However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto.

[0132] In operation 1102, an electronic device (101) according to one embodiment may display a message generated based on profile information of an activated SIM and screen context information through a display (230). For example, the electronic device (101) may display a message generated based on profile information of an activated SIM and screen context information through a display (230) in accordance with the identification that there is a situation identified based on screen context information.

[0133] In one embodiment, the electronic device (101) may generate (or acquire) profile information for a first SIM and profile information for a second SIM. The electronic device (101) may generate a prompt for generating profile information based on information of the first SIM, information of the second SIM, and / or personal information of the user of the electronic device (101). For example, the first SIM may be a physical SIM (pSIM) or an embedded SIM (eSIM). The information of the first SIM may include the mobile country code (MCC) and / or mobile network code (MNC) of the first SIM. In one example, the MCC of the first SIM may represent a first country (e.g., South Korea). However, this is merely an example and the present disclosure is not limited thereto. For example, the second SIM may be a physical SIM or an embedded SIM. The information of the second SIM may include the MCC and / or MNC of the second SIM. In one example, the MCC of the second SIM may represent a second country (e.g., the United States). However, this is merely an example and the present disclosure is not limited thereto. For example, the user's personal information may include information about the user collected by the electronic device (101) in an on-device environment. In one example, the user's personal information may include information about the user's height, weight, blood type, MBTI (Myers-Briggs type indicator), personality, hobbies, disposition, major, interests, occupation, ideal type, social network service (SNS) channels, and / or schedule. However, this is merely an example and the present disclosure is not limited thereto. For example, the personal information may further include other information other than the examples described above.The electronic device (101) can generate (or acquire) profile information for a first SIM and profile information for a second SIM based on a generated prompt. An artificial intelligence module (250) may be used to generate profile information based on the prompt. In one example, an LLM of the artificial intelligence module (250) may be used to generate profile information. However, this is merely an example and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., LMM) may be used to generate profile information.

[0134] In one embodiment, the electronic device (101) can identify an active SIM among a first SIM and a second SIM. The first SIM and the second SIM may be configured based on a dual SIM dual standby (DSDS). For example, in a DSDS environment, only one of the first SIM and the second SIM may be active. The electronic device (101) can identify the SIM set as the default SIM among the first SIM and the second SIM as the active SIM. For example, the electronic device (101) can identify a SIM designated for a specific task as the active SIM. In one example, the electronic device (101) can identify a SIM designated for a voice call application as the active SIM while a voice call application is running. In one example, the electronic device (101) can identify a SIM designated for an SMS application as the active SIM while a short message service (SMS) application is running. However, this is merely an example and the present disclosure is not limited thereto.

[0135] In one embodiment, the electronic device (101) may display a message generated based on profile information and screen context information of the activated SIM through a display (230). For example, an artificial intelligence module (250) may be used to generate the message. In one example, an LLM of the artificial intelligence module (250) may be used to generate the message. However, this is merely an example and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., LMM) may be used to generate the message. For example, the message may be a message intended to guide the user regarding the situation appearing on the screen displayed through the display (230). For example, the message may be generated based on the situation appearing on the screen and the persona appearing in the profile information. In one example, if an object (e.g., a restaurant sign) is included on the screen displayed through the display and a first SIM for a first country (e.g., South Korea) is activated, the message may be, 'Would you like to recommend a regular dining place in Korea?' It may be, "I will find you a popular Korean restaurant nearby or a cafe you frequently visit." In one example, if an object (e.g., a restaurant sign) is included on a screen displayed via a display and a second SIM for a second country (e.g., South Korea) is activated, the message may be, "Are you traveling? I will recommend popular local restaurants or restaurants that suit your taste near your current location." However, this is merely an example and the present disclosure is not limited thereto.

[0136] In operation 1103, an electronic device (101) according to one embodiment can obtain application information based on user input and / or screen context information.

[0137] In one embodiment, the electronic device (101) may acquire application information based on user input (e.g., voice input) and screen context information. The user input and screen context information may indicate user intent. For example, the user's apparent intent may be identified based on the user input and screen context information. For example, the electronic device (101) may generate commands (or codes) for data requests based on the user input and screen context information. In one example, the commands (or codes) may be implemented in the form of a schema. However, this is merely an example and the present disclosure is not limited thereto. The electronic device (101) may provide commands (or codes) to one or more applications. For example, the electronic device (101) may acquire application information while the user interfaces (UIs) of one or more applications are not displayed through the display (230) by providing commands (or codes) to one or more applications. Application information may refer to information collected based on user intent appearing in the user input and screen context information. In one example, the function of obtaining application information may be referred to as an app intent. In one example, application information may be referred to as contextual information or other terms having an equivalent technical meaning. In one example, application information may include restaurant information searched based on the user's current location, the user's schedule information, information regarding the user's internet search history and preferences, restaurant information shared on social network services (SNS), and / or restaurant review information. However, this is merely an example and the present disclosure is not limited thereto. Application information may include only some of the above information or may further include other information that can be collected from applications.

[0138] In operation 1104, an electronic device (101) according to one embodiment can display content generated based on profile information and application information of an activated SIM through a display (230).

[0139] In one embodiment, the activation SIM may be a first SIM. The electronic device (101) may display first content generated based on the profile information and application information of the first SIM through a display (230). An artificial intelligence module (250) may be used to generate the first content based on the profile information and application information of the first SIM. In one example, a large language model (LLM) of the artificial intelligence module (250) may be used to generate the first content. However, this is merely an example, and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., a large multimodal model (LMM)) may be used to generate the first content. The first content may be a summary of application information according to the persona represented by the profile information of the first SIM.

[0140] In one embodiment, the active SIM may be a second SIM. The electronic device (101) may display second content generated based on the profile information and application information of the second SIM through a display (230). An artificial intelligence module (250) may be used to generate second content based on the profile information and application information of the second SIM. In one example, an LLM of the artificial intelligence module (250) may be used to generate second content. However, this is merely an example, and the present disclosure is not limited thereto. For example, another artificial intelligence model (e.g., LMM) may be used to generate second content. The second content may be a summary of application information according to the persona represented by the profile information of the second SIM.

[0141] FIG. 12 is a flowchart illustrating the operations of an electronic device for displaying a message for network change. The operations of FIG. 12 may be performed by the electronic device (101) of FIG. 1 and FIG. 2. For example, at least some of the operations may be controlled by the processor (210) of the electronic device (101). In the following, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed. For example, at least two operations may be performed in parallel.

[0142] Referring to FIG. 12, in operation 1201, an electronic device (101) according to one embodiment can identify whether the signal strength of a network is below a threshold value. For example, the electronic device (101) can identify whether the signal strength of a network is below a threshold value in response to the execution of an assistant application.

[0143] In one embodiment, the electronic device (101) can identify an active SIM among a first SIM (subscriber) and a second SIM. The first SIM and the second SIM may be configured based on a dual SIM dual standby (DSDS). For example, in a DSDS environment, only one of the first SIM and the second SIM may be active. The electronic device (101) can identify the SIM set as the default SIM among the first SIM and the second SIM as the active SIM. For example, the electronic device (101) can identify a SIM designated for a specific task as the active SIM. In one example, the electronic device (101) can identify a SIM designated for a voice call application as the active SIM while a voice call application is running. In one example, the electronic device (101) can identify a SIM designated for an SMS application as the active SIM while a short message service (SMS) application is running. However, this is merely an example and the present disclosure is not limited thereto.

[0144] In one embodiment, the electronic device (101) may identify profile information of the first SIM based on the identification that the active SIM is the first SIM. The profile information of the first SIM may be information generated based on the information of the first SIM and / or the user's personal information. For example, the information of the first SIM may include a mobile country code (MCC) indicating a country and / or a mobile network code (MNC) indicating a carrier. For example, the user's personal information may include information about the user collected by the electronic device (101) in an on-device environment. In one example, the MCC of the first SIM may indicate a first country with poor network conditions. In one example, the profile information of the first SIM may indicate a type of persona that avoids unnecessary network switching. However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto.

[0145] In one embodiment, the electronic device (101) may identify profile information of the second SIM based on the identification that the active SIM is the second SIM. The profile information of the second SIM may be information generated based on the information of the second SIM and / or the user's personal information. For example, the information of the second SIM may include an MCC and / or MNC indicating a country. In one example, the MCC of the second SIM may indicate a second country with a good network environment. In one example, the profile information of the second SIM may indicate a type of persona seeking fast data transmission speeds. However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto.

[0146] For example, the profile information of the first SIM and the profile information of the second SIM associated with the network connection may be as shown in [Table 2] below.

[0147] SIM Profile 1 Information - Enneagram Type 9 (The Pacifist) - Possesses high agreeableness and low extraversion in the Big Five personality model. - Prefers calm and stable information delivery. - Tends to avoid unnecessary network switching. SIM Profile 2 Information - Enneagram Type 7 (The Pleasure Seeker) - Possesses high openness and high extraversion in the Big Five personality model. - Prefers new experiences and stimulation. - Tends to seek fast data transmission speeds.

[0148] In one embodiment, the electronic device (101) can identify a threshold for network change based on profile information of the active SIM. In one example, when the active SIM is a first SIM, the electronic device (101) can identify a first threshold for network change based on profile information of the first SIM. Since the profile information of the first SIM represents a type of persona that avoids unnecessary network switching, the first threshold identified based on the profile information of the first SIM may be relatively small. In one example, when the active SIM is a second SIM, the electronic device (101) can identify a second threshold for network change based on profile information of the second SIM. Since the profile information of the second SIM represents a type of persona that seeks fast data transmission speeds, the second threshold identified based on the profile information of the second SIM may be relatively large. In light of the profile information of each SIM, the first threshold may be smaller than the second threshold.

[0149] In one embodiment, the electronic device (101) can identify whether the signal strength is below a threshold value (e.g., a first threshold value or a second threshold value). For example, the signal strength may be a received signal strength indicator (RSSI), a reference signal received power (RSRP), and / or a signal to interference plus noise ratio (SINR).

[0150] In operation 1202, the electronic device (101) may display a message for changing the network via the display (230). For example, the electronic device (101) may display a message for changing the network via the display (230) upon identifying that the signal strength of the network is below a threshold value. In one example, the message for changing the network may be a message for inducing a SIM change. In one example, the message for changing the network may be a message for inducing a change of carrier (e.g., changing to a different SIM with an MNC representing a different carrier while having an MCC representing the same country). In one example, the message for changing the network may be a message for inducing a connection to a wireless local area network (e.g., Wi-Fi). However, this is merely an example and the present disclosure is not limited thereto.

[0151] In operation 1203, the electronic device (101) may refrain from displaying a message for network change through the display (230). For example, the electronic device (101) may refrain from displaying a message for network change through the display (230) upon identifying that the signal strength of the network is above a threshold value.

[0152] FIG. 13 illustrates examples of screens displaying messages for network changes.

[0153] Referring to FIG. 13, in a situation (1310), the active SIM (subscriber identity module) may be a first SIM. The mobile country code (MCC) of the first SIM indicates a first country with poor network conditions, and the profile information of the first SIM may be a persona of a type that avoids unnecessary network switching. The electronic device (101) may receive input (e.g., voice call, press on a physical button of the electronic device (101)) for executing an assistant application. The electronic device (101) may execute an assistant application based on the input. The electronic device (101) may display a visual object (1311) indicating the execution of the assistant application through a display (230). The electronic device (101) may check the network conditions before performing a specific action (e.g., call, data communication) based on the voice input in response to the execution of the assistant application. The electronic device (101) can identify a first threshold of signal strength for checking network conditions based on the profile information of the first SIM. Since the profile information of the first SIM represents a type of persona that avoids unnecessary network switching, the first threshold identified based on the profile information of the first SIM may be relatively small. The electronic device (101) can identify whether the signal strength (1312) of the network connected through the first SIM is below the first threshold. Upon identifying that the signal strength (1312) of the network connected through the first SIM is below the first threshold, the electronic device (101) can display content for network change through the display (230).Content for changing the network may include an image (1313) representing the first SIM, a message (1314) for guiding the network change, a visual object (1315) for obtaining user input to connect the network through the second SIM, and a visual object (1316) for obtaining user input to maintain the network connection through the first SIM. However, the screen of the situation (1310) illustrated in FIG. 13 is merely an example for explanation and the present disclosure is not limited thereto. For example, the content displayed through the display (230) may include only some of the image (1313), message (1314), visual object (1315), and visual object (1316).

[0154] Referring to FIG. 13, in a situation (1320), the active SIM may be a second SIM. The MCC of the second SIM may represent a second country with a good network environment, and the profile information of the second SIM may be a persona of a type that seeks fast data transmission speeds. The electronic device (101) may receive input for executing an assistant application (e.g., voice call, press on a physical button of the electronic device (101)). The electronic device (101) may execute an assistant application based on the input. The electronic device (101) may display a visual object (1321) indicating the execution of the assistant application through a display (230). The electronic device (101) may check the network conditions before performing a specific action (e.g., call, data communication) based on the voice input in response to the execution of the assistant application. The electronic device (101) can identify a second threshold of signal strength for checking network conditions based on the profile information of the second SIM. Since the profile information of the second SIM represents a type of persona that seeks a fast data transmission speed, the second threshold identified based on the profile information of the second SIM may be relatively large. The electronic device (101) can identify whether the signal strength (1322) of the network connected through the second SIM is below the second threshold. Upon identifying that the signal strength (1322) of the network connected through the second SIM is below the second threshold, the electronic device (101) can display content for changing the network through the display (230). The content for changing the network may include an image (1323) representing the second SIM, a message (1324) for guiding the network change, a visual object (1325) for obtaining user input for connecting the network through the first SIM, and a visual object (1326) for obtaining user input for maintaining the network connection through the second SIM.However, the screen of the situation (1320) illustrated in FIG. 13 is merely an example for illustrative purposes, and the present disclosure is not limited thereto. For example, the content displayed through the display (230) may include only some of the images (1323), messages (1324), visual objects (1325), and visual objects (1326).

[0155] FIG. 14 is a flowchart illustrating the operations of an electronic device for displaying content that responds to user input. The operations of FIG. 14 may be performed by the electronic device (101) of FIG. 1 and FIG. 2. For example, at least some of the operations may be controlled by a processor (210) of the electronic device (101). In the following, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed. For example, at least two operations may be performed in parallel.

[0156] Referring to FIG. 14, in operation 1401, an electronic device (101) according to one embodiment can identify whether user input obtained while an assistant application is running corresponds to screen context information.

[0157] In one embodiment, the electronic device (101) may execute an assistant application based on input (e.g., voice call, pressing a physical button of the electronic device (101)). The assistant application may be an AI-based application that enables interaction with the electronic device (101) based on the user's voice input. For example, the assistant application may output commands (or code) for performing operations of the electronic device (101) based on the user's voice input. In one example, the assistant application may be referred to as a voice recognition application, a voice assistant, a voice-based intelligent assistant, a voice recognition AI application, or other terms having an equivalent technical meaning. The electronic device (101) may display a visual object of the assistant application through the display (230) in response to the execution of the assistant application. However, the present disclosure is not limited thereto. For example, the assistant application may run in the background without displaying visual objects. The electronic device (101) may receive user input that triggers a specific action of the electronic device (101) while the assistant application is running.

[0158] In one embodiment, the electronic device (101) may generate screen context information in response to the execution of an assistant application. For example, the electronic device (101) may generate a prompt for generating screen context information in response to the execution of an assistant application. An artificial intelligence module (250) may be used to generate the prompt. In one example, a screen artificial intelligence model of the artificial intelligence module (250) may be used to generate the prompt. However, this is merely an example, and the present disclosure is not limited thereto. For example, another artificial intelligence model capable of generating a prompt based on the analysis of a screen displayed through a display (230) may be used. The electronic device (101) may generate screen context information based on the generated prompt. An artificial intelligence module (250) may be used to generate screen context information based on the prompt. In one example, a large multimodal model (LMM) of the artificial intelligence module (250) may be used to generate screen context information. However, this is merely an example, and the present disclosure is not limited thereto. For example, other artificial intelligence models (e.g., a large language model (LLM)) may be used to generate screen context information. The screen context information may include information indicating an object (or situation) of the screen displayed through the display (230). The screen context information may be used to estimate user intent. In one example, if a screen associated with an online lecture is displayed through the display (230), the screen context information may indicate the situation of taking the online lecture. However, this is merely an example for illustrative purposes, and the present disclosure is not limited thereto.

[0159] In one embodiment, the electronic device (101) can identify whether user input (e.g., voice input) obtained while an assistant application is running corresponds to screen context information. An artificial intelligence module (250) may be used to identify whether user input corresponds to screen context information. In one example, an LLM may be used to identify whether user input corresponds to screen context information. However, this is merely an example and the present disclosure is not limited thereto. Other artificial intelligence models may be used to identify whether user input corresponds to screen context information. The artificial intelligence module (250) may output whether user input corresponds to screen context information based on user input and screen context information.

[0160] In operation 1402, an electronic device (101) according to one embodiment may display a message through a display (230) to provide content that responds to user input. For example, the electronic device (101) may display a message through a display (230) to provide content corresponding to user input and screen context information, upon identification that user input obtained while an assistant application is running corresponds to screen context information.

[0161] In operation 1403, an electronic device (101) according to one embodiment may display a message through a display (230) to refrain from providing content that responds to user input. For example, the electronic device (101) may display a message through a display (230) to refrain from providing content corresponding to user input and screen context information upon identifying that user input obtained while an assistant application is running does not correspond to screen context information.

[0162] FIG. 15a illustrates examples of screens that display messages to provide content that responds to user input.

[0163] Referring to FIG. 15a, in a situation (1510), an electronic device (101) can run an internet lecture application. The electronic device (101) can display a screen (1513) corresponding to the internet lecture application through a display (230). The electronic device (101) can obtain an input (e.g., voice call) for running an assistant application. The electronic device (101) can run the assistant application based on the input. The electronic device (101) can display a visual object (1511) indicating the execution of the assistant application through the display (230). While the assistant application is running, the electronic device (101) can obtain voice input (e.g., "Can you recommend movies?"). The electronic device (101) can display text (1512) corresponding to the voice input through the display (230). The electronic device (101) can generate screen context information in response to the execution of an assistant application. The screen context information may represent the situation of a screen (1513) displayed through a display (230) (e.g., a Japanese language lecture). The electronic device (101) can identify whether voice input (e.g., can you recommend movies or something?) corresponds to the screen context information (e.g., a Japanese language lecture).

[0164] Referring to FIG. 15a, in a situation (1520), the electronic device (101) can identify that voice input corresponds to screen context information. Upon identifying that voice input corresponds to screen context information, the electronic device (101) can display content for providing a response to the voice input through a display (230). The content displayed through the display (230) may include an image (1521) representing a persona (e.g., an educational persona), a message (1522) for guiding the user, a visual object (1523) for obtaining user input that generates a response to the voice input, and a visual object (1524) for obtaining user input that refrains from generating a response to the voice input. However, the screen of the situation (1520) illustrated in FIG. 15a is merely an example, and the present disclosure is not limited thereto. For example, the content displayed through the display (230) may include only some of the images (1521), messages (1522), visual objects (1523), and visual objects (1524).

[0165] FIG. 15b illustrates examples of screens that display a message to refrain from providing content that responds to user input.

[0166] Referring to FIG. 15b, in a situation (1530), an electronic device (101) can run an internet lecture application. The electronic device (101) can display a screen (1533) corresponding to the internet lecture application through a display (230). The electronic device (101) can obtain an input (e.g., voice call) for running an assistant application. The electronic device (101) can run the assistant application based on the input. The electronic device (101) can display a visual object (1531) indicating the execution of the assistant application through the display (230). While the assistant application is running, the electronic device (101) can obtain voice input (e.g., "What is the weather like today?"). The electronic device (101) can display text (1532) corresponding to the voice input through the display (230). The electronic device (101) can generate screen context information in response to the execution of an assistant application. The screen context information may represent the situation of a screen (1533) displayed through a display (230) (e.g., a Japanese language lesson). The electronic device (101) can identify whether voice input (e.g., "What is the weather like today?") corresponds to the screen context information (e.g., a Japanese language lesson).

[0167] Referring to FIG. 15b, in a situation (1540), the electronic device (101) can identify that voice input does not correspond to screen context information. Upon identifying that voice input does not correspond to screen context information, the electronic device (101) can display content through a display (230) to refrain from providing a response to the voice input. The content displayed through the display (230) may include an image (1541) representing a persona (e.g., an educational persona), a message (1542) to guide the user, a visual object (1543) for obtaining user input to refrain from generating a response to the voice input, and a visual object (1544) for obtaining user input to generate a response to the voice input. However, the screen of the situation (1540) illustrated in FIG. 15b is merely an example for illustrative purposes and the present disclosure is not limited thereto. For example, the content displayed through the display (230) may include only some of the images (1541), messages (1542), visual objects (1543), and visual objects (1544).

[0168] FIG. 16 is a flowchart illustrating the operations of an electronic device for providing content that responds to user input while multiple screens are displayed through a display. The operations of FIG. 16 may be performed by the electronic device (101) of FIG. 1 and FIG. 2. For example, at least some of the operations may be controlled by a processor (210) of the electronic device (101). In the following, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed. For example, at least two operations may be performed in parallel.

[0169] Referring to FIG. 16, in operation 1601, an electronic device (101) according to one embodiment can obtain user input while a first screen and a second screen are displayed through a display (230).

[0170] In one embodiment, the electronic device (101) may display a first screen and a second screen through a display (230). In one example, the electronic device (101) may be a foldable electronic device. While the electronic device (101) displays the first screen and the second screen through the display (230), a first SIM (subscriber identity module) and a second SIM may be activated. An environment in which the first SIM and the second SIM are activated may be referred to as DSDA (dual SIM dual active). For example, the SIM for the first application (e.g., online lecture) may be designated as the first SIM, and the SIM for the second application (e.g., SMS (short message service)) may be designated as the second SIM.

[0171] In one embodiment, the electronic device (101) may execute an assistant application while a first screen for a first application and a second screen for a second application are displayed through the display (230). The electronic device (101) may display a visual object indicating the execution of the assistant application through the display (230). The electronic device (101) may generate context information of the first screen and context information of the second screen in response to the execution of the assistant application. The context information of the first screen may indicate the situation of the first screen displayed through the display (230). The context information of the second screen may indicate the situation of the second screen displayed through the display (230).

[0172] In one embodiment, the electronic device (101) can obtain user input requesting a specific action while the assistant application is running.

[0173] In operation 1602, an electronic device (101) according to one embodiment can identify whether user input corresponds to first screen context information.

[0174] In one embodiment, the electronic device (101) can identify screen context information corresponding to user input among the context information of a first screen and the context information of a second screen. An artificial intelligence module (250) may be used to identify screen context information corresponding to user input. In one example, a large language model (LLM) may be used to identify screen context information corresponding to user input. However, this is merely an example, and the present disclosure is not limited thereto. Another artificial intelligence model (e.g., a large multimodal model (LMM)) may be used to identify screen context information corresponding to user input. Based on the user input, the context information of the first screen, and the context information of the second screen, the artificial intelligence module (250) may output information indicating the screen corresponding to the user input among the first screen and the second screen.

[0175] In operation 1603, an electronic device (101) according to one embodiment can display content generated based on user input and first screen context information through a display (230). For example, the electronic device (101) can display content generated based on user input and first screen context information through a display (230) upon identification that user input corresponds to first screen context information.

[0176] In operation 1604, an electronic device (101) according to one embodiment can display content generated based on user input and second screen context information through a display (230). For example, the electronic device (101) can display content generated based on user input and second screen context information through a display (230) upon identification that user input corresponds to second screen context information.

[0177] Figure 17 illustrates an example in which multiple screens are displayed.

[0178] Referring to FIG. 17, an electronic device (101) (e.g., a foldable electronic device) can display a first screen (1710) and a second screen (1720) through a display (230). While the first screen (1710) and the second screen (1720) are displayed, a first SIM (subscriber identity module) and a second SIM can be activated. The first SIM may be a SIM assigned to an application (e.g., an online lecture) running on the first screen (1710). The second SIM may be a SIM assigned to an application (e.g., a short message service) running on the second screen (1720).

[0179] For example, the electronic device (101) may obtain input (e.g., voice call, press on a physical button of the electronic device (101)) for executing an assistant application while the first screen (1710) and the second screen (1720) are displayed. The electronic device (101) may execute the assistant application based on the input. The electronic device (101) may display a visual object (1701) indicating the execution of the assistant application through the display (230). In the example illustrated in FIG. 17, the visual object (1701) indicating the execution of the assistant application is shown as being displayed on the first screen (1701), but this is merely an example and the present disclosure is not limited thereto.

[0180] For example, the electronic device (101) may generate context information of a first screen (1710) and context information of a second screen (1720) in response to the execution of an assistant application. The context information of the first screen (1710) may represent a situation (e.g., an online lecture) appearing on the first screen (1710). The context information of the second screen (1720) may represent a situation (e.g., message exchange) appearing on the second screen (1720).

[0181] For example, the electronic device (101) can acquire a first voice input (e.g., 'Summarize the lecture') while the assistant application is running. The electronic device (101) can identify the context information of the first screen (1710) corresponding to the first voice input among the context information of the first screen (1710) and the context information of the second screen (1720). The electronic device (101) can display content generated based on the first voice input and the context information of the first screen (1710) through the display (230). The content generated based on the first voice input and the context information of the first screen (1710) may be summary information of an online lecture.

[0182] For example, the electronic device (101) may acquire a second voice input (e.g., 'summarize the message') while the assistant application is running. The electronic device (101) may identify the context information of the second screen (1720) corresponding to the second voice input among the context information of the first screen (1710) and the context information of the second screen (1720). The electronic device (101) may display content generated based on the second voice input and the context information of the second screen (1720) through the display (230). The content generated based on the second voice input and the context information of the second screen (1720) may be summary information of the message (e.g., meeting in Conference Room C at 2:00 PM on November 5).

[0183] FIG. 18 is a flowchart illustrating the operations of an electronic device for displaying content that responds to user input. The operations of FIG. 18 may be performed by the electronic device (101) of FIG. 1 and FIG. 2. For example, at least some of the operations may be controlled by a processor (210) of the electronic device (101). In the following, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed. For example, at least two operations may be performed in parallel.

[0184] Referring to FIG. 18, in operation 1801, an electronic device (101) according to one embodiment can identify whether the electronic device (101) is connected to an external electronic device (e.g., a car).

[0185] In one embodiment, the electronic device (101) can identify whether the electronic device (101) and an external electronic device (e.g., a vehicle) are connected via a short-range wireless communication or a wired interface. For example, if the electronic device (101) and the external electronic device are connected, a first SIM (subscriber identity module) may be activated. In one example, the first SIM may be a SIM designated for the user's driving state. For example, if the electronic device (101) and the external electronic device are not connected, a second SIM may be activated. In one example, the second SIM may be a SIM designated for the user's pedestrian state. However, this is merely an example and the present disclosure is not limited thereto.

[0186] In one embodiment, the electronic device (101) may obtain input for executing an assistant application (e.g., voice call, pressing a physical button of the electronic device (101)). The electronic device (101) may execute an assistant application based on the input. The electronic device (101) may display a visual object indicating the execution of the assistant application through a display (230). The electronic device (101) may obtain user input while the assistant application is executing.

[0187] In operation 1802, an electronic device (101) according to one embodiment may display content generated based on first profile information and user input through a display (230). For example, the electronic device (101) may display content generated based on profile information of a first SIM and user input through a display (230) according to identification that the electronic device (101) and an external electronic device are connected.

[0188] In one embodiment, the electronic device (101) may obtain application information from one or more applications based on user input. Application information may refer to information collected based on user intent appearing in user input. In one example, the application information may include route information for a destination collected by a navigation application. The route information may be route information via a vehicle.

[0189] In one embodiment, the electronic device (101) may generate content based on profile information and application information of a first SIM designated for a user's driving state. The content may be a summary of application information according to a first persona represented by the profile information of the first SIM. In one example, the content may include information that briefly summarizes application information for a user in a driving state.

[0190] In operation 1803, an electronic device (101) according to one embodiment may display content generated based on second profile information and user input through a display (230). For example, the electronic device (101) may display content generated based on profile information of a second SIM and user input through a display (230) upon identification that the electronic device (101) and an external electronic device are not connected.

[0191] In one embodiment, the electronic device (101) may obtain application information from one or more applications based on user input. Application information may refer to information collected based on user intent appearing in user input. In one example, the application information may include route information for a destination collected by a navigation application. The route information may be route information via walking.

[0192] In one embodiment, the electronic device (101) may generate content based on profile information and application information of a second SIM designated for a walking state of a user. The content may be a summary of application information according to a second persona represented by the profile information of the second SIM. In one example, the content may include information that summarizes application information in detail for a user in a walking state.

[0193] FIGS. 19a and FIGS. 19b illustrate examples of screens that display content responding to user input.

[0194] Referring to FIG. 19a, in a situation (1910), an electronic device (101) can obtain input (e.g., voice call, press on a physical button of the electronic device (101)) for executing an assistant application. The electronic device (101) can execute the assistant application based on the input. The electronic device (101) can display a visual object (1911) indicating the execution of the assistant application through a display. The electronic device (101) can obtain voice input (e.g., Tell me a cafe nearby to go to today) while the assistant application is running. The electronic device (101) can display text (1912) corresponding to the voice input through a display (230). The electronic device (101) can obtain application information from one or more applications based on the voice input. The electronic device (101) can identify whether the electronic device (101) and an external electronic device (e.g., a car) are connected via a short-range wireless communication or a wired interface in response to the execution of an assistant application. In the example illustrated in FIG. 19a, the electronic device (101) can identify that the electronic device (101) and the external electronic device are connected. Based on the identification that the electronic device (101) and the external electronic device are connected, the electronic device (101) can activate a first SIM (subscriber identity module) designated for the user's driving state.

[0195] In a situation (1920), the electronic device (101) can display content generated based on the profile information and application information of the first SIM through a display (230). The content displayed through the display (230) may include an image (1921) representing the first SIM and a message (1922) for guiding the user. The message (1922) for guiding the user may be information that briefly summarizes the application information according to the first persona represented by the profile information of the first SIM designated for the user's driving state (e.g., "Start route guidance to Cafe A, which you frequently visit nearby").

[0196] In situation (1930), the electronic device (101) can execute an application to navigate an external electronic device to a destination identified based on the profile information and application information of the first SIM without separate user input. The electronic device (101) can display content displayed through the display (230) (e.g., an image (1931) representing the first SIM and a message (1932) for guiding the user) for a specified time and then remove it from the screen.

[0197] Referring to FIG. 19b, in a situation (1940), the electronic device (101) can obtain input for executing an assistant application (e.g., voice call, pressing a physical button of the electronic device (101)). The electronic device (101) can execute the assistant application based on the input. The electronic device (101) can display a visual object (1941) indicating the execution of the assistant application through a display (230). The electronic device (101) can obtain voice input (e.g., Tell me a cafe nearby to go to today) while the assistant application is executing. The electronic device (101) can display text (1942) corresponding to the voice input through a display (230). The electronic device (101) can obtain application information from one or more applications based on the voice input. The electronic device (101) can identify whether the electronic device (101) and an external electronic device (e.g., a car) are connected via a short-range wireless communication or a wired interface in response to the execution of an assistant application. In the example illustrated in FIG. 19b, the electronic device (101) can identify that the electronic device (101) and the external electronic device are not connected. Based on the identification that the electronic device (101) and the external electronic device are not connected, the electronic device (101) can activate a second SIM (subscriber identity module) designated for the user's pedestrian state.

[0198] In a situation (1950), the electronic device (101) can display content generated based on the profile information and application information of the second SIM through a display (230). The content displayed through the display (230) may include an image (1951) representing the second SIM, a message (1952) summarizing application information, a visual object (1953) for obtaining user input to guide the user to a destination identified based on the profile information and application information of the second SIM, and a visual object (1954) for obtaining user input to obtain other options. The message (1952) summarizing application information may be information that summarizes the application information in detail according to the second persona represented by the profile information of the second SIM designated for the user's walking state (e.g., star rating, distance, availability).

[0199] FIG. 20 is a flowchart illustrating the operations of an electronic device for displaying content that responds to user input. The operations of FIG. 20 may be performed by the electronic device (101) of FIG. 1 and FIG. 2. For example, at least some of the operations may be controlled by a processor (210) of the electronic device (101). In the following, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed. For example, at least two operations may be performed in parallel.

[0200] Referring to FIG. 20, in operation 2001, an electronic device (101) according to one embodiment can identify whether the user is exercising.

[0201] In one embodiment, the electronic device (101) can identify whether a user is exercising by using at least one sensor of the electronic device (101) (e.g., an inertial measurement unit (IMU) sensor) and / or a sensor of a wearable device connected to the electronic device (101) (e.g., an IMU sensor). For example, if the user is exercising, a first SIM (subscriber identity module) may be activated. In one example, the first SIM may be a SIM designated for the user's exercise state. For example, if the user is not exercising, a second SIM may be activated. In one example, the second SIM may be a SIM designated for the user's rest state. However, this is merely an example and the present disclosure is not limited thereto.

[0202] In one embodiment, the electronic device (101) may acquire input for executing an assistant application (e.g., voice call, pressing a physical button of the electronic device (101)). The electronic device (101) may execute an assistant application based on the input. The electronic device (101) may display a visual object indicating the execution of the assistant application through a display (230). The electronic device (101) may acquire user input (e.g., voice input) while the assistant application is executing.

[0203] In operation 2002, the electronic device (101) may provide content generated based on first profile information and user input through a wearable device connected to the electronic device (101). For example, the electronic device (101) may provide content generated based on first profile information and user input through a wearable device connected to the electronic device (101) upon identification that the user is exercising.

[0204] In one embodiment, the electronic device (101) may obtain application information from one or more applications based on user input and screen context information. Application information may refer to information collected based on user intent appearing in user input and screen context information.

[0205] In one embodiment, the electronic device (101) may generate content based on profile information and application information of a first SIM designated for the user's exercise state. The content may be a summary of application information according to a first persona represented by the profile information of the first SIM. In one example, the content may include information that briefly summarizes application information for a user in an exercise state. However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto.

[0206] In one embodiment, the electronic device (101) can transmit content generated based on the profile information and application information of the first SIM to a wearable device connected to the electronic device (101). The wearable device can display the content through the display of the wearable device or output the content through the speaker of the wearable device.

[0207] In operation 2003, the electronic device (101) can provide content generated based on second profile information and user input through the electronic device (101). For example, the electronic device (101) can provide content generated based on second profile information and user input through the electronic device (101) upon identification that the user is not exercising.

[0208] In one embodiment, the electronic device (101) may obtain application information from one or more applications based on user input and screen context information. Application information may refer to information collected based on user intent appearing in user input and screen context information.

[0209] In one embodiment, the electronic device (101) may generate content based on profile information and application information of a second SIM designated for a user's resting state. The content may be a summary of application information according to a second persona represented by the profile information of the second SIM. In one example, the content may include information that summarizes application information in detail for a user in a resting state. However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto. The electronic device (101) may display the generated content through a display (230).

[0210] FIG. 21 illustrates an example of a situation for providing content that responds to user input.

[0211] Referring to FIG. 21, a user wearing a first wearable device (2101) and a second wearable device (2102) may be in an exercise state. The electronic device (101) may not be carried by the user. The electronic device (101), the first wearable device (2101), and the second wearable device (2102) may be devices owned by the user. In the example illustrated in FIG. 21, the first wearable device (2101) and the second wearable device (2102) may be devices in which the assistant application is disabled or does not support the assistant application.

[0212] For example, an electronic device (101) may acquire input (e.g., voice call) for executing an assistant application while the user is in an exercise state. The electronic device (101) may execute an assistant application based on user input. In response to the execution of the assistant application, the electronic device (101) may identify whether the user is exercising. Upon identification that the user is exercising, the electronic device (101) may activate a SIM (subscriber identity module) designated for the user's exercise state. The electronic device (101) may acquire application information based on context information acquired during the execution of the assistant application and the user's voice input (e.g., "Tell me my exercise posture"). The electronic device (101) may generate content based on the profile information of the activated SIM and the application information. The content may be a brief summary of the application information according to the persona represented by the profile information of the SIM designated for the user's exercise state.

[0213] For example, the electronic device (101) may transmit generated content to the first wearable device (2101) and / or the second wearable device (2102). The first wearable device (2101) may output content briefly summarized for a user in an exercise state through the speaker of the first wearable device (2101). The second wearable device (2102) may display content briefly summarized for a user in an exercise state through the display of the second wearable device (2102).

[0214] Figure 22 illustrates an example of a multi-persona according to an operating system.

[0215] Referring to FIG. 22, an electronic device (101) may operate based on a first operating system (OS) (2211) in a situation (2210). For example, a first persona (2212) may be assigned to the first operating system (2211). In one example, the first persona (2212) may be a personal privacy persona. However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto. For example, the electronic device (101) may obtain application information using one or more applications according to a user intent identified based on user input and screen context information. The electronic device (101) may generate content by summarizing the obtained application information based on the first persona (2212). The electronic device (101) may display the generated content through a display (230).

[0216] The electronic device (101) may operate based on a second operating system (2221) in a situation (2220). For example, a second persona (2222) may be assigned to the second operating system (2221). In one example, the second persona (2222) may be a work persona. However, this is merely an example for illustrative purposes and the present disclosure is not limited thereto. The electronic device (101) may obtain application information using one or more applications according to a user intent identified based on user input and screen context information. The electronic device (101) may generate content by summarizing the obtained application information based on the second persona (2222). The electronic device (101) may display the generated content through a display (230).

[0217] In one example, even if the same application information is used, content generated based on the first persona (2212) may differ from content generated based on the second persona (2222). However, this is merely an example and the present disclosure is not limited thereto. As described above, the electronic device (101) can provide content based on user preferences and / or behavioral patterns to the user by applying personas differently depending on the operating system.

[0218] FIG. 23 illustrates an example of a multi-persona in a foldable device. An electronic device (101) may be a multi-foldable device as illustrated in FIG. 23. Referring to FIG. 23, the electronic device (101) may be composed of a first state (2310), a second state (2320), a third state (2330), a fourth state (2340), and / or a fifth state (2350). For example, the electronic device (101) may have a different persona for each of the aforementioned states.

[0219] For example, the electronic device (101) may operate based on a first persona in a first state (2310). The electronic device (101) may obtain application information using one or more applications according to a user intent identified based on user input and screen context information. The electronic device (101) may generate content by summarizing the obtained application information based on the first persona. The electronic device (101) may display the generated content through a display (230).

[0220] For example, the electronic device (101) may operate based on a second persona in a second state (2320). The electronic device (101) may obtain application information using one or more applications according to a user intent identified based on user input and screen context information. The electronic device (101) may generate content by summarizing the obtained application information based on the second persona. The electronic device (101) may display the generated content through a display (230).

[0221] For example, the electronic device (101) may operate based on a third persona in a third state (2330). The electronic device (101) may obtain application information using one or more applications according to a user intent identified based on user input and screen context information. The electronic device (101) may generate content by summarizing the obtained application information based on the third persona. The electronic device (101) may display the generated content through a display (230).

[0222] For example, the electronic device (101) may operate based on a fourth persona in a fourth state (2340). The electronic device (101) may obtain application information using one or more applications according to a user intent identified based on user input and screen context information. The electronic device (101) may generate content by summarizing the obtained application information based on the fourth persona. The electronic device (101) may display the generated content through a display (230).

[0223] For example, the electronic device (101) may operate based on a fifth persona in a fifth state (2350). The electronic device (101) may obtain application information using one or more applications according to a user intent identified based on user input and screen context information. The electronic device (101) may generate content by summarizing the obtained application information based on the fifth persona. The electronic device (101) may display the generated content through a display (230).

[0224] The electronic device (101) may use different personas to generate content according to the configured form of the electronic device (101). By using different personas, the electronic device (101) may generate content suitable for the user's situation.

[0225] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0226] The electronic device described above may include a communication circuit. The electronic device (101) may include a display. The electronic device may include at least one sensor. The electronic device may include a memory that stores instructions and includes one or more storage media. The electronic device may include at least one processor that includes a processing circuit. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to obtain screen context information generated based on a screen displayed through the display and user input to request an action of the electronic device in response to the execution of an assistant application. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to obtain application information from one or more applications based on the screen context information generated based on a screen displayed through the display and the user input to request an action of the electronic device. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to identify an active SIM among the first SIM (subscriber identity module) and the second SIM of the electronic device. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to display first content generated based on the profile information of the first SIM and the application information, upon identification that the active SIM corresponds to the first SIM.When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the second content generated based on the profile information of the second SIM and the application information, upon identification that the activation SIM corresponds to the second SIM.

[0227] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the display of a message to guide a user's selection regarding a situation indicated by the screen context information, based on the profile information of the activation SIM and the screen context information.

[0228] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display a message to refrain from providing content generated based on the profile information of the activation SIM and the application information, upon identification that the user input does not correspond to the screen context information. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display a message to provide the content generated based on the profile information of the activation SIM and the application information, upon identification that the user input corresponds to the screen context information.

[0229] For example, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify whether the electronic device is connected to a vehicle. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to execute an application to navigate the vehicle to a destination identified based on the user input, using the profile information of the first SIM for the driving state of the vehicle, upon identification that the electronic device is connected to the vehicle. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display content generated based on the user input, using the profile information of the second SIM for the pedestrian state of the user of the electronic device, upon identification that the electronic device is not connected to the vehicle.

[0230] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify screen context information corresponding to the first user input among the first screen context information of the first screen and the second screen context information of the second screen while the first screen for the first application and the second screen for the second application are displayed through the display. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display on the first screen a message generated based on the first user input and the profile information of the first SIM, in accordance with the identification that the screen context information corresponding to the first user input is the first screen context information. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display on the second screen a message generated based on the first user input and the profile information of the second SIM, in accordance with the identification that the screen context information corresponding to the first user input is the second screen context information.

[0231] For example, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify a first threshold of signal strength based on the profile information of the first SIM, upon identification that the activation SIM corresponds to the first SIM. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify a second threshold of signal strength based on the profile information of the second SIM, upon identification that the activation SIM corresponds to the second SIM. The first threshold for changing the network connected through the first SIM may be smaller than the second threshold for changing the network connected through the second SIM.

[0232] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify whether the user of the electronic device is in an exercise state using the at least one sensor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to provide content generated based on the profile information of the first SIM and the application information through a wearable device connected to the electronic device, upon identification that the user is in the exercise state. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to provide content generated based on the profile information of the second SIM and the application information through the electronic device, upon identification that the user is not in the exercise state.

[0233] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the one or more applications to acquire the application information while the user interfaces (UIs) of the one or more applications are not displayed through the display by providing the instructions generated based on the screen context information and the user input.

[0234] For example, the application information may include information obtained from one or more applications to generate content intended by the screen context information and the user input.

[0235] For example, the artificial intelligence model can output the first content based on the profile information of the first SIM and the application information. The artificial intelligence model can output the second content based on the profile information of the second SIM and the application information.

[0236] A method performed by an electronic device comprising a display and at least one sensor as described above may include an operation of obtaining screen context information generated based on a screen displayed through the display and user input for requesting an action of the electronic device in response to the execution of an assistant application. The method may include an operation of obtaining application information from one or more applications based on the screen context information generated based on the screen displayed through the display and the user input for requesting an action of the electronic device. The method may include an operation of identifying an active SIM among a first SIM (subscriber identity module) and a second SIM of the electronic device. The method may include an operation of displaying first content generated based on profile information of the first SIM and application information according to the identification that the active SIM corresponds to the first SIM. The method may include an operation of displaying second content generated based on profile information of the second SIM and application information according to the identification that the active SIM corresponds to the second SIM.

[0237] For example, the above method may include an operation to display a message to guide a user's selection regarding a situation indicated by the screen context information, based on the profile information of the activated SIM and the screen context information.

[0238] For example, the above method may include an action of displaying a message to refrain from providing content generated based on the profile information of the activation SIM and the application information, upon identification that the user input does not correspond to the screen context information. The above method may include an action of displaying a message to provide the content generated based on the profile information of the activation SIM and the application information, upon identification that the user input corresponds to the screen context information.

[0239] For example, the above method may include an operation of identifying whether the electronic device is connected to a vehicle. The method may include an operation of executing an application to navigate the vehicle to a destination identified based on the user input, using profile information of the first SIM for the driving state of the vehicle, upon identifying that the electronic device is connected to the vehicle. The method may include an operation of displaying content generated based on the user input, using profile information of the second SIM for the pedestrian state of the user of the electronic device, upon identifying that the electronic device is not connected to the vehicle.

[0240] For example, the above method may include an operation of identifying screen context information corresponding to a first user input among first screen context information of the first screen and second screen context information of the second screen while a first screen for a first application and a second screen for a second application are displayed through the display. The above method may include an operation of displaying a message generated based on the first user input and the profile information of the first SIM on the first screen according to the identification that the screen context information corresponding to the first user input is the first screen context information. The above method may include an operation of displaying a message generated based on the first user input and the profile information of the second SIM on the second screen according to the identification that the screen context information corresponding to the first user input is the second screen context information.

[0241] For example, the above method may include an operation of identifying a first threshold value of signal strength based on profile information of the first SIM, upon identifying that the activation SIM corresponds to the first SIM. The above method may include an operation of identifying a second threshold value of signal strength based on profile information of the second SIM, upon identifying that the activation SIM corresponds to the second SIM. The first threshold value for changing the network connected through the first SIM may be smaller than the second threshold value for changing the network connected through the second SIM.

[0242] For example, the above method may include an operation of identifying whether a user of the electronic device is in an exercise state using at least one sensor. The above method may include an operation of providing content generated based on the profile information of the first SIM and the application information through a wearable device connected to the electronic device, upon identification that the user is in the exercise state. The above method may include an operation of providing content generated based on the profile information of the second SIM and the application information through the electronic device, upon identification that the user is not in the exercise state.

[0243] For example, the above method may include an operation of acquiring application information while the user interfaces (UIs) of the one or more applications are not displayed through the display, by providing the one or more applications with a command generated based on the screen context information and the user input.

[0244] For example, the application information may include information obtained from one or more applications to generate content intended by the screen context information and the user input.

[0245] For example, the artificial intelligence model can output the first content based on the profile information of the first SIM and the situation information. The artificial intelligence model can output the second content based on the profile information of the second SIM and the situation information.

[0246] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.

[0247] For one or more embodiments, at least one of the components described in one or more of the prior art drawings may be configured to perform one or more operations, techniques, processes and / or methods as described in the present disclosure. For example, a processor (e.g., a baseband processor) described in the present disclosure in relation to one or more of the prior art drawings may be configured to operate according to one or more examples described in the present disclosure. As another example, circuits associated with user equipment (UE), base stations, network elements, etc., as described above in relation to one or more of the prior art drawings may be configured to operate according to one or more examples described herein.

[0248] Any of the embodiments described above may be combined with any other embodiment (or combination of embodiments) unless otherwise explicitly stated. The foregoing description of one or more embodiments is for illustrative and explanatory purposes only, and is not intended to limit or exhaust the scope of the embodiments in the exact form disclosed. Modifications and variations are possible in light of the foregoing teachings or may be obtained from the practice of various embodiments.

[0249] The electronic devices according to the various embodiments disclosed in this document may be of various forms. The electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, electronic devices, or consumer electronics. The electronic devices according to the embodiments of this document are not limited to the devices described above.

[0250] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0251] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0252] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0253] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0254] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device, Communication circuit; display; At least one sensor; Memory for storing instructions and including one or more storage media; and It includes at least one processor comprising a processing circuit, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, In response to the execution of an assistant application, screen context information generated based on a screen displayed through the display and user input for requesting an action of the electronic device are obtained, and Based on the screen context information generated based on the screen displayed through the above display and the user input for requesting an action of the electronic device, application information is obtained from one or more applications, and Identifying the active SIM among the first SIM (subscriber identity module) and the second SIM of the electronic device, and Based on the identification that the above-mentioned activation SIM corresponds to the above-mentioned first SIM, a first content generated based on the profile information of the above-mentioned first SIM and the application information is displayed, and Causing to display second content generated based on the profile information of the second SIM and the application information, upon identification that the activation SIM corresponds to the second SIM. Electronic device.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Causing to display a message to guide a user's selection regarding a situation indicated by the screen context information, based on the profile information of the activated SIM and the screen context information. Electronic device.

3. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on the identification that the above user input does not correspond to the above screen context information, a message is displayed to refrain from providing content generated based on the profile information of the activation SIM and the above application information, and Causing to display a message for providing the content generated based on the profile information of the activation SIM and the application information, upon identification that the above user input corresponds to the above screen context information, Electronic device.

4. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Identify whether the above electronic device is connected to a vehicle, and Based on the identification that the electronic device is connected to the vehicle, an application for navigating the vehicle to a destination identified based on the user input is executed using the profile information of the first SIM for the driving state of the vehicle, and Causing to display content generated based on the user input by using the profile information of the second SIM for the pedestrian state of the user of the electronic device, upon identification that the electronic device is not connected to the vehicle. Electronic device.

5. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, While a first screen for a first application and a second screen for a second application are displayed through the above display, screen context information corresponding to a first user input is identified among the first screen context information of the first screen and the second screen context information of the second screen, and According to the identification that the screen context information corresponding to the first user input is the first screen context information, a message generated based on the first user input and the profile information of the first SIM is displayed on the first screen, and Causing a message generated based on the first user input and the profile information of the second SIM to be displayed on the second screen, according to the identification that the screen context information corresponding to the first user input is the second screen context information. Electronic device.

6. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on the identification that the above-mentioned activation SIM corresponds to the above-mentioned first SIM, a first threshold value of signal strength is identified based on the profile information of the above-mentioned first SIM, and, Based on the identification that the above-mentioned activation SIM corresponds to the above-mentioned second SIM, a second threshold value of signal strength is identified based on the profile information of the above-mentioned second SIM, and The first threshold value for changing the network connected through the first SIM is smaller than the second threshold value for changing the network connected through the second SIM, Electronic device.

7. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Using the above at least one sensor, determine whether the user of the electronic device is in an exercise state, and Based on the identification that the user is in the exercise state, content generated based on the profile information of the first SIM and the application information is provided through a wearable device connected to the electronic device, and Causing to provide content generated based on the profile information of the second SIM and the application information through the electronic device upon identification that the user is not in the exercise state. Electronic device.

8. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, By providing commands generated based on the screen context information and the user input to the one or more applications, the UI (user interface) of the one or more applications causes the application information to be acquired while the UIs are not displayed through the display. Electronic device.

9. In Paragraph 1, The above application information includes information obtained from one or more applications to generate content intended by the screen context information and the user input. Electronic device.

10. In Paragraph 1, The artificial intelligence model outputs the first content based on the profile information of the first SIM and the application information, and The above artificial intelligence model outputs the second content based on the profile information of the second SIM and the application information, Electronic device.

11. A method performed by an electronic device comprising a display and at least one sensor, An operation to obtain screen context information generated based on a screen displayed through the display and user input for requesting an action of the electronic device in response to the execution of an assistant application; An operation of obtaining application information from one or more applications based on screen context information generated based on a screen displayed through the above display and user input for requesting an action of the electronic device; An operation to identify the active SIM among the first SIM (subscriber identity module) and the second SIM of the electronic device; An operation of displaying first content generated based on the profile information of the first SIM and the application information, in accordance with the identification that the activation SIM corresponds to the first SIM; and A method including an operation of displaying second content generated based on profile information of the second SIM and application information, upon identification that the activation SIM corresponds to the second SIM. method.

12. In Paragraph 11, Further including an operation to display a message to guide a user's selection regarding a situation indicated by the screen context information, based on the profile information of the activated SIM and the screen context information. method.

13. In Paragraph 11, An operation to display a message to refrain from providing content generated based on the profile information of the activation SIM and the application information, upon identification that the above user input does not correspond to the above screen context information; and A method further comprising an operation of displaying a message for providing the content generated based on the profile information of the activated SIM and the application information, upon identification that the user input corresponds to the screen context information. method.

14. In Paragraph 11, An operation to identify whether the above electronic device is connected to a vehicle; The operation of executing an application to navigate the vehicle to a destination identified based on the user input, using profile information of the first SIM for the driving state of the vehicle, upon identification that the electronic device is connected to the vehicle; and Further including an operation to display content generated based on the user input using the profile information of the second SIM for the pedestrian state of the user of the electronic device, upon identification that the electronic device is not connected to the vehicle. method.

15. In Paragraph 11, An operation of identifying screen context information corresponding to a first user input among the first screen context information of the first screen and the second screen context information of the second screen while a first screen for a first application and a second screen for a second application are displayed through the above display; An operation of displaying a message generated based on the first user input and the profile information of the first SIM on the first screen, according to the identification that the screen context information corresponding to the first user input is the first screen context information; and The operation further includes displaying a message generated based on the first user input and the profile information of the second SIM on the second screen, according to the identification that the screen context information corresponding to the first user input is the second screen context information. method.

Images