Electronic device, method, and recording medium for providing artificial intelligence-based recommendation information

Abstract

Various embodiments of the present disclosure provide an electronic device, a method, and a recording medium for providing recommendation information on the basis of artificial intelligence (AI). An electronic device, according to one embodiment of the present invention, may display an execution screen of an interactive service. The electronic device may detect a feature point from content inputted while performing the interactive service. The electronic device may determine relationship information with at least one counterpart user participating in the interactive service, on the basis of the feature point detection. The electronic device may determine an access level for user information on the basis of the relationship information. The electronic device may acquire at least a part of the user information and / or general information, on the basis of the access level. The electronic device may generate recommendation information related to the feature point, on the basis of the acquired information. The electronic device may provide the recommendation information.

Description

Electronic device, method, and recording medium for providing artificial intelligence-based recommendation information

[0001] Embodiments of the present disclosure provide an electronic device, a method, and a recording medium that provide recommended information based on artificial intelligence (AI).

[0002] With the advancement of digital technology, various types of electronic devices, such as smartphones, digital cameras, and / or wearable devices, are becoming widely used. The hardware and / or software components of these electronic devices are continuously being developed to support and enhance their functionality.

[0003] For example, portable electronic devices (hereinafter referred to as "electronic devices"), such as smartphones, can now be equipped with a variety of functions. Electronic devices include touchscreen-based displays that allow users to easily access various functions, and can display screens for various applications through these displays.

[0004] Recently, with the rapid development of big data and deep learning technologies, artificial intelligence (AI) is being implemented in electronic devices. AI technologies can include the analysis of specific data and intelligent personal services that integrate and utilize information from various fields tailored to the user's needs. For example, users can control electronic devices through voice conversations, and a deep learning-based knowledge base allows them to search for, query, and respond to specific information. Currently, AI-user interactions can take the form of conversations.

[0005] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0006] In one embodiment of the present disclosure, a method for providing a recommended answer based on conversation data between a user and a counterpart user while executing an interactive service, an electronic device supporting the same, and a recording medium are provided.

[0007] In one embodiment of the present disclosure, a method for recommending and providing an appropriate answer to conversation data through artificial intelligence based on conversation data between a user and a counterpart user, an electronic device supporting the method, and a recording medium are provided.

[0008] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0009] An electronic device according to one embodiment of the present disclosure may include a display, a memory storing instructions (or commands or one or more computer programs), and processing circuitry, and may include at least one processor operatively connected to the display and the memory. In one embodiment, the memory may store one or more computer programs (or instructions) that, when individually and / or collectively executed by the at least one processor, cause the electronic device to perform operations. In one embodiment, the one or more computer programs may include computer-executable instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to perform the following:

[0010] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display an execution screen of an interactive service. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to detect a feature point from content input while performing the interactive service. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine relationship information with at least one other user participating in the interactive service. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine an access level to user information based on the relationship information. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain at least a portion of the user information and / or general information based on the access level. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to generate recommendation information related to the feature point based on the acquired information. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to provide the recommendation information.

[0011] An operating method of an electronic device according to one embodiment of the present disclosure may include an operation of displaying an execution screen of an interactive service. The operating method may include an operation of detecting a feature point from content input while performing the interactive service. The operating method may include an operation of determining relationship information with at least one other user participating in the interactive service. The operating method may include an operation of determining an access level to user information based on the relationship information. The operating method may include an operation of acquiring at least a portion of the user information and / or general information based on the access level. The operating method may include an operation of generating recommendation information related to the feature point based on the acquired information. The operating method may include an operation of providing the recommendation information.

[0012] In order to solve the above-described problem, various embodiments of the present disclosure may include a computer-readable recording medium having recorded thereon a program for executing the method on a processor.

[0013] According to one embodiment, one or more non-transitory computer-readable recording media (or storage media or computer program products) are provided that store computer-executable instructions that cause one or more processors of an electronic device to perform operations when individually or collectively executed.

[0014] According to one embodiment, the above operations may include an operation of displaying an execution screen of an interactive service, an operation of detecting a feature point from content input while performing the interactive service, an operation of determining relationship information with at least one counterpart user participating in the interactive service, an operation of determining an access level to user information based on the relationship information, an operation of obtaining at least a portion of the user information and / or general information based on the access level, an operation of generating recommendation information related to the feature point based on the obtained information, and an operation of providing the recommendation information.

[0015] Further scope of the applicability of the present disclosure will become apparent from the detailed description below. However, since various modifications and variations within the spirit and scope of the present disclosure will readily become apparent to those skilled in the art, it should be understood that the detailed description and specific examples, such as preferred embodiments of the present disclosure, are given by way of example only.

[0016] According to one embodiment of the present disclosure, an electronic device, a method of operation thereof, and a recording medium, a recommended answer can be generated and provided to a user in response to conversation data between a user and a counterpart user while providing an interactive service. According to one embodiment, based on the conversation data between the user and the counterpart user, an appropriate answer to the conversation data can be recommended and provided to the user through artificial intelligence, thereby improving the convenience of the user's dialogue writing. According to one embodiment, the user's needs for using an interactive service using an electronic device can be satisfied, and a new user experience (UX) can be provided to the user in accordance with the use of the electronic device.

[0017] In addition, various effects may be directly or indirectly realized through this document. The effects obtained through this disclosure are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains, based on the description below.

[0018] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0019] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0020] FIG. 2 is a block diagram illustrating an integrated intelligence system according to various embodiments.

[0021] FIG. 3 is a diagram showing the form in which relationship information between concepts and actions according to various embodiments is stored in a database.

[0022] FIG. 4 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0023] FIG. 5 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.

[0024] FIGS. 6A, 6B, and 6C are diagrams illustrating examples of providing interactive services in an electronic device according to one embodiment of the present disclosure.

[0025] FIGS. 7A, 7B, and 7C are diagrams illustrating various examples of a user interface for supporting an interactive service in an electronic device according to one embodiment of the present disclosure.

[0026] FIGS. 8A, 8B, and 8C are diagrams illustrating various examples of a user interface for supporting an interactive service in an electronic device according to one embodiment of the present disclosure.

[0027] FIGS. 9A and 9B are diagrams illustrating examples of providing interactive services in an electronic device according to one embodiment of the present disclosure.

[0028] FIG. 10 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.

[0029] FIG. 11 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.

[0030] FIGS. 12A, 12B, and 12C are diagrams illustrating various examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0031] FIGS. 13A, 13B, and 13C are diagrams illustrating various examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0032] FIGS. 14A and 14B are diagrams illustrating various examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0033] FIGS. 15A, 15B, and 15C are diagrams illustrating various examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0034] FIGS. 16A and 16B are diagrams illustrating various examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0035] FIG. 17 is a diagram illustrating an example of an adjustment object that supports adjustment of an information disclosure step in an electronic device according to one embodiment of the present disclosure.

[0036] FIGS. 18a, 18b, 18c, and 18d are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0037] FIGS. 19A and 19B are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0038] FIGS. 20A and 20B are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0039] FIGS. 21A and 21B are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0040] FIGS. 22A and 22B are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0041] FIGS. 23a, 23b, and 23c are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0042] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0043] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0044] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0045] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor (123) (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0046] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0047] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0048] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (OS) (142), middleware (144), or an application (146).

[0049] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0050] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0051] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0052] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0053] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0054] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0055] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0056] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0057] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0058] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0059] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0060] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0061] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimizing terminal power and connecting multiple terminals (mMTC, massive machine type communications), or high reliability and low latency communications (URLLC, ultra-reliable and low-latency communications). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0062] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0063] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0064] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0065] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0066] FIG. 2 is a block diagram illustrating an integrated intelligence system according to various embodiments.

[0067] Referring to FIG. 2, an integrated intelligence system according to one embodiment may include an electronic device (210) (e.g., electronic device (101) of FIG. 1), an intelligent server (230) (e.g., server (108) of FIG. 1), and a service server (250) (e.g., server (108) of FIG. 1).

[0068] According to one embodiment, the electronic device (210) may be a terminal device (or electronic device) that can connect to the Internet, such as a mobile phone, a smart phone, a personal digital assistant (PDA), a laptop computer, a TV, white goods, a wearable device, a head mounted display (HMD), or a smart speaker.

[0069] According to the illustrated embodiment, the electronic device (210) may include a communication interface (213) (e.g., the interface (177) of FIG. 1), a microphone (212) (e.g., the input module (150) of FIG. 1), a speaker (216) (e.g., the audio output module (155) of FIG. 1), a display module (211) (e.g., the display module (160) of FIG. 1), a memory (215) (e.g., the memory (130) of FIG. 1), or a processor (214) (e.g., the processor (120) of FIG. 1). The components listed above may be operatively or electrically connected to each other. The electronic device (210) may include at least some of the configurations and / or functions of the electronic device (101) of FIG. 1.

[0070] In one embodiment, the communication interface (213) may be configured to connect to an external device and transmit and receive data. In one embodiment, the microphone (212) may receive sound (e.g., user speech) and convert it into an electrical signal. In one embodiment, the speaker (216) may output the electrical signal as sound (e.g., voice).

[0071] In one embodiment, the display module (211) may be configured to display an image or video. In one embodiment, the display module (211) may also display a graphical user interface (GUI) of a running app (or application program). In one embodiment, the display module (211) may receive a touch input via a touch sensor. For example, the display module (211) may receive a text input via a touch sensor in an on-screen keyboard area displayed within the display module (211).

[0072] According to one embodiment, the memory (215) can store a client module (218), a software development kit (SDK) (217), and a plurality of apps (e.g., a first app (219a), a second app (219b)). The client module (218) and the SDK (217) can form a framework (or solution program) for performing general functions. In addition, the client module (218) or the SDK (217) can form a framework for processing user input (e.g., voice input, text input, touch input).

[0073] According to one embodiment, the plurality of apps (219a, 219b) stored in the memory (215) may be programs for performing a specified function. According to one embodiment, the plurality of apps may include a first app (219a) and a second app (219b). According to one embodiment, each of the plurality of apps (219a, 219b) may include a plurality of operations for performing a specified function. For example, the apps (219a, 219b) may include an alarm app, a message app, and / or a schedule app. According to one embodiment, the plurality of apps (219a, 219b) may be executed by the processor (214) to sequentially execute at least some of the plurality of operations.

[0074] According to one embodiment, the processor (214) can control the overall operation of the electronic device (210). For example, the processor (214) can be electrically connected to a communication interface (213), a microphone (212), a speaker (216), and a display module (211) to perform designated operations.

[0075] According to one embodiment, the processor (214) may also execute a program stored in the memory (215) to perform a designated function. For example, the processor (214) may execute at least one of the client module (218) or the SDK (217) to perform the following operations for processing user input. The processor (214) may control the operations of a plurality of apps (219a, 219b), for example, through the SDK (217). The following operations described as operations of the client module (218) or the SDK (217) may be operations executed by the processor (214).

[0076] According to one embodiment, the client module (218) can receive user input. For example, the client module (218) can receive a voice signal corresponding to a user utterance detected through the microphone (212). Alternatively, the client module (218) can receive a touch input detected through the display module (211). Alternatively, the client module (218) can receive a text input detected through a keyboard or a visual keyboard. In addition, the client module (218) can receive various forms of user input detected through an input module included in the electronic device (210) or an input module connected to the electronic device (210). The client module (218) can transmit the received user input to the intelligent server (230). The client module (218) can transmit status information of the electronic device (210) together with the received user input to the intelligent server (230). The status information can be, for example, execution status information of an app.

[0077] In one embodiment, the client module (218) may receive a result corresponding to the received user input. For example, the client module (218) may receive a result corresponding to the received user input if the intelligent server (230) can produce a result corresponding to the received user input. The client module (218) may display the received result on the display module (211). Additionally, the client module (218) may output the received result as audio through the speaker (216).

[0078] According to one embodiment, the client module (218) can receive a plan corresponding to the received user input. The client module (218) can display the results of executing multiple operations of the app according to the plan on the display module (211). For example, the client module (218) can sequentially display the results of executing multiple operations on the display module (211) and output audio through the speaker (216). The electronic device (210) can, for another example, display only some results of executing multiple operations (e.g., the result of the last operation) on the display module (211) and output audio through the speaker (216).

[0079] In one embodiment, the client module (218) may receive a request from the intelligent server (230) to obtain information necessary to produce a result corresponding to the voice input. In one embodiment, the client module (218) may transmit the necessary information to the intelligent server (230) in response to the request.

[0080] According to one embodiment, the client module (218) may transmit result information of executing multiple operations according to a plan to the intelligent server (230). The intelligent server (230) may use the result information to confirm that the received user input has been processed correctly.

[0081] In one embodiment, the client module (218) may include a voice recognition module. In one embodiment, the client module (218) may recognize voice inputs that perform limited functions through the voice recognition module. For example, the client module (218) may execute an intelligent app that processes voice inputs to perform organic actions based on a specified input (e.g., "Wake up!").

[0082] According to one embodiment, the intelligent server (230) can receive information related to a user voice input from an electronic device (210) via a communication network. According to one embodiment, the intelligent server (230) can convert data related to the received voice input into text data. According to one embodiment, the intelligent server (230) can generate a plan for performing a task corresponding to the user voice input based on the text data.

[0083] In one embodiment, the plan may be generated by an artificial intelligence (AI) system. The AI ​​system may be a rule-based system, a neural network-based system (NNS) (e.g., a feedforward neural network (FNN), a recurrent neural network (RNN)), or a combination of the aforementioned or another AI system. In one embodiment, the plan may be selected from a set of predefined plans or generated in real time in response to a user request. For example, the AI ​​system may select at least one plan from a plurality of predefined plans.

[0084] According to one embodiment, the intelligent server (230) may transmit the results according to the generated plan to the electronic device (210), or transmit the generated plan to the electronic device (210). According to one embodiment, the electronic device (210) may display the results according to the plan on the display module (211). According to one embodiment, the electronic device (210) may display the results of executing an operation according to the plan on the display module (211).

[0085] According to one embodiment, the intelligent server (230) may include a front end (231), a natural language platform (232), a capsule database (238), an execution engine (233), an end user interface (234), a management platform (235), a big data platform (236), and / or an analytic platform (237).

[0086] According to one embodiment, the front end (231) can receive user input from the electronic device (210). The front end (231) can transmit a response corresponding to the user input.

[0087] According to one embodiment, the natural language platform (232) may include an automatic speech recognition module (ASR module) (232a), a natural language understanding module (NLU module) (232b), a planner module (232c), a natural language generator module (NLG module) (232d), and / or a text to speech module (TTS module) (232e).

[0088] According to one embodiment, the automatic speech recognition module (232a) can convert voice input received from the electronic device (210) into text data. According to one embodiment, the natural language understanding module (232b) can use the text data of the voice input to determine the user's intention. For example, the natural language understanding module (232b) can perform syntactic analysis and / or semantic analysis on user input in the form of text data to determine the user's intention. According to one embodiment, the natural language understanding module (232b) can use linguistic features (e.g., grammatical elements) of morphemes or phrases to determine the meaning of words extracted from the voice input, and can match the meaning of the determined words to the intent to determine the user's intent. The natural language understanding module (223b) can obtain intent information corresponding to the user's utterance. The intent information can be information indicating the user's intent determined by interpreting text data. The intent information can include information indicating an action or function that the user intends to execute using the device.

[0089] According to one embodiment, the planner module (232c) can generate a plan using the intent and parameters determined by the natural language understanding module (232b). According to one embodiment, the planner module (232c) can determine a plurality of domains necessary to perform a task based on the determined intent. The planner module (232c) can determine a plurality of operations included in each of the plurality of domains determined based on the intent. According to one embodiment, the planner module (232c) can determine parameters necessary to execute the plurality of determined operations or result values ​​output by the execution of the plurality of operations. The parameters and the result values ​​can be defined as concepts of a specified format (or class). Accordingly, the plan can include a plurality of operations and a plurality of concepts determined by the user's intent.

[0090] According to one embodiment, the planner module (232c) can determine the relationship between the plurality of operations and the plurality of concepts in a stepwise (or hierarchical) manner. For example, the planner module (232c) can determine the execution order of the plurality of operations determined based on the user's intention based on the plurality of concepts. In other words, the planner module (232c) can determine the execution order of the plurality of operations based on the parameters required for the execution of the plurality of operations and the results output by the execution of the plurality of operations. Accordingly, the planner module (232c) can generate a plan including association information (e.g., ontology) between the plurality of operations and the plurality of concepts. The planner module (232c) can generate the plan using information stored in a capsule database (238) in which a set of relationships between concepts and operations is stored.

[0091] According to one embodiment, the natural language generation module (232d) can convert specified information into text format. The information converted into text format may be in the form of natural language speech. According to one embodiment, the text-to-speech module (232e) can convert text-to-speech information into speech information.

[0092] According to one embodiment, some or all of the functions of the natural language platform (232) may also be implemented in the electronic device (210).

[0093] The capsule database (238) may store information on the relationships between multiple concepts and actions corresponding to multiple domains. According to one embodiment, a capsule may include multiple action objects (or action information) and concept objects (or concept information) included in a plan. According to one embodiment, the capsule database (238) may store multiple capsules in the form of a concept action network (CAN). According to one embodiment, the multiple capsules may be stored in a function registry included in the capsule database (238).

[0094] The capsule database (238) may include a strategy registry that stores strategy information necessary for determining a plan corresponding to a user input. The strategy information may include reference information for determining a single plan when there are multiple plans corresponding to a user input. According to one embodiment, the capsule database (238) may include a follow-up registry that stores information on follow-up actions for suggesting follow-up actions to a user in a given situation. The follow-up actions may include, for example, follow-up utterances. According to one embodiment, the capsule database (238) may include a layout registry that stores layout information of information output through the electronic device (210). According to one embodiment, the capsule database (238) may include a vocabulary registry that stores vocabulary information included in capsule information. According to one embodiment, the capsule database (238) may include a dialog registry that stores information on a dialogue (or interaction) with a user. The capsule database (238) can update stored objects through a developer tool. The developer tool may include, for example, a function editor for updating action objects or concept objects. The developer tool may include a vocabulary editor for updating vocabulary. The developer tool may include a strategy editor for creating and registering strategies that determine plans. The developer tool may include a dialog editor for creating conversations with users.The developer tool may include a follow-up editor that activates follow-up goals and allows editing of follow-up utterances that provide hints. The follow-up goals may be determined based on the currently set goals, user preferences, or environmental conditions. In one embodiment, the capsule database (238) may also be implemented within the electronic device (210).

[0095] In one embodiment, the execution engine (233) can use the generated plan to produce a result. The end user interface (234) can transmit the produced result to the electronic device (210). Accordingly, the electronic device (210) can receive the result and provide the received result to the user. In one embodiment, the management platform (235) can manage information used in the intelligent server (230). In one embodiment, the big data platform (236) can collect user data. In one embodiment, the analysis platform (237) can manage the quality of service (QoS) of the intelligent server (230). For example, the analysis platform (237) can manage the components and processing speed (or efficiency) of the intelligent server (230).

[0096] According to one embodiment, the service server (250) may provide a service (e.g., food ordering or hotel reservation) specified to the electronic device (210). According to one embodiment, the service server (250) may be a server operated by a third party. According to one embodiment, the service server (250) may provide information for generating a plan corresponding to the received voice input to the intelligent server (230). The provided information may be stored in the capsule database (238). In addition, the service server (250) may provide result information according to the plan to the intelligent server (230). The service server (250) may include a plurality of service providers (e.g., CP service A (251), CP service B (252), CP service C (253)), and each of the service providers (251, 252, 253) may provide a function for a domain associated with each capsule stored in the capsule database (238) of the intelligent server (230).

[0097] In the integrated intelligence system described above, the electronic device (210) can provide various intelligent services to the user in response to user input. The user input may include, for example, input via a physical button, touch input, or voice input.

[0098] According to one embodiment, the electronic device (210) may provide a voice recognition service through an intelligent app (or voice recognition app) stored within the device. In this case, for example, the electronic device (210) may recognize a user utterance or voice input received through the microphone (212) and provide the user with a service corresponding to the recognized voice input.

[0099] According to one embodiment, the electronic device (210) may perform a designated operation based on the received voice input, either alone or together with the intelligent server (230) and / or the service server (250). For example, the electronic device (210) may execute an app corresponding to the received voice input and perform a designated operation through the executed app.

[0100] According to one embodiment, when an electronic device (210) provides a service together with an intelligent server (230) and / or a service server (250), the electronic device (210) may detect a user's speech using the microphone (212) and generate a signal (or voice data) corresponding to the detected user's speech. The electronic device (210) may transmit the voice data to the intelligent server (230) via a network (240) using a communication interface (213).

[0101] In one embodiment, an intelligent server (230) may generate a plan for performing a task corresponding to a voice input received from an electronic device (210), or a result of performing an operation according to the plan, in response to the voice input. The plan may include, for example, a plurality of operations for performing a task corresponding to a user's voice input, and a plurality of concepts related to the plurality of operations. The concept may define parameters input to the execution of the plurality of operations, or result values ​​output by the execution of the plurality of operations. The plan may include association information between the plurality of operations and the plurality of concepts.

[0102] According to one embodiment, the electronic device (210) can receive the response using the communication interface (213). The electronic device (210) can output a voice signal generated within the electronic device (210) to the outside using the speaker (216), or can output an image generated within the electronic device (210) to the outside using the display module (211).

[0103] Although FIG. 2 illustrates an example in which voice recognition, natural language understanding and generation, and plan-based output operations of user input received from an electronic device (210) are performed on an intelligent server (230), the various embodiments of the present document are not limited thereto. For example, at least some components of the intelligent server (230) (e.g., natural language platform (232), execution engine (233), capsule database (238)) may be embedded in the electronic device (210) (or the electronic device (101) of FIG. 1), such that the operations may be performed by the electronic device (210).

[0104] Figure 3 is a drawing showing the form in which relationship information between concepts and operations according to various embodiments is stored in a database.

[0105] According to one embodiment, a capsule database (e.g., capsule database (238) of FIG. 2) of an intelligent server (e.g., intelligent server (230) of FIG. 2) may store capsules in the form of a CAN (concept action network) (300). The capsule database may store operations for processing tasks corresponding to a user's voice input and parameters necessary for the operations in the form of a CAN (concept action network).

[0106] According to one embodiment, the capsule database may store a plurality of capsules (capsule (A) (310), capsule (B) (320)) corresponding to each of a plurality of domains (e.g., applications). According to one embodiment, one capsule (e.g., capsule (A) (310)) may correspond to one domain (e.g., location (geo), application). In addition, one capsule may correspond to at least one service provider (e.g., CP 1 (331) or CP 2 (332)) for performing a function for a domain related to the capsule. According to one embodiment, one capsule may include at least one operation (350) and at least one concept (360) for performing a specified function.

[0107] In one embodiment, a natural language platform (e.g., the natural language platform (232) of FIG. 2) can generate a plan for performing a task corresponding to a received speech input using capsules stored in a capsule database. For example, a planner module of the natural language platform (e.g., the planner module (232c) of FIG. 2) can generate a plan using capsules stored in a capsule database. For example, a plan can be generated using actions (311, 313) and concepts (312, 314) of capsule A (310) and actions (321) and concepts (322) of capsule B (320).

[0108] FIG. 4 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0109] Referring to FIG. 4, an electronic device (101) according to one embodiment of the present disclosure may include a display (490) (e.g., the display module (160, 211) of FIG. 1 or 2), a memory (130) (e.g., the memory (130) of FIG. 1), a communication circuit (495) (e.g., the communication module (190) or the communication interface (213) of FIG. 1), and / or a processor (120) (e.g., the processor (120, 214) of FIG. 1 or 2). According to one embodiment, the electronic device (101) may include all or at least a part of the components of the electronic device (101, 210) described in the description with reference to FIG. 1 or 2. For example, in various embodiments of the present document, some of the illustrated components may be omitted or replaced. The electronic device (101) may include at least some of the configurations and / or functions of the electronic device (101) of FIG. 1 and / or the electronic device (210) of FIG. 2. At least some of the respective configurations of the illustrated (or not illustrated) electronic device (101) may be operatively, functionally, and / or electrically connected to each other.

[0110] According to one embodiment, the display (490) may include a configuration identical or similar to the display module (160, 211) of FIG. 1 or FIG. 2. According to one embodiment, the display (490) may display various images provided from the processor (120). According to one embodiment, the display (490) may visually provide, under the control of the processor (120), an application being executed (e.g., the application (146) of FIG. 1) and various screens related to its use (e.g., a contents screen, an application execution screen, a menu screen, and / or a function execution screen).

[0111] According to one embodiment, the display (490) may be combined with a touch sensor, a pressure sensor capable of measuring the intensity of a touch, and / or a touch panel (e.g., a digitizer) that detects a magnetic stylus pen. According to one embodiment, the display (490) may detect a touch input, an air gesture input, and / or a hovering input (or a proximity input) by measuring a change in a signal (e.g., voltage, light intensity, resistance, electromagnetic signal, and / or charge) for a specific location of the display (490) based on the touch sensor, the pressure sensor, and / or the touch panel. For example, the display (490) may include a touchscreen that detects a touch and / or a proximity touch (or a hovering) input using a part of a user's body (e.g., a finger) or an input device (e.g., a stylus pen). The display (490) may include at least some of the configuration and / or functions of the display module (160) of FIG. 1 and / or the display module (211) of FIG. 2.

[0112] In one embodiment, the display (490) may include, but is not limited to, a liquid crystal display (LCD), a light-emitting diode (LED), an organic light-emitting diode (OLED) display, and / or an active matrix OLED (AMOLED) display, a micro electro mechanical systems (MEMS) display, or an electronic paper display. In one embodiment, the display (490) may include a flexible display.

[0113] According to one embodiment, the memory (130) includes at least a portion of the configuration and / or function of the memory (130) of FIG. 1 and / or the memory (215) of FIG. 2, and may store software (e.g., the program (140) of FIG. 1). The memory (101) may store various applications (e.g., the application (146) of FIG. 1 or the plurality of apps (219a, 219b) of FIG. 2), and program modules supporting intelligent services (e.g., the client module (218) of FIG. 2).

[0114] According to one embodiment, the memory (130) may store various data used by at least one component (e.g., processor (120)) of the electronic device (101). In one embodiment, the data may include, for example, software (e.g., program (140) of FIG. 1), and input data or output data for commands related to the software.

[0115] According to one embodiment, the memory (130) may include volatile memory (e.g., volatile memory (132) of FIG. 1) or non-volatile memory (134) (e.g., non-volatile memory (134) of FIG. 1). According to one embodiment, the memory (130) may store instructions or data received from the processor (120) in the volatile memory (1320), and may store result data of instructions or data stored in the volatile memory (132) being processed by the processor (120) in the non-volatile memory (134).

[0116] In one embodiment, the data stored in the memory (130) may include data related to user information, data related to general information, learning data, data related to user context, and / or conversation data between users. In one embodiment, the data may include information related to various settings to support controlling an operation of providing recommended information (e.g., recommended answers) through artificial intelligence while the electronic device (101) is executing an interactive service.

[0117] In one embodiment, the data stored in the memory (130) may include various learning data and / or parameters acquired based on the user's learning through interaction with the user. In one embodiment, the data may include various schemas (or algorithms, models, networks, or functions) for supporting operations related to providing recommended information (e.g., recommended answers) through artificial intelligence while executing an interactive service.

[0118] In one embodiment, the fields in which artificial intelligence technology is applied may be diverse. For example, it may consist of technologies in the fields of linguistic understanding, visual understanding, inference / prediction, knowledge representation, and / or motion control. Linguistic understanding refers to technologies that recognize and apply / process human language / characters, and may include natural language processing, machine translation, conversational systems, question answering, and / or speech recognition / synthesis. Visual understanding refers to technologies that recognize and process objects similar to human vision, and may include object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and / or image enhancement. Inference / prediction refers to technologies that logically infer and predict by judging information, and may include knowledge / probability-based inference, optimized prediction, preference-based planning, and / or recommendation. Knowledge representation refers to technologies that automatically process human experience information into knowledge data, and may include knowledge construction (e.g., data generation / classification) and / or knowledge management (e.g., data utilization). Motion control is a technology for controlling the movement of an electronic device (101), and may include motion control and / or manipulation control (e.g., action control).

[0119] In one embodiment, a scheme for supporting operations related to the operation of an interactive service in an electronic device (101) may include a neural network. In one embodiment, the neural network may include a neural network model based on at least one of an artificial neural network (ANN), a convolution neural network (CNN), a region with convolution neural network (R-CNN), a region proposal network (RPN), a recurrent neural network (RNN), a stacking-based deep neural network (S-DNN), a state-space dynamic neural network (S-SDNN), a deconvolution network, a deep belief network (DBN), a restricted Boltzman machine (RBM), a long short-term memory (LSTM) network, a classification network, a plain residual network, a dense network, a hierarchical pyramid network, and / or a fully convolutional network. According to one embodiment, the type of the neural network model is not limited to the examples described above.

[0120] According to one embodiment, the memory (130) may store instructions that, when executed individually and / or collectively by the processor (120), cause the electronic device (101) to perform operations.

[0121] According to one embodiment, the memory (130) may store instructions that, when individually and / or collectively executed by the processor (120), cause the electronic device (101) to display an execution screen of an interactive service, detect a feature point from content input while performing the interactive service, determine relationship information with at least one counterpart user participating in the interactive service, determine an access level to user information based on the relationship information, acquire at least a portion of the user information and / or general information based on the access level, generate recommendation information related to the feature point based on the acquired information, and provide the recommendation information.

[0122] According to one embodiment, the instructions may be stored as software (e.g., program (140) of FIG. 1) on the memory (130) and executable by the processor (120). For example, the instructions may include control commands such as arithmetic and logical operations, data movement, and / or input / output that may be recognized by the processor (120). According to one embodiment, the software may include various applications (e.g., application (146) of FIG. 1) that may provide various functions (or services) (e.g., interactive service function, call function, message function, messenger function, e-mail function, social network service (SNS) function, search function, media playback function, game function, and / or wireless communication function) in the electronic device (101).

[0123] In one embodiment, the communication circuit (495) may support wireless communication with an external device using cellular wireless communication (e.g., 4G LTE, 5G NR) and / or short-range wireless communication (e.g., Wi-Fi). For example, the electronic device (101) may use the communication circuit (495) to communicate with an external server providing a voice assistant function over a network. In one embodiment, the communication circuit (495) may include at least a portion of the configuration and / or functions of the communication module (190) of FIG. 1 and / or the communication interface (213) of FIG. 2.

[0124] According to one embodiment, the processor (120) may perform an application layer processing function requested by a user of the electronic device (101). According to one embodiment, the processor (120) may provide control and commands of functions for various blocks of the electronic device (101). According to one embodiment, the processor (120) may perform operations or data processing related to control and / or communication of each component of the electronic device (101). For example, the processor (120) may include at least some of the configurations and / or functions of the processor (120) of FIG. 1. According to one embodiment, the processor (120) may be operatively connected to the components of the electronic device (101). According to one embodiment, the processor (120) may load commands or data received from other components of the electronic device (101) into the memory (130), process the commands or data stored in the memory (130), and store result data.

[0125] According to one embodiment, the processor (120) may include one or more processors including processing circuitry and / or executable program elements. According to one embodiment, the processor (120) may control (or process) the overall operation related to supporting the function of the electronic device (101) (e.g., the function of providing recommended information based on artificial intelligence (AI) when providing an interactive service) based on the processing circuitry and / or executable program elements.

[0126] According to one embodiment, the processor (120) may perform an operation of displaying an execution screen of an interactive service. According to one embodiment, the processor (120) may perform an operation of detecting a feature point from content input while performing the interactive service. According to one embodiment, the processor (120) may perform an operation of determining relationship information with at least one other user participating in the interactive service based on the feature point detection. According to one embodiment, the processor (120) may perform an operation of determining an access level to user information based on the relationship information. According to one embodiment, the processor (120) may perform an operation of acquiring at least a portion of the user information and / or general information based on the access level. According to one embodiment, the processor (120) may perform an operation of generating recommendation information related to the feature point based on the acquired information. According to one embodiment, the processor (120) may perform an operation of providing recommendation information.

[0127] According to one embodiment, the detailed operation of the processor (120) of the electronic device (101) is described with reference to the drawings described below.

[0128] According to one embodiment, the processor (120) may include an application processor (AP). For example, the processor (120) may be a system semiconductor that is responsible for various functions (e.g., calculation and multimedia driving functions) of the electronic device (101). According to one embodiment, the processor (120) may be configured in the form of a system-on-chip (SoC), and may include a technology-intensive semiconductor chip (e.g., an application processor) that integrates multiple semiconductor technologies into one and implements components (e.g., system blocks) into a single chip.

[0129] According to one embodiment, components (e.g., system blocks) of the processor (120) may include components such as a graphics processing unit (GPU) (410), an image signal processor (ISP) (420), a central processing unit (CPU) (430), a neural processing unit (NPU) (440), a digital signal processor (DSP) (450), a modem (460), connectivity (470), and / or security (480), as illustrated in FIG. 4. According to one embodiment, the processor (120) may operate individually and / or collectively.

[0130] In one embodiment, the GPU (410) may be responsible for graphics processing. In one embodiment, the GPU (410) may receive commands from the CPU (430) and perform graphics processing to express the shape, position, color, shading, movement, and / or texture of objects (or objects) on the display.

[0131] In one embodiment, the ISP (420) may be responsible for image processing and correction of images and videos. In one embodiment, the ISP (420) may correct raw data (e.g., raw data) transmitted from an image sensor of a camera (e.g., the camera module (180) of FIG. 1) to generate an image in a form more preferred by the user. In one embodiment, the ISP (420) may perform post-processing, such as adjusting partial brightness of an image and emphasizing detailed parts. For example, the ISP (420) may independently perform a process of tuning and correcting the image quality of an image acquired through a camera to generate a result preferred by the user.

[0132] According to one embodiment, the ISP (420) may support artificial intelligence (AI)-based image processing technology. According to one embodiment, the ISP (420) may support scene segmentation (e.g., image segmentation) technology that recognizes and / or classifies parts of a scene being captured in conjunction with the NPU (440). For example, the ISP (420) may include a function that applies different parameters to objects such as the sky, bushes, and / or skin and processes them. According to one embodiment, the ISP (420) may detect and display a human face during image capture using the AI ​​function, or adjust the brightness, focus, and / or color of the image using the coordinates and information of the face.

[0133] According to one embodiment, the CPU (430) may perform a role corresponding to the processor (120). According to one embodiment, the CPU (430) may decode a user's command, perform arithmetic and logical operations, and / or data processing. For example, the CPU (430) may be responsible for functions such as memory, interpretation, calculation, and control. According to one embodiment, the CPU (430) may control the overall function of the electronic device (101). For example, the CPU (430) may execute all software of the electronic device (101) (e.g., the application (146) of FIG. 1 and / or the plurality of apps (219a, 219b) of FIG. 2) on an operating system (OS) and control the hardware device. According to one embodiment, the CPU (430) may execute an application and control the overall operation of the processor (120) to perform neural network-based tasks required according to the execution of the application.

[0134] According to one embodiment, the CPU (430) may store instructions or data in volatile memory (e.g., volatile memory (132) of FIG. 1) of the memory (130), process the instructions or data stored in the volatile memory, and store resultant data in nonvolatile memory (e.g., nonvolatile memory (134) of FIG. 1) of the memory (130) as at least part of data processing or calculation.

[0135] According to one embodiment, the CPU (430) may include a single processor core or multiple processor cores (multi-core). According to one embodiment, the CPU (430) may be a programmable processor that stores executable instructions (e.g., instructions capable of performing operations of the CPU (430)) and executes the instructions.

[0136] In one embodiment, the CPU (430) can operate in a multi-domain environment. In one embodiment, the CPU (430) can operate in a multi-domain environment of a normal world (e.g., a non-secure world, a framework, or a non-secure environment) and a secure world (e.g., a secure framework or a secure environment). In one embodiment, the domain of the secure world can include one or more domains (e.g., a trusted OS, a trust zone, and / or a virtualization framework). In one embodiment, the CPU (430) can be shared between the multiple domains.

[0137] According to one embodiment, the NPU (440) may be responsible for processing optimized for artificial intelligence deep-learning algorithms. According to one embodiment, the NPU (440) is a processor optimized for deep-learning algorithm operations (e.g., artificial intelligence operations) and can process big data quickly and efficiently like a human neural network. For example, the NPU (440) may be mainly used for artificial intelligence operations. According to one embodiment, the NPU (440) may recognize objects, environments, and / or people in the background when taking a video through a camera and automatically adjust the focus, automatically switch the shooting mode of the camera module (180) to food mode when taking a picture of food, and / or be responsible for processing only the deletion of unnecessary subjects from the captured results.

[0138] According to one embodiment, the electronic device (101) can support integrated machine learning processing by interacting with all processors such as the GPU (410), the ISP (420), the CPU (430), and the NPU (440).

[0139] In one embodiment, the DSP (450) may represent an integrated circuit that facilitates rapid processing of digital signals. In one embodiment, the DSP (450) may perform the function of converting analog signals into digital signals and performing high-speed processing.

[0140] According to one embodiment, the modem (460) may perform a role that enables the use of various communication functions in the electronic device (101). For example, the modem (460) may support communications such as phone calls and data transmission and reception by exchanging signals with a base station. According to one embodiment, the modem (460) may include an integrated modem (e.g., a cellular modem, an LTE modem, a 5G modem, a 5G-Advanced modem, and a 6G modem) that supports communication technologies such as long term evolution (LTE) and 2G to 5G. According to one embodiment, the modem (460) may include an artificial intelligence modem that applies an artificial intelligence algorithm.

[0141] In one embodiment, the connectivity (470) may support wireless data transmission based on IEEE 802.11. In one embodiment, the connectivity (470) may support communication services based on IEEE 802.11 (e.g., Wi-Fi) and / or 802.15 (e.g., Bluetooth, ZigBee, UWB). For example, the connectivity (470) may support communication services targeting an unspecified number of people in a localized area, such as indoors, using an unlicensed band.

[0142] According to one embodiment, security (480) may provide an independent security execution environment between data or services stored in the electronic device (101). According to one embodiment, security (480) may play a role in preventing external hacking through software and hardware security during the process of user authentication when providing services such as biometrics, mobile identification, and / or payment of the electronic device (101). For example, security (480) may provide an independent security execution environment for device security for reinforcing the security of the electronic device (101) itself and for security services based on user information such as mobile identification, payment, and car keys in the electronic device (101).

[0143] According to one embodiment, the operations performed by the processor (120) may be implemented by executing instructions stored in a recording medium (or a computer program product or storage medium). For example, the recording medium may include a non-transitory computer-readable recording medium having recorded thereon a program for executing various operations performed by the processor (120).

[0144] The embodiments described in the present disclosure may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. In a hardware implementation, the operations described in one embodiment may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and / or other electrical units for performing functions.

[0145] In one embodiment, a computer-readable recording medium (or computer program product) is provided, which records a program for causing an electronic device (101) to perform (or execute) various operations.

[0146] The above operations may include an operation of displaying an execution screen of an interactive service, an operation of detecting a feature point from content input while performing the interactive service, an operation of determining relationship information with at least one counterpart user participating in the interactive service based on the feature point detection, an operation of determining an access level to user information based on the relationship information, an operation of obtaining at least a portion of user information and / or general information based on the access level, an operation of generating recommendation information related to the feature point based on the obtained information, and an operation of providing recommendation information.

[0147] An electronic device (101) according to one embodiment of the present disclosure may include a display (e.g., a display module (160, 211) of FIG. 1 or 2, or a display (490) of FIG. 4), a memory (e.g., a memory (130, 215) of FIG. 1, 2, or 4) for storing instructions (hereinafter, referred to as memory (130)), and processing circuitry, and may include at least one processor (e.g., a processor (120, 214) of FIG. 1, 2, or 4) (hereinafter, referred to as processor (120)) operatively connected to the display and the memory.

[0148] According to one embodiment, the memory (130) may store one or more computer programs (or instructions) that, when individually and / or collectively executed by at least one processor (120), cause the electronic device (101) to perform operations. In one embodiment, the one or more computer programs may include computer-executable instructions that, when individually or collectively executed by one or more processors, cause the electronic device (101) to:

[0149] According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to display an execution screen of an interactive service. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to detect a feature point from content input while performing the interactive service. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to determine relationship information with at least one other user participating in the interactive service. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to determine an access level to user information based on the relationship information. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to obtain at least a portion of the user information and / or general information based on the access level. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to generate recommendation information related to the feature point based on the acquired information. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to provide the recommendation information.

[0150] According to one embodiment, the interactive service may include a service that supports communication between users through an application for conversation between two or more remote parties (e.g., a messaging service, a chat service, a SNS, an e-mail service).

[0151] In one embodiment, the content may include text or images provided through a conversation field of the interactive service.

[0152] According to one embodiment, the feature points may include meaningful words and / or meaningful image objects that can be extracted from the content.

[0153] According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to display the content in a dialogue field while performing the interactive service. According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to detect the feature from the content displayed in the dialogue field. According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to execute an AI-based answer function based on detecting the feature. According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to generate the recommendation information based at least on the user information and the general information in the AI-based answer function.

[0154] According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to provide a notification object related to the artificial intelligence-based answer function in association with an input field of the interactive service based on the execution of the artificial intelligence-based answer function.

[0155] According to one embodiment, the notification object may include an object that indicates a status of whether the artificial intelligence-based answering function is operating and supports a toggle for activating or deactivating the artificial intelligence-based answering function.

[0156] According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to provide the recommendation information to an input field of the interactive service. According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to edit or transmit the recommendation information based on a user input while the recommendation information is provided through the input field.

[0157] According to one embodiment, the instructions, when executed individually and / or collectively by the at least one processor, may cause the electronic device to edit the recommendation information at least based on direct input by a user, changing the amount of information by adjusting the information disclosure step based on an adjustment object, or selecting sub-information from a list of sub-information that can replace the main information.

[0158] According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to transmit the recommendation information to an electronic device of a counterpart user based on a user input while the recommendation information is provided through the input field, and to provide the recommendation information through a conversation field of the interactive service.

[0159] According to one embodiment, the interactive service may be provided including a coordination object for information coordination.

[0160] According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to provide the recommendation information by changing it according to a step corresponding to the adjustment object based on a user input using the adjustment object.

[0161] According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to provide a portion of the recommendation information that is edited by the user and a portion that is automatically generated by artificial intelligence.

[0162] According to one embodiment, the instructions, when executed individually and / or collectively by the at least one processor, may cause the electronic device to provide a list of at least one sub-information associated with the feature point that is replaceable for the main information associated with the feature point while the recommendation information is provided through an input field.

[0163] According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to detect a user input for selecting sub-information from the list. According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to provide the main information by replacing it with the selected sub-information based on the user input.

[0164] According to one embodiment, the instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to provide the list between the input field and the keyboard area, or to provide the list in place of the keyboard area.

[0165] Hereinafter, the operating method of the electronic device (101) of various embodiments will be described in detail. Operations performed in the electronic device (101) according to various embodiments may be executed by a processor (120) including various processing circuitry and / or executable program elements of the electronic device (101). According to one embodiment, the operations performed in the electronic device (101) may be stored as instructions in a memory (130) and individually and / or collectively performed (or executed) by one or more processors (e.g., the processor (120) of FIG. 1).

[0166] FIG. 5 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.

[0167] According to one embodiment, FIG. 5 may illustrate an example of an operation of providing recommended information (e.g., recommended answers) through artificial intelligence (AI) while executing an interactive service in an electronic device (101) according to one embodiment.

[0168] An operation method supported by an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to a flowchart illustrated in FIG. 5. The flowchart illustrated in FIG. 5 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 501 to 513 may be performed by at least one processor (120) of the electronic device (101) (e.g., the processor (120, 214) of FIG. 1, FIG. 2, or FIG. 4).

[0169] As illustrated in FIG. 5, an operation method performed by an electronic device (101) according to an embodiment may include an operation of displaying an execution screen of an interactive service (operation 501), an operation of detecting a feature point from content input while performing an interactive service (operation 503), an operation of determining relationship information with at least one counterpart user participating in the interactive service based on the feature point detection (operation 505), an operation of determining an access level to user information based on the relationship information (operation 507), an operation of acquiring at least a portion of user information and / or general information based on the access level (operation 509), an operation of generating recommendation information related to the feature point based on the acquired information (operation 511), and an operation of providing recommendation information (operation 513).

[0170] Referring to FIG. 5, in operation 501, the processor (120) of the electronic device (101) may perform an operation of displaying an execution screen of an interactive service. According to one embodiment, the interactive service may include a service that supports communication between users through an application for conversation between two or more remote parties (e.g., an application that supports a service such as a message service, a chat service, an SNS, or an e-mail service). According to one embodiment, the processor (120) may execute an application based on a user input requesting execution of an application for the interactive service. According to one embodiment, the processor (120) may execute the application and provide an interactive service related to the application to the user. For example, the processor (120) may display an execution screen including a conversation field (or conversation window) (e.g., an execution screen of an interactive service (e.g., a chat screen, a mail screen, an SNS screen)) through a display (e.g., a display module (160) of FIG. 1).

[0171] In operation 503, the processor (120) may perform an operation of detecting a feature point from content input while performing an interactive service. According to one embodiment, the content may include text and / or images provided through a dialogue field of the interactive service. For example, the content may represent text and / or images input (or written or attached) by a user through an input field of the interactive service, input into the dialogue field of the interactive service (e.g., transmitted externally via a designated communication from an electronic device), and shared with at least one other user participating in the interactive service. According to one embodiment, the feature point may include meaningful words and / or meaningful image objects that can be extracted from the content. For example, the feature point may be divided into a feature word and a feature part. In one embodiment, the feature word may include a meaningful word and / or a user-specified word of interest determined based on word or context analysis within the content (e.g., a sentence). In one embodiment, the features may include various image objects (or image regions) (e.g., people, faces, animals, places, things) that can be extracted based on content analysis (e.g., image analysis, object recognition) within the content (e.g., image).

[0172] According to one embodiment, the processor (120) may detect features (e.g., feature words or feature parts) from the content of a dialogue field. For example, the processor (120) may detect feature words based on linguistic context analysis from the content of the dialogue field (e.g., text (e.g., sentences) or images of a user's previous utterance) upon activation of an input field (or selection of an input field by a user) while performing an interactive service, and / or may detect feature parts based on image analysis.

[0173] In operation 505, the processor (120) may perform an operation of determining relationship information with at least one counterpart user participating in the interactive service based on detecting a feature point. According to one embodiment, when a feature point is detected from content, the processor (120) may identify at least one counterpart user participating in the interactive service. For example, the processor (120) may identify an identifier (e.g., a name, a nickname, an ID, an email address, and / or a phone number) used by the counterpart user of the interactive service in the interactive service. According to one embodiment, the processor (120) may search for information (e.g., a name, a nickname, an ID, an email address, and / or a phone number) corresponding to (or mapped to) the identifier from information (e.g., contact information) stored (or registered) in the electronic device (101) (e.g., the memory (130) of FIG. 1) and / or a server (e.g., a user account-based cloud server).

[0174] According to one embodiment, the processor (120) may identify a first relationship (e.g., a family relationship, a friend relationship, a romantic relationship, a colleague relationship, a neighbor relationship, an SNS relationship, or a business relationship) and / or a second relationship (e.g., a dependent relationship such as a parent, sibling, grandparent, or relative among family relationships, or a dependent relationship such as a company, school, or club among colleague relationships) with the counterpart user participating in the interactive service based on the retrieved information. In one embodiment, the processor (120) may identify a relationship with the counterpart user as having no relationship (e.g., no relationship) if no information related to the counterpart user is retrieved from the pre-stored information. In one embodiment, the pre-stored information may include information stored in the memory (130) of the electronic device (101) and / or stored externally (e.g., a cloud server, an account server, a social network service) of the electronic device (101). For example, the pre-stored information may include phone book information, account information, and / or SNS information obtainable from the electronic device (101) and / or externally.

[0175] According to one embodiment, when a relationship with a counterpart user is identified, the processor (120) may determine intimacy based on the identified relationship. In one embodiment, intimacy may be classified as, for example, high, medium, or low depending on the relationship with the user. In one embodiment, the classification of relationships is exemplary and is not limited thereto, and may be set in various ways, such as more detailed stages (e.g., four or more stages) or expanded stages (e.g., two stages). In one embodiment, the processor (120) may not perform an intimacy determination operation. According to one embodiment, when a relationship with a counterpart user is identified, the processor (120) may operate to immediately determine an access level based on the identified relationship (e.g., relationship information). For example, if the relationship with the counterpart user is family, the processor (120) may allow access to all personal information. For example, if the relationship with the counterpart user is coworker, the processor (120) may block (or not allow) access to specified information (e.g., gallery information).

[0176] According to one embodiment, the processor (120) may determine whether the intimacy with the other user is high, medium, or low based on the identified relationship. According to one embodiment, the processor (120) may determine relationship information with the other user based on the relationship and intimacy. In one embodiment, the relationship information may be classified into high, medium, and low. In one embodiment, the classification of the relationship information is exemplary and is not limited thereto, and may be variously set, such as more detailed stages (e.g., very high, high, medium, low, very low, none). For example, the processor (120) may determine the relationship information as 'high' if the relationship is a first family (e.g., parent or sibling) and the intimacy is 'high'. For example, the processor (120) may determine the relationship information as 'medium' if the relationship is a second family (e.g., relative) and the intimacy is 'medium'. For example, the processor (120) may determine the relationship information as 'medium' if the relationship is a coworker relationship and the intimacy is 'high'. For example, the processor (120) may determine the relationship information as 'low' if it is a peer relationship and the intimacy is 'medium' or lower.

[0177] In operation 507, the processor (120) may perform an operation of determining an access level to user information based on relationship information. In one embodiment, the operation of determining the access level may include an operation of distinguishing an access level in the processor (120). The present disclosure is not limited thereto, and the operation of determining the access level may include, for example, determining the degree of access to user information based on a relationship with the user (e.g., family, relatives, friends, or colleagues). In one embodiment, the access level may include the degree of authority (or permission) to access user information for composing recommendation information, and may be distinguished as, for example, high (e.g., access level = 1), medium (e.g., access level = 2), and low (e.g., access level = 3). In one embodiment, the distinction of the access level is exemplary and is not limited thereto, and may be set in various ways, such as in more detailed steps.

[0178] According to one embodiment, the processor (120) may determine the access level to user information as "high" when the relationship information is "high." In one embodiment, even when the relationship information is "high," access to user-specified excluded user information (e.g., categories of user information) may not be permitted. According to one embodiment, the processor (120) may determine the access level to user information as "medium" when the relationship information is "medium." According to one embodiment, the processor (120) may determine the access level to user information as "low" when the relationship information is "low."

[0179] According to one embodiment, even if the processor (120) has the same relationship information, if the user has set the provision of user information (e.g., personal information) differently, the processor (120) can determine different access levels based on the user settings. For example, the user can change the settings to provide different personal information even for the same relationship. For example, for a first user, a second user, and a third user in the same friendship relationship, the first user can be set to have access to all photos in the gallery, the second user can be set to have access only to a specified folder in the gallery, and the third user can be set to have no access to the gallery. According to one embodiment, the settings for relationship information can be added, modified (or changed), or deleted by the user.

[0180] In operation 509, the processor (120) may perform an operation to obtain at least a portion of the user information and / or general information based on the access level.

[0181] In one embodiment, the user information may include various information associated with the feature point and stored in the electronic device (101) and / or externally (e.g., a cloud server) that is related to (or associated with) the user of the electronic device (101). For example, the processor (120) may extract user information associated with the feature point from among related information directly used by the user (e.g., information directly related to the user), such as various operations (or actions) performed by the user through the electronic device (101) (e.g., payment, location movement, media playback, media download, recording, web surfing, SNS use, messenger use, taking pictures, visiting places, writing notes, taking pictures / videos, and / or writing messages) and / or settings made by the user (e.g., account settings, mobile ID settings). In one embodiment, the user information may include sensitive information and personal information. The sensitive information may be stored, for example, in the electronic device (101) and / or externally (e.g., a cloud server). Sensitive information may include, for example, content information regarding content (e.g., photos / videos captured by a camera application, memo content created by a document application, and / or recording content recorded by a recording application), financial information related to the user's financial use, and / or payment information related to the user's payment use. Personal information may be stored, for example, on the electronic device (101) and / or externally (e.g., on a cloud server).Personal information may include, for example, account information, mobile ID information, financial information, location information, health information, social networking service information, conversation history information, internet usage history information, music application-related information (e.g., downloaded music, recently played music, user-customized (e.g., frequently played by the user) music), geographic location information, movement path information based on location movement over a specified period (e.g., a day, a week, or a month), and visit information (e.g., information obtained based on specified locations tagged in a map application).

[0182] In one embodiment, sensitive information and personal information may be classified for convenience of explanation, and may be managed as user information without classification into sensitive information and personal information. In one embodiment, user information, sensitive information, and / or personal information may be classified in advance by the electronic device (101) and / or an external source (e.g., a cloud server) and stored in the electronic device (101) and / or externally. In one embodiment, user information, sensitive information, and / or personal information may be classified by the user of the electronic device (101) and stored in the electronic device (101) and / or externally.

[0183] In one embodiment, the general information may include information (e.g., generally available information) that is associated with the feature point and can be retrieved externally (e.g., via a web server (or internet server), a social network service, and / or a broadcast service). For example, assuming that the feature point is a feature word related to “place” (e.g., Seoul, the United States, department store A, train station B), the personal information may include information that is accessible based on the access level, and may include data searched (e.g., Seoul search), visited (e.g., Seoul visit history, location, and / or date), photographed (e.g., photographed in Seoul), used (e.g., payment), and / or written (e.g., Seoul entered in a chat room) in association with the place (e.g., Seoul) from user information of the electronic device (101) and / or an external server (e.g., a cloud server). For example, assuming that the feature point is a feature word related to “place,” the general information may include a search result for the place (e.g., Seoul) externally (e.g., a web server, a social network service, and / or a broadcast service). For example, general information may be publicly available for external search and may include common information associated with a location (e.g., Seoul) that all users can access and search (or recognize).

[0184] In one embodiment, the processor (120) may access most of the user information to collect (or extract) data for recommendation information based on determining the access level to the user information as 'high'. In one embodiment, even when the access level is 'high', access to user-specified excluded user information (e.g., categories of user information) may not be permitted. In one embodiment, the processor (120) may access a portion of the user information (e.g., categories of specified user information) to collect (or extract) data for recommendation information based on determining the access level to the user information as 'medium'. In one embodiment, the processor (120) may restrict (or not permit) access to the user information based on determining the access level to the user information as 'low'.

[0185] According to one embodiment, the processor (120) may collect general information along with user information collection based on access level. According to one embodiment, the processor (120) may operate to search for information related to the feature point through the electronic device (101) and / or an external server (e.g., a cloud server, an internet server). For example, the processor (120) may collect data related to the feature point (e.g., location data, time data, dictionary data) from various data stored in the electronic device (101). For example, the processor (120) may provide the feature point (or information related to the feature point) to an external server, request the external server to search for data related to the feature point, and receive the search data searched by the external server. According to one embodiment, the processor (120) may also operate to acquire the general information through AI. For example, the general information may be searched, extracted, and / or collected by the AI ​​and provided to the processor (120).

[0186] According to one embodiment, the order of operations 503 to 509 is not limited to the order shown, and the order of operations 503 to 509 may be changed. For example, operations 503 to 509 may be performed sequentially, in parallel, in reverse sequence, iteratively, or heuristically, or one or more of operations 503 to 509 may be performed in a different order, omitted, or one or more other operations may be added.

[0187] In operation 511, the processor (120) may perform an operation of generating (e.g., inferring) recommendation information related to a feature point based on acquired information (e.g., user information and / or general information). According to one embodiment, the processor (120) may generate recommendation information having a linguistic context based on data collected from at least a portion of the user information (e.g., first data) and / or data collected from the general information (e.g., second data) through AI. According to one embodiment, the processor (120) (or AI) may generate recommendation information through linguistic context analysis from the given data. In one embodiment, the linguistic context analysis may include, for example, an analysis that takes into account the communication situation and the content of preceding and following utterances surrounding a certain utterance (e.g., feature point).

[0188] In operation 513, the processor (120) may perform an operation for providing recommendation information. According to one embodiment, the processor (120) may display the recommendation information through an input field of an interactive service. According to one embodiment, the user may input the recommendation information provided through the input field by sending (or sharing) the recommendation information, or may input the recommendation information provided through the input field by editing (or processing) the recommendation information and then sending the edited recommendation information.

[0189] FIGS. 6A, 6B, and 6C are diagrams illustrating examples of providing interactive services in an electronic device according to one embodiment of the present disclosure.

[0190] According to one embodiment, FIGS. 6A, 6B, and 6C may illustrate examples of conversation screens in which an interactive service is performed between a user (e.g., user B) and a counterpart user (e.g., user A).

[0191] Referring to FIG. 6A, FIG. 6A may illustrate an example of an execution screen (e.g., a user interface) of an interactive service. As illustrated in FIG. 6A, the execution screen may include a first area for an input field (610), a second area for a dialogue field (620), and a third area for a keyboard (630) (or keypad). According to one embodiment, the first area may include a transmission button (640) for sharing content (e.g., text and / or images) input through the input field (610) with a counterpart user (e.g., transmitting it to an electronic device of the counterpart user) and displaying it in the dialogue field (620). According to one embodiment, the third area for the keyboard (630) may be provided by being activated (e.g., sliding in from a lower area) based on a first user input (e.g., a touch) based on the input field (610). According to one embodiment, in FIG. 6A, first content (601) (e.g., text in a conversation bubble) shared by a counterpart user (e.g., user A) and second content (603) (e.g., text in a conversation bubble) shared by a user (e.g., user B) may be displayed through a conversation field (620).

[0192] Referring to FIG. 6B, FIG. 6B may illustrate an example of providing recommendation information (660) generated based on AI based on content (e.g., second content (603)). According to one embodiment, the content may include text and / or images provided through a dialogue field (620) of an interactive service. For example, the content may indicate text and / or images inputted (or written or attached) by a user through an input field (610) of the interactive service into the dialogue field (620) of the interactive service (e.g., transmitted externally through a designated communication from an electronic device (101)) and shared with at least one other user participating in the interactive service.

[0193] According to one embodiment, the electronic device (101) may generate recommendation information (660) through AI based on content (e.g., second content (603)) entered in the dialogue field (620), and provide the generated recommendation information (660) through the input field (610).

[0194] According to one embodiment, the electronic device (101) can detect features from the second content (603) through AI. In one embodiment, the features in FIG. 6B may include features (e.g., meaningful words and / or user-defined words of interest) analyzed based on word or context analysis within the second content (603). For example, in FIG. 6B , the features may be 'Gwanggyo' indicating a place and 'shopping' indicating an activity. In one embodiment, if the second content (603) includes words indicating a date and / or time, the features may further include the date and / or time.

[0195] According to one embodiment, the electronic device (101) can detect feature words (e.g., 'Gwanggyo' and 'shopping') based on linguistic context analysis from content (e.g., second content (603)) input by a user (e.g., a user of the electronic device (101)) in a dialogue field (620) upon activation of the input field (610) (or selection of the input field (610) by the user) while performing an interactive service (e.g., text (or sentence) of the user's previous utterance (e.g., 'Shall we go shopping in Gwanggyo together?').

[0196] According to one embodiment, when the electronic device (101) detects a characteristic word in the second content (603) of the dialogue field (620), it may determine to enter (or execute) the AI-based answer mode (or AI-based answer function). According to one embodiment, the electronic device (101) may provide a notification object (650) related to the AI-based answer mode based on the execution (or entry) of the AI-based answer mode. In one embodiment, the notification object (650) may be an object indicating a status regarding whether the AI-based answer mode is operating (or executing). In one embodiment, the notification object (650) may support a toggle for activating or deactivating the AI-based answer mode. In one embodiment, the notification object (650) may be provided in association with the input field (610). For example, the electronic device (101) may provide the notification object (650) in association with the input field (610) of the conversational service based on the execution of the AI-based answer mode. Various examples of notification objects (650) being provided are described below with reference to the drawings.

[0197] According to one embodiment, the electronic device (101) may perform an operation related to generating AI-based recommendation information (660) based at least on user information and / or general information through AI in an AI-based answer mode. According to one embodiment, when the electronic device (101) detects a characteristic word in the second content (603) of the conversation field (620), the electronic device (101) may determine relationship information between the user and the other user participating in the interactive service (e.g., user A). According to one embodiment, the electronic device (101) may determine relationship information based on the relationship and intimacy between the user and the other user.

[0198] In one embodiment, the electronic device (101) may determine an access level to user information based on relationship information. In one embodiment, the access level may include the degree of authority (or permission) to access user information for composing recommendation information (660).

[0199] According to one embodiment, the electronic device (101) may collect data related to the characteristic word (e.g., data for composing the recommendation information (660)) from accessible user information (e.g., source information, e.g., conversation history with the other user, other applications used in conversation with the other user, photos taken with the other user, places visited with the other user, and / or personal information of the user, for composing the recommendation information in association with the characteristic word and the other user in conversation) and general information inside or outside the electronic device (101). For example, the electronic device (101) may collect first data related to feature words (e.g., 'Gwanggyo' and 'shopping') from user information through AI (e.g., data related to actions the user took in Gwanggyo (e.g., shopping, eating, visiting places (e.g., shopping mall A), taking pictures, and / or making payments)), and second data related to feature words (e.g., 'Gwanggyo' and 'shopping') from general information (e.g., data related to hot places located in Gwanggyo (e.g., restaurants, shopping mall B)).

[0200] According to one embodiment, the electronic device (101) may generate (e.g., infer) recommendation information (660) related to feature words (e.g., 'Gwanggyo' and 'shopping') based on a combination of collected data (e.g., first data and second data) through AI. According to one embodiment, the electronic device (101) may generate recommendation information (660) having a linguistic context based on the first data and the second data through AI. According to one embodiment, the electronic device (101) (or AI) may generate recommendation information (660) through linguistic context analysis from given data. In one embodiment, the linguistic context analysis may include, for example, an analysis that takes into account the communication situation and the content of the preceding and following utterances surrounding a certain utterance (e.g., feature word). For example, the electronic device (101) may generate recommendation information (660) by saying, 'I recently went to Gwanggyo A Shopping Mall, and it was good for shopping because there were many clothing stores. By constructing preceding and following utterances surrounding characteristic words (e.g., 'Gwanggyo' and 'shopping'), we can generate recommendation information (660) with linguistic context, such as 'I heard that the newly opened B shopping mall in Gwanggyo has a lot of desserts and good restaurants.'

[0201] According to one embodiment, the electronic device (101) can provide (e.g., display) recommendation information (660) generated through AI through an input field (610). According to one embodiment, the user can input the recommendation information (660) provided through the input field (610) into the dialogue field (620) by transmitting (or sharing) it through a transmission button (640). According to one embodiment, the user can edit (or process) the recommendation information (660) provided through the input field (610) through user input and then input it into the dialogue field (620) by transmitting it through a transmission button (640). Various examples of editing the recommendation information (660) will be described with reference to the drawings described below.

[0202] Referring to FIG. 6C, FIG. 6C may illustrate an example of providing recommendation information (670) through a dialogue field (620) of an interactive service. According to one embodiment, when a transmission request (e.g., selection of a transmission button (640)) is made by a user for recommendation information (660) provided through an input field (610) as in FIG. 6B, the electronic device (101) may transmit the recommendation information (660) to an external device (e.g., an electronic device of a counterpart user) through a designated communication, and provide the transmitted recommendation information (670) through the dialogue field (620). According to one embodiment, based on transmitting the recommendation information (660) of the input field (610), the electronic device (101) may remove (or not display) the recommendation information (660) of the input field (610) and display the transmitted recommendation information (670) through the dialogue field (620). According to one embodiment, when the electronic device (101) removes the recommendation information (660) upon transmission of the recommendation information (660), the electronic device (101) may remove and not display the notification object (650) provided in association with the input field (610).

[0203] FIGS. 7A, 7B, and 7C are diagrams illustrating various examples of a user interface for supporting an interactive service in an electronic device according to one embodiment of the present disclosure.

[0204] According to one embodiment, FIGS. 7A, 7B and 7C may illustrate various examples of an interface that provides an input field (610), a send button (640) and a notification object (650) in an area for the input field (610).

[0205] Referring to FIG. 7A, FIG. 7A may illustrate an example in which a transmission button (640) and a notification object (650) are positioned outside an input field (610). For example, in an area for an input field (610), the input field (610) may be positioned to the left, and the transmission button (640) and the notification object (650) may be positioned adjacent to the right side of the input field (610). According to one embodiment, the transmission object (640) may be fixedly positioned at the lower right side of the input field (640), and the notification object (650) may be fixedly positioned at the upper right side of the input field (650). According to one embodiment, the size (e.g., height) of the input field (650) may be variable (e.g., the size of the area of ​​the dialogue field (620) may be reduced while the size of the area of ​​the input field (610) may be increased) depending on the amount of information of the recommended information. According to one embodiment, the position of the notification object (650) may vary depending on the size change of the input field (610) (e.g., the position may move up and down depending on the increase or decrease in the size of the input field (610).

[0206] Referring to FIG. 7B, FIG. 7B may illustrate an example in which a transmission button (640) and a notification object (650) are positioned within an input field (610). For example, the input field (610) may be positioned to occupy the entire area in the area for the input field (610), and the transmission button (640) and the notification object (650) may be positioned offset to the right side of the inside of the input field (610). According to one embodiment, the transmission object (640) may be fixedly positioned at the lower right within the input field (640), and the notification object (650) may be fixedly positioned at the upper right within the input field (650). According to one embodiment, the position of the notification object (650) may vary (e.g., the position may move up and down depending on the increase or decrease in the size of the input field (610)) depending on the change in the size of the input field (610).

[0207] Referring to FIG. 7C, FIG. 7C may illustrate an example in which a transmission button (640) and a notification object (650) are positioned outside of an input field (610). For example, in an area for an input field (610), the input field (610) may be positioned offset to the upper side, and the transmission button (640) and the notification object (650) may be positioned adjacent to the lower side of the input field (610). According to one embodiment, the transmission object (640) may be positioned offset to the lower right side of the input field (640) and fixed, and the notification object (650) may be positioned offset to the lower left side of the input field (650). According to one embodiment, the size (e.g., height) of the input field (650) may be variable (e.g., the size of the area of ​​the dialogue field (620) may be increased while the size of the area of ​​the input field (610) is decreased) depending on the amount of information of the recommended information. According to one embodiment, the transmission object (640) and the notification object (650) may have fixed positions regardless of the size variation of the input field (610).

[0208] FIGS. 8A, 8B, and 8C are diagrams illustrating various examples of a user interface for supporting an interactive service in an electronic device according to one embodiment of the present disclosure.

[0209] According to one embodiment, FIGS. 8A, 8B, and 8C may illustrate various examples of interfaces for indicating the status of an AI-based answer mode (or AI-based answer function).

[0210] Referring to FIG. 8A, FIG. 8A may illustrate an example of providing a notification object (810) as a floating icon, indicating that AI is assisting with a response (e.g., recommended information). For example, the notification object (810) may be provided in a floating form over an input field (610).

[0211] Referring to FIG. 8B, FIG. 8B may illustrate an example of providing status notifications through color changes of letters and / or backgrounds of an input field (610), in addition to a notification object (810) capable of indicating that AI is assisting with an answer (e.g., recommendation information). For example, the background of the input field (610) may be changed from a designated first color (e.g., white background) to a designated second color (e.g., green background, yellow background, or sky blue background), thereby providing the operational status of the AI-based recommendation mode with a visual effect according to the color change.

[0212] Referring to FIG. 8C, FIG. 8C may illustrate an example of providing status notification through a cursor (850) within an input field (610), in addition to a notification object (650) capable of indicating that AI is assisting with an answer (e.g., recommendation information). For example, the shape of the cursor provided within the input field (610) may be changed from a designated first cursor (e.g., a bar-shaped cursor) to a designated second cursor (e.g., a lollipop-shaped cursor including an AI logo), thereby providing an operational status of an AI-based recommendation mode as a visual effect according to the cursor change.

[0213] FIGS. 9A and 9B are diagrams illustrating examples of providing interactive services in an electronic device according to one embodiment of the present disclosure.

[0214] According to one embodiment, FIGS. 9A and 9B may illustrate examples of supporting activation / deactivation (or on / off) of a recommendation function in an AI-based recommendation mode.

[0215] Referring to FIG. 9A, FIG. 9A may illustrate an example of a state in which a function is activated (or turned on) to display recommendation information generated in an AI-based recommendation mode. For example, FIG. 9A may illustrate an example of a state in which recommendation information (950) is displayed in an input field (610) according to a state in which a function is activated (e.g., an “ON” button of a notification object (650) is activated) to display recommendation information (950) in an AI-based recommendation mode.

[0216] Referring to FIG. 9B, FIG. 9B may illustrate an example of a state in which a function is disabled (or turned off) so as not to display recommendation information generated in an AI-based recommendation mode. For example, FIG. 9B may illustrate an example in which recommendation information is not displayed in an input field (610) according to a state in which a function is disabled (e.g., by activating the “OFF” button of a notification object (650)) so as not to display recommendation information (950) in an AI-based recommendation mode.

[0217] According to one embodiment, a user can display or not display recommendation information (950) by toggling the display function based on the notification object (650) in the AI-based recommendation mode. According to one embodiment, the disabled state of the display function is for toggling whether to display the recommendation information, and the running state of the AI-based recommendation mode can be maintained. According to one embodiment, the AI-based recommendation mode can be disabled (or turned off) using the notification object (650), and when the AI-based recommendation mode is disabled, the notification object (650) can be removed (e.g., not displayed).

[0218] FIG. 10 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.

[0219] According to one embodiment, FIG. 10 may illustrate an example of an operation of providing recommended information (e.g., recommended answers) through artificial intelligence while executing an interactive service in an electronic device (101) according to one embodiment.

[0220] An operation method supported by an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to a flowchart illustrated in FIG. 10. The flowchart illustrated in FIG. 10 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 1001 to 1017 may be performed by at least one processor of the electronic device (101) (e.g., the processor (120, 214) of FIG. 1, FIG. 2, or FIG. 4).

[0221] According to one embodiment, the operations described in FIG. 10 may be heuristically performed in combination with the operations described in FIGS. 5 to 9B, for example, or heuristically performed as a replacement for at least some of the operations described and combined with at least some other operations, or heuristically performed as a detailed operation of at least some of the operations described.

[0222] As illustrated in FIG. 10, an operation method performed by an electronic device (101) according to an embodiment may include an operation of detecting a user input based on an input field of an interactive service (operation 1001), an operation of detecting a feature point from the content of a dialogue field of an interactive service (operation 1003), an operation of executing an AI-based recommendation mode based on the feature point detection (operation 1005), an operation of identifying a counterpart user (operation 1007), an operation of determining relationship information (operation 1009), an operation of determining an access level for accessing user information based on the relationship information (operation 1011), an operation of collecting data for recommendation information related to the feature point from user information and / or general information according to the access level (operation 1013), an operation of generating recommendation information based on linguistic context analysis including the feature point and data (operation 1015), and an operation of providing recommendation information based on the input field (operation 1017).

[0223] Referring to FIG. 10, in operation 1001, the processor (120) of the electronic device (101) may perform an operation of detecting a user input based on an input field of an interactive service. According to one embodiment, the processor (120) may detect a user input of selecting (or touching) an input field while performing the interactive service. According to one embodiment, the processor (120) may call up a keyboard based on detecting a user input based on the input field and provide the keyboard by placing it at the bottom of the input field. According to one embodiment, when the input means for user speech in the interactive service is voice input-based rather than keyboard input-based, the keyboard may not be provided, and an operation may be performed to turn on a microphone to receive a voice input according to the user speech.

[0224] In operation 1003, the processor (120) may perform an operation of detecting a feature point from the content of a dialogue field of an interactive service. According to one embodiment, the processor (120) may detect a feature point (e.g., a feature word or a feature part) from the content of the dialogue field. For example, the processor (120) may detect a feature word based on linguistic context analysis from the content of the dialogue field (e.g., a text (e.g., a sentence) or an image of a user's previous utterance) when an input field is activated (or an input field is selected by a user) while performing an interactive service, and / or may detect a feature part based on image analysis.

[0225] In operation 1005, the processor (120) may perform an operation of executing an AI-based recommendation mode based on feature point detection. According to one embodiment, if at least one feature point is detected from the content of the dialogue field, the processor (120) may determine to execute an AI-based recommendation mode that assists (e.g., automatically generates and recommends) an answer through AI, and may enter the AI-based recommendation mode. According to one embodiment, when entering the AI-based recommendation mode, the processor (120) may provide a notification object associated with the input field. According to one embodiment, if at least one feature point is not detected from the content of the dialogue field, the processor (120) may not execute the AI-based recommendation mode.

[0226] In operation 1007, the processor (120) may perform an operation for identifying a counterpart user. According to one embodiment, in an AI-based recommendation mode, the processor (120) may identify at least one counterpart user participating in the interactive service through AI. For example, the processor (120) may identify an identifier (e.g., name, nickname, ID, email address, and / or phone number) used by the counterpart user of the interactive service in the interactive service.

[0227] In operation 1009, the processor (120) may perform an operation of determining relationship information. According to one embodiment, the processor (120) may search for information (e.g., name, nickname, ID, email address, and / or phone number) corresponding to (or mapped to) the identifier from information (e.g., contact information) stored (or registered) in the electronic device (101) (e.g., memory (130) of FIG. 1) and / or a server (e.g., a user account-based cloud server) based on the identification of the other user.

[0228] According to one embodiment, the processor (120) may identify a first relationship with a counterpart user participating in an interactive service based on the retrieved information. In one embodiment, if information related to the counterpart user is not retrieved from the pre-stored information, the processor (120) may identify the relationship with the counterpart user as having no relationship (e.g., relationship 'no'). According to one embodiment, the processor (120) may determine the degree of intimacy related to the counterpart user based on the identified relationship. In one embodiment, the pre-stored information may include information stored in the memory (130) of the electronic device (101) and / or stored externally (e.g., a cloud server, an account server, a social network service) of the electronic device (101). For example, the pre-stored information may include phonebook information, account information, and / or SNS information obtainable from the electronic device (101) and / or externally.

[0229] According to one embodiment, the processor (120) may determine relationship information with the other user based on the relationship and intimacy. In one embodiment, the relationship information may be classified as high, medium, and low. In one embodiment, the classification of the relationship information is exemplary and is not limited thereto, and may be set in various ways, such as more detailed stages (e.g., very high, high, medium, low, very low, none). For example, the processor (120) may determine the relationship information as "high" if the relationship is between a first family member (e.g., parents or siblings) and the intimacy is "high." For example, the processor (120) may determine the relationship information as "medium" if the relationship is between a second family member (e.g., relatives) and the intimacy is "medium." For example, the processor (120) may determine the relationship information as "medium" if the relationship is between colleagues and the intimacy is "high." For example, the processor (120) may determine the relationship information as "low" if the relationship is between colleagues and the intimacy is "medium" or lower. In one embodiment, the processor (120) may not perform an intimacy determination operation. In another embodiment, once a relationship with a user is identified, the processor (120) may operate to immediately determine the level of access based on the identified relationship (e.g., relationship information). For example, if the relationship with the user is family, the processor (120) may allow access to all personal information. For example, if the relationship with the user is a colleague, the processor (120) may prevent (or not allow) access to specified information (e.g., gallery information).

[0230] According to one embodiment, the order of operations 1003 to 1009 is not limited to the order shown, and the order of operations 1003 to 1009 may be changed. For example, operations 1003 to 1009 may be executed sequentially, in parallel, in reverse sequence, iteratively, or heuristically, or one or more of operations 1003 to 1009 may be executed in a different order, omitted, or one or more other operations may be added.

[0231] In operation 1011, the processor (120) may perform an operation of determining an access level for accessing user information based on relationship information. In one embodiment, the operation of determining the access level may include an operation of distinguishing an access level in the processor (120). The present disclosure is not limited thereto, and the operation of determining the access level may include, for example, determining the degree of access to user information based on a relationship with the user (e.g., family, relatives, friends, or colleagues). In one embodiment, the access level may include the degree of authority (or permission) to access user information for composing recommendation information. According to one embodiment, the processor (120) may determine the access level to user information as 'high' when the relationship information is 'high'. In one embodiment, even when the relationship information is 'high', access to user-specified excluded user information (e.g., a category of user information) may not be permitted. According to one embodiment, the processor (120) may determine the access level to user information as 'medium' when the relationship information is 'medium'. According to one embodiment, the processor (120) may determine the access level to user information as 'low' when the relationship information is 'low'.

[0232] According to one embodiment, even if the processor (120) has the same relationship information, if the user has set the provision of user information (e.g., personal information) differently, the processor (120) can determine different access levels based on the user settings. For example, the user can change the settings to provide different personal information even for the same relationship. For example, for a first user, a second user, and a third user in the same friendship relationship, the first user can be set to have access to all photos in the gallery, the second user can be set to have access only to a specified folder in the gallery, and the third user can be set to have no access to the gallery. According to one embodiment, the settings for relationship information can be added, modified (or changed), or deleted by the user.

[0233] In operation 1013, the processor (120) may perform an operation of collecting data for recommendation information related to feature points from user information and / or general information according to an access level.

[0234] In one embodiment, the user information may include various information stored in the electronic device (101) and / or externally (e.g., a cloud server) that is associated with the feature point and is related to (or associated with) the user of the electronic device (101). For example, the processor (120) may extract user information associated with the feature point from among related information directly used by the user (e.g., information directly related to the user), such as various operations (or actions) performed by the user through the electronic device (101) (e.g., payment, location movement, media playback, media download, recording, web surfing, SNS use, messenger use, taking pictures, visiting places, writing notes, taking pictures / videos, and / or writing messages) and / or settings made by the user (e.g., account settings, mobile ID settings). In one embodiment, the user information may include sensitive information and personal information. The sensitive information may be stored, for example, in the electronic device (101) and / or externally (e.g., a cloud server). Sensitive information may include, for example, content information regarding content (e.g., photos / videos captured by a camera application, memo content created by a document application, and / or recording content recorded by a recording application), financial information related to the user's financial use, and / or payment information related to the user's payment use. Personal information may be stored, for example, on the electronic device (101) and / or externally (e.g., on a cloud server).Personal information may include, for example, account information, mobile ID information, financial information, location information, health information, social networking service information, conversation history information, internet usage history information, music application-related information (e.g., downloaded music, recently played music, user-customized (e.g., frequently played by the user) music), geographic location information, movement path information based on location movement over a specified period (e.g., a day, a week, or a month), and visit information (e.g., information obtained based on specified locations tagged in a map application).

[0235] In one embodiment, sensitive information and personal information may be classified for convenience of explanation, and may be managed as user information without classification into sensitive information and personal information. In one embodiment, user information, sensitive information, and / or personal information may be classified in advance by the electronic device (101) and / or an external source (e.g., a cloud server) and stored in the electronic device (101) and / or externally. In one embodiment, user information, sensitive information, and / or personal information may be classified by the user of the electronic device (101) and stored in the electronic device (101) and / or externally.

[0236] In one embodiment, the general information may include information (e.g., generally available information) that is associated with the feature point and can be retrieved externally (e.g., via a web server (or internet server), a social network service, and / or a broadcast service). For example, assuming that the feature point is a feature word related to “place” (e.g., Seoul, the United States, department store A, train station B), the personal information may include information that is accessible based on the access level, and may include data searched (e.g., Seoul search), visited (e.g., Seoul visit history, location, and / or date), photographed (e.g., photographed in Seoul), used (e.g., payment), and / or written (e.g., Seoul entered in a chat room) in association with the place (e.g., Seoul) from user information of the electronic device (101) and / or an external server (e.g., a cloud server). For example, assuming that the feature point is a feature word related to “place,” the general information may include a search result for the place (e.g., Seoul) externally (e.g., a web server, a social network service, and / or a broadcast service). For example, general information may be publicly available for external search and may include common information associated with a location (e.g., Seoul) that all users can access and search (or recognize).

[0237] In one embodiment, the processor (120) may access most of the user information to collect (or extract) data for recommendation information based on determining the access level to the user information as 'high'. In one embodiment, even when the access level is 'high', access to user-specified excluded user information (e.g., categories of user information) may not be permitted. In one embodiment, the processor (120) may access a portion of the user information (e.g., categories of specified user information) to collect (or extract) data for recommendation information based on determining the access level to the user information as 'medium'. In one embodiment, the processor (120) may restrict (or not permit) access to the user information based on determining the access level to the user information as 'low'.

[0238] According to one embodiment, the processor (120) may collect general information along with user information collection based on an access level. According to one embodiment, the processor (120) may operate to search for information related to a feature point through the electronic device (101) and / or an external server (e.g., a cloud server, an Internet server). For example, the processor (120) may collect data related to the feature point (e.g., location data, time data, dictionary data) from various data stored in the electronic device (101). For example, the processor (120) may provide the feature point (or information related to the feature point) to an external server, request the external server to search for data related to the feature point, and receive the search data searched by the external server.

[0239] In operation 1015, the processor (120) may perform an operation of generating recommendation information based on linguistic context analysis including feature points and data. In one embodiment, the processor (120) may generate recommendation information having linguistic context (e.g., meaningful to the user) based on data collected from at least a portion of user information (e.g., first data) and / or data collected from general information (e.g., second data) via AI. In one embodiment, the processor (120) (or AI) may generate meaningful recommendation information through linguistic context analysis from given data. In one embodiment, the linguistic context analysis may include, for example, an analysis that takes into account the communication situation and the content of preceding and following utterances surrounding a certain utterance (e.g., feature points).

[0240] In operation 1017, the processor (120) may perform an operation of providing recommendation information based on an input field. According to one embodiment, the processor (120) may display the recommendation information through an input field of an interactive service. According to one embodiment, the user may input the recommendation information provided through the input field by sending (or sharing) the recommendation information into the conversation field, or may input the recommendation information provided by editing (or processing) the recommendation information through user input and then sending the edited recommendation information into the conversation field.

[0241] FIG. 11 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.

[0242] FIGS. 12A, 12B, and 12C are diagrams illustrating various examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0243] According to one embodiment, FIG. 11 may illustrate an example of an operation of providing recommended information (e.g., a recommended answer) through artificial intelligence while executing an interactive service on an electronic device (101) according to one embodiment. According to one embodiment, FIGS. 12a, 12b, and 12c may illustrate examples of a dialogue screen in which an interactive service is performed between a user (e.g., user B) and a counterpart user (e.g., user A).

[0244] An operation method supported by an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to a flowchart illustrated in FIG. 11. The flowchart illustrated in FIG. 11 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed or performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 1101 to 1109 may be performed by at least one processor of the electronic device (101) (e.g., the processor (120, 214) of FIG. 1, FIG. 2, or FIG. 4).

[0245] According to one embodiment, the operations described in FIG. 11 may be heuristically performed in combination with the operations described in FIGS. 5 to 10, for example, or heuristically performed as a replacement for at least some of the operations described and combined with at least some other operations, or heuristically performed as a detailed operation of at least some of the operations described.

[0246] As illustrated in FIG. 11, an operation method performed by an electronic device (101) according to one embodiment may include an operation of providing recommendation information based on an input field (operation 1101), an operation of visualizing recommendation information (operation 1103), an operation of receiving user input (operation 1105), an operation of performing at least one of editing recommendation information, providing link information, and / or transmitting link information based on a type of user input (operation 1107), and an operation of displaying an execution screen corresponding to the performed operation (operation 1109).

[0247] Referring to FIGS. 11, 12A, 12B, and 12C, in operation 1101, the processor (120) of the electronic device (101) may perform an operation of providing recommendation information based on an input field. According to one embodiment, as illustrated in FIG. 12A, the processor (120) may provide recommendation information (1220) generated based on AI based on content (1210) provided through a dialogue field (1201) of an interactive service through an input field (1203) of the interactive service.

[0248] In operation 1103, the processor (120) may perform an operation of visualizing the recommendation information. According to one embodiment, the processor (120) may detect the receipt of a designated user input (e.g., a designated first user input for entering an edit mode) for editing the recommendation information (1220) based on the input field (1203). According to one embodiment, as illustrated in FIG. 12A, the user may input a command for visualizing the recommendation information (1220) (e.g., switching to an edit mode for editing the recommendation information (1220)) through a user input (e.g., a designated touch gesture such as a touch, long touch, double tap, swipe, or flick) for selecting the recommendation information (1220) provided through the input field (1203). According to one embodiment, the processor (120) may determine that the designated user input is a trigger for editing the recommendation information (1220). For example, the processor (120) may determine that the user has entered an edit mode for visualizing recommended information (1220) based on a specified user input, and may switch the input mode of the interactive service to the edit mode.

[0249] In one embodiment, the edit mode may represent a mode in which the recommended information (1220) of the input field (1203) can be edited (or processed) based on a user input (e.g., a second user input related to editing). According to one embodiment, the processor (120) may perform a context analysis of the recommended information (1220) of the input field (1203) when entering the edit mode. For example, the processor (120) may provide a visualization (e.g., a conversion into designated visual information) of a portion related to a feature point (e.g., a feature word such as a meaningful word and / or a user-specified word of interest) in the recommended information (1220) based on the context analysis based on the recommended information (1220). For example, the visualization may include presenting a feature point by transforming the feature point (e.g., highlighting the feature point with a bubble associated with the feature word) by applying (or implementing) various visual elements such as images, diagrams, animations, infographics, word clouds, colors, and / or links based on at least a portion of the feature point to convey information about the feature point to the user. For example, the visualization may be provided based on at least one visual element (e.g., a visual image). An example of this is illustrated in FIG. 12b or FIG. 12c.

[0250] According to one embodiment, as illustrated in FIG. 12b or FIG. 12c, the processor (120) may detect features (e.g., features such as “Gwanggyo a shopping mall”, “Gwanggyo b shopping mall”) related to a user and / or a counterpart user from the recommendation information (1220) via AI. In one embodiment, the features in FIG. 12b or FIG. 12c may include features (e.g., meaningful words and / or user-specified words of interest) analyzed according to word or context analysis within the recommendation information (1220). For example, in the examples of FIG. 12b or FIG. 12c, the features may be “Gwanggyo” indicating a place and “shopping” indicating an action. In one embodiment, if the recommendation information (1220) includes words indicating a date and / or time, the features may further include the date and / or time.

[0251] According to one embodiment, the processor (120) may detect a feature point from the recommendation information (1220) of the input field (1203), visualize a portion corresponding to the feature point, and provide corresponding visual information (e.g., first visual information (1240) (or first bubble), second visual information (1250) (or second bubble)) according to the visualization. According to one embodiment, the processor (120) may provide visual information (1240, 1250) by distinguishing a portion for a user (e.g., a user of the electronic device (101)) and a portion for a counterpart user. For example, as illustrated in FIG. 12b or 12c, an identifier (e.g., “B”) indicating that the first feature point is based on the user’s content may be included in the first visual information (1240) by associating it with a first feature point related to the user, and may be expressed as “B: Gwanggyo a Shopping Mall”. For example, as illustrated in FIG. 12b or FIG. 12c, the second visual information (1250) may include an identifier (e.g., “A”) indicating that the second feature point is based on the content of the other user, in association with the second feature point related to the other user, such as “A: Gwanggyo b shopping mall.”

[0252] In operation 1105, the processor (120) may perform an operation of receiving a user input. According to one embodiment, the processor (120) may detect the receipt of a user input (e.g., a second user input related to editing) based on visual information (1240, 1250). According to one embodiment, as illustrated in FIG. 12b, the user may perform a user input (1245, 1255) (e.g., a designated touch gesture such as a touch) to select the first visual information (1240) or the second visual information (1250) from the recommended information (1220). According to one embodiment, as illustrated in FIG. 12c, the user may perform a user input (1285) (e.g., a designated touch gesture such as a touch) to select a removal item (1280) included in the first visual information (1240) or the second visual information (1250) from the recommended information (1220). According to one embodiment, the user input may include various inputs each corresponding to editing of the recommendation information (1220) as described above. According to one embodiment, the user input may include, in addition to inputs related to editing, an input for transmitting the recommendation information (1220) (or edited (or processed) recommendation information (1225)) (e.g., a 'send button' selection input).

[0253] In operation 1107, the processor (120) may perform at least one of editing recommendation information, providing link information, and / or transmitting recommendation information based on the type of user input. According to one embodiment, the processor (120) may perform an operation of editing (e.g., removing) a feature point based on visual information (1240, 1250) of recommendation information (1220), providing (e.g., displaying) link information linked to visual information (1240, 1250), or removing visual information (1240, 1250) from recommendation information (1220) and transmitting original recommendation information (1220) or edited recommendation information (1225), based on the user input.

[0254] According to one embodiment, the visual information (1240, 1250) may include a link related to the corresponding feature point. According to one embodiment, referring to FIG. 12B or FIG. 12C, the first visual information (1240) may include first link information related to the feature point (e.g., information such as a photo taken by user “B” at a location related to the feature word, or an SNS on which the photo was posted). According to one embodiment, the second visual information (1250) may include second link information related to the feature point (e.g., information such as a previous conversation history of user “A” that includes data (e.g., content) related to the feature word, or an SNS on which user “A” recently posted related to the feature word). According to one embodiment, the processor (120) may determine (e.g., extract) a link included in the visual information (1240, 1250) based on a user input selecting the visual information (1240, 1250). According to one embodiment, the processor (120) may perform an operation of calling and providing link information related to the link based on the determined link.

[0255] According to one embodiment, the visual information (1240, 1250) may include a removal item (1280). According to one embodiment, referring to FIG. 12C, the first visual information (1240) and the second visual information (1250) may include a removal item (1280) that can remove (e.g., exclude from the recommendation information (1220)) data of the corresponding visual information (e.g., data of a feature word related to a target of the visual information (e.g., a user or a counterpart user)) and associated data (or remaining data (or content)) of the corresponding visual information (e.g., recommendation information generated from content of the target of the visual information). According to one embodiment, the processor (120) may determine (e.g., extract) a removal target (e.g., data related to a feature point and associated data) based on the visual information (1240, 1250) based on a user input selecting a removal item (1280) of the visual information (1240, 1250). According to one embodiment, the processor (120) may perform an operation of editing (or reorganizing) the recommendation information (1220) (e.g., removing (or deleting) the removal target from the recommendation information (1220)) based on the determined removal target.

[0256] In operation 1109, the processor (120) may perform an operation of displaying an execution screen corresponding to the operation performed. According to one embodiment, the processor (120) may control the display to display an execution screen corresponding to the operation performed based on user input (e.g., editing recommended information, providing and / or transmitting link information). According to one embodiment, the processor (120) may provide a result corresponding to the operation performed on an execution screen of an interactive service (e.g., a conversation screen). An example of this is illustrated in FIG. 12b or FIG. 12c.

[0257] According to one embodiment, as illustrated in FIG. 12B, in response to a user input (1245) selecting the first visual information (1240), the processor (120) may provide first link information (1260) linked to the first visual information (1240) as a pop-up window on the dialogue screen. For example, based on the user input (1245), the processor (120) may provide corresponding link information, such as a photo taken by user “B” at a location related to the characteristic word (e.g., “Gwanggyo a Shopping Mall”) or an SNS post in which the photo was uploaded, through a pop-up window on an area of ​​the dialogue screen.

[0258] According to one embodiment, as illustrated in FIG. 12B, in response to a user input (1255) selecting second visual information (1250), second link information (1270) linked to the second visual information (1250) may be provided as a pop-up window on the conversation screen. For example, the processor (120) may provide corresponding link information, such as a previous conversation history of user “A” related to the characteristic word and / or a recent SNS post by user “A,” in an area of ​​the conversation screen through a pop-up window based on the user input (1255). For example, the second link information (1270) may be a conversation history related to an action performed by user “A” at a place related to the characteristic word (e.g., “Gwanggyo”) three days ago.

[0259] In one embodiment, as illustrated in FIG. 12c, in response to a user input (1285) selecting a removal item (1280) of the second visual information (1250), data of the second visual information (1250) (e.g., data of a feature word related to user “A”) and associated data (or remaining data) of the second visual information (1250) may be removed (e.g., excluded from the recommendation information (1220)) from the recommendation information (1220). For example, the processor (120) may perform an operation of removing the second visual information (1250) and associated data, and editing (or processing or reconstructing) the recommendation information (1220), based on a user input (1285) selecting a removal item (1280) of the second visual information (1250). According to one embodiment, the processor (120) may replace the original recommendation information (1220) with edited (or processed) recommendation information (1225) and provide it to the input field (1203), as illustrated in element 1290. For example, the edited recommendation information (1225) may exclude content related to user “A” and include only content related to user “B.”

[0260] According to one embodiment, while one embodiment is described with respect to editing of recommendation information in FIGS. 12A, 12B, and 12C, the present disclosure is not limited thereto. For example, the electronic device (101) may support various editing operations, such as adjusting the amount of information in recommendation information based on user input, adding objects (e.g., text, icons, images, and / or videos) to the recommendation information according to user input, or deleting or modifying objects (e.g., phrases) specified in the recommendation information.

[0261] FIGS. 13A, 13B, and 13C are diagrams illustrating various examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0262] According to one embodiment, FIGS. 13A, 13B, and 13C may illustrate examples of conversation screens in which an interactive service is performed between a user (e.g., user B) and a counterpart user (e.g., user A). According to one embodiment, FIGS. 13A, 13B, and 13 may illustrate examples in which the amount of recommended information provided varies based on the user's level of access to information (e.g., accessible source information).

[0263] According to one embodiment, as illustrated in FIGS. 13A, 13B, and 13C, the electronic device (101) may provide recommendation information by configuring the amount of information differently according to the access level to the user information based on the relationship information. In one embodiment, the user information may include sensitive information (e.g., photo information, financial information, payment information) and personal information (e.g., account information, mobile ID information, financial information, location information, health information, SNS information, conversation history information) that are associated with the feature point and directly related to the user. In one embodiment, the access level may include the degree of authority (or permission) to access the user information for configuring the recommendation information, and may be classified as, for example, high, medium, and low. In one embodiment, the classification of the access level is exemplary and is not limited thereto, and may be set in various ways, such as in more detailed steps.

[0264] According to one embodiment, when the relationship information is 'high', the electronic device (101) determines the access level to the user information as 'high' and may access most of the user information to collect (or extract) data for recommendation information. In one embodiment, even when the access level is 'high', access to user-specified excluded user information (e.g., categories of user information) may not be permitted. According to one embodiment, when the relationship information is 'medium', the electronic device (101) determines the access level to the user information as 'medium' and may access a portion of the user information (e.g., categories of specified user information) to collect (or extract) data for recommendation information. According to one embodiment, when the relationship information is 'low', the electronic device (101) determines the access level to the user information as 'low' and may restrict (or not permit) access to the user information.

[0265] According to one embodiment, the electronic device (101) may collect at least a portion of user information based on an access level (e.g., high, medium, or low). According to one embodiment, the electronic device (101) may collect general information along with the user information collected based on the access level. In one embodiment, the general information may include information that is associated with a feature point and is generally public. According to one embodiment, the electronic device (101) may obtain at least a portion of user information and / or general information based on the access level, and generate recommendation information based on the obtained information.

[0266] According to one embodiment, the electronic device (101) can search and collect information related to a feature point through the memory (130) of the electronic device (101) and / or an external server (e.g., a cloud server, an Internet server). For example, the electronic device (101) can collect data related to the feature point (e.g., location data, time data, dictionary data) from various data stored in the memory (130). For example, the electronic device (101) can provide the feature point (or information related to the feature point) to an external server, request the external server to search for data related to the feature point, and receive the search data searched by the external server.

[0267] According to one embodiment, the electronic device (101) may generate (e.g., infer) recommendation information related to a feature point based on acquired information (e.g., user information and / or general information). According to one embodiment, the electronic device (101) may generate recommendation information having a linguistic context based on data collected from at least a portion of the user information (e.g., first data) and / or data collected from the general information (e.g., second data) through AI (e.g., generative AI). According to one embodiment, the electronic device (101) may generate recommendation information (1310, 1320, 1330) through linguistic context analysis from given data according to an access level. In one embodiment, the linguistic context analysis may include, for example, an analysis that takes into account the communication situation and the content of preceding and following utterances surrounding a certain utterance (e.g., feature point).

[0268] According to one embodiment, the electronic device (101) may provide recommendation information (1310, 1320, 1330) through an input field (1300) of an interactive service. According to one embodiment, the electronic device (101) may provide information (1390) about an information disclosure stage according to an access level (e.g., information about high, medium, or low) by visualizing it (e.g., adding a visual element (1390) based on text and a stage (or information amount) adjustment object). For example, the visual element (1390) about the information disclosure stage may be provided in association with the input field (1300) (e.g., in a lower adjacent area of ​​the input field (1300)). According to one embodiment, the electronic device (101) may adjust the amount of information in the recommended information (1310, 1320, 1330) based on a user input (e.g., a touch gesture such as a swipe for adjusting the level (or amount of information)) using a visual element (1390), and reconfigure and provide the recommended information based on the adjusted amount of information. For example, the user may adjust the amount of information in the recommended information (1310, 1320, 1330) by adjusting the level based on the visual element (1390).

[0269] According to one embodiment, FIG. 13A may illustrate an example of providing recommendation information (1310) to an input field (1300) when the access level to user information is “high.” As illustrated in FIG. 13A, the electronic device (101) may access most of the user information and construct and provide recommendation information (1310) from the collected data. According to one embodiment, when the access level is “high,” a relatively large amount of information may be included. According to one embodiment, the electronic device (101) may visualize a portion corresponding to a feature point in the recommendation information (1310) and convert and provide visual elements according to the visualization (e.g., first visual information (1340) and second visual information (1350)). According to one embodiment, the visual elements (1340, 1350) may be provided differently for each user participating in the interactive service. According to one embodiment, the visual elements may not be provided in the recommendation information (1310).

[0270] According to one embodiment, the electronic device (101) may provide the user with an indication through a visual element (1390) that the information disclosure stage according to the access level in association with the input field (1300) corresponds to “high.” For example, the electronic device (101) may display a stage adjustment object (e.g., an emphasis point at the first point (e.g., a large circle)) and guide text (“Information disclosure stage: high”) indicating that the information disclosure stage is “high” as the visual element (1390). According to one embodiment, the user may adjust the amount of information of the recommended information (1310) displayed in the input field (1300) by moving the emphasis point of the stage adjustment object of the visual element (1390) (e.g., changing the information disclosure stage by moving it to the right). For example, when the user moves the emphasis point to the “middle” stage on the right, the amount of information of the recommended information (1310) may be changed, such as the recommended information (1320) of FIG. 13b, which is configured based on data corresponding to the “middle” access level. For example, if the user moves the emphasis to the “low” level on the right, the amount of information in the recommendation information (1310) may change, such as the recommendation information (1330) of FIG. 13c, which is configured based on data corresponding to the “low” level of access.

[0271] According to one embodiment, FIG. 13B may illustrate an example of providing recommended information (1320) to an input field (1300) when the access level to user information is “medium.” As illustrated in FIG. 13B , the electronic device (101) may access a portion of the user information (e.g., data related to a previous conversation history with the other user, excluding the user’s personal information) and provide the recommended information (1320) by configuring the collected data. According to one embodiment, when the access level is “medium,” a relatively medium amount of information may be included. According to one embodiment, the electronic device (101) may visualize a portion corresponding to a feature point in the recommended information (1320) and convert it into a visual element (e.g., second visual information (1350)) according to the visualization and provide it. According to one embodiment, the recommended information (1320) may not provide a visual element.

[0272] According to one embodiment, the electronic device (101) may provide the user with an indication through a visual element (1390) that the information disclosure stage according to the access level associated with the input field (1300) corresponds to “middle”. For example, the electronic device (101) may display a stage adjustment object (e.g., an emphasis point at the second point (e.g., a large circle)) and guide text (“Information disclosure stage: middle”) indicating that the information disclosure stage is “middle” as the visual element (1390). According to one embodiment, the user may adjust the amount of information of the recommended information (1320) displayed in the input field (1300) by moving the emphasis point of the stage adjustment object of the visual element (1390) (e.g., changing the information disclosure stage by moving it to the left or right). For example, when a user moves the emphasis point to the “High” level on the left, the amount of information in the recommendation information (1320) may change, such as in the recommendation information (1310) of FIG. 13a, which is constructed based on data corresponding to the “High” level of access. For example, when a user moves the emphasis point to the “Low” level on the right, the amount of information in the recommendation information (1320) may change, such as in the recommendation information (1330) of FIG. 13c, which is constructed based on data corresponding to the “Low” level of access.

[0273] According to one embodiment, FIG. 13C may illustrate an example of providing recommendation information (1330) to an input field (1300) when the access level to user information is “low.” As illustrated in FIG. 13C, the electronic device (101) may configure and provide recommendation information (1330) from data collected from general information, excluding user information. According to one embodiment, when the access level is “low,” a relatively small amount of information may be included. According to one embodiment, the electronic device (101) may visualize a portion corresponding to a feature point in the recommendation information (1330), and convert and provide a visual element (e.g., third visual information (1360)) according to the visualization. According to one embodiment, the third visual element (1360) may be distinguished from a visual element related to user information (e.g., first visual information (1340) and / or second visual information (1350)), and may provide to the user that the third visual element (1360) is based on general information. For example, the electronic device (101) may provide visual elements (1340, 1350) based on user information and visual elements (1360) based on general information differently (e.g., shape distinction, color distinction, and / or highlighting distinction). In one embodiment, visual elements may not be provided in the recommendation information (1330).

[0274] According to one embodiment, the electronic device (101) may provide the user with an indication through a visual element (1390) that the information disclosure stage according to the access level in association with the input field (1300) corresponds to “low.” For example, the electronic device (101) may display a stage adjustment object (e.g., an emphasis point at the third point (e.g., a large circle)) and guide text (“Information disclosure stage: low”) indicating that the information disclosure stage is “low” as the visual element (1390). According to one embodiment, the user may adjust the amount of information of the recommended information (1330) displayed in the input field (1300) by moving the emphasis point of the stage adjustment object of the visual element (1390) (e.g., changing the information disclosure stage by moving it to the left). For example, when the user moves the emphasis point to the “middle” stage on the left, the amount of information of the recommended information (1330) may be changed, such as the recommended information (1320) of FIG. 13b, which is configured based on data corresponding to the “middle” access level. For example, if the user moves the emphasis to the “high” level on the left, the amount of information in the recommendation information (1330) may change, such as the recommendation information (1310) of FIG. 13a, which is configured based on data corresponding to the “high” level of access.

[0275] FIGS. 14A and 14B are diagrams illustrating various examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0276] According to one embodiment, FIGS. 14A and 14B illustrate examples of providing visual elements (e.g., bubbles) based on feature words in recommended information, and providing candidate information that can replace information (e.g., feature word portions) highlighted by the visual elements based on user input regarding the visual elements. For example, the electronic device (101) may support a user to select candidate information and quickly and easily modify feature word-based information associated with the visual element with other information.

[0277] According to one embodiment, FIG. 14A may illustrate an example of a conversation screen displaying recommended information (1400) based on an input field. According to one embodiment, the recommended information (1400) may include a first visual element (1410) and a second visual element (1420) visualized in association with a feature word, as exemplified above. According to one embodiment, the first visual element (1410) and the second visual element (1420) may be implemented in the form of a bubble containing information (or content) related to the feature word.

[0278] According to one embodiment, the electronic device (101) may provide other information that is not included in the recommendation information (1400) but can be used as content of the recommendation information (1400) based on a user input specified in the recommendation information (1400). For example, the electronic device (101) may provide candidate information that is related to information (e.g., a portion related to the feature word) of a visual element (e.g., a first visual element (1410), a second visual element (1420)) associated with a feature word and that can replace the information of the visual elements (1410, 1420).

[0279] As illustrated in FIG. 14A, a user may perform a user input (e.g., a touch gesture such as a long press) specified for one of the visual elements (1410, 1420). According to one embodiment, the electronic device (101) may provide a transition object (1430) that may call up and display a list (e.g., a candidate list) containing candidate information in response to the specified user input. For example, the transition object (1430) may be provided in association with an input field or a keyboard (1440). According to one embodiment, FIG. 14A illustrates an example in which the transition object (1430) is provided as an object of a specified shape (e.g., a triangle icon) through a portion of an upper edge of the keyboard (1440) in association with the keyboard (1440).

[0280] As illustrated in FIGS. 14A and 14B , the transition object (1430) may include an object having a directionality that indicates a direction based on a switching target (e.g., a keyboard (1440) or a list (1450)). For example, if the switching target is switching from a keyboard (1440) to a list (1450), the transition object (1430) may be provided as an inverted triangle icon to indicate to the user (e.g., a swipe downward) that the area of ​​the keyboard (1440) can be switched to an area of ​​the list (1450) (e.g., an information change area). For example, if the switching target is switching from a list (1450) to a keyboard (1440), the transition object (1430) may be provided as a triangle icon to indicate to the user (e.g., a swipe upward) that the area of ​​the list (1450) can be switched to an area of ​​the keyboard (1440). According to one embodiment, the transition object (1430) may be provided as a designated polygonal shape object (e.g., a circular icon, a square icon, a pentagonal icon, or a star icon) that does not have a direction. According to one embodiment, the transition object (1430) may support switching between the keyboard (1440) and the list (1450) by a touch gesture, such as a swipe moving in a designated direction. According to one embodiment, the transition object (1430) may also support switching between the keyboard (1440) and the list (1450) by a touch gesture, such as a touch.

[0281] According to one embodiment, a user may perform a specified user input (e.g., a touch gesture such as a swipe or touch) based on a transition object (1430). According to one embodiment, when the electronic device (101) detects the specified user input through the transition object (1430), the electronic device (101) may provide a list (1450) including at least one piece of candidate information by switching the keyboard (1440). According to one embodiment, the transition object (1430) may change from a first icon (e.g., an inverted triangle icon) indicating a first direction of FIG. 14A to a second icon (e.g., a triangle icon) indicating a second direction opposite to the first direction, in response to the switching between the keyboard (1440) and the list (1450). According to one embodiment, an area of ​​the list (1450) may be provided to replace an area of ​​the keyboard (1440), or may be provided through an area between an input field and the keyboard (1440).

[0282] According to one embodiment, the electronic device (101) may generate candidate information that can replace information of the visual elements (1410, 1420) by using source information (e.g., user information and / or general information) associated with the feature word based on a specified user input based on the transition object (1430).

[0283] As illustrated in FIG. 14B, the list (1450) may include various candidate information (e.g., first candidate information (1460), second candidate information (1470), third candidate information (1480)) that correspond to information of visual elements (1410, 1420) associated with feature words (e.g., feature word-related portions), and may replace the information of the visual elements (1410, 1420). In one embodiment, the candidate information (1460, 1470, 1480) of the list (1450) may all be displayed in correspondence with users participating in the interactive service (e.g., user “A” and user “B”) and / or the visual elements (1410, 1420). For example, the first candidate information (1460) may include items that can be utilized by replacing the information of the first visual element (1410). For example, the second candidate information (1470) may include items that can be used to replace the information of the second visual element (1420). For example, the third candidate information (1480) may include items related to general information that can be used to replace the information of the first visual element (1470) and / or the second visual element (1420).

[0284] According to one embodiment, candidate information (1460, 1470, 1480) may include an execution object (1490) that can input a command for replacing information, as illustrated in element 1490. For example, a user may select an execution object (1490) of candidate information to be replaced among candidate information (1460, 1470, 1480) to modify the corresponding information in the recommendation information (1400) by replacing it with the candidate information. According to one embodiment, the electronic device (101) may replace information of corresponding visual elements (1410, 1420) in the recommendation information (1400) according to the candidate information for which the execution object (1490) is selected. For example, in response to a user input based on the execution object (1490) of the first candidate information (1460), information of the first visual element (1410) may be replaced with the corresponding candidate information. For example, in response to a user input based on an execution object (1490) of the second candidate information (1470), information of the second visual element (1420) may be replaced with the corresponding candidate information. According to one embodiment, when a portion of the recommendation information (1400) is replaced with candidate information (1460, 1470, 1480), the wording of the recommendation information (1400) may be automatically and naturally corrected based on the content and context of the candidate information.

[0285] In one embodiment, although not illustrated in FIG. 14b, the list may also provide guidance information regarding the source (e.g., target user and / or source information) associated with each candidate information (1460, 1470, 1480). For example, guidance information regarding the information source associated with each candidate information (1460, 1470, 1480) may be provided in the lower area of ​​each candidate information. For example, the electronic device (101) may provide guidance regarding the first candidate information (1460) by indicating that the first candidate information (1460) is recommended based on “User B’s payment history.” For example, the electronic device (101) may provide guidance regarding the second candidate information (1470) by indicating that the second candidate information (1470) is recommended based on “User A’s conversation history.” For example, the electronic device (101) may, in association with the third candidate information (1480), inform that the third candidate information (1480) is recommended based on “general information related to the characteristic word (e.g., movie ranking, genre of interest, real-time trend).”

[0286] FIGS. 15A, 15B, and 15C are diagrams illustrating various examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0287] According to one embodiment, FIGS. 15A, 15B, and 15C illustrate examples of providing visual elements (e.g., bubbles) based on feature words in recommended information, and providing candidate information that can replace information (e.g., feature word portions) highlighted by the visual elements based on user input regarding the visual elements. For example, the electronic device (101) may support a user to select candidate information and easily and quickly modify feature word-based information associated with the visual element with other information.

[0288] According to one embodiment, FIG. 15A may illustrate an example of a conversation screen displaying recommended information (1500) based on an input field. According to one embodiment, the recommended information (1500) may include a first visual element (1510) and a second visual element (1520) visualized in association with a feature word, as exemplified above. According to one embodiment, the first visual element (1510) and the second visual element (1520) may be implemented in the form of a bubble containing information (or content) related to the feature word.

[0289] According to one embodiment, the electronic device (101) may provide other information that is not included in the recommendation information (1500) but can be used as content of the recommendation information (1500) based on a user input specified in the recommendation information (1500). For example, the electronic device (101) may provide candidate information that is related to information (e.g., a portion related to the feature word) of a visual element (e.g., a first visual element (1510), a second visual element (1520)) associated with a feature word and that can replace the information of the visual elements (1510, 1520).

[0290] As illustrated in FIG. 15A, a user may perform a user input (e.g., a touch gesture such as a long press) designated for one of the visual elements (1510, 1520) (e.g., a second visual element (1520)). In one embodiment, the electronic device (101) may, in response to the designated user input, provide a list (1550) (e.g., a candidate list) including candidate information related to the second visual element (1520), as illustrated in FIG. 15B. In one embodiment, the electronic device (101) may, in response to the designated user input, provide a transition object (1530) associated with a keyboard (1540).

[0291] According to one embodiment, when the electronic device (101) detects a specified user input, the electronic device (101) may provide a list (1550) including at least one candidate information by switching the keyboard (1540). According to one embodiment, an area of ​​the list (1550) (e.g., an information change area) may be provided to replace an area of ​​the keyboard (1540) or may be provided through an area between the input field and the keyboard (1540). According to one embodiment, the electronic device (101) may generate candidate information that can replace information of the second visual element (1520) based on a specified user input based on the second visual element (1520).

[0292] As illustrated in FIG. 15B, the list (1550) may include various candidate information (e.g., first candidate information (1570), second candidate information (1580)) that correspond to information of the second visual element (1520) (e.g., a feature word-related portion) and may replace the information of the second visual element (1520). In one embodiment, the candidate information (1570, 1580) of the list (1550) may display candidate information related to the second visual element (1520) (or a user associated with the second visual element (1520)) selected according to a specified user input. For example, the first candidate information (1570) may include items that can be utilized by replacing the information of the second visual element (1520). For example, the second candidate information (1580) may include items related to general information that can be utilized by replacing the information of the second visual element (1520).

[0293] According to one embodiment, the candidate information (1570, 1580) may include an execution object (1590) that can input a command for replacing information, as illustrated in element 1590. For example, a user may select an execution object (1590) of candidate information to be replaced among candidate information (1570, 1580) to modify the corresponding information in the recommendation information (1500) by replacing it with the candidate information. According to one embodiment, the electronic device (101) may replace the information of the corresponding second visual element (1450) in the recommendation information (1500) according to the candidate information for which the execution object (1590) is selected. For example, in response to a user input based on the execution object (1590) of the first candidate information (1570), the information (or content) of the second visual element (1520) may be replaced with the corresponding candidate information. According to one embodiment, when a part of the recommendation information (1500) (e.g., information of the second visual element (1520)) is replaced with candidate information (1570, 1580), the phrase of the recommendation information (1500) may be naturally and automatically corrected based on the content and context of the candidate information. For example, assuming that the information of the second visual element (1520) is “Gwanggyo b shopping mall” and the recommendation information (1500) including it is “I heard that the newly opened Gwanggyo b shopping mall is good because there are a lot of good restaurants”, it may be assumed that the candidate information is “Gwanggyo Samsung Store”. In this case, the electronic device (101) may correct the content of the recommendation information (1500) (e.g., the content of the second visual element (1520) and the preceding and following utterances) through AI to something like “Let’s stop by the Gwanggyo Samsung Store to check out the new cell phone.”

[0294] For example, as illustrated in FIG. 15c, the second visual element (1520) of the recommendation information (1500) may be replaced with a third visual element (1525) including the selected candidate information, and the context before and after the third visual element (1525) may be changed to recommendation information (1505) corrected based on the candidate information and provided. According to one embodiment, the electronic device (101) may also provide other candidate information (1575) that can be replaced in the corresponding portion, excluding the candidate information selected from the list (1550).

[0295] FIGS. 16A and 16B are diagrams illustrating various examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0296] According to one embodiment, FIGS. 16A and 16B may illustrate examples of providing candidate information differently based on an information disclosure step for user information.

[0297] As illustrated in FIGS. 16A and 16B , a list (1600) may be provided including a visual element (1630) including an adjustment object (1610) and guide text (1620) for adjusting an information disclosure level together with at least one candidate information (1601, 1603, 1605). For example, the visual element (1630) may be provided through an area designated in association with the candidate information (1601, 1603, 1605) within an area of ​​the list (1600) (e.g., a top area of ​​the candidate information (1601, 1603, 1605)). According to one embodiment, the electronic device (101) may support a user to adjust an information disclosure level (e.g., high, medium, or low) related to the candidate information (1601, 1603, 1605) based on the visual element (1630).

[0298] According to one embodiment, the electronic device (101) may determine the disclosure stage of candidate information (1601, 1603, 1605) in the list (1600) based on a user input (e.g., a touch gesture such as a swipe for adjusting the stage) using a visual element (1630) (e.g., an adjustment object (1610)), and may adjust and provide display information (e.g., the amount of information) of the candidate information (1601, 1603, 1605) based on the determined disclosure stage. For example, the electronic device (101) may hide (e.g., dim) some of the candidate information (1601, 1603, 1605) through stage adjustment according to a user input based on the visual element (1630), thereby visually indicating that the hidden candidate information corresponds to the user information.

[0299] According to one embodiment, FIG. 16A may illustrate an example of providing (e.g., displaying) all candidate information (1601, 1603, 1605) in a list (1600) when the information disclosure level is “high.” As illustrated in FIG. 16A, the electronic device (101) may display all candidate information (1601, 1603, 1605) in the list (1600) without hiding them.

[0300] According to one embodiment, FIG. 16B may illustrate an example of providing candidate information (1601, 1603, 1605) from a list (1600) when the information disclosure level is “low.” As illustrated in FIG. 16B, the electronic device (101) may visually obscure some candidate information (1601, 1603) (e.g., candidate information related to user information) among the candidate information (1601, 1603, 1605) from the list (1600) through a visualization (e.g., hiding processing), thereby making some candidate information (1601, 1603) invisible to the user. According to one embodiment, the electronic device (101) may provide an effect of hiding some areas of candidate information (1601, 1603) related to user information by overlapping a shading filter (1640) (or layer) based on the “low” level of information disclosure. According to one embodiment, the electronic device (101) may also provide a related guide (1645) (e.g., a message such as “This personal information will not be used to generate AI answers”) together with the effect of hiding some of the candidate information (1601, 1603) based on the shading filter (1640).

[0301] FIG. 17 is a diagram illustrating an example of an adjustment object that supports adjustment of an information disclosure step in an electronic device according to one embodiment of the present disclosure.

[0302] According to one embodiment, FIG. 17 illustrates various implementation examples of an adjustment object (1700) for supporting adjustment of an information disclosure step in an electronic device (101) and various examples of utilizing the adjustment object (1700). According to one embodiment, the adjustment object (1700) may be used to adjust the disclosure step of display information (e.g., information amount) related to recommendation information and / or candidate information.

[0303] As illustrated in FIG. 17, the adjustment object (1700) for supporting adjustment of the information disclosure stage can be implemented in various ways, such as a first object (1710) divided into three stages such as 'high / medium / low' (or 'upper / medium / lower'), a second object (1720) divided into two stages such as 'yes / no', or a third object (1730) divided into a ratio (or percentage). In one embodiment, the illustrated form of the adjustment object (1700) is exemplary and is not limited thereto, and can be set in various ways, such as an object that distinguishes more stages (e.g., very high, high, medium, low, very low).

[0304] According to one embodiment, the information that can be adjusted based on the adjustment object (1700) may vary. For example, the adjustment object (1700) may be designed to specify the degree of AI intervention to implement settings and / or restrictions related to information, such as the extent of information disclosure, the format of the information, or whether the information can be used. For example, the adjustment object (1700) may be adaptively configured and provided to set and / or restrict various pieces of information depending on the type and / or context of the information provided by the AI. For example, the adjustment object (1700) may be implemented in various ways depending on the type and / or context of the information provided, such as a first form for adjusting the information disclosure level (e.g., high / medium / low or upper / middle / low), a second form (e.g., a two-stage adjustment object) for setting whether to use user information, a third form for adjusting tone and / or intonation based on relationship information and / or intimacy, a fourth form for setting whether to use honorifics, a fifth form for setting whether to add conditions (or considerations) for recommended information (e.g., whether to consider schedules) and / or the level of disclosure, and / or a sixth form that allows for more detailed adjustments based on ratios (or percentages) when multiple conditions are complexly combined.

[0305] FIGS. 18a, 18b, 18c, and 18d are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0306] According to one embodiment, FIGS. 18a, 18b, 18c and 18d may illustrate an example of providing AI-based recommendation information (e.g., recommended answers) through a conversation screen while an interactive service is performed between a user of an electronic device (101) (e.g., user B) and a counterpart user of another electronic device (e.g., user A).

[0307] Referring to FIG. 18A, FIG. 18A may illustrate an example of providing an answer (e.g., recommended information (1830)) generated by AI through a dialogue field (1820) of an execution screen (e.g., user interface) of an interactive service. According to one embodiment, FIG. 18A may display first content (1801) (e.g., text in a dialogue bubble) shared by a counterpart user (e.g., user A) and second content (1803) (e.g., text in a dialogue bubble) shared by a user (e.g., user B) through the dialogue field (1820). According to one embodiment, the electronic device (101) may generate recommended information (1830) through AI based on a context according to previous utterances (e.g., content (1801, 1803)) between users of the dialogue field (1820). According to one embodiment, the electronic device (101) may provide recommendation information (1830) generated through AI in a pop-up format via a pop-up window on a dialogue field (1820). For example, the electronic device (101) may provide a pop-up window containing recommendation information (1830) via a portion of a dialogue screen.

[0308] According to one embodiment, the electronic device (101) can detect features from the second content (1803) through AI. In one embodiment, the features in FIG. 18A may include features (e.g., meaningful words and / or user-defined words of interest) analyzed based on word or context analysis within the second content (1803). For example, in FIG. 18A, the features may be "Gwanggyo" indicating a location and "shopping" indicating an activity. In one embodiment, if the second content (603) includes words indicating a date and / or time, the features may further include the date and / or time.

[0309] According to one embodiment, the electronic device (101) may detect feature words (e.g., 'Gwanggyo' and 'shopping') based on linguistic context analysis from content (e.g., 'Shall we go shopping in Gwanggyo together?') in the dialogue field (1820) upon activation of the input field (1810) while performing an interactive service. According to one embodiment, the electronic device (101) may generate (e.g., infer) recommendation information (1830) related to the feature words (e.g., 'Gwanggyo' and 'shopping') through AI. According to one embodiment, the electronic device (101) may generate recommendation information (1830) having a linguistic context related to the feature words. For example, the electronic device (101) may generate recommendation information (1830) having a linguistic context related to the feature words, such as 'I recently went to Gwanggyo A Shopping Mall, and it was good for shopping because there were many clothing stores. By constructing utterances surrounding characteristic words (e.g., 'Gwanggyo' and 'shopping'), such as 'I heard that the newly opened B shopping mall in Gwanggyo is good because it has many desserts and delicious restaurants', recommendation information (1830) with linguistic context can be generated.

[0310] According to one embodiment, the electronic device (101) may provide (e.g., display) recommendation information (1830) generated by AI through a dialogue field (1820). According to one embodiment, the user may perform a designated first user input (1835) (e.g., a touch gesture such as tapping the recommendation information (1830)) to use the recommendation information (1830) provided through the dialogue field (1820). According to one embodiment, the user may edit (or process) the recommendation information (1830) recommended by AI through the user input or share it with a counterpart user participating in an interactive service.

[0311] Referring to FIG. 18B, FIG. 18B may illustrate an example of providing a screen in a state of waiting for a user input (e.g., user input related to transmission or editing) for using recommended information (1830) recommended by AI. According to one embodiment, the electronic device (101) may provide recommended information (1830) by inputting (e.g., moving) it into an input field (1810) based on a designated first user input for using recommended information (1830) provided through a dialogue field (1820).

[0312] According to one embodiment, the electronic device (101) may detect receipt of a designated second user input for editing the recommended information (1830) based on the input field (1810). According to one embodiment, the user may edit the recommended information (1830) through a user input (e.g., a designated touch gesture such as a touch) that selects a portion (or text) to be edited (e.g., designates a position of an input cursor) in the recommended information (1830) provided through the input field (1810). According to one embodiment, the electronic device (101) may determine, based on the designated second user input, that the second user input is a trigger for editing the recommended information (1830).

[0313] Referring to FIG. 18C, FIG. 18C may illustrate an example of providing a screen in which some content of the recommendation information (1830) has been edited by the user. For example, the user may edit the recommendation information (1830) of the example described above, such as “... I heard that the newly opened B shopping mall in Gwanggyo is also good because it has a lot of desserts and good restaurants.” to “... Should I shop there and eat dessert at the newly opened B shopping mall?” According to one embodiment, when the recommendation information (1830) generated based on AI is edited by a user input, the electronic device (101) may differently provide (e.g., display) the first content (e.g., an answer generated by AI) with help from the AI ​​and the second content (e.g., directly input and edited by the user) in the recommendation information (1830). According to one embodiment, the electronic device (101) may provide the first content and the second content by distinguishing them based at least on the text color, background color, text type, and / or font size of the first content and the second content. For example, as illustrated in FIG. 18c, it can be assumed that the content of element 1840 is first content assisted by AI, and the content of element 1850 is second content edited by a user (e.g., directly input and modified by the user). According to one embodiment, the electronic device (101) can display the first content (1840) in letters of a first designated color (e.g., black), and display the second content (1850) in letters of a second designated color (e.g., green).

[0314] According to one embodiment, a user may edit (or process) recommendation information (1830) provided through an input field (1810) through user input, and then share the recommendation information (1830) (e.g., edited recommendation information) with a counterpart user through user input based on a transmit button (1860). According to one embodiment, the electronic device (101) may transmit the recommendation information (1830) (e.g., edited recommendation information) entered in the input field (1810) to the counterpart user's electronic device based on a user input based on the transmit button (1860). According to one embodiment, the transmitted (or shared) recommendation information (1830) may be provided (e.g., displayed) through a conversation field (1820).

[0315] Referring to FIG. 18D, FIG. 18D may illustrate an example of providing (e.g., displaying) recommendation information (1870) through a dialogue field (1820) of an interactive service. According to one embodiment, as illustrated in FIG. 18C, when recommendation information (1830) is edited by a user and transmission of the edited recommendation information (1830) is requested by the user (e.g., by selecting a transmission button (1860), the electronic device (101) may transmit the recommendation information (1830) to an external device (e.g., an electronic device of the other user) through a designated communication.

[0316] According to one embodiment, the electronic device (101) may provide the transmitted recommendation information (1830) as content (1870) input by the user through the dialogue field (1820). According to one embodiment, the electronic device (101) may, based on transmitting the recommendation information (1830) of the input field (1810), remove (or not display) the recommendation information (1830) of the input field (1810) and display the content (1870) corresponding to the transmitted recommendation information (1830) through the dialogue field (1820). According to one embodiment, when the electronic device (101) removes the recommendation information (1830) from the input field (1810) according to the transmission of the recommendation information (1830), the electronic device (101) may change the size of the input field (1810) to a default size and display it, and remove and not display a notification object provided in association with the input field (1810).

[0317] According to one embodiment, the electronic device (101) may input content (1870) corresponding to the recommendation information (1830) into the dialogue field (1820) based on the transmission of the recommendation information (1830). According to one embodiment, when the recommendation information (1830) generated based on AI is edited and transmitted based on a user input, the electronic device (101) may provide (e.g., display) the content (1870) by distinguishing between first content (1840) (e.g., an answer generated by AI) assisted by AI and second content (1850) edited by the user (e.g., directly input and modified by the user) in the recommendation information (1830). According to one embodiment, the electronic device (101) may provide the first content (1840) and the second content (1850) by distinguishing them based at least on the text color, background color, text type, and / or font size of the first content (1840) and the second content (1850) in the content (1870). For example, as illustrated in FIG. 18d, in the content (1870), the first content (1840) and the second content (1850) may be displayed in text of a first designated color (e.g., black), and the second content (1850) may be displayed in text of a second designated color (e.g., green), as in the edited recommendation information (1830) illustrated in FIG. 18c.

[0318] According to one embodiment, content (1870) transmitted (e.g., shared) from an electronic device (101) may be displayed on the electronic device of the other user as first content (1840) and second content (1850) in a differentiated manner, as displayed on the electronic device (101). For example, when the electronic device of the other user receives recommendation information (1830) transmitted by the electronic device (101) and displays content (1870) corresponding to the received recommendation information (1830), the electronic device may provide the content (1870) by distinguishing the font colors of the first content (1840) and the second content (1850), as illustrated in FIG. 18D .

[0319] FIGS. 19A and 19B are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0320] According to one embodiment, FIGS. 19A and 19B may illustrate an example in which a user refreshes (or changes, processes, or regenerates) first recommended information (e.g., a recommended answer) recommended (or generated) from AI with different second recommended information (e.g., a different recommended answer).

[0321] According to one embodiment, as illustrated in FIG. 19A, the electronic device (101) may provide first recommendation information (1930) generated based on AI based on content (e.g., conversation contents of a user and / or a counterpart user) provided through a conversation field (1920) of the interactive service through an input field (1910) of the interactive service. According to one embodiment, the electronic device (101) may provide a refresh object (1950) (e.g., an “R” button) related to a change request (or refresh request) of the recommendation information, either together with an adjustment object (1940) (or a visual element) related to adjusting an information disclosure step, or independently, by associating it with the input field (1910) (e.g., an adjacent area at the bottom of the input field (1910)). According to one embodiment, the refresh object (1950) may be provided independently of the adjustment object (1940) and in association with the recommended information within the input field (1910) through a designated area (e.g., the right area adjacent to the last letter of the recommended information content, or the lower right area of ​​the input field (1910)).

[0322] In one embodiment, a user may perform a user input (e.g., a touch gesture such as tapping (or touching) the refresh object (1950)) on the refresh object (1950) to receive a recommendation for the first recommendation information (1930) provided through the input field (1910) as another second recommendation information (1960). In one embodiment, based on the selection of the refresh object (1950), the user may receive the first recommendation information (1930) recommended by the AI ​​as another recommendation information (e.g., the second recommendation information (1960)).

[0323] According to one embodiment, as illustrated in FIG. 19b, the electronic device (101) may, based on detecting a user input through a refresh object (1950), process the recommendation content based on the first recommendation information (1930) through AI to generate and provide new recommendation information (e.g., second recommendation information (1960)). For example, the electronic device (101) may change the first recommendation information (1930) such as “I recently went to Gwanggyo A Shopping Mall, and it was good for shopping because there were a lot of clothing stores. I also heard that the newly opened B Shopping Mall in Gwanggyo is good because there are a lot of desserts and good restaurants.” to second recommendation information (1960) such as “The shopping mall I recently visited in Gwanggyo is Gwanggyo A Shopping Mall, and it is your favorite shopping mall because you like clothes. The newly opened B Shopping Mall in Gwanggyo is also a shopping mall with a lot of the latest brands, so it is a good place for clothes shopping.” and provide the changed information in the input field (1910). According to one embodiment, the electronic device (101) may, through AI, regenerate and provide second recommendation information (1960) to the user based on the context of previous utterances between users in the conversation field (1920) and the characteristic words (e.g., 'Gwanggyo' and 'shopping').

[0324] According to one embodiment, when a user requests a refresh of recommended information using a refresh object (1950) (e.g., when the user wants a different answer), the user may request automatic generation by selecting (e.g., tapping) the refresh object (1950), or may request the user to input a desired request (e.g., input a voice command) while pressing the refresh object (1950). According to one embodiment, while a user input is detected in the refresh object (1950), the electronic device (101) may receive and detect a voice command according to a user utterance, and generate and provide second recommended information (1960) corresponding to the user request according to the voice command.

[0325] FIGS. 20A and 20B are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0326] According to one embodiment, FIGS. 20A and 20B may illustrate an example in which a user refreshes (or changes, processes, or regenerates) first recommendation information (e.g., a recommended answer) recommended (or generated) from AI with different second recommendation information (e.g., a different recommended answer).

[0327] According to one embodiment, as illustrated in FIG. 20A, the electronic device (101) may provide first recommendation information (2030) generated based on AI based on content (e.g., conversation contents of a user and / or a counterpart user) provided through a conversation field (2020) of the conversation service through an input field (2010) of the conversation service. According to one embodiment, the electronic device (101) may provide an adjustment object (2040) (or a visual element) related to adjusting an information disclosure stage, a refresh object (2050) (e.g., an “R” button) related to a request for changing recommended information (or a refresh request), and / or an existence object (2070) for changing a conversational tone by associating it with the input field (2010) (e.g., an adjacent area at the bottom of the input field (2010)). In one embodiment, the extensibility object (2070) may be provided together with the adjustment object (2040) and the refresh object (2050), or may be provided independently without the adjustment object (2040) and the refresh object (2050).

[0328] In one embodiment, the exisitance object (2070) may represent an object for toggling the function of changing (or processing) the conversational tone of an AI-recommended answer (e.g., the first recommendation information (2030)) into a conversational tone (e.g., conversational tone such as similar words, similar phrases, similar tones, and / or similar intonations that the user uses in conversations with the other user) based on the user context (e.g., conversational patterns between the user and the other user). For example, based on the activation (e.g., “O” object ON / “X” object OFF) or deactivation (e.g., “O” object OFF / “X” object ON) of the exisitance object (2070), the user may share the first recommendation information (2030), which is an AI-recommended answer, or may hide the assistance provided by the AI ​​and share the second recommendation information (2060), which is an answer changed to resemble something entered directly by the user.

[0329] According to one embodiment, a user may perform a user input (e.g., a touch gesture such as tapping (or touching) the extrinsic object (2070)) on the “O” object or the “X” object of the extrinsic object (2070) to receive a recommendation for the first recommendation information (2030) provided through the input field (1910) as another second recommendation information (2060). According to one embodiment, based on an activation selection (e.g., selecting the “O” object) of the extrinsic object (2070), the user may receive the first recommendation information (2030) recommended by the AI ​​as second recommendation information (2060) changed into a user context-based conversational form.

[0330] According to one embodiment, as illustrated in FIG. 20b, the electronic device (101) may process the recommended content based on the first recommended information (2030) and the user context through AI based on detecting a user input through the identity object (2070) and change it into second recommended information (2060) and provide it (e.g., display it). For example, the electronic device (101) may change the first recommended information (2030) such as “I recently went to Gwanggyo A Shopping Mall and it was good for shopping because there were a lot of clothing stores. I also heard that the newly opened B Shopping Mall in Gwanggyo is good because there are a lot of desserts and good restaurants.” into second recommended information (2060) such as “I went to Gwanggyo to play last time and bought a new item at A Shopping Mall. How about doing some shopping at A Shopping Mall and having lunch at B Shopping Mall?” and provide it in the input field (2010). For example, the electronic device (101) may change the first recommendation information (2030) of the honorific conversational tone to the second recommendation information (2060) of the user conversational tone used between the user and the other user based on the user context. According to one embodiment, the electronic device (101) may regenerate the second recommendation information (2060) and provide it to the user based on the context of the previous utterances between the users in the conversation field (20220) and the characteristic words (e.g., 'Gwanggyo' and 'shopping') through AI.

[0331] According to one embodiment, when a user requests regeneration of recommendation information using an extrinsic object (2070) (e.g., when the user wants a response in the same user dialogue format as the user has written), the user may request automatic generation by selecting (e.g., tapping) the extrinsic object (2070), or may request the user to input a desired request (e.g., input a voice command) while pressing the extrinsic object (2070). According to one embodiment, the electronic device (101) may receive and detect a voice command according to a user utterance while a user input is detected in the extrinsic object (2070), and may generate and provide second recommendation information (2060) corresponding to the user request according to the voice command.

[0332] FIGS. 21A and 21B are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0333] According to one embodiment, FIGS. 21A and 21B may illustrate an example in which a user adds a search range of data (e.g., source data) for the AI ​​to search (or retrieve) when the user receives recommendation information from the AI. According to one embodiment, when searching for data for recommendation information through the AI, the electronic device (101) may search within a first designated range, perform a search within a second designated range different from the first designated range based on data specified by the user, and generate (or regenerate or process) recommendation information based on the searched data.

[0334] According to one embodiment, as illustrated in FIG. 21A, the electronic device (101) may provide first recommendation information (2130) generated based on AI based on content (e.g., conversation contents of a user and / or a counterpart user) provided through a dialogue field (2120) of the interactive service, through an input field (2110) of the interactive service. According to one embodiment, the electronic device (101) may provide a refresh object (2150) (e.g., an “R” button) related to a request for change (or refresh) of the recommendation information through a designated area within the input field (2110). According to one embodiment, the electronic device (101) may provide a range setting object (2170) that allows the AI ​​to add or remove data to be searched for the recommendation information, by associating it with the input field (2110) (e.g., an area adjacent to the bottom of the input field (2110). In one embodiment, the scope setting object (2170) may include functionality that allows the AI ​​to adjust the search scope for data (e.g., source data) to reference (or access) when generating a recommended answer.

[0335] According to one embodiment, the range setting object (2170) may include at least one indicator (2171) that provides information about related data so that a user can adjust the search range. In one embodiment, the indicator (2171) may be provided based at least on an identifier (e.g., text, an icon, an image, and / or a symbol) that may represent (or that may be identifiable by a user) an application, function, and / or service. For example, the indicator (2171) may be represented by a representative name, a representative icon, a representative image, and / or a representative symbol indicating an application, function, or service. In one embodiment, FIGS. 21A and 21B illustrate an example of providing an indicator (2171) using a representative name as an identifier based on text. For example, in FIG. 21A, the indicator (2171) may illustrate an example of providing a text-based identifier representing the representative names of applications, such as “A,” “B,” and “C.” According to one embodiment, the electronic device (101) can extract data related to feature words from source data related to application “A,” application “B,” and application “C” through AI, and provide first recommendation information (2130).

[0336] According to one embodiment, the range setting object (2170) may include a selection object (2173) for toggling activation or deactivation of the indicator (2171). The selection object (2173) may be provided for each indicator (2171). For example, the user may activate (e.g., “O” object ON / “X” object OFF) data corresponding to the indicator (2171) to be included in the recommendation information, or deactivate (e.g., “O” object OFF / “X” object ON) data corresponding to the indicator (2171) to be excluded from the recommendation information. According to one embodiment, the electronic device (101) may determine a search range of data to be searched by the AI ​​for the first recommendation information (2130) based on the activation / deactivation setting of the selection object (2173) for each indicator (2171). According to one embodiment, the electronic device (101) may provide first recommendation information (2130) related to a feature word based on data corresponding to a search range through AI.

[0337] According to one embodiment, a user may perform a user input (e.g., a touch gesture such as tapping (or touching) a selection object (2173)) on an “O” object or an “X” object of a range setting object (2170). According to one embodiment, the electronic device (101) may generate (or process) an answer by including data (e.g., information generated based on the corresponding data) related to an application (or function or service) corresponding to the corresponding indicator in the first recommendation information (2130) recommended by the AI ​​based on an activation selection (e.g., selection of the “O” object) of the selection object (2173). According to one embodiment, the electronic device (101) may generate (or process) an answer by excluding data (e.g., information generated based on the corresponding data) related to an application corresponding to the corresponding indicator from the first recommendation information (2130) recommended by the AI ​​based on an inactivation selection (e.g., selection of the “X” object) of the selection object (2173).

[0338] In one embodiment, the scope setting object (2170) may include an add object (2175) (e.g., a “+” button) that allows a user to add a search scope. For example, the electronic device (101) may support the user to add an application, function, or service for the AI ​​to search for based on the add object (2175). In one embodiment, the user may add a target application, function, or service for the AI ​​to search for recommendation information through a user input (e.g., a touch gesture such as a touch or tap) based on the add object (2175).

[0339] According to one embodiment, when the electronic device (101) detects (or receives) a user input through the ad object (2175), the AI ​​may provide a list (2180) related to additionally searchable applications, functions, and / or services. According to one embodiment, the list (2180) may be provided as a pop-up window on a conversation screen. For example, the electronic device (101) may provide the list (2180) in a pop-up format on a conversation field (2120). According to one embodiment, the list (2180) may be provided based at least on an identifier (i.e., indicator) (e.g., text, an icon, an image, and / or a symbol) that may represent (or that may be identifiable by a user) an application, function, and / or service. For example, in FIG. 21A, the list (2180) may represent an example of providing identifiers based on text that represents representative names of applications, such as “D”, “E”, “F”, “G”, and “H”. In one embodiment, the list (2180) may include a list (e.g., a list of apps) of applications, functions, and / or services from which the AI ​​can obtain (or collect) data for recommendation information.

[0340] According to one embodiment, a user may select at least one identifier corresponding to an application, function, or service to be further searched by AI from the list (2180) and add it as a new indicator to the scope setting object (2170). For example, the user may adjust (e.g., change) a search range to be searched by AI by adding it as an indicator to the scope setting object (2170). According to one embodiment, when an object (e.g., a “D” object) to be added from the list (2180) to the scope setting object (2170) is selected (e.g., an add command for the selected object is completed), the electronic device (101) may add and display a new indicator related to the selected object (e.g., the “D” object) based on the area of ​​the scope setting object (2170). An example of this is illustrated in FIG. 21B.

[0341] According to one embodiment, as illustrated in FIG. 21b, the electronic device (101) may determine an application, function, and / or service corresponding to an object (e.g., a “D” object) selected by the user input based on detecting the user input through the list (2180). According to one embodiment, based on the result of the determination, the electronic device (101) may add and provide a corresponding indicator (2190) as a range setting object (2170).

[0342] According to one embodiment, the electronic device (101) may generate (or process) an answer by including data (e.g., information generated based on the data) related to an application (or function or service) corresponding to the indicator (2190) in the first recommendation information (2130) recommended by AI based on the addition of the indicator (2190). For example, the electronic device (101) may collect data related to characteristic words and user content from an application (or function or service) corresponding to the indicator (2190) through the AI. According to one embodiment, the electronic device (101) may process the recommendation content of the first recommendation information (2130) based on the related data through the AI ​​and provide (e.g., display) the second recommendation information (2160) by changing it.

[0343] In one embodiment, when the indicator (2190) relates to a “gallery,” the electronic device (101) may search for data related to a feature word (e.g., visual images such as icons, photos, videos, and / or animated objects) from the gallery, and provide second recommendation information (2160) including at least one searched data (e.g., visual images (2165)) and related recommendation content (2163). For example, the electronic device (101) may change the first recommendation content (2161) of the first recommendation information (2130) to second recommendation information (2160) that further includes second recommendation content (2163) based on at least one data, and provide the second recommendation information (2160) to the input field (2110). In one embodiment, according to the example of FIG. 21B, the second recommendation content (2163) may further include a visual element (2165).

[0344] According to one embodiment, the electronic device (101) may support the user to directly adjust the range of target data to be searched by the AI ​​using the range setting object (2170). For example, the user may adjust the range of target data for recommendation information by adding or excluding desired applications, functions, and / or services using the range setting object (2170). According to one embodiment, the electronic device (101) may generate (e.g., change) and provide second recommendation information (2160) corresponding to the user's request from the first recommendation information (2130) based on an indicator specified by the user in the range setting object (2170).

[0345] FIGS. 22A and 22B are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0346] According to one embodiment, FIGS. 22A and 22B may illustrate an example in which a user adds a search range of data (e.g., source data) for the AI ​​to search (or retrieve) when the user receives recommendation information from the AI. According to one embodiment, when searching for data for recommendation information through the AI, the electronic device (101) may search within a first designated range, perform a search within a second designated range different from the first designated range based on data specified by the user, and generate (or regenerate or process) recommendation information based on the searched data.

[0347] According to one embodiment, as illustrated in FIG. 22A, the electronic device (101) may provide first recommendation information (2230) generated based on AI based on content (e.g., conversation contents of a user and / or a counterpart user) provided through a conversation field (2220) of the interactive service, through an input field (2210) of the interactive service. According to one embodiment, the electronic device (101) may provide a refresh object (2150) (e.g., an “R” button) related to a request for change (or refresh) of the recommendation information, through a designated area within the input field (2210). According to one embodiment, the electronic device (101) may provide a range setting object (2270) that allows the AI ​​to add or remove data to be searched for the recommendation information, by associating it with the input field (2210) (e.g., an area adjacent to the bottom of the input field (2210). In one embodiment, the scope setting object (2270) may include functionality that allows the AI ​​to adjust the search scope for data (e.g., source data) to reference (or access) when generating a recommended answer.

[0348] According to one embodiment, the range setting object (2270) may include at least one indicator that provides information about related data so that a user can adjust the search range. In one embodiment, the indicator may be provided based at least on an identifier (e.g., text, an icon, an image, and / or a symbol) that may represent (or that may be identifiable by a user) an application, function, and / or service. For example, the indicator may be represented by a representative name, a representative icon, a representative image, and / or a representative symbol that indicates an application, function, or service. In one embodiment, FIGS. 22A and 22B illustrate an example of providing an indicator in the form of a bubble using a representative name as an identifier based on text. For example, in FIG. 22A, the indicator (2171) may be provided based on a bubble that includes text representing the representative names of applications, such as “A”, “B”, “C”, “D”, “AA”, “BB”, “CC”, and “DD”. According to one embodiment, the electronic device (101) may extract data related to a feature word from source data related to an application (e.g., application “A,” application “B,” and application “C”) related to an activated indicator through AI, and provide first recommendation information (2230).

[0349] According to one embodiment, each indicator of the range setting object (2270) can be toggled to be activated or deactivated based on a user input (e.g., a touch gesture such as a touch (or tap)). For example, the user can activate (e.g., turn indicator ON) data corresponding to the indicator of the range setting object (2270) to include data corresponding to the indicator in the recommendation information, or deactivate (e.g., turn indicator OFF) data corresponding to the indicator to exclude data corresponding to the indicator from the recommendation information. According to one embodiment, the electronic device (101) can determine a search range of data to be searched by the AI ​​for the first recommendation information (2230) based on the activation / deactivation setting for each indicator (2171). According to one embodiment, the electronic device (101) can provide first recommendation information (2230) related to a feature word based on data corresponding to the search range through the AI.

[0350] According to one embodiment, a user may perform a user input (e.g., a touch gesture such as tapping (or touching) an indicator) on each indicator of a range setting object (2270). According to one embodiment, the electronic device (101) may generate (or process) an answer by including data (e.g., information generated based on the data) related to an application (or function or service) corresponding to the corresponding indicator in the first recommended information (2230) recommended by AI based on an activation selection of the indicator. According to one embodiment, the electronic device (101) may generate (or process) an answer by excluding data (e.g., information generated based on the data) related to an application corresponding to the corresponding indicator from the first recommended information (2230) recommended by AI based on an inactivation selection of the indicator.

[0351] In one embodiment, a user may add or exclude target applications, features, or services for the AI ​​to explore for recommendation information through user input (e.g., a touch gesture such as a touch or tap) to activate an indicator.

[0352] According to one embodiment, the electronic device (101) may adjust (e.g., change) the search range to be searched by the AI ​​when a user input activating the corresponding indicator is detected (or received) through the indicator. According to one embodiment, the electronic device (101) may select any one of the indicators (e.g., the “AA” object) that is deactivated in the range setting object (2270), activate the selected indicator (e.g., the “AA” object) in the range setting object (2270), and provide recommendation information including related data. An example of this is illustrated in FIG. 22b.

[0353] According to one embodiment, as illustrated in FIG. 22b, the electronic device (101) may determine an application, function, and / or service corresponding to an object (e.g., an “AA” object) selected by the user input based on detecting a user input through an indicator (2290) of a range setting object (2270) (e.g., an “AA” object). According to one embodiment, the electronic device (101) may activate and provide a corresponding indicator (2290) in the range setting object (2270) based on the determination result.

[0354] According to one embodiment, the electronic device (101) may generate (or process) an answer by including data (e.g., information generated based on the data) related to an application (or function or service) corresponding to the indicator (2290) in the first recommendation information (2230) recommended by AI based on the additional activation of the indicator (2290). For example, the electronic device (101) may collect data related to characteristic words and user content from an application (or function or service) corresponding to the indicator (2290) through AI. According to one embodiment, the electronic device (101) may process the recommendation content of the first recommendation information (2230) based on the related data through AI and provide (e.g., display) the second recommendation information (2260) by changing it.

[0355] In one embodiment, when the indicator (2290) relates to a “gallery,” the electronic device (101) may search for data related to a feature word (e.g., visual images such as icons, photos, videos, and / or animated objects) from the gallery, and provide second recommendation information (2260) including at least one searched data (e.g., visual images (2265)) and related recommendation content (2263). For example, the electronic device (101) may change the first recommendation content (2261) of the first recommendation information (2230) to second recommendation information (2260) that further includes second recommendation content (2263) based on at least one data, and provide the second recommendation information (2260) to the input field (2110). In one embodiment, according to the example of FIG. 22B, the second recommendation content (2263) may further include a visual element (2265).

[0356] According to one embodiment, the electronic device (101) may support the user to directly adjust the range of target data to be searched by the AI ​​using the range setting object (2270). For example, the user may adjust the range of target data for recommendation information by adding or excluding desired applications, functions, and / or services using the range setting object (2270). According to one embodiment, the electronic device (101) may generate (e.g., change) and provide second recommendation information (2260) corresponding to the user's request from the first recommendation information (2230) based on an indicator specified by the user in the range setting object (2270).

[0357] FIGS. 23a, 23b, and 23c are diagrams illustrating examples of providing recommendation information in an electronic device according to one embodiment of the present disclosure.

[0358] According to one embodiment, FIGS. 21A, 23B, and 23C illustrate examples of assisting a user in processing recommended information (e.g., recommended answers) recommended (or generated) by AI. For example, FIGS. 21A, 23B, and 23C illustrate examples of adjusting the conversational tone with a partner user when composing a conversation with assistance from AI.

[0359] According to one embodiment, as illustrated in FIG. 23a, the electronic device (101) may provide first recommendation information (2330) generated based on AI based on content (e.g., conversation contents of a user and / or a counterpart user) provided through a conversation field (2320) of the interactive service, through an input field (2310) of the interactive service. According to one embodiment, the electronic device (101) may provide an adjustment object (2340) (or a visual element) related to tone (and / or inflection) adjustment by associating it with the input field (2310) (e.g., an area adjacent to the bottom of the input field (2310)). In one embodiment, as illustrated in FIGS. 23a, 23b, and 23c, the adjustment object (2340) may represent an example in which an object is provided in a form in which tone and / or infancy can be adjusted in three stages based on relationship information and / or intimacy.

[0360] According to one embodiment, the user may perform a user input (e.g., an input for step adjustment, for example, a touch gesture such as touching and swiping the adjustment object (2340)) to the adjustment object (2340) to receive stepwise recommendations for a first tone of voice (e.g., friendly tone of voice: low) with respect to the counterpart user according to the first recommendation information (2330) provided through the input field (2310), to a second tone of voice (e.g., friendly tone of voice: medium) or a third tone of voice (e.g., friendly tone of voice: high). According to one embodiment, the user may adjust the tone of voice of the recommendation information (e.g., the first recommendation information (2330)) recommended by the AI ​​through stepwise adjustment using the adjustment object (2340) to receive recommendation information (e.g., the second recommendation information (2350) or the third recommendation information (2370)) having a different tone of voice. In one embodiment, the first recommendation information (2330), the second recommendation information (2350), and the third recommendation information (2370) may generally contain the same content (or meaning or interpretation), and may have different tones / inflections depending on the adjustment level (e.g., low, medium, or high) of the adjustment object (2340).

[0361] According to one embodiment, as illustrated in FIG. 23b, the electronic device (101) may, based on detecting a user input through an adjustment object (2340), process the recommendation content based on the first recommendation information (2330) and the user context through AI and provide (e.g., display) the second recommendation information (2350). For example, the electronic device (101) may change the first recommendation information (2330) based on the first tone / speech according to the first stage (e.g., friendly tone / speech: low) of the adjustment object (2340), such as “The shopping mall I recently visited in Gwanggyo is Shopping Mall A, and it has many clothing stores, so it’s a good place to shop for clothes. And the newly opened and recently popular shopping mall is Shopping Mall B, and it has many desserts and foods, so it’s a good place to eat delicious food.” into the second recommendation information (2350) based on the second tone / speech according to the second stage (e.g., friendly tone / speech: medium) of the adjustment object (2340), such as “I recently went to Shopping Mall A in Gwanggyo, and it’s a good place to shop for clothes, so it’s a good place to shop for clothes! And the newly opened and recently popular shopping mall is Shopping Mall B, and it has many desserts and foods, so it would be nice to eat delicious food with you!”, and provide the information to the input field (2310). For example, the electronic device (101) may change the first recommendation information (2330) in a polite conversational tone based on the user context into the second recommendation information (2350) in a more friendly expression depending on the user conversational tone (e.g., tone / intonation) used between the user and the other user. According to one embodiment, the electronic device (101) may regenerate the second recommendation information (2350) through AI based on the context according to the characteristic words (e.g., 'Gwanggyo' and 'shopping') and previous utterances between the users in the conversation field (2320) and provide it to the user.

[0362] According to one embodiment, as illustrated in FIG. 23c, the electronic device (101) may, based on detecting a user input through an adjustment object (2340), process the recommendation content based on the second recommendation information (2350) and the user context through AI and provide (e.g., display) the third recommendation information (2370). For example, the electronic device (101) may change the second recommendation information (2350) based on the second tone / speech according to the second stage (e.g., friendly tone / speech: medium) of the adjustment object (2340), such as “I recently went to shopping mall A in Gwanggyo. It has a lot of clothing stores, so it’s a good place to shop for clothes! Also, a newly opened and recently popular shopping mall is B. It has a lot of desserts and food, so it would be nice to eat something delicious with you!” into the third recommendation information (2370) based on the third tone / speech according to the third stage (e.g., friendly tone / speech: high) of the adjustment object (2340), such as “I went to shopping mall A in Gwanggyo last week. It had a lot of hip clothing stores. I want to go shopping for clothes with you! Also, I heard that a newly opened and recently popular shopping mall B is famous for its dessert stores. I want to eat something delicious with you there!”, and provide the information to the input field (2310). For example, the electronic device (101) may change the second recommendation information (2350) of the medium-intimacy conversational tone based on the user context into the third recommendation information (2370) of a more intimacy expression based on the user conversational tone (e.g., tone / intonation) used between the user and the other user. According to one embodiment, the electronic device (101) may regenerate the third recommendation information (2370) and provide it to the user based on the context according to the characteristic words (e.g., 'Gwanggyo' and 'shopping') and previous utterances between the users in the conversation field (2320) through AI.

[0363] An operation method performed in an electronic device (101) according to one embodiment of the present disclosure may include an operation of displaying an execution screen of an interactive service. According to one embodiment, the operation method may include an operation of detecting a feature point from content input while performing the interactive service. According to one embodiment, the operation method may include an operation of determining relationship information with at least one other user participating in the interactive service. According to one embodiment, the operation method may include an operation of determining an access level to user information based on the relationship information. According to one embodiment, the operation method may include an operation of acquiring at least a portion of the user information and / or general information based on the access level. According to one embodiment, the operation method may include an operation of generating recommendation information related to the feature point based on the acquired information. According to one embodiment, the operation method may include an operation of providing the recommendation information.

[0364] According to one embodiment, the method may include an operation of displaying the content in a dialogue field while performing the interactive service. According to one embodiment, the method may include an operation of detecting the feature point from the content displayed in the dialogue field. According to one embodiment, the method may include an operation of executing an artificial intelligence-based answer function based on the detection of the feature point. According to one embodiment, the method may include an operation of generating the recommendation information based at least on the user information and the general information in the artificial intelligence-based answer function.

[0365] According to one embodiment, the executing operation may include an operation of providing a notification object related to the artificial intelligence-based answer function in association with an input field of the interactive service based on executing the artificial intelligence-based answer function.

[0366] According to one embodiment, the notification object may include an object that indicates a status of whether the artificial intelligence-based answering function is operating and supports a toggle for activating or deactivating the artificial intelligence-based answering function.

[0367] In one embodiment, the method may include providing the recommendation information to an input field of the interactive service. In one embodiment, the method may include editing or transmitting the recommendation information based on a user input while the recommendation information is provided through the input field.

[0368] According to one embodiment, the interactive service may be provided including a coordination object for information coordination.

[0369] According to one embodiment, the operating method may include an operation of changing and providing the recommendation information according to a step corresponding to the adjustment object based on a user input using the adjustment object.

[0370] According to one embodiment, the method of operation may include a service that supports communication between users through an application for conversation between two or more remote parties (e.g., a messaging service, a chat service, an SNS, an e-mail service).

[0371] In one embodiment, the content may include text or images provided through a conversation field of the interactive service.

[0372] According to one embodiment, the feature points may include meaningful words and / or meaningful image objects that can be extracted from the content.

[0373] A non-transitory computer-readable recording medium storing instructions, which, when executed by a processor (120) of an electronic device (101) according to one embodiment of the present disclosure, cause the processor (120) to perform operations, may include instructions, which, when executed by the processor, cause the electronic device to perform an operation of displaying an execution screen of an interactive service, an operation of detecting a feature point from content input while performing the interactive service, an operation of determining relationship information with at least one counterpart user participating in the interactive service, an operation of determining an access level to user information based on the relationship information, an operation of acquiring at least a portion of the user information and / or general information based on the access level, an operation of generating recommendation information related to the feature point based on the acquired information, and an operation of providing the recommendation information.

[0374] It will be appreciated that the above-described embodiments and their technical features may be combined with each other in any and all combinations, as long as there is no potential conflict between the two embodiments or features. For example, any and all combinations of two or more of the above-described embodiments may be envisioned and incorporated within the present disclosure. One or more features from any embodiment may be incorporated into any other embodiment, providing a corresponding advantage or advantages.

[0375] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0376] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0377] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0378] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0379] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0380] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0381] The various embodiments of the present disclosure disclosed in this specification and drawings are merely specific examples to facilitate easy explanation of the technical content of the present disclosure and aid understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be interpreted to include all modifications or variations derived based on the technical concepts of the present disclosure, in addition to the embodiments disclosed herein.

Claims

1. In electronic devices, display; Memory for storing instructions; and comprising processing circuitry, and at least one processor operatively connected to the display and the memory; The above instructions, when executed by the at least one processor, cause the electronic device to: Displays the execution screen of the interactive service, Detecting feature points from input content while performing the above interactive service, Determine relationship information with at least one other user participating in the above interactive service, Determine the level of access to user information based on the above relationship information, Obtain at least some of the user information and / or general information based on the above access level, Generate recommended information related to the above feature points based on the acquired information, and An electronic device that provides the above recommended information.

2. In paragraph 1, The above content includes text or images provided through the conversation field of the above interactive service, An electronic device wherein the above features include meaningful words and / or meaningful image objects that can be extracted from the content.

3. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, Display the above content in the conversation field while performing the above interactive service, Detecting the feature points from the content displayed in the above dialogue field, Executes an AI-based answer function based on detecting the above features, An electronic device that generates the recommended information based at least on the user information and the general information in the artificial intelligence-based answer function.

4. In the third paragraph, when the instructions are executed by the at least one processor, the electronic device, Based on executing the above AI-based answer function, a notification object related to the AI-based answer function is provided in association with the input field of the above conversational service, An electronic device, wherein the notification object includes an object that indicates a status of whether the artificial intelligence-based answering function is operating and supports toggling of activation or deactivation of the artificial intelligence-based answering function.

5. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, Provide the above recommendation information in the input field of the above interactive service, An electronic device that edits or transmits said recommendation information based on user input while said recommendation information is provided through said input field.

6. In the fifth paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: An electronic device that allows the recommended information to be edited at least based on direct input by a user, changing the amount of information by adjusting the information disclosure stage based on a control object, or selecting sub-information from a list of sub-information that can replace the main information.

7. In the fifth paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: While the above recommendation information is provided through the above input field, based on the user input, the above recommendation information is transmitted to the electronic device of the other user, An electronic device that provides the above recommendation information through a dialogue field of the above interactive service.

8. In paragraph 1, The above interactive service includes a coordination object for information coordination, The above instructions, when executed by the at least one processor, cause the electronic device to: An electronic device that provides the recommended information by changing it according to a step corresponding to the adjustment object based on a user input using the adjustment object.

9. In the first paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: An electronic device that provides the above recommended information by distinguishing between a portion edited by a user and a portion automatically generated by artificial intelligence.

10. In the first paragraph, when the instructions are executed by the at least one processor, the electronic device, While the above recommendation information is provided through an input field, a list related to at least one sub-information that can replace the main information related to the feature point is provided, Detect user input selecting sub-information from the above list, An electronic device that provides the main information by replacing it with the selected sub-information based on the user input.

11. In the 10th paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: An electronic device providing the above list between an input field and a keyboard area, or instead of the keyboard area.

12. In the method of operating an electronic device, An action that displays the execution screen of an interactive service; An action of detecting feature points from input content while performing the above interactive service; An action for determining relationship information with at least one opposing user participating in the above interactive service; An action for determining the level of access to user information based on the above relationship information; An action to obtain at least a portion of the user information and / or general information based on the access level; An operation of generating recommendation information related to the feature point based on the acquired information; and A method comprising the action of providing the above recommendation information.

13. In paragraph 12, An action to display the above content in a conversation field while performing the above interactive service; An action of detecting the feature point from the content displayed in the above dialogue field; An action to execute an artificial intelligence-based answer function based on detecting the above-mentioned features; A method including an action of generating the recommendation information based at least on the user information and the general information in the artificial intelligence-based answer function.

14. In paragraph 13, the executing operation is: Based on executing the above artificial intelligence-based answer function, the method comprises providing a notification object related to the artificial intelligence-based answer function in association with an input field of the conversational service, A method wherein the above notification object includes an object that indicates a status of whether the artificial intelligence-based answering function is operating and supports toggling of activation or deactivation of the artificial intelligence-based answering function.

15. A non-transitory computer-readable recording medium storing instructions that, when executed individually or collectively by a processor of an electronic device, cause the processor to perform operations, The above instructions, when executed by the processor, cause the electronic device to: Action to display the execution screen of an interactive service; An action of detecting feature points from input content while performing the above interactive service; An action for determining relationship information with at least one other user participating in the above interactive service; An action to determine the level of access to user information based on the above relationship information; An action to obtain at least a portion of the user information and / or general information based on the above access level; An operation for generating recommendation information related to the above feature points based on the acquired information, and A computer-readable recording medium that causes a computer to perform an action of providing the above recommendation information.

Images