Method for providing summary content and electronic device therefor

Abstract

An embodiment of the present invention may comprise a display, a processor, and a memory. When executed by the processor, instructions stored in the memory may instruct an electronic device to: identify a screen size of at least a portion of a user interface (UI) screen for displaying summary content and a font size to be used to display the summary content; identify the length of text for the summary content on the basis of the screen size and the font size; transmit a request, including first information related to the summary content and second information related to the length of the text associated with the summary content, to a server on the basis of a user input; acquire the summary content, in association with the request, from the server; and display at least a portion of the user interface screen via the display on the basis of the acquired summary content.

Description

Method for providing summary content and electronic device thereof

[0001] Various embodiments of the present invention disclose a method for providing summary content and an electronic device thereof.

[0002] With the advancement of digital technology, various types of electronic devices, such as mobile terminals, personal digital assistants (PDAs), electronic notebooks, smartphones, tablet PCs (personal computers), and wearable devices, are becoming widely used. These electronic devices are constantly undergoing improvements in their hardware and / or software to support and enhance their functionality.

[0003] For example, electronic devices are being designed to provide users with various services through larger screens by implementing progressively larger screen sizes on their displays. These electronic devices may have new form factors, such as multi-display (e.g., dual display) devices (e.g., foldable electronic devices, rollable devices, or slideable devices). Foldable electronic devices are equipped with displays that fold (or bend) (e.g., foldable displays or flexible displays) and can be used by folding or unfolding. Rollable devices or slideable devices are equipped with flexible displays and can be used by rolling up the flexible display to the back of the rollable device or by extending the flexible display to the front of the rollable device.

[0004] Products with various form factors are being released, and the resulting display sizes that provide users with results are becoming more diverse. However, due to the display size, additional user input may ultimately be required to obtain accurate information. Techniques for understanding language and summarizing long sentences or condensing content through large language models (LLMs) are advancing. However, it can be costly to go through LLM servers every time a summary is needed.

[0005] In one embodiment, a method and device for identifying the length of text based on the size and font size of the screen on which the content is to be displayed, and generating (or receiving) summary content based on the length of the text and providing the summary content instead of the original content may be disclosed.

[0006] According to one embodiment of the present disclosure, an electronic device (101) includes a display (160), a processor (120); and instructions stored in a memory (130), which, when the processor is executed, cause the electronic device to identify a screen size of at least a portion of a user interface (UI) screen for displaying summary content and a font size to be used for displaying the summary content, identify a length of text for the summary content based on the screen size and the font size, transmit a request to a server based on a user input, including first information related to the summary content and second information related to the length of the text related to the summary content, obtain summary content in association with the request from the server, and display at least a portion of the user interface screen through the display based on the obtained summary content.

[0007] According to an embodiment of the present disclosure, a method of operating an electronic device (101) may include an operation of identifying a screen size of at least a portion of a user interface (UI) screen for displaying summary content and a font size to be used for displaying the summary content, an operation of identifying a length of text for the summary content based on the screen size and the font size, an operation of transmitting a request to a server based on a user input, the request including first information related to the summary content and second information related to the length of the text related to the summary content, an operation of obtaining summary content in association with the request from the server, and an operation of displaying at least a portion of the user interface screen on a display of the electronic device based on the obtained summary content.

[0008] According to one embodiment, when processing of a large language model (LLM) is required, the size of the screen (or window, display) on which the content is to be displayed is determined, and the length (or size, amount) of the summary content suitable for the screen size is determined, and the summary content can be requested from the LLM server.

[0009] In one embodiment, it is possible to identify how much of the original content to summarize based on the length of the text.

[0010] In one embodiment, by determining whether on-device processing is possible and generating summary content directly on the electronic device, the LLM server does not need to be used each time, thereby reducing server usage costs.

[0011] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0012] FIG. 2 is a diagram illustrating examples of various screen sizes of an electronic device according to one embodiment.

[0013] FIG. 3 is a flowchart illustrating an operating method of an electronic device according to one embodiment.

[0014] FIG. 4 is a diagram illustrating an example for setting an application-specific summary in an electronic device according to one embodiment.

[0015] FIG. 5 is a diagram illustrating an example of providing summary content in an electronic device according to one embodiment.

[0016] FIGS. 6A and 6B are diagrams illustrating an example of providing summary content in an electronic device according to one embodiment.

[0017] FIG. 7 is a flowchart illustrating an operation method between an electronic device and a server according to one embodiment.

[0018] FIG. 8 is a flowchart illustrating a method for providing summary content in an electronic device according to one embodiment.

[0019] FIG. 9A is a diagram illustrating an example of setting a font size in an electronic device according to one embodiment.

[0020] FIGS. 9b and 9c are diagrams illustrating an example of providing summary content in an electronic device according to one embodiment.

[0021] FIG. 10A is a drawing illustrating an example of displaying original content and summary content in an electronic device according to one embodiment.

[0022] FIG. 10b is a drawing illustrating an example of displaying original content and summary content in an electronic device according to one embodiment.

[0023] FIG. 11A is a diagram illustrating an example of changing from summary content to original content in an electronic device according to one embodiment.

[0024] FIG. 11b is a diagram illustrating an example of comparing summary content and original content in an electronic device according to one embodiment.

[0025] FIG. 12A is a diagram illustrating an example of changing and displaying summary content to original content in an electronic device according to one embodiment.

[0026] FIG. 12b is a diagram illustrating an example of displaying summary content differently depending on the font size in an electronic device according to one embodiment.

[0027] FIGS. 13a and 13b are diagrams illustrating an example of displaying summary content differently depending on the screen size in an electronic device according to one embodiment.

[0028] FIG. 14 is a flowchart illustrating a method for obtaining summary content in an electronic device according to an embodiment.

[0029] FIG. 15A is a diagram illustrating an example of guiding the display of summary content in an electronic device according to one embodiment.

[0030] FIG. 15b is a diagram illustrating an example of guiding the display of summary content in an electronic device according to one embodiment.

[0031] FIG. 16A is a diagram illustrating an example of displaying summary content in an electronic device while connected to another electronic device according to one embodiment.

[0032] FIG. 16b is a diagram illustrating an example of displaying summary content according to a screen size in an electronic device according to one embodiment.

[0033] FIGS. 17A to 17D are diagrams illustrating an example of displaying summary content according to an area size within an application in an electronic device according to one embodiment.

[0034] FIGS. 18a and 18b are diagrams illustrating an example of displaying summary content according to a screen size in an electronic device according to one embodiment.

[0035] FIG. 19 is a diagram illustrating an example of displaying summary content according to a screen size in an electronic device according to one embodiment.

[0036] FIG. 20A is a diagram illustrating an example of a prompt related to the generation of summary content in an electronic device according to one embodiment.

[0037] FIG. 20b is a diagram illustrating an example of learning a model for generating summary content in an electronic device according to an embodiment.

[0038] FIGS. 21A and 21B are drawings illustrating examples of screen sizes for displaying summary content in an electronic device according to one embodiment.

[0039] FIGS. 22A to 22C are drawings illustrating examples of electronic devices having various screen sizes according to one embodiment.

[0040] FIG. 23 is a block diagram illustrating an example of a generative artificial intelligence system according to one embodiment.

[0041] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0042] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0043] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0044] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0045] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0046] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0047] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0048] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0049] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor for detecting a touch, or a pressure sensor for measuring the strength of a force generated by the touch.

[0050] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0051] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0052] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0053] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0054] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0055] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0056] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0057] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0058] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0059] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0060] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0061] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0062] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0063] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0064] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0065] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish the corresponding component from other corresponding components and do not limit the corresponding components in any other respect (e.g., importance or order). When a component (e.g., a first) is referred to as "coupled" or "connected" to another (e.g., a second) component, with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0066] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0067] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0068] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0069] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0070] FIG. 2 is a diagram illustrating examples of various screen sizes of an electronic device according to one embodiment.

[0071] Referring to FIG. 2, an electronic device according to an embodiment (e.g., the electronic device (101) of FIG. 1) may include displays having various sizes or shapes. For example, a first example (210) may be an example of an electronic device including one display having a rectangular shape. A second example (230) may be an example of an electronic device including at least two displays, wherein the size of one display may be larger than the size of the display included in the electronic device of the first example (210). A third example (250) may be an example of a wearable device including a circular display. A fourth example (270) may be an example of an electronic device including at least two displays, wherein the size of one display may be smaller than the size of the display included in the electronic device of the first example (210). The fifth example (290) shows a state in which an electronic device (101) is connected to another electronic device (201) (e.g., a computer), and content can be displayed through the display of the electronic device (101) or the display of the other electronic device (201).

[0072] According to one embodiment of the present disclosure, an electronic device (101) may include instructions stored in a display (160), a processor (120), and a memory (130), such that when the processor is executed, the electronic device may identify a screen size of at least a portion of a user interface (UI) screen for displaying summary content and a font size to be used for displaying the summary content, identify a length of text for the summary content based on the screen size and the font size, transmit a request to a server based on a user input, the request including first information related to the summary content and second information related to the length of the text related to the summary content, obtain summary content in association with the request from the server, and display at least a portion of the user interface screen through the display based on the obtained summary content.

[0073] The above first information may include original content associated with the summary content or information for obtaining the original content.

[0074] The instructions, when executed by the processor, may cause the electronic device to identify at least one of the following: a size of one of multiple windows, a size of an activated display area of ​​the display, or a size of a specified content area within an application, as the size of the screen.

[0075] The instructions may cause the electronic device, when the processor is executed, to display the original content requested by the user if the original content is below a specified threshold for the screen size, and to identify the length of text for obtaining the summary content if the original content requested by the user exceeds the specified threshold for the screen size.

[0076] The above instructions, when the processor is executed, may cause the electronic device to determine whether generation of the summary content is possible, and if generation of the summary content is possible, to generate the summary content based on the length of the identified text.

[0077] The instructions may be configured such that when the processor is executed, the electronic device includes, in the second information, a size of an image or a number of images associated with the summary content, if the original content associated with the summary content includes an image.

[0078] The above instructions may cause the electronic device, when the processor is executed, to reconfigure and display the summary content based on the changed screen size when the size of the screen displaying the obtained summary content changes while displaying the summary content.

[0079] The above instructions, when executed by the processor, may control the electronic device to display original content following the summary content based on a user's scroll input.

[0080] The instructions, when executed by the processor, may cause the electronic device to display the summary content instead of the original content associated with the summary content based on application settings.

[0081] The instructions, when the processor is executed, may cause the electronic device to display an object indicating that the obtained summary content is the summary content while displaying the obtained summary content, and to display original content associated with the summary content instead of the summary content based on a user input selecting the object.

[0082] According to one embodiment of the present disclosure, an electronic device (101) includes a display (160), a processor (120); and instructions stored in a memory (130), which, when the processor is executed, cause the electronic device to identify a screen size of at least a portion of a user interface (UI) screen for displaying summary content and a font size to be used for displaying the summary content, identify a length of text for the summary content based on the screen size and the font size, identify content to be summarized based on a user input, generate summary content based on the content to be summarized and the length of the identified text, and display at least a portion of the user interface screen based on the generated summary content through the display.

[0083] Figure 3 is a flowchart (300) illustrating an operating method of an electronic device according to one embodiment.

[0084] Referring to FIG. 3, in operation 301, a processor (e.g., the processor 120 of FIG. 1) of an electronic device (e.g., the electronic device 101 of FIG. 1) according to an embodiment may identify a screen size and / or a font size. For example, the processor (120) may identify a screen size on which content is displayed on a display (e.g., the display module (160) of FIG. 1) of the electronic device (101). The processor (120) may identify a screen size of at least a portion of a user interface (UI) screen for displaying summary content and a font size to be used for displaying the summary content. The processor (120) may identify a screen size and / or a font size on which the requested content is to be displayed in response to a user's content request (e.g., a user query, a voice request). The requested content may include (or consist of) at least one of text, an image, or a video. The above screen size may be the size (or display size) of the area where the requested content is to be displayed (or the area where the content is displayed).

[0085] For example, when displaying multiple windows on the display of the electronic device (101) (e.g., the display module (160) of FIG. 1), if the processor (120) receives a content request from the user, the processor (120) may identify (or determine) the size of one of the multiple windows as the screen size. Alternatively, if the requested content should be displayed as a pop-up window, the processor (120) may identify the size of the pop-up window or the area where the content is displayed within the pop-up window as the screen size. Alternatively, if a cover (or case) is mounted on the electronic device (101), the processor (120) may identify the size of the activated (or exposed) display area of ​​the display module (160) by the cover among the entire display area of ​​the display module (160) as the screen size. The processor (120) may identify the size of a content area specified within an application as the screen size. For example, the content area specified within a message application may be a bubble area for displaying the contents of a single message. The size of the above bubble area may vary depending on the size of the display module (160) and may vary depending on the size of the activated display area of ​​the display module (160).

[0086] The above font size may be a font size set in the electronic device (101) or a font size set in the application. The processor (120) may identify the font size set in the electronic device (101) or the font size set in the application associated with the requested content. If the font size set in the electronic device (101) and the font size set in the application are different, the processor (120) may use the font size set in the application to determine the length of the text. The font size set in the application may have priority over the font size set in the electronic device (101).

[0087] In operation 303, the processor (120) may identify the length (or size) of the text. The length of the text may be a reference for providing summarized content that summarizes the original content. If the original content of the requested content exceeds a specified reference value (e.g., 1.2 times) of the screen size, the processor (120) may determine that the original content cannot be displayed on the requested screen and may determine whether to summarize it. The processor (120) may identify the length of the text based on the identified screen size and / or the identified font size. For example, identifying the length (or size) of the text may determine the size (length) of the summarized content to be displayed on the screen on which the content is to be displayed. For example, if the content is text, the number of characters that can be displayed on the screen may be determined based on the screen size and font size. According to one embodiment, if the content requested by the user (e.g., original content) includes images, the processor (120) may identify the size of the images or the number of images associated with the summary content.

[0088] When the font sizes are the same, the processor (120) can identify the length of the text as large (large) if the screen size is large, and can identify the length of the text as small (small) if the screen size is small. When the screen sizes are the same, the processor (120) can identify the length of the text as large (large) if the font size is large, and can identify the length of the text as small (small) if the font size is small.

[0089] The processor (120) may identify the length of the text by calculating the maximum number of characters that can be displayed on the screen based on the screen size and font size, or, if the original content includes images, may identify the length of the text by adjusting the maximum number of characters of the text to be shorter according to the number of images and the image size. In addition, the determined length of the text may be the maximum length, and the summary content may be smaller (shorter) than the determined length of the text.

[0090] In operation 305, the processor (120) may transmit first information and second information to a server (e.g., the server (108) of FIG. 1, the generative artificial intelligence system of FIG. 23). The server (108) may be a server to which a large language model (LLM) technology is applied. The first information may be related to the summary content, and the second information may be related to the length of the text. For example, the first information may include the original content itself or information (e.g., URL) for obtaining the original content. The processor (120) may inform the server (108) of what the original content requested by the user is. In addition, the processor (120) may request the summary content by including the length of the text in the second information and transmitting it to the server (108). The server (108) may generate the summary content based on the length of the text and the original content, and transmit the generated summary content to the electronic device (101).

[0091] In one embodiment, the summary content received from the server (108) may be equal to or less than (or shorter than) the length of the text. That is, the summary content may not exceed the length of the text. If the original content is generated in real time through generative AI, the processor (120) may transmit the length of the text to the server (108) without the original content. The generative AI server may be the same as the LLM server.

[0092] In operation 307, the processor (120) may obtain summary content from a server. The processor (120) may receive the summary content through a communication module (e.g., the communication module (190) of FIG. 1). The summary content may include (or be configured with) at least one of text, image, or video. The summary content may be generated directly in the electronic device (101) (e.g., on-device) or received from a large language model (LLM) server (e.g., the server (108) of FIG. 1). According to an embodiment, the processor (120) may determine whether on-device processing is possible, and if on-device processing is possible, the processor (120) may generate summary content. For example, the processor (120) may include an LLM management module, and may search for a small LM (large language) using the LLM management module (e.g., Retrieval), and if a supported small LM is found, the processor may determine that on-device processing is possible. The small LM can learn about the domains and functions for generating summary content and generate summary content. If on-device processing is not possible, the processor (120) can request summary content from the server (108). If there is no small LM for generating summary content, the processor (120) can determine that on-device processing is not possible. The processor (120) can receive summary content from the server (108) according to the request.

[0093] In operation 309, the processor (120) may display summary content. The summary content may be a summary of the original content that fits the size of a designated screen. The processor (120) may display the summary content on a screen that displays the requested content. When the processor (120) requests the summary content from the server (108), the processor (120) may receive the summary content from the server (108) and display it on the screen. According to one embodiment, when the original content of the requested content is below a designated threshold for the screen size, the processor (120) may display the original content on the requested screen.

[0094] FIG. 4 is a diagram illustrating an example for setting an application-specific summary in an electronic device according to one embodiment.

[0095] Referring to FIG. 4, a processor (e.g., the processor 120 of FIG. 1) of an electronic device (e.g., the electronic device 101 of FIG. 1) according to an embodiment may detect a user input (401) on a home screen such as a first user interface (410). The user input (401) may include a touch input of dragging (or swiping) inward of a display (e.g., the display module (160) of FIG. 1) in a bezel area of ​​the electronic device (101). The processor (120) may provide a second user interface (430) in response to the user input (401). The second user interface (430) may include quick function items. The quick function items may be provided so that some functions with high usability among various useful functions of the electronic device (101) can be executed immediately without multiple selection inputs. The second user interface (430) may include a summary of content (431) as one of the quick function items.

[0096] When content summarization (431) is selected, the processor (120) may provide a third user interface (450). The third user interface (450) may include a toggle button (451) for enabling (e.g., activating) content summarization. When the toggle button (451) is turned on, the user may determine whether to enable (or activate) content summarization for each application. For example, the user may set content summarization to be enabled for a first application and not to be enabled for a second application. When content summarization is enabled, the original content may be provided following the summarized content when providing the requested content. That is, when content summarization is enabled (e.g., turned on), the summarized content may be displayed with priority over the original content.

[0097] FIG. 5 is a diagram illustrating an example of providing summary content in an electronic device according to one embodiment.

[0098] Referring to FIG. 5, a processor (e.g., a processor (120) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1) according to an embodiment may provide an execution screen of an application (e.g., display it on a display (e.g., a display module (160) of FIG. 1)) as a first user interface (510). The application may be a search application, and the first user interface (510) may be a web page screen. The first user interface (510) may include a first object (501) (e.g., an icon) indicating whether summary content is provided. The first object (501) indicates whether the content displayed on the first user interface (510) is summary content or not, and may activate or deactivate the summary content. The first object (501) displayed on the first user interface (510) may indicate that the content displayed on the first user interface (510) is not summary content.

[0099] When a user input (503) for scrolling is detected in the first user interface (510), the processor (120) may provide a second user interface (530). The second user interface (530) may include a second object (523) indicating that the content displayed in the second user interface (530) is not summary content. The second user interface (530) may be one of the screens that constitute the same web page as the first user interface (510).

[0100] When the second object (523) is selected, the processor (120) may provide a third user interface (550). When the second object (523) is selected while the content displayed on the second user interface (530) is not summary content, the processor (120) may determine that the user has requested summary content. When the second object (523) is selected, the processor (120) may generate (or receive) summary content that summarizes the content constituting one web page and provide a third user interface (550). The third user interface (550) may include summary content (531), original content (533), and a third object (535). The processor (120) may control the original content (533) to be displayed following the summary content (531), and may display a third object (535) indicating that the content displayed on the third user interface (550) includes summary content. The third object (535) may be displayed distinctly from the first object (501) or the second object (523).

[0101] FIGS. 6A and 6B are diagrams illustrating an example of providing summary content in an electronic device according to one embodiment.

[0102] Referring to FIG. 6A, a processor (e.g., a processor (120) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1) according to an embodiment may display a setting screen of an application, such as a first user interface (610). The application may be a voice recognition service, and the first user interface (610) may include setting items of the voice recognition service. When a user input (613) for selecting content summary (611) from the setting items is detected, the processor (120) may provide a second user interface (620). The second user interface (620) may include a toggle button (623) for selecting whether to use (e.g., activate) content summary in the voice recognition service. A user may touch the toggle button (623) to activate or deactivate content summary in the voice recognition service.

[0103] Referring to FIG. 6B, the processor (120) may display a third user interface (630) including content (631) related to a map application within an application execution screen of a voice recognition service. When at least one item (633) within the content (631) is selected in the third user interface (630), the processor (120) may provide a fourth user interface (650). The processor (120) may also directly enter a fifth user interface (670) according to a setting in the third user interface (630). The fourth user interface (650) may include content (e.g., original content) corresponding to the selected item (633). When a designated item (651) is selected in the fourth user interface (650), a menu item (653) including a summary (655) may be provided. The processor (120) may provide an object (e.g., a summary (655)) for requesting the summary content in the form of a pop-up window.

[0104] When Summarize (655) is selected from the menu item (653), the processor (120) may display a fifth user interface (670). The fifth user interface (670) may include summary content of the original content displayed in the fourth user interface (650). The summary content included in the fifth user interface (670) is a summary of the original content that was scrolled in the fourth user interface (650). The summary content may be a summary image created by summarizing text included in the original content and reducing the size of images included in the original content or displaying only some of the images. The summary content may include at least one of text, an image, or a video.

[0105] FIG. 7 is a flowchart illustrating an operation method between an electronic device and a server according to one embodiment.

[0106] Referring to FIG. 7, in operation 701, an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may receive a content request. The content request is received from a user and may be a user query or a voice request. The requested content may include (or consist of) at least one of text, an image, or a video.

[0107] In operation 703, the electronic device (101) may identify a screen size and / or a font size. The screen size may be a size (or display size) of at least a portion of a user interface (UI) screen for displaying summary content. The screen size may include at least one of a size of one of multiple windows, a size of a pop-up window, a size of an activated display area, or a size of a specified content area within an application.

[0108] For example, when displaying multiple windows on the display of the electronic device (101) (e.g., the display module (160) of FIG. 1), if the electronic device (101) receives a content request from a user, the electronic device (101) may identify (or determine) the size of one of the multiple windows as the screen size. Alternatively, if the electronic device (101) needs to display the requested content as a pop-up window, the electronic device (101) may identify the size of the pop-up window or the area where the content is displayed within the pop-up window as the screen size. Alternatively, if a cover (or case) is mounted on the electronic device (101), the electronic device (101) may identify the size of the activated (or exposed) display area of ​​the display module (160) by the cover among the entire display area of ​​the display module (160) as the screen size. The electronic device (101) may identify the size of a content area specified within an application as the screen size. For example, the content area specified within a message application may be a bubble area for displaying the contents of a single message.

[0109] The above font size may be a font size set in the electronic device (101) or a font size set in the application. The font size may be used to display the summary content. The processor (120) may identify the font size set in the electronic device (101) or the font size set in the application associated with the requested content. If the font size set in the electronic device (101) and the font size set in the application are different, the processor (120) may use the font size set in the application to determine the length of the text. The font size set in the application may take precedence over the font size set in the electronic device (101).

[0110] In operation 705, the electronic device (101) can identify the length of the text. The length of the text may be a reference for providing summary content that summarizes the original content. The electronic device (101) may determine the length of the text by calculating the maximum number of characters that can be displayed on the screen based on the identified screen size and font size, or, if the original content includes images, may determine the length of the text by adjusting the maximum number of characters of the text to a shorter length according to the number of images and the image sizes. In addition, the determined length of the text may be the maximum length, and the summary content may be smaller (shorter) than the determined length of the text.

[0111] If the original content of the requested content exceeds the specified threshold for the screen size, the electronic device (101) may determine that the original content cannot be displayed on the requested screen and determine the length of the text. The electronic device (101) may determine the length of the text based on the identified screen size and / or the identified font size.

[0112] According to one embodiment, the electronic device (101) determines whether on-device processing is possible, and if on-device processing is possible, operations 707 to 711 may be omitted. If on-device processing is not possible, the electronic device (101) may perform operations 707 to 711.

[0113] In operation 707, the electronic device (101) may request a summary from an LLM server (e.g., server (108) of FIG. 1, generative artificial intelligence system of FIG. 23). Based on a user input, the electronic device (101) may transmit a request to the server (108) including first information related to the summary content and second information related to the length of the text associated with the summary content. The first information may include original content associated with the summary content or information (e.g., URL) for obtaining the original content. The second information may include the length of the text. If the original content associated with the summary content includes an image, the second information may further include the size of the image or the number of images associated with the summary content.

[0114] The electronic device (101) can request summary content by transmitting the first information and the second information to the server (108). If the original content is generated in real time through the server (108), the electronic device (101) can transmit the length of the text to the server (108) without the original content.

[0115] In operation 709, the server (108) may generate summary content. For example, if the server (108) receives the length of text when requesting a summary from the electronic device (101), the server (108) may generate summary content based on the length of the text. Since the length of the text is generated based on the size and / or font size of the screen on which the summary content is to be displayed, the server (108) may convert (or process) the original content into summary content to match the length of the text. If the server (108) receives the length of the text and the original content when requesting a summary from the electronic device (101), the server (108) may generate summary content based on the length of the text and the original content.

[0116] In operation 711, the server (108) can transmit the generated summary content to the electronic device (101).

[0117] In operation 713, the electronic device (101) may obtain summary content. The obtained summary content may be generated directly by the electronic device (101) or received from a server (108).

[0118] In operation 715, the electronic device (101) may display summary content. The summary content may be a summary of the original content that fits the size of a specified screen. The electronic device (101) may display the summary content on the screen on which the requested content is to be displayed. According to one embodiment, if the original content of the requested content is below the specified threshold for the screen size, the electronic device (101) may display the original content on the requested screen.

[0119] FIG. 8 is a flowchart (800) illustrating a method for providing summary content in an electronic device according to one embodiment.

[0120] Referring to FIG. 8, in operation 801, a processor (e.g., processor (120) of FIG. 1) of an electronic device (e.g., electronic device (101) of FIG. 1) according to an embodiment may receive a content request from a user. For example, a user may request content by selecting an item within an application, entering a search term on a web page, or entering a question (e.g., user query or voice request) into a voice recognition service.

[0121] In operation 803, the processor (120) may identify a screen size and / or a font size. The screen size may be the size (or display size) of an area where the requested content is to be displayed. The screen size may include at least one of the size of one window among multiple windows, the size of a pop-up window, the size of an activated display area, or the size of a content area designated within an application. The font size may be a font size set in the electronic device (101), or may be a font size set in an application. The processor (120) may identify a font size set in the electronic device (101) or a font size set in an application associated with the requested content.

[0122] In operation 805, the processor (120) may determine whether the original content is below a specified screen size threshold. The processor (120) may determine whether the original content to be displayed by the content request can be displayed on a display (e.g., the display module (160) of FIG. 1). If the original content is below the specified screen size threshold, the processor (120) may perform operation 807, and if the original content exceeds the specified screen size threshold, the processor (120) may perform operation 809.

[0123] If the original content is below the specified screen size threshold, in operation 807, the processor (120) may display the original content. If the original content is below the specified screen size threshold, the processor (120) may determine that the original content is displayable. If the original content is displayable on the screen specified when the content is requested, the processor (120) may display the original content.

[0124] If the original content exceeds a specified threshold of the screen size, in operation 809, the processor (120) may identify the length of the text based on the screen size and / or the font size. The length of the text may be a reference for providing summary content that summarizes the original content. If the original content of the requested content exceeds the specified threshold of the screen size, the processor (120) may determine that the original content cannot be displayed on the requested screen and may determine the length of the text. For example, if the identified font sizes are the same, the processor (120) may determine the length of the text to be large if the identified screen size is large, and may determine the length of the text to be small if the identified screen size is small. If the identified screen sizes are the same, the processor (120) may determine the length of the text to be large if the identified font size is large, and may determine the length of the text to be small if the identified font size is small.

[0125] In operation 811, the processor (120) may obtain summary content. The summary content may include (or be composed of) at least one of text, an image, or a video. The summary content may be generated directly by the electronic device (101) (e.g., on-device) or received from an LLM server (e.g., server (108) of FIG. 1, generative artificial intelligence system of FIG. 23). The processor (120) may transmit a request to the server, based on a user input, including first information related to the summary content and second information related to the length of the text related to the summary content. The first information may include original content related to the summary content or information (e.g., URL) for obtaining the original content. The second information may include the length of the text. If the original content related to the summary content includes an image, the second information may further include the size of the image or the number of images related to the summary content.

[0126] According to one embodiment, the processor (120) determines whether on-device processing is possible, and if so, generates summary content. If on-device processing is not possible, the processor (120) may request summary content from the server (108). If there is no small LM for generating summary content, the processor (120) may determine that on-device processing is not possible. The processor (120) may receive summary content from the server (108) in response to the request.

[0127] According to one embodiment, the processor (120) may request summary content by transmitting the length of the text to the server (108). The server (108) may generate summary content based on the length of the text and transmit the generated summary content to the electronic device (101). Alternatively, the processor (120) may request summary content by transmitting the length of the text and the original content to the server (108). The server (108) may generate summary content based on the length of the text and the original content and transmit the generated summary content to the electronic device (101).

[0128] In operation 813, the processor (120) may display summary content. The summary content may be a summary of the original content, tailored to the size of a specified screen. The processor (120) may display the summary content on the screen that displays the requested content.

[0129] FIG. 9A is a diagram illustrating an example of setting a font size in an electronic device according to one embodiment.

[0130] Referring to FIG. 9A, a processor (e.g., processor (120) of FIG. 1) of an electronic device (e.g., electronic device (101) of FIG. 1) according to an embodiment may set a font size of an application executed based on a user input, such as a first user interface (910). Alternatively, the processor (120) may set a font size set in the electronic device (101) based on a user input, such as a second user interface (920).

[0131] FIGS. 9b and 9c are diagrams illustrating an example of providing summary content in an electronic device according to one embodiment.

[0132] Referring to FIG. 9B, the processor (120) may detect a user input (931) through a voice recognition service and provide a third user interface (930) that provides result data (933) based on the user input (931). For example, in the case of a voice recognition service, the processor (120) may transmit the user input (931) to a voice recognition service server (e.g., the server (108) of FIG. 1, the generative artificial intelligence system of FIG. 23) and receive (e.g., stream) original data corresponding to the user input (931) from the server (108). The processor (120) may control the text for the first result data (933) of the original content to be sequentially displayed while receiving the original content from the server (108). That is, the processor (120) may provide the result data (933) by sequentially increasing (or enlarging) the area (e.g., box area of ​​933) (or bubble area) that displays the result data, rather than displaying the original content at once.

[0133] The fourth user interface (940) indicates that the amount (e.g., text length) of the second result data (943) has increased compared to the first result data (933) of the third user interface (930). While displaying the second result data (943) while increasing the area displaying the second result data (943) in the fourth user interface (940) (e.g., increasing the amount of the result data (943)), a stop responding (941) may be selected. Even if the stop responding (941) is selected, the processor (120) may continue to stream the original data from the server (108) (e.g., background processing).

[0134] Referring to FIG. 9C, when the response interruption (941) is selected, the processor (120) may stop increasing the area displaying the second result data (943) and provide a fifth user interface (950). The fifth user interface (950) may include an object (953) for requesting the original content (951) and the summary content. For reference, the fifth user interface (950) may not display the entire contents of the original content (951), but may display only a portion of the original content (951). The entire contents of the original content (951) may include a larger amount than what is displayed. When the object (953) is selected, the processor (120) may identify the screen size of the area displaying the second result data (943) and identify the font size of the second result data (943). The processor (120) may determine the length of the text based on the screen size and / or font size, and transmit a summary request of the original content including the determined length of the text to the server (108). At this time, since the server (108) has the original content, the processor (120) may not transmit the original content to the server (108). The processor (120) may receive the summary content from the server (108).

[0135] The processor (120) may provide a sixth user interface (960) including a summary content (963) and an object (961) indicating the summary content. The summary content (963) of the sixth user interface (960) is a summary of the original content and may be displayed in an area where the second result data (943) is displayed. According to one embodiment, the processor (120) may display the original content following the summary content (963) based on a user's scrolling (or dragging, swiping) input on the summary content (963). The processor (120) may display the original content while increasing the size of the area where the summary content (963) is displayed based on the user's scrolling input.

[0136] FIG. 10A is a drawing illustrating an example of displaying original content and summary content in an electronic device according to one embodiment.

[0137] Referring to FIG. 10A, a processor (e.g., a processor (120) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1) according to an embodiment may display a first user interface (1010) being used as a multi-window on a display (e.g., a display module (160) of FIG. 1). The electronic device (101) may be a foldable electronic device (e.g., a device in which two housings are folded based on a folding axis). The first user interface (1010) may include an execution screen of a first application (e.g., a web search application) in a first window (1011) and an execution screen of a second application (e.g., a note application) in a second window (1013). A user may search a webpage and write a note with the search results. If summary content is preset to be provided for the first application, the processor (120) may provide summary content (1001) of the requested content. Additionally, the processor (120) may display a first object (1005) indicating that summary content (1001) is displayed on the execution screen of the first application. The processor (120) may detect a user input (1003) that scrolls the summary content (1001) downward.

[0138] The processor (120) may display a second user interface (1020) based on a user input (1003). The second user interface (1020) may display original content (1025) following summary content (1021) by a user input of scrolling downward. The second user interface (1020) may display a second object (1023) indicating that the summary content (1021) is being displayed.

[0139] Alternatively, if the processor (120) is not preset to provide summary content for the first application, the processor (120) may provide a third user interface (1030) including the original content (1031) of the requested content. Alternatively, if the second object (1023) is selected in the second user interface (1020), the processor (120) may provide a third user interface (1030). The third user interface (1030) may display a third object (1033) indicating that summary content is not displayed. The third object (1033) may indicate that the currently displayed content is not summary content and may be displayed to be distinct from the first object (1005) and the second object (1023).

[0140] FIG. 10b is a drawing illustrating an example of displaying original content and summary content in an electronic device according to one embodiment.

[0141] Referring to FIG. 10b, the processor (120) may display a fourth user interface (1050) including summary content (1051) on the display module (160). If the application providing the summary content (1051) is preset to provide the summary content, the processor (120) may sequentially provide the summary content (1051) from the top when providing the content. The processor (120) may sequentially summarize the original content, like the fifth user interface (1060), and increase the size of the area providing the summary content (1063). The processor (120) may detect a user input (1061) of scrolling (dragging, swiping) on ​​the summary content (1063). The processor (120) may provide the sixth user interface (1070) in response to the user input (1061). The sixth user interface (1070) may display the original content (1075) following the summary content (1073). That is, in the sixth user interface (1070), the processor (120) may display the original content (1075) rather than the summary content (1073) on the display module (160). The sixth user interface (1070) may include a fourth object (1071) for requesting the summary content. When the fourth object (1071) is selected, the processor (120) may display a fifth user interface (1060) including the summary content (1061).

[0142] FIG. 11A is a diagram illustrating an example of changing from summary content to original content in an electronic device according to one embodiment.

[0143] Referring to FIG. 11A, a processor (e.g., a processor (120) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1) according to an embodiment may display a first user interface (1110) being used as a multi-window on a display (e.g., a display module (160) of FIG. 1). The electronic device (101) may be a foldable electronic device (e.g., a device in which two housings are folded based on a folding axis). The first user interface (1110) may include an execution screen of a first application (e.g., a web search application) in a first window (1101) and an execution screen of a second application (e.g., a messenger application) in a second window (1113). A user may perform a web search to obtain necessary information while exchanging messages with the other party. If summary content is preset to be provided for the first application, the processor (120) may provide summary content of the requested content. Additionally, the processor (120) may display a first object (1101) that guides that summary content is displayed on the execution screen of the first application.

[0144] According to one embodiment, when the electronic device (101) is a foldable electronic device, the foldable electronic device may display an execution screen of a first application (e.g., a web search application) on a first display area (e.g., a first window (1101)) corresponding to the first housing, and display an execution screen of a second application (e.g., a messenger application) on a second display area (e.g., a second window (1113)) corresponding to the second housing, in a state where the first housing and the second housing are placed in an “L” (or “L”) shape, the second housing is placed on the ground (e.g., a desk), and the first housing forms a predetermined angle (e.g., 50° to 130°) with the ground. For example, the intermediate state of the foldable electronic device may be a state where the first housing and the second housing are placed in an “L” (or “L”) shape, the second housing is placed on the ground (e.g., a desk), and the first housing forms a predetermined angle (e.g., 50° to 130°) with the ground.

[0145] Referring to the second user interface (1120), when a certain area (1121) is selected (e.g., pressed and held) in the summary content, the processor (120) may provide a pop-up window (1123). The pop-up window (1123) includes an original opening (1125), and when the original opening (1125) is selected, the processor (120) may display a third user interface (1130). The third user interface (1130) may display areas (1131, 1133) corresponding to the selected area (1121) in the original content in a manner that is distinct from other areas.

[0146] FIG. 11b is a diagram illustrating an example of comparing summary content and original content in an electronic device according to one embodiment.

[0147] Referring to FIG. 11B, the electronic device (101) may be a wearable device (e.g., a watch-type device). The first drawing symbol (1150) may include original content (1153). The fourth user interface (1160) may include summary content (1163). The processor (120) may generate summary content (1163) by summarizing the original content (1153) on its own or through the server (108). The fifth user interface (1170) may include a message (1173) that is conventionally provided to fit the size of a display. Since the information in the message (1173) is displayed from the top of the original content (1153), it may be difficult to grasp the entire content. Comparing the summary content (1163) and the message (1173), unnecessary content (e.g., advertisements) may be deleted in the summary content (1163) and only important information may be summarized and displayed. When an object (1165) indicating summary content is selected in the fourth user interface (1160) or a scroll input is detected on the summary content (1163), the processor (120) may display the original content (1153) instead of the summary content (1163).

[0148] FIG. 12A is a diagram illustrating an example of changing and displaying summary content to original content in an electronic device according to one embodiment.

[0149] Referring to FIG. 12A, when a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment opens content (e.g., a document file) and then selects a list of recently executed applications, menu items such as application information (1201) and view as pop-up screen (1203) may be displayed, as in the first user interface (1210). When view as pop-up screen (1203) is selected, the processor (120) may determine that the user intends to reduce the amount of original content and may provide a second user interface (1220). The second user interface (1220) may include notification information (1221) that guides that summary content is being generated (or acquired). The processor (120) may identify a screen size and / or font size for displaying the requested content while displaying the second user interface (1220), determine the length of the text based on the identified screen size and / or font size, and obtain (e.g., generate or receive) summary content based on the length of the text.

[0150] When the summary content acquisition is complete, the processor (120) can display a third user interface (1230) including the summary content (1231) and an object (1233) indicating that it is the summary content (1231).

[0151] Alternatively, if a user input scrolling on the notification information (1221) is detected while the processor (120) is displaying the second user interface (1220), the processor (120) may stop generating the summary content and display the fourth user interface (1240) including the original content (1241).

[0152] FIG. 12b is a diagram illustrating an example of displaying summary content differently depending on the font size in an electronic device according to one embodiment.

[0153] Referring to FIG. 12B, the processor (120) may display the fifth user interface (1250) or the sixth user interface (1260) depending on the font size. When generating summary content using the same original content, the processor (120) may generate different summary content when the screen size is the same but the font size is different. The content or length of the text included in the first summary content (1251) included in the fifth user interface (1250) and the second summary content (1261) included in the sixth user interface (1260) may be different. For example, when providing the fifth user interface (1250), if the font size is '90% (or 7)' and when providing the sixth user interface (1250), if the font size is '120% (or 12)', if the length of the text of the first summary content (1251) is 100, the length of the text of the second summary content (1261) may be 80. The processor (120) may further reduce the amount of content by considering the font size set in the electronic device (101). These figures are only to help understanding of the invention and do not limit the invention.

[0154] FIGS. 13a and 13b are diagrams illustrating an example of displaying summary content differently depending on the screen size in an electronic device according to one embodiment.

[0155] Referring to FIGS. 13A and 13B , a processor (e.g., a processor (120) of FIG. 1 ) of an electronic device (e.g., an electronic device (101) of FIG. 1 ) according to an embodiment may detect a user input (1301) of dragging and dropping a document to be opened onto a first screen area (1301) such as a first user interface (1310). The processor (120) may identify the size of the first screen area (1301) and identify a font size (e.g., a font size set in the electronic device (101) or a font size of a document application). The processor (120) may determine the length of text based on the size and / or font size of the first screen area (1301) and obtain summary content based on the determined length of the text.

[0156] The second user interface (1330) may display the first summary content (1331) and include an object (1333) indicating that it is the first summary content (1331). The user may change the size of the first screen area (1301) displaying the summary content (1331). For example, the size of the first screen area (1301) may be changed to the size of the second screen area (1303). The processor (120) may reconfigure the summary content based on the size of the second screen area (1303). Alternatively, the processor (120) may re-determine the length of the text based on the size and / or font size of the second screen area (1303) and obtain the summary content based on the determined length of the text.

[0157] The third user interface (1350) may represent the second summary content (1353) displayed in the second screen area (1303). Alternatively, the size of the first screen area (1301) may be changed to the size of the third screen area. The fourth user interface (1370) may represent the third summary content (1373) displayed in the third screen area. The third screen area may be different in size from the first screen area (1301) or the second screen area (1303). Accordingly, the text (or text length) included in the first summary content (1331), the second summary content (1353), or the third summary content (1373) in different screen areas may be different from each other. When the screen area is changed, the processor (120) may reconfigure the summary content to fit the changed screen area.

[0158] FIG. 14 is a flowchart (1400) illustrating a method for obtaining summary content in an electronic device according to one embodiment.

[0159] Referring to FIG. 14, in operation 1401, a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., electronic device 101 of FIG. 1) according to an embodiment may determine whether on-device processing is possible. For example, the processor (120) may include an LLM management module, and may search for a small LM using the LLM management module. If a supported small LM is found, the processor may determine that on-device processing is possible. The small LM may learn about domains and functions for generating summary content, and may generate the summary content. If on-device processing is possible, the processor (120) may perform operation 1409, and if on-device processing is not possible, the processor (120) may perform operation 1403.

[0160] If on-device processing is not possible, in operation 1403, the processor (120) may transmit the length of the text and the original content to an LLM server (e.g., server (108) of FIG. 1). The processor (120) may transmit the original content itself to the server (108), or may transmit information (e.g., URL) for the server (108) to obtain the original content to the server (108). If the original content associated with the summary content includes an image, the processor (120) may transmit the size of the image or the number of images associated with the summary content together with the length of the text to the server (108). If there is no small LM for generating the summary content, the processor (120) may determine that on-device processing is not possible and request the summary content from the server (108).

[0161] In operation 1405, the processor (120) may receive summary content from the server (108). The server (108) may generate summary content based on the length of the text and the original content, and transmit the generated summary content to the electronic device (101). The processor (120) may receive the summary content through a communication module (e.g., the communication module (190) of FIG. 1).

[0162] In operation 1407, the processor (120) may display summary content. The summary content may be a summary of the original content that fits the size of a designated screen. The processor (120) may display the summary content on the screen on which the requested content is to be displayed. According to one embodiment, the processor (120) may display the original content on the requested screen if the original content of the requested content is below a designated threshold for the screen size.

[0163] If on-device processing is possible, the processor (120) may generate summary content at operation 1409. The processor (120) may generate summary content based on the length of the text and the original content through the searched small LM. Once the summary content generation is completed, the processor (120) may display the generated summary content by performing operation 1407.

[0164] FIG. 15A is a diagram illustrating an example of guiding the display of summary content in an electronic device according to one embodiment.

[0165] Referring to FIG. 15A, a processor (e.g., processor (120) of FIG. 1) of an electronic device (e.g., electronic device (101) of FIG. 1) according to an embodiment may detect a user input (1501) of dragging and dropping a document to be opened into a first screen area (1503), such as a first user interface (1510). The user may change the size of the area displaying the document to better view the document. For example, when the user changes the first screen area to a second screen area (1521), such as a second user interface (1520), the processor (120) may display a notification message (1523). The notification message (1523) may inform the user that changing the setting will allow viewing of a summary of the original content (e.g., document).

[0166] FIG. 15b is a diagram illustrating an example of guiding the display of summary content in an electronic device according to one embodiment.

[0167] Referring to FIG. 15B, while displaying summary content (1531), the processor (120) may detect a user input for changing the screen area on which the summary content (1531) is displayed. For example, the user may perform a drag input (1541) to reduce the first screen area (1503) to a smaller size. In response to the user input for changing the screen area, the processor (120) may display a first message (1543) indicating that the summary content is being generated. While displaying the first message (1543), the processor (120) may generate the summary content and determine whether the screen size on which the summary content is to be displayed is below a minimum reference value. If the screen size on which the summary content is to be displayed is below the minimum reference value, the processor (120) may display a second message (1551) indicating that the content may be distorted by providing a warning sign. When the processor (120) turns on (e.g., activates) provision of summary content and the text content exceeds the screen by N% or more, the processor (120) may provide an object (1561) indicating summary content as a floating button. Alternatively, the processor (120) may display information (1571) related to the summary content. The information (1571) relates to a meta prompt, which is a standard for the summary content, and the user may edit or delete the meta prompt, which is a standard for the summary content.

[0168] FIG. 16A is a diagram illustrating an example of displaying summary content in an electronic device while connected to another electronic device according to one embodiment.

[0169] Referring to FIG. 16A, an electronic device according to an embodiment (e.g., the electronic device (101) of FIG. 1) may be used in connection with another electronic device (1601). The other electronic device (1601) may include a display larger in size than the electronic device (101) (e.g., a computer or a laptop). The electronic device (101) may receive a message while connected (1610) to the other electronic device (1601). The electronic device (101) may notify (1613) that a message has been received, and the other electronic device (1601) may notify (1611) that a message has been received. When a user checks a notification on an electronic device (1601) other than the electronic device (101), the other electronic device (1601) can identify the size and / or font size of the screen (1623) on which the notification will be displayed, as in the second example (1620), and provide summary content on the identified screen (1623).

[0170] FIG. 16b is a diagram illustrating an example of displaying summary content according to a screen size in an electronic device according to one embodiment.

[0171] Referring to FIG. 16B, the electronic device (101) may be equipped with a case (or cover), and only a portion of the display (e.g., the display module (160) of FIG. 1) of the electronic device (101) may be activated by the case. For example, the electronic device may activate only the first area (1631) of the display module (160), as in the first example (1630). In this case, the electronic device (101) may provide the first summary content (1671) based on the size and / or font size of the first area (1631). The electronic device may activate only the second area (1643) of the display module (160), as in the second example (1640). In this case, the electronic device (101) may provide the second summary content (1673) based on the size and / or font size of the second area (1643). The electronic device may activate only the third area (1653) of the display module (160), as in the third example (1650). In this case, the electronic device (101) may provide the third summary content (1675) based on the size and / or font size of the third area (1653). The first summary content (1671), the second summary content (1673), and the third summary content (1675), which are summarized for the same original content, may differ in the amount, size, or length of text or images (e.g., icons) included in the first summary content (1671), the second summary content (1673), and the third summary content (1675).

[0172] FIGS. 17A to 17D are diagrams illustrating an example of displaying summary content according to an area size within an application in an electronic device according to one embodiment.

[0173] Referring to FIGS. 17A to 17D , a processor (e.g., the processor (120) of FIG. 1 ) of an electronic device (e.g., the electronic device (101) of FIG. 1 ) according to an embodiment may divide an execution screen of an application into areas displaying phone information (1711) and message information (1713). The first user interface (1710) to the third user interface (1730) may be execution screens of applications associated with text calls. The processor (120) may identify one area included in the message information (1713) of the first user interface (1710) as a screen area for displaying summary content (1701). The first user interface (1710) may include summary content (1701), and the second user interface (1720) may include original content (1721). The processor (120) may display summary content (1701) that summarizes the original content (1721) based on the identified screen area. When the execution screen of an application associated with a text call is displayed on a large display, the original content (1731) may be displayed as in the third user interface (1730).

[0174] The processor (120) may provide summary content as a pop-up window on the execution screen of the application. For example, referring to the fourth user interface (1750), a call may be received while the execution screen (1755) of the video application is displayed. The processor (120) may generate summary content based on the size and / or font size of the predetermined pop-up window. The processor (120) may display summary content (1753) related to the call on the execution screen (1755) of the video application. The summary content (1753) may include information about the calling party, as well as an image (e.g., an icon) related to a text call (1751), answering a call (1759), or rejecting a call.

[0175] Conventionally, when receiving a call (1759) is selected in the fourth user interface (1750), the processor (120) can display an execution screen (1760) of a phone application on the display of the electronic device (101). That is, the processor (120) can switch from an execution screen (1755) of a video application to an execution screen (1760) of a phone application. Alternatively, when a text call (1751) is selected in the fourth user interface (1750), the processor (120) can display an execution screen (1770) of a text call application on the display of the electronic device (101). That is, the processor (120) can switch from an execution screen (1755) of a video application to an execution screen (1770) of a text call application.

[0176] In the present invention, when a text call (1751) is selected in the fourth user interface (1750), the processor (120) can provide summary content while displaying the execution screen of the video application. For example, summary content (1781) related to the text call can be displayed on the execution screen of the video application, as in the fifth user interface (1780). The processor (120) can generate and display the summary content (1781) related to the text call based on the size and / or font size of a predetermined pop-up window.

[0177] FIGS. 18a and 18b are diagrams illustrating an example of displaying summary content according to a screen size in an electronic device according to one embodiment.

[0178] Referring to FIGS. 18A and 18B , in the first drawing symbol (1810), a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1 ) according to an embodiment may notify that a call has arrived in a pop-up window (1801) in a virtual space. The processor (120) may identify a screen size and / or a font size of the pop-up window (1801). When a text call (1803) is selected by a user, the processor (120) may determine the length of the text based on the identified screen size and / or font size, and obtain summary content based on the determined length of the text. As in the second drawing symbol (1820), the processor (120) may provide summary content (1821) on the first screen. The user may change the size of the first screen. As shown in the third drawing symbol (1830), when the screen size is changed, the processor (120) can provide the original content (1833) according to the changed screen (1831) (e.g., the second screen). That is, since the second screen size is larger than the first screen to display the original content, the processor (120) can display the original content (1833) instead of the summary content (1821).

[0179] Alternatively, as shown in the fourth drawing symbol (1850), the processor (120) may provide an abbreviated version of the original content according to the size of the specified window when displaying text-to-speech information, such as live captions. For example, since the size of the first screen (1851) is smaller than the size of the second screen (1853), the processor (120) may display an abbreviated version of the original content.

[0180] FIG. 19 is a diagram illustrating an example of displaying summary content according to a screen size in an electronic device according to one embodiment.

[0181] Referring to FIG. 19, a processor (e.g., a processor (120) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1) according to an embodiment may set a screen size to be small, such as a split screen or a pop-up screen, based on a user input in a first user interface (1910). In the first user interface (1910), a video application execution screen may be displayed in a first window (1911), and a message application execution screen may be displayed in a second window (1913). When a summary content is requested in the execution screen of the video application displayed in the first window (1911), the processor (120) may provide a second user interface (1920). When the summary content is text, the processor (120) may summarize and display speech-to-text information in a text displayable area (1921) excluding an image display area in the first window (1911). Alternatively, the processor (120) may display summary content in some area (1935) that requests display of summary content within the message list area (1931) among the message content area (1933) and the message list area (1931), such as the third user interface (1930).

[0182] FIG. 20A is a diagram illustrating an example of a prompt related to the generation of summary content in an electronic device according to one embodiment.

[0183] Referring to FIG. 20A, a processor (e.g., the processor (120) of FIG. 1) of an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may train a language model to generate prompt data (2010) that is a standard for summary content. For example, the processor (120) may generate a length of text (e.g., 20) based on a screen size (e.g., 324*102) and a font size (e.g., 12) to display the requested content. The processor (120) may generate condition information (2001) that includes at least one of the screen size, the font size, or the length of the text. The processor (120) may train the condition information (2001) and the first summary content (1213) corresponding to the first original content (2011), and the second summary content (1217) corresponding to the second original content (2015).

[0184] The processor (120) learns that the provided display information, using prompt data (2010), is summarized data according to the output character length of the original text data, so that summary data (e.g., summarized content) can be obtained using only condition information and original text data (e.g., original content). Alternatively, the processor (120) can learn that the provided display information, using prompt data (2010), is summarized data according to the output character length. The processor (120) calculates the possible output character length (e.g., length of text) in advance by calculating the screen size, font size, and number of display output lines, transmits the length of the text and the original data to a server (e.g., server (108) of FIG. 1), and receives the summarized content from the server (108).

[0185] FIG. 20b is a diagram illustrating an example of learning a model for generating summary content in an electronic device according to an embodiment.

[0186] Referring to FIG. 20b, the processor (120) can teach first information (2051) to the first small LM (2050), second information (2061) to the second small LM (2060), and third information (2071) to the third small LM (2007). The first small LM (2050) can be utilized as a search engine, the second small LM (2060) can be utilized to utilize personal information and preference information, and the third small LM (2007) can be utilized to utilize context information of the electronic device (101).

[0187] FIGS. 21A and 21B are drawings illustrating examples of screen sizes for displaying summary content in an electronic device according to one embodiment.

[0188] Referring to FIG. 21A, a first example (2110) may be configured such that a case is mounted on an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment, and only a portion of a display area of ​​a display (e.g., the display module (160) of FIG. 1) included in the electronic device (101) may be activated by the case. The electronic device (101) may display summary content based on the size and / or font size of the activated display area (1201). For example, if the summary content is schedule information, the electronic device (101) may provide only the time and title as summary content if there are three schedules, and may provide more detailed schedule information as summary content if there is one schedule. A second example (2120) may provide a first information (or notification) item (2121) of the electronic device (101) as summary content. The third example (2130) may provide the second information item (2131) as summary content in a smaller size than the first information item (2121). The fourth example (2140) may provide the third information item (2141) of the electronic device (101) as summary content. The screen sizes and font sizes of the first information item (2121), the second information item (2131), and the third information item (2141) may be different. When the screen sizes and / or font sizes are different, the summary content displayed on the first information item (2121), the second information item (2131), and the third information item (2141) for the same content may be different from each other.

[0189] Referring to FIG. 21B, the fifth example (2150) may provide the fifth information item (2151) of the electronic device (101) as summary content. The sixth example (2160) may provide the sixth information item (2161) as summary content through an edge area of ​​the electronic device (101). The seventh example (2170) may provide the seventh information item (2171) as summary content through a designated area of ​​the electronic device (101). The screen sizes and font sizes of the fifth information item (2151), the sixth information item (2161), and the seventh information item (2171) may be different. When the screen sizes and / or font sizes are different, the summary content displayed on the fifth information item (2151), the sixth information item (2161), and the seventh information item (2171) for the same content may be different from each other.

[0190] FIGS. 22A to 22C are drawings illustrating examples of electronic devices having various screen sizes according to one embodiment.

[0191] Referring to FIG. 22A, an electronic device (e.g., the electronic device (101) of FIG. 1) according to an embodiment may be implemented as a first foldable electronic device (2210) or a second foldable electronic device (2220) having different display sizes. The first foldable electronic device (2210) may be an electronic device that folds at least once by infolding or outfolding. When the first foldable electronic device (2210) is folded, summary content is displayed only in a portion of the display area, and when the screen area displaying the summary content is changed according to a user input, the content of the summary content may be expanded and displayed to fit the changed screen size.

[0192] According to one embodiment, a first foldable electronic device (2210) may display an application execution screen (e.g., YouTube) in a first display area (e.g., top of the screen) corresponding to the first housing, and a second housing (e.g., bottom of the screen) corresponding to the second housing, in a state (2211) where the first housing and the second housing are arranged on both sides of the folding axis and formed to be folded relative to each other, at a predetermined angle based on the folding axis, and may display summary information in a second display area (e.g., bottom of the screen) corresponding to the second housing.

[0193] The second foldable electronic device (2220) is an electronic device that folds at least twice, and its main display may be larger than the main display of the first foldable electronic device (2210). The first foldable electronic device (2210) or the second foldable electronic device (2220) may display a changed amount of summary content depending on changes in the size of the physical screen.

[0194] Referring to FIG. 22B, the electronic device (101) may be implemented in the form of a washing machine (2230) or a vacuum cleaner (2240). The washing machine (2230) or the vacuum cleaner (2240) may include a smaller display than a device such as a smartphone. The washing machine (2230) or the vacuum cleaner (2240) may display different content for the same summary content than a smartphone. Alternatively, as shown in the first drawing reference numeral (2250), the electronic device (101) may be utilized as a home appliance (e.g., a refrigerator (2253) or a TV (2251)). The summary content may be displayed through a refrigerator (2253), a TV (2251), or a device having various screens.

[0195] Referring to FIG. 22c, the summary content may be displayed differently according to the first screen size (2261), the second screen size (2263), and the third screen size (2265), as in the first example (2260). Alternatively, the summary content may be displayed according to the size of the lens (2281) of the wearable device (2280). The summary content may be displayed on the entire screen of the lens (2281) or on a portion of the lens (2281).

[0196] FIG. 23 is a block diagram illustrating an example of a generative artificial intelligence system according to one embodiment.

[0197] Referring to FIG. 23, a generative artificial intelligence system (e.g., an intelligent server, server (108) of FIG. 1) according to one embodiment may include a user interface (2310), a database (2320), an application and service component (2330), an AI framework (250), and a generative AI model (2370).

[0198] A user interface (2310) can receive a user's query. The user's query can be in the form of natural language, images, or videos. Additionally, contextual information can be transmitted along with the user's query. As another example, the user's query can also be a non-natural language input that does not generate natural language, such as a design request or modification. Furthermore, the query can be a mixture of natural language, images, sounds, and contextual information as described above. Furthermore, the user interface (2310) can output the results of the generative artificial intelligence system to the user. The output can be in the form of natural language or specific content, and can also be provided in the form of an action requested by the user.

[0199] The AI ​​framework (250) can receive a user's query and coordinate and control each component necessary to carry out the user's intent. The AI ​​framework (250) may include a prompt design component (2351), an application and plug-in management component (APIs / Plugins Management component (2353), and an output modification component (2355).

[0200] A user query or action entered in the user interface (2310) can be transmitted to a prompt design component (2351). The prompt design component (2351) can be used to generate prompts suitable for input into a large language model (LLM) or a large multimodal model. The prompt design component (2351) can be an AI component that uses a machine learning algorithm or a neural network to develop better prompts over time. The prompt design component (2351) can access a knowledge component containing user preference data, a prompt library, and prompt examples to generate prompts and pass them to the large language model (LLM) or the large multimodal model (LMM).

[0201] The application and plugin management component (2353) can communicate with external information when additional information is requested when user input is passed as input to the generative model. The application and plugin management component (2353) establishes a channel for communication with external entities within the AI ​​Interface via an application programming interface (API), thereby enabling access to various data sources. Furthermore, if the application or service requires an action that ultimately fulfills a user's query, rather than an intermediate result, the application and plugin management component (2353) can request such action via the API. Information obtained from external sources can be passed as input to the generative model along with user input.

[0202] The output modification component (2355) can fine-tune the output from the generative model. For example, the output modification component (2355) can verify that content generated through a language model (LLM) or a large-scale multimodal model (LMM) is not irrelevant, does not contain biased content, or does not contain harmful content. In addition, the output modification component (2355) can determine the degree to which the content matches the user's desired result and, if necessary, can perform additional processing. Additionally, the output modification component (2355) can configure and provide hints to the user to avoid undesired output.

[0203] Generative AI models (2370) generally refer to artificial intelligence neural networks that create new forms of data based on user input information. Representative models that generate images include generative adversarial networks (GANs) and variational autoencoders (VAEs). Recently, diffusion-based generative models that use VAE and transformer structures are also called generative models. In addition, language models are models trained to statistically produce the most appropriate output based on input values, and representative examples include models such as CHAT-GPT 3 and CHAT-GPT 4. In addition, since they can recognize various types of data input, such as text, images, and voice, and generate new data corresponding to them, they are called large multimodal models (LMMs).

[0204] According to an embodiment of the present disclosure, a method of operating an electronic device (101) may include an operation of identifying a screen size of at least a portion of a user interface (UI) screen for displaying summary content and a font size to be used for displaying the summary content, an operation of identifying a length of text for the summary content based on the screen size and the font size, an operation of transmitting a request to a server based on a user input, the request including first information related to the summary content and second information related to the length of the text related to the summary content, an operation of obtaining summary content in association with the request from the server, and an operation of displaying at least a portion of the user interface screen on a display of the electronic device based on the obtained summary content.

[0205] The above first information may include original content associated with the summary content or information for obtaining the original content.

[0206] The act of identifying the screen size may include an act of identifying at least one of the following: the size of one of the multi-window windows, the size of an activated display area of ​​the display, or the size of a specified content area within an application, as the size of the screen.

[0207] The method may include an operation of displaying the original content when the original content of the content requested from the user is below a specified standard of the screen size, and an operation of identifying the length of text for obtaining the summary content when the original content of the content requested from the user exceeds the specified standard of the screen size.

[0208] The above-described acquiring operation may include an operation of determining whether the creation of the summary content is possible, and an operation of creating the summary content based on the determined length of the text if the creation of the summary content is possible.

[0209] The method may further include an operation of including, in the second information, the size of an image or the number of images associated with the summary content, if the original content associated with the summary content includes an image.

[0210] The above method may further include an operation of reconfiguring and displaying the summary content based on the changed screen size when the size of the screen displaying the summary content changes while displaying the obtained summary content.

[0211] The above method may further include an action of controlling the display of original content following the summary content based on a user's scroll input.

[0212] The method may further include an action of displaying summary content instead of the original content of the requested content based on application settings.

[0213] The method may further include an operation of displaying an object indicating that the summary content is the summary content while displaying the obtained summary content, and an operation of displaying original content associated with the summary content instead of the summary content based on a user input selecting the object.

[0214] The various embodiments of the present invention disclosed in this specification and drawings are merely specific examples presented to facilitate easy explanation of the technical content of the present invention and aid understanding thereof, and are not intended to limit the scope of the present invention. Therefore, the scope of the present invention should be interpreted to include all modifications or variations derived based on the technical concept of the present invention, in addition to the embodiments disclosed herein.

Claims

1. In an electronic device (101), display (160); Processor (120); and The instructions stored in the memory, when the processor is executed, the electronic device, Identifying a screen size of at least a portion of a user interface (UI) screen for displaying summary content and a font size to be used for displaying said summary content; Identify the length of text for the summary content based on the above screen size and the above font size, Based on user input, a request is transmitted to the server, including first information related to the summary content and second information related to the length of the text associated with the summary content; Obtain summary content related to the above request from the above server, An electronic device that displays at least a portion of the user interface screen through the display based on the summary content obtained above.

2. In paragraph 1, The length of the above text is, An electronic device, wherein the above summary content is the number of texts that can be displayed on a screen.

3. In the first paragraph, the instructions, when the processor is executed, the electronic device, An electronic device that identifies at least one of the following: the size of one window among the multi-windows, the size of an activated display area of ​​the display, or the size of a specified content area within an application, based on the screen size.

4. In the first paragraph, the instructions, when the processor is executed, the electronic device, If the original content of the content requested by the user is below the specified criteria for the screen size, the original content is displayed. An electronic device that identifies the length of text for the summary content when the original content of the content requested by the user exceeds a specified criterion for the screen size.

5. In paragraph 1, An electronic device wherein when the font size is large, the number of texts included in the summary content is small, and when the font size is small, the number of texts included in the summary content is large.

6. In the first paragraph, the instructions, when the processor is executed, the electronic device, An electronic device that includes, in the second information, the size or number of images associated with the summary content, if the original content associated with the summary content includes images.

7. In the first paragraph, the instructions, when the processor is executed, the electronic device, An electronic device that, while displaying the summary content obtained above, if the size of the screen displaying the summary content changes, displays the summary content by reconfiguring it based on the changed screen size.

8. In the first paragraph, the instructions, when the processor is executed, the electronic device, An electronic device that controls the display of original content following the summary content based on a user's scroll input.

9. In the first paragraph, the instructions, when the processor is executed, the electronic device, An electronic device that displays summary content instead of the original content associated with said summary content based on application settings.

10. In the first paragraph, the instructions, when the processor is executed, the electronic device, While displaying the summary content obtained above, display an object indicating that it is the summary content, An electronic device that displays original content associated with said summary content instead of said summary content based on user input selecting said object.

11. In the operating method of an electronic device (101), An action to identify a screen size of at least a portion of a user interface (UI) screen for displaying summary content and a font size to be used for displaying said summary content; An action of identifying the length of text for the summary content based on the screen size and the font size; An action of transmitting a request to a server, based on user input, comprising first information related to the summary content and second information related to the length of the text associated with the summary content; An operation of obtaining summary content in connection with the request from the server; and A method comprising the action of displaying at least a portion of the user interface screen on a display of the electronic device based on the obtained summary content.

12. In paragraph 11, The length of the above text is, How the above summary content is displayed on the screen, which is the number of texts that can be displayed.

13. In paragraph 11, the operation of identifying the screen size is as follows: A method comprising: identifying at least one of a size of one of multiple windows, a size of an activated display area of ​​the display, or a size of a specified content area within an application, based on the screen size.

14. In paragraph 11, An action to display the original content when the original content of the content requested by the user is below the specified criteria for the screen size; and A method comprising an action of identifying the length of text for the summary content when the original content of the content requested by the user exceeds a specified criterion of the screen size.

15. In paragraph 11, A method wherein when the font size is large, the number of texts included in the summary content decreases, and when the font size is small, the number of texts included in the summary content increases.

Images