Electronic device, method for operating electronic device, and computer-readable recording medium therefor

Abstract

An embodiment of the present disclosure provides an electronic device for generating and providing content on the basis of a user input, a method for operating an electronic device, and a computer-readable recording medium therefor. The electronic device may display the content on a display. The electronic device may select an object portion in response to a first input for selecting the object portion of the content. The electronic device may set a range of information of the object portion in response to a second input for changing the information of the object portion. The electronic device may identify, in response to a release of the second input, the amount of information (e.g., the number of characters) corresponding to the set range of information. The electronic device may generate data on the basis of the object portion and the amount of information. The electronic device may update and display the object portion of the content on the basis of the generated data. Various embodiments are possible.

Description

Electronic device, method of driving the electronic device, and computer-readable recording medium for the same

[0001] Embodiments of the present disclosure provide an electronic device that generates and provides content (e.g., text and / or images) based on user input, a method for operating the electronic device, and a computer-readable recording medium for the same.

[0002] With the development of digital technology, various types of electronic devices such as smartphones, tablet PCs, laptop computers, desktop computers, digital cameras, and / or wearable devices are widely used. To support and enhance the functionality of these electronic devices, the hardware and / or software parts of the devices are continuously being developed.

[0003] For example, portable electronic devices (hereinafter referred to as "electronic devices"), such as smartphones, have become capable of incorporating various functions. Electronic devices include touchscreen-based displays to allow users easy access to various functions, and can provide screens for various applications through the display.

[0004] Recently, with the rapid advancement of big data and deep learning technologies, artificial intelligence (AI) technology has been implemented in electronic devices and is also being applied to intelligent personalized services that analyze specific data and integrate and utilize information from various fields tailored to the user. For example, users can control electronic devices through voice conversation and perform searches, queries, and responses regarding specific information using a knowledge base powered by deep learning. Furthermore, with the evolution of AI technology, generative AI is being implemented. Generative AI can refer to AI technology that creates new, similar content using existing content such as text, audio, and / or images. For instance, generative AI can refer to AI technology capable of generating content (e.g., text, audio, images, and / or videos) corresponding to a given input.

[0005] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0006] In one embodiment of the present disclosure, an electronic device that generates and provides content (e.g., text and / or images) based on user input, a method for operating the electronic device, and a computer-readable recording medium for the same are provided.

[0007] In one embodiment of the present disclosure, an electronic device that determines a user's purpose based on user input and automatically generates (e.g., rewriting) and provides content (e.g., text and / or images) to suit the purpose, a method for operating the electronic device, and a computer-readable recording medium for the same are provided.

[0008] In one embodiment of the present disclosure, an electronic device is provided that modifies and provides a portion of content (e.g., text and / or image) (e.g., word, sentence, paragraph and / or image portion) defined (e.g., block setting) according to user input in the content (e.g., text and / or image) of a document (e.g., web document, word document, PDF document, or note document, etc.) displayed on a display, with an amount of information (e.g., number of characters, image size, and / or number of images, etc.) corresponding to the user input, an electronic device, a method for operating the electronic device, and a computer-readable recording medium for the same.

[0009] The technical problems intended to be solved in this document are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.

[0010] According to an embodiment of the present disclosure, an electronic device is provided that regenerates and provides the content (or information) of a content through interaction with a user. The electronic device may include a display, a memory storing one or more computer programs, and one or more processors that are communicatively coupled to the display and memory and include processing circuitry. One or more computer programs may include instructions (e.g., computer-executable instructions) that cause the electronic device to perform the following when executed individually or collectively by one or more processors.

[0011] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may display content on a display. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may select an object part in response to a first input selecting an object part of the content. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may set (or identify) a range of information of the object part in response to a second input changing information of the object part. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may identify a number of characters corresponding to the set range of information in response to the release of the second input. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may generate data based on the object portion and the number of characters. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may update and display the object portion of the content based on the generated data.

[0012] A method of operation of an electronic device according to an embodiment of the present disclosure may include an operation of displaying content on a display. According to one embodiment, the method of operation may include an operation of selecting an object portion in response to a first input selecting an object portion of the content. According to one embodiment, the method of operation may include an operation of setting a range of information of the object portion in response to a second input changing information of the object portion. According to one embodiment, the method of operation may include an operation of identifying a number of characters corresponding to the set range of information in response to the release of the second input. According to one embodiment, the method of operation may include an operation of generating data based on the object portion and the number of characters. According to one embodiment, the method of operation may include an operation of updating and displaying the object portion of the content based on the generated data.

[0013] In order to solve the above problems, various embodiments of the present disclosure may include a computer-readable recording medium that records a program for executing the method on a processor.

[0014] According to one embodiment, one or more non-transitory computer-readable recording media are provided for storing computer-executable instructions that cause one or more processors of an electronic device to perform operations when one or more processors are executed individually or collectively.

[0015] According to one embodiment, the operations may include: an operation of displaying content on a display; an operation of selecting an object portion in response to a first input selecting an object portion of the content; an operation of setting a range of information of the object portion in response to a second input changing information of the object portion; an operation of identifying a number of characters corresponding to the set range of information in response to the release of the second input; an operation of generating data based on the object portion and the number of characters; and an operation of updating and displaying the object portion of the content based on the generated data.

[0016] Further scopes of the applicability of the present disclosure will become apparent from the following detailed description. However, since various changes and modifications within the spirit and scope of the present disclosure are clearly understood by those skilled in the art, specific embodiments, such as the detailed description and preferred embodiments of the present disclosure, should be understood as being given merely as examples.

[0017] According to an electronic device, a method for driving an electronic device, and a computer-readable recording medium for the same, the length (e.g., amount of information such as the number of characters) and / or style of a designated part of the content (or information) (e.g., text and / or images such as words, sentences, or phrases) can be intuitively adjusted and provided through direct interaction, such as user gesture-based interaction, in a document (e.g., web document, word document, PDF document, or note document, etc.) on a display.

[0018] According to one embodiment, an electronic device can provide a designated part of content by modifying it in real time in response to user input, and can provide immediate verification of the modified part through the user. According to one embodiment, the convenience of adjusting the information (or content) (e.g., style and length) of the content can be improved in response to user input. For example, the user can directly perform changes to text length and style to enable quick verification. According to one embodiment, content (e.g., text and / or images) can be regenerated (e.g., adjusted content) using direct user input and can provide a new UX (user experience) / UI (user interface) to the user.

[0019] In addition, various effects that can be understood directly or indirectly through this document may be provided. The effects obtainable from this disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.

[0020] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0021] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0022] FIG. 2 is a block diagram showing an integrated intelligence system according to one embodiment.

[0023] FIG. 3 is a block diagram illustrating a generative artificial intelligence system according to one embodiment.

[0024] FIG. 4 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0025] FIG. 5 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.

[0026] FIG. 6 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.

[0027] FIGS. 7a, FIGS. 7b, FIGS. 7c, and FIGS. 7d ​​are drawings illustrating examples of operations for adjusting content information in an electronic device according to one embodiment of the present disclosure.

[0028] FIG. 8 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.

[0029] FIGS. 9a, FIGS. 9b, and FIGS. 9c are drawings illustrating examples of operations for adjusting content information in an electronic device according to one embodiment of the present disclosure.

[0030] FIGS. 10a, FIGS. 10b, FIGS. 10c, FIGS. 10d, FIGS. 10e, and FIGS. 10f are drawings illustrating examples of operations for adjusting content information in an electronic device according to one embodiment of the present disclosure.

[0031] FIG. 11 is a drawing illustrating an example of an operation that supports user input in an electronic device according to one embodiment of the present disclosure.

[0032] FIG. 12 is a drawing illustrating an example of an operation that supports the adjustment of content information in an electronic device according to one embodiment of the present disclosure.

[0033] FIG. 13 is a drawing illustrating an example of an operation that supports the adjustment of content information in an electronic device according to one embodiment of the present disclosure.

[0034] FIG. 14 is a drawing illustrating an example of an operation that supports the adjustment of content information in an electronic device according to one embodiment of the present disclosure.

[0035] FIG. 15 is a drawing illustrating an example of an operation that supports user input in an electronic device according to one embodiment of the present disclosure.

[0036] FIG. 16 is a drawing illustrating an example of an operation that supports user input in an electronic device according to one embodiment of the present disclosure.

[0037] FIG. 17 is a drawing illustrating an example of an operation for adjusting content information in an electronic device according to one embodiment of the present disclosure.

[0038] FIGS. 18a, FIGS. 18b, and FIGS. 18c are drawings illustrating examples of operations for adjusting content information in an electronic device according to one embodiment of the present disclosure.

[0039] FIG. 19 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.

[0040] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0041] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.

[0042] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0043] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0044] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0045] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0046] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (OS) (142), middleware (144), or an application (146).

[0047] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0048] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0049] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0050] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0051] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0052] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0053] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0054] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0055] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0056] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0057] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0058] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a WAN (wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0059] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimization of terminal power and connection of multiple terminals (mMTC, massive machine type communications), or high reliability and low-latency (URLLC, ultra-reliable and low-latency communications). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0060] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0061] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0062] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0063] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0064] FIG. 2 is a block diagram showing an integrated intelligence system according to one embodiment.

[0065] Referring to FIG. 2, an integrated intelligent system of one embodiment may include an electronic device (201) (e.g., the electronic device (101) of FIG. 1), an intelligent server (300), and a service server (399).

[0066] According to the illustrated embodiment, the electronic device (201) may include a communication interface (210), an input / output (I / O) interface (220), a processor (230), and / or memory (240). The listed components may be operatively or electrically connected to each other. For example, the electronic device (201) may include at least some of the components of the electronic device (101) of FIG. 1.

[0067] The communication interface (210) can be connected to an external device (e.g., an intelligent server (300) and / or a service server (399)) via a network (299) (e.g., any network including a cellular network and / or a WLAN (wireless local area network)) to transmit and receive data. For example, the communication interface (210) may correspond to the CP and / or communication circuit of FIG. 1. The I / O interface (220) can receive user input, process received user input, and / or output results processed by the processor (230) using an input / output device (not shown) (e.g., a microphone, a speaker, and / or a display (e.g., the display of FIG. 1).

[0068] The processor (230) may perform a specified operation by being operatively or electrically connected to a communication interface (210), an I / O interface (220), and / or a memory (240) (e.g., the memory (130) of FIG. 1). For example, the processor (230) may correspond to the processor (120) of FIG. 1. The processor (230) may perform a specified operation by executing a program (or one or more instructions) stored in the memory (240). For example, the processor (230) may receive a user's voice input (e.g., user speech) through the I / O interface (220) or from an external electronic device. The processor (230) may transmit the voice input received through the communication interface (210) to an intelligent server (300). For example, the processor (230) may include one or more processors.

[0069] The processor (230) may receive a result corresponding to a voice input from the intelligent server (300). For example, the processor (230) may receive a plan corresponding to the voice input and / or a result calculated using the plan from the intelligent server (300). For example, the plan may include, but is not limited to, information regarding a plurality of sequential operations to be executed by the first electronic device (201) and / or other electronic devices in relation to the voice input. The processor (230) may receive a request from the intelligent server (300) to obtain information (e.g., entities, slots, and / or parameters) necessary to generate a plan corresponding to the voice input. The processor (230) may transmit the necessary information to the intelligent server (300) in response to the request.

[0070] The processor (230) can output the result of executing a specified action according to a plan visually, tactilely, and / or audibly through the I / O interface (220). For example, the processor (230) can sequentially display the result of executing multiple actions on a display. For example, the processor (230) can display only the result of executing multiple actions (e.g., the result of executing one of the multiple actions or the last action) on a display.

[0071] The processor (230) can recognize voice input. For example, the processor (230) can execute an intelligent app (or voice recognition app) to process voice input in response to a specified voice input (e.g., Wake up!). The processor (230) can provide voice recognition services through the intelligent app. The processor (230) can transmit voice input to an intelligent server (300) through the intelligent app and receive a result corresponding to the voice input from the intelligent server (300).

[0072] An intelligent server (300) of one embodiment can receive a user's voice input from an electronic device (201) via a network (299). The intelligent server (300) can convert audio data corresponding to the received voice input into text data. Based on the text data, the intelligent server (300) can generate at least one plan for performing a task corresponding to the user's voice input. The intelligent server (300) can transmit the generated plan, or the result according to the generated plan, to the electronic device (201) via the network (299).

[0073] An intelligent server (300) of one embodiment may include a front end (310), a natural language platform (320), a capsule database (330), an execution engine (340), and / or an end user interface (350).

[0074] The front end (310) can receive voice input received by the electronic device (201) from the electronic device (201). The front end (310) can transmit a response corresponding to the voice input to the electronic device (201).

[0075] The natural language platform (320) may include an automatic speech recognition (ASR) module (321), a natural language understanding (NLU) module (323), a planner module (325), a natural language generator (NLG) module (327), and / or a text-to-speech (TTS) module (329).

[0076] The automatic speech recognition module (321) can convert voice input received from the electronic device (201) into text data. The natural language understanding module (323) can identify the user's intent and / or parameters (e.g., entities and / or slots) based on the text data of the voice input. The user's intent corresponds to the voice input and may include information indicating an action (or function) that the user intends to perform using the device. A slot may be detailed information related to the user's intent. A slot may be obtained based on a domain corresponding to the utterance. A slot may be variable information required to perform an action. In one embodiment, the variable information constituting the slot may include a named entity.

[0077] The planner module (325) can generate a plan using the intent and / or parameters determined by the natural language understanding module (323). For example, the planner module (325) can determine at least one domain required to perform a task based on the determined intent. The planner module (325) can determine multiple actions included in each of the at least one domain determined based on the intent. The domain may correspond to a category (or service) associated with an action (or function) that the user intends to execute using the device. The domain may be classified according to a service (e.g., an app) related to text. The domain may be related to the user's intent corresponding to the text. The domain may be classified according to, for example, the application that receives voice input and / or the type of service to be provided based on voice input, but is not limited thereto. In one example, the determination of the domain may be performed by another module (e.g., the natural language understanding module (323)). The planner module (325) can determine parameters required to execute a plurality of determined actions or result values ​​output by the execution of a plurality of actions. The parameters and result values ​​may be defined as concepts of a specified format (or class). For example, the plan may include a plurality of actions and / or a plurality of concepts determined by the user's intent. The planner module (325) can determine the relationship between the plurality of actions and / or a plurality of concepts in a stepwise (or hierarchical) manner. For example, the planner module (325) can identify the execution order of a plurality of actions (e.g., a plurality of actions determined based on the user's intent) based on a plurality of concepts (e.g., parameters required to execute a plurality of actions, and result values ​​output by the execution of a plurality of actions). The planner module (325) can generate a plan that includes association information (e.g., an ontology) between the plurality of actions and the plurality of concepts.The planner module (325) can generate a plan using information (e.g., at least one capsule) stored in a capsule database (330) in which a set of relationships between concepts and actions is stored.

[0078] The planner module (325) can generate a plan based on an artificial intelligence (AI) system. For example, the AI ​​system may include one or more electronic devices and / or one or more processing circuits to execute a rule-based system, a neural network-based system (e.g., a feedforward neural network (FNN), a recurrent neural network (RNN)), or a combination of the above. The AI ​​system described above is exemplary, and the AI ​​system may be an AI system based on any model based on machine learning. The planner module (325) may select a plan corresponding to a user request from a set of predefined plans, or generate a plan in real time in response to a user request.

[0079] The natural language generation module (327) can change the specified information into a text form. The information changed into a text form may be in the form of a natural language utterance. The text-to-speech conversion module (329) can convert the information in the text form into information in the speech form.

[0080] The capsule database (330) can store information regarding the relationships between multiple concepts and actions corresponding to multiple domains (e.g., applications). The capsule database (330) can store at least one capsule (e.g., capsule (331) and / or capsule (333)) in the form of a concept action network (CAN). For example, the capsule database (330) can store actions for processing a task corresponding to a user's voice input, and parameters required for the actions, in the form of a CAN. A capsule may include multiple action objects (or action information) and / or concept objects (or concept information) included in a plan. For example, capsules (331, 333) may be created per domain and stored in the capsule database (330), but are not limited thereto.

[0081] The execution engine (340) can produce a result using the generated plan. The end user interface (350) can transmit the produced result to the electronic device (201).

[0082] According to one embodiment, some functions (e.g., natural language platform (320)) or all functions of the intelligent server (300) may be implemented in the electronic device (201). For example, the electronic device (201) may execute one or more programs including a natural language platform (e.g., the natural language platform (320) of FIG. 2) separately from the intelligent server (300). For example, the electronic device (201) may directly perform at least some of the operations of the natural language platform (320) of the intelligent server (300) (e.g., automatic speech recognition module (321), natural language understanding module (323), planner module (325), natural language generation module (327), and / or text-to-speech module (329)).

[0083] In one embodiment, the service server (399) may provide a designated service (e.g., food ordering or hotel reservation) to the electronic device (201). The service server (399) may be a server operated by an operator different from the intelligent server (300). The service server (399) may communicate with the intelligent server (300) and / or the electronic device (201) through the network (299). The service server (399) may communicate with the intelligent server (300) through a separate connection (not shown). The service server (399) may provide the intelligent server (300) with information (e.g., operation information and / or concept information for providing the designated service) to generate a plan corresponding to the voice input received by the electronic device (201). The provided information may be stored in the capsule database (330). The service server (399) may provide the intelligent server (300) with result information according to the plan received from the electronic device (201).

[0084] FIG. 3 is a block diagram illustrating a generative artificial intelligence system according to one embodiment.

[0085] Referring to FIG. 3, a generative artificial intelligence system according to one embodiment (e.g., server (108) of FIG. 1 or intelligent server (300) of FIG. 2) may include a user interface (260), a database (265), an application and service component (270), an artificial intelligence (AI) framework (280), and a generative AI model (290). According to one embodiment, the generative artificial intelligence system may be included in an electronic device (e.g., electronic device (101, 201) of FIG. 1 or FIG. 2) (e.g., AI engine)) and / or in an intelligent server (e.g., an external server (e.g., server (108) of FIG. 1).

[0086] The user interface (260) can receive user queries.

[0087] The above input may include user input and / or data obtained or generated by an electronic device (e.g., the electronic device (101, 201) of FIG. 1 or FIG. 2).

[0088] The above data may include images, videos, and / or sensor data generated by at least one processor of the electronic device (101, 201) (e.g., processor (120, 230) of FIG. 1 or FIG. 2).

[0089] The sensor data may include, for example, illuminance data around the electronic device (102, 201) obtained from the sensor module (176) or sensor hub of FIG. 1, posture data (or orientation data) of the electronic device (101, 201), temperature inside the electronic device (101, 201) (e.g., temperature of the display module (160) of FIG. 1 and / or temperature of the processor (120, 230)), size information of the display area of ​​the display module (160), and / or an image obtained through the image sensor of the electronic device (101, 201) (e.g., camera module (180) of FIG. 1).

[0090] The above user query may be in the form of natural language, touch data obtained through a touch circuit included in the display module (160) (e.g., used to identify input from a finger and / or stylus), an image, audio, and / or video. Additionally, context information may be transmitted along with the user query. The context information may include various side information related to the time when the user query is input into the generative artificial intelligence system. For example, the side information may include information such as application information currently being used by the user and / or location information of the user. As another example, the user query may also be a non-natural language input that does not generate natural language, such as a design request or modification. Additionally, a mixed form of the natural language, image, sound, and context information described above is also possible.

[0091] Additionally, the user interface (260) may output results of the generative artificial intelligence system to the user. The output may include results (or result information) generated or obtained by the generative artificial intelligence system based on at least part of the input. The output may be in the form of natural language or specific content, and may also be provided in the form of an action requested by the user. For example, the output may have a format according to the user settings of the electronic device (101, 201).

[0092] The AI ​​framework (280) can receive a user query and coordinate and control each component necessary to perform the user's intent. This AI framework (280) may include a prompt design component (281), an APIs / Plugins Management component (283), and an output modification component (285).

[0093] User queries or actions entered in the user interface (260) can be transmitted to a prompt design component (281). The prompt design component (281) can be used to generate prompts suitable for input into a large language model (LLM), a large vision model (LVM), or a large multimodal model (LMM). The prompt design component (281) may be an AI component that uses machine learning algorithms or neural networks to develop better prompts over time. The prompt design component (281) can generate prompts by accessing a database (265) (e.g., a knowledge component) containing user preference data, a prompt library, and prompt examples, and can transmit them to the large language model (LLM), the large vision model (LVM), and / or the large multimodal model (LMM).

[0094] The application and plugin management component (283) can perform the role of communicating with external information when there is a request for additional information when user input is transmitted as input to the generative AI model (290). The application and plugin management component (283) establishes a channel to communicate with the outside of the generative artificial intelligence system through an application programming interface (API), thereby enabling access to various data sources. For example, the application and plugin management component (283) can be used to request other components (e.g., application and service components (270)) that perform feedback (or response) according to the prompt. The acquired information can be used to generate a prompt by the prompt design component (281) together with the user input, or can be used as input to the generative AI model (290). Additionally, the application and plugin management component (283) can request the action through the API if the application or service needs to perform an action that ultimately executes the user query rather than an intermediate result. Information obtained from an external source can be transmitted as input to a generative AI model (290) along with user input.

[0095] The output modification component (285) can fine-tune (or adjust or change) the output produced by the generative AI model (290). For example, the output modification component (285) can determine the relevance (e.g., score) between the output (e.g., content) of the generative AI model (290) and the user input. For example, the output modification component (285) can verify whether the content generated through a large language model (LLM), a large vision model (LVM), or a large multimodal model (LMM) is relevant, contains biased information (e.g., selective information), or contains harmful information (e.g., violent content or profanity). Additionally, the output modification component (285) can determine the extent to which the output matches the desired result and, if additional processing is required, proceed with that process. Additionally, the output modification component (285) can configure and provide to the user a hint to avoid unwanted output.

[0096] A generative AI model (290) generally refers to an artificial intelligence neural network that generates new forms of data based on user input information. A generative AI model (290) may include an image generation model and / or a language generation model. An image generation model may include a generative adversarial network (GAN) and / or a variational autoencoder (VAE). An example of an image generation model is a diffusion-based generative model that uses the structures of a VAE and a Transformer. Additionally, a language generation model is a model trained to output the statistically most appropriate output value based on input values, and representative examples include models such as CHAT-GPT 3 and CHAT-GPT 4. Additionally, it may include a large-scale multimodal model (LMM) capable of recognizing various forms of data input, such as text, images, and / or speech, and generating new data corresponding to them.

[0097] In one embodiment, the AI ​​framework (280) and / or generative AI model (290) may be included within an AI module (e.g., including a processing circuit) within an electronic device (101, 201). For example, the AI ​​module may be operatively coupled with at least one processor (120, 230) of the electronic device (101, 201). For example, the AI ​​module may be operatively coupled with a sensor hub of the electronic device (101, 201) for one or more sensors within the electronic device (101, 201).

[0098] FIG. 4 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0099] According to one embodiment, FIG. 4 may show a block diagram of an exemplary electronic device (400) (e.g., the electronic device (101) of FIG. 1) capable of performing the operations described in this document.

[0100] Referring to FIG. 4, the electronic device (400) may be one of various forms of electronic devices, such as a notebook (490), smartphones (491) having various form factors (e.g., a bar-type smartphone (491-1), a foldable-type smartphone (491-2), or a sliderable (or rollable)-type smartphone (491-3)), a tablet (492), a cellular phone (not shown), and other similar computing devices (not shown). The components, their relationships, and their functions illustrated in FIG. 4 are illustrative only and are not intended to limit the implementations described or claimed herein. The electronic device (400) may be referred to as a mobile device, a user device, a multifunction device, a portable device, or a server.

[0101] According to one embodiment, the electronic device (400) may include all or at least some of the components of the electronic device (400) as described in the description section with reference to FIG. 1. For example, in various embodiments of this document, some of the illustrated components may be omitted or substituted. The electronic device (400) may include at least some of the components and / or functions of the electronic device (101) of FIG. 1. At least some of each component of the illustrated (or unillustrated) electronic device (400) may be operatively, functionally, and / or electrically connected.

[0102] The electronic device (400) may include components comprising at least one processor (410) (e.g., processor (120) of FIG. 1) (hereinafter referred to as processor (410)), at least one memory (420) (e.g., memory (130) of FIG. 1) (hereinafter referred to as memory (420)), at least one display (440) (e.g., display module (160) of FIG. 1) (hereinafter referred to as display (440)), at least one image sensor (450) (hereinafter referred to as image sensor (450)), at least one communication circuit (460) (e.g., communication module (190) of FIG. 1) (hereinafter referred to as communication circuit (460)), and / or at least one sensor (470) (hereinafter referred to as sensor (470)). The components are merely exemplary. For example, the electronic device (400) may include other components (e.g., power management integrated circuitry (PMIC), audio processing circuit, antenna, rechargeable battery, or input / output interface). For example, some components may be omitted from the electronic device (400). For example, some components may be integrated into a single component.

[0103] The processor (410) can perform application layer processing functions required by the user of the electronic device (400). According to one embodiment, the processor (410) can provide control and commands for functions for various blocks of the electronic device (400). According to one embodiment, the processor (410) can perform operations or data processing regarding the control and / or communication of each component of the electronic device (400). For example, the processor (410) may include at least some of the configuration and / or functions of the processor (120) of FIG. 1. According to one embodiment, the processor (410) may be operatively connected to the components of the electronic device (400). According to one embodiment, the processor (410) may load commands or data received from other components of the electronic device (400) into memory (420), process commands or data stored in memory (420), and store result data.

[0104] The processor (410) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (410) may include at least one electrical circuit and may individually and / or collectively process instructions (or programs, data, etc.) stored in memory (420). The processor (410) may include a processor assembly comprising one or more processing circuitries and / or executable program elements.

[0105] The processor (410) may include any processing circuit operative to control the performance and operation of one or more components of the electronic device (400) (e.g., memory (420), display (440), image sensor (450), communication circuit (460), and / or sensor (470)). For example, the processor (410) may be an application processor (AP). For example, the processor (410) may be a system semiconductor responsible for various functions of the electronic device (400) (e.g., computation and multimedia driving functions). The processor (410) may be implemented as a system on chip (SoC) (e.g., a single chip or a chipset). For example, the processor (410) may be implemented as multiple cores (or at least one core circuit), multiple chips, or multiple chipsets. For example, the processor (410) may include one or more processing circuits. For example, the processor (410) may include one or more processing circuits configured to perform the various functions of the present disclosure individually and / or collectively. As an example without limitation, at least a portion of the processor (410) may be included in a first chip of the electronic device (400), and at least another portion of the processor (410) may be included in a second chip of the electronic device (400) that is different from the first chip of the electronic device (400).

[0106] For example, the processor (410) may include a central processing unit (CPU) (411), a graphics processing unit (GPU) (412), a neural processing unit (NPU) (413), an image signal processor (ISP) (414), a display controller (415), a memory controller (416), a storage controller (417), a communication processor (CP) (418), and / or a sensor interface (419). These components of the processor (410) are merely exemplary. For example, the processor (410) may include other components. For example, some components of the processor (410) may be omitted from the processor (410). For example, some components of the processor (410) may be included as separate components of the electronic device (400) outside of the processor (410). For example, some components of the processor (410) (e.g., memory controller (416)) may be included within other components (e.g., at least part of memory (420), an interface (e.g. available for connection to at least one component of the electronic device (400)), a display (440) and / or an image sensor (450)).

[0107] The processor (410) can cause other components of the electronic device (400) to perform various operations by executing instructions stored in memory (420).

[0108] The CPU (411) (or central processing circuit) may be configured to control the components of the processor (410) based on the execution of instructions stored in memory (420) (e.g., volatile memory (421) and / or non-volatile memory (422)). The CPU (411) may decode user commands and perform arithmetic and logical operations, and / or data processing operations. For example, the CPU (411) may be responsible for the functions of memory, interpretation, operation, and control. The CPU (411) may execute all software of the electronic device (400) (e.g., application (146) of FIG. 1) on an operating system (OS) and control hardware devices.

[0109] The CPU (411) can store instructions or data in the volatile memory (421) of the memory (420) (e.g., the volatile memory (132) of FIG. 1) as at least part of the data processing or operation, process the instructions or data stored in the volatile memory (421), and store the result data in the non-volatile memory (422) of the memory (420) (e.g., the non-volatile memory (134) of FIG. 1).

[0110] The CPU (411) may include a single processor core or multiple processor cores. The CPU (411) may be a programmable processor capable of storing executable instructions (e.g., instructions capable of performing operations on the CPU (411)) and executing the instructions.

[0111] The CPU (411) may operate in a multi-domain environment. The CPU (411) may operate in a domain of a normal world (e.g., a non-secure world, a framework, or a non-secure environment) and a multi-domain environment of a secure world (e.g., a security framework or a security environment). In one embodiment, a domain of the secure world may include one or more domains (e.g., a trusted OS, a Trustzone, and / or a virtualization framework).

[0112] The GPU (412) (or graphics processing circuit) may be configured to perform parallel operations (e.g., rendering). The GPU (412) may be responsible for graphics processing. The GPU (412) may receive instructions from the CPU (411) and perform graphics processing to represent the shape, position, color, shade, movement, and / or texture of objects (or things) on the display (440).

[0113] The NPU (413) (or neural processing circuit, or AI (artificial intelligence) chip) can be configured to execute computations (e.g., convolution computations) for artificial intelligence models. The NPU (413) can perform processing optimized for deep-learning algorithms of artificial intelligence. The NPU (413) is a processor optimized for deep-learning algorithm computations (e.g., artificial intelligence computations) and can process big data quickly and efficiently like a human neural network. For example, the NPU (413) can be primarily used for artificial intelligence computations. The NPU (413) can perform processing such as automatically adjusting the focus by recognizing objects, environments, and / or people in the background when capturing video through a camera, automatically switching the camera's shooting mode to food mode when taking food photos, and / or removing only unnecessary subjects from the captured results. The NPU (413) can perform processing to generate response content based on given information (e.g., natural language).

[0114] The ISP (414) (or image signal processing circuit) may be configured to process a raw image acquired through an image sensor (450) into a format suitable for components within the electronic device (400) or components of the processor (410). For example, the ISP (414) may be responsible for image processing and correction of images and videos. The ISP (414) may correct unprocessed data (e.g., raw data) transmitted from the image sensor (450) of a camera (e.g., camera module (180) of FIG. 1) to generate an image in a form more preferred by the user. The ISP (414) may perform post-processing such as adjusting the partial brightness of the image and emphasizing detailed parts. For example, the ISP (414) may independently undergo a process of image quality tuning and correction of the image acquired through the camera to generate a result preferred by the user.

[0115] The ISP (414) can support artificial intelligence-based image processing technology. The ISP (414) can support scene segmentation (e.g., image segmentation) technology that recognizes and / or classifies parts of the scene being captured in conjunction with the NPU (413). For example, the ISP (414) may include a function to process objects such as the sky, bushes, and / or skin by applying different parameters. The ISP (414) can detect and display a human face during video capture using artificial intelligence functions, or use the coordinates and information of the face to adjust the brightness, focus, and / or color of the image.

[0116] According to one embodiment, the electronic device (400) can support integrated machine learning processing by interacting with all processors such as a CPU (411), GPU (412), NPU (413), and ISP (414).

[0117] A display controller (415) (or display control circuit, or DPU (display processing unit)) may be configured to process an image obtained from a CPU (411), GPU (412), ISP (414), or memory (420) (e.g., volatile memory (421)) into a format suitable for display (440).

[0118] The memory controller (416) (or memory control circuit) may be configured to control reading data from the volatile memory (421) and writing data to the volatile memory (421).

[0119] The storage controller (417) (or storage control circuit) may be configured to control reading data from non-volatile memory (422) and writing data to non-volatile memory (422).

[0120] The CP (418) (or communication processing circuit) may be configured to process data obtained from a component of the processor (410) into a format suitable for transmitting to another electronic device via the communication circuit (460), or to process data obtained from another electronic device via the communication circuit (460) into a format suitable for processing by the component of the processor (410). For example, the communication circuit (460) may include one or more communication circuits.

[0121] The sensor interface (419) (or sensing data processing circuit, sensor hub) may be configured to process data regarding the state of the electronic device (400) and / or the state around the electronic device (400), obtained through the sensor (470), into a format suitable for the components of the processor (410).

[0122] According to one embodiment, the processor (410) can operate in a normal mode (or normal world) and a secure mode (or secure world). According to one embodiment, the processor (410) can control (or process) the overall operation related to adjusting and providing the content (or information) of a portion of the content corresponding to user input (e.g., touch gesture-based input) based on processing circuits and / or executable program elements.

[0123] According to one embodiment, the processor (410) can display content on a display and receive input selecting an object portion of the content. According to one embodiment, the processor (410) can identify a predetermined amount of information (e.g., number of characters) in response to the input. According to one embodiment, the processor (410) can generate a prompt including first information and second information to generate data regarding first information about the object portion and second information about the number of characters. According to one embodiment, the processor (410) can transmit the prompt to a generative artificial intelligence (AI) on-device and / or a server and acquire data based on the prompt. According to one embodiment, the processor (410) can update and display the object portion of the content based on the acquired data.

[0124] According to one embodiment, the detailed operation of the processor (410) (e.g., processor (120) of FIG. 1) of the electronic device (400) (e.g., electronic device (101) of FIG. 1) is described with reference to the drawings described below.

[0125] According to one embodiment, operations performed by the processor (410) may be implemented by executing instructions stored in a recording medium (or computer program product or storage medium). For example, the recording medium may include a non-transitory computer-readable recording medium that records a program for executing various operations performed by the processor (410).

[0126] The embodiments described in this disclosure may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof. According to a hardware implementation, the operations described in one embodiment may be implemented using at least one of application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, and / or other electrical units for performing functions.

[0127] In one embodiment, a computer-readable recording medium (or computer program product or storage medium) is provided that records a program to perform (or execute) various operations in an electronic device (400).

[0128] The above operations may include: an operation of displaying content on a display; an operation of receiving an input selecting an object portion of the content; an operation of identifying a predetermined number of characters in response to the input; an operation of generating a prompt including first information and second information to generate data regarding first information about the object portion and second information about the number of characters; an operation of transmitting the prompt to a generative artificial intelligence (AI) on a device and / or server; an operation of acquiring data based on the prompt; and an operation of updating and displaying the object portion of the content based on the acquired data.

[0129] The memory (420) includes at least some of the configuration and / or functions of the memory (130) of FIG. 1 and can store software (e.g., the program (140) of FIG. 1 and / or the application (146) of FIG. 1). The memory (420) may include one or more storage media (or one or more storage devices). For example, the memory (420) may include a memory assembly comprising one or more storage media. For example, the one or more storage media may include a hard drive, a permanent memory such as flash memory, read-only memory (ROM) (e.g., non-volatile memory (422)), a semi-permanent memory such as random access memory (RAM) (e.g., volatile memory (421)), any other suitable type of storage (or storage assembly), or any combination thereof.

[0130] The memory (420) may include a cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (400). As an example, but not limited to, the cache memory may be included within the processor (410).

[0131] The memory (420) can be fixedly embedded in the electronic device (400) or incorporated into one or more suitable types of components (e.g., a SIM (subscriber identity module) card and / or an SD (secure digital) card) that can be repeatedly inserted into and removed from the electronic device (400).

[0132] For example, memory (420) may store one or more software applications, such as operating system (OS) (or system) software applications, firmware software applications, driver software applications, plugin (e.g., add-in, add-on, and / or applet) software applications, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by the processor (410). For example, memory (420) may store instructions that can be called by an application programming interface (API). For example, memory (420) may store instructions within a library.

[0133] The memory (420) can store various data used by at least one component of the electronic device (400) (e.g., processor (410)). In one embodiment, the data may include software (e.g., program (140) of FIG. 1) (e.g., operating system (142), middleware (144), and / or application (146) of FIG. 1) and input data or output data for commands associated with the software.

[0134] The memory (420) may include a volatile memory (421) (e.g., the volatile memory (132) of FIG. 1) or a non-volatile memory (422) (e.g., the non-volatile memory (134) of FIG. 1). The memory (420) may store instructions or data received from the processor (410) in the volatile memory (421), and may store result data processed by the processor (410) from the instructions or data stored in the volatile memory (421) in the non-volatile memory (422).

[0135] In one embodiment, the data stored in the memory (420) may include various learning data and / or parameters obtained based on the user's learning through interaction with the user. In one embodiment, the data may include various schemas (or algorithms, models, networks, or functions) to support artificial intelligence-based operations (e.g., artificial intelligence-based operations related to adjusting the content of parts corresponding to user input in the content).

[0136] In one embodiment, the fields in which artificial intelligence technology is applied may be diverse. For example, it may consist of technology fields of linguistic understanding, visual understanding, reasoning / prediction, knowledge representation, and / or motion control. Linguistic understanding is a technology that recognizes and applies / processes human language / characters, and may include natural language processing, machine translation, dialogue systems, question answering, and / or speech recognition / synthesis. Visual understanding is a technology that recognizes and processes objects like human vision, and may include object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and / or image enhancement. Reasoning / prediction is a technology that logically reasones and predicts by judging information, and may include knowledge / probability-based reasoning, optimization prediction, preference-based planning, and / or recommendation. Knowledge representation is a technology that automatically processes human experience information into knowledge data, and may include knowledge construction (e.g., data generation / classification) and / or knowledge management (e.g., data utilization). Motion control is a technique for controlling the movement of an electronic device (200) and may include motion control and / or operation control (e.g., behavior control).

[0137] In one embodiment, a schema for supporting artificial intelligence-based operation in an electronic device (400) may include a neural network. In one embodiment, the neural network may include a neural network model based on at least one of an artificial neural network (ANN), a convolutional neural network (CNN), a region with convolutional neural network (R-CNN), a region proposal network (RPN), a recurrent neural network (RNN), a stacking-based deep neural network (S-DNN), a state-space dynamic neural network (S-SDNN), a Deconvolution Network, a deep belief network (DBN), a restricted Boltzmann machine (RBM), a long short-term memory (LSTM) network, a classification network, a plain residual network, a dense network, a hierarchical pyramid network, and / or a fully convolutional network. According to one embodiment, the types of neural network models are not limited to the examples described above.

[0138] According to one embodiment, the memory (420) can store instructions that cause the electronic device (200) to perform an operation when executed individually and / or collectively by the processor (410).

[0139] According to one embodiment, the memory (420) may store instructions that, when executed individually and / or collectively by the processor (410), allow the electronic device (400) to display content on a display, receive an input selecting an object portion of the content, and in response to the input, identify a predetermined number of characters, generate a prompt including first information and second information to generate data regarding first information about the object portion and second information about the number of characters, transmit the prompt to a generative artificial intelligence on the device and / or server, acquire data based on the prompt, and update and display the object portion of the content based on the acquired data.

[0140] Instructions can be stored as software (e.g., program (140) of FIG. 1) in memory (420) and can be executed by a processor (410). For example, instructions may include control commands such as arithmetic and logical operations, data movement, and / or input / output that can be recognized by the processor (410). According to one embodiment, the software may include various applications (e.g., application (146) of FIG. 1) that can provide various functions (or services) (e.g., content creation function, AI service function, conversational service function, routine function, search function, context awareness function, prompt generation function, call function, message function, messenger function, email function, social networking service (SNS) function, media (e.g., video and / or music) playback function, game function, and / or wireless communication function) in the electronic device (400).

[0141] The display (440) may include a configuration identical or similar to the display module (160) of FIG. 1. The display (440) may display various images provided by the processor (410). Under the control of the processor (410), the display (440) may visually provide various screens related to an application being executed (e.g., the application (146) of FIG. 1) and its use (e.g., contents screen, application execution screen, menu screen, and / or function execution screen). According to one embodiment, the display (440) may display a screen provided by adjusting the content of a portion of the content that corresponds to user input.

[0142] According to one embodiment, the display (440) may change its screen size according to the form factor of the electronic device (400) (e.g., a bar-type smartphone (491-1), a foldable-type smartphone (491-2), or a sliderable (or rollable)-type smartphone (491-3)), or a tablet (492)). For example, the display (440) may be configured to provide a first state having a first screen size and a second state having a second screen size larger than the first screen size. According to one embodiment, the display (440) may display a screen in which the content of the portion corresponding to user input in the content is adjusted according to the screen size and / or display area.

[0143] According to one embodiment, the electronic device (400) may include an electronic device of the form of a foldable electronic device (e.g., a foldable type smartphone (491-2)) (e.g., including a multi-foldable electronic device). For example, the electronic device (400) may be a foldable electronic device of various forms such as a G-type, Z-type, or e-type. According to one embodiment, if the electronic device (400) is in the form of a multi-foldable electronic device, the electronic device (400) may include a first housing, a second housing, and a third housing. According to one embodiment, the electronic device (400) may provide different information displays depending on the state of the display (440) of the electronic device (400) (or the size of the displayed screen (or screen display area)) (e.g., flex state (or intermediate mode)), such as when the first housing is folded or when the first housing and the third housing are folded together.

[0144] In one embodiment, the operation when the electronic device (400) is a foldable electronic device is merely illustrative and is not intended to limit the implementations described or claimed in this document, and the implementation of the present disclosure may be implemented in various devices such as smartphones, wearable devices, laptop computers, home appliances, and / or vehicles equipped with content creation functions.

[0145] The display (440) may be combined with a touch sensor, a pressure sensor capable of measuring the intensity of the touch, and / or a touch panel (e.g., a digitizer) that detects a magnetic field-based stylus pen. The display (440) may detect touch input, air gesture input, and / or hovering input (or proximity input) by measuring a change in a signal (e.g., voltage, light intensity, resistance, electromagnetic signal, and / or charge quantity) at a specific location on the display (440) based on the touch sensor, pressure sensor, and / or touch panel. For example, the display (440) may include a touchscreen that detects touch and / or proximity touch (or hovering) input using a part of the user's body (e.g., a finger) or an input device (e.g., a stylus pen).

[0146] The display (440) may include, but is not limited to, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, and / or an active matrix OLED (AMOLED) display, a micro electro mechanical systems (MEMS) display, or an electronic paper display. According to one embodiment, the display (440) may include a flexible display.

[0147] The communication circuit (460) can support the establishment of a designated wireless communication channel (e.g., short-range communication such as Bluetooth communication and / or BLE communication) and the performance of communication through the established wireless communication channel. For example, the communication circuit (460) can perform designated communication (e.g., Bluetooth communication and / or BLE communication) with an external device. The communication circuit (460) can support wireless communication with an external device using cellular wireless communication (e.g., 4G LTE, 5G NR) and / or short-range wireless communication (e.g., Wi-Fi). For example, the electronic device (400) can use the communication circuit (460) to communicate with an external server (e.g., a generative artificial intelligence server) that provides artificial intelligence-based functions (e.g., conversational services or assistant services or AI agents) over a network. According to one embodiment, the communication circuit (460) can transmit data generated from the electronic device (400) to an external server and receive data transmitted from the external server. The communication circuit (460) may include at least some of the configuration and / or functions of the communication module (190) of FIG. 1.

[0148] In one embodiment, the electronic device (400) may include an artificial intelligence-based function (e.g., a conversational service or an assistant service or an AI agent) within an AI module (e.g., including a processing circuit) within the electronic device (400). For example, the AI ​​module may be operatively coupled with at least one processor of the electronic device (400) (e.g., processor (120), processor (230), or processor (410)). For example, the AI ​​module may be operatively coupled with a sensor of the electronic device (400) for one or more sensors within the electronic device (400) (e.g., sensor module (176), sensor (470), or sensor interface (419)).

[0149] An electronic device according to one embodiment of the present disclosure (e.g., the electronic device (101, 201, 400) of FIG. 1, 2 or 4) (hereinafter referred to as electronic device (101)) may include a display (e.g., the display module (160) of FIG. 1 or the display (440) of FIG. 4) (hereinafter referred to as display (160)), at least one processor (e.g., the processor (120, 230, 410) of FIG. 1, 2 or 4) including processing circuitry (hereinafter referred to as processor (120)), and a memory (e.g., the memory (130, 240, 420) of FIG. 1, 2 or 4) (hereinafter referred to as memory (130)). In one embodiment, the memory (130) can store instructions that cause the electronic device (101) to perform an operation when executed individually and / or collectively by the processor (120).

[0150] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may display content on a display. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may select an object part in response to a first input selecting an object part of the content. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may set a range of information of the object part in response to a second input changing information of the object part. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may identify a number of characters corresponding to the set range of information in response to the release of the second input. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may generate data based on the object portion and the number of characters. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may update and display the object portion of the content based on the generated data.

[0151] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may display content on a display (160). When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may receive an input selecting an object portion of the content. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may identify a set number of characters in response to the input. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may generate a prompt including the first information and the second information to generate data regarding the first information about the object part and the second information about the number of characters. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may transmit the prompt to a generative artificial intelligence (AI) on-device and / or a server. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may obtain data based on the prompt. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may update and display the object portion of the content based on the acquired data.

[0152] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may provide a cue indicating a selection state for a selected object part in response to a first input. According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may receive a second input that moves the first input based on the object part while providing the cue. According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may provide a custom information window based on the object part in response to the second input.

[0153] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be configured to adjust the range of the custom information window according to a change in the second input. According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be configured to detect the release of the second input. According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be configured to identify the amount of information that can be generated based on the custom information window in response to the release of the second input.

[0154] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may provide the queue based on a highlighting indication of the object portion in response to the first input.

[0155] According to one embodiment, the object portion may include a text portion and / or an image portion of the content.

[0156] According to one embodiment, the first input may include a touch gesture input defined to set the highlighting.

[0157] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be configured to process a second function different from a first function that is fundamentally defined to operate by the second input, for the second input while the selection of the object part is active.

[0158] According to one embodiment, the second input may include a pinch in / out touch gesture input.

[0159] According to one embodiment, the first function may include a screen zoom in / out function based on the pinch in / out touch gesture input.

[0160] According to one embodiment, the second function may include a function to adjust the range of the custom information window based on the pinch in / out touch gesture input.

[0161] According to one embodiment, the custom information window may include an information preview area for previewing information to be generated.

[0162] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may provide the custom information window with a reduced range corresponding to the pinch-in touch gesture input when the second input is a pinch-in touch gesture input. According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may provide the custom information window with an expanded range corresponding to the pinch-out touch gesture input when the second input is a pinch-out touch gesture input.

[0163] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be able to identify an amount of information that can be generated corresponding to the range of the custom information window.

[0164] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may identify the full range of the content and the maximum input limit range for which the content can be entered. According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may identify the maximum supportable range of the custom information window using the full range and the input limit range.

[0165] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be able to limit the range adjustment of the custom information window for the second input that exceeds the maximum supportable range of the custom information window.

[0166] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may provide a notification interface in response to the limitation of the range adjustment of the custom information window.

[0167] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may adjust the object size of the information to increase the range of the amount of information that can be generated when the maximum supportable range of the custom information window is exceeded.

[0168] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may provide the custom information window in a different format depending on the characteristics of the application providing the content.

[0169] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may provide the custom information window by replacing the object portion according to a first characteristic of the application providing the content. According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may change the layout in which the content is displayed according to the adjustment of the scope of the custom information window.

[0170] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may provide the custom information window as a popup window based on the object portion according to a second characteristic of the application providing the content. According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may change the popup window while maintaining the layout in which the content is displayed according to the adjustment of the scope of the custom information window.

[0171] According to one embodiment, the acquired data may include text data and a style indicator.

[0172] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be configured to display the style indicator adjacent to the custom information window.

[0173] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) may be configured to change the type of data to correspond to the format of the selected one or more indicators in response to an input selecting one or more indicators of the style indicator.

[0174] Hereinafter, the operation method of an electronic device (101, 201, 400) (hereinafter referred to as electronic device (101)) of various embodiments will be described in detail. Operations performed in the electronic device (101) according to various embodiments may be executed by at least one processor (120, 230, 410) (hereinafter referred to as processor (120)) comprising various processing circuitry and / or executable program elements of the electronic device (101). According to one embodiment, operations performed in the electronic device (101) may be stored as instructions in memory (130, 240, 420) (hereinafter referred to as memory (130)) and may be performed (or executed) individually and / or collectively by the processor (120).

[0175] FIG. 5 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.

[0176] According to one embodiment, FIG. 5 may illustrate an example of an operation (or method) in which the electronic device (101) according to one embodiment adjusts and provides content (or information) of a portion corresponding to user input (e.g., touch gesture-based input) in displayed content. For example, FIG. 5 may illustrate an example of an operation in which the electronic device (101) regenerates and provides content (or information) of a portion corresponding to user input (e.g., touch gesture-based input) in content using artificial intelligence (e.g., generative AI). According to one embodiment, as illustrated in FIG. 5, the operation method performed by the electronic device (101) may include receiving a prompt related to information generation in response to direct user input, and based on the prompt, obtaining information (e.g., result data) generated in relation to the prompt from an on-device and / or server and providing (e.g., displaying) it to the user.

[0177] According to one embodiment, artificial intelligence may include generative artificial intelligence (generative AI). Generative artificial intelligence may represent an artificial intelligence technology that creates new content using existing content such as text, audio, and / or images. For example, generative artificial intelligence may represent an artificial intelligence technology that can generate content (e.g., text, audio, images, and / or videos) corresponding to an input based on a given input (e.g., a prompt). According to one embodiment, an electronic device (101) may generate and provide music based on generative artificial intelligence (e.g., on-device AI). According to one embodiment, the electronic device (101) may request music generation from a server and receive and provide music generated based on the server's generative artificial intelligence from the server. According to one embodiment, the electronic device (101) may provide a prompt (or instruction or generative AI prompt) requesting music generation (e.g., a question or instruction to be input to the generative artificial intelligence) to the generative artificial intelligence.

[0178] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 5. The flowchart illustrated in FIG. 5 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 501 to 513 may be performed by at least one processor (120) of the electronic device (101).

[0179] As illustrated in FIG. 5, the operation method performed by an electronic device (101) according to one embodiment may include: an operation of displaying content on a display (operation 501); an operation of receiving an input selecting an object part of the content (operation 503); an operation of identifying a predetermined number of characters in response to the input (operation 505); an operation of generating a prompt including first information and second information to generate data regarding first information about the object part and second information about the number of characters (operation 507); an operation of transmitting the prompt to a generative artificial intelligence (AI) on-device and / or server (operation 509); an operation of acquiring data based on (or in relation to) the prompt (operation 511); and an operation of updating and displaying the object part of the content based on the acquired data (operation 513).

[0180] Referring to FIG. 5, in operation 501, the processor (120) of the electronic device (101) can display content on a display. In one embodiment, the content may include content included (or provided) in a document of a defined format and / or content included (or being entered) in an input field that supports the input of content (e.g., text and / or images) by a user.

[0181] According to one embodiment, the processor (120) can execute an application (e.g., a web browser, a word application, a PDF application, a note application, or a character input application (e.g., a message application, an email application, a web browser, etc.)) based on user input and display a document related to the application on the display.

[0182] In one embodiment, the document may include documents of various formats (or forms) that are displayed and editable (e.g., editable) through the electronic device (101), such as, for example, web documents, Word documents, PDF documents, or note documents. In one embodiment, the document may include content (e.g., text and / or images). In one embodiment, the document may include content (e.g., text and / or images) that can be written by a user through, for example, a keypad (or keyboard) of the electronic device (101) and that the user is writing (or inputting) on ​​a display area. In one embodiment, the document may include content (e.g., text and / or images) that is being written (or inputting) through, for example, an input field (e.g., an input field for writing a message, an input field for writing an email, an input field for text input on a webpage, etc.).

[0183] In operation 503, the processor (120) may receive an input that selects an object portion of the content (e.g., at least a part of the content (e.g., the whole part of the content or a part of the content)). In one embodiment, the object portion of the content may include, for example, a text portion and / or an image portion contained in the content. In one embodiment, the input may include various touch gesture inputs that support block selection on the object portion (or area) intended by the user in the content. For example, the input may include multi-touch gesture inputs such as pinch in / out inputs. In one embodiment, the input may include an input that selects (or multi-long touches) an object portion of the content (e.g., a portion of the content between the first portion and the second portion) by selecting (or multi-long touching) a first portion of the content within the document displayed on the display (e.g., a first touch portion) and a second portion different from the first portion (e.g., a second touch portion). In one embodiment, the input may include selecting a first part of the content within the document and moving to (e.g., dragging) a second part of the content to select and specify an object part of the content (e.g., a part of the content between the first part and the second part). For example, the user may select (e.g., by selecting with the user's block selection) an object part (e.g., a text part and / or an image part) that needs to be shortened or expanded from the content displayed on the display.

[0184] According to one embodiment, user input may be distinguished into, for example, a first input for selecting an object portion (e.g., block selection) and a second input for adjusting information (or content) of the selected object portion. In one embodiment, the first input and the second input may be consecutive inputs that interact. For example, the first input may include a multi-touch gesture input, and the second input may include a touch gesture input for zooming (e.g., zoom in / out) while maintaining the first input (e.g., multi-touch gesture input).

[0185] According to one embodiment, the processor (120) may provide a cue indicating a selection state for a selected object portion in response to an input (e.g., a first input for block selection). According to one embodiment, the processor (120) may provide a cue based on a highlighting indication of the object portion in response to the first input. For example, a user may perform an input to set a block on an object portion, and the processor (120) may provide a cue indicating a block state through the object portion in response to the user's input. In one embodiment, the first input may include a touch gesture input (e.g., touch and drag input, long press input, etc.) defined to set the highlighting.

[0186] According to one embodiment, the processor (120) may receive an input based on an object part while providing a queue (e.g., a second input that moves a first input (e.g., a pinch in / out touch gesture input). According to one embodiment, the processor (120) may provide a custom information window (or information bubble) based on the object part in response to the input (e.g., the second input). In one embodiment, the custom information window may be provided optionally or not provided. For example, the processor (120) may identify the character count based on the second input without displaying an additional information window (e.g., a custom information window), regenerate the selected text to match the character count, and then display the result. For example, the custom information window may be provided optionally, and the processor (120) may not display the custom information window, and the content containing the object part may be displayed in the window (or input field) where the object part (e.g., a text part and / or an image part) expands / collapses. In one embodiment, regarding an embodiment providing a custom information window This will be discussed later.

[0187] In one embodiment, the second input may include, for example, a touch gesture (e.g., pinch-in touch gesture or pinch-out touch gesture) for specifying the range (or amount of information) (e.g., number of characters) of information of an object part.

[0188] According to one embodiment, the processor (120) may set and provide a custom information window (or information bubble) (e.g., a defined block or highlighting) on ​​a selected object part in response to input. According to one embodiment, while the selection of an object part of the content is active (e.g., a block is set on the object part or a custom information window is displayed), the processor (120) may process a second function different from a first function that is basically defined to operate by said input in response to a user input (e.g., a second input) (e.g., a pinch-in / out touch gesture input). In one embodiment, the first function may include a screen zoom function (e.g., a screen zooming (e.g., a zoom in / out) function) in response to a pinch-in / out touch gesture input when at least one part of the content (e.g., an object part) is not selected (e.g., a block is not set on the object part). In one embodiment, the second function may include a function to adjust the range (or amount of information) (e.g., number of characters) of information to be displayed (or provided or updated) based on an object part of the content, according to a pinch-in / out touch gesture input, when at least one part of the content (e.g., an object part) is selected (e.g., a block is set on the object part). In one embodiment, the range of information may be referenced, for example, by a custom information window that can be set and changed through the object part. In one embodiment, the second function may include a function to adjust the range of the custom information window.

[0189] According to one embodiment, when the second input is a pinch-in touch gesture input, the processor (120) may reduce the amount of information (e.g., number of characters, image size, and / or number of images, etc.) related to an object part (e.g., a part blocked in the content) to correspond to changes in the pinch-in touch gesture input. According to one embodiment, when providing a custom information window (or information bubble), the processor (120) may reduce the range of the custom information window. According to one embodiment, when the second input is a pinch-out touch gesture input, the processor (120) may expand the amount of information (e.g., number of characters, image size, and / or number of images, etc.) related to an object part (e.g., a part blocked in the content) to correspond to changes in the pinch-out touch gesture input. According to one embodiment, when providing a custom information window, the processor (120) may expand the range of the custom information window.

[0190] According to one embodiment, the processor (120) may display a custom information window (or amount of information) in a different format depending on the characteristics of the application providing the content. For example, the processor (120) may provide a custom information window by replacing an object portion depending on a first characteristic of the application providing the content, and may change and provide the layout in which the content is displayed depending on the adjustment of the range of the custom information window. For example, the processor (120) may provide the custom information window as a popup window based on an object portion depending on a second characteristic of the application providing the content. According to one embodiment, the processor (120) may change the popup window while maintaining the layout in which the content is displayed depending on the adjustment of the range of the custom information window based on user input.

[0191] In operation 505, the processor (120) can identify a set number of characters in response to an input. According to one embodiment, the processor (120) can adjust the range (or amount of information) (e.g., number of characters) of information in an object part according to a change in input (e.g., a change in a second input). According to one embodiment, when using a custom information window, the processor (120) can adjust the range of the custom information window. According to one embodiment, the processor (120) can identify the range (or amount of information) (e.g., number of characters) of information that has been changed (e.g., expanded or contracted) in relation to the object part, or the range (or amount of information) (e.g., number of characters) of information corresponding to the changed custom information window in response to detecting the release of the second input (e.g., release of touch or release of pinch touch gesture). For example, when the processor (120) detects the release of the second input, it can identify the amount of information (e.g., number of characters) that can be generated based on the custom information window. For example, the processor (120) can determine (e.g., calculate) the amount of information that can be generated in correspondence with the range of information changed in relation to the object part (or the range of the changed custom information window). According to one embodiment, the processor (120) can calculate the amount of information (e.g., number of characters) based on the size of a rectangular area (e.g., virtual rectangular area) based on the distance between two touches of a pinch touch gesture and the size of the displayed characters (e.g., font size).

[0192] According to one embodiment, the processor (120) can calculate the range (or amount of information) (e.g., number of characters, image size, number of images, etc.) of information corresponding to a custom information window. According to one embodiment, the content and / or object portion may include text, images, and / or videos. According to one embodiment, the processor (120) can determine the type of information (or rewriting style) (e.g., writing style, picture) based on the type of content (e.g., text, images, and / or videos) of the content portion, along with the range of information.

[0193] According to one embodiment, the range of information may be set differently depending on the type (or attribute) of the content of the object part selected in the content. According to one embodiment, if the type of content included in the selected object part is text, the range of information may be determined by the number of characters mapped to correspond to the size of the block area (e.g., the range of the custom information window). For example, corresponding to the size of the custom information window, the number of characters of the text may be determined as approximately 100 characters, approximately 300 characters, or approximately 500 characters. According to one embodiment, if the type of content included in the selected object part is an image or video, the range of information may be determined by the capacity (or size) and / or the number of images / videos mapped to correspond to the size of the block area (e.g., the range of the custom information window). For example, corresponding to the size of the custom information window, the number of images / videos may be determined as approximately 2, approximately 3, or approximately 5 images / videos. For example, corresponding to the size of the custom information window, the size of a single image / video (e.g., aspect ratio) may be set to approximately 3*3, approximately 5*5, etc. For example, corresponding to the size of the custom information window, the size of a single image / video (e.g., capacity) may be set to approximately 50 bytes, approximately 100 bytes, approximately 300 bytes, etc. According to one embodiment, if the type of content included in the selected object portion is text and image (and / or video), the scope of the information may be determined by the number of characters mapped to correspond to the size of the custom information window and the size of the image. For example, corresponding to the size of the custom information window, the number of characters of the text may be set to approximately 150, and the size of the image may be approximately 5*5, approximately 50 bytes, etc. These examples are provided to aid in understanding the present disclosure, and the embodiments of the present disclosure are not limited by such examples.

[0194] According to one embodiment, the scope of information may be information that defines (or limits) the amount (or length, capacity, or size) of data (or content, result data, or answer) to be generated for a selected object portion in the content (700), for example. According to one embodiment, the amount of information (e.g., total number of characters and / or total capacity or total number of images / videos) that can be provided (e.g., displayed) in the content (700) may be defined (or set) differently depending on the document (or application).

[0195] According to one embodiment, depending on the application, there may be a maximum length that limits the amount of content that can be displayed by the application. For example, the processor (120) may identify the full range of content and the maximum input limit range for which content can be entered. According to one embodiment, the processor (120) may identify the maximum range that can be supported by the custom information window using the full range and the input limit range. According to one embodiment, the processor (120) may limit the range adjustment of the custom information window for a second input that exceeds the maximum range that can be supported by the custom information window. According to one embodiment, the processor (120) may provide a notification interface to the user in response to the limitation of the range adjustment of the custom information window. According to one embodiment, if the maximum range that can be supported by the custom information window is exceeded, the processor (120) may increase the range of the amount of information that can be generated by adjusting the object size of the information. An embodiment thereof is described with reference to the drawings described below.

[0196] According to one embodiment, the maximum length limiting the amount of content may be set differently depending on the type of content. For example, if the type of content is 'text', the maximum length may be defined as approximately 500 characters. For example, if the type of content includes 'text' and 'image', the text included in the maximum length may be defined as approximately 300 characters, the number of images included in the maximum length may be 2, or the size of a single image may be defined as 3*3 (width*height). For example, if the type of content includes 'text' and 'video', the text included in the maximum length may be defined as approximately 150 characters, the size of the video included in the maximum length may be defined as 5*5 (width*height), and the capacity of the video may be defined as approximately 50 bytes. These examples are provided to aid in understanding the present disclosure and are not intended to limit the present disclosure.

[0197] In operation 507, the processor (120) may generate a prompt containing first information and second information to generate data regarding first information about an object part and second information about the number of characters. For example, while the user is adjusting the range of information based on the second input, if the user determines that they have reached a desired length (or range), the second input may be released (e.g., touch-up). According to one embodiment, in response to the release of the second input (e.g., third input), the processor (120) may generate a prompt containing content and a range of information (or amount of information) to generate data (e.g., related information or result data or answer) regarding the content (e.g., text and / or image) of the object part selected in the content (700) and the range of information (or amount of information) (e.g., number of characters, image size, number of images, etc.) according to the size of the custom information window.

[0198] According to one embodiment, if a maximum length exists, the processor (120) may include information about the maximum length (e.g., second information about the maximum number of characters) in the prompt. For example, the generative artificial intelligence may generate and provide result data within the maximum length according to the prompt. For example, if the maximum length is about 100 bytes, the amount of content included in the result data may be limited to within about 100 bytes. According to one embodiment, the processor (120) may obtain result data from the generative artificial intelligence without limiting the amount of content, and may summarize and provide the obtained result data to fit the maximum length. According to one embodiment, if no maximum length exists, the processor (120) may include first information about the object part in the prompt and transmit it to the generative artificial intelligence.

[0199] In operation 509, the processor (120) can transmit the prompt to the generative artificial intelligence (AI) of the on-device and / or server (e.g., the intelligent server (300) of FIG. 3).

[0200] In operation 511, the processor (120) may obtain data based on (or in relation to) a prompt. According to one embodiment, the processor (120) may obtain data (e.g., relevant information or result data or answers) from a generative artificial intelligence based on a prompt.

[0201] In operation 513, the processor (120) can update and display an object portion of the content based on acquired data. According to one embodiment, the processor (120) can update (or replace) and display an object portion selected according to user input in the content displayed on the display with result data (e.g., regenerated information).

[0202] FIG. 6 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.

[0203] FIGS. 7a, FIGS. 7b, FIGS. 7c, and FIGS. 7d ​​are drawings illustrating examples of operations for adjusting content information in an electronic device according to one embodiment of the present disclosure.

[0204] According to one embodiment, FIGS. 6 and FIGS. 7a through 7d may illustrate an example of an operation (or method) in which, in an electronic device (101) according to one embodiment, the content (or information) of a portion corresponding to user input (e.g., touch gesture-based input) within the content of a displayed document is adjusted and provided. For example, FIGS. 6 and FIGS. 7a through 7d may illustrate an example of an operation in which the electronic device (101) regenerates and provides the content (or information) of a portion corresponding to user input (e.g., touch gesture-based input) within the content using artificial intelligence (e.g., generative AI). According to one embodiment, as illustrated in FIGS. 6 and FIGS. 7a through 7d, the operation method performed by the electronic device (101) may include receiving a prompt related to information generation in response to a user's direct input, and based on the prompt, obtaining information (e.g., result data) generated in relation to the prompt from an on-device and / or server and providing (e.g., displaying) it to the user.

[0205] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 6. The flowchart illustrated in FIG. 6 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 601 to 613 may be performed by at least one processor (120) of the electronic device (101).

[0206] According to one embodiment, the operations described in FIGS. 6 and FIGS. 7a to 7d may be performed heuristically in combination with the operations described in FIG. 5, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.

[0207] As illustrated in FIG. 6, the operation method performed by an electronic device (101) according to one embodiment may include: an operation of displaying content (601); an operation of receiving a first input for selecting a part of the content (operation 603); an operation of providing a queue indicating a selection state for the selected part in response to the first input (operation 605); an operation of receiving a second input for adjusting the range of information (or length or amount of information) (e.g., number of characters) (operation 607); an operation of identifying the range of information in response to the second input (operation 609); an operation of obtaining result data corresponding to the content of the selected part and the range of information in response to the third input (operation 611); and an operation of displaying the result data based on the selected part (operation 613).

[0208] Referring to FIGS. 6 and FIGS. 7a through 7d, in operation 601, the processor (120) of the electronic device (101) can display content. According to one embodiment, the processor (120) can execute an application (or document application) (e.g., a web browser, a word application, a PDF application, a note application, a character input application, etc.) based on user input and display a document related to the application on the display. In one embodiment, the document may include documents of various formats (or forms) that are displayed and editable (e.g., a web document, a word document, a PDF document, or a note document, etc.) through the electronic device (101). In one embodiment, the document may include content (e.g., text and / or images). According to one embodiment, the document may be writeable by the user through the keypad (or keyboard) of the electronic device (101), and, depending on the embodiment, may be referred to as including content being written by the user on the display area and / or content being written through the input field.

[0209] In operation 603, the processor (120) may receive a first input for selecting a portion of the content. In one embodiment, the user input including the first input may include a touch gesture input. For example, the first input may include a multi-touch gesture input, such as a pinch input. In one embodiment, the first input may include an input for selecting (or multi-long-touching) a portion of the content (e.g., a portion of the content between the first portion and the second portion) by selecting (or multi-long-touching) a first portion of the content within the document displayed on the display (e.g., a first touch portion) and a second portion different from the first portion (e.g., a second touch portion). In one embodiment, the first input may include an input for selecting a portion of the content (e.g., a portion of the content between the first portion and the second portion) by selecting a first portion of the content within the document and moving (e.g., dragging) to a second portion of the content. For example, as illustrated in FIG. 7a, the user can select a part of the content (700) that needs to be shortened or expanded (e.g., a text part) from the content (700) displayed through the display area (701) of the display (e.g., selected by the user's block settings).

[0210] In operation 605, the processor (120) may provide a cue indicating a selection state for a selected portion in response to a first input. According to one embodiment, the processor (120) may provide a cue based on a defined indicator (710) (or effect object) (e.g., highlighting or block) indicating a selection state for a portion of content selected through the first input in the content (700) in response to a first input.

[0211] For example, as illustrated in FIG. 7a, a portion of content (e.g., selected portion or target portion) selected according to a first input in content (700) (e.g., text) displayed through a display area (701) can be provided to the user in a state where a portion of the content is selected through block setting using a defined indicator (710) (e.g., highlighting or block). For example, a queue indicating the selection state may be a visual object that visually provides a range corresponding to the portion selected according to the user's first input.

[0212] In operation 607, the processor (120) may receive a second input that adjusts the range (or length or amount of information) (e.g., number of characters) of information. In one embodiment, the user input including the second input may include a touch gesture input. For example, the second input may include a touch gesture input that moves the first input. For example, the second input may include a multi-touch gesture input such as a pinch in / out input. For example, the user may perform the second input including a pinch in input if they wish to abbreviate information (or content) of a selected part of the content (700). For example, the user may perform the second input including a pinch out input if they wish to expand information (or content) of a selected part of the content (700).

[0213] According to one embodiment, the processor (120) may set and provide a defined object (e.g., custom information window (720, 730)) (e.g., blur object) (hereinafter referred to as custom information window) in response to a second input, as illustrated in FIGS. 7b and 7c, in a part of the selected content (e.g., a part blocked by an indicator (710)). For example, the processor (120) may provide the user with that it has entered a content creation mode through the custom information window (720, 730) based on the detection of the second input. In one embodiment, the custom information window (720, 730) may correspond to a queue (e.g., an indicator (710) (e.g., see FIG. 7a)) indicating the selection state for the selected portion, and may provide a change in the adjustment portion by applying a blur effect (e.g., setting a dark block) to the indicator (710). In one embodiment, the custom information window (720, 730) may adaptively change (e.g., adjust the range of the queue (or the size of the set block area) (e.g., shrink or expand)) in response to a change (or movement) of the second input (e.g., a change in the adjustment range according to the user's pinch-in / out input). According to one embodiment, as illustrated in FIG. 7b and FIG. 7c, the user may adjust (e.g., expand or shorten) the range (e.g., number of characters) of the information (content) through the second input (e.g., pinch-out input). According to one embodiment, the user may transmit a command to the processor (120) requesting that the range of the information be adjusted and provided through the second input. there is.

[0214] In operation 609, the processor (120) can identify the range of information in response to the second input. According to one embodiment, the processor (120) can identify the range of information set according to the second input. For example, referring to FIG. 7b or FIG. 7c, the processor (120) can calculate the range of information (or amount of information) (e.g., number of characters, image size, number of images, etc.) corresponding to the block portion according to the custom information window (720) or the custom information window (730). According to one embodiment, the content (700) and / or the selected portion of content (or content) may include text, images, and / or videos. According to one embodiment, the processor (120) can determine the type of information (or rewriting style) (e.g., writing style, picture) based on the type of content (e.g., text, images, and / or videos) of the portion of content, along with the range of information.

[0215] According to one embodiment, the range of information may be set differently depending on the type (or attribute) of the part selected in the content (700). According to one embodiment, if the type of the content part included in the selected part (hereinafter referred to as the content part) is text, the range of information may be determined by the number of characters mapped to correspond to the size of the block area (e.g., the range of the custom information window (720, 730)). For example, corresponding to the size of the block area, the number of characters of the text may be determined as approximately 100 characters, approximately 300 characters, or approximately 500 characters, etc. According to one embodiment, if the type of the content part included in the selected part is an image or video, the range of information may be determined by the capacity (or size) and / or the number of images mapped to correspond to the size of the block area. For example, corresponding to the size of the block area, the number of images / videos may be determined as approximately 2, approximately 3, or approximately 5, etc. For example, corresponding to the size of the block area, the size of a single image / video (e.g., aspect ratio) may be determined as approximately 3*3, approximately 5*5, etc. For example, corresponding to the size of the block area, the size of a single image / video (e.g., capacity) may be determined as approximately 50 bytes, approximately 100 bytes, approximately 300 bytes, etc. According to one embodiment, if the type of content part included in the selected portion is text and image (and / or video), the range of information may be determined by the number of characters mapped to correspond to the size of the block area and the size of the image. For example, corresponding to the size of the block area, the number of characters of the text may be determined as approximately 150 characters and the size of the image may be approximately 5*5, approximately 50 bytes, etc. These examples are provided to aid in understanding the present disclosure, and the embodiments of the present disclosure are not limited by such examples.

[0216] According to one embodiment, the scope of information may be information that defines (or limits) the amount (or length, capacity, or size) of data (or content, result data, or answer) to be generated for a selected portion of the content (700), for example. According to one embodiment, the amount of information (e.g., total number of characters and / or total capacity or total number of images / videos) that can be provided (e.g., displayed) by the content (700) may be defined (or set) differently depending on the document (or application).

[0217] In operation 611, the processor (120) may obtain result data corresponding to the content of the selected portion and the range of information in response to the third input. For example, while the user is adjusting the range of information based on the second input, if the user determines that they have reached the desired length (or range), the second input may be released (e.g., touch-up). According to one embodiment, the processor (120) may, in response to the release of a second input (e.g., a third input), generate a prompt including content and a range of information (or amount of information) (e.g., number of characters, image size, number of images, etc.) for the content (e.g., text and / or image) of a selected portion of the content (700) and the size of the block area (e.g., custom information window (720 or 730)) to generate data (e.g., relevant information or result data or answer), and transmit the prompt to a generative artificial intelligence (AI) on-device and / or a server. According to one embodiment, the processor (120) may obtain data (e.g., relevant information or result data or answer) from the generative artificial intelligence based on the prompt.

[0218] In operation 613, the processor (120) may display result data based on the selected portion. According to one embodiment, the processor (120) may update (or replace) the selected portion in the content (700) of the display area (701) according to user input with result data (740) (e.g., regenerated information) and display it, as illustrated in FIG. 7d.

[0219] According to one embodiment, as illustrated in FIGS. 5, 6 and FIGS. 7a through 7d, a situation may be considered in which a user abbreviates or expands information in a designated part of content (e.g., a paper). For example, when viewing content (e.g., a paper), the user may expand the content (or information) to enhance understanding of the designated part. According to one embodiment, the electronic device (101) may update and provide relevant information (e.g., regenerated information) to the user in accordance with a layout directly changed by the user within the content for the style and consistency of the content. The user may continue to view the intentionally abbreviated / expanded information naturally as if it were part of the main body of the content (e.g., a paper).

[0220] FIG. 8 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.

[0221] According to one embodiment, FIG. 8 may illustrate an example of an operation (or method) in which the electronic device (101) according to one embodiment adjusts and provides content (or information) in a portion of the content within a displayed document that corresponds to user input (e.g., touch gesture-based input). For example, FIG. 8 may illustrate an example of an operation in which the electronic device (101) regenerates and provides content (or information) in a portion of the content that corresponds to user input (e.g., touch gesture-based input) using artificial intelligence (e.g., generative AI). According to one embodiment, as illustrated in FIG. 8, the operation method performed by the electronic device (101) may include receiving a prompt related to information generation in response to direct user input, and based on the prompt, obtaining information (e.g., result data) generated in relation to the prompt from an on-device and / or server and providing (e.g., displaying) it to the user.

[0222] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 8. The flowchart illustrated in FIG. 8 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 801 to 823 may be performed by at least one processor (120) of the electronic device (101).

[0223] According to one embodiment, the operations described in FIG. 8 may be performed heuristically in combination with the operations described in FIG. 5 to 7d, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.

[0224] As illustrated in FIG. 8, an operation method performed by an electronic device (101) according to one embodiment comprises: an operation of displaying content (801); an operation of receiving a first input selecting an object portion of the content (operation 803); an operation of providing a queue indicating a selection state for the selected object portion in response to the first input (operation 805); an operation of receiving a second input adjusting the range of information (or length or amount of information) (e.g., number of characters) based on the object portion while providing the queue (operation 807); an operation of providing a custom information window based on the object portion in response to the second input (operation 809); an operation of adjusting the range of the custom information window in response to a change in the second input (operation 811); an operation of detecting the release of the second input (operation 813); an operation of identifying the range of information to be generated based on the custom information window (operation 815); and, for generating data regarding the first information of the object portion, the second information including at least a part of the content, and the third information regarding the range of information, the first information, the second information, It may include an operation to generate a prompt including third information (operation 817), an operation to transmit the prompt to a generative artificial intelligence on the device and / or server (operation 819), an operation to acquire data based on the prompt (operation 821), and an operation to update and display an object part with the acquired data through a custom information window (operation 823).

[0225] Referring to FIG. 8, in operation 801, the processor (120) of the electronic device (101) can display content.

[0226] In operation 803, the processor (120) may receive a first input for selecting an object portion of the content. In one embodiment, the object portion of the content may include, for example, a text portion and / or an image portion contained in the content. In one embodiment, the first input may include various touch gesture inputs that support block setting on an object portion (or area) intended by the user in the content. For example, the first input may include a touch gesture input (e.g., touch and drag input, long press input, etc.) defined to set highlighting (e.g., block) on the object portion.

[0227] In operation 805, the processor (120) may provide a queue indicating a selection state for a selected object part in response to a first input. For example, the processor (120) may provide a queue based on a highlighting indication of an object part corresponding to the first input in the content displayed on the display in response to a first input. For example, a user may perform an input to set a block in an object part, and the processor (120) may provide a queue indicating a block state through the object part in response to the user's input.

[0228] In operation 807, the processor (120) may receive a second input that adjusts the range (or length or amount of information) (e.g., number of characters) of information based on an object portion while providing a queue. According to one embodiment, the processor (120) may receive a second input based on an object portion (e.g., an input that moves the first input (e.g., a pinch in / out touch gesture input)) while providing a queue.

[0229] In operation 809, the processor (120) may provide a custom information window (or information bubble) based on an object portion in response to a second input. For example, the processor (120) may set and provide a custom information window (or information bubble) on a selected object portion in response to a second input.

[0230] In operation 811, the processor (120) can adjust the range of the custom information window in response to a change in the second input. In one embodiment, the second input may include, for example, a touch gesture (e.g., pinch-in touch gesture or pinch-out touch gesture) for specifying the range (or amount of information) (e.g., number of characters) of information in an object part. According to one embodiment, if the second input is a pinch-in touch gesture input, the processor (120) may reduce the range of the custom information window (or information bubble) in response to a change in the pinch-in touch gesture input. According to one embodiment, if the second input is a pinch-out touch gesture input, the processor (120) may expand the range of the custom information window in response to a change in the pinch-out touch gesture input.

[0231] In operation 813, the processor (120) can detect the release of the second input. According to one embodiment, the processor (120) can adjust the range of the custom information window according to the change in the second input and detect the release of the second input.

[0232] In operation 815, the processor (120) can identify the range of information to be generated based on the custom information window. According to one embodiment, the processor (120) can adjust the range of the custom information window according to a change in the second input and identify the number of characters corresponding to the custom information window in response to detecting the release of the second input. For example, when the processor (120) detects the release of the second input, it can identify the amount of information that can be generated based on the custom information window (e.g., number of characters, image size, number of images, etc.). For example, the processor (120) can determine (e.g., calculate) the amount of information that can be generated corresponding to the range of the custom information window. According to one embodiment, the range of information may be information that defines (or limits) the amount (or length, capacity, or size) of data (or content, result data, or answer) to be generated for a selected object part in the content. According to one embodiment, the amount of information that can be provided (e.g., displayed) depending on the document (or application) (e.g., total number of characters and / or total capacity or total number of images / videos) may be defined (or set differently).

[0233] In operation 817, the processor (120) may generate a prompt including the first information, the second information, and the third information to generate data for the first information of the object part, the second information including at least a part of the content (e.g., text before and after the object part, and / or the subject, title, or field of the content, etc.), and the third information regarding the scope of the information.

[0234] In operation 819, the processor (120) can pass a prompt to the generative artificial intelligence on the device and / or server.

[0235] In operation 821, the processor (120) may obtain data based on (or in relation to) a prompt. According to one embodiment, the processor (120) may obtain data (e.g., relevant information or result data or answers) from a generative artificial intelligence based on a prompt.

[0236] In operation 823, the processor (120) can update and display an object part with acquired data through a custom information window. According to one embodiment, the processor (120) can update (or replace) and display an object part selected according to user input in the content displayed on the display with result data (e.g., regenerated information).

[0237] FIGS. 9a, FIGS. 9b, and FIGS. 9c are drawings illustrating examples of operations for adjusting content information in an electronic device according to one embodiment of the present disclosure.

[0238] According to one embodiment, FIGS. 9a, 9, and 9c may illustrate other examples of providing a custom information window (910). In one embodiment, the custom information window (910) may be referred to as an information bubble. In one embodiment, the custom information window (910) may be referred to as an information guide area or an information preview area for guiding information that is created (or updated) in correspondence with a selected object portion in the content.

[0239] Referring to FIG. 9a, FIG. 9a may show a state in which content (900) is displayed through a display area (901) of a display, and an object part (e.g., a text part) that needs to be shortened or expanded in the content (900) is selected (e.g., selected by the user's block settings).

[0240] Referring to FIG. 9b, FIG. 9b may show an example in which a custom information window (910) is provided based on user input.

[0241] According to one embodiment, the electronic device (101) may display a custom information window in a different format depending on the characteristics of the application providing the content. According to one embodiment, the electronic device (101) may provide a custom information window by replacing an object portion, as illustrated above with reference to the reference drawings, depending on a first characteristic of the application providing the content (e.g., a characteristic that allows for adaptive changes to the layout according to user input), and may change the layout in which the content is displayed according to the adjustment of the scope of the custom information window. For example, the electronic device (101) may provide a custom information window by replacing an object portion in the content according to the first characteristic of the application providing the content. For example, the electronic device (101) may change the layout in which the content is displayed according to the adjustment of the scope of the custom information window.

[0242] According to one embodiment, the electronic device (101) may provide a custom information window (910) in the form of a popup window based on an object portion, as illustrated in FIG. 9b, depending on a second characteristic of the application providing the content (e.g., a characteristic in which adaptive changes to the layout are not possible according to user input). According to one embodiment, the electronic device (101) may maintain the layout in which the content is displayed and provide a modified popup window depending on the adjustment of the range of the custom information window (910) according to user input. For example, the electronic device (101) may provide a custom information window (910) as a popup window based on an object portion depending on the second characteristic of the application providing the content. For example, the electronic device (101) may maintain the layout in which the content is displayed and provide a modified popup window depending on the adjustment of the range of the custom information window (910).

[0243] According to one embodiment, the electronic device (101) may set and provide a custom information window (910) in a selected object portion in response to user input. In one embodiment, the custom information window (910) may include a control object (930) related to the control of the custom information window (910). In one embodiment, the control object (930) is exemplified by including a first object (931) and a second object (933), but is not limited thereto. In one embodiment, the first object (931) may include an object having the function of applying or saving data (e.g., result data) that can be generated in relation to the object portion to the content. In one embodiment, the second object (933) may include an object having the function of removing (or turning off) the custom information window (910) and displaying the content of the original text.

[0244] According to one embodiment, the custom information window (910) may provide a preview of information (920) (e.g., result data) that is generated (or updated) in response to a selected object portion in the content. For example, the user may view the temporarily abbreviated or expanded (or enlarged) information (920), minimize (or remove) the custom information window (910) by selecting a second object (933), and view the content of the original text.

[0245] According to one embodiment, a user can adjust the custom information window (910) by making a pinch-in touch gesture input or a pinch-out touch gesture input while touching a first part (A) (e.g., a first touch part) of the custom information window (910) and a second part (B) (e.g., a second touch part) spaced apart from the first part (A). According to one embodiment, the electronic device (101) can adjust (e.g., adjust content) the generated information (910) in response to the adjustment of the custom information window (910). According to one embodiment, the electronic device (101) can reduce the range of the custom information window (910) in response to changes in the pinch-in touch gesture input. According to one embodiment, the electronic device (101) can expand the range of the custom information window (910) in response to changes in the pinch-out touch gesture input.

[0246] According to one embodiment, while the custom information window (910) is displayed, the electronic device (101) may be configured to process a first function and a second function different from the first function, which are defined to operate by the input, in response to user input (e.g., pinch-in / out touch gesture input). In one embodiment, the first function may include a screen zoom function (e.g., screen zooming (e.g., zoom in / out) function) in response to the pinch-in / out touch gesture input. In one embodiment, the second function may include a function to adjust the range (or amount) (e.g., number of characters) of information to be displayed (or provided or updated) based on an object portion of the content in response to the pinch-in / out touch gesture input. In one embodiment, the range of information may be determined, for example, in correspondence with the size of the custom information window (910).

[0247] Referring to FIG. 9c, FIG. 9c may illustrate an example in which information (920) confirmed by a user (or requested to be applied or saved based on the first object (911)) through a custom information window (910) is queued (950) in the original content (900) with a defined effect (e.g., highlighting, underline, or block) in the object part. For example, when an electronic device (101) receives user input through a defined effect part (e.g., object part) in the content (900), it may load and display the relevant information (920) through the custom information window (910), as exemplified in FIG. 9b.

[0248] FIGS. 10a, FIGS. 10b, FIGS. 10c, FIGS. 10d, FIGS. 10e, and FIGS. 10f are drawings illustrating examples of operations for adjusting content information in an electronic device according to one embodiment of the present disclosure.

[0249] According to one embodiment, FIGS. 10a, 10b, 10c, 10d, 10e, and 10f may illustrate an example of generating information by selecting and specifying the type of information (or rewriting style) (e.g., writing style, drawing) to be generated for a selected object part in the content. According to one embodiment, FIGS. 10a through 10f provide an input field (1010) in which a user can input content (1000) in a display area (1001), and a situation may be considered in which the user inputs content (1000) (e.g., a self-introduction) into the input field (1010). According to one embodiment, the input field (1010) may have a set maximum length and may include information (1020) (e.g., about 100 characters) that guides the maximum length.

[0250] Referring to FIG. 10a, an example can be shown in which content (1000) (e.g., text) entered by a user is entered into an input field (1010) provided through a display area (1001) of the display. According to one embodiment, the user can select an object part (1030) that requires information while writing the content (1000). For example, the user can write the content (1000) and select an object part (1030) (e.g., text part) that requires a change in information (e.g., style or writing style) (e.g., writing style) in the content (1000) (e.g., selected by the user's block selection).

[0251] Referring to FIG. 10b, the user can adjust (e.g., expand or contract) the range of information corresponding to the object part (1030) through pinch-in touch gesture input or pinch-out touch gesture input while touching the first part (A) (e.g., first touch part) of the object part (1030) and the second part (B) (e.g., second touch part) spaced apart from the first part (A).

[0252] According to one embodiment, the electronic device (101) may set and provide a custom information window (1040) (e.g., a defined block or highlighting) based on an object part (1030) in response to a multi-touch input (e.g., pinch in / out input) of the first part (A) and the second part (B). As illustrated in FIG. 10c.

[0253] Referring to FIG. 10c, the multi-touch changing input of the first part (A) and the second part (B) may include a multi-touch gesture input (e.g., pinch-in touch gesture input or pinch-out touch gesture input) for specifying the range (or amount of information) (e.g., number of characters) of information corresponding to the object part (1030) of the content (1000).

[0254] According to one embodiment, the electronic device (101) can adjust the range of the custom information window (1040) in response to an input (e.g., pinch in / out input) and determine (e.g., calculate) the range of genable information (e.g., number of characters) corresponding to the custom information window in response to detecting the release of the input. According to one embodiment, as illustrated in FIGS. 10a to 10f, depending on the application, there may be a maximum length (e.g., about 100 characters) that limits the amount of content that can be displayed by the application. For example, the number of characters that can be entered into the input field (1010) may have a set maximum length (e.g., about 100 characters), and information (1020) guiding the maximum length may be provided.

[0255] According to one embodiment, the electronic device (101) can identify the full range (or full length) of the content (1000) and the maximum length (e.g., input limit range) for which the content (1000) can be input. According to one embodiment, the electronic device (101) can determine the maximum supportable range of the custom information window (1040) using the full range and the maximum length. According to one embodiment, the electronic device (101) can limit the range adjustment of the custom information window (1040) for inputs that exceed the maximum supportable range of the custom information window (1040). According to one embodiment, the electronic device (101) may include an action of providing a notification interface to the user in response to the limitation of the range adjustment of the custom information window (1040). According to one embodiment, if the electronic device (101) exceeds the maximum supportable range of the custom information window (1040), it may increase the range of the amount of information that can be generated by adjusting the object size of the information (e.g., result data) or the object size of the content (1000). An embodiment thereof is described with reference to the drawings described below.

[0256] According to one embodiment, the electronic device (101) may provide at least one style indicator (1050) (e.g., bubble object) through a display area (1001) based on multi-touch inputs (e.g., pinch in / out inputs) of a first part (A) and a second part (B). For example, as illustrated in FIG. 10c, the electronic device (101) may provide (e.g., display) the style indicator (1050) by placing it adjacent to a custom information window (1040) (or object part (1030)). In one embodiment, the style indicator (1050) may be a visual object indicating the type of information (or style or rewriting style) to be generated for the object part (1030) selected in the content (1000). For example, the style indicator (1050) may include at least one visual object corresponding to the style of information, the language of information, and / or the format of information (e.g., images and / or videos) corresponding to the selected object portion (1030). In one embodiment, the style indicator (1050) may be provided by floating in a bubble shape corresponding to each size in the display area (1001). In one embodiment, the style indicator (1050) may be referred to as a bubble object. According to one embodiment, for the selected object portion (1030) in the content (1000), the user may specify the type of information (or rewriting style) (e.g., style, picture) to be generated by selecting and specifying at least one of the style indicators (1050).

[0257] In one embodiment, the style indicators (1050) may be placed at random locations within the display area (1001) so as not to overlap each other, based on the number and / or size of the style indicators (1050). In one embodiment, as an example but not limited to, the style indicators (1050) may be provided in the form of a scrollable list placed in an area defined based on the content (1000), for example (e.g., the top area of ​​the display area (1001) or the bottom area of ​​the display area (1001).

[0258] According to one embodiment, as a non-limiting example, the style indicator (1050) may be provided in advance as a preset in response to an input selecting an object part (1030) (e.g., see FIG. 10b). For example, the user may first specify a style (e.g., a style) corresponding to the object part (1030) through the preset before requesting information about the object part (1030) (or adjusting the range of information).

[0259] Referring to FIG. 10d or FIG. 10e, while the user is adjusting the range of information based on the custom information window (1040), if the user determines that they have reached a desired length (or range), the user may release the user's input (e.g., touch-up). According to one embodiment, the electronic device (101) may provide information (1060) generated by adjusting (e.g., content adjustment) in response to the adjustment of the custom information window (1040). According to one embodiment, the electronic device (101) may provide information (1060) corresponding to the object part (1030) by expanding it, as illustrated in FIG. 10d, in response to changes in pinch-out touch gesture input. According to one embodiment, the electronic device (101) may provide information (1060) corresponding to the object part (1030) by reducing it, as illustrated in FIG. 10e, in response to changes in pinch-in touch gesture input. In one embodiment, information (1060) may be provided in correspondence with a type of information selected by the user (e.g., style or rewriting style). For example, information (1060) may be provided updated (or replaced) with a style corresponding to a style indicator (1050) selected by the user, a language corresponding to a selected style indicator (1050), and / or a format corresponding to a style indicator (1050) (e.g., image and / or video).

[0260] Referring to FIG. 10f, the user can view result data (1070). According to one embodiment, the electronic device (101) can update and display an object part (1030) of content (1000) based on the acquired result data (1070). For example, the electronic device (101) can update (or replace) the object part (1030) selected according to user input in the content (1000) displayed on the display with result data (1070) (e.g., regenerated information).

[0261] According to one embodiment, an electronic device (101) may receive a prompt related to information generation in response to a user's direct input, and based on the prompt, obtain information generated in relation to the prompt (e.g., result data) from an on-device and / or server and provide it to the user. According to one embodiment, in response to a user's input, the electronic device (101) may generate a prompt including information about the content, the range (or amount) of information (e.g., number of characters), and the indicator selected in the style indicator (1050) to generate data (e.g., related information or result data or answer) for the content of the object part (1030) selected in the content (1000) and the range (or amount) of information (e.g., number of characters) according to the size of the custom information window (1040), and the indicator (e.g., style, language, and / or format), and transmit it to a generative artificial intelligence.

[0262] According to one embodiment, the result data (1070) may be provided modified to correspond to a quantity (or length, capacity, or size) corresponding to the range (or amount of information) and a format corresponding to one or more indicators selected from the style indicators (1050). According to one embodiment, the result data (1070) may further include a style indicator recommended by a generative artificial intelligence corresponding to the data generated for the object part (1030) (e.g., text data, image data, and / or video data).

[0263] FIG. 11 is a drawing illustrating an example of an operation that supports user input in an electronic device according to one embodiment of the present disclosure.

[0264] Referring to FIG. 11, FIG. 11 may consider a situation where an input field (1110, 1120) for user input (e.g., a character (e.g., text) input field) is small. For example, the input field (1110, 1120) may include a form with a narrow vertical width (e.g., see input field (1110)) and / or a form with a narrow horizontal width (e.g., see input field (1120)). In one embodiment, the input field (1110, 1120) may be an input field of a keypad (or keyboard) or may include an input field that supports user document creation through a display area.

[0265] According to one embodiment, when the input field (1110, 1120) is small, the interaction range (1100) may be extended to a minimum area to enable user input (e.g., a first part (A) (e.g., a first touch part) and a second part (B) spaced apart from the first part (A) (e.g., pinch in / out touch gesture input based on the second touch part). For example, the minimum area may include a predetermined value (e.g., about 3 cm, about 5 cm, etc.) to extend the interaction range (1100) in the short horizontal and / or vertical direction. According to one embodiment, the interaction range (1100) (or minimum area) may be customized by the user, taking into account the user's finger size, etc.

[0266] FIG. 12 is a drawing illustrating an example of an operation that supports the adjustment of content information in an electronic device according to one embodiment of the present disclosure.

[0267] According to one embodiment, FIG. 12 may consider a situation in which an input field (1200) for user input has a limited size and the size is fixed rather than variable. According to one embodiment, the input field (1200) may have a defined maximum length (e.g., a maximum number of characters) that can contain content (1210). For example, the input field (1200) may have a maximum length that limits the amount of displayable content (1210).

[0268] Referring to FIG. 12, the electronic device (101) can determine the total range of content (1210) (e.g., the number of characters of content entered so far) and the maximum length of content (1210) that can be entered (e.g., the input limit range). According to one embodiment, the electronic device (101) can determine the maximum range (or amount of information) (e.g., the number of characters) of information that can be supported for a selected object part (1220) by using the total range and the maximum length.

[0269] According to one embodiment, the electronic device (101) may limit range adjustment based on user input when the maximum supportable range is exceeded. According to one embodiment, the electronic device (101) may provide a notification interface (1230) (e.g., a visual indicator or a visual object or visual information) to the user in response to the limitation of range adjustment. For example, the electronic device (101) may determine that it is difficult to expand information regarding a selected object part (1220) and provide a visual cue to the user through the notification interface (1230) that further expansion is difficult.

[0270] FIG. 13 is a drawing illustrating an example of an operation that supports the adjustment of content information in an electronic device according to one embodiment of the present disclosure.

[0271] According to one embodiment, FIG. 13 may consider a situation in which an input field (1300) for user input has a limited size and the size is fixed rather than variable. According to one embodiment, the input field (1300) may have a defined maximum length (e.g., a maximum number of characters) that can contain content. For example, the input field (1300) may have a maximum length that limits the amount of content that can be displayed.

[0272] Referring to FIG. 13, the electronic device (101) can determine the full range of content and the maximum length of content that can be entered (e.g., input limit range). According to one embodiment, the electronic device (101) can determine the maximum range (or amount of information) (e.g., number of characters) of information (1310) that can be supported for a selected object part by using the full range and the maximum length.

[0273] According to one embodiment, if the maximum supported range is exceeded, the electronic device (101) may provide information (1310) corresponding to the object portion by adjusting it with a predetermined effect. For example, the electronic device (101) may display the information (1310) to fit the maximum length and may display it through the information (1310) by setting a link that allows checking the details (or full text) of the information (1310). For example, the electronic device (101) may replace some of the content of the information (1310) with an ellipsis to fit the maximum length. For example, the electronic device (101) may provide a visual cue to the user through a predetermined effect (e.g., highlighting, underlining) to indicate that there are details linked to the information (1310).

[0274] According to one embodiment, when user input (1330) is received through a defined effect part of the content (e.g., a part of the information (1310) with an underline), the electronic device (101) may provide a custom information window (or information bubble) (1350) (e.g., in the form of a dialog) superimposed on the input field (1300). For example, the electronic device (101) may provide detailed information (or full text) about the information (1310) through the custom information window (1350).

[0275] According to one embodiment, the electronic device (101) may provide a custom information window (1350) in the form of a popup window on the input field (1300) when the layout of the input field (1300) is not variable. According to one embodiment, the electronic device (101) may maintain the layout of the input field (1300) where the content is displayed and provide detailed information about the information (1310) through the custom information window (1350). For example, depending on the characteristics of the input field (1300), the electronic device (101) may provide the custom information window (1350) as a popup window based on the information (1310) portion.

[0276] In one embodiment, the custom information window (1370) may include a control object (1370) related to the control of the custom information window (1370). In one embodiment, the control object (1370) is exemplified by including a first object (1371) and a second object (1373), but is not limited thereto. In one embodiment, the first object (1371) may include an object having the function of regenerating information (e.g., result data), or editing or saving information. In one embodiment, the second object (1373) may include an object having the function of removing (or turning off) the custom information window (1350) and displaying the content of the original text.

[0277] FIG. 14 is a drawing illustrating an example of an operation that supports the adjustment of content information in an electronic device according to one embodiment of the present disclosure.

[0278] According to one embodiment, FIG. 14 may consider a situation in which an input field (1400) for user input has a limited size and the size is fixed rather than variable. According to one embodiment, the input field (1400) may have a defined maximum length (e.g., a maximum number of characters) that can contain content. For example, the input field (1400) may have a maximum length that limits the amount of content that can be displayed.

[0279] Referring to FIG. 14, the electronic device (101) can determine the full range of content and the maximum length of content that can be entered (e.g., input limit range). According to one embodiment, the electronic device (101) can determine the maximum range (or amount of information) (e.g., number of characters) of information (1310) that can be supported for a selected object part by using the full range and the maximum length.

[0280] According to one embodiment, if the electronic device (101) exceeds the maximum supportable range, it can adjust the object size (e.g., font size) of the information (1450) portion of the input field (1400), the content portion excluding the information (1450), and / or the content portion including the information (1450) (e.g., change to a smaller font size) so that the content including the information (1450) can be fully displayed within the input field (1400).

[0281] FIG. 15 is a drawing illustrating an example of an operation that supports user input in an electronic device according to one embodiment of the present disclosure.

[0282] Referring to FIG. 15, examples of supporting user input may be shown when modifying content being created, when changing information (or result data) displayed by updating an object part, or when restoration is required. In one embodiment, the user input may include a multi-touch based left or right swipe interaction. For example, the user input may include a first function (e.g., an undo function) and a second function (e.g., a redo) depending on the direction of the swipe interaction.

[0283] According to one embodiment, a user can perform a first swipe interaction in a first direction (A) (e.g., from right to left) while multi-touching a first part (1510) (e.g., a first touch part) and a second part (1520) (e.g., a second touch part) spaced apart from the first part (1510) on an input field (1500). According to one embodiment, an electronic device (101) can execute a first function (e.g., an undo function) mapped to the first swipe interaction (e.g., "go back") in response to the user's first swipe interaction.

[0284] According to one embodiment, the user can perform a second swipe interaction in a second direction (B) opposite to the first direction (A) (e.g., left to right direction) while multi-touching the first part (1510) and the second part (1520) in the state of the input field (1500). According to one embodiment, the electronic device (101) can execute a second function (e.g., redo function) mapped to the second swipe interaction (e.g., forward) in response to the user's second swipe interaction.

[0285] FIG. 16 is a drawing illustrating an example of an operation that supports user input in an electronic device according to one embodiment of the present disclosure.

[0286] According to one embodiment, FIG. 16 may illustrate an example of an application of pinch-in / out touch gesture input among user inputs. For example, FIG. 16 may illustrate an example of supporting input that selects (or changes) the type of information (e.g., style or rewriting style) by utilizing the direction in which a part moves during pinch-in / out touch gesture input. According to one embodiment, during pinch-in / out touch gesture input, the user can more easily and quickly select the type of information (e.g., style of information, language of information, and / or format of information) that expands or contracts depending on the direction of input.

[0287] Referring to FIG. 16, the user can input a pinch-based touch gesture based on the input field (1600), for example, while multi-touching the first part (1610) and the second part (1620).

[0288] According to one embodiment, when a user inputs a pinch-based touch gesture, for example, the user may input a first touch gesture in which the touch state of the first part (1610) (e.g., right index finger touch) is fixed and the touch of the second part (1620) (e.g., right thumb touch) is moved in a first direction (1630). According to one embodiment, the electronic device (101) may select a first style of writing (e.g., friendly style) mapped to the first touch gesture in response to the first touch gesture. For example, information corresponding to the object part selected in the input field (1600) may be generated and provided in a more friendly style according to the first style of writing based on the first touch gesture input.

[0289] According to one embodiment, when a user inputs a pinch-based touch gesture, for example, the user may input a second touch gesture in which the touch state of the second part (1620) (e.g., right thumb touch) is fixed and the touch of the first part (1610) (e.g., right index finger touch) is moved in a second direction (1640) opposite to the first direction (1630). According to one embodiment, the electronic device (101) may select a second stylistic style (e.g., a polite style) mapped to the second touch gesture in response to the second touch gesture. For example, information corresponding to the object part selected in the input field (1600) may be generated and provided in a more polite style according to the second stylistic style based on the second touch gesture input.

[0290] These examples are provided to aid in understanding the present disclosure, and the embodiments of the present disclosure are not limited by such examples. For example, the type of information (e.g., style of information, language of information, and / or format of information) according to the input direction of a pinch-based touch gesture may be customized in various ways by the user. For example, the input direction of any part of the pinch-based touch gesture may not be limited to the first direction (1630) and the second direction (1640), and the movement direction of any part of the pinch-based touch gesture may be varied, such as the upper-left diagonal, lower-left diagonal, upper-right diagonal, and lower-right diagonal directions. For example, the type of information (e.g., style of information, language of information, and / or format of information) corresponding to each of the various movement directions may be mapped.

[0291] FIG. 17 is a drawing illustrating an example of an operation for adjusting content information in an electronic device according to one embodiment of the present disclosure.

[0292] According to one embodiment, FIG. 17 may illustrate an example of the application of a pinch-in / out touch gesture input during user input. For example, FIG. 17 may illustrate an example of supporting an input that selects (or changes) the type of information (e.g., style or rewriting style) by utilizing the direction in which the pinch-based touch gesture input rotates during a pinch-in / out touch gesture input. According to one embodiment, when a pinch-in / out touch gesture input is performed, the user can more easily and quickly select the type of information (e.g., style of information, language of information, and / or format of information) that expands or contracts depending on the direction of rotation (or angle of rotation) of the input. For example, based on a style indicator provided in the form of a wheel after the pinch, the user can select an indicator to apply to the information by rotating the pinch touch gesture (e.g., wheel rotation motion).

[0293] Referring to FIG. 17, a user may input a pinch-based touch gesture based on an input field (1700), for example, while multi-touching a first part (1710) and a second part (1720). According to one embodiment, an electronic device (101) may provide at least one style indicator (1730, 1740, 1750, etc.) (e.g., a bubble object) through a display area (1701) in response to the input of the user's pinch-based touch gesture. For example, the electronic device (101) may provide (e.g., display) the style indicator (1730, 1740, 1750, etc.) by arranging it in a wheel shape based on the input field (1700). In one embodiment, the style indicator (1730, 1740, 1750, etc.) may be a visual object representing the type of information to be generated for a selected object portion in the content (e.g., style of information, language of information, and / or format of information). For example, the style indicator (1730, 1740, 1750, etc.) may include at least one visual object corresponding to the style of information, language of information, and / or format of information (e.g., image and / or video) corresponding to the selected object portion. In one embodiment, the style indicator (1730, 1740, 1750, etc.) may be provided in the form of a wheel, floating in a bubble shape corresponding to each size in the display area (1701). According to one embodiment, the user can specify the type of information to be generated (e.g., style of information, language of information, and / or format of information) by selecting and specifying at least one of style indicators (1730, 1740, 1750, etc.) for a selected object part in the content.

[0294] According to one embodiment, the user can select and specify a style indicator while rotating in a predetermined direction (e.g., clockwise or counterclockwise) in a state of touch of the first part (1710) (e.g., right index finger touch) and touch of the second part (1720) (e.g., right thumb touch) (hereinafter referred to as the first pinch state).

[0295] For example, as illustrated in FIG. 17, the user may select, for example, a first style indicator (1740) by maintaining a first pinch state for a certain period of time or by making an additional touch in the first pinch state. According to one embodiment, the electronic device (101) may select a first style style (e.g., logical style) corresponding to the style indicator (1740) selected in the first pinch state.

[0296] According to one embodiment, the user may, for example, position the first part (1710) and the second part (1720) at the third part (1715) and the fourth part (1725), respectively, in a first pinch state. For example, the user may rotate the first pinch state to a state of touch of the third part (1715) and touch of the second part (1725) (hereinafter referred to as the second pinch state), such as by rotating a wheel counterclockwise. For example, as illustrated in FIG. 17, the user may maintain the second pinch state for a certain period of time or select, for example, a second style indicator (1750) through an additional touch in the second pinch state. According to one embodiment, the electronic device (101) may select a second stylistic style (e.g., a polite style) corresponding to the style indicator (1750) selected in the second pinch state.

[0297] For example, information corresponding to the object part selected in the input field (1700) can be generated and provided in, for example, a more logical and polite style, according to the first style style mapped to the first style indicator (1740) selected in the first pinch state and the second style style mapped to the second style indicator (1750) selected in the second pinch state.

[0298] In one embodiment, the dashed lines (1760) shown in FIG. 17 and the diagrams (1710, 1715, 1720, 1725) representing each pinch state are for the purpose of facilitating understanding of the explanation and may not be substantially visible.

[0299] FIGS. 18a, FIGS. 18b, and FIGS. 18c are drawings illustrating examples of operations for adjusting content information in an electronic device according to one embodiment of the present disclosure.

[0300] According to one embodiment, FIGS. 18a, 18b, and 18c may illustrate an example of generating information by selecting and specifying the type of information (or rewriting style) (e.g., style of information, language of information, and / or format of information) to be generated for a selected object part in the content. According to one embodiment, FIGS. 18a, 18b, and 18c may illustrate an example of providing an image as information corresponding to a selected object part in the content, and providing the image by selecting and specifying it as the object part to update the corresponding information (e.g., text and / or image).

[0301] Referring to FIG. 18a, FIG. 18a may illustrate an example in which an object part (1810) is selected from content (1800) displayed in a display area (1801), and a style indicator is displayed to select the type of information (or rewriting style) corresponding to the object part (1810). In one embodiment, the style indicator may include at least one visual object corresponding to the style of the information, the language of the information, and / or the format of the information (e.g., image and / or video) corresponding to the selected object part (1810). According to one embodiment, a user may specify the type of information (or rewriting style) to be generated by selecting and specifying at least one of various style indicators for the object part (1810) selected in the content (1800). According to one embodiment, FIG. 18a may consider a situation in which a user selects a picture indicator (1820) among the style indicators to check picture information related to the information corresponding to the object part (1810). According to one embodiment, the electronic device (101) determines a first style (e.g., image) in response to an input selecting a picture indicator (1820), and information corresponding to the selected object part in the content (1800) can be generated and provided in a more friendly style according to the first style style based on the first touch gesture input.

[0302] Referring to FIG. 18b, FIG. 18b may show an example in which an object part (1810) in the content (1800) is updated (or replaced) with an image (1830) in response to user input (e.g., selection of a picture indicator (1820)) based on FIG. 18a.

[0303] According to one embodiment, a user can view result data (e.g., image (1830)). According to one embodiment, an electronic device (101) can display an object portion (1810) of content (1800) by updating it based on the acquired result data (e.g., image (1830)). For example, the electronic device (101) can display an object portion (1810) selected according to user input in content (1800) displayed in a display area (1801) by updating (or replacing) it with result data (e.g., image (1830)) (e.g., regenerated information). According to one embodiment, the result data (e.g., image (1830)) can be displayed together with the remaining portion (1840) of content (1800) that is not designated as an object portion (1810). For example, the object part (1810) in the content (1800) may be updated (or replaced) with the result data (e.g., image (1830)), and the rest of the content (1800) may be retained.

[0304] According to one embodiment, the result data (e.g., image (1830)) may be provided in a format corresponding to one or more selected indicators (e.g., picture indicator (1820)) and an amount (or length or capacity or size) corresponding to the range (or amount of information) of the information.

[0305] According to one embodiment, FIG. 18b illustrates an example in which an object part (1810) is updated and displayed as an image (1830), but such an example is provided to aid in understanding the present disclosure and the embodiments of the present disclosure are not limited by the example. As a non-limiting example, the content or the object part of the content may be updated to a second type of content identical to the first type (e.g., text or image), updated to a third type of content different from the first type (e.g., text -> image update, or image -> text update), or updated to a second type and a third type for the first type (e.g., text -> text and image update, or image -> image and text update).

[0306] According to one embodiment, when the electronic device (101) is updated to a second type identical to a first type (e.g., text or image) of content or an object part of content, it may display the object part by adding and / or replacing the regenerated data (e.g., text or image). According to one embodiment, when the electronic device (101) is updated to a third type different from the first type, it may display the object part by replacing it with the regenerated data (e.g., text or image). According to one embodiment, when the electronic device (101) is updated to a second type and a third type for the first type, it may display the object part by adding and / or replacing it with the regenerated data (e.g., text and image).

[0307] According to one embodiment, in the example of FIG. 18b, when updating an object part (1810) corresponding to a first type to a second type and a third type, the electronic device (101) may display a regenerated image (1830) and regenerated text together for the object part (1810) in the content (1800). According to one embodiment, when the electronic device (101) updates and provides data regenerated for the object part (1810) in the content (1800), it may also provide a designated indicator (e.g., a visual cue, indication, or UI element such as an arrow) for the regenerated data so that the user can easily recognize it.

[0308] According to one embodiment, in the state illustrated in FIG. 18b, a user can select an object part (e.g., result data of FIG. 18b (e.g., image (1830)) (hereinafter referred to as object part (1830)). For example, the user can select an object part (1830) (e.g., image (1830) part) (e.g., selected by the user's block settings). According to one embodiment, the electronic device (101) can set and provide a custom information window (e.g., a defined block or highlighting) based on the object part (1830).

[0309] According to one embodiment, a user can adjust (e.g., expand or contract) the range of information corresponding to the object part (1830) through a pinch-in touch gesture input or a pinch-out touch gesture input while touching the first part (1850) (e.g., first touch part) of the object part (1830) and the second part (1860) (e.g., second touch part) spaced apart from the first part (1850). For example, the user can change the object part (1830) into a more summarized picture or a richer picture through a pinch interaction (e.g., pinch-in touch gesture input or pinch-out touch gesture input). According to one embodiment, the electronic device (101) can provide the object part (1830) expanded into a richer picture in response to a pinch-out touch gesture input. According to one embodiment, the electronic device (101) can provide the object part (1830) contracted into a more summarized picture in response to a pinch-in touch gesture input. For example, as illustrated in FIG. 18c, the object part (1830) can be updated and provided with a richer picture (e.g., image (1870)).

[0310] Referring to FIG. 18c, FIG. 18c may show an example in which an object part (1870) is selected from the content (1800) displayed in the display area (1801), and a style indicator is displayed that allows selecting the type of information (or rewriting style) corresponding to the object part (1870).

[0311] According to one embodiment, information corresponding to the object part (1870) may be provided in correspondence with a type of information selected by the user (e.g., rewriting style). For example, information corresponding to the object part (1870) may be provided by updating (or replacing) with a drawing style (e.g., cartoon style, webtoon, oil painting, 3D, diagram) corresponding to a style indicator (e.g., 1881, 1883, 1885, etc.) selected by the user, and text (e.g., academic text) corresponding to a selected style indicator (e.g., 1881, 1883, 1885, etc.).

[0312] According to one embodiment, the user may specify the type of information to be generated (or rewriting style) by selecting and specifying at least one of various style indicators for the object part (1870). For example, the user may select a cartoon style indicator (1881) among the style indicators to change the information corresponding to the object part (1870) into a cartoon style. For example, the user may select a 3D indicator (1883) among the style indicators to change the information corresponding to the object part (1870) into a three-dimensional style. For example, the user may select an academic indicator (1885) among the style indicators to change the information corresponding to the object part (1870) into academic text.

[0313] According to one embodiment, the electronic device (101) determines the type of information in response to an input selecting an indicator (e.g., 1881, 1883, 1885, etc.), and the information corresponding to the object part (1870) may be generated and provided in a style corresponding to the selected indicator (e.g., cartoon style, 3D, or academic text).

[0314] FIG. 19 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.

[0315] According to one embodiment, FIG. 19 may illustrate an example of an operation (or method) in which the electronic device (101) according to one embodiment adjusts and provides the content (or information) of an object part (e.g., text part and / or image part) corresponding to user input (e.g., touch gesture-based input) in content (e.g., content of a document and / or content entered through an input field). For example, FIG. 19 may illustrate an example of an operation in which the electronic device (101) regenerates and provides the content (or information) of an object part corresponding to user input (e.g., touch gesture-based input) in the content as expanded or reduced data using artificial intelligence (e.g., generative AI).

[0316] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 19. The flowchart illustrated in FIG. 19 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 1901 to 1915 may be performed by at least one processor (120) of the electronic device (101).

[0317] According to one embodiment, the operations described in FIG. 19 may be performed heuristically in combination with the operations described in FIG. 5 to FIG. 18c, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.

[0318] As illustrated in FIG. 19, the operation method performed by an electronic device (101) according to one embodiment may include: an operation of displaying content (1901); an operation of receiving a first input for selecting an object portion of the content (operation 1903); an operation of selecting an object portion of the content in response to the first input (operation 1905); an operation of receiving a second input for changing (or adjusting) information (or amount of information or length) (e.g., number of characters) of the object portion (operation 1907); an operation of setting a range of information corresponding to the object portion in response to the second input (operation 1909); an operation of identifying an amount of information corresponding to the set range of information in response to the release of the second input (operation 1911); an operation of generating data based on the object portion and the amount of information (e.g., number of characters, image size, and / or number of images, etc.) (operation 1913); and an operation of updating and displaying the object portion of the content based on the generated data (operation 1915).

[0319] Referring to FIG. 19, in operation 1901, the processor (120) of the electronic device (101) can display content on a display. In one embodiment, the content may include content included (or provided) in a document of a defined format and / or content included (or being entered) in an input field that supports the input of content (e.g., text and / or images) by a user.

[0320] In operation 1903, the processor (120) may receive a first input selecting an object portion of the content (e.g., at least a portion of the content (e.g., the entire portion of the content or a portion of the content)). In one embodiment, the object portion of the content may include, for example, a text portion and / or an image portion contained in the content. In one embodiment, the first input may include various touch gesture inputs that support block setting on the object portion (or area) intended by the user in the content.

[0321] In one embodiment, the first input may include a multi-touch gesture input, such as a pinch input. In one embodiment, the first input may include an input that selects (or performs a multi-long touch) a first part of the content (e.g., a first touch part) and a second part different from the first part (e.g., a second touch part) to select and specify a part of the content (e.g., a part of the content between the first part and the second part). In one embodiment, the first input may include an input that selects a first part of the content and moves (e.g., drags) to a second part of the content to select and specify a part of the content (e.g., a part of the content between the first part and the second part). For example, the user may select (e.g., block selection) a part of an object (e.g., a text part and / or an image part) that needs to be shortened or expanded in the content displayed on the display.

[0322] In operation 1905, the processor (120) can select an object portion in the content in response to the first input. According to one embodiment, the processor (120) can indicate the selection state of the object portion in response to the first input through a defined indicator (or effect) (e.g., highlighting or blocking) that indicates the selection state for the object portion of the content selected through the first input.

[0323] In operation 1907, the processor (120) may receive a second input that changes (or adjusts) information (or amount or length of information) (e.g., number of characters) of an object part. In one embodiment, the first input and the second input may be consecutive inputs that interact. For example, the first input may include a multi-touch gesture input, and the second input may include a touch gesture input (e.g., pinch-in touch gesture or pinch-out touch gesture) that zooms (e.g., zoom in / out) while maintaining the first input (e.g., multi-touch gesture input). According to one embodiment, the processor (120) may receive a second input (e.g., pinch-in / out touch gesture input) that moves the first input based on the object part while the selection of the object part of the content is active (e.g., a block is set on the object part or a custom information window is displayed).

[0324] According to one embodiment, the processor (120) may be configured to process a second function different from a first function defined by default for a second input (e.g., pinch in / out touch gesture input). In one embodiment, the first function may include a screen zoom function (e.g., screen zooming (e.g., zoom in / out) function) upon a pinch in / out touch gesture input when at least one part of the content (e.g., object part) is not selected (e.g., no block is set on the object part). In one embodiment, the second function may include a function to adjust the range (or amount of) (e.g., number of characters) of information to be displayed (or provided or updated) based on the object part of the content upon a pinch in / out touch gesture input when at least one part of the content (e.g., object part) is selected (e.g., a block is set on the object part).

[0325] In operation 1909, the processor (120) may set a range of information corresponding to an object part in response to a second input. According to one embodiment, if the second input is a pinch-in touch gesture input, the processor (120) may reduce the amount of information (e.g., number of characters, image size, and / or number of images, etc.) related to the object part (e.g., a part blocked in the content) to correspond to a change in the pinch-in touch gesture input. According to one embodiment, if the second input is a pinch-out touch gesture input, the processor (120) may expand the amount of information (e.g., number of characters, image size, and / or number of images, etc.) related to the object part (e.g., a part blocked in the content) to correspond to a change in the pinch-out touch gesture input.

[0326] In operation 1911, the processor (120) can identify an amount of information corresponding to a set range of information in response to the release of the second input. According to one embodiment, the processor (120) can identify a range of information (or amount of information) (e.g., number of characters) corresponding to a range of information (or amount of information) (e.g., number of characters) that has been changed (e.g., expanded or reduced) in relation to the object part in response to detecting the release of the second input (e.g., release of touch or release of pinch touch gesture). For example, when the processor (120) detects the release of the second input, it can identify (e.g., calculate) an amount of information (e.g., number of characters) that can be generated in relation to the range of information changed in relation to the object part. According to one embodiment, the processor (120) can calculate the range (or amount) of information (e.g., number of characters, image size, number of images, etc.) based on the size of a rectangular area (e.g., virtual rectangular area) based on the distance between two touches of a pinch touch gesture and the size of the displayed text (e.g., font size).

[0327] In operation 1913, the processor (120) may generate data based on an object part and an amount of information (e.g., number of characters, image size, and / or number of images). According to one embodiment, while the user is adjusting the range of information based on the second input, if the user determines that they have reached a desired length (or range), the second input may be released (e.g., touch-up). According to one embodiment, in response to the release of the second input (or the third input), the processor (120) may generate data (e.g., related information or result data or answer) based on the content of the object part selected in the content (e.g., text and / or image) and the amount of information (or range of information) (e.g., number of characters, image size, number of images, etc.).

[0328] According to one embodiment, the processor (120) may generate a prompt including the range (or amount of information) of the object part and the amount of information (or information about the object part and the amount of information) to generate data (e.g., related information or result data or answer) for the object part and the amount of information. According to one embodiment, the processor (120) may transmit the prompt to a generative artificial intelligence on an on-device and / or server (e.g., the intelligent server (300) of FIG. 3). According to one embodiment, the processor (120) may obtain data based on (or in relation to) the prompt. According to one embodiment, the processor (120) may obtain data (e.g., related information or result data or answer) from the generative artificial intelligence based on the prompt.

[0329] In operation 1915, the processor (120) can update and display object portions of the content based on generated data. According to one embodiment, the processor (120) can update (or replace) and display object portions selected in the content displayed on the display based on user input with generated data (e.g., result data or regenerated information).

[0330] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may include an operation of displaying content on a display. The method of operation may include an operation of selecting an object portion in response to a first input selecting an object portion of the content. The method of operation may include an operation of setting a range of information of the object portion in response to a second input changing information of the object portion. The method of operation may include an operation of identifying a number of characters corresponding to the set range of information in response to the release of the second input. The method of operation may include an operation of generating data based on the object portion and the number of characters. The method of operation may include an operation of updating and displaying the object portion of the content based on the generated data.

[0331] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may include an operation of displaying content on a display. The method of operation may include an operation of receiving an input selecting an object portion of the content. The method of operation may include an operation of identifying a predetermined number of characters in response to the input. The method of operation may include an operation of generating a prompt including first information and second information to generate data regarding first information regarding the object portion and second information regarding the number of characters. The method of operation may include an operation of transmitting the prompt to a generative artificial intelligence (AI) on a device and / or server. The method of operation may include an operation of acquiring data based on the prompt. The method of operation may include an operation of updating and displaying the object portion of the content based on the acquired data.

[0332] According to one embodiment, the operation method may include an operation of providing a cue indicating a selection state for a selected object part in response to a first input, an operation of receiving a second input that moves the first input based on the object part while providing the cue, and an operation of providing a custom information window based on the object part in response to the second input.

[0333] According to one embodiment, the operation method may include an operation of adjusting the range of the custom information window according to a change in the second input, an operation of detecting the release of the second input, and an operation of identifying the amount of information that can be generated based on the custom information window in response to the release of the second input.

[0334] According to one embodiment, the operation method may include an operation of providing the queue based on a highlighting display of the object portion in response to the first input.

[0335] According to one embodiment, the object portion may include a text portion and / or an image portion of the content.

[0336] According to one embodiment, the first input may include a touch gesture input defined to set the highlighting.

[0337] According to one embodiment, the operation method may include, while the selection of the object part is active, an operation of processing a second function different from a first function that is basically defined to operate by the second input for the second input.

[0338] According to one embodiment, the second input may include a pinch in / out touch gesture input.

[0339] According to one embodiment, the first function may include a screen zoom in / out function based on the pinch in / out touch gesture input.

[0340] According to one embodiment, the second function may include a function to adjust the range of the custom information window based on the pinch in / out touch gesture input.

[0341] According to one embodiment, the custom information window may include an information preview area for previewing information to be generated.

[0342] According to one embodiment, the operation method may include, when the second input is a pinch-in touch gesture input, reducing the range of the custom information window to correspond to the pinch-in touch gesture input, and when the second input is a pinch-out touch gesture input, expanding the range of the custom information window to correspond to the pinch-out touch gesture input.

[0343] According to one embodiment, the operation method may include an operation of identifying an amount of information that can be generated corresponding to the range of the custom information window.

[0344] According to one embodiment, the operation method may include an operation of identifying the entire range of the content and an input limit range in which the content can be entered to the maximum extent, and an operation of identifying the maximum range that can be supported by the custom information window using the entire range and the input limit range.

[0345] According to one embodiment, the operation method may include an operation to limit the range adjustment of the custom information window for the second input that exceeds the maximum supportable range of the custom information window.

[0346] According to one embodiment, the operation method may include an operation of providing a notification interface in response to a limitation on the range adjustment of the custom information window.

[0347] According to one embodiment, the operation method may include adjusting the object size of the information to increase the range of the amount of information that can be generated when the maximum supportable range of the custom information window is exceeded.

[0348] According to one embodiment, the operation method may include providing the custom information window in a different format depending on the characteristics of the application providing the content.

[0349] According to one embodiment, the operation method may include, depending on a first characteristic of an application providing the content, an operation of providing the custom information window by replacing the object part, and an operation of changing the layout in which the content is displayed depending on the adjustment of the range of the custom information window.

[0350] According to one embodiment, the operation method may include, depending on a second characteristic of the application providing the content, providing the custom information window as a popup window based on the object portion, and, depending on the adjustment of the range of the custom information window, maintaining the layout in which the content is displayed and changing the popup window.

[0351] According to one embodiment, the acquired data may include text data and a style indicator.

[0352] According to one embodiment, the operation method may include the operation of placing and displaying the style indicator adjacent to the custom information window.

[0353] According to one embodiment, the operation method may include an operation of changing and providing the type of data to correspond to the format of the selected one or more indicators in response to an input selecting one or more indicators of the style indicator.

[0354] In a non-transitory computer-readable recording medium that stores instructions for causing the processor (120, 230, 410) to perform operations when executed by the processor (120, 230, 410) of an electronic device (101, 200, 400) according to one embodiment of the present disclosure, the operations may include: an operation of displaying content on a display; an operation of selecting an object portion in response to a first input selecting an object portion of the content; an operation of setting a range of information of the object portion in response to a second input changing information of the object portion; an operation of identifying a number of characters corresponding to the set range of information in response to the release of the second input; an operation of generating data based on the object portion and the number of characters; and an operation of updating and displaying the object portion of the content based on the generated data.

[0355] When the above operations are executed by the processor (120, 230, 410), the electronic device (101, 200, 400) may include the operation of displaying content on a display, the operation of receiving an input selecting an object part of the content, the operation of identifying a predetermined number of characters in response to the input, the operation of generating a prompt including the first information and the second information to generate data regarding the first information regarding the object part and the second information regarding the number of characters, the operation of transmitting the prompt to a generative artificial intelligence (AI) on-device and / or server, the operation of acquiring data based on the prompt, and the operation of updating and displaying the object part of the content based on the acquired data.

[0356] It will be understood that the foregoing embodiments and their technical features may be combined with one another in any combination, provided there is no conflict between the two embodiments or features. For example, any combination of two or more of the foregoing embodiments may be conceived and included within the present disclosure. One or more features from any embodiment may be incorporated into any other embodiment and may provide corresponding advantages or benefits.

[0357] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0358] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0359] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0360] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (or recording medium) (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-transient' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0361] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium (or recording medium), such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0362] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0363] The various embodiments of the present disclosure disclosed in this specification and drawings are provided as specific examples to facilitate the explanation of the technical content of the present disclosure and to aid in understanding the present disclosure, and are not intended to limit the scope of the present disclosure. Accordingly, the scope of the present disclosure should be interpreted to include all modifications or variations derived based on the technical concept of the present disclosure, in addition to the embodiments disclosed herein.

Claims

1. In an electronic device, display; At least one processor including processing circuitry; and It includes memory for storing instructions, When the above instructions are executed individually and / or collectively by the at least one processor, the electronic device, Display content on the display, In response to a first input selecting an object part of the above content, the object part is selected, and In response to a second input that changes the information of the object part, the range of the information of the object part is set, and In response to the release of the second input above, the number of characters corresponding to the range of the set information is identified, and Generate data based on the above object part and the above number of characters, and An electronic device that updates and displays the object portion of the above content based on the generated data.

2. In paragraph 1, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, In response to the first input above, a cue is provided that indicates the selection state for the selected object part, and While providing the above queue, receiving the second input that moves the first input based on the object portion, and An electronic device that provides a custom information window based on the object portion in response to the second input above.

3. In paragraph 2, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, Adjust the range of the custom information window according to the change in the second input above, and Detecting the release of the above second input, An electronic device that identifies the amount of information that can be generated based on the custom information window in response to the release of the second input.

4. In paragraph 2, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, In response to the first input above, the queue is provided based on a highlighting display of the object portion, and The above object portion includes a text portion and / or an image portion of the above content, and The above first input is an electronic device comprising a touch gesture input defined to set the highlighting.

5. In paragraph 2, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, While the selection of the above object part is active, for the above second input, the first function defined by default to operate by the second input and the second function different from the first function are processed, and The second input above includes a pinch in / out touch gesture input, and The first function above includes a screen zoom in / out function according to the pinch in / out touch gesture input, and The above second function is an electronic device that includes a function to adjust the range of the custom information window according to the pinch in / out touch gesture input.

6. In Paragraph 2, The above custom information window is an electronic device comprising an information preview area for previewing information being generated.

7. In paragraph 2, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, If the second input is a pinch-in-touch gesture input, the range of the custom information window is reduced to correspond to the pinch-in-touch gesture input and provided. An electronic device that, when the second input is a pinch-out touch gesture input, expands the range of the custom information window to correspond to the pinch-out touch gesture input.

8. In paragraph 2, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, An electronic device that identifies the amount of information that can be generated in correspondence with the range of the custom information window above.

9. In paragraph 2, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, Identify the entire range of the above content and the maximum input limit range for which content can be entered, and An electronic device that identifies the maximum supportable range of the custom information window using the above-mentioned total range and the above-mentioned input limit range.

10. In paragraph 9, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, For the second input that exceeds the maximum supportable range of the custom information window, the range adjustment of the custom information window is restricted, and An electronic device that provides a notification interface in response to the limitation of the range adjustment of the custom information window above.

11. In paragraph 10, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, An electronic device that, when the maximum supportable range of the custom information window is exceeded, adjusts the object size of the information to increase the range of the amount of information that can be generated.

12. In paragraph 2, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, According to the first characteristic of the application providing the above content, the custom information window is provided by replacing the object part, and the layout in which the content is displayed is changed according to the adjustment of the range of the custom information window. An electronic device that, according to a second characteristic of an application providing the above content, provides the custom information window as a popup window based on the object portion, and, according to the adjustment of the range of the custom information window, maintains the layout in which the content is displayed and changes the popup window.

13. In paragraph 1, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, For the first information regarding the object part and the second information regarding the number of characters, a prompt including the first information and the second information is generated to generate data, and The above prompt is transmitted to generative artificial intelligence (AI) on-device and / or server, and Acquire the above data based on the above prompt, and The above-mentioned acquired data is an electronic device comprising text data and a style indicator.

14. In paragraph 13, when the instructions are executed individually and / or collectively by the at least one processor, the electronic device, The style indicator is placed and displayed adjacent to the object part, and An electronic device that, in response to an input selecting one or more indicators of the style indicators, changes the type of data to correspond to the format of the selected one or more indicators and provides it.

15. In a method of operating an electronic device, The action of displaying content on a display; An operation of selecting an object portion in response to a first input selecting an object portion of the above content; An operation to set the range of information of the object part in response to a second input that changes the information of the object part; An operation to identify the number of characters corresponding to the range of the set information in response to the release of the second input above; An operation to generate data based on the above object part and the above number of characters; and A method comprising the operation of updating and displaying the object portion of the above content based on the generated data.

Images