Electronic device for applying function to image, operation method thereof, and recording medium

Abstract

According to an embodiment, an electronic device may comprise a display, at least one processor, and a memory for storing instructions, wherein the instructions, when executed individually or collectively by the at least one processor, cause the electronic device to: on the basis of identifying a first input for a first image displayed through the display, identify a function corresponding to the first input through a software platform of the electronic device for executing at least one function related to an image; execute the first function through the software platform to identify at least one area of the first image related to the function; display, through the display, a visual object provided by the function on the at least one area of the first image; and on the basis of identifying a second input for selecting a specific area from among the at least one area on which the visual object is displayed, obtain, through the software platform, a second image obtained by applying the first function to the specific area of the first image.

Description

Electronic device for applying a function to an image, method of operating the same, and recording medium

[0001] Various embodiments relate to an electronic device for applying a function to an image, a method of operating the same, and a recording medium.

[0002] Thanks to remarkable advancements in information and communication technology and semiconductor technology, the proliferation and use of various electronic devices is rapidly increasing. Electronic devices are being developed to enable users to carry and communicate with one another. An electronic device can refer to any device that performs a specific function based on its embedded software, such as a mobile communication terminal, tablet PC, audio / video device, desktop / laptop computer, or in-car navigation system.

[0003] Recently, with the rapid increase in demand for electronic devices, research on user interface methods related to displays included in electronic devices is being actively conducted.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0005] According to one embodiment, an electronic device may include a display, at least one processor, and a memory storing instructions.

[0006] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, based on identifying a first input for a first image displayed through the display, identify a function corresponding to the first input through a software platform of the electronic device for executing at least one function related to the image.

[0007] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to execute the function through the software platform to identify at least one area of ​​the first image associated with the function.

[0008] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display, through the display, a visual object provided by the function over the at least one area of ​​the first image.

[0009] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain, through the software platform, a second image having the function applied to the first area of ​​the first image based on identifying a second input selecting a specific area of ​​the at least one area in which the visual object is displayed.

[0010] According to one embodiment, a method of operating an electronic device may include an operation of confirming a first input for a first image displayed through a display of the electronic device, and confirming a function corresponding to the first input through a software platform of the electronic device for executing at least one function related to the image.

[0011] According to one embodiment, a method of operating an electronic device may include an operation of executing the first function through the software platform to identify at least one area of ​​the first image related to the function.

[0012] According to one embodiment, a method of operating an electronic device may include an operation of displaying a visual object provided by the function over at least one area of ​​the first image through the display.

[0013] According to one embodiment, a method of operating an electronic device may include an operation of obtaining a second image to which the function is applied for the specific area of ​​the first image through the software platform based on confirming a second input selecting a specific area among the at least one area on which the visual object is displayed.

[0014] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor of an electronic device, cause the electronic device to perform at least one operation, wherein the at least one operation may include: identifying a function corresponding to the first input through a software platform of the electronic device for executing at least one function related to the image based on identifying a first input for a first image displayed through a display of the electronic device.

[0015] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor of an electronic device, cause the electronic device to perform at least one operation, wherein the at least one operation may include an operation of executing the function through the software platform to identify at least one area of ​​the first image related to the function.

[0016] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor of an electronic device, cause the electronic device to perform at least one operation, wherein the at least one operation may include displaying a visual object provided by the function over the at least one area of ​​the first image through the display.

[0017] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor of an electronic device, cause the electronic device to perform at least one operation, wherein the at least one operation may include obtaining a second image to which the function is applied for the specific area of ​​the first image through the software platform based on identifying a second input selecting a specific area among the at least one area on which the visual object is displayed.

[0018] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0019] FIG. 2 is a drawing for explaining an operation of an electronic device executing a function of scanning a document image included in an image according to a comparative example.

[0020] FIG. 3 is a schematic block diagram illustrating an electronic device according to one embodiment.

[0021] FIG. 4 is a diagram illustrating a layer related to an application program of an electronic device, a layer related to a framework, and a hardware abstraction layer according to one embodiment.

[0022] FIG. 5 is a flowchart illustrating an operation of an electronic device to obtain a second image to which a first function is applied to a first image through a software platform according to one embodiment.

[0023] FIG. 6 is a flowchart illustrating an operation of an electronic device to obtain a second image to which a first function is applied to a first image through a framework according to one embodiment.

[0024] FIG. 7 is a flowchart illustrating an operation of an electronic device to confirm a first function based on confirming an input for an indicator displayed on a display, according to one embodiment.

[0025] FIG. 8A is a flowchart illustrating an operation of deleting an object included in a first image based on an electronic device identifying a first function, according to one embodiment.

[0026] FIG. 8B is a flowchart illustrating an operation of scanning a document image included in a first image based on an electronic device identifying a first function, according to one embodiment.

[0027] FIG. 9 is a diagram illustrating an operation of an electronic device executing a function of deleting an object included in an image according to one embodiment.

[0028] FIG. 10 is a diagram illustrating an operation of an electronic device executing a function of scanning a document image included in an image, according to one embodiment.

[0029] FIG. 11 is a diagram illustrating an operation of an electronic device displaying a visual object over an area of ​​an image based on a user input selecting an indicator indicating a function of deleting an object included in the image, according to one embodiment.

[0030] FIG. 12 is a diagram illustrating an operation of displaying a visual object over an area of ​​a document image based on a user input selecting an indicator indicating a function of an electronic device to scan a document image, according to one embodiment.

[0031] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0032] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0033] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0034] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0035] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0036] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0037] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0038] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0039] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0040] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0041] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0042] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0043] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0044] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0045] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0046] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0047] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0048] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0049] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0050] In one embodiment, the antenna module (197) may generate a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0051] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0052] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0053] FIG. 2 is a drawing for explaining an operation of an electronic device executing a function of scanning a document image included in an image according to a comparative example.

[0054] Each of the application programs of the electronic device (201) according to the comparative embodiment can execute a function for an image through an application programming interface (API) included in each of the application programs. Alternatively, each of the application programs according to the comparative embodiment can execute a function for an image through a software development kit (SDK) including an application programming interface (API). Each of the application programs according to the comparative embodiment can obtain the result of executing the function for an image from the software development kit (SDK).

[0055] According to the comparative example, each application program directly implements a user interface based on the results of executing a function on an image, thereby providing different user interfaces. Therefore, the electronic device (201) according to the comparative example cannot provide a unified user interface to the user because the user interface provided by each running application program differs even when the functions applied to the image are identical.

[0056] Referring to (a) of FIG. 2, an electronic device (201) according to a comparative embodiment can execute an application program related to a camera. Based on executing the application program related to the camera, the electronic device (201) according to the comparative embodiment can display a user interface (202, 203) provided by the application program related to the camera. Based on confirming a user input for executing a scan function for a document image (211) displayed through a display, the electronic device (201) according to the comparative embodiment can further display a visual object (220) (user interface) for setting an area to which a scan function is to be applied among the document image (211).

[0057] Referring to (b) of FIG. 2, the electronic device (201) according to the comparative embodiment can execute an application program related to a memo. Based on executing the application program related to the memo, the electronic device (201) according to the comparative embodiment can display a user interface (204) provided by the application program related to the memo. Based on confirming a user input for executing a scan function for a document image (211) displayed through the display, the electronic device (201) according to the comparative embodiment can further display a visual object (230) (user interface) for setting an area to which a scan function is to be applied among the document image (211).

[0058] According to a comparative example, when executing the same function (e.g., scanning function for a document image) through each of a camera-related application program and a memo-related application program, the user interfaces (202, 203, 220) provided by the camera-related application program and the user interfaces (230, 204) provided by the memo-related application program may be different from each other. According to a comparative example, since the electronic device (201) according to the comparative example executes a function for an image (e.g., image processing solution, visual solution) through an API (application programming interface) included in each of the application programs of the electronic device (201) according to the comparative example or a software development kit (SDK) including an API (application programming interface), the user interfaces provided by each of the application programs may be different from each other.

[0059] FIG. 3 is a schematic block diagram illustrating an electronic device according to one embodiment.

[0060] Referring to FIG. 3, an electronic device (301) according to one embodiment can apply a function to an image displayed through a display (360) through a vision software platform (460) (e.g., the vision software platform (460) of FIG. 4). For example, the function may include a function of deleting at least one object (e.g., a person, an object, an animal, a plant) included in an image or a function of scanning a document image included in an image. According to one embodiment, the vision software platform (460) may include a platform that provides a vision overlay program (or, application program) (430) (e.g., the vision overlay program (430) of FIG. 4) capable of executing a function applicable to an image and a vision framework (450) (e.g., the framework (450) of FIG. 4) for the vision overlay program (430).

[0061] According to one embodiment, when an input for applying a function to an image is confirmed while the electronic device (301) is executing a specific application program (e.g., a native application program (410) (e.g., the native application program (410) of FIG. 4) or a third-party application program (420) (e.g., a third-party application program (420) of FIG. 4), the electronic device (301) may execute a vision overlay program (430) included in the vision software platform (460). According to one embodiment, the vision overlay program (430) may directly implement a user interface related to a function that may be applied to an image. According to one embodiment, the electronic device (301) may apply a function to an image through the vision framework (450) and display a user interface. Through this, the electronic device (301) according to one embodiment may provide a unified user interface to a user through the vision software platform (460). According to one embodiment, the vision overlay program (430) may include a first component (431) and a second component (432). A component (432) may be included. For example, the first component (431) may provide a visual object that sets an area to which a scan function is applied among document images included in the image. For example, the second component (432) may provide a visual object that sets an area to which a function for deleting at least one object (e.g., a person, an object, an animal, a plant) included in the image is applied.

[0062] According to one embodiment, the electronic device (301) (e.g., the electronic device (101) of FIG. 1) may include a processor (320) (e.g., the processor (120) of FIG. 1), a memory (330) (e.g., the memory (130) of FIG. 1), and a display (360) (e.g., the display module (160) of FIG. 1). According to one embodiment, the electronic device (301) may be implemented in the same or similar manner as the electronic device (101) of FIG. 1. According to one embodiment, the processor (320) may control the overall operation of the electronic device (301).

[0063] According to one embodiment, the processor (320) may display a first image through the display (360) while executing a first application program. For example, the first application program may include a native application program (410) (e.g., the native application program (410) of FIG. 4) or a third-party application program (420) (e.g., the third-party application program (420) of FIG. 4). For example, the native application program (410) may include an application program pre-installed in the electronic device (301) during the development phase of the electronic device (301). For example, the third-party application program (420) may include an application program installed through a separate server.

[0064] According to one embodiment, the processor (320) may, based on identifying a first input for the first image, identify a function corresponding to the first input through the vision software platform (460). For example, the first input may include a long press input or a touch input. For example, the first input may include an input for drawing a specific shape (e.g., an X, a square). For example, the function may include a function for deleting at least one object (e.g., a person, an object, an animal, a plant) included in the image or a function for scanning a document image included in the image. However, this is an example, and various functions may be further included.

[0065] Alternatively, according to one embodiment, the processor (320) may display at least one indicator (object) representing at least one function related to the first image through the vision software platform (460) based on identifying an input (e.g., a touch input, a long press input) to the first image. According to one embodiment, the processor (320) may identify a function represented by the first indicator through the vision software platform (460) based on identifying a user input (e.g., a touch input, a long press input) to a first indicator among the at least one indicator. For example, the vision software platform (460) may be utilized in a native application program (410) and / or a third-party application program (420).

[0066] According to one embodiment, the processor (320) can identify at least one area of ​​the first image to which a function can be applied via the vision software platform (460).

[0067] According to one embodiment, the processor (320) can display a visual object provided by the function over at least one area of ​​the first image.

[0068] According to one embodiment, the processor (320) may display a visual object overlaid on at least one area. For example, the size of the visual object may be the same as the size of the at least one area. According to one embodiment, the processor (320) may also display a visual object representing the outline of at least one area.

[0069] In one embodiment, the processor (320) may apply a function to a specific region via the vision software platform (460) based on identifying a second input that selects a specific region from among at least one region in which a visual object is displayed. For example, the second input may include a touch input or a long press input.

[0070] In one embodiment, the processor (320) may acquire a second image in which a function is applied to a specific area of ​​the first image through the vision software platform (460). In one embodiment, the processor (320) may display the second image through the display (360).

[0071] For example, the function may represent a function of deleting at least one object (e.g., a person, an object, an animal, a plant) included in an image. According to one embodiment, the processor (320) may identify at least one object (e.g., a person, an object, an animal, a plant) included in the first image that can be separated from the first image through the vision software platform (460). The processor (320) may display a visual object by overlaying it on at least one area corresponding to the at least one object through the vision software platform (460). The processor (320) may identify a second input that selects a specific area among at least one area where a visual object is displayed. Based on identifying the second input, the processor (320) may execute a function of deleting the first object corresponding to the specific area from the first image through the vision software platform (460). Based on executing the function through the vision software platform (460), the processor (320) may acquire a second image in which the first object corresponding to the specific area from the first image has been deleted. For example, the processor (320) may use an artificial intelligence (AI) model to delete an object corresponding to a specific area of ​​the first image. For example, the artificial intelligence (AI) model may be implemented as a generative artificial intelligence model. For example, the processor (320) may obtain a second image in which a first object corresponding to the first area has been deleted based on providing information about the first image and the first area to the artificial intelligence model through the vision software platform (460).

[0072] For example, the first function may represent a function of scanning a document image included in an image. According to one embodiment, the processor (320) may confirm the document image included in the first image through the vision software platform (460). According to one embodiment, the processor (320) may display a visual object on at least one area corresponding to the document image. According to one embodiment, the processor (320) may display a visual object representing the outline of at least one area. According to one embodiment, the processor (320) may confirm a second input of selecting a specific area among at least one area on which a visual object is displayed. According to one embodiment, the processor (320) may execute a function of scanning the document image corresponding to the first area according to a specified document scanning method through the vision software platform (460) based on confirming the second input. According to one embodiment, the processor (320) may acquire a second image in which a document image corresponding to a specific area in the first image is scanned based on executing a function through the vision software platform (460). According to one embodiment, the first image may represent a still image, a moving image, or a frame included in a moving image acquired through a camera (e.g., the camera module (180) of FIG. 1). According to one embodiment, the first image may represent an image acquired from an external electronic device through a communication module (e.g., the communication module (190) of FIG. 1). According to one embodiment, the first image may represent an image acquired based on capturing (screen shot) an image displayed through the display (360) while executing at least one application program (e.g., a web browser application program, a content playback program, etc.) of the electronic device (301).

[0073] According to one embodiment, the electronic device (301) may be implemented as a wearable electronic device that provides augmented reality images. For example, the electronic device (301) may be implemented as an augmented reality glass (AR glass), a video see-through (VST) device, or a head-mounted display (HMD) device. Embodiments of the present disclosure may be equally applied to the electronic device (301) implemented as a wearable electronic device that provides augmented reality images. For example, the electronic device (301) may delete and display at least one object selected by the user among objects (e.g., a person, an object, etc.) included in an image displayed through the display (360).

[0074] According to one embodiment, the external electronic device may display the first image. According to one embodiment, the external electronic device may provide a command requesting the electronic device to delete at least one object included in the first image or a command requesting the electronic device to scan a document image included in the first image. According to one embodiment, the electronic device (301) may provide information about the vision software platform (460) to the external electronic device. Alternatively, according to one embodiment, the electronic device (301) may provide an image to which a requested function has been applied (e.g., an image to which a function for deleting an object has been applied, an image to which a function for scanning a document image has been applied) to the external electronic device based on the command through the communication module (190).

[0075] FIG. 4 is a diagram illustrating a layer related to an application program of an electronic device, a layer related to a framework, and a hardware abstraction layer according to one embodiment.

[0076] Referring to FIG. 4, according to one embodiment, a layer (e.g., applications (apps)) related to an application program of an electronic device (301) (e.g., the electronic device (301) of FIG. 3) may represent a layer (area) that can provide a function by executing a native application program (410), a third-party application program (420), and a vision overlay program (430). According to one embodiment, the native application program (410) may include an application program that is pre-installed in the electronic device (301) during the development phase of the electronic device (301). For example, the native application program (410) may include an application program related to a camera and an application program related to a gallery (photo). According to one embodiment, the third-party application program (420) may include an application program installed through a separate server.

[0077] According to one embodiment, a layer related to the framework of the electronic device (301) may represent a layer (area) including a first framework (440) of an operating system of the electronic device (301) and a vision framework (450) for a vision overlay program (430). According to one embodiment, the first framework (440) of the operating system of the electronic device (301) and the vision framework (450) for the vision overlay program (430) may be different from each other. Depending on the implementation, the vision framework (450) for the vision overlay program (430) may be included in the first framework (440) of the operating system. Depending on the implementation, the vision framework (450) for the vision overlay program (430) may be an extension (e.g., an extension) of the first framework (440) of the operating system.

[0078] According to one embodiment, the hardware abstraction layer (HAL) of the electronic device (301) may represent a layer (area) that can provide functions of a hardware component (e.g., a camera (470)) included in the electronic device (301). According to one embodiment, the vision framework (450) may execute functions related to the hardware components through the hardware abstraction layer (HAL) of the electronic device (301). For example, the vision framework (450) may execute functions related to the camera (470) through the hardware abstraction layer (HAL).

[0079] According to one embodiment, the vision software platform (460) of the electronic device (301) for applying a function to an image may include a vision overlay program (430) and a vision framework (450) for the vision overlay program (430). According to one embodiment, the vision overlay program (430) may include a component that provides a function for deleting at least one object included in an image or a component that provides a function for scanning a document image included in the image. According to one embodiment, the vision overlay program (430) may provide a designated user interface for applying a function related to an image. For example, the application program (430) may provide a visual object displayed on an area to which a function can be applied among a plurality of areas included in the image. For example, the vision overlay program (430) may provide a visual object (indicator) indicating a function that can be applied to the image. According to one embodiment, the vision framework (450) may be different from the first framework (440). According to one embodiment, the vision framework (450) may be implemented as an extension of the first framework (440).

[0080] According to one embodiment, the vision framework (450) for the vision overlay program (430) can be provided with an image to which a function is to be applied. The vision framework (450) for the vision overlay program (430) can verify an input for the image and execute the vision overlay program (430). The vision framework (450) for the vision overlay program (430) can verify a function corresponding to the input. According to one embodiment, the vision framework (450) for the vision overlay program (430) can apply a function to an image using components included in the vision overlay program (430) (e.g., the first component (431), the second component (432)). For example, the vision framework (450) can apply (process) a function corresponding to a component to an image on a component basis (or a pipeline basis). The vision framework (450) for the vision overlay program (430) can verify at least one area to which a function can be applied among a plurality of areas included in the image. The vision framework (450) for the vision overlay program (430) can display a visual object on an area to which a function can be applied among multiple areas included in an image. For example, the first component (431) can provide a visual object that sets an area to which a scan function can be applied among document images included in the image. For example, the second component (432) can provide a visual object that sets an area to which a function to delete at least one object (e.g., a person, an object, an animal, a plant) included in the image can be applied.

[0081] The operations of the electronic device (301) described in the drawings below may be performed by the processor (320). However, for convenience of explanation, the operations performed by the processor (320) will be described as being performed by the electronic device (301).

[0082] FIG. 5 is a flowchart illustrating an operation of an electronic device to obtain a second image to which a first function is applied to a first image through a software platform according to one embodiment.

[0083] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0084] Referring to FIG. 5, according to one embodiment, in operation 511, an electronic device (301) (e.g., the electronic device (301) of FIG. 3) may confirm a first input for a first image displayed through a display (360) (e.g., the display (360) of FIG. 3). For example, the first input may include a long press input or a touch input. For example, the first input may include an input for drawing a specific shape. For example, the first image may be an image acquired through a camera (e.g., the camera module (180) of FIG. 1) or may include an image acquired from an external device.

[0085] According to one embodiment, in operation 513, the electronic device (301) may determine whether the function corresponding to the first input is a function related to the vision software platform (460) (e.g., the vision software platform (460) of FIG. 4 ). For example, the function may include a function for deleting at least one object (e.g., a person, an object, an animal, a plant) included in an image or a function for scanning a document image included in an image. However, this is merely an example, and various other functions may be included.

[0086] For example, a function related to the vision software platform (460) may include a function related to a first component (431) (e.g., the first component (431) of FIG. 4) or a second component (432) (e.g., the second component (432) of FIG. 4).

[0087] For example, if the electronic device (301) determines that the first input represents an input for drawing a specific shape (e.g., an X shape), the electronic device (301) can determine that the function corresponding to the first input is a function related to the second component (432) included in the vision software platform (460). For example, if the electronic device (301) determines through the vision framework (450) that the first input represents an input for drawing a specific shape (e.g., a square shape), the electronic device (301) can determine that the function corresponding to the first input is a function related to the first component (431) included in the vision software platform (460). For example, the first component (431) can provide a visual object that sets an area to which a scan function is to be applied among document images included in the image. For example, the second component (432) can provide a visual object that sets an area to which a function for deleting at least one object (e.g., a person, an object, an animal, a plant) included in the image is to be applied. For example, a component related to a function corresponding to an input may be pre-specified. According to one embodiment, if the electronic device (301) determines that the function corresponding to the first input is a function related to the vision software platform (460) (operation 513 - Yes), in operation 515, the electronic device (301) may provide a first image to the vision software platform (460).

[0088] According to one embodiment, in operation 517, the electronic device (301) can identify at least one area of ​​the first image related to the function through the vision software platform (460). According to one embodiment, the electronic device (301) can analyze the first image through the vision software platform (460). The operation of analyzing the first image may include an operation of identifying at least one object included in the first image. For example, the at least one area may include at least one area corresponding to at least one object (e.g., a person, an object, an animal, a plant) included in the first image to which the function can be applied. For example, the at least one area may include at least one area corresponding to a document image included in the first image to which the function can be applied.

[0089] According to one embodiment, in operation 519, the electronic device (301) may display a visual object over at least one area of ​​the first image through the vision software platform (460). According to one embodiment, the electronic device (301) may display the visual object by overlaying it over the at least one area through the vision software platform (460). For example, the size of the visual object may be the same as the size of the at least one object. According to one embodiment, the electronic device (301) may also display a visual object representing an outline of the at least one area through the vision software platform (460).

[0090] According to one embodiment, in operation 521, the electronic device (301) may identify a second input that selects a first region among at least one region in which a visual object is displayed. For example, the second input may include a touch input or a long press input.

[0091] According to one embodiment, in operation 523, the electronic device (301) may execute a function on a first area of ​​the first image through the vision software platform (460) based on confirming a second input. For example, the electronic device (301) may delete a first object corresponding to the first area using the second component (432) through the vision software platform (460). For example, the electronic device (301) may scan a document image corresponding to the first area using the first component (431) through the vision software platform (460). According to one embodiment, in operation 521, the electronic device (301) may not execute a function on the first area of ​​the first image if a second input for selecting the first area from among at least one area where a visual object is displayed is not confirmed.

[0092] According to one embodiment, in operation 525, the electronic device (301) may display a second image to which a function is applied to the first image through the display (360). For example, the electronic device (301) may display a second image in which a first object is deleted from the first image. For example, the electronic device (301) may display a second image obtained by scanning a document image corresponding to a first area in the first image.

[0093] An electronic device (301) according to one embodiment can apply functions to an image and display a designated user interface through a vision software platform (460) even when different application programs are running, thereby providing a unified user interface to a user.

[0094] According to one embodiment, if the electronic device (301) determines that the function corresponding to the first input is not a function related to the vision software platform (460) (operation 513-No), then in operation 527, the electronic device (301) may execute the function corresponding to the first input through the first framework (440) (e.g., the first framework (440) of FIG. 4).

[0095] According to one embodiment, the electronic device (301) may provide the first image to the first framework (440). According to one embodiment, the electronic device (301) may identify a component related to a function corresponding to the first input through the first framework (440). According to one embodiment, the electronic device (301) may apply the function corresponding to the first input to the first image based on the component.

[0096] FIG. 6 is a flowchart illustrating an operation of an electronic device to obtain a second image to which a first function is applied to a first image through a framework according to one embodiment.

[0097] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0098] Referring to FIG. 6, according to one embodiment, in operation 611, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may confirm a first input for a first image displayed through the display (360) (e.g., the display (360) of FIG. 3) while executing a first application program. For example, the first application program may include a native application program (410) (e.g., the native application program (410) of FIG. 4) or a third-party application program (420) (e.g., the third-party application program (420) of FIG. 4). For example, the first input may represent an input for executing a function applicable to the first image. For example, the first input may include a touch input or a long press input. For example, the first input may include an input for drawing a specific shape (e.g., an X-shape, a square shape).

[0099] According to one embodiment, in operation 613, the electronic device (301) may provide a first image to the vision framework (450) (e.g., the vision framework (450) of FIG. 4) based on determining a first input. For example, if the electronic device (301) determines that a function corresponding to the first input is a function related to the software platform (460) (e.g., the software platform (460) of FIG. 4), the electronic device (301) may provide the first image to the vision framework (450) (e.g., the vision framework (450) of FIG. 4).

[0100] For example, the electronic device (301) may provide a first image to a first framework (440) (e.g., the first framework (440) of FIG. 4) through a first application program that is running based on confirming a first input. The electronic device (301) may provide the first image to a vision framework (450) through the first framework (440).

[0101] According to one embodiment, in operation 615, the electronic device (301) may verify a function corresponding to the first input through the vision framework (450) and execute a vision overlay program (430) (e.g., the vision overlay program (430) of FIG. 4) to execute the function for the first image. For example, the function may include a function of deleting at least one object included in the first image or a function of scanning a document image included in the first image. According to one embodiment, the electronic device (301) may execute the function using a first component (431) (e.g., the first component (431) of FIG. 4) or a second component (432) (e.g., the second component (432) of FIG. 4) included in the vision overlay program (430) related to the function corresponding to the first input. According to one embodiment, in operation 617, the electronic device (301) may verify at least one area of ​​the first image to which the function can be applied through the vision framework (450). According to one embodiment, the electronic device (301) can analyze the first image through the vision framework (450). According to one embodiment, the electronic device (301) can obtain information about the first image (e.g., at least one object included in the first image, a document image, etc.) through the vision framework (450).

[0102] According to one embodiment, in operation 619, the electronic device (301) may display a visual object over at least one area via the vision framework (450).

[0103] According to one embodiment, the electronic device (301) may display a visual object overlaid on at least one area via the vision framework (450). For example, the size of the visual object may be the same as the size of at least one object.

[0104] According to one embodiment, in operation 621, the electronic device (301) may identify a second input that selects a first region among at least one region. For example, the second input may include a touch input or a long press input.

[0105] According to one embodiment, in operation 623, the electronic device (301) may apply a first function to a first area of ​​the first image through the vision framework (450) based on confirming the second input. For example, the electronic device (301) may delete a first object corresponding to the first area through the vision framework (450). For example, the electronic device (301) may scan a document image corresponding to the first area through the vision framework (450).

[0106] According to one embodiment, in operation 625, the electronic device (301) may display a second image to which a first function is applied to the first image through the display (360). For example, the electronic device (301) may display a second image in which a first object is deleted from the first image. For example, the electronic device (301) may display a second image obtained by scanning a document image corresponding to a first area in the first image.

[0107] FIG. 7 is a flowchart illustrating an operation of an electronic device to confirm a first function based on confirming an input for an indicator displayed on a display, according to one embodiment.

[0108] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0109] Referring to FIG. 7, according to one embodiment, in operation 711, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may confirm an input for a first image displayed through the display (360) (e.g., the display (360) of FIG. 3). For example, the input may include a touch input or a long press input. Based on the confirmation of the input for the first image, the electronic device (301) may provide the first image to the vision framework (450) (e.g., the vision framework (450) of FIG. 4). According to one embodiment, the electronic device (301) may execute the vision overlay program (430) (e.g., the vision overlay program (430) of FIG. 4) based on the confirmation of the input for the first image. For example, the first image may include a still image, a moving image, or a frame included in a moving image acquired through a camera (e.g., the camera module (180) of FIG. 1). Depending on the implementation, the vision overlay program (430) may be included in the first framework (440). Depending on the implementation, the vision overlay program (430) may be implemented in the form of an extension of the first framework (440).

[0110] According to one embodiment, in operation 713, the electronic device (301) may display at least one indicator (e.g., 1120 of FIG. 11) indicating at least one function applicable to the first image through the vision framework (450) based on verifying an input for the first image. For example, the electronic device (301) may verify a function related to a component corresponding to the input for the first image among the first component (431) (e.g., the first component (431) of FIG. 4) and the second component (432) (e.g., the second component (432) of FIG. 4) included in the vision overlay program (430) through the vision framework (450). The electronic device (301) may display an indicator related to the function verified through the vision framework (450).

[0111] According to an implementation, according to one embodiment, the electronic device (301) may display a first indicator (e.g., 1110 of FIG. 11) that indicates at least one function applicable to the first image through the vision framework (450). According to one embodiment, when a user input for the first indicator (e.g., 1110 of FIG. 11) is confirmed, the electronic device (301) may display at least one indicator (e.g., 1120 of FIG. 11) that indicates at least one function applicable to the first image through the vision framework (450).

[0112] According to one embodiment, in operation 715, the electronic device (301) may determine an input for a first indicator among at least one indicator. For example, the input may include a touch input or a long press input.

[0113] According to one embodiment, in operation 717, the electronic device (301) can determine the function indicated by the first indicator through the vision framework (450). For example, the function may include a function of deleting at least one object (e.g., a person, an object, an animal, a plant) included in an image or a function of scanning a document image included in an image.

[0114] According to one embodiment, in operation 719, the electronic device (301) may identify at least one area of ​​the first image to which a function may be applied via the vision framework (450). For example, the at least one area may include at least one area corresponding to at least one object (e.g., a person, an object, an animal, a plant) included in the first image. For example, the at least one area may include at least one area corresponding to a document image included in the first image.

[0115] According to one embodiment, in operation 721, the electronic device (301) may identify an input that selects a first area among at least one area. For example, the input may include a touch input or a long press input.

[0116] According to one embodiment, in operation 723, the electronic device (301) may apply a function to a first area of ​​a first image through the framework (450). For example, the electronic device (301) may delete a first object corresponding to the first area using the second component (432) included in the vision framework (450). For example, the electronic device (301) may scan a document image corresponding to the first area using the first component (431) included in the vision framework (450).

[0117] According to one embodiment, in operation 725, the electronic device (301) may display a second image to which a function is applied with respect to the first image. FIG. 8A is a flowchart illustrating an operation of deleting an object included in a first image based on the electronic device confirming the first function, according to one embodiment.

[0118] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0119] Referring to FIG. 8A, according to one embodiment, in operation 801, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may identify at least one object included in a first image that can be separated from the first image displayed through the display (360) (e.g., the display (360) of FIG. 3) based on identifying a function corresponding to a first input through the vision framework (450) (e.g., the vision framework (450) of FIG. 4). According to one embodiment, if the electronic device (301) determines that the function corresponding to the first input is a function related to the vision framework (450), the electronic device (301) may provide the first image to the vision framework (450). According to one embodiment, the electronic device (301) may identify a function corresponding to the first input based on a second component (432) included in the vision framework (450) (e.g., the second component (432) of FIG. 4). For example, a function corresponding to a first input may represent a function of deleting at least one object included in a first image. For example, the at least one object may include at least one of a person, an object, an animal, or a plant.

[0120] According to one embodiment, in operation 803, the electronic device (301) may display a visual object by overlaying it over at least one area corresponding to at least one object through the vision framework (450). For example, the size of the visual object may be substantially the same as the size of the at least one object.

[0121] According to one embodiment, in operation 805, the electronic device (301) may identify a second input selecting a first region among at least one region through the vision framework (450). For example, the second input may include a touch input or a long press input.

[0122] According to one embodiment, at operation 808, the electronic device (301) may delete an object corresponding to a first region among at least one region through the vision framework (450) based on verifying the second input.

[0123] According to one embodiment, the electronic device (301) may delete an object corresponding to a first region among at least one region based on information about the second component (432) included in the vision framework (450). For example, the information about the second component (432) may include an algorithm or an artificial intelligence model capable of deleting at least one object included in an image.

[0124] For example, the electronic device (301) can use an algorithm to delete an object corresponding to a first area of ​​the first image. For example, the electronic device (301) can also use an artificial intelligence (AI) model to delete an object corresponding to a first area of ​​the first image. For example, the artificial intelligence (AI) model can be implemented as a generative artificial intelligence model. For example, the electronic device (301) can obtain a second image from which an object corresponding to the first area has been deleted based on providing information about the first image and the first area to the artificial intelligence model through the vision framework (450). For example, the electronic device (301) may delete an object corresponding to a first area of ​​the first image based on information about a component included in a native application program (410) (e.g., the native application program (410) of FIG. 4) or information about a component included in a third-party application program (420) (e.g., information about a component included in a third-party application program (420) of FIG. 4).

[0125] According to one embodiment, in operation 809, the electronic device (301) may display a second image in which an object corresponding to the first area has been deleted through the display (360). According to one embodiment, the electronic device (301) may display a second image in which an object corresponding to the first area has been deleted through the vision framework (450).

[0126] FIG. 8B is a flowchart illustrating an operation of scanning a document image included in a first image based on an electronic device identifying a first function, according to one embodiment.

[0127] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0128] Referring to FIG. 8B, according to one embodiment, in operation 811, the electronic device (301) (e.g., the electronic device (301) of FIG. 3) may identify a document image included in a first image displayed through the display (360) (e.g., the display (360) of FIG. 3) based on identifying a function corresponding to a first input through the vision framework (450) (e.g., the vision framework (450) of FIG. 4). According to one embodiment, if the electronic device (301) identifies that the function corresponding to the first input is a function related to the vision framework (450), the electronic device (301) may provide the first image to the vision framework (450). According to one embodiment, the electronic device (301) may identify a function corresponding to the first input based on a first component (431) included in the vision framework (450) (e.g., the first component (431) of FIG. 4). For example, the function corresponding to the first input may represent a function of scanning a document image.

[0129] According to one embodiment, in operation 813, the electronic device (301) may display a visual object over at least one area corresponding to the document image via the vision framework (450). For example, the electronic device (301) may display a visual object representing an outline of at least one area corresponding to the document image.

[0130] According to one embodiment, in operation 815, the electronic device (301) may identify a second input that selects a first region among at least one region. For example, the second input may include a touch input or a long press input.

[0131] According to one embodiment, in operation 817, the electronic device (301) may scan a document image corresponding to a first region among at least one region according to a specified document scanning method through the vision framework (450). According to one embodiment, the electronic device (301) may scan the document image according to the specified document scanning method based on information about the first component (431) included in the vision framework (450). For example, the information about the first component (431) may include an algorithm or an artificial intelligence model capable of scanning the document image. For example, the electronic device (301) may also scan the document image according to the specified document scanning method based on information about a component included in a native application program (410) (e.g., the native application program (410) of FIG. 4) or information about a component included in a third-party application program (420) (e.g., information about a component included in the third-party application program (420) of FIG. 4).

[0132] According to one embodiment, in operation 819, the electronic device (301) may display a second image obtained by scanning a document image corresponding to the first area through the display (360).

[0133] FIG. 9 is a diagram illustrating an operation of an electronic device executing a function of deleting an object included in a first image according to one embodiment.

[0134] Referring to (a) of FIG. 9, according to one embodiment, an electronic device (301) (e.g., the electronic device (301) of FIG. 3) may display a first image (910) through a display (360) (e.g., the display (360) of FIG. 3) while executing a first application program of the electronic device (301). For example, the first application program may include a native application program (410) (e.g., the native application program (410) of FIG. 4) or a third-party application program (420) (e.g., the third-party application program (420) of FIG. 4). For example, the first image (910) may include a first object (911) and a second object (912). The first object (911) and the second object (912) may include a person.

[0135] According to one embodiment, the electronic device (301) can verify an input (913) for a first image (910).

[0136] According to one embodiment, the electronic device (301) can provide the first image (910) to a vision framework (450) (e.g., the vision framework (450) of FIG. 4). According to one embodiment, the electronic device (301) can execute an application program (430) (e.g., the application program (430) of FIG. 4).

[0137] According to one embodiment, the electronic device (301) can identify a function corresponding to the input (913) through the vision framework (450). For example, the input (913) may include an input for drawing a specific shape (e.g., an X shape). For example, the function corresponding to the input (913) may include a function for deleting at least one object included in an image.

[0138] Referring to (b) of FIG. 9, according to one embodiment, the electronic device (301) can identify an area (923) corresponding to a first object (911) of a first image (910) to which a function corresponding to an input (913) can be applied and an area (924) corresponding to a second object (912) through the vision framework (450). The area (923) corresponding to the first object (911) includes an area corresponding to the first object (911) that can be separated from the first image (910), and the area (924) corresponding to the second object (912) includes an area corresponding to the second object (912) that can be separated from the first image (910).

[0139] According to one embodiment, the electronic device (301) can identify a first object (911) and a second object (912) that can be separated from a first image (910) through the vision framework (450). The electronic device (301) can identify an area corresponding to the first object (911) and an area corresponding to the second object (912) through the vision framework (450). The electronic device (301) can display a visual object (921) by overlapping it over an area (923) corresponding to the first object (911) through the vision framework (450). The electronic device (301) can display a visual object (922) by overlapping it over an area (924) corresponding to the second object (912) through the vision framework (450). According to one embodiment, the shape and / or size of the visual objects (921, 922) may not be limited thereto and may be set to various shapes and / or sizes.

[0140] For example, the size of the visual object (921) may be substantially the same as the size of the area (923) corresponding to the first object (911), or may be larger than the size of the area (923) corresponding to the first object (911). For example, the size of the visual object (922) may be substantially the same as the size of the area (924) corresponding to the second object (912), or may be larger than the size of the area (924) corresponding to the second object (912).

[0141] For example, the shape and / or size of the visual object (921, 922) can be selected by the user's settings. For example, the electronic device (301) can display a setting screen that can set the shape and / or size of the visual object (921, 922). When a user input for setting the shape and / or size of the visual object (921, 922) is confirmed, the electronic device (301) can display the visual object (921, 922) of the shape and / or size according to the user input.

[0142] Referring to (c) of FIG. 9, according to one embodiment, the electronic device (301) can identify an input for selecting an area corresponding to a second object (912). For example, the input may include a voice input, a touch input, a hovering input, a tap input, or a long press input. However, this is merely an example, and the type of input may not be limited thereto.

[0143] According to one embodiment, the electronic device (301) can obtain a second image (920) in which the second object (912) included in the first image (910) is deleted through the vision framework (450) based on confirming an input for selecting an area corresponding to the second object (912).

[0144] According to one embodiment, the electronic device (301) can display a second image (920) through the display (360).

[0145] FIG. 10 is a diagram illustrating an operation of an electronic device executing a function of scanning a document image included in a first image according to one embodiment.

[0146] Referring to (a) of FIG. 10, according to one embodiment, an electronic device (301) (e.g., the electronic device (301) of FIG. 3) may display a third image (1010) through a display (360) (e.g., the display (360) of FIG. 3) while executing a first application program of the electronic device (301). For example, the first application program may include a native application program (410) (e.g., the native application program (410) of FIG. 4) or a third-party application program (420) (e.g., the third-party application program (420) of FIG. 4). For example, the third image (1010) may include a document image including text.

[0147] According to one embodiment, the electronic device (301) can verify an input (1011) for a third image (1010).

[0148] In one embodiment, the electronic device (301) can provide the third image (1010) to a vision framework (450) (e.g., the vision framework (450) of FIG. 4). In one embodiment, the electronic device (301) can execute an application program (430) (e.g., the application program (430) of FIG. 4).

[0149] According to one embodiment, the electronic device (301) can identify a function corresponding to an input (1011) through the vision framework (450). For example, the input (1011) may include an input for drawing a specific shape (e.g., a square shape). For example, the input (1011) may also include a voice input, a hovering input, or a gesture input.

[0150] According to one embodiment, the function corresponding to the input (1011) may include the function of scanning a document image.

[0151] Referring to (b) of FIG. 10, according to one embodiment, the electronic device (301) can identify an area corresponding to a document image (1010) to which a function corresponding to an input (1011) can be applied through the vision framework (450).

[0152] According to one embodiment, the electronic device (301) may display a visual object (1012) over an area corresponding to the document image (1010) based on identifying an area corresponding to the document image (1010) through the vision framework (450). For example, the visual object (1012) may represent an outline of an area corresponding to the document image (1010).

[0153] Referring to (c) of FIG. 10, according to one embodiment, the electronic device (301) may acquire a fourth image (1013) by scanning the document image (1010) according to a specified document scanning method based on confirming an input for selecting an area corresponding to the document image (1010). According to one embodiment, the electronic device (301) may display the fourth image (1013) through a display (360) (e.g., the display (360) of FIG. 3).

[0154] According to an implementation, according to one embodiment, the electronic device (301) may obtain a fourth image (1013) scanned by a specified document scanning method of the document image (1010) without displaying a visual object (1012) over an area corresponding to the document image (1010) based on identifying a function corresponding to the input (1011) through the vision framework (450).

[0155] FIG. 11 is a diagram illustrating an operation of an electronic device displaying a visual object over an area of ​​an image based on a user input selecting an indicator indicating a function of deleting an object included in the image, according to one embodiment.

[0156] Referring to (a) of FIG. 11, according to one embodiment, an electronic device (301) (e.g., the electronic device (301) of FIG. 3) may display an indicator (1110) that displays at least one function that can be applied to a first image (910) (e.g., the first image (910) of FIG. 9) through a vision framework (450) (e.g., the vision framework (450) of FIG. 4).

[0157] According to one embodiment, the electronic device (301) can detect a user input for an indicator (1110) that indicates at least one function. For example, the user input can include a touch input or a long press input.

[0158] Referring to (b) of FIG. 11, according to one embodiment, the electronic device (301) may display an indicator (1120) (e.g., AI eraser) indicating a function applicable to the first image (910) through the vision framework (450) based on confirming a user input for the indicator (1110). For example, the function applicable to the first image (910) may include a function of deleting at least one object included in the image.

[0159] Referring to (c) of FIG. 11, according to one embodiment, the electronic device (301) can identify an area corresponding to the first object (911) and an area corresponding to the second object (912) through the vision framework (450) based on confirming a user input for an indicator (1120) indicating a function applicable to the first image (910) (e.g., AI eraser). The electronic device (301) can display a visual object (921) by overlapping it over the area corresponding to the first object (911) through the vision framework (450). The electronic device (301) can display a visual object (922) by overlapping it at least partially over the area corresponding to the second object (912) through the vision framework (450).

[0160] According to one embodiment, when an input for selecting an area corresponding to a first object (911) is confirmed, the electronic device (301) can obtain a second image (920) (e.g., the second image (920) of FIG. 9) from which the first object (911) included in the first image (910) is deleted through the vision framework (450). According to one embodiment, when an input for selecting an area corresponding to a second object (912) is confirmed, the electronic device (301) can obtain a second image (920) (e.g., the second image (920) of FIG. 9) from which the second object (912) included in the first image (910) is deleted through the vision framework (450).

[0161] FIG. 12 is a diagram illustrating an operation of displaying a visual object over an area of ​​a document image based on a user input selecting an indicator indicating a function of an electronic device to scan a document image, according to one embodiment.

[0162] Referring to (a) of FIG. 12, according to one embodiment, an electronic device (301) (e.g., the electronic device (301) of FIG. 3) may display an indicator (1110) that displays at least one function that can be applied to a third image (1010) (e.g., the third image (1010) of FIG. 10) through a vision framework (450) (e.g., the vision framework (450) of FIG. 4).

[0163] According to one embodiment, the electronic device (301) can detect a user input for an indicator (1110) that indicates at least one function. For example, the user input can include a touch input or a long press input.

[0164] Referring to (b) of FIG. 12, according to one embodiment, the electronic device (301) may display an indicator (1220, 1230) (e.g., AI eraser, document scan) indicating a function applicable to the third image (1010) through the vision framework (450) based on confirming a user input for the indicator (1110). For example, the function applicable to the third image (1010) may include a function of deleting at least one object included in the document image and a function of scanning the document image.

[0165] Referring to (c) of FIG. 12, according to one embodiment, the electronic device (301) can identify an area corresponding to a document image based on a user input regarding an indicator (1230) indicating a function applicable to a third image (1010) (e.g., document scanning). The electronic device (301) can display a visual object (1012) by overlaying it on the area corresponding to the document image through the vision framework (450).

[0166] According to one embodiment, when an input for selecting an area corresponding to a document image is confirmed, the electronic device (301) can acquire a fourth image (1013) (e.g., the fourth image (1013) of FIG. 10) of a scanned document through the vision framework (450).

[0167] According to one embodiment, an electronic device may include a display, at least one processor, and a memory storing instructions.

[0168] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to, based on identifying a first input for a first image displayed through the display, identify a function corresponding to the first input through a software platform of the electronic device for executing at least one function related to the image.

[0169] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to execute the function through the software platform to identify at least one area of ​​the first image related to the function.

[0170] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to display, through the display, a visual object provided by the function over the at least one area of ​​the first image.

[0171] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to obtain a second image having the function applied to the specific area of ​​the first image through the software platform based on identifying a second input selecting a specific area of ​​the at least one area in which the visual object is displayed.

[0172] According to one embodiment, the software platform may include an application program configured to execute the at least one function and a framework for the application program.

[0173] In one embodiment, the framework may be different from the framework of the operating system of the electronic device.

[0174] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to provide the first image to the framework based on identifying the first input for the first image.

[0175] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to identify, through the framework, the function corresponding to the first input and the at least one area of ​​the first image to which the function can be applied, based on providing the first image to the framework.

[0176] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to display the visual object overlaid on the at least one area through the framework.

[0177] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to execute the application program to perform the function for the first image based on identifying the first input for the first image while executing the first application program of the electronic device.

[0178] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to display, through the software platform, at least one object representing the at least one function applicable to the first image based on a user input with respect to the first image displayed through the display.

[0179] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to execute the function represented by the first object through the software platform based on verifying an input to the first object of the at least one object.

[0180] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to identify the at least one area of ​​the first image through the software platform based on executing the function.

[0181] According to one embodiment, the function may include a function of deleting an object included in the first image.

[0182] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to identify at least one first object that is separable from the first image.

[0183] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to display the visual object over the at least one area corresponding to the at least one first object.

[0184] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to delete an object corresponding to the first area among the at least one area, based on the second input.

[0185] In one embodiment, the function may include scanning a document included in the first image.

[0186] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to identify a document image included in the first image.

[0187] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to display the visual object over the at least one area corresponding to the document image.

[0188] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor (320), may cause the electronic device (301) to scan a document image corresponding to the specific area among the at least one area according to a specified document scanning method, based on the second input.

[0189] According to one embodiment, a method of operating an electronic device (301) may include an operation of confirming a first input for a first image displayed through a display (360) of the electronic device (301), and confirming a function corresponding to the first input through a software platform of the electronic device (301) for executing at least one function related to the image.

[0190] According to one embodiment, a method of operating an electronic device (301) may include an operation of executing the function through the software platform to confirm at least one area of ​​the first image related to the function.

[0191] According to one embodiment, a method of operating an electronic device (301) may include an operation of displaying a visual object provided by the function on at least one area of ​​the first image through the display (360).

[0192] According to one embodiment, a method of operating an electronic device (301) may include an operation of obtaining a second image to which the function is applied for the first area of ​​the first image through the software platform based on confirming a second input of selecting a specific area among the at least one area where the visual object is displayed.

[0193] According to one embodiment, a method of operating an electronic device (301) may include an operation of providing the first image to the framework based on confirming the first input for the first image.

[0194] According to one embodiment, in a method of operating an electronic device (301), the method may include an operation of identifying, through the framework, the function corresponding to the first input and the at least one area of ​​the first image to which the function can be applied, based on providing the first image to the framework.

[0195] According to one embodiment, the method of operating the electronic device (301) may include an operation of displaying the visual object by overlapping it over the at least one area through the framework.

[0196] According to one embodiment, a method of operating an electronic device (301) may include an operation of executing a first application program of the electronic device (301) to execute the function for the first image based on confirming the first input for the first image.

[0197] According to one embodiment, a method of operating an electronic device (301) may include an operation of displaying at least one object representing at least one function applicable to the first image through the software platform based on a user input for the first image displayed through the display (360).

[0198] According to one embodiment, a method of operating an electronic device (301) may include an operation of executing the function indicated by the first object through the software platform based on confirming an input to the first object among the at least one object.

[0199] According to one embodiment, a method of operating an electronic device (301) may include an operation of identifying at least one area of ​​the first image through the software platform based on executing the first function.

[0200] According to one embodiment, a method of operating an electronic device (301) may include an operation of identifying at least one first object that can be separated from the first image.

[0201] According to one embodiment, a method of operating an electronic device (301) may include an operation of displaying the visual object on the at least one area corresponding to the at least one first object.

[0202] According to one embodiment, the method of operating the electronic device (301) may include an operation of deleting an object corresponding to the specific area among the at least one area based on the second input.

[0203] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor (320) of an electronic device (301), cause the electronic device to perform at least one operation, wherein the at least one operation may include: identifying a function corresponding to the first input through a software platform of the electronic device (301) for executing at least one function related to an image based on identifying a first input for a first image displayed through a display (360) of the electronic device (301).

[0204] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor (320) of an electronic device (301), cause the electronic device to perform at least one operation, wherein the at least one operation may include an operation of executing the first function through the software platform to identify at least one area of ​​the first image related to the function.

[0205] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor (320) of an electronic device (301), cause the electronic device (301) to perform at least one operation, wherein the at least one operation may include displaying a visual object provided by the function on the at least one area of ​​the first image through the display (360).

[0206] According to one embodiment, a non-transitory storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor (320) of an electronic device (301), cause the electronic device (301) to perform at least one operation, wherein the at least one operation may include an operation of obtaining a second image to which the function is applied for the first area of ​​the first image through the software platform based on identifying a second input selecting a specific area among the at least one area in which the visual object is displayed.

[0207] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0208] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first) is referred to as "coupled" or "connected" to another (e.g., a second) component, with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0209] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0210] Various embodiments of the present document may be implemented as software (e.g., program (140)) including one or more commands stored in a storage medium (e.g., built-in memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101, 301)). For example, a processor (e.g., processor (120, 320)) of a machine (e.g., electronic device (101, 301)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the called at least one command. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means a device in which the storage medium is tangible, It simply means that it does not contain signals (e.g. electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on a storage medium.

[0211] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0212] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; at least one processor; and Contains memory that stores instructions, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on confirming a first input for a first image displayed through the display, a function corresponding to the first input is confirmed through a software platform of the electronic device for executing at least one function related to the image, By executing the function through the software platform, at least one area of ​​the first image related to the function is identified, Through the display, display a visual object provided by the function on at least one area of ​​the first image, An electronic device that causes the software platform to acquire a second image to which the first function is applied for the specific area of ​​the first image based on a second input selecting a specific area among the at least one area where the visual object is displayed.

2. In paragraph 1, The software platform includes an application program configured to execute at least one function and a framework for the application program, The above framework is an electronic device different from the framework of the operating system of the electronic device.

3. In any one of paragraphs 1 and 2, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Providing the first image to the framework based on verifying the first input for the first image, Based on providing the first image to the framework, identifying the function corresponding to the first input and the at least one area of ​​the first image to which the function can be applied through the framework, An electronic device that causes the visual object to be displayed over the at least one area through the framework.

4. In any one of paragraphs 1 to 3, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that causes the application program to be executed to perform the function for the first image based on confirming the first input for the first image while the first application program of the electronic device is being executed.

5. In any one of paragraphs 1 to 4, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on a user input for the first image displayed through the display, displaying at least one object representing the at least one function that can be applied to the first image through the software platform; Based on verifying an input to a first object among the at least one object, executing the function represented by the first object through the software platform, An electronic device that causes the software platform to identify at least one area of ​​the first image based on executing the above function.

6. In any one of paragraphs 1 to 5, The above function includes a function of deleting an object included in the first image, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Identifying at least one object included in the first image that can be separated from the first image; Displaying the visual object over the at least one area corresponding to the at least one object; An electronic device that causes an object corresponding to a specific area among the at least one area to be deleted based on the second input.

7. In any one of paragraphs 1 to 6, The above function includes a function of scanning a document included in the first image, The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Check the document image included in the first image above, Displaying the visual object over the at least one area corresponding to the document image, An electronic device that causes a document image corresponding to a specific area among the at least one area to be scanned according to a specified document scanning method based on the second input.

8. In the method of operating an electronic device, An operation of confirming a first input for a first image displayed through a display of the electronic device, and confirming a function corresponding to the first input through a software platform of the electronic device for executing at least one function related to the image; An operation of executing the function through the software platform to identify at least one area of ​​the first image related to the function; An operation of displaying a visual object provided by the function over at least one area of ​​the first image through the display; and An operating method of an electronic device, comprising: obtaining a second image to which the function is applied for the specific area of ​​the first image through the software platform based on a second input selecting a specific area among the at least one area in which the visual object is displayed.

9. In paragraph 8, The software platform includes an application program configured to execute at least one function and a framework for the application program, The above framework is a method of operating an electronic device that is different from the framework of the operating system of the electronic device.

10. In any one of paragraphs 8 to 9, An action of providing the first image to the framework based on verifying the first input for the first image; An operation of identifying, based on providing the first image to the framework, the function corresponding to the first input and the at least one area of ​​the first image to which the function can be applied through the framework; and A method of operating an electronic device further comprising an action of displaying the visual object by overlaying it over the at least one area through the framework.

11. In any one of paragraphs 8 to 10, An operating method of an electronic device further comprising: executing the application program to execute the function for the first image based on confirming the first input for the first image while executing the first application program of the electronic device.

12. In any one of paragraphs 8 to 11, An action of displaying at least one object representing at least one function applicable to the first image through the software platform based on a user input for the first image displayed through the display; An operation of executing the function represented by the first object through the software platform based on verifying an input to the first object among the at least one object; and A method of operating an electronic device further comprising an operation of identifying at least one area of ​​the first image through the software platform based on executing the above function.

13. In any one of paragraphs 8 to 12, The above function includes a function of deleting an object included in the first image, An operation of identifying at least one first object that can be separated from the first image; An operation of displaying the visual object over the at least one area corresponding to the at least one first object; and A method of operating an electronic device, further comprising an operation of deleting an object corresponding to the specific area among the at least one area based on the second input.

14. In any one of paragraphs 8 to 13, The above function includes a function of scanning a document included in the first image, An action to check a document image included in the first image; An operation of displaying the visual object over the at least one area corresponding to the document image; and An operating method of an electronic device further comprising an operation of scanning a document image corresponding to the first area among the at least one area based on the second input according to a specified document scanning method.

15. A storage medium storing computer-readable instructions, wherein the instructions, when executed by at least one processor of an electronic device, cause the electronic device to perform at least one operation, wherein the at least one operation is: An operation of confirming a first input for a first image displayed through a display of the electronic device, and confirming a function corresponding to the first input through a software platform of the electronic device for executing at least one function related to the image; An operation of executing the function through the software platform to identify at least one area of ​​the first image related to the function; An operation of displaying a visual object provided by the function over at least one area of ​​the first image through the display; and A storage medium comprising an operation of obtaining a second image to which the function is applied for the specific area of ​​the first image through the software platform based on identifying a second input selecting a specific area among the at least one area where the visual object is displayed.

Images