Electronic device and image processing method using same electronic device
The electronic device uses a generative AI model to correct objects across camera switches, addressing discrepancies in brightness, color, and position, ensuring consistent image quality.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-09-18
- Publication Date
- 2026-05-15
AI Technical Summary
When switching between cameras on an electronic device, discrepancies in brightness, color tone, and position of added objects can occur, leading to undesired image generation.
The electronic device employs a generative artificial intelligence model to create objects based on user input, and upon camera switch, corrects these objects to align with the characteristics of the new camera, ensuring consistency across images.
This approach enables the generation of images with reduced discrepancies by adjusting objects to match the new camera's characteristics, resulting in a cohesive and desired final image.
Smart Images

Figure KR2025014508_15052026_PF_FP_ABST
Abstract
Description
Electronic device and image processing method using said electronic device
[0001] Various embodiments of the present invention disclose an electronic device and a method for processing an image using said electronic device.
[0002] The use of electronic devices such as bar-type, foldable-type, rollable-type, or sliding-type devices is increasing, and various functions are being provided to these devices.
[0003] The above electronic device can acquire at least one of an image and a video using one or more cameras.
[0004] The electronic device described above can provide a function to add and edit a new image (e.g., an object image or a virtual object) to at least one of the images and videos acquired using a camera.
[0005] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art in relation to the present disclosure.
[0006] An electronic device can add new objects (e.g., object images or virtual objects) to a preview image acquired through a camera using generative artificial intelligence (AI) or a generative artificial intelligence model.
[0007] For example, if an object (e.g., an object image or a virtual object) is added to a first preview image obtained through a first camera, and then the first camera is switched to a second camera, a difference (brightness, color tone, and / or position) may occur between the second preview image obtained through the second camera and the object.
[0008] For example, when a user of an electronic device generates a new image by adding an object (e.g., object image or virtual object) to an original image (e.g., preview image) captured through a camera, if there is a difference (e.g., disparity) between the original image and the object image, the user may not be able to obtain the desired image.
[0009] Various embodiments of the present invention may provide an electronic device capable of correcting an object (e.g., an object image or a virtual object) to correspond to the characteristics of the second camera (e.g., a second preview image) even when the first camera is switched to the second camera, and an image processing method using said electronic device.
[0010] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description below.
[0011] An electronic device according to one embodiment of the present invention may include a touch screen display, a first camera having a first characteristic and a second camera having a second characteristic, at least one processor, and a memory for storing instructions. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the electronic device may acquire a first preview image through the first camera, receive user input to create an object within the first preview image through the touch screen display, create the object based on the user input through a generative artificial intelligence model trained to create at least one object based on text input, drawing input, or image input, display the created object within the first preview image through the touch screen display, acquire a second preview image through the second camera based on confirmation that the first camera is switched to the second camera, correct the object based on the second characteristic of the second camera, and display the corrected object within the second preview image through the touch screen display.
[0012] A method for processing an image using an electronic device according to an embodiment of the present invention may include an operation of acquiring a first preview image through a first camera having a first characteristic. According to an embodiment, the method may include an operation of receiving user input for creating an object within the first preview image through a touch screen display. According to an embodiment, the method may include an operation of creating the object based on the user input through a generative artificial intelligence model trained to create at least one object based on text input, drawing input, or image input. According to an embodiment, the method may include an operation of displaying the created object within the first preview image through the touch screen display. According to an embodiment, the method may include an operation of checking whether the first camera is switched to a second camera having a second characteristic. According to an embodiment, the method may include an operation of acquiring a second preview image through the second camera based on the confirmation that the first camera is switched to the second camera. According to one embodiment, the method may include an operation of correcting the object based on the second characteristic of the second camera. According to one embodiment, the method may include an operation of displaying the corrected object within the second preview image through the touch screen display.
[0013] According to one embodiment, a method for processing an image using the electronic device may be performed using a non-transient computer-readable storage medium that stores one or more programs. One or more programs according to one embodiment may include instructions and / or commands that are executed when executed by a processor of the electronic device.
[0014] According to various embodiments of the present invention, even if a transition occurs between a first camera and a second camera, by correcting an object (e.g., an object image or a virtual object) to correspond to the characteristics of the transitioned camera, an image with less discrepancy between the preview image of the transitioned camera and the object (e.g., an object image) can be obtained and generated.
[0015] In addition, various effects that can be identified directly or indirectly through this document may be provided.
[0016] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0017] FIG. 1a is a block diagram of an electronic device in a network environment according to various embodiments of the present invention.
[0018] FIG. 1b is a block diagram illustrating a camera module according to various embodiments of the present invention.
[0019] FIG. 2a is a front perspective view of an electronic device according to various embodiments of the present invention.
[0020] FIG. 2b is a perspective view of the rear of an electronic device according to various embodiments of the present invention.
[0021] FIG. 3a is a schematic diagram showing a camera used according to a zoom array of a camera module according to one embodiment of the present invention.
[0022] FIG. 3b is a schematic diagram illustrating an embodiment in which a first camera and a second camera are used according to one embodiment of the present invention.
[0023] FIG. 4a is a schematic diagram illustrating an embodiment of adjusting the magnification of a preview image using a magnification adjustment button according to an embodiment of the present invention.
[0024] FIG. 4b is a schematic diagram illustrating an embodiment of adjusting the magnification of a preview image using a progress bar according to an embodiment of the present invention.
[0025] FIG. 4c is a schematic diagram illustrating an embodiment of adjusting the magnification of a preview image using a pinch zoom gesture according to an embodiment of the present invention.
[0026] FIG. 5 is a block diagram schematically showing the configuration of an electronic device according to one embodiment of the present invention.
[0027] FIG. 6a is a diagram schematically showing a first image including a first preview image and a first object image according to an embodiment of the present invention.
[0028] FIG. 6b is a diagram schematically showing a second preview image and a first object image displayed on a touch screen display when a first camera is switched to a second camera according to an embodiment of the present invention.
[0029] FIG. 6c is a diagram schematically showing a second image including a second preview image and a second object image according to an embodiment of the present invention.
[0030] FIG. 7a is a diagram schematically illustrating a first image including a first preview image and a first object image according to various embodiments of the present invention.
[0031] FIG. 7b is a diagram schematically showing a second preview image and a first object image displayed on a touch screen display when a first camera is switched to a second camera according to various embodiments of the present invention.
[0032] FIG. 7c is a diagram schematically showing a second image including a second preview image and a first object image according to various embodiments of the present invention.
[0033] FIG. 8a is a schematic diagram illustrating an embodiment in which a first preview image obtained using a first camera and a second preview image obtained using a second camera according to an embodiment of the present invention are displayed on a touch screen display.
[0034] FIG. 8b is a diagram schematically illustrating an embodiment in which a first object image is generated on a first preview image according to one embodiment of the present invention.
[0035] FIG. 8c is a schematic diagram illustrating an embodiment in which the position of a first object image is changed according to the movement of an electronic device according to an embodiment of the present invention.
[0036] FIG. 8d is a schematic diagram illustrating an embodiment in which a first object image according to an embodiment of the present invention is displayed on a first preview image and a second preview image.
[0037] FIG. 9a is a diagram schematically showing a state in which a first object image generated using a generative artificial intelligence model is displayed on a first preview image according to an embodiment of the present invention.
[0038] FIG. 9b is a schematic diagram illustrating an embodiment in which the sizes of a first preview image and a first object image are changed based on a zoom operation according to various embodiments of the present invention.
[0039] FIG. 10a is a diagram schematically illustrating a state in which a first object image generated using a generative artificial intelligence model is displayed on a first preview image according to various embodiments of the present invention.
[0040] FIG. 10b is a diagram schematically showing a second preview image and a second object image displayed on a touch screen display when a first camera is switched to a second camera according to various embodiments of the present invention.
[0041] FIG. 11a is a diagram schematically showing a first object image and a second object image generated through a generative artificial intelligence model according to an embodiment of the present invention.
[0042] FIG. 11b is a diagram schematically illustrating an embodiment in which a second object generated through a generative artificial intelligence model is reflected in a second preview image according to an embodiment of the present invention.
[0043] FIG. 12a is a schematic diagram showing a display screen of a slideable electronic device according to various embodiments of the present invention.
[0044] FIG. 12b is a schematic diagram showing an expanded screen of a display of a slideable electronic device according to various embodiments of the present invention.
[0045] FIG. 13 is a flowchart schematically illustrating a method for processing an image using an electronic device according to one embodiment of the present invention.
[0046] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.
[0047] FIG. 1a is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments of the present invention.
[0048] Referring to FIG. 1a, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0049] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0050] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0051] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0052] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0053] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0054] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0055] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0056] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0057] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0058] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0059] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0060] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0061] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0062] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0063] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0064] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0065] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.
[0066] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0067] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0068] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0069] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0070] FIG. 1b is a block diagram (105) illustrating a camera module (180) according to various embodiments of the present invention.
[0071] Referring to FIG. 1b, the camera module (180) may include a lens assembly (181), a flash (182), an image sensor (183), an image stabilizer (184), a memory (185) (e.g., a buffer memory), or an image signal processor (186). The lens assembly (181) may collect light emitted from a subject that is the subject of the image capture. The lens assembly (181) may include one or more lenses. According to one embodiment, the camera module (180) may include a plurality of lens assemblies (181). In this case, the camera module (180) may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies (181) may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties different from the lens properties of the other lens assemblies. The lens assembly (181) may include, for example, a wide-angle lens or a telephoto lens.
[0072] A flash (182) may emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash (182) may include one or more light-emitting diodes (e.g., RGB (red-green-blue) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp. An image sensor (183) may acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through a lens assembly (181) into an electrical signal. According to one embodiment, the image sensor (183) may include, for example, one image sensor selected from image sensors with different properties such as an RGB sensor, a BW (black and white) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same properties, or a plurality of image sensors having different properties. Each image sensor included in the image sensor (183) may be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.
[0073] The image stabilizer (184) can move at least one lens or image sensor (183) included in the lens assembly (181) in a specific direction or control the operational characteristics of the image sensor (183) (e.g., adjusting read-out timing) in response to the movement of the camera module (180) or the electronic device (101) including it. This allows for compensating for at least some of the negative effects caused by the movement on the image being captured. According to one embodiment, the image stabilizer (184) can detect such movement of the camera module (180) or the electronic device (101) using a gyroscope sensor (not shown) or an accelerometer sensor (not shown) placed inside or outside the camera module (180). According to one embodiment, the image stabilizer (184) can be implemented, for example, as an optical image stabilizer. The memory (185) can temporarily store at least some of the image acquired through the image sensor (183) for the next image processing operation. For example, if image acquisition by the shutter is delayed or multiple images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) is stored in memory (185), and the corresponding copy image (e.g., a low-resolution image) can be previewed through the display module (160). Subsequently, when a specified condition is satisfied (e.g., user input or system command), at least a portion of the original image stored in memory (185) can be acquired and processed by, for example, an image signal processor (186). According to one embodiment, memory (185) may be configured as at least a portion of memory (130) or as a separate memory that operates independently thereof.
[0074] The image signal processor (186) can perform one or more image processing operations on an image obtained through the image sensor (183) or an image stored in memory (185). The above one or more image processing methods may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softing). Additionally or generally, the image signal processor (186) may perform control (e.g., exposure time control, or readout timing control, etc.) over at least one of the components included in the camera module (180) (e.g., image sensor (183)). The image processed by the image signal processor (186) may be stored back in memory (185) for further processing or provided to an external component of the camera module (180) (e.g., memory (130), display module (160), electronic device (102), electronic device (104), or server (108)). According to one embodiment, the image signal processor (186) may be composed of at least a part of the processor (120), or It may be configured as a separate processor that operates independently of the processor (120). If the image signal processor (186) is configured as a separate processor from the processor (120), at least one image processed by the image signal processor (186) may be displayed through the display module (160) as is or after additional image processing by the processor (120).
[0075] According to one embodiment, the electronic device (101) may include a plurality of camera modules (180), each having different attributes or functions. In this case, for example, at least one of the plurality of camera modules (180) may be a wide-angle camera and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules (180) may be a front camera and at least another may be a rear camera.
[0076] FIG. 2a is a front perspective view of an electronic device according to various embodiments of the present invention. FIG. 2b is a rear perspective view of an electronic device according to various embodiments of the present invention.
[0077] Referring to FIGS. 2a and 2b, an electronic device (200) according to one embodiment may include a housing (210) comprising a first surface (or front) (210A), a second surface (or rear) (210B), and a side (210C) surrounding the space between the first surface (210A) and the second surface (210B). In other embodiments (not shown), the housing (210) may refer to a structure forming some of the first surface (210A), the second surface (210B), and the side (210C) of FIGS. 2a and 2b. According to one embodiment, the first surface (210A) may be formed by a front plate (202) (e.g., a glass plate or a polymer plate having various coating layers) in which at least a portion is substantially transparent. The second surface (210B) may be formed by a rear plate (211) that is substantially opaque. The rear plate (211) may be formed, for example, by coated or colored glass, ceramic, polymer, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of the above materials. The side (210C) may be formed by a side bezel structure (218) (or "side member") comprising metal and / or polymer, which is combined with the front plate (202) and the rear plate (211). In some embodiments, the rear plate (211) and the side bezel structure (218) may be formed integrally and may comprise the same material (e.g., a metallic material such as aluminum).
[0078] In the illustrated embodiment, the front plate (202) may include a first region (210D) that curves seamlessly from the first surface (210A) toward the rear plate at both ends of the long edge of the front plate (202). In the illustrated embodiment (see FIG. 2b), the rear plate (211) may include a second region (210E) that curves seamlessly from the second surface (210B) toward the front plate (102) at both ends of the long edge. In some embodiments, the front plate (202) or the rear plate (211) may include only one of the first region (210D) or the second region (210E). In some embodiments, the front plate (202) may not include the first region (210D) and the second region (210E), and may only include a flat plane arranged parallel to the second surface (210B). In the embodiments, when viewed from the side of the electronic device (200), the side bezel structure (218) may have a first thickness (or width) on the side that does not include the first region (210D) or the second region (210E), and a second thickness that is thinner than the first thickness on the side that includes the first region (210D) or the second region (210E).
[0079] According to one embodiment, the electronic device (200) may include at least one of a display (201), an audio module (203, 207, 214), a sensor module (204, 219), a camera module (205, 212, 213), a key input device (217), an indicator (not shown), and a connector (208). In some embodiments, the electronic device (200) may omit at least one of the components (e.g., a key input device (217), or an indicator) or additionally include other components.
[0080] The display (201) may be exposed, for example, through a significant portion of the front plate (202). In some embodiments, at least a portion of the display (201) may be exposed through the front plate (202) forming the first surface (210A) and the first area (210D) of the side (210C). In some embodiments, the corners of the display (201) may be formed to be largely identical to the adjacent outer shape of the front plate (202). In other embodiments (not shown), to expand the area where the display (201) is exposed, the gap between the outer edge of the display (201) and the outer edge of the front plate (202) may be formed to be largely identical.
[0081] In another embodiment (not shown), a recess or opening may be formed in a part of the screen display area of the display (201), and at least one of an audio module (214), a sensor module (204), and a camera module (205) may be included that are aligned with said recess or said opening. In another embodiment (not shown), at least one of an audio module (214), a sensor module (204), and a camera module (205) may be included on the back surface of the screen display area of the display (201). In another embodiment (not shown), the display (201) may be combined with or adjacent to a touch detection circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer that detects a magnetic field type stylus pen. In some embodiments, at least a portion of the sensor module (204, 219) and / or at least a portion of the key input device (217) may be placed in the first area (210D) and / or the second area (210E).
[0082] The audio module (203, 207, 214) may include a microphone hole (203) and a speaker hole (207, 214). A microphone for acquiring external sound may be placed inside the microphone hole (203), and in some embodiments, a plurality of microphones may be placed to detect the direction of sound. The speaker hole (207, 214) may include an external speaker hole (207) and a receiver hole (214) for calls. In some embodiments, the speaker hole (207, 214) and the microphone hole (203) may be implemented as a single hole, or a speaker may be included without the speaker hole (207, 214) (e.g., a piezo speaker).
[0083] The sensor module (204, 219) can generate an electrical signal or data value corresponding to an internal operating state of the electronic device (200) or an external environmental state. The sensor module (204, 219) may include, for example, a first sensor module (204) (e.g., proximity sensor) and / or a second sensor module (not shown) (e.g., fingerprint sensor) disposed on a first surface (210A) of the housing (210), and / or a third sensor module (219) (e.g., HRM sensor) disposed on a second surface (210B) of the housing (210). The fingerprint sensor may be placed on the first side (210A) (e.g., display (201)) of the housing (210) as well as on the second side (210B). The electronic device (200) may further include at least one of a sensor module not illustrated, e.g., a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor (204).
[0084] The camera modules (205, 212, 213) may include a first camera module (205) disposed on a first surface (210A) of the electronic device (200), a second camera module (212) disposed on a second surface (210B), and / or a flash (213). The camera modules (205, 212) may include one or more lenses, an image sensor, and / or an image signal processor. The flash (213) may include, for example, a light-emitting diode or a xenon lamp. In some embodiments, two or more lenses (wide-angle lenses, ultra-wide-angle lenses, or telephoto lenses) and image sensors may be disposed on one surface of the electronic device (200).
[0085] A key input device (217) may be placed on a side (210C) of the housing (210). In another embodiment, the electronic device (200) may not include some or all of the aforementioned key input devices (217), and the key input device (217) not included may be implemented in other forms, such as soft keys, on the display (201). In another embodiment, the key input device (217) may be implemented using a pressure sensor included in the display (201). In some embodiments, the key input device may include a sensor module placed on a second side (210B) of the housing (210).
[0086] The indicator may be placed, for example, on a first surface (210A) of the housing (210). The indicator may, for example, provide status information of the electronic device (200) in the form of light. In another embodiment, the light-emitting element may, for example, provide a light source that is coupled with the operation of the camera module (205). The indicator may include, for example, an LED, an IR LED, and a xenon lamp.
[0087] The connector hole (208) may include a first connector hole (208) capable of receiving a connector (e.g., a USB connector) for transmitting and receiving power and / or data with an external electronic device, and / or a second connector hole (or earphone jack) capable of receiving a connector for transmitting and receiving audio signals with an external electronic device.
[0088] According to various embodiments, a second camera module (212) disposed on a second surface (210B) of an electronic device (200) (e.g., the electronic device (101) of FIG. 1a) may include at least one of a first camera (212a), a second camera (212b), a third camera (212c), and a fourth camera (212c). For example, the first camera (212a) may include a first image sensor (e.g., the image sensor (183) of FIG. 1b). For example, the second camera (212b) may include a second image sensor (e.g., the image sensor (183) of FIG. 1b). For example, the third camera (212c) may include a third image sensor (e.g., the image sensor (183) of FIG. 1b). For example, the fourth camera (212d) may include a fourth image sensor (e.g., the image sensor (183) of FIG. 1b).
[0089] According to one embodiment, the first camera (212a) may be an ultra-wide camera providing a first magnification (e.g., about 0.5x). The second camera (212b) may be a wide camera providing a second magnification (e.g., about 1.0x). The third camera (212c) may be a first telescope camera providing a third magnification (e.g., about 3.0x). The fourth camera (212d) may be a second telescope camera providing a fourth magnification (e.g., about 5.0x to 100x). For example, the first camera (212a) to the fourth camera (212d) may have different zoom magnifications applied depending on the zoom-in and zoom-out operations on the preview image. For example, the preview image obtained through the first camera (212a) to the fourth camera (212d) can be enlarged or reduced according to zoom-in and zoom-out operations. For example, the first camera (212a) to the fourth camera (212d) can be switched and used according to zoom-in and zoom-out operations for the preview image.
[0090] According to one embodiment, the display (201) may include a touch screen display. For example, the display (201) may include the display module (160) disclosed in FIG. 1a.
[0091] FIG. 3a is a schematic diagram showing a camera used according to a zoom array of a camera module according to one embodiment of the present invention.
[0092] For example, FIG. 3a may be a drawing for illustrating an embodiment in which the first camera (212a), second camera (212b), third camera (212c) and fourth camera (212d) disclosed in FIG. 2b are used when zooming in by about 0.5 to 100 times. For example, the zoom operation may include at least one of zoom in and zoom out operations.
[0093] Referring to FIG. 3a, the first camera (212a) can be used when a zoom operation is performed to a range of about 0.5x to about 1.0x. The second camera (212b) can be used when a zoom operation is performed to a range of about 1.0x to about 3.0x. The third camera (212c) can be used when a zoom operation is performed to a range of about 3.0x to about 5.0x. The fourth camera (212d) can be used when a zoom operation is performed to a range of about 5.0x to about 100x.
[0094] FIG. 3b is a schematic diagram illustrating an embodiment in which a first camera and a second camera are used according to one embodiment of the present invention.
[0095] Referring to FIG. 3b, when a zoom-in operation is performed from about 0.5x to about 3.0x, the first camera (212a) is used from about 0.5x to about 1.0x, and the second camera (212b) is used from about 1.0x to about 3.0x. For example, the first camera (212a) and the second camera (212b) can be switched and used according to the zoom-in and zoom-out operations.
[0096] According to one embodiment, the first camera (212a) may include a first characteristic. For example, the first characteristic of the first camera (212a) may include a characteristic related to at least one of a first brightness, a first color tone, a first position information, and a first angle of view. For example, the second camera (212b) may include a second characteristic. For example, the second characteristic of the second camera (212b) may include a characteristic related to at least one of a second brightness, a second color tone, a second position information, and a second angle of view. For example, the first characteristic of the first camera (212a) and the second characteristic of the second camera (212b) may be different. For example, a first preview image (e.g., the first preview image (610) of FIG. 6a) obtained through the first camera (212a) may include the first characteristic. For example, a second preview image obtained through the second camera (212b) (e.g., the second preview image (620) of FIG. 6b) may include a second characteristic. For example, the first preview image obtained through the first camera (212a) (e.g., the first preview image (610) of FIG. 6a) and the second preview image obtained through the second camera (212b) (e.g., the second preview image (620) of FIG. 6b) may differ in at least one of brightness, color tone, position information, and angle of view.
[0097] According to one embodiment, when switching from the first camera (212a) to the second camera (212b) or from the second camera (212b) to the first camera (212a), a difference may occur in at least one of brightness, color tone, position information, and field of view depending on the characteristics of the first camera (212a) and the second camera (212b) (e.g., first characteristics and second characteristics). For example, when switching from the first camera (212a) to the second camera (212b) or from the second camera (212b) to the first camera (212a), a parallax may occur between the preview images due to the physical distance, position, and / or field of view between the first camera (212a) and the second camera (212b).
[0098] According to one embodiment, an electronic device (200) according to one embodiment of the present invention (e.g., electronic device (101) of FIG. 1a) can correct an object (e.g., object image or virtual object) (e.g., brightness, color tone, position and / or angle of view) to correspond to the characteristics of the preview image of the switched camera when switching from a first camera (212a) to a second camera (212b) or when switching from a second camera (212b) to a first camera (212a).
[0099] FIG. 4a is a schematic diagram illustrating an embodiment of adjusting the magnification of a preview image using a magnification adjustment button according to an embodiment of the present invention.
[0100] Referring to FIG. 4a, the electronic device (200) may display a magnification adjustment button (410) through a touch screen display (201) (e.g., the display module (160) of FIG. 1a or the display (201) of FIG. 2a). For example, the magnification adjustment button (410) may include at least one button that can display a preview image obtained through a camera module (180) (e.g., the second camera module (212) of FIG. 2b) on the touch screen display (201) by expanding or shrinking it to at least one of a first magnification (e.g., about 1x), a second magnification (e.g., about 3x), a third magnification (e.g., about 5x), and a fourth magnification (e.g., 10x). For example, when user input (e.g., input signal) is received through at least one scale adjustment button (410) displayed on a touch screen display (201), the electronic device (200) can change the preview image to a scale corresponding to the received user input.
[0101] FIG. 4b is a schematic diagram illustrating an embodiment of adjusting the magnification of a preview image using a progress bar according to an embodiment of the present invention.
[0102] Referring to FIG. 4b, the electronic device (200) can display a progress bar (420) (e.g., an icon) through a touch screen display (201) (e.g., the display module (160) of FIG. 1a or the display (201) of FIG. 2a). For example, when a user of the electronic device (200) touches a specific location on the progress bar (420) using a finger (402) or a stylus pen, the electronic device (200) can adjust the preview image at a scale corresponding to the touch.
[0103] FIG. 4c is a schematic diagram illustrating an embodiment of adjusting the magnification of a preview image using a pinch zoom gesture according to an embodiment of the present invention.
[0104] Referring to FIG. 4c, a user of the electronic device (200) can perform a pinch-out gesture (430) and a pinch-in gesture (440) through a touch screen display (201) (e.g., the display module (160) of FIG. 1a or the display (201) of FIG. 2a). For example, when a user performs a pinch-out gesture (430) on the touch screen display (201) using fingers (402) (e.g., thumb and index finger), a preview image displayed on the touch screen display (201) can be enlarged by a ratio corresponding to the pinch-out gesture (430). For example, when a user performs a pinch-in gesture (440) on the touch screen display (201) using fingers (402) (e.g., thumb and index finger), a preview image displayed on the touch screen display (201) can be reduced by a ratio corresponding to the pinch-in gesture (440).
[0105] FIG. 5 is a block diagram schematically showing the configuration of an electronic device according to one embodiment of the present invention.
[0106] According to various embodiments, the electronic device (200) disclosed below (e.g., the electronic device (101) of FIG. 1a) may include at least some of the embodiments described in FIG. 1a to FIG. 4c. In the description of the electronic device (200) according to one embodiment of the present invention disclosed below, the same reference numerals are assigned to components that are substantially identical to the embodiments disclosed in FIG. 1a to FIG. 4c described above, and redundant descriptions of their functions may be omitted.
[0107] Referring to FIG. 5, an electronic device (200) according to one embodiment of the present invention may include a first camera (212a), a second camera (212b), an input module (150), a generative artificial intelligence model (510), a memory (130), a touch screen display (201) and / or a processor (120).
[0108] According to various embodiments, a generative artificial intelligence (AI) model (510) may be included in at least one of an electronic device (200) and a server (108) disclosed in FIG. 1a. For example, the generative artificial intelligence model (510) may include generative artificial intelligence.
[0109] According to one embodiment, the first camera (212a) can acquire a first preview image (e.g., the first preview image (610) of FIG. 6a) associated with at least one of an image and a video. For example, the first preview image (e.g., the first preview image (610) of FIG. 6a) acquired through the first camera (212a) can be transmitted to a generative artificial intelligence model (510). For example, the first camera (212a) may include a first characteristic. For example, the first characteristic of the first camera (212a) may include at least one of a first brightness, a first color tone, a first position information, and a first field of view. For example, a first preview image (e.g., the first preview image (610) of FIG. 6a) obtained through the first camera (212a) may include at least one of a first brightness, a first color tone, first position information, and a first angle of view corresponding to the first characteristic.
[0110] According to one embodiment, the second camera (212b) can acquire a second preview image (e.g., the second preview image (620) of FIG. 6b) associated with at least one of an image and a video. For example, the second preview image (e.g., the second preview image (620) of FIG. 6b) acquired through the second camera (212b) can be transmitted to a generative artificial intelligence model (510). For example, the second camera (212b) may include a second characteristic. For example, the second characteristic of the second camera (212b) may include at least one of a second brightness, a second color tone, a second position information, and a second field of view, which is different from the first characteristic of the first camera (212a). For example, a second preview image (e.g., the second preview image (620) of FIG. 6b) obtained through the second camera (212b) may include at least one of a second brightness, a second color tone, second position information, and a second angle of view corresponding to the second characteristic.
[0111] According to one embodiment, a first preview image (e.g., the first preview image (610) of FIG. 6a) obtained through a first camera (212a) and a second preview image (e.g., the second preview image (620) of FIG. 6b) obtained through a second camera (212b) may differ in at least one of brightness, color tone, position, and angle of view. The first characteristic and the second characteristic may be changed based on the occurrence of a transition between the first camera (212a) and the second camera (212b). The first camera (212a) and the second camera (212b) may be operated according to the execution of a camera application installed in the electronic device (200). For example, a first preview image obtained through the first camera (212a) (e.g., the first preview image (610) of FIG. 6a) and a second preview image obtained through the second camera (212b) (e.g., the second preview image (620) of FIG. 6b) can be displayed through a touch screen display (201).
[0112] According to one embodiment, the input module (150) may receive user input related to an object (e.g., the first object image (611) of FIG. 6A) to be added to and / or created in the first preview image (e.g., the first preview image (610) of FIG. 6A). For example, the input module (150) may receive information input by a user of the electronic device (200) regarding an object (e.g., the first object image (611) of FIG. 6A) that the user wishes to create and / or add to the first preview image (e.g., the first preview image (610) of FIG. 6A). For example, the input related to the object (e.g., the first object image (611) of FIG. 6A) to be added to the first preview image (e.g., the first preview image (610) of FIG. 6A) may include at least one of text, drawing, image, and voice. For example, information related to an object input through the input module (150) (e.g., the first object image (611) of FIG. 6a) can be transmitted to a generative artificial intelligence model (510).
[0113] According to various embodiments, the input module (150) may receive commands and / or data to be used for components of the electronic device (200) (e.g., a generative artificial intelligence model (510) and / or a processor (120)) from outside the electronic device (200). For example, the input module (150) may include a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen). For example, text and / or images among the information related to an object (e.g., the first object image (611) of FIG. 6a) to be added to a first preview image (e.g., the first preview image (610) of FIG. 6a) may be received through at least one of a mouse, a keyboard and a digital pen, drawings may be received through a mouse or a digital pen, and voice may be received through a microphone.
[0114] According to one embodiment, a generative artificial intelligence model (510) can generate an object (e.g., the first object image (611) of FIG. 6a) based on information (e.g., user input information) related to an object (e.g., the first object image (611) of FIG. 6a) received through an input module (150) and / or a touch screen display (201). For example, the generative artificial intelligence model (510) can be trained and / or learned to generate at least one object based on at least one user input among text input, drawing input, image input, and voice input received through an input module (150) and / or a touch screen display (201). For example, the generative artificial intelligence model (510) can generate an object (e.g., the first object image (611) of FIG. 6a) based on user input (e.g., text input, drawing input, image input, and / or voice input). For example, the generative artificial intelligence model (510) can display the generated object (e.g., the first object image (611) of FIG. 6a) and the first preview image (e.g., the first preview image (610) of FIG. 6a) on the touch screen display (201). For example, the generative artificial intelligence model (510) can generate a prompt using at least one of the first preview image (e.g., the first preview image (610) of FIG. 6a) transmitted through the first camera (212a) and the second preview image (e.g., the second preview image (620) of FIG. 6b) transmitted through the second camera (212b). For example, the generative artificial intelligence model (510) can generate a prompt based on user input information received through the input module (150) and / or the touch screen display (201).For example, the generative artificial intelligence (510) can generate a prompt for use in the generative artificial intelligence model (510) based on user input for generating an object (e.g., the first object image (611) of FIG. 6a) transmitted through the input module (150) and / or the touch screen display (201). For example, the generative artificial intelligence model (510) can be trained and / or learned to generate a prompt based on at least one of text input, drawing input, image input, and voice input.
[0115] According to various embodiments, the generative artificial intelligence (510) model may generate a plan and / or prompt for performing a task based on information transmitted through at least one of the input module (150), the touch screen display (201), the first camera (212a), and the second camera (212b). For example, the plan and / or prompt may be generated by a system based on the generative artificial intelligence model (510). For example, the system based on the generative artificial intelligence model (510) may include a rule-based system, a neural network-based system (e.g., a feed-forward neural network (FNN)) and / or a recurrent neural network (RNN) system. For example, plans and / or prompts may be selected from a predefined data set or may be generated in real time in response to a user request (e.g., user input via the input module (150) and / or touch screen display (201)). For example, the generative artificial intelligence model (510) may select at least one of a plurality of predefined plans and prompts. For example, the generative artificial intelligence model (510) may generate a new object (e.g., the first object image (611) of FIG. 6a) in response to the plan and / or prompt. The plans and / or prompts may include commands and / or instructions that process information (e.g., user input) input via the input module (150) and / or touch screen display (201) for use by the generative artificial intelligence model (510).
[0116] According to various embodiments, the generative artificial intelligence model (510) may transmit to the processor (120) an object (e.g., the first object image (611) of FIG. 6a) generated in response to information (e.g., user input) input through the input module (150) and / or the touch screen display (201) and / or a first preview image (e.g., the first preview image (610) of FIG. 6a) transmitted through the first camera (212a). For example, the object (e.g., the first object image (611) of FIG. 6a) generated in response to information (e.g., user input) input through the input module (150) and / or the touch screen display (201) may be stored in memory (130). For example, the generative artificial intelligence model (510) may not generate an object or object image (e.g., the first object image (611) of FIG. 6a) for each of multiple frames of the first camera (212a), but may generate an object or object image (e.g., the first object image (611) of FIG. 6a) for one frame of the first camera (212a).
[0117] According to various embodiments, the generative artificial intelligence model (510) may include a model (e.g., artificial intelligence) trained or learned using an artificial intelligence algorithm. For example, the generative artificial intelligence model (510) may include a model trained or learned using at least one of machine learning, neural networks, genes, deep learning, and classification algorithms. For example, the generative artificial intelligence model (510) may be implemented based on machine learning, a neural network (NN), or an artificial neural network (ANN). For example, an artificial neural network may include a computational model implemented in software or hardware that mimics the computational capabilities of a biological system using a plurality of artificial neurons connected through connecting lines.
[0118] According to one embodiment, the processor (120) can extract and manage information related to an object (e.g., the first object image (611) of FIG. 6a) generated through the generative artificial intelligence model (510). For example, the processor (120) can compare an object (e.g., the first object image (611) of FIG. 6a) transmitted through the generative artificial intelligence model (510) with a first preview image (e.g., the first preview image (610) of FIG. 6a) obtained through the first camera (212a). For example, the generative artificial intelligence model (510) can generate an image containing an object (e.g., the first object image (611) of FIG. 6a) within the first preview image (e.g., the first preview image (610) of FIG. 6a). For example, the processor (120) can compare a first preview image (e.g., the first preview image (610) of FIG. 6A) obtained through the first camera (212a) with a result image (e.g., the first preview image (610) of FIG. 6A) containing an object (e.g., the first object image (611) of FIG. 6A) generated through the generative artificial intelligence model (510). For example, if it is confirmed that the transition from the first camera (212a) to the second camera (212b) is made, the processor (120) can correct (e.g., change and / or transform) the object generated through the generative artificial intelligence model (510) (e.g., the first object image (611) of FIG. 6A) into an object corresponding to the second characteristic of the second camera (212b) (e.g., the second object image (621) of FIG. 6c). There is. For example, the processor (120) can combine the corrected object (e.g., the second object image (621) of FIG. 6c) and the second preview image (e.g., the second preview image (620) of FIG. 6b).For example, expressions related to correction disclosed in this specification may include the meaning of changing, altering, or modifying an object (e.g., the first object image (611) of FIG. 6a) into another object (e.g., the second object image (621) of FIG. 6c). For example, the object disclosed in this specification may include an object image or a virtual object.
[0119] According to one embodiment, the processor (120) can acquire a first preview image (e.g., the first preview image (610) of FIG. 6A) through the first camera (212a). For example, the processor (120) can receive user input (e.g., text, drawing, image and / or voice) to create an object (e.g., the first object image (611) of FIG. 6A) within the first preview image (e.g., the first preview image (610) of FIG. 6A) through a touch screen display (201). For example, the processor (120) can create an object (e.g., the first object image (611) of FIG. 6A) based on the user input through a generative artificial intelligence model (510). For example, the processor (120) can display the generated object (e.g., the first object image (611) of FIG. 6a) within the first preview image (e.g., the first preview image (610) of FIG. 6a) through the touch screen display (201). For example, the processor (120) can acquire a second preview image (e.g., the second preview image (620) of FIG. 6b) through the second camera (212b) based on confirmation that the first camera (212a) is switched to the second camera (212b). For example, the processor (120) can correct the generated object (e.g., the first object image (611) of FIG. 6a) based on the second characteristics of the second camera (212b). For example, the processor (120) can display the corrected object (e.g., the second object image (621) in FIG. 6c) within the second preview image (e.g., the second preview image (620) in FIG. 6b) through the touch screen display (201).
[0120] According to various embodiments, the processor (120) may be electrically or operatively connected to the first camera (212a), the second camera (212b), the input module (150), the generative artificial intelligence model (510), the memory (130), and / or the touch screen display (201). The processor (120) may control the functions and operations of the first camera (212a), the second camera (212b), the input module (150), the generative artificial intelligence model (510), the memory (130), and / or the touch screen display (201). The processor (120) may be configured to access the memory (130) to execute at least one instruction. The electronic device (200) may include at least one processor (120). For example, the processor (120) may include a central processing unit (CPU), a single core processor, a multi-core processor, an application processor, a communication processor, a micro-processor unit (MPU) and / or a data processing unit (DPU).
[0121] According to various embodiments, an operation performed in the electronic device (101) may be performed and / or executed by at least one instruction stored in the processor (120) and / or memory (130). For example, in this document, an embodiment in which the electronic device (101) can perform any operation may be interpreted to mean that it is performed by at least one instruction stored in the processor (120) and / or memory (130). For example, at least one instruction stored in memory (130) may be executed individually or collectively by the processor (120).
[0122] According to one embodiment, the memory (130) may store at least one object and / or object image (e.g., the first preview image (610) of FIG. 6a) generated through the generative artificial intelligence model (510), and at least one piece of information transmitted through the processor (120). For example, the memory (130) may store an image acquired by at least one of the first camera (212a) and the second camera (212b). For example, the memory (130) may store a first characteristic associated with the first camera (212a) and a second characteristic associated with the second camera (212b). For example, the memory (130) may store at least one prompt generated by the generative artificial intelligence model (510) to correspond to information (e.g., user input information) input through the input module (150) and / or the touch screen display (201). For example, memory (130) may store images provided via an external electronic device (e.g., external electronic device (102, 104) of FIG. 1a) and / or a server (e.g., server (108) of FIG. 1a). Memory (130) may store executable instructions. For example, memory (130) may include one or more storage media for storing instructions. For example, memory (130) may store at least one instruction that causes the electronic device (200) to perform at least one operation when executed individually or collectively by at least one processor (120). For example, at least one instruction may be stored on a computer-readable recording medium. The recording medium may be tangible and non-transitory. The memory (130) and / or the recording medium may store one or more programs containing at least one instruction.
[0123] According to various embodiments, the memory (130) may store an initial screen, a settings screen, and / or various applications of the electronic device (200) provided through a touch screen display (201). The memory (130) may store a user interface (UI) capable of providing various services to the user of the electronic device (200). The memory (130) may perform the function of storing a program for processing and controlling the processor (120) (e.g., the program (140) of FIG. 1a), an operating system (e.g., the operating system (142) of FIG. 1a), various applications, and input / output data. The memory (130) may store a program that controls the overall operation of the electronic device (200). The memory (130) may store various settings information required for function processing in the electronic device (200).
[0124] According to one embodiment, a touch screen display (201) can display an object (e.g., the first object image (611) of FIG. 6a) generated using a generative artificial intelligence model (510) and a first preview image (e.g., the first preview image (610) of FIG. 6a) obtained using a first camera (212a). For example, the touch screen display (201) can receive user input (e.g., text, drawing, image and / or voice) to generate an object (e.g., the first object image (611) of FIG. 6a) within the first preview image (e.g., the first preview image (610) of FIG. 6a). For example, the touch screen display (201) can display an object generated based on user input (e.g., the first object image (611) of FIG. 6a) in the first preview image (e.g., the first preview image (610) of FIG. 6a). For example, the touch screen display (201) can display a second preview image (e.g., the second preview image (620) of FIG. 6b) obtained using the second camera (212b) when switching from the first camera (212a) to the second camera (212b). For example, the touch screen display (201) can use the processor (120) to display a corrected object (e.g., the second object image (621) in FIG. 6c) from an object (e.g., the first object image (611) in FIG. 6a) and a second preview image (e.g., the second preview image (620) in FIG. 6b) obtained through the second camera (212b). For example, the touch screen display (201) can display the corrected object (e.g., the second object image (621) in FIG. 6c) within the second preview image (e.g., the second preview image (620) in FIG. 6b).For example, the touch screen display (201) can display at least one of a first preview image (e.g., the first preview image (610) of FIG. 6a) obtained through the first camera (212a) and a second preview image (e.g., the second preview image (620) of FIG. 6b) obtained through the second camera (212b). The touch screen display (201) can display at least one image stored in the memory (130).
[0125] According to various embodiments, the touch screen display (201) can perform input and display functions. For example, the touch screen display (201) may include a touch panel (e.g., a touch circuit) and a display unit. The touch panel (e.g., a touch circuit) can detect and / or detect at least one of a user's touch signal input to the display unit, zoom in and zoom out signals, a pinch-out gesture (430), and a pinch-in gesture (440). For example, the touch panel (e.g., a touch sensor) may be composed of a touch sensing sensor such as a capacitive overlay, a resistive overlay, or an infrared beam, or may be composed of a pressure sensing sensor. In addition to the sensors described above, various sensors capable of detecting contact or pressure of an object (e.g., a finger or a stylus pen) may be composed of the touch panel. For example, the display unit includes at least one of a Liquid Crystal Display (LCD), Organic Light Emitting Diodes (OLED), and Active Matrix Organic Light Emitting Diodes (AMOLED), and can visually provide various information to the user, such as a menu of the electronic device (200), input data, or function setting information.
[0126] FIG. 6a is a schematic diagram showing a first image including a first preview image and a first object image according to an embodiment of the present invention. FIG. 6b is a schematic diagram showing a second preview image and a first object image displayed on a touch screen display when a first camera is switched to a second camera according to an embodiment of the present invention. FIG. 6c is a schematic diagram showing a second image including a second preview image and a second object image according to an embodiment of the present invention.
[0127] Referring to FIG. 6a, a touch screen display (201) may display a first image (601) including a first preview image (610) obtained through a first camera (212a) and an object (611) generated through a generative artificial intelligence model (510) (e.g., a first object image (611)). For example, the first preview image (610) may include at least one of a first brightness, a first color tone, first position information, and a first field of view corresponding to a first characteristic of the first camera (212a).
[0128] According to one embodiment, the first camera (212a) may be switched to the second camera (212b) based on the selection (e.g., user input) of the user of the electronic device (200). For example, the first camera (212a) may be switched to the second camera (212b) using at least one of the magnification button (410) disclosed in FIG. 4a, the progress bar (420) disclosed in FIG. 4b, and the pinch-out gesture (430) and pinch-in gesture (440) disclosed in FIG. 4c. For example, the first camera (212a) may be switched to the second camera (212b) or the magnification may be changed based on a drag operation in a first direction (e.g., left) or a second direction (e.g., right) through the progress bar (420) disclosed in FIG. 4b.
[0129] Referring to FIG. 6b, when switching from the first camera (212a) to the second camera (212b), the touch screen display (201) can display the second preview image (620) and object (611) (e.g., the first object image (611)) obtained through the second camera (212b).
[0130] According to one embodiment, the second preview image (620) may include at least one of a second brightness, a second color tone, a second position (e.g., second position information), and a second field of view corresponding to the second characteristic of the second camera (212b). For example, the first characteristic of the first camera (212a) (e.g., the first preview image (610)) and the second characteristic of the second camera (212b) (e.g., the second preview image (620)) may be different from each other.
[0131] Referring to FIG. 6c, when switching from the first camera (212a) to the second camera (212b), the touch screen display (201) may display a second preview image (620) containing an object (621) (e.g., a second object image (621)) corrected to correspond to a second characteristic of the second camera (212b) (e.g., a second preview image (620)).
[0132] According to one embodiment, when switching from the first camera (212a) to the second camera (212b), the processor (120) can correct the object (621) (e.g., the first object image (611)) generated using the generative artificial intelligence model (510) into an object (621) (e.g., the second object image (621)) corresponding to the second characteristic of the second camera (212b) (e.g., the second preview image (620)). For example, when switching from the first camera (212a) to the second camera (212b), the touch screen display (201) can display the corrected object (621) (e.g., the second object image (621)) and the second preview image (620). For example, the touch screen display (201) may display the corrected object (621) (e.g., the second object image (621)) in the second preview image (620). For example, when switching from the first camera (212a) to the second camera (212b), the processor (120) may display a second image (602) in which the corrected object (621) (e.g., the second object image (621)) and the second preview image (620) are combined through the display (201).
[0133] FIG. 7a is a schematic diagram illustrating a first image including a first preview image and a first object image according to various embodiments of the present invention. FIG. 7b is a schematic diagram illustrating a second preview image and a first object image displayed on a touch screen display when a first camera is switched to a second camera according to various embodiments of the present invention. FIG. 7c is a schematic diagram illustrating a second image including a second preview image and a first object image according to various embodiments of the present invention.
[0134] Referring to FIG. 7a, a touch screen display (201) may display a first image (601) including a first preview image (610) obtained through a first camera (212a) and an object (611) generated through a generative artificial intelligence model (510) (e.g., a first object image (611)). For example, the first preview image (610) may include at least one of a first brightness, a first color tone, a first position (e.g., first position information) and a first field of view corresponding to a first characteristic of the first camera (212a).
[0135] According to one embodiment, the first camera (212a) may be switched to the second camera (212b) according to the selection (e.g., user input) of the user of the electronic device (200). For example, the first camera (212a) may be switched to the second camera (212b) using at least one of a first direction (e.g., left) or a second direction (e.g., right) drag operation using the magnification button (410) disclosed in FIG. 4a and the progress bar (420) disclosed in FIG. 4b, and a pinch-out gesture (430) and a pinch-in gesture (440) disclosed in FIG. 4c.
[0136] Referring to FIG. 7b, when switching from the first camera (212a) to the second camera (212b), the display position of the second preview image (620) and object (611) (e.g., the first object image (611)) obtained using the second camera (212b) may be changed.
[0137] According to one embodiment, the second preview image (620) may include at least one of a second brightness, a second color tone, a second position (e.g., second position information), and a second field of view corresponding to the second characteristic of the second camera (212b). For example, the first characteristic of the first camera (212a) (e.g., the first preview image (610)) and the second characteristic of the second camera (212b) (e.g., the second preview image (620)) may be different from each other.
[0138] Referring to FIG. 7c, when switching from the first camera (212a) to the second camera (212b), the processor (120) can change the display position of the second preview image (620) and the object (611) (e.g., the first object image (611)) and display them on the touch screen display (201).
[0139] According to one embodiment, when switching from the first camera (212a) to the second camera (212b), the processor (120) can correct the position of an object (611) (e.g., the first object image (611)) generated through a generative artificial intelligence model (510) to a position corresponding to a second characteristic of the second camera (212b) (e.g., the second preview image (620)). For example, when switching from the first camera (212a) to the second camera (212b), the touch screen display (201) can display the object (611) (e.g., the first object image (611)) and the second preview image (620) with the corrected position. For example, when switching from the first camera (212a) to the second camera (212b), the processor (120) can display a second image (602) in which the position-corrected object (611) (e.g., the first object image (611)) and the second preview image (620) are combined through the touch screen display (201).
[0140] FIG. 8a is a schematic diagram illustrating an embodiment in which a first preview image obtained using a first camera and a second preview image obtained using a second camera are displayed on a touch screen display according to an embodiment of the present invention. FIG. 8b is a schematic diagram illustrating an embodiment in which a first object image is generated on the first preview image according to an embodiment of the present invention. FIG. 8c is a schematic diagram illustrating an embodiment in which the position of the first object image is changed according to the movement of an electronic device according to an embodiment of the present invention. FIG. 8d is a schematic diagram illustrating an embodiment in which a first object image is displayed on the first preview image and the second preview image according to an embodiment of the present invention.
[0141] Referring to FIG. 8a, the electronic device (200) can display a first preview image (610) obtained through a first camera (212a) and a second preview image (620) obtained through a second camera (212b) on a touch screen display (201).
[0142] According to one embodiment, the first camera (212a) may include a first characteristic related to at least one of a first brightness, a first color tone, a first position (e.g., first position information), and a first angle of view. For example, the second camera (212b) may include a second characteristic related to at least one of a second brightness, a second color tone, a second position (e.g., second position information), and a second angle of view. For example, the angle of view of the second camera (212b) (e.g., second angle of view) may be wider than the angle of view of the first camera (212a) (e.g., first angle of view). For example, the first preview image (610) obtained through the first camera (212a) may be displayed in the center of the touch screen display (201). For example, the second preview image (620) obtained through the second camera (212b) may be displayed on the first side (e.g., left direction) and the second side (e.g., right direction) of the touch screen display (201). For example, the second preview image (620) may be displayed on both sides of the first preview image (610).
[0143] Referring to FIG. 8b, the touch screen display (201) can display an object (611) (e.g., a first object image (611)) generated through a generative artificial intelligence model (510) on a first preview image (610) obtained through a first camera (212a).
[0144] According to one embodiment, while an object (611) (e.g., a first object image (611)) is displayed on a first preview image (610), the electronic device (200) can be moved in one direction (e.g., a second direction or a right direction) according to a user's selection (e.g., user input).
[0145] Referring to FIG. 8c, when an object (611) (e.g., first object image (611)) is displayed on a first preview image (610) and the electronic device (200) is moved in one direction (e.g., second direction or right direction), a part of the object (611) (e.g., first object image (611)) (e.g., second part (611b) in FIG. 8d) may be displayed on a second preview image (620).
[0146] Referring to FIG. 8d, when an object (611) (e.g., a first object image (611)) is displayed on a first preview image (610) and an electronic device (200) is moved in one direction (e.g., a second direction or a right direction), a first part (611a) of the object (611) (e.g., a first object image (611)) may be displayed on the first preview image (610), and a second part (611b) may be displayed on the second preview image (620).
[0147] According to one embodiment, the processor (120) can correct a second part (611b) of an object (611) (e.g., a first object image (611)) displayed on a second preview image (620) into an object (620) (e.g., a second object image (620)) corresponding to a second characteristic (e.g., a second brightness and / or color tone) of a second camera (212a) (e.g., a second preview image (620)). For example, referring to FIG. 8d, an object (611) displayed on a first preview image (610) (e.g., a first part (611a) of the first object image (611) may be displayed on a touch screen display (201) with a first brightness and / or a first color tone, and a second part (611b) may be displayed on a touch screen display (201) with a second brightness and / or a second color tone.
[0148] FIG. 9a is a schematic diagram showing a state in which a first object image generated using a generative artificial intelligence model is displayed on a first preview image according to one embodiment of the present invention. FIG. 9b is a schematic diagram showing an embodiment in which the size of the first preview image and the first object image is changed based on a zoom operation according to various embodiments of the present invention.
[0149] Referring to FIG. 9a, the touch screen display (201) can display a first preview image (610) obtained through the first camera (212a) and an object (611) generated using a generative artificial intelligence model (510) (e.g., the first object image (611)).
[0150] According to one embodiment, the electronic device (200) can adjust the size of a first preview image (610) and an object (611) (e.g., a first object image (611)) displayed on a touch screen display (201) based on user input using at least one of a drag motion in a first direction (e.g., left) or a second direction (e.g., right) through a scale adjustment button (410) disclosed in FIG. 4a and a progress bar (420) disclosed in FIG. 4b, and a pinch-out gesture (430) and a pinch-in gesture (440) disclosed in FIG. 4c.
[0151] Referring to FIG. 9b, when a user input (e.g., input signal) related to changing the magnification (e.g., zoom in) is received using at least one of the magnification adjustment button (410) disclosed in FIG. 4a, the progress bar (420) disclosed in FIG. 4b, and the pinch-out gesture (430) and pinch-in gesture (440) disclosed in FIG. 4c, the electronic device (200) can enlarge the size of the first preview image (610) and object (611) (e.g., first object image (611)) displayed on the touch screen display (201).
[0152] FIG. 10a is a schematic diagram showing a state in which a first object image generated using a generative artificial intelligence model is displayed on a first preview image according to various embodiments of the present invention. FIG. 10b is a schematic diagram showing a second preview image and a second object image displayed on a touch screen display when the first camera is switched to a second camera according to various embodiments of the present invention.
[0153] Referring to FIG. 10a, the touch screen display (201) can display a first preview image (610) obtained through the first camera (212a) and an object (611) generated through the generative artificial intelligence model (510) (e.g., the first object image (611)).
[0154] According to one embodiment, the electronic device (200) can enlarge the size of a first preview image (610) and an object (611) (e.g., a first object image (611)) displayed on a touchscreen display (201) and switch the first camera (212a) to a second camera (212b) based on user input related to changing the magnification (e.g., zoom in) using at least one of a drag operation in a first direction (e.g., left) or a second direction (e.g., right) through a magnification button (410) disclosed in FIG. 4a and a progress bar (420) disclosed in FIG. 4b, and a pinch-out gesture (430) and a pinch-in gesture (440) disclosed in FIG. 4c.
[0155] Referring to FIG. 10b, when switching from the first camera (212a) to the second camera (212b), the electronic device (200) (e.g., processor (120)) can correct the object (611) (e.g., first object image (611)) generated using the generative artificial intelligence model (510) into an object (621) (e.g., second object image (621)) corresponding to the second characteristics (e.g., second brightness, second color tone, second position and / or second angle of view) of the second camera (212b) (e.g., second brightness, second color tone, second position and / or second angle of view). For example, when switching from the first camera (212a) to the second camera (212b), the touch screen display (201) can enlarge and display the corrected object (621) (e.g., the second object image (621)) and the second preview image (620).
[0156] FIG. 11a is a schematic diagram showing a first object image and a second object image generated through a generative artificial intelligence model according to an embodiment of the present invention. FIG. 11b is a schematic diagram showing an embodiment in which a second object generated through a generative artificial intelligence model is reflected in a second preview image according to an embodiment of the present invention.
[0157] According to one embodiment, a generative artificial intelligence model (510) may pre-generate an object (611) (e.g., a first object image (611)) corresponding to a first characteristic of a first camera (212a) and an object (621) (e.g., a second object image (621)) corresponding to a second characteristic of a second camera (212b). For example, the object (611) (e.g., a first object image (611)) corresponding to the first characteristic and the object (621) (e.g., a second object image (621)) corresponding to the second characteristic of the second camera (212b) may be different from each other. For example, an object (611) (e.g., a first object image (611)) generated through a generative artificial intelligence model (510) and an object (621) (e.g., a second object image (621)) different from the object (611) (e.g., a first object image (611)) can be stored in memory (130). For example, an object (621) (e.g., a second object image (621)) generated in advance through a generative artificial intelligence model (510) can be reflected in a second preview image (620) when switching from a first camera (212a) to a second camera (212b). For example, if a pre-generated object (621) (e.g., second object image (621)) through a generative artificial intelligence model (510) is reflected in the second preview image (620) when switching from the first camera (212a) to the second camera (212b), the time required to correct the object (611) (e.g., first object image (611)) into another object (621) (e.g., second object image (621)) corresponding to the second characteristic of the second camera (212b) can be reduced.
[0158] According to one embodiment, a generative artificial intelligence model (510) can generate an object (611) (e.g., a first object image (611)) corresponding to a first characteristic of a first camera (212a) and an object (621) (e.g., a second object image (621)) corresponding to a second characteristic of a second camera (212b) based on information (e.g., user input) input through an input module (150) and / or a touch screen display (201), and then store the depth values of the object (611) (e.g., the first object image (611)) and the object (621) (e.g., the second object image (621)) which is different from the object (611) in a memory (130). For example, the processor (120) can calculate an estimated value of how much the object (621) (e.g., the second object image (621)) moves in the second preview image (620) when switching from the first camera (212a) to the second camera (212b) based on calibration data based on the physical position and / or angle of view difference between the first camera (212a) and the second camera (212b), and apply it to the second object image (621) displayed on the second preview image (620).
[0159] Referring to FIG. 11a, the touch screen display (201) can display a first preview image (610) obtained through the first camera (212a) and an object (611) generated through the generative artificial intelligence model (510) (e.g., the first object image (611)). For example, an object (621) (e.g., the second object image (621)) corresponding to the second characteristic of the second camera (212b) (e.g., the second preview image (620)) can be generated in advance through the generative artificial intelligence model (510) and then stored in memory (130).
[0160] According to one embodiment, the first camera (212a) may be switched to the second camera (212b) according to the selection (e.g., user input) of the user of the electronic device (200). For example, the first camera (212a) may be switched to the second camera (212b) using at least one of the magnification button (410) disclosed in FIG. 4a, a drag operation in a first direction (e.g., left) or a second direction (e.g., right) through the progress bar (420) disclosed in FIG. 4b, and the pinch-out gesture (430) and pinch-in gesture (440) disclosed in FIG. 4c.
[0161] Referring to FIG. 11b, when switching from the first camera (212a) to the second camera (212b), the second preview image (620) and the position-corrected object (621) (e.g., the second object image (621)) obtained using the second camera (212b) can be displayed through the touch screen display (201).
[0162] According to one embodiment, the processor (120) can apply a pre-generated object (621) (e.g., a second object image (621)) through a generative artificial intelligence model (510) to a location corresponding to a second characteristic of a second camera (212b) (e.g., a second preview image (620)).
[0163] FIG. 12a is a schematic diagram showing a display screen of a slideable electronic device according to various embodiments of the present invention. FIG. 12b is a schematic diagram showing an expanded screen of a slideable electronic device according to various embodiments of the present invention.
[0164] According to various embodiments, at least one embodiment disclosed in FIGS. 1a to 11b can be substantially applied and integrated into the slideable electronic device (1200) disclosed in FIGS. 12a and 12b.
[0165] Referring to FIG. 12a, a slideable electronic device (1200) can display a first preview image (1210) obtained through a first camera (212a) using a display (1201). For example, the display (1201) may include the touch screen display (201) described above. For example, the display (1201) may include a flexible display.
[0166] Referring to FIG. 12b, when the slideable electronic device (1220) is slid out (e.g. unfolded), the display (1201) may be unfolded to have an extended area (1205). For example, the display (1201) may be unfolded in a second direction (e.g. to the right) to have an extended area (1205). For example, when the display (1201) is unfolded to have an extended area (1205), the first camera (212a) may be switched to the second camera (212b). For example, when the first camera (212a) is switched to the second camera (212b), the second preview image (1220) obtained using the second camera (212b) may be displayed in the extended area (1205) of the display (1201). For example, the extended area (1205) of the display (1201) may include an object (611) (e.g., a first object image (611)) generated by a generative artificial intelligence model (510). For example, the second preview image (1220) and the object (611) (e.g., a first object image (611)) displayed in the extended area (1205) of the display (1201) may be corrected to correspond to a first characteristic of the first camera (212a).
[0167] According to various embodiments, when the display (1201) is unfolded to have an extended area (1205), the first camera (212a) may be switched to the second camera (212b). For example, when the first camera (212a) is switched to the second camera (212b), the second preview image (1220) obtained through the second camera (212b) may be displayed on the entire screen of the display (1201). For example, while the first preview image (1210) obtained through the first camera (212a) is displayed on the display (1201), if an object (611) (e.g., the first object image (611)) generated through the generative artificial intelligence model (510) is added to the extended area (1205), the first camera (212a) may be switched to the second camera (212b). For example, when switching from the first camera (212a) to the second camera (212b), the processor (120) may correct the object (611) (e.g., the first object image (611)) generated through the generative artificial intelligence model (510) into another object corresponding to the second characteristic of the second camera (212b). For example, the memory (130) may store the first object corresponding to the first characteristic of the first camera (212a) and / or the second object corresponding to the second characteristic of the second camera (212b), and when switching between the first camera (212a) and the second camera (212b), the stored first object or second object may be displayed on the display (1201).
[0168] FIG. 13 is a flowchart schematically illustrating a method for processing an image using an electronic device according to one embodiment of the present invention.
[0169] The method disclosed below may include, for example, at least one embodiment disclosed in FIGS. 1a to 12b. The method disclosed below may be applied, for example, to the embodiments disclosed in FIGS. 1a to 12b. For example, the method disclosed below may perform operations related to at least one embodiment disclosed in FIGS. 1a to 12b, not limited to the operations described below. In the embodiments related to the method disclosed below, each operation may be performed sequentially, but may not necessarily be performed sequentially. For example, the order of each operation may be changed. For example, the order of each operation may be performed in parallel. For example, each operation may not be performed all, but at least some may be performed. The operations disclosed below may be performed by at least one instruction stored in the processor (120) and / or memory (130) of the electronic device (200).
[0170] In operation 1310, the electronic device (200) can acquire a first preview image (610) through the first camera (212a).
[0171] In operation 1320, the electronic device (200) can receive user input to create an object (611) (e.g., a first object image (611)) within a first preview image (610) through a touch screen display (201).
[0172] In operation 1330, the electronic device (200) can generate an object (611) (e.g., a first object image (611)) based on user input received through the touch screen display (201) via a generative artificial intelligence model (510).
[0173] According to one embodiment, a generative artificial intelligence model (510) can be trained and / or learned to generate at least one object based on text input, drawing input and image input.
[0174] In operation 1340, the electronic device (200) can display the generated object (611) (e.g., the first object image (611)) within the first preview image (610) through the touch screen display (201).
[0175] In operation 1350, the electronic device (200) can check whether the first camera (212a) is switched to the second camera (212b).
[0176] In operation 1360, the electronic device (200) can acquire a second preview image (620) through the second camera (212b) based on confirmation that the first camera (212a) is switched to the second camera (212b).
[0177] In operation 1370, the electronic device (200) can correct the generated object (611) (e.g., first object image (611)) into another object (621) (e.g., second object image (621)) based on the second characteristic of the second camera (212b).
[0178] In operation 1380, the electronic device (200) can display the corrected object (621) (e.g., the second object image (621)) in the second preview image (620) through the touch screen display (201).
[0179] An electronic device (200) according to one embodiment of the present invention may include a touch screen display (201), a first camera (212a) having a first characteristic and a second camera (212b) having a second characteristic, at least one processor (120), and a memory (130) for storing instructions. According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (120), the electronic device (200) acquires a first preview image (610) through the first camera (212a), receives user input to create an object (611) (e.g., a first object image (611)) within the first preview image (610) through the touch screen display (201), creates the object (611) (e.g., a first object image (611)) based on the user input through a generative artificial intelligence model (510) trained to create at least one object based on text input, drawing input, or image input, displays the created object (611) (e.g., a first object image (611)) within the first preview image (610) through the touch screen display (201), and the first Based on the confirmation that the camera (212a) is switched to the second camera (212b), a second preview image (620) is obtained through the second camera (212b), the object (611) is corrected based on the second characteristic of the second camera (212b), and the corrected object (621) can be displayed in the second preview image (620) through the touch screen display (201).
[0180] According to one embodiment, the first characteristic includes at least one of the first brightness, first color tone, first position information, and first angle of view of the first camera (212a), and the second characteristic includes at least one of the second brightness, second color tone, second position information, and second angle of view of the second camera (212b), provided that the first characteristic may be different from the second characteristic.
[0181] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (120), the electronic device (200) may store the object (611) (e.g., the first object image (611)) generated using the generative artificial intelligence model (510) in the memory (130).
[0182] According to one embodiment, the electronic device (200) may further include at least one of an input module (150) and a microphone. According to one embodiment, the user input may include at least one of text input, drawing input, and voice input.
[0183] According to one embodiment, the generative artificial intelligence model (510) may be configured to generate a prompt based on the user input for generating the object (611) (e.g., the first object image (611)). According to one embodiment, the generative artificial intelligence model (510) may be trained to generate the prompt based on at least one of text input, drawing input, and voice input.
[0184] According to one embodiment, the generative artificial intelligence model (510) may be included in at least one of the electronic device (200) and the server (108).
[0185] According to one embodiment, when the first camera (212a) is switched to the second camera (212b), it may include at least one of zoom-in and zoom-out.
[0186] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (120), the electronic device (200) may adjust the size of the corrected object (621) (e.g., the second object image (621)) to correspond to a change in size of the second preview image (620) based on confirmation that the first camera (212a) is switched to the second camera (212b).
[0187] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (120), the electronic device (200) may adjust at least one of the brightness and color tone of the corrected object (621) (e.g., the second object image (621)) to correspond to at least one change in the brightness and color tone of the second preview image (620), based on confirmation that the first camera (212a) is switched to the second camera (212b).
[0188] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (120), the electronic device (200) may adjust the position of the corrected object (621) (e.g., the second object image (621)) to correspond to a change in the position of the second preview image (620) based on confirmation that the first camera (212a) is switched to the second camera (212b).
[0189] A method for processing an image using an electronic device (200) according to one embodiment of the present invention may include the operation of acquiring a first preview image (610) through a first camera (212a) having a first characteristic. According to one embodiment, the method may include the operation of receiving user input to create an object (611) (e.g., a first object image (611)) within the first preview image (610) through a touch screen display (201). According to one embodiment, the method may include the operation of creating the object (611) (e.g., a first object image (611)) based on the user input through a generative artificial intelligence model (510) trained to create at least one object based on text input, drawing input, or image input. According to one embodiment, the method may include an operation of displaying the generated object (611) (e.g., the first object image (611)) within the first preview image (610) through a touch screen display (201). According to one embodiment, the method may include an operation of checking whether the first camera (212a) is switched to a second camera (212b) having a second characteristic. According to one embodiment, the method may include an operation of acquiring a second preview image (620) through the second camera (212b) based on the confirmation that the first camera (212a) is switched to the second camera (212b). According to one embodiment, the method may include an operation of correcting the object (611) based on the second characteristic of the second camera (212b). According to one embodiment, the method may include the operation of displaying the corrected object (621) (e.g., the second object image (621)) within the second preview image (620) through the touch screen display (201).
[0190] According to one embodiment, the first characteristic includes at least one of the first brightness, first color tone, first position information, and first angle of view of the first camera (212a), and the second characteristic includes at least one of the second brightness, second color tone, second position information, and second angle of view of the second camera (212b), provided that the first characteristic may be different from the second characteristic.
[0191] According to one embodiment, the method may further include the operation of storing the object (611) (e.g., the first object image (611)) generated through the generative artificial intelligence model (510) in memory (130).
[0192] According to one embodiment, the electronic device (200) further includes at least one of an input module (150) and a microphone, and the user input may include at least one of text input, drawing input, and voice input.
[0193] According to one embodiment, the method further includes the operation of generating a prompt based on the user input for generating the object (611) (e.g., the first object image (611)), wherein the generative artificial intelligence model (510) may be trained to generate the prompt based on at least one of text input, drawing input, and voice input.
[0194] According to one embodiment, the generative artificial intelligence model (510) may be included in at least one of an electronic device (200) and a server (108).
[0195] According to one embodiment, when the first camera (212a) is switched to the second camera (212b), it may include at least one of zoom-in and zoom-out.
[0196] According to one embodiment, the method may further include an operation to adjust the size of the corrected object (621) (e.g., the second object image (621)) to correspond to a change in size of the second preview image (620) based on confirmation that the first camera (212a) is switched to the second camera (212b).
[0197] According to one embodiment, the method may further include an operation of adjusting at least one of the brightness and color tone of the corrected object (621) (e.g., the second object image (621)) to correspond to at least one of the change in brightness and color tone of the second preview image (620), based on confirmation that the first camera (212a) is switched to the second camera (212b).
[0198] According to one embodiment, the method may further include an operation of adjusting the position of the corrected object (621) (e.g., the second object image (621)) to correspond to a change in the position of the second preview image (620) based on confirmation that the first camera (212a) is switched to the second camera (212b).
[0199] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0200] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0201] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0202] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0203] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0204] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0205] The embodiments of the present disclosure disclosed in this specification and drawings are merely specific examples provided to facilitate the explanation of the technical content according to the embodiments of the present disclosure and to aid in understanding the embodiments of the present disclosure, and are not intended to limit the scope of the embodiments of the present disclosure. Accordingly, the scope of an embodiment of the present disclosure should be interpreted as including all modifications or variations derived based on the technical features of an embodiment of the present disclosure, in addition to the embodiments disclosed herein.
Claims
1. In an electronic device (200), touch screen display (201); A first camera (212a) having a first characteristic and a second camera (212b) having a second characteristic; At least one processor (120); and It includes a memory (130) for storing instructions, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (200), A first preview image (610) is obtained through the first camera (212a), and Through the touch screen display (201), user input for creating an object (611) within the first preview image (610) is received, and The object (611) based on the user input is generated through a generative artificial intelligence model (510) trained to generate at least one object based on text input, drawing input, or image input, and The generated object (611) is displayed within the first preview image (610) through the touch screen display (201), and Based on the confirmation that the first camera (212a) is switched to the second camera (212b), a second preview image (620) is obtained through the second camera (212b), and Correcting the object (611) based on the second characteristic of the second camera (212b), and An electronic device that displays the corrected object (621) within the second preview image (620) through the touch screen display (201).
2. In Paragraph 1, The first characteristic above includes at least one of the first brightness, first color tone, first position information, and first field of view of the first camera (212a), and The second characteristic includes at least one of the second brightness, second color tone, second position information, and second field of view of the second camera (212b), wherein The above first characteristic is an electronic device different from the above second characteristic.
3. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (200), An electronic device that stores the object (611) generated using the above generative artificial intelligence model (510) in the memory (130).
4. In Paragraph 1, It further includes at least one of an input module (150) and a microphone, and The above user input is an electronic device comprising at least one of text input, drawing input, and voice input.
5. In Paragraph 1, The above generative artificial intelligence model (510) is configured to generate a prompt based on the user input for generating the object image (611), and the generative artificial intelligence model (510) is an electronic device trained to generate the prompt based on at least one of text input, drawing input, and voice input.
6. In Paragraph 1, The above generative artificial intelligence model (510) is an electronic device included in at least one of the electronic device (200) and the server (108).
7. In Paragraph 1, An electronic device comprising at least one of zoom-in and zoom-out when the first camera (212a) is switched to the second camera (212b).
8. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (200), An electronic device that adjusts the size of the corrected object (621) to correspond to a change in the size of the second preview image (620) based on confirmation that the first camera (212a) is switched to the second camera (212b).
9. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (200), An electronic device that adjusts at least one of the brightness and color tone of the corrected object (621) to correspond to a change in at least one of the brightness and color tone of the second preview image (620), based on confirmation that the first camera (212a) is switched to the second camera (212b).
10. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (200), An electronic device that adjusts the position of the corrected object (621) to correspond to a position change of the second preview image (620) based on confirmation that the first camera (212a) is switched to the second camera (212b).
11. A method for processing an image using an electronic device (200), The operation of acquiring a first preview image (610) through a first camera (212a) having a first characteristic; The operation of receiving user input to create an object (611) within the first preview image (610) through a touch screen display (201); The operation of generating the object (611) based on the user input through a generative artificial intelligence model (510) trained to generate at least one object based on text input, drawing input, or image input; The operation of displaying the generated object (611) within the first preview image (610) through the touch screen display (201); An operation to check whether the first camera (212a) is switched to a second camera (212b) having a second characteristic; An operation of acquiring a second preview image (620) through the second camera (212b) based on confirmation that the first camera (212a) is switched to the second camera (212b); An operation to correct the object (611) based on the second characteristic of the second camera (212b); and A method including the operation of displaying the corrected object (621) within the second preview image (620) through the touch screen display (201).
12. In Paragraph 11, The first characteristic above includes at least one of the first brightness, first color tone, first position information, and first field of view of the first camera (212a), and The second characteristic includes at least one of the second brightness, second color tone, second position information, and second field of view of the second camera (212b), wherein The above first characteristic is a method different from the above second characteristic.
13. In Paragraph 11, A method further comprising the operation of storing the object (611) generated using the above-mentioned generative artificial intelligence model (510) in memory (130).
14. In Paragraph 11, It further includes at least one of an input module (150) and a microphone, and The above user input includes at least one of text input, drawing input, and voice input.
15. In Paragraph 11, A method in which the generative artificial intelligence model (510) further includes an operation of generating a prompt based on the user input for generating the object (611), wherein the generative artificial intelligence model (510) is trained to generate the prompt based on at least one of text input, drawing input, and voice input.