Electronic device and control method thereof

Abstract

An electronic device according to an embodiment of the present disclosure may comprise: a display; one or more processors; and a memory electrically connected to the one or more processors and configured to store instructions. The instructions, when individually or collectively executed by the one or more processors, may cause the electronic device to: generate a first prompt corresponding to user request information; generate a second prompt on the basis of advertisement information and the first prompt; and output, on the display, an image based on the second prompt. The image is generated by a generative artificial intelligence model and may include a background screen corresponding to the user request information and an advertisement element corresponding to the advertisement information.

Description

Electronic device and control method thereof

[0001] The various embodiments disclosed in this document relate to electronic devices and methods for controlling the same.

[0002] With the advancement of electronic technology, electronic devices providing various functions are being developed. For example, electronic devices including displays (hereinafter referred to as display devices) have been continuously evolving over the past few years as they are used in various locations such as homes, offices, and public spaces.

[0003] A display device can output various content, including photos and videos, to a screen (or display). For example, the display device can perform a function similar to a picture frame by providing images such as masterpieces, landscapes, or photographs as backgrounds.

[0004] In providing these functions, the display device may provide a pre-stored existing image as a wallpaper, or provide a new image generated by a generative artificial intelligence (AI) model in response to a user's request as a wallpaper.

[0005] Generally, generative AI models used for generating wallpapers are provided by service providers other than the manufacturers of display devices. Consequently, if a user wishes to generate a new wallpaper using a generative AI model, the user must pay a separate fee to use the said model. Otherwise, when using the generative AI model, certain features or usage limits regarding wallpaper generation may be restricted.

[0006] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0007] An electronic device according to one embodiment of the present disclosure may include a display, one or more processors, and a memory electrically connected to the one or more processors and configured to store instructions. When the instructions are executed individually or collectively by the one or more processors, the electronic device may be configured to generate a first prompt in response to user request information, generate a second prompt based on advertising information and the first prompt, and output an image based on the second prompt to the display. The image may be generated by a generative artificial intelligence model and may include a background image corresponding to the user request information and an advertising element corresponding to the advertising information.

[0008] A control method for an electronic device according to one embodiment of the present disclosure may include an operation of generating a first prompt in response to user request information, an operation of generating a second prompt based on advertising information and the first prompt, and an operation of outputting an image based on the second prompt to a display. The image may be generated by a generative artificial intelligence model and may include a background image corresponding to the user request information and an advertising element corresponding to the advertising information.

[0009] However, the problems to be solved in this disclosure are not limited to those mentioned above, and may be determined in various ways without departing from the spirit and scope of this disclosure.

[0010] FIG. 1 is a front view of an electronic device according to one embodiment of the present disclosure.

[0011] FIG. 2 is a control block diagram of an electronic device according to one embodiment of the present disclosure.

[0012] FIG. 3 is a control flowchart of an electronic device according to one embodiment of the present disclosure.

[0013] FIGS. 4 and 5 are schematic diagrams illustrating a series of processes for generating and / or outputting a background image of an electronic device containing advertising elements using a generative artificial intelligence model according to one embodiment of the present disclosure.

[0014] FIGS. 6 and 7 are schematic diagrams illustrating a series of processes for generating and / or outputting a background image of an electronic device containing advertising elements using a generative artificial intelligence model according to one embodiment of the present disclosure.

[0015] In the following description, the attached drawings are referenced, and specific examples of implementation are illustrated within the drawings. Additionally, other examples may be used and structural modifications may be made without departing from the scope of the various examples.

[0016] The terms used in this document are used merely to describe specific embodiments and are not intended to limit the technical features of this document. For example, a component expressed in the singular form should be understood as a concept including singular or plural components unless the context clearly indicates only the singular form.

[0017] In this document, each of the following phrases may include any one of the items listed with the corresponding phrase, or any combination thereof: "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C." The term "and / or" as used in this document should be understood to encompass any possible combination of one or more of the multiple items listed with the corresponding term. Terms such as "first," "second," "first," or "second" as used in this document may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order).

[0018] Where it is stated that any (e.g., 1st) component is “coupled,” “connected,” “linked,” “coupled,” “supported,” “connected,” or “contacted” with or without the terms “functionally” or “communicationly,” it includes not only cases where the component is directly coupled, connected, linked, coupled, supported, or contacted with the other component, but also cases where it is indirectly coupled, connected, linked, coupled, supported, or contacted through a third component.

[0019] Terms such as "include" or "have" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in this Document, and do not preclude the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof. When a component is said to be located "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where another component exists between the two components.

[0020] As used in this document, the expression "configured to..." may be appropriately substituted depending on the context, for example, with "suitable for...", "capable of...", "designed to...", "modified to...", "made to...", or "capable of...". The term "configured to..." does not necessarily mean only that it is "specially designed" in hardware. Instead, in some situations, the expression "device configured to..." may mean that the device is "capable of..." in conjunction with other devices or components. For example, the phrase "device configured (or set) to perform A, B, and C" may refer to a device dedicated to performing the said operation, or it may refer to a general-purpose device capable of performing various operations, including the said operation.

[0021] Terms such as "upper side," "lower side," and "front-rear direction" used in this document are defined based on the drawings, and the shape and location of each component are not limited by these terms.

[0022] The description in this document is centered on specific embodiments, but this document is not limited to such specific embodiments and should be understood to encompass all various modifications, equivalents, and / or substitutions of the various embodiments described in this document. In relation to the description of the drawings, similar reference numerals may be used for similar or related components.

[0023] FIG. 1 is a front view of an electronic device (100) according to one embodiment of the present disclosure.

[0024] According to one embodiment, the electronic device (100) may include a TV, a monitor, a video wall, a large format display (LFD), digital signage, a digital information display (DID), or a projector display. For example, the electronic device (100) may be understood as an electronic device having a display function. The electronic device (100) may be named a display device.

[0025] According to one embodiment, an electronic device (100) can receive various compressed images or / and images of various resolutions (hereinafter referred to as images). For example, the electronic device (100) can receive images in a compressed form such as MPEG (Moving Picture Experts Group) (e.g., MP2, MP4, MP7, etc.), JPEG (joint photographic coding experts group), AVC (Advanced Video Coding), H.264, H.265, HEVC (High Efficiency Video Codec), etc. For example, the electronic device (100) can receive any one of SD (Standard Definition), HD (High Definition), FHD (Full HD), and UHD (Ultra HD) images.

[0026] According to one embodiment, an electronic device (100) can perform various image processing based on the characteristics of a received image. Here, the image may be a digital image. A digital image refers to an image that has been converted from an analog image through processes such as sampling, quantization, and coding. A digital image can be distinguished by arranging each pixel in a two-dimensional form using coordinates or matrix positions. Image processing may include at least one of image enhancement, image restoration, image transformation, image analysis, image understanding, or image compression.

[0027] According to one embodiment, only a portion of the entire display area of ​​the electronic device (100) is used as an area for playing advertising content, and a background image (or background screen) may be provided in the remaining area. In one embodiment, the entire display area of ​​the electronic device (100) is provided as a background image (hereinafter, background screen), and an advertising element (or advertising object) may be included as an object (or object) within the background image. The position, size, and output form (e.g., text, image, video) of the advertising content or advertising element displayed on the electronic device (100) may be changed based on user input (or user request), etc.

[0028] According to one embodiment, the electronic device (100) can provide various wallpapers.

[0029] For example, the electronic device (100) may provide an image such as a masterpiece, landscape, or photograph that is stored in advance within the electronic device (100) as a background image, or may provide an image received from an external device (e.g., user terminal device, network device, server device) as a background image. Additionally, the electronic device (100) may, in response to a user's request, generate a new image by a generative artificial intelligence model and provide the generated image as a background image. A method for providing an image generated by the generative artificial intelligence model as a background image will be described later with reference to FIG. 3 and below.

[0030] FIG. 2 is a control block diagram of an electronic device (100) according to one embodiment of the present disclosure.

[0031] Referring to FIG. 2, an electronic device (100) according to one embodiment may include a memory (110), a processor (120), a microphone (130), a communication interface (140), a user interface (150), and a display (160).

[0032] However, such configurations are exemplary, and it is understood that new configurations may be added or some configurations omitted in addition to such configurations when implementing the present disclosure.

[0033] According to one embodiment, the memory (110) may include hardware that stores information, such as data, in an electrical or magnetic form so that a processor (120) or the like can access it. For example, the memory (110) may include at least one of non-volatile memory, volatile memory, flash memory, hard disk drive (HDD) or solid-state drive (SSD), RAM, ROM, etc.

[0034] According to one embodiment, at least one instruction regarding an electronic device (100) may be stored in the memory (110). For example, at least one instruction required for the operation of the electronic device (100) or the processor (120) may be stored in the memory (110). Here, the instruction is a unit of code that directs the operation of the electronic device (100) or the processor (120), and may be written in machine language, which is a language that a computer can understand. Alternatively, a plurality of instructions that perform a specific task of the electronic device (100) or the processor (120) may be stored in the memory (110) as an instruction set.

[0035] According to one embodiment, an O / S (Operating System) for driving an electronic device (100) may be stored in the memory (110).

[0036] According to one embodiment, various software programs or applications for an electronic device (100) to operate according to various embodiments of the present disclosure may be stored in the memory (110).

[0037] According to one embodiment, various software modules for operating an electronic device (100) according to various embodiments of the present disclosure may be stored in the memory (110). A processor (120) may control the operation of the electronic device (100) by executing the various software modules stored in the memory (110).

[0038] According to one embodiment, data in bit or byte units that can represent characters, numbers, images, etc., may be stored in the memory (110). For example, user characteristic information (or user personal information), advertising information, or a generative artificial intelligence model may be stored in the memory (110). The user characteristic information may include the user's personal information, such as gender, age, occupation, physical information, and hobbies. The advertising information may include a list of multiple advertisers, advertising product information (e.g., product name, product image), advertising request details (e.g., a third prompt). The generative artificial intelligence may correspond to an image-generating artificial intelligence based on a neural network model that generates an image corresponding to the prompt in response to the input prompt.

[0039] According to one embodiment, the memory (110) can be accessed by a processor (120), and data reading / writing / modification / deletion / updating, etc. by the processor (120) can be performed.

[0040] According to one embodiment, the processor (120) can control the overall operation of the electronic device (100). Specifically, the processor (120) can control the overall operation of the electronic device (100) by being connected to the configuration of the electronic device (100) including the microphone (130) and memory (110) as described above.

[0041] According to one embodiment, at least one processor (120) may include one or more of a CPU, a GPU (Graphics Processing Unit), an APU (Accelerated Processing Unit), a MIC (Many Integrated Core), a NPU (Neural Processing Unit), a hardware accelerator, or a machine learning accelerator. At least one processor (120) may control one or any combination of other components of the electronic device (100) and may perform operations or data processing related to communication. At least one processor (120) may execute one or more programs or instructions (e.g., instructions) stored in memory. For example, at least one processor (120) may perform a method according to one embodiment of the present disclosure by executing one or more instructions stored in memory (110).

[0042] In the case where a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor (120) or by a plurality of processors (120). For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, all of the first operation, the second operation, and the third operation may be performed by a first processor. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence dedicated processor).

[0043] According to one embodiment, at least one processor (120) may be implemented as a single-core processor including one core, or as one or more multicore processors including a plurality of cores (e.g., homogeneous multicore or heterogeneous multicore). When at least one processor (120) is implemented as a multicore processor, each of the plurality of cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by the plurality of cores may be included in the multicore processor. Additionally, each of the plurality of cores included in the multicore processor (or some of the plurality of cores) may independently read and execute program instructions for implementing the method according to one embodiment of the present disclosure, or all (or some) of the plurality of cores may be linked together to read and execute program instructions for implementing the method according to one embodiment of the present disclosure.

[0044] According to one embodiment, at least one processor (120) may refer to a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor. Here, the core may be implemented as a CPU, GPU, APU, MIC, NPU, hardware accelerator, or machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. However, for convenience of explanation, the operation of the electronic device (100) is described below using the expression "processor (120)."

[0045] According to one embodiment, the processor (120) may generate a prompt (e.g., a second prompt) for generating a wallpaper based on advertising information and / or received user input. The prompt is a command input to a generative artificial intelligence model, and the wallpaper generated by the generative artificial intelligence model based on the prompt may include an object corresponding to the user input and an object corresponding to the advertising information.

[0046] According to one embodiment, the processor (120) may generate a first prompt for generating a wallpaper corresponding to a user request based on user voice received by the microphone (130). Alternatively, the processor (120) may generate a first prompt for generating a wallpaper corresponding to a user request based on input (e.g., text) received by an external device (e.g., user terminal, remote control). The first prompt is a prompt used in the process of generating a second prompt described below, which is input to a generative artificial intelligence model, and may include a user request regarding a wallpaper generated by the generative artificial intelligence model. The first prompt may be named a user prompt. The first prompt may include, for example, an image (e.g., a photo, a video) that is stored in advance in the electronic device (100).

[0047] According to one embodiment, the processor (120) can generate a second prompt to be input into a generative artificial intelligence model based on the generated first prompt and advertisement information. For example, the processor (120) can combine advertisement information with the first prompt to generate a second prompt for generating a wallpaper containing advertisement elements. The second prompt is a prompt to be input into the generative artificial intelligence model and may be named the final prompt.

[0048] In one embodiment, the processor (120) may generate a second prompt based on a first prompt and an advertising request (e.g., a third prompt) among the aforementioned advertising information. The advertising request may include content previously requested by an advertiser, such as the size, position, and orientation of an advertising element to be reflected on a background screen generated by a generative artificial intelligence model. The advertising request may be named an advertising prompt. In this case, the second prompt may be generated based on the first prompt and the third prompt.

[0049] As described above, a generative AI model for generating a wallpaper is stored in the memory (110) of an electronic device (100) and can be accessed by a processor (120). In this case, a prompt generated by the processor (120) (e.g., a second prompt) is input into the generative AI model stored in the memory (110), and a wallpaper corresponding to the prompt can be output to the display (160) of the electronic device (100). In this way, the method of using a generative AI model stored in the electronic device (100) can be named On-Device AI.

[0050] Generally, a generative AI model for generating a wallpaper is stored in an external device (e.g., a network device, a server device) and can transmit and receive data with a processor (120) through a communication interface (140). In this case, a prompt generated by the processor (120) (e.g., a second prompt) is transmitted to the generative AI model stored in the external device through the communication interface (140), and the generative AI model generates a wallpaper corresponding to the received prompt and then transmits the generated wallpaper to an electronic device (100), so that the wallpaper can finally be displayed on the display (160) of the electronic device (100). In this way, the method of using a generative AI model from an external device can be named cloud-based AI.

[0051] According to one embodiment, the microphone (130) is configured to receive sound (e.g., user voice) and convert it into an audio signal. The microphone (130) is electrically connected to the processor (120) and can receive sound under the control of the processor (120). In one embodiment, the microphone (130) can receive user voice according to the user's speech, and the received user voice can be used to generate a prompt (e.g., a first prompt) for generating a background screen.

[0052] According to one embodiment, the microphone (130) may be formed as an integrated unit on the upper side, front side, or side side of the electronic device (100). Alternatively, the microphone (130) may be provided with an external device (e.g., a remote control) separate from the electronic device (100). In this case, the remote control may receive sound through the microphone (130) and provide the received sound to the electronic device (100).

[0053] According to one embodiment, the microphone (130) may include various configurations such as a microphone for collecting analog sound, an amplifier circuit for amplifying the collected sound, an A / D conversion circuit for sampling the amplified sound and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0054] Meanwhile, the microphone (130) may be implemented in the form of a sound sensor, and any configuration capable of collecting sound is acceptable.

[0055] According to one embodiment, the communication interface (140) is configured to communicate with various types of external devices according to various types of communication methods. For example, an electronic device (100) can communicate with an external device (e.g., a remote control, a user terminal device) or a server (not shown) through the communication interface (140). The communication interface (140) may be named a communication unit.

[0056] In particular, in various embodiments according to the present disclosure, the communication interface (140) performs a communication connection with an external device or server and can receive information regarding a background screen, advertisement information, prompt, etc. from the external device or server.

[0057] According to one embodiment, the communication interface (140) may include a Wi-Fi module, a Bluetooth module, an infrared communication module, and a wireless communication module, etc. Here, each communication module may be implemented in the form of at least one hardware chip.

[0058] According to one embodiment, the Wi-Fi module and the Bluetooth module perform communication using the Wi-Fi method and the Bluetooth method, respectively. When using the Wi-Fi module or the Bluetooth module, various connection information, such as SSID and session key, is transmitted and received first, and after establishing a communication connection using this information, various information can be transmitted and received. The infrared communication module performs communication according to infrared communication (IrDA, infrared Data Association) technology, which wirelessly transmits data over short distances using infrared rays located between visual light and millimeter waves.

[0059] According to one embodiment, in addition to the communication method described above, the wireless communication module supports Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5 소 It may include at least one communication chip that performs communication according to various wireless communication standards, such as Generation).

[0060] According to one embodiment, the communication interface (140) may include a wired communication interface such as HDMI, DP, Thunderbolt, USB, RGB, D-SUB, DVI, etc.

[0061] In addition, the communication interface (140) may include at least one of a LAN (Local Area Network) module, an Ethernet module, or a wired communication module that performs communication using a pair cable, a coaxial cable, or a fiber optic cable.

[0062] According to one embodiment, the user interface (150) receives user interaction input for controlling the overall operation of the electronic device (100). Specifically, the user interface (160) may be composed of components such as a camera (not shown), a microphone (130), and a remote control signal receiver. Meanwhile, the user interface (150) may be implemented as a touch screen included in the display (160). Since the microphone (130) has been described as a separate component, a redundant description is omitted. The user interface (150) may be named an input unit.

[0063] According to one embodiment, the display (160) is configured to display an image and can be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, a PDP (Plasma Display Panel), etc. The display (160) may also include a driving circuit, a backlight unit, etc., which can be implemented in forms such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc. Meanwhile, the display (150) can be implemented as a touch screen combined with a touch sensor, a flexible display, a 3D display, etc.

[0064] Hereinafter, with reference to FIG. 3, a method for generating and outputting a wallpaper containing an advertisement (or an advertisement element) using a generative artificial intelligence model is described.

[0065] FIG. 3 is a control flowchart of an electronic device (100) according to one embodiment of the present disclosure.

[0066] FIG. 3 is a control flowchart for generating a wallpaper containing advertising elements through generative artificial intelligence in response to a user's request regarding wallpaper generation and outputting the same.

[0067] The embodiment of FIG. 3 can be optionally combined with the embodiments of FIG. 1 and FIG. 2.

[0068] Referring to FIG. 3, in operation 310, the electronic device (100) can generate a first prompt corresponding to user request information. For example, the electronic device (100) can generate the first prompt based on user voice obtained through the microphone (130). For example, the electronic device (100) can receive input regarding a user request from a user interface (150) or an external device (e.g., user terminal, remote control) and generate the first prompt based on said input. The first prompt can be understood as a prompt corresponding to a user request (or command) regarding the creation of a wallpaper.

[0069] According to one embodiment, in operation 320, the electronic device (100) can generate a second prompt based on advertising information and a first prompt. For example, the electronic device (100) can combine advertising information with the first prompt to generate a second prompt that includes user request information regarding wallpaper creation and advertising information.

[0070] According to one embodiment, the electronic device (100) may select advertising information to be combined with the first prompt during the process of generating the second prompt. For example, the advertising information may include a list of multiple advertisers and information regarding an advertising target (e.g., an advertising product) corresponding to each advertiser. For example, the advertising information included in the second prompt may include brand advertising text, brand-related video, brand-related audio, etc. The advertising information may be provided, for example, from an external device (e.g., an operating server).

[0071] In one embodiment, the electronic device (100) may, in the process of generating a second prompt, select advertising information corresponding to an advertiser selected by the user from a plurality of advertising lists and combine the selected advertising information with the first prompt to generate the second prompt. At this time, the electronic device (100) may obtain information regarding the advertiser selected by the user from at least one of a microphone (130), a user interface (150), and an external device (e.g., a remote control, a user terminal).

[0072] According to one embodiment, the electronic device (100) can select advertising information to be combined with the first prompt by considering the sentence components of the first prompt during the process of generating the second prompt. For example, the electronic device (100) can analyze the subject, predicate, or object, which are the sentence components of the first prompt, and select an advertiser among a list of multiple advertisers that has a high degree of relevance to the subject, predicate, or object of the first prompt. Accordingly, the electronic device (100) can generate the second prompt by combining advertising information corresponding to the selected advertiser with the first prompt. For example, if the first prompt is "create a background image of a puppy playing on the grass," advertising information regarding an advertising target (e.g., a pet supply company) that has a high degree of relevance to the subject "puppy" (e.g., a pet supply company) among a list of multiple advertisers, such as a pet supply product (e.g., a leash), can be combined with the first prompt. Accordingly, the electronic device (100) can generate a second prompt, for example, “Generate a background image of a leashed puppy playing on the grass.”

[0073] According to one embodiment, the advertising information may include a third prompt regarding the creation of advertising elements. The third prompt may be a prompt regarding a detailed request from an advertiser regarding advertising elements included in a background image generated by a generative artificial intelligence model. For example, the advertiser may pre-set a prompt regarding a detailed request for advertising elements to be included in the background image, such as the size, location, and display method (e.g., image, video, text) of an advertising target, on an electronic device (100), an external device (e.g., user terminal), or a server. In one embodiment, the electronic device (100) may create a second prompt based on a first prompt based on a user request and a third prompt based on an advertiser request during the process of creating a second prompt. For example, if the first prompt is "create a background image of a puppy playing on the grass" and the third prompt is "expose a Coca-Cola product image in the center," the electronic device (100) can combine the first prompt and the third prompt to create a second prompt of "create a background image of a puppy playing on the grass with a Coca-Cola product image positioned in the center."

[0074] According to one embodiment, in operation 330, the electronic device (100) may generate a wallpaper based on a second prompt generated in operation 320 using generative artificial intelligence (in the case of on-device AI). Alternatively, the electronic device (100) may transmit the second prompt generated in operation 320 to a server (or device) including generative artificial intelligence, and the generative artificial intelligence model may generate a wallpaper corresponding to a user request based on the received second prompt (in the case of cloud AI). Afterward, the server (or device) may transmit the generated wallpaper to the electronic device (100) again.

[0075] According to one embodiment, in operation 340, the electronic device (100) can output a background image generated by a generative artificial intelligence model to a display. For example, in the case of on-device AI, the processor (120) of the electronic device (100) can control the output of the generated background image to the display (160). For example, in the case of cloud AI, the electronic device (100) can receive the generated background image from an external server including a generative artificial intelligence model through a communication interface (140) and control the output of the background image to the display (160).

[0076] FIGS. 4 and 5 are schematic diagrams illustrating a series of processes for generating and / or outputting a background image of an electronic device (100) containing advertising elements using a generative artificial intelligence model according to one embodiment of the present disclosure.

[0077] The embodiments of FIGS. 4 and 5 can be optionally combined with the embodiments of FIGS. 1 to 3.

[0078] FIGS. 4 and 5 are drawings illustrating one example of generating and outputting a background image containing an advertisement by a generative artificial intelligence model based on a user's voice, but the present disclosure is not limited thereto.

[0079] Referring to FIGS. 4 and 5, a user can execute a wallpaper application of an electronic device (100) through a microphone (130) provided in the electronic device (100) or a microphone (130) provided in an external device (hereinafter, remote control). For example, the user can make a request regarding the execution of a wallpaper application, such as "change wallpaper," toward the microphone (130) of the electronic device (100) or the remote control.

[0080] The electronic device (100) may receive a request from the microphone (130) of the electronic device (100) or the remote control regarding the execution of a user's wallpaper application. The electronic device (100) may execute the wallpaper application and output a screen regarding the wallpaper application in response to the received request regarding the execution of the user's wallpaper application. For example, the electronic device (100) may output a screen (or icon) regarding the operation of the wallpaper application, such as an image creation menu and / or a settings menu of the wallpaper application, in response to the user's request regarding the execution of the wallpaper application. The image creation menu may include a "wallpaper modification menu" for utilizing existing images (e.g., photos, etc.) stored in the electronic device (100) for wallpaper creation through generative artificial intelligence, or a "wallpaper creation menu" for creating new images not stored in the electronic device (100).

[0081] The user may utter a request regarding the selection of an image creation menu of a wallpaper application toward the microphone (130) of the electronic device (100) or the remote control. For example, the user may utter a request regarding the selection of a "wallpaper creation menu" to create and / or output a new wallpaper that is not currently being output or is stored in the electronic device (100).

[0082] The user may make a request regarding the wallpaper setting towards the microphone (130) of the electronic device (100) or the remote control. For example, the user may make a request regarding the wallpaper setting towards the microphone (130) of the electronic device (100) or the remote control, such as "create a wallpaper of a puppy playing on the grass."

[0083] The electronic device (100) can obtain a user request (or voice information) regarding a wallpaper setting through a microphone (130) or a remote control, and generate a first prompt (P1) based on the obtained user request regarding a wallpaper setting. The first prompt (P1) may correspond to "creating a wallpaper of a puppy playing on the grass" corresponding to the user's speech.

[0084] The electronic device (100) can obtain advertising information (CI) corresponding to advertisers selected directly by the user or selected according to specific criteria (or conditions). For example, the electronic device (100) can obtain advertising information regarding Coca-Cola, which is one of a plurality of advertisers, as illustrated in the drawing.

[0085] The electronic device (100) can generate a second prompt (P2) for generating a background image by combining a first prompt (P1) generated according to user speech and advertising information (CI). For example, the second prompt (P2) can be generated as "Generate a background image of a dog running around with Coca-Cola on the grass" by combining the first prompt (P1), "Generate a background image of a dog running around on the grass," and the advertising information (CI), "Coca-Cola."

[0086] The electronic device (100) can transmit the generated second prompt (P2) to a generative artificial intelligence model (AI) provided in the electronic device (100) or to a generative artificial intelligence model (100) provided in an external server, etc. through a communication interface (140).

[0087] Subsequently, the generative artificial intelligence model (100) can finally generate a background image (BG) based on the second prompt (P2) received. The background image (BG) generated by the generative artificial intelligence model (100) may be divided into a background image area (BGA) corresponding to the first prompt (P1) regarding the user request, and an advertising area (CIA) containing advertising elements corresponding to advertising information (CI) (or the third prompt (P3)). When a background image is generated by the generative artificial intelligence model (100) provided in an external device, the electronic device (100) can receive the background image through communication with the external device.

[0088] Finally, the electronic device (100) can provide the user with a wallpaper combined with an advertisement by outputting the generated wallpaper to a display.

[0089] FIGS. 6 and 7 are schematic diagrams illustrating a series of processes for generating and / or outputting a background image of an electronic device (100) containing advertising elements using a generative artificial intelligence model according to one embodiment of the present disclosure.

[0090] The embodiments of FIGS. 6 and 7 can be optionally combined with the embodiments of FIGS. 1 to 5.

[0091] FIGS. 6 and 7 are drawings illustrating another example of generating and outputting a background image containing an advertisement by a generative artificial intelligence model based on a user's voice, but the present disclosure is not limited thereto.

[0092] In describing with reference to FIGS. 6 and 7, descriptions of parts that are substantially identical or similar to those described with reference to FIGS. 4 and 5 (e.g., background application call operation, etc.) will be omitted, and the explanation will focus on the differences.

[0093] Referring to FIGS. 6 and 7, the user can run a wallpaper application through the microphone (130) of the electronic device (100) or the remote control, and can make a request to select the "wallpaper modification menu" among the image creation menus of the wallpaper application in order to utilize existing images stored in the electronic device (100). Additionally, the user can select an image stored in the electronic device (100) from the "wallpaper modification menu," and the electronic device (100) can output the image selected by the user's request in response.

[0094] The user may make a request regarding the wallpaper setting toward the microphone (130) of the electronic device (100) or the remote control. For example, the user may make a request regarding the wallpaper setting toward the microphone (130) of the electronic device (100) or the remote control, such as, "Change the landscape of the selected photo to a snowy winter."

[0095] The electronic device (100) can obtain a user request (or voice information) regarding a wallpaper setting through a microphone (130) or a remote control, and generate a first prompt (P1) based on the obtained user request regarding a wallpaper setting. The first prompt (P1) may correspond to "creating a wallpaper in which the landscape of the selected photo is changed to a snowy landscape" corresponding to the user's speech.

[0096] The electronic device (100) can acquire advertising information (CI) corresponding to advertisers selected directly by the user or selected according to specific criteria (or conditions). For example, the electronic device (100) can acquire advertising information regarding a winter goods company, which is one of a plurality of advertisers, related to the season of the selected photo, as illustrated in the drawing.

[0097] The electronic device (100) can generate a second prompt (P2) for creating a wallpaper by combining a first prompt (P1) generated according to user speech and advertising information (CI). For example, the second prompt (P2) can be generated as "creating a wallpaper including a snowman wearing a scarf in a selected photo of a snowy landscape" by combining the first prompt (P1), "creating a wallpaper where the landscape of the selected photo is changed to a snowy landscape," and the advertising information (CI), "winter items (e.g., a scarf)."

[0098] The electronic device (100) can transmit the generated second prompt (P2) to a generative artificial intelligence model (AI) provided in the electronic device (100) or to a generative artificial intelligence model (100) provided in an external server, etc. through a communication interface (140).

[0099] Subsequently, the generative artificial intelligence model (100) can finally generate a background image (BG) based on the second prompt (P2) received. When a background image is generated by the generative artificial intelligence model (100) provided in an external device, the electronic device (100) can receive the background image through communication with the external device.

[0100] Unlike the above-described method of setting a wallpaper based on user voice commands, the electronic device (100) may receive a user request regarding a wallpaper in the form of text from an external device (e.g., remote control, user terminal), and may use the input text as a prompt regarding the user request for setting a wallpaper. Subsequently, the operations regarding setting a wallpaper may be applied in accordance with the above-described method of setting a wallpaper based on user voice commands.

[0101] According to one embodiment of the present disclosure, an electronic device (100) capable of outputting a background image including an advertisement, generated by a generative artificial intelligence model in response to a user request, can be provided.

[0102] According to one embodiment of the present disclosure, when generating a background image of an electronic device (100) using a generative artificial intelligence model, in addition to a user's request, by including an advertisement in the background image to be generated to realize advertising revenue, the generative artificial intelligence model can be used free of charge or usage fees can be reduced, and the functions of the generative artificial intelligence model can also be used without restriction.

[0103] An electronic device (100) according to one embodiment of the present disclosure may include a display (160), one or more processors (120), and a memory (110) electrically connected to the one or more processors (120) and configured to store instructions. When the instructions are executed individually or collectively by the one or more processors (120), the electronic device may be configured to generate a first prompt in response to user request information, generate a second prompt based on advertising information and the first prompt, and output an image based on the second prompt to the display (160). The image may be generated by a generative artificial intelligence model and may include a background image corresponding to the user request information and an advertising element corresponding to the advertising information.

[0104] According to one embodiment, the advertising information may include a third prompt for generating the advertising element. The second prompt may be generated based on the first prompt and the third prompt.

[0105] According to one embodiment, the memory (110) may include the generative artificial intelligence model configured to generate the image using a neural network model.

[0106] According to one embodiment, when the instructions are executed individually or collectively by one or more processors (120), the electronic device (100) may generate the image by the generative artificial intelligence model based on the second prompt.

[0107] According to one embodiment, the electronic device (100) may include a communication interface (140) for transmitting / receiving data with an external device including the generative artificial intelligence model.

[0108] According to one embodiment, the instructions may be configured such that, when executed individually or collectively by one or more processors (120), the electronic device (100) transmits the second prompt to the external device and receives the image generated by the generative artificial intelligence model from the external device.

[0109] According to one embodiment, the electronic device (100) may include a user interface (150) for obtaining the user request information. The user interface (150) may be a microphone (130). The user request information may include a user voice signal that can be received through the microphone (130).

[0110] According to one embodiment, the electronic device (100) may include a communication interface (140) for transmitting and receiving data with an external device. The user request information may be received from the external device through the communication interface (140).

[0111] According to one embodiment, the advertising information may include a plurality of advertiser lists and information regarding an advertiser selected by a user among the plurality of advertiser lists. An advertising element included in the image may relate to an advertiser selected by a user among the plurality of advertiser lists.

[0112] According to one embodiment, the advertising information may include a plurality of advertiser lists. When the instructions are executed individually or collectively by the one or more processors (120), the electronic device (100) may determine advertising information corresponding to an advertiser to be used when generating a second prompt among the plurality of advertiser lists by considering the subject, predicate, or object of the first prompt.

[0113] A control method for an electronic device (100) comprising a display (160), one or more processors (120), and a memory (110) according to one embodiment of the present disclosure may include an operation of generating a first prompt in response to user request information, an operation of generating a second prompt based on advertising information and the first prompt, and an operation of outputting an image based on the second prompt to the display (160). The image may be generated by a generative artificial intelligence model and may include a background image corresponding to the user request information and an advertising element corresponding to the advertising information.

[0114] According to one embodiment, the advertising information may include a third prompt for generating the advertising element. The second prompt may be generated based on the first prompt and the third prompt.

[0115] According to one embodiment, the memory (110) may include the generative artificial intelligence model configured to generate the image using a neural network model.

[0116] According to one embodiment, the control method of the electronic device (100) may include an operation of generating the image by the generative artificial intelligence model based on the second prompt.

[0117] According to one embodiment, the electronic device (100) may include a communication interface (140) for transmitting and receiving data with an external device including the generative artificial intelligence model.

[0118] According to one embodiment, a control method for the electronic device (100) may include the operation of transmitting the second prompt to the external device, and the operation of receiving the image generated by the generative artificial intelligence model from the external device.

[0119] According to one embodiment, the electronic device (100) may include a user interface (150) for obtaining the user request information. The user interface (150) may be a microphone (130). The user request information may include a user voice signal that can be received through the microphone (130).

[0120] According to one embodiment, the electronic device (100) may include a communication interface (140) for transmitting and receiving data with an external device. The user request information may be received from the external device through the communication interface (140).

[0121] According to one embodiment, the advertising information may include a plurality of advertiser lists and information regarding an advertiser selected by a user among the plurality of advertiser lists. An advertising element included in the image may relate to an advertiser selected by a user among the plurality of advertiser lists.

[0122] According to one embodiment, the advertising information may include a plurality of advertiser lists. The control method of the electronic device (100) may include an operation of determining advertising information corresponding to an advertiser to be used when generating a second prompt among the plurality of advertiser lists, by considering the subject, predicate, or object of the first prompt.

Claims

1. In an electronic device (100), Display (160); One or more processors (120); and It includes a memory (110) electrically connected to one or more processors (120) and configured to store instructions, and When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device, In response to user request information, a first prompt is generated, and Based on the advertising information and the first prompt above, a second prompt is generated, and The image based on the second prompt above is output to the display (160), and The image above is, It is generated by a generative artificial intelligence model, and A device comprising a background corresponding to the above user request information and an advertising element corresponding to the above advertising information.

2. In Paragraph 1, The above advertising information is, It includes a third prompt for generating the above-mentioned advertising element, and The above second prompt is a device generated based on the above first prompt and the above third prompt.

3. In Paragraph 1 or 2, The above memory (110) is, A device comprising a generative artificial intelligence model configured to generate the image using a neural network model.

4. In Paragraph 3, When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (100) causes, A device that generates the image by the generative artificial intelligence model based on the second prompt above.

5. In Paragraph 1 or 2, It includes a communication interface (140) for transmitting / receiving data with an external device including the above-mentioned generative artificial intelligence model, and When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (100) causes, Transmit the above second prompt to the above external device, and A device that receives the image generated by the generative artificial intelligence model from the above external device.

6. In any one of paragraphs 1 through 5, It includes a user interface (150) for obtaining the above user request information, and The above user interface (150) is a microphone (130), and The above user request information is a device that includes a user voice signal that can be received through the microphone (130).

7. In any one of paragraphs 1 through 5, It includes a communication interface (140) for transmitting / receiving data with an external device, and The above user request information is received from the external device through the communication interface (140).

8. In any one of paragraphs 1 through 7, The advertising information includes a list of multiple advertisers and information regarding an advertiser selected by a user from the list of multiple advertisers. The advertising element included in the above image is a device relating to an advertiser selected by a user from among the above list of multiple advertisers.

9. In any one of paragraphs 1 through 8, The above advertising information includes a list of multiple advertisers, and When the above instructions are executed individually or collectively by the one or more processors (120), the electronic device (100) causes, A device for determining advertising information corresponding to an advertiser to be used when generating a second prompt among a plurality of advertiser lists, by considering the subject, predicate, or object of the first prompt.

10. A method for controlling an electronic device (100) comprising a display (160), one or more processors (120), and a memory (110), The operation of generating a first prompt in response to user request information; The operation of generating a second prompt based on advertising information and the first prompt; and The operation includes outputting an image based on the second prompt to the display (160). The image above is, It is generated by a generative artificial intelligence model, and A method comprising a background image corresponding to the above user request information and an advertising element corresponding to the above advertising information.

11. In Paragraph 10, The above advertising information is, It includes a third prompt for generating the above-mentioned advertising element, and The above second prompt is a method generated based on the above first prompt and the above third prompt.

12. In Paragraph 10 or 11, The above memory (110) is, The generative artificial intelligence model configured to generate the image using a neural network model, and A method comprising the operation of generating the image by the generative artificial intelligence model based on the second prompt above.

13. In Paragraph 10 or 11, The above electronic device (100) is, It includes a communication interface (140) for transmitting / receiving data with an external device including the above-mentioned generative artificial intelligence model, and The operation of transmitting the above second prompt to the external device, and A method comprising the operation of receiving the image generated by the generative artificial intelligence model from the external device.

14. In any one of paragraphs 10 through 13, The above advertising information includes a list of multiple advertisers and information regarding an advertiser selected by a user from among the list of multiple advertisers. The advertising element included in the above image is a method relating to an advertiser selected by a user from among the above list of multiple advertisers.

15. In any one of paragraphs 10 through 14, The above advertising information includes a list of multiple advertisers, and A method comprising the operation of determining advertising information corresponding to an advertiser to be used when generating a second prompt among the plurality of advertiser lists, by considering the subject, predicate, or object of the first prompt.

Images