Method for displaying background image according to transition of operation state and electronic device performing method

Abstract

An electronic device according to one embodiment may obtain a first image corresponding to a first screen outputted on a display in response to an input for switching an operation state from a first state to a second state, sequentially output each of a plurality of first switched images obtained by differently adjusting transparency of the first image, output a second image preset for a second mode, and output the second image while operating in the second mode.

Description

Method for displaying a background image according to a transition of an operating state and an electronic device performing the method

[0001] One embodiment relates to a technique for switching an operating state, and more specifically, to a technique for outputting a background image according to a switching of an operating state.

[0002] AOD (always on display) refers to an always-on display, while AOD status indicates the state in which the electronic device controls the display as AOD. AOD is used in smartphones and smart wearable devices. AOD status allows the display to always be on, allowing it to display information such as the time, date, or notifications. For example, AOD status can be used in electronic devices that use AMOLED (active matrix organic light-emitting diode) displays or OLED displays. AOD status can provide users with necessary information without activating the entire display screen, thereby minimizing battery consumption while providing convenience.

[0003] As the screen switches from the home screen state to the AOD state, the process of the screen in the home screen state turning off and the screen in the AOD state turning on may not be visually natural.

[0004] According to one embodiment, an electronic device includes a display, at least one processor, and a memory storing instructions, wherein when the instructions are individually or collectively executed by the at least one processor, the electronic device may: output a first screen for a first state through the display; receive an input for changing from the first state to a second state while the first screen is being output; acquire a first image corresponding to the first screen output to the display in response to the input; sequentially output, through the display, a plurality of first transition images each having a different transparency of the first image; and output, through the display, a second image for the second state.

[0005] According to one embodiment, a method for switching an operating state of an electronic device may include an operation of outputting a first screen for a first state through a display of the electronic device, an operation of receiving an input for changing from the first state to a second state while the first screen is being output, an operation of acquiring a first image corresponding to the first screen output to the display in response to the input, an operation of sequentially outputting, through the display, a plurality of first transition images each having a different transparency of the first image, and an operation of outputting, through the display, a second image for the second state.

[0006] In one embodiment, an electronic device includes a battery, a display, at least one processor, and a memory storing instructions, wherein when the instructions are individually or collectively executed by the at least one processor, the electronic device may: in a first state in which a first power is used from the battery, output a first background image corresponding to a first frame of a specified video through the display; determine whether a specified condition is satisfied while the first background image is output in the first state; and, if it is determined that the specified condition is satisfied, sequentially output a first intermediate image and a second intermediate image corresponding to a first intermediate frame and a second intermediate frame, respectively, between the first frame and the second frame of the specified video; and in a second state in which a second power different from the first power is used from the battery, output a second background image corresponding to the second frame of the specified video different from the first frame through the display (160).

[0007] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0008] FIG. 2a illustrates an output screen that varies depending on operating states according to one embodiment.

[0009] FIG. 2b illustrates screens representing options for setting the AOD state, according to one embodiment.

[0010] FIG. 3 is a flowchart of a method for switching an operating state according to one embodiment.

[0011] FIG. 4a illustrates a screen output in a home screen state and a screen output in an AOD state according to one embodiment.

[0012] FIG. 4b illustrates a screen output in an app execution state and a screen output in an AOD state according to one embodiment.

[0013] FIG. 5 is a flowchart of a method for outputting any one of a plurality of second transition images generated based on a wall wallpaper image while operating in a second state, according to one embodiment.

[0014] FIG. 6 is a flowchart of a method for outputting one of a plurality of second transition images based on a first SoC of a battery, according to one embodiment.

[0015] FIG. 7 illustrates second transition images output according to different SoCs, according to one embodiment.

[0016] FIG. 8 is a flowchart of a method for outputting a graphic object together with a second image while operating in a second state, according to one embodiment.

[0017] FIG. 9 illustrates an original image and images with different image effects applied to the original image, according to one embodiment.

[0018] FIG. 10 is a flowchart of a method for switching an operating state according to one embodiment.

[0019] FIG. 11 is a flowchart of a method for displaying a background image according to a transition of an operating state, according to one embodiment.

[0020] FIG. 12 is a flowchart of a method for determining a frame corresponding to each state according to one embodiment.

[0021] FIG. 13 illustrates a frame corresponding to an AOD state, a frame corresponding to a lock screen state, and a frame corresponding to a home screen state among a plurality of frames of a target video according to one embodiment.

[0022] FIG. 14 is a flowchart of a method for determining a first frame based on a position of a first graphic object displayed in a first state, according to one embodiment.

[0023] FIG. 15 illustrates a method for determining a first frame based on a position of a first graphic object displayed in a first state, according to one embodiment.

[0024] FIG. 16 is a flowchart of a method for determining a first frame based on a changed position of a first graphic object displayed in a first state, according to one embodiment.

[0025] FIG. 17 is a flowchart of a method for generating a target video based on a base video according to one embodiment.

[0026] FIGS. 18A and 18B illustrate screens of a method for generating a target video based on a base video according to one embodiment.

[0027] FIG. 19 is a flowchart of a method for generating a target video based on a base image, according to one embodiment.

[0028] FIG. 20 is a flowchart of a method for switching an operating state according to one embodiment.

[0029] FIG. 21 illustrates a generative AI system according to one embodiment.

[0030] Hereinafter, various embodiments of the present disclosure will be described with reference to the attached drawings. However, this is not intended to limit the present disclosure to specific embodiments, and it should be understood that the present disclosure encompasses various modifications, equivalents, and / or alternatives of the embodiments.

[0031] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0032] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to an embodiment. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to an embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0033] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0034] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0035] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0036] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0037] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0038] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0039] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0040] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0041] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0042] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0043] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0044] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0045] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0046] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0047] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0048] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0049] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0050] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0051] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0052] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0053] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service by itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0054] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0055] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0056] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0057] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0058] According to one embodiment, the method according to the various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0059] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0060] FIG. 2a illustrates an output screen that varies depending on operating states according to one embodiment.

[0061] According to one embodiment, an electronic device (e.g., electronic device (101) of FIG. 1) may operate in any one of an operating state (or operating mode) of a first state, a second state, and a third state.

[0062] For example, the first state may be a home screen state. The home screen state may be a state in which icons for one or more applications (hereinafter referred to as “apps”) installed on the electronic device are displayed on the display together with a wallpaper image (or background image) set on the electronic device. The screen of the display displayed in the home screen state may be a first screen (210). The first screen (210) may include a first layer in which a wallpaper image is displayed and a second layer in which icons for one or more applications are displayed. The first screen (210) may include an additional layer in which a search window appears. A user may transmit a user input to the electronic device by touching a specific location on the first screen (210). The electronic device may control the electronic device based on the user input. For example, if the user touches a first icon for the first app, the first app may be executed.

[0063] For example, the second state may be a lock screen state. The lock screen state may be a state in which preset information is displayed on the display together with a wallpaper image set on the electronic device. For example, the lock screen state may be a state in which a digital clock is displayed on the wallpaper image. For example, the information displayed in the lock screen state may be preset through a menu (or option) that sets the lock screen state. For example, the preset information may include at least one of clock information, weather information, battery information, or alarm information. In the lock screen state, one or more widgets and a specific application shortcut icon may be output on the wallpaper image set on the electronic device.

[0064] The display screen output in the locked screen state may be a second screen (220). The second screen (220) may include a first layer on which a wallpaper image is output and a second layer on which preset information is output. The second screen (220) may include an additional layer related to a method for unlocking the device. For example, the additional layer may include an image representing a location for receiving a user's fingerprint. For example, the additional layer may include an image representing a keypad for receiving a password. In the locked screen state, even if the user touches a specific location on the second screen (220), the electronic device may invalidate the touch input. In the locked screen state, the electronic device may only process user input for the additional layer. For example, the electronic device may unlock the electronic device based on the user's fingerprint received through the additional layer.

[0065] For example, the third state may be an AOD (always one display) state. The AOD state represents a state in which the electronic device controls the display as an AOD. The AOD state may be a state in which preset information is output to the display along with an AOD image set for the AOD state. For example, the information output in the AOD state may be preset through options (or menus) that set the AOD state. For example, the preset information may include at least one of a clock, weather, battery information, or an alarm. The screen of the display output in the AOD state may be a third screen (230).

[0066] The third screen (230) may include a first layer on which an AOD image is output and a second layer on which preset information is output. Whether an AOD image is output in the AOD state may vary depending on the settings for the AOD state. Whether an AOD image is output in the AOD state may be preset through options (or menus) that set the AOD state. For example, if an AOD image is set not to be output in the AOD state, the AOD image may not be output, and preset information may be output through the second layer. For example, if an AOD image is set to be output in the AOD state, the AOD image may be output through the first layer, and preset information may be output through the second layer. Options for setting the AOD state will be described in detail below with reference to FIG. 2b.

[0067] In one embodiment, the AOD image may be an image generated based on the wallpaper image. When switching from the home screen state or the lock screen state to the AOD state, if the transition from the wallpaper image to the AOD image appears natural, user satisfaction may be enhanced. A method for switching between operating states is described in detail below with reference to FIGS. 3 to 16.

[0068] FIG. 2b illustrates screens representing options for setting the AOD state, according to one embodiment.

[0069] An electronic device (e.g., electronic device (101) of FIG. 1) may provide a user with options to control settings for the AOD state.

[0070] In one embodiment, the electronic device may provide the user with an option to turn on the AOD state. For example, if the option (244) displayed on the screen (242a) is turned on, the AOD state may be turned on, and if the option (244) is turned off, the AOD state may be turned off. If the AOD state is turned off, the electronic device may not operate in the AOD state.

[0071] According to one embodiment, the electronic device may provide the user with an option to determine whether a wallpaper image (or background image) is output in the AOD state. For example, if the option (246) displayed on the screen (242a) is turned off, the wallpaper image may not be output even when the electronic device operates in the AOD state. For example, if the option (246) displayed on the screen (242b) is turned on, the wallpaper image may be output when the electronic device operates in the AOD state.

[0072] The electronic device may output a preview of the AOD state that reflects the selection result for the option (246). For example, the electronic device may output a preview screen (248a) for the AOD state when the option (246) displayed on the screen (242a) is turned off. The preview screen (248a) may not display a wallpaper image. For example, the electronic device may output a preview screen (248b) for the AOD state when the option (246) displayed on the screen (242b) is turned on. The preview screen (248b) may display a wallpaper image.

[0073] According to one embodiment, the electronic device may provide a user with an option to determine whether to output only a main object among one or more graphic objects within a wallpaper image in an AOD state.

[0074] In one embodiment, the electronic device may provide the user with an option to determine whether to output information about the music being played in the AOD state.

[0075] FIG. 3 is a flowchart of a method for switching an operating state according to one embodiment.

[0076] The following operations 305 to 340 may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1). For example, the electronic device may include a processor (e.g., the processor (120) of FIG. 1), a memory (e.g., the memory (130) of FIG. 1), and a display (e.g., the display module (160) of FIG. 1).

[0077] In operation 305, the electronic device may output a first screen (e.g., the first screen (210) or the second screen (220) of FIG. 2A) for a first state via the display. For example, the first state may be a home screen state, an app running state, or a lock screen state. The app running state may be a state in which an app is running and a screen for the app is being output. For example, the second state may be an AOD state.

[0078] In operation 310, the electronic device may receive an input for switching the operational state from the first state to the second state while the first screen is being output. For example, the input may be named a state transition input.

[0079] In one embodiment, the electronic device may receive input from a user via an input module (e.g., input module (150) of FIG. 1 ). For example, the user may transmit a state transition input to the electronic device by pressing a side button of the electronic device. For example, the user may transmit a state transition input to the electronic device by performing a touch drag on the display of the electronic device.

[0080] According to one embodiment, the electronic device can internally generate a state transition input when no user input is received for a preset period of time, and receive the generated state transition input.

[0081] According to one embodiment, the electronic device can transition its operational state from a first state to a second state at the time a state transition input is received.

[0082] In operation 320, the electronic device may acquire a first image corresponding to a first screen output on the display in response to the input. The first screen may be the screen being output on the display at the time the state transition input is received. For example, the first image may be a bitmap image.

[0083] According to one embodiment, the electronic device can generate a first image by capturing a first screen output to a display.

[0084] In one embodiment, the electronic device may generate a first image by loading information about a first screen stored in memory or a buffer. For example, the information about the first screen stored in the memory or buffer may be pixel values ​​for pixels of a display. For example, the information about the first screen stored in the memory or buffer may be information for rendering the screen.

[0085] In operation 330, the electronic device may sequentially (or consecutively) output through a display, in response to an input, each of a plurality of first transition images having at least one property of the first image differently adjusted (e.g., transparency, color, shape, size, selection of a specific object, or some property of a specific object (e.g., edge of a specific object)).

[0086] According to one embodiment, the meaning of sequentially outputting a plurality of first transition images, each of which has at least one property of the first image differently adjusted, may mean that an animation resulting from the sequential adjustment of at least one property of the first image may be output as a plurality of images. For example, an animation in which the first image gradually disappears by adjusting the transparency or brightness of the first image may be output as a plurality of images.

[0087] According to one embodiment, the meaning that each of a plurality of first transition images having at least one property of the first image differently adjusted is sequentially output may mean that a plurality of images each generated by individually adjusting the property of the first image are sequentially output.

[0088] For example, the plurality of first transition images may include a first sub-transition image having a first transparency (or a first brightness), a second sub-transition image having a second transparency, and a third sub-transition image having a third transparency. For example, the first transparency may be a lower transparency than the second transparency and the third transparency. For example, the third transparency may be a higher transparency than the first transparency and the second transparency. The first transparency may correspond to the lowest transparency (e.g., 0% transparency), and the third transparency may correspond to the highest transparency (e.g., 100% transparency). The first sub-transition image having the first transparency may be identical to the first image.

[0089] The electronic device may sequentially output a first sub-transition image having a first transparency among a plurality of first transition images, a second sub-transition image having a second transparency, and a third sub-transition image having a third transparency. An animation effect in which the first image gradually disappears may be displayed by the plurality of first transition images.

[0090] According to one embodiment, the plurality of first transition images may be images in which at least one of the size or position of an object within the first image changes.

[0091] In operation 340, the electronic device may output a second image for the second state through the display in response to the input. For example, the second image may be an image corresponding to the wallpaper image or an image generated based on the wallpaper image.

[0092] According to one embodiment, the electronic device may output a second image with adjusted transparency in the AOD state. For example, the transparency of the second image may correspond to a transparency of 60%. The electronic device may adjust the transparency of the second image based on the current state of charge (SoC) of the battery of the electronic device (e.g., the battery (189) of FIG. 1). The lower the current SoC of the battery, the higher the transparency of the second image.

[0093] According to one embodiment, the second image output in the AOD state may be an image that simplifies the wallpaper image to reduce battery power consumed by the display. For example, the second image may be an edge image for the wallpaper image. For example, the second image may be an image that restricts or omits at least some of the properties that constitute the shape of the wallpaper image. For example, the second image may be an image that changes the color characteristics (e.g., saturation) that constitute the wallpaper image.

[0094] In one embodiment, the electronic device may output a second image when an input is received. For example, a plurality of first transition images may be output using a first layer of the display, and a second image may be output using a second layer of the display.

[0095] In one embodiment, the electronic device may simultaneously output the first transition images and the second image through the display. For example, the electronic device may output the second image through the display while at least one of the plurality of first transition images is being output. By simultaneously outputting the first transition images and the second image, a visual effect may be created in which the first image disappears and the second image appears.

[0096] According to one embodiment, the electronic device can output a second image through a display after outputting a plurality of first transition images.

[0097] According to one embodiment, the electronic device may output a graphic object representing information on the second image through the display. For example, if the second state is an AOD state, the electronic device may output at least one of a clock information object, a weather information object, a battery information object, or an alarm information object through the display together with the second image.

[0098] According to one embodiment, the graphic object output together with the second image may be output after the output of the first transition images is finished.

[0099] According to one embodiment, when the operating state of the electronic device is an AOD state, the electronic device can control the electronic device using a low-power processor (e.g., the auxiliary processor (123) of FIG. 1).

[0100] FIG. 4a illustrates a screen output in a home screen state and a screen output in an AOD state according to one embodiment.

[0101] According to one embodiment, a screen output in a home screen state may include a wallpaper image (410), a first icon (411) corresponding to a first app, a search box (412), and weather information (413). When the electronic device receives an input for switching to an AOD state while operating in the home screen state, the electronic device may acquire a first image corresponding to the screen (405) output in the home screen state, and output a plurality of first transition images based on the first image. The first image may correspond to an image or screen of a home screen provided in the home screen state. The first image may include at least a portion of the wallpaper image (410), an image portion corresponding to one or more icons (e.g., the first icon (412)). The first image may include an image portion corresponding to the search box (412).

[0102] When the electronic device receives an input (e.g., a mode switching input) to change from the home screen state to the AOD state, the electronic device may output a second image (420) preset for the AOD state. For example, the electronic device may output a plurality of second transition images as the second image (420). The electronic device may output the second image (420) while operating in the AOD state. For example, the electronic device may output a screen including the second image (420) while operating in the AOD state. The screen including the second image (420) may further include a clock information object (421) and a battery information object (422).

[0103] As a second state, the AOD state can output a second image by overlaying a digital clock image (e.g., a clock information object (421)) on a modified image of the wall wallpaper image (410) (e.g., a second image (420)). The second image can include a battery image (e.g., a battery information object (422)).

[0104] According to one embodiment, the electronic device may output a plurality of first transition images through the display so as to be overlaid on the second image (420) while the second image (420) is being output.

[0105] FIG. 4b illustrates a screen output in an app execution state and a screen output in an AOD state according to one embodiment.

[0106] According to one embodiment, the screen output in the app execution state may include an app image (430). When the electronic device receives an input (e.g., a mode switching input) for switching to an AOD state while operating in the app execution state, the electronic device may acquire a first image corresponding to the screen output in the app execution state and output a plurality of first switching images based on the first image. The first image may correspond to the app image (430) provided in the app execution state.

[0107] The electronic device may output a second image (420) for the AOD state when receiving an input for switching from the home screen state to the AOD state. For example, the electronic device may output a plurality of second transition images as the second image (420). While operating in the AOD state, the electronic device may output the second image (420) through the display. For example, while operating in the AOD state, the electronic device may output a screen including the second image (420). The screen including the second image (420) may further include a clock information object (421) and a battery information object (422).

[0108] FIG. 5 is a flowchart of a method for outputting any one of a plurality of second transition images generated based on a wall wallpaper image while operating in a second state, according to one embodiment.

[0109] According to one embodiment, operations 510 and 520 below may be related to operation 340 described above with reference to FIG. 3. For example, operation 340 may include operations 510 and 520. Operations 510 and 520 may be performed by an electronic device (e.g., electronic device (101) of FIG. 1). The electronic device may include a processor (e.g., processor (120) of FIG. 1), a communication module (e.g., communication module (190) of FIG. 1), a memory (e.g., memory (130) of FIG. 1), and a display (e.g., display module (160) of FIG. 1).

[0110] In operation 510, an electronic device (e.g., electronic device (101) of FIG. 1) can sequentially output a plurality of second transition images generated based on a wall wallpaper image.

[0111] According to one embodiment, the meaning of sequentially outputting a plurality of second transition images generated based on the above-described wallpaper image may be that an animation in which at least one property of the wallpaper image is sequentially adjusted is output as a plurality of images. For example, an animation in which a second image gradually appears by adjusting the transparency or brightness of the second image may be output as a plurality of second transition images.

[0112] According to one embodiment, the meaning that each of a plurality of first transition images having at least one property of the first image differently adjusted is sequentially output may mean that a plurality of images each generated by individually adjusting the property of the first image are sequentially output.

[0113] According to one embodiment, the electronic device may sequentially output a plurality of second transition images generated based on a wall wallpaper image as a second image through a display. For example, the plurality of second transition images may include a fourth sub-transition image having a fourth transparency, a fifth sub-transition image having a fifth transparency, and a sixth sub-transition image having a sixth transparency. The fourth transparency may correspond to the highest transparency (e.g., 100% transparency) among the transparencies of the second transition images, and the sixth transparency may correspond to the lowest transparency (e.g., 60% transparency) among the transparencies of the second transition images. The lowest transparency among the transparencies of the second transition images may vary depending on the current SoC of the battery. For example, the lower the current SoC of the battery, the higher the lowest transparency value may be. As the lowest transparency value increases, the power consumption of the battery for maintaining the AOD state may be reduced.

[0114] The electronic device may sequentially output a fourth sub-transition image having a fourth transparency among a plurality of second transition images, a fifth sub-transition image having a fifth transparency, and a sixth sub-transition image having a sixth transparency. An animation effect in which the second image gradually appears may be generated by the plurality of second transition images.

[0115] According to one embodiment, the plurality of second transition images may be images generated by applying a preset image effect to the wallpaper image. For example, the image effect may include at least one of a grayscale effect, a one-line drawing effect, or an edge effect. Each of the plurality of second transition images generated by applying the first image effect to the wallpaper image may have a different degree of effect. For example, the first image effect may be applied more strongly to a sub-transition image that is output later.

[0116] According to one embodiment, the electronic device can simultaneously output a plurality of first transition images and a plurality of second transition images through the display. For example, while at least one of the plurality of first transition images is output through the display, at least one of the plurality of second transition images generated based on the wallpaper image can be sequentially output as the second image through the display. By simultaneously outputting the plurality of first transition images and the plurality of second transition images, a visual effect can be created in which the first image disappears and the second image appears.

[0117] According to one embodiment, the electronic device can output a plurality of second transition images sequentially through the display after output of the plurality of first transition images is terminated.

[0118] In the second state, the electronic device can output any one of a plurality of second transition images while operating in the second state.

[0119] According to one embodiment, the last sub-transition image output among the plurality of second transition images may be continuously output through the display while operating in the second state.

[0120] According to one embodiment, a sub-switched image determined based on the current SoC of the battery among a plurality of second transition images may be continuously output through the display while the electronic device is operating in the second state. A method for outputting any one of the plurality of second transition images based on the current SoC while the electronic device is operating in the second state is described in detail below with reference to FIGS. 6 and 7.

[0121] FIG. 6 is a flowchart of a method for outputting one of a plurality of second transition images based on a first SoC of a battery, according to one embodiment.

[0122] According to one embodiment, operations 610 to 630 below may be related to operation 340 described above with reference to FIG. 3 or operation 520 described above with reference to FIG. 5. For example, operation 340 may include operations 610 to 630. For example, operation 520 may include operations 610 to 630. Operations 610 to 630 may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1). The electronic device may include a processor (e.g., the processor (120) of FIG. 1), a communication module (e.g., the communication module (190) of FIG. 1), a memory (e.g., the memory (130) of FIG. 1), and a display (e.g., the display module (160) of FIG. 1).

[0123] According to one embodiment, operations 610 to 630 may be performed when the electronic device receives an input that transitions from a first state to a second state.

[0124] In operation 610, the electronic device may determine a first SoC of a battery (e.g., battery (189) of FIG. 1). The first SoC may be a current SoC of the battery.

[0125] In operation 620, the electronic device may determine a second image to correspond to the first SoC. For example, the electronic device may determine which of the plurality of second transition images corresponds to the first SoC.

[0126] In operation 630, the electronic device may output a second image for the second state via a display. A method for outputting one of the plurality of second transition images corresponding to the first SoC is described in detail below with reference to FIG. 7.

[0127] FIG. 7 illustrates some of a plurality of second transition images output according to different SoCs, according to one embodiment.

[0128] For example, when the first SoC of a battery (e.g., battery (189) of FIG. 1) of an electronic device (e.g., electronic device (101) of FIG. 1) is within a first range (e.g., 70% to 100%), a seventh sub-transition image (710) with an image effect applied by 10% among a plurality of second transition images may be output.

[0129] For example, if the first SoC of the battery of the electronic device is within the second range (e.g., 50% to 70%), an eighth sub-transition image (720) with an image effect applied at 50% among the plurality of second transition images may be output.

[0130] For example, if the first SoC of the battery of the electronic device is within the third range (e.g., less than 50%), a ninth sub-transition image (730) with an image effect applied 100% among the plurality of second transition images may be output. The more strongly the image effect is applied to a sub-transition image, the more simplified the object appearing in the image may be expressed.

[0131] According to one embodiment, when the first SoC of the battery changes to the second SoC while the electronic device is operating in the second state, the electronic device can change the image output to a sub-switched image corresponding to the changed second SoC.

[0132] FIG. 8 is a flowchart of a method for outputting a graphic object together with a second image while operating in a second state, according to one embodiment.

[0133] The following operations 810 to 840 may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1). The electronic device may include a processor (e.g., the processor (120) of FIG. 1), a communication module (e.g., the communication module (190) of FIG. 1), a memory (e.g., the memory (130) of FIG. 1), and a display (e.g., the display module (160) of FIG. 1).

[0134] According to one embodiment, operations 810 and 820 may be performed before operation 310 described above with reference to FIG. 3 is performed.

[0135] In operation 810, the electronic device can determine whether the selected wallpaper image is a single-layer image or a multi-layer image. For example, the user can select a wallpaper image to be displayed in the home screen state or the lock screen state from among images stored in the electronic device (e.g., photo gallery images).

[0136] According to one embodiment, the electronic device can determine a foreground object area by detecting a foreground object within a wallpaper image. The electronic device can determine whether the wallpaper image is a single-layer image or a multi-layer image based on a size or ratio of the foreground object area within the wallpaper image. For example, the electronic device can determine the wallpaper image as a single-layer image if the size of the foreground object area is greater than or equal to a first threshold value or less than or equal to a second threshold value. For example, the electronic device can determine the wallpaper image as a single-layer image if the horizontal aspect ratio of the foreground object area is greater than or equal to a third threshold value. For example, the electronic device can determine the wallpaper image as a single-layer image if the vertical aspect ratio of the foreground object area is greater than or equal to a fourth threshold value.

[0137] In operation 820, the electronic device may determine the location of the graphic object output in the second state based on whether the wallpaper image is a single-layer image or a multi-layer image. For example, the graphic object output in the second state may include at least one of a clock graphic object, a weather graphic object, a battery graphic object, or an alarm graphic object.

[0138] For example, if the wallpaper image is a single layer image, the position of the graphic object can be determined by considering the visibility of the graphic object output together with the second image generated based on the wallpaper image.

[0139] For example, if the wallpaper image is a multi-layer image, the position of the graphic object can be determined by taking into account that the size and position of the foreground object in the second image generated based on the wallpaper image will change.

[0140] In operation 830, the electronic device may generate a second image based on the wallpaper image. For example, the second image output in the AOD state may be an image in which at least one property of the wallpaper image is changed to reduce power consumption of a battery (e.g., battery (189) of FIG. 1) consumed by the display.

[0141] According to one embodiment, at least one property of the wallpaper image may include at least one of transparency, color, shape, or size of the wallpaper image. For example, the second image may be an edge image for the wallpaper image. For example, the second image may be an image generated by adjusting the transparency or brightness of the wallpaper image.

[0142] According to one embodiment, at least one attribute of the wallpaper image may include an attribute of an object within the wallpaper image. The attribute of the object within the wallpaper image may include at least one of the edge, color, shape, or size of the object. For example, the second image may be an image that has changed an attribute of an object within the wallpaper image.

[0143] According to one embodiment, the second image may include a plurality of second transition images.

[0144] In one embodiment, operation 830 may be performed before operation 310 is performed.

[0145] In one embodiment, operation 830 may be associated with operation 340. For example, operation 340 may include operation 830. For example, operation 830 may be performed in response to receiving an input that transitions from a first state to a second state.

[0146] At operation 840, the electronic device can output a graphic object along with a second image for a second state.

[0147] FIG. 9 illustrates an original image and images with different image effects applied to the original image, according to one embodiment.

[0148] An electronic device (e.g., electronic device (101) of FIG. 1) can generate an image (920), an image (930), and an image (940) by applying different image effects to an original image (or, wallpaper image) (910).

[0149] For example, the electronic device can generate an image (920) by applying an edge effect to an original image (910).

[0150] For example, the electronic device can generate an image (930) by applying a pen & wash effect and an edge effect together to the original image (910).

[0151] For example, the electronic device can generate an image (940) by applying a line drawing effect to an original image (910).

[0152] FIG. 10 is a flowchart of a method for switching an operating state according to one embodiment.

[0153] The following operations 1005 to 1040 may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1). For example, the electronic device may include a processor (e.g., the processor (120) of FIG. 1), a memory (e.g., the memory (130) of FIG. 1), and a display (e.g., the display module (160) of FIG. 1).

[0154] In operation 1005, the electronic device may output a first screen (e.g., the first screen (210) or the second screen (220) of FIG. 2A) for a first state via the display. For example, the first state may be a home screen state, an app running state, or a lock screen state. For example, the second state may be an AOD state. The description of operation 1005 may be replaced with the description of operation 305 described above with reference to FIG. 3.

[0155] In operation 1010, the electronic device may receive an input (e.g., a state transition input) for switching the operational state from the first state to the second state while the first screen is being output. The description of operation 1010 may be replaced with the description of operation 310 described above with reference to FIG. 3.

[0156] In operation 1020, the electronic device may acquire a first image corresponding to the first screen output on the display in response to the input. The description of operation 1020 may be replaced with the description of operation 320 described above with reference to FIG. 3.

[0157] In operation 1030, the electronic device may output a second image for the second state through a display in response to the input. The description of operation 1030 may be replaced with the description of operation 340 described above with reference to FIG. 3.

[0158] In operation 1040, the electronic device may sequentially output, through the display, a plurality of first transition images, each of which has at least one property of the first image differently adjusted, in response to the input. For example, the plurality of first transition images may be output using the first layer of the display, and the second image may be output using the second layer of the display. The description of operation 1040 may be replaced with the description of operation 330 described above with reference to FIG. 3.

[0159] According to one embodiment, the electronic device can output a plurality of first transition images through the display so as to be overlaid on the second image while the second image is being output.

[0160] FIG. 11 is a flowchart of a method for displaying a background image according to a transition of an operating state, according to one embodiment.

[0161] The following operations 1110 to 1140 may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1). For example, the electronic device may include a processor (e.g., the processor (120) of FIG. 1), a memory (e.g., the memory (130) of FIG. 1), and a display (e.g., the display module (160) of FIG. 1).

[0162] In operation 1110, the electronic device may output a first background image (or a first wallpaper image) corresponding to a first frame of a specified video through a display in a first state in which first power is used from a battery (e.g., battery (189) of FIG. 1). The first background image may be an image in which at least one property of the first frame is changed. The first state may be any one of an AOD state, a lock screen state, and an unlock screen state. For example, the unlock screen state may include an app running state and a home screen state.

[0163] A method for determining the first frame of a specified video corresponding to the first state is described in detail below with reference to FIG. 12.

[0164] According to one embodiment, the electronic device can generate a first background image based on at least a portion of a first graphic object selected from among a first plurality of graphic objects included in a first frame.

[0165] In operation 1120, the electronic device can determine whether a specified condition is satisfied while the first background image is output in the first state.

[0166] In one embodiment, the specified condition may be the receipt of an input (e.g., a state transition input) for transitioning from a first state to a second state. The electronic device may receive the input for transitioning from the first state to the second state while the first background screen is being output.

[0167] An electronic device may receive a state transition input from a user via an input module (e.g., input module (150) of FIG. 1). For example, a user may transmit a state transition input to the electronic device by pressing a side button of the electronic device.

[0168] The electronic device may receive a state transition input based on a user's touch-drag input on the display. For example, if the first state is a lock screen state or an AOD state, the electronic device may receive a user's touch-drag input on the display as a state transition input.

[0169] In one embodiment, the specified condition may be that no user input is received for a preset period of time. If no user input is received for the preset period of time, the electronic device may internally generate a state transition input and receive the generated state transition input.

[0170] In operation 1130, if it is determined that a specified condition is satisfied, the electronic device may sequentially output a first intermediate image and a second intermediate image corresponding to each of a first intermediate frame and a second intermediate frame between a first frame and a second frame of the specified video. The second frame may be a frame of the specified video set for the second state. For example, if the specified video is composed of the 1st frame to the 2500th frame, and the first frame for the first state is determined to be the 25th frame, and the second frame for the second state is determined to be the 461st frame, each of the 26th frame to the 460th frame may correspond to the first intermediate frame or the second intermediate frame.

[0171] The first intermediate image may be an image in which at least one property of the first intermediate frame has been changed. The second intermediate image may be an image in which at least one property of the second intermediate frame has been changed. For example, the electronic device may output the first intermediate image and the second intermediate image such that the first intermediate image has a first transparency or a first brightness, and the second intermediate image has a second transparency different from the first transparency or a second brightness different from the first brightness. For example, the first intermediate image and the second intermediate image may be output such that the first transparency of the first intermediate image is higher than the second transparency of the second intermediate image.

[0172] In operation 1140, the electronic device may output a second background image corresponding to a second frame of a specified video different from the first frame through a display in a second state in which a second power different from the first power is used from the battery. The second background image may be an image in which at least one property of the second frame is changed. The second state may be another state different from the first state among an AOD state, a lock screen state, and an unlock screen state.

[0173] A method for determining a second frame of a specified video corresponding to a second state is described in detail below with reference to FIG. 12.

[0174] According to one embodiment, the electronic device may generate a second background image based on at least a portion of a second graphic object selected from among a second plurality of graphic objects included in a second frame. For example, the second graphic object of the second frame may be a graphic object corresponding to or identical to a first graphic object of the first frame. For example, the second graphic object of the second frame may be a graphic object different from the first graphic object of the first frame.

[0175] FIG. 12 is a flowchart of a method for determining a frame corresponding to each state according to one embodiment.

[0176] According to one embodiment, operations 1210 and 1220 below may be related to operation 1110 described above with reference to FIG. 11. For example, operations 1210 and 1220 may be performed before operation 1110 is performed. Operations 1210 and 1220 may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1). The electronic device may include a processor (e.g., the processor (120) of FIG. 1), a communication module (e.g., the communication module (190) of FIG. 1), a memory (e.g., the memory (130) of FIG. 1), and a display (e.g., the display module (160) of FIG. 1).

[0177] In operation 1210, the electronic device may determine a first frame based on a first graphic object displayed in a first state among a plurality of frames of a specified video. For example, the first graphic object output in the first state may include at least one of an app icon, a search bar, a clock graphic object, a weather graphic object, a battery graphic object, or an alarm graphic object.

[0178] According to one embodiment, the electronic device may determine a first frame to be displayed in a first state based on an input for selecting one of a plurality of frames of a target video. The selection input may include a selection input by a user, a selection input generated internally in the electronic device, or a selection input generated externally in the electronic device. For example, the electronic device may determine a frame most preferred by the user among a plurality of frames as the first frame based on data regarding the user's usage behavior.

[0179] According to one embodiment, the electronic device may determine a first frame among a plurality of frames by considering the position or layout of one or more graphic objects displayed in a first state. For example, if the visibility of the first graphic object displayed in the first state is obstructed by a foreground object or a background object of the first candidate frame among the plurality of frames, the first candidate frame may not be determined as the first frame. For example, if the first state is a lock screen state, if the visibility of a clock graphic object output in the lock screen state is obstructed by a foreground object of the first candidate frame, the first candidate frame may not be determined as the first frame. For example, if the color of the clock graphic object and the color of the foreground object arranged around the clock graphic object are the same, the visibility of the clock graphic object may be obstructed.

[0180] For example, if the first state is a lock screen state, and the visibility of a clock graphic object output in the lock screen state is obstructed by a foreground object in the first candidate frame, the electronic device may change at least one property of an object in the first candidate frame to increase the visibility of the clock graphic object.

[0181] In operation 1220, the electronic device may determine a second frame based on a second graphic object displayed in a second state among a plurality of frames of a specified video. For example, the second graphic object output in the second state may include at least one of an app icon, a search bar, a clock graphic object, a weather graphic object, a battery graphic object, or an alarm graphic object.

[0182] According to one embodiment, the electronic device may determine a second frame for the second state from among a plurality of frames of a specified video, taking into account the positions or layouts of one or more graphic objects displayed in the second state. A description of a method for determining a second frame for the second state from among a plurality of frames of a specified video is omitted below, as the description of a method for determining a first frame for the first state is equally applicable.

[0183] FIG. 13 illustrates a frame corresponding to an AOD state, a frame corresponding to a lock screen state, and a frame corresponding to a home screen state among a plurality of frames of a specified video according to one embodiment.

[0184] Although the description referring to FIG. 11 describes the first state and the second state as the operating states of the electronic device, the operating states of the electronic device may include the first state, the second state, and the third state. For example, the first state may be an AOD state, the second state may be a lock screen state, and the third state may be a home screen state.

[0185] In one embodiment, the specified video may consist of a total of 2500 frames. For example, the specified video may be a video in which the position, shape, or color of an object within the video changes from frame to frame.

[0186] For example, the 300th frame of the specified video may be determined as the first frame for the AOD state, the 720th frame of the specified video may be determined as the second frame for the lock screen state, and the 2492nd frame of the specified video may be determined as the third frame for the home screen state.

[0187] In the AOD state, the 300th frame (1310) can be output as an AOD image. A graphic object (1312) for the AOD state can be output together with the 300th frame (1310). The transparency or brightness of the 300th frame (1310) can be adjusted and output.

[0188] When a state transition input from the AOD state to the lock screen state is received from the user, the 301st frame to the 719th frame may be output as intermediate frames. After the 719th frame is output, the 720th frame (1320) may be output. A graphic object (1322) for the lock screen state may be output together with the 720th frame (1320).

[0189] In one embodiment, when a state transition input is based on a user's touch-drag input on the display, the next state of the AOD state may be determined based on the direction of the drag. For example, if the direction of the drag is to the right, the next state may be the lock screen state. For example, if the direction of the drag is to the left, the next state may be the home screen state.

[0190] In one embodiment, when a state transition input is based on a user's touch-drag input on a display, the output speed of intermediate frames (or intermediate images corresponding to intermediate frames) may be determined based on the speed of the drag. For example, the electronic device may determine the output speed of first intermediate frames based on the state transition input in response to the state transition input. The output speed may be determined based on the amount of change in coordinates of the touch-drag input. The faster the drag speed, the faster the change speed between intermediate frames.

[0191] When a state transition input from a lock screen state to a home screen state is received from a user, the 721st frame to the 2491st frame may be output as intermediate frames. The electronic device may sequentially output the first intermediate frames through the display at an output speed. After the 2491st frame is output, the 2492nd frame (1330) may be output. A graphic object (1332) for the home screen state may be output together with the 2492nd frame (1330).

[0192] According to one embodiment, when a state transition input is a touch drag input on a display, the electronic device may determine a second state among a plurality of states based on a movement direction of the touch drag input. For example, when the movement direction of the touch drag input is left in the lock screen state, the second state may be an AOD state. For example, when the movement direction of the touch drag input is right in the lock screen state, the second state may be a home screen state.

[0193] FIG. 14 is a flowchart of a method for determining a first frame based on a position of a first graphic object displayed in a first state, according to one embodiment.

[0194] According to one embodiment, operations 1410 and 1420 below may be related to operation 1210 described above with reference to FIG. 12 . For example, operation 1210 may include operations 1410 and 1420. Operations 1410 and 1420 may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1 ). For example, the electronic device may include a processor (e.g., the processor (120) of FIG. 1 ), a memory (e.g., the memory (130) of FIG. 1 ), and a display (e.g., the display module (160) of FIG. 1 ).

[0195] In operation 1410, the electronic device may determine whether the position of the foreground object of a first candidate frame among the frames of a first candidate group preset for a first state among a plurality of frames of a specified video corresponds to the position of the first graphic object displayed in the first state. For example, the frames of the first candidate group may be determined differently depending on the first state. For example, in one embodiment described with reference to FIG. 13, the 1st frame to the 500th frame of the video specified for the AOD state may be determined as a candidate group, the 501st frame to the 1700th frame of the video specified for the lock screen state may be determined as a candidate group, and the 1701st frame to the 2500th frame of the video specified for the home screen state may be determined as a candidate group.

[0196] According to one embodiment, the electronic device can determine whether the visibility of the screen layout of the first state is obscured by a foreground object of a first candidate frame among a plurality of frames of a specified video.

[0197] In operation 1420, the electronic device may determine the first candidate frame as the first frame if the position of the foreground object of the first candidate frame and the position of the first graphic object displayed in the first state do not correspond.

[0198] According to one embodiment, the electronic device may determine whether the visibility of the first graphical object is obstructed by the foreground object when the position of the foreground object of the first candidate frame corresponds to the position of the first graphical object displayed in the first state. If the visibility of the first graphical object is not obstructed by the foreground object, the first candidate frame may be determined as the first frame. For example, if the color of the first graphical object and the color of the foreground object arranged around the first graphical object are the same, the visibility of the first graphical object may be obstructed.

[0199] According to one embodiment, the electronic device may change the color of the first graphic object to increase the visibility of the first graphic object. The color of the first graphic object to be changed may be a color that contrasts with the color of a foreground object placed around the first graphic object.

[0200] According to one embodiment, the electronic device can change the position of the first graphic object to increase the visibility of the first graphic object.

[0201] According to one embodiment, the electronic device may determine the first candidate frame as the first frame if the visibility of the screen layout of the first state is not obstructed by a foreground object of the first candidate frame among the frames of the first candidate group preset for the first state among a plurality of frames of the specified video.

[0202] In one embodiment, the electronic device may not determine the first candidate frame as the first frame if the first candidate frame is not clear.

[0203] According to one embodiment, the electronic device can determine the position and color of each of the graphic objects output in a first state with increased visibility and the first frame for the first state by analyzing a plurality of frames of a specified video.

[0204] A second frame for a second state may be determined using a method similar to that used to determine a first frame for a first state. Additionally, a third frame for a third state may be further determined using a method similar to that used to determine a first frame for a first state.

[0205] FIG. 15 illustrates a method for determining a first frame based on a position of a first graphic object displayed in a first state, according to one embodiment.

[0206] The visibility of the first graphic object (1512) output in the first state may be impaired by the foreground object of the first candidate frame (1510) positioned around the first graphic object (1512). Compared to the visibility of the first candidate frame (1510), the visibility of the first graphic object (1522) may be better due to the foreground object of the second candidate frame (1520) positioned around the first graphic object (1522). Accordingly, among the first candidate frame (1510) and the second candidate frame (1520), the second candidate frame (1520) may be determined as the first frame for the first state.

[0207] FIG. 16 is a flowchart of a method for determining a first frame based on a changed position of a first graphic object displayed in a first state, according to one embodiment.

[0208] According to one embodiment, operations 1610 and 1620 below may be performed after operation 1420 described above with reference to FIG. 14 is performed. Operations 1610 and 1620 may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1). For example, the electronic device may include a processor (e.g., the processor (120) of FIG. 1), a memory (e.g., the memory (130) of FIG. 1), and a display (e.g., the display module (160) of FIG. 1).

[0209] In operation 1610, the electronic device can determine whether the position of the foreground object of the first candidate frame corresponds to the second position of the first graphic object when the position of the first graphic object displayed in the first state has changed from the first position to the second position.

[0210] As the position of the foreground object of the first candidate frame corresponds to the second position of the first graphic object, the following operation 1620 may be performed when the visibility of the first graphic object is impaired.

[0211] In operation 1620, the electronic device may re-determine a second candidate frame among the frames of the first candidate group as the first frame if the position of the foreground object of the first candidate frame corresponds to the second position of the first graphical object. For example, the second candidate frame may be a candidate frame in which the position of the foreground object of the second candidate frame does not correspond to the second position of the first graphical object displayed in the first state. For example, the second candidate frame may be a candidate frame in which the visibility of the first graphical object is not impaired even if the position of the foreground object of the second candidate frame corresponds to the second position of the first graphical object displayed in the first state.

[0212] FIG. 17 is a flowchart of a method for generating a specified video based on a base video according to one embodiment.

[0213] According to one embodiment, operations 1710 to 1740 below may be related to operation 1110 described above with reference to FIG. 11. For example, operations 1710 to 1740 may be performed before operation 1110 is performed. Operations 1710 to 1740 may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1). For example, the electronic device may include a processor (e.g., the processor (120) of FIG. 1), a memory (e.g., the memory (130) of FIG. 1), and a display (e.g., the display module (160) of FIG. 1).

[0214] In operation 1710, the electronic device may determine a default video. The default video may be a video selected by the user. For example, a video selected by the user from among multiple videos (e.g., video from a photo gallery) stored in the memory of the electronic device may be determined as the default video. For example, a video selected by the user from among multiple videos stored in an external electronic device (e.g., the electronic device (104) of FIG. 1) or server (e.g., the server (108) of FIG. 1) directly or indirectly connected to the electronic device via a network may be determined as the default video.

[0215] At operation 1720, the electronic device can determine a target section from the entire section of the primary video.

[0216] According to one embodiment, if the total number of frames of the basic video is greater than or equal to a preset number (e.g., 2500), a portion of the total section of the basic video may be determined as a target section. For example, the electronic device may display the total section of the basic video in the form of a slide bar, and the user may select the target section using the slide bar. The target section may be determined from the total section of the basic video based on the user's selection input. The target section may be determined such that the number of frames included in the target section is a preset number. While the preset number is exemplified as 2500, the preset number may vary depending on the embodiment.

[0217] In one embodiment, a target section may be determined from the entire section of the base video based on a user's arbitrary selection of a section. For example, even if the number of frames in the target section is greater than a preset number (e.g., 2500), a target section corresponding to the user's selection of a section from the entire section of the base video may be determined.

[0218] If the number of total frames included in the determined target section is greater than or equal to a preset number, operation 1730 may be further performed.

[0219] In operation 1730, the electronic device can determine target frames from among all frames in the target section. For example, the electronic device can determine target frames by sampling all frames in the target section at a preset rate. For example, if the number of total frames in the target section is 5,000, 2,500 target frames can be determined by sampling all frames at a rate of 1 / 2.

[0220] In operation 1740, the electronic device may generate a designated video based on the target frames. For example, a designated video may be generated to include the target frames.

[0221] According to one embodiment, operations 1210 and 1220 of FIG. 12 may be performed on a generated designated video to determine a first frame for a first state and a second frame for a second state. Thereafter, operation 1110 of FIG. 11 may be performed to output a first background image corresponding to the first frame in the first state.

[0222] FIGS. 18A and 18B illustrate screens of a method for generating a target video based on a base video according to one embodiment.

[0223] Screens (1810 to 1880) can be output through a display (e.g., a display module (160) of FIG. 1) of an electronic device (e.g., an electronic device (101) of FIG. 1).

[0224] The screen (1810) may include an option to change the wallpaper image (or background image) displayed in the AOD state. The user may select (e.g., touch or click) an option to change the wallpaper image.

[0225] A screen (1820) may be displayed in response to a user's selection to change the wallpaper image. The screen (1820) may include options for distinguishing the format of the wallpaper image displayed in the AOD state. For example, the format of the wallpaper image may be a still image format stored in the electronic device (e.g., a photo gallery) or a video format. The user may select an option corresponding to the desired format among the wallpaper image formats. For example, the user may select an option corresponding to the video format.

[0226] A screen (1830) may be displayed in response to the user's selection of a format for the wallpaper image. For example, if a video format is selected, the screen (1830) may display a list of videos stored on the electronic device. For example, the list may be displayed based on thumbnails of the videos. The user may select any of the videos displayed in the list as the default video.

[0227] A screen (1840) may be output in response to the selection of the basic video. For example, the screen (1840) may include a preview screen for an AOD state output based on a frame of the basic video.

[0228] In one embodiment, if the total number of frames of the basic video exceeds a preset number (e.g., 2500), an option for adjusting the total number of frames to the preset number may be added to the screen (1840). The option for adjusting the total number of frames to be less than or equal to the preset number may be "Trim." If the total number of frames of the basic video is less than or equal to the preset number, the option for adjusting the total number of frames to be less than or equal to the preset number may not be displayed on the screen (1840).

[0229] In one embodiment, if the total duration of the primary video exceeds a preset duration (e.g., 15 seconds), an option to adjust the total duration of the primary video to the preset duration may be added to the screen (1840). The option to adjust the total duration of the primary video to less than the preset duration may be "Trim." If the total duration of the primary video is less than the preset duration, the option to adjust the duration of the primary video to less than the preset duration may not be displayed on the screen (1840).

[0230] A screen (1850) may be displayed in response to the selection of an option to adjust the number or duration of frames of the basic video. For example, the screen (1850) may display the basic video in the form of a slide bar corresponding to the total duration of the basic video. The slide bar may display a specific frame corresponding to a specific time. The user may use the slide bar to select a desired time (e.g., a target period) from the total duration. An example in which a time ranging from 2 seconds to 17 seconds is selected as the target period is illustrated in the screen (1850).

[0231] While an embodiment of adjusting the overall time of a basic video has been described with reference to screen (1850), the above description can be similarly applied to an embodiment of adjusting all frames of a basic video. When the time or number of frames of a basic video is adjusted, the result can be stored as a target video.

[0232] When a target video is generated, a screen (1860) or a screen (1870) may be output. The screen (1860) may include a preview of a screen output in a home screen state. The screen output in the home screen state may include at least a portion of a first wall paper image corresponding to a first frame of the target video. For example, the first wall paper image may be the same image as the first frame. For example, the first wall paper image may be an image in which at least one property of the first frame (e.g., transparency, color, shape, size, selection of a specific object, or some property of a specific object (e.g., an edge of a specific object)) is adjusted.

[0233] According to one embodiment, a first frame corresponding to a home screen state can be selected by a user.

[0234] In one embodiment, a first frame corresponding to a home screen state may be selected by the electronic device. For example, the electronic device may determine a first frame among a plurality of frames of a target video by considering the position or layout of one or more graphic objects displayed in the home screen state.

[0235] The screen (1860) may include an option (e.g., "Lock Options") that provides a preview of the screen that will be displayed in the lock screen state.

[0236] The screen (1870) may include a preview of a screen output in the locked screen state. The screen output in the locked screen state may include at least a portion of a second wall paper image corresponding to a second frame of the target video. For example, the second wall paper image may be the same image as the second frame. For example, the second wall paper image may be an image in which at least one property of the second frame (e.g., transparency, color, shape, size, selection of a specific object, or some property of a specific object (e.g., an edge of a specific object)) is adjusted.

[0237] According to one embodiment, a second frame corresponding to the lock screen state can be selected by the user.

[0238] In one embodiment, a second frame corresponding to the lock screen state may be selected by the electronic device. For example, the electronic device may determine the second frame among a plurality of frames of the target video by considering the position or layout of one or more graphic objects displayed in the lock screen state.

[0239] Screen (1870) may include an option (e.g., "Home option") that provides a preview of the screen displayed in the home screen state. If "Home option" is selected, screen (1860) may be displayed.

[0240] Although the method of setting a first wall paper image for the home screen state and a second wall paper image for the lock screen state has been described with reference to screens (1860) and (1870), the above description can be similarly applied to the method of setting a third wall paper image for the AOD state.

[0241] When the settings for the first wall paper image for the home screen state and the second wall paper image for the lock screen state are completed using the target video, a screen (1880) may be output. The screen (1880) may display text (1882) indicating that the first wall paper image for the home screen state and the second wall paper image for the lock screen state have been changed.

[0242] FIG. 19 is a flowchart of a method for generating a specified video based on a base image, according to one embodiment.

[0243] According to one embodiment, operations 1910 and 1920 below may be performed before operation 1110 described above with reference to FIG. 11 is performed. Operations 1910 and 1920 may be performed by an electronic device (e.g., electronic device (101) of FIG. 1). For example, the electronic device may include a processor (e.g., processor (120) of FIG. 1), a memory (e.g., memory (130) of FIG. 1), and a display (e.g., display module (160) of FIG. 1).

[0244] In operation 1910, the electronic device may receive a base image. For example, the electronic device may receive the base image in response to an input from a user selecting one of the images stored on the electronic device.

[0245] In operation 1920, the electronic device can generate a video by generating a plurality of frames, each of which is associated with a base image, using a generative artificial intelligence (AI) model. For example, if the base image includes a foreground object, the plurality of frames can be generated to vary the position, shape, or color of the foreground object.

[0246] In one embodiment, multiple frames may be generated so that the video has a frame rate of 120 fps (frames per second). The number of frames included in the video is not limited to the described embodiment and may vary depending on the embodiment. The video may be generated so that the total time corresponds to a preset time or so that the total number of frames corresponds to a preset number.

[0247] FIG. 20 is a flowchart of a method for switching an operating state according to one embodiment.

[0248] The following operations 2010 to 2060 may be performed by an electronic device (e.g., the electronic device (101) of FIG. 1). For example, the electronic device may include a processor (e.g., the processor (120) of FIG. 1), a memory (e.g., the memory (130) of FIG. 1), and a display (e.g., the display module (160) of FIG. 1).

[0249] In operation 2010, the electronic device may determine a first frame based on a first graphic object displayed in a first state among a plurality of frames of a target video (or a designated video). According to one embodiment, the electronic device may determine the first frame displayed in the first state based on an input for selecting one of the plurality of frames of the target video. The input may include a selection input by a user or a selection input generated internally or externally to the electronic device. For example, the electronic device may replace a selection by a user by utilizing data on the user's usage behavior to predict the user's preference and determine the first frame based on the predicted preference. For example, the first state may be a home screen state, a lock screen state, or an AOD state.

[0250] According to one embodiment, the electronic device may determine a first frame among a plurality of frames by considering the position or layout of one or more graphic objects displayed in a first state. For example, if the visibility of the first graphic object displayed in the first state is obstructed by a foreground object or a background object of the first candidate frame among the plurality of frames, the first candidate frame may not be determined as the first frame. For example, if the first state is a lock screen state, if the visibility of a clock graphic object output in the lock screen state is obstructed by a foreground object of the first candidate frame, the first candidate frame may not be determined as the first frame. For example, if the color of the clock graphic object and the color of the foreground object arranged around the clock graphic object are the same, the visibility of the clock graphic object may be obstructed. For example, if the first state is a lock screen state and the visibility of a clock graphic object output in the lock screen state is obstructed by a foreground object of the first candidate frame, at least some properties of the objects constituting the first candidate frame may be changed, and the first candidate frame in which at least some properties of the objects have been changed may be determined as the first frame.

[0251] In operation 2020, the electronic device may determine a second frame based on a second graphic object displayed in a second state among a plurality of frames of the target video. According to one embodiment, the electronic device may determine the second frame displayed in the second state based on an input for selecting one of the plurality of frames of the target video. The input may include a selection input by the user or a selection input generated internally or externally to the electronic device. For example, the electronic device may use data about the user's usage behavior to predict the user's preference and determine the second frame based on the predicted preference, thereby replacing the selection by the user. For example, the second state may be a home screen state, a lock screen state, or an AOD state, and may be a different state from the first state.

[0252] According to one embodiment, the electronic device may determine a second frame among a plurality of frames by considering the position or layout of one or more graphic objects displayed in the second state. The description of operation 2020 may be similarly applied to the description of operation 2010.

[0253] In operation 2030, the electronic device may output a first frame or a first wallpaper image generated based on the first frame through a display in a first state. For example, if the first state is a home screen state or a lock screen state, the first frame may correspond to a wallpaper image. For example, if the first state is a lock screen state, the first frame may correspond to a lock screen image.

[0254] At operation 2040, the electronic device may receive an input (e.g., a state transition input) for transitioning from a first state to a second state. For example, the electronic device may receive an input for transitioning from the first state to the second state while the first frame is being output.

[0255] In one embodiment, the electronic device may receive a state transition input from a user via an input module (e.g., input module (150) of FIG. 1). For example, the user may transmit the state transition input to the electronic device by pressing a side button of the electronic device.

[0256] According to one embodiment, the electronic device can internally generate a state transition input and receive the generated state transition input when no user input is received for a preset period of time.

[0257] In one embodiment, the electronic device may receive a state transition input based on a user's touch-drag input on the display. For example, if the first state is a lock screen state or an AOD state, the user may receive a state transition input by touching and dragging the screen.

[0258] According to one embodiment, the electronic device can transition its operational state from a first state to a second state at the time a state transition input is received.

[0259] In operation 2050, the electronic device may sequentially output first intermediate frames between the first frame and the second frame through the display in response to an input for transitioning from the first state to the second state. For example, if the target video is composed of the 1st frame to the 500th frame, and the first frame for the first state is determined to be the 25th frame and the second frame for the second state is determined to be the 461st frame, the 26th frame to the 460th frame may be sequentially output through the display as the first intermediate frames.

[0260] In operation 2060, the electronic device may output a second frame or a first wall paper image generated based on the second frame through the display in response to the input. In the above example, the electronic device may output the 461st frame as the second frame in the second state. While operating in the second state, the electronic device may output a graphic object for the second state together with the second frame.

[0261] In one embodiment, the electronic device may output the second frame by adjusting the transparency or brightness when the second state is an AOD state. For example, the transparency or brightness may vary depending on the first SoC of the battery.

[0262] FIG. 21 illustrates a generative AI system according to one embodiment.

[0263] The User Query / Response Interface can receive user input. User input can be in the form of natural language, images, and / or videos. Context information can also be transmitted when the user input is transmitted. Context information can include various additional information at the time of user input. For example, it can include information about the application the user is currently using or the user's location. Furthermore, user input can be a mixture of natural language, images, sounds, and context information. Furthermore, user input can be in non-natural language forms, such as selecting a menu. The User Query / Response Interface can output the results of a generative artificial intelligence system to the user. The output can be in the form of natural language or specific content, and can also be provided in the form of actions requested by the user. The User Query Interface can output the results of a generative artificial intelligence system to the user. The output can be in the form of natural language or specific content, and can also be provided in the form of actions requested by the user.

[0264] The AI ​​framework can receive user input and coordinate and control each component necessary to carry out the user's intention based on the user's query.

[0265] User input received from the User Query / Response Interface can be sent to the Prompt design component. The Prompt design component can be used to generate prompts suitable for inputting user input into an LLM or LMM. The Prompt design component can be an AI component that uses a machine learning algorithm or neural network to develop better prompts over time. The Prompt design component can access a knowledge component containing user preference data, a prompt library, and prompt examples based on the user input to generate prompts and pass the generated prompts to the LLM or LMM.

[0266] The API / Plug-in management component can communicate with external information when additional information is requested when user input is passed as input to a generative model. The API / Plug-in management component establishes a channel for communication with external entities within the AI ​​Interface via APIs, enabling access to various data sources. Furthermore, if an application or service needs to perform an action that ultimately implements user input, rather than an intermediate result, the API / Plug-in management component can request such action via APIs. Information obtained from external sources can be used to generate prompts in the Prompt design component alongside user input, or can be passed as input to the generative model.

[0267] The Refiner component can fine-tune the output from generative models. For example, the Refiner component can verify that the content generated by LLMs and / or LMMs is not irrelevant, biased, or harmful. Furthermore, the Refiner component can determine the degree to which the output matches the user's desired outcome and, if necessary, initiate additional processing. Additionally, the Refiner component can configure and provide users with hints to avoid undesirable output.

[0268] Generative AI models generally refer to artificial intelligence neural networks that generate new forms of data based on user input. Generative AI models can include models that generate images and / or models that generate language. Representative image-generating models include generative adversarial networks (GANs) and variational autoencoders (VAEs), with examples including diffusion-based generative models that use VAE and Transformer architectures. Language-generating models are trained to statistically optimize output based on input values, and examples include models like CHAT-GPT 3 and CHAT-GPT 4. Additionally, there are large multimodal models (LMMs) that can recognize various types of data input, such as text, images, and voice, and generate corresponding new data.

[0269] According to one embodiment, an electronic device (101) includes a display (160), at least one processor (120), and a memory (130) storing instructions, and when the instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) may: receive an input for changing from a first state to a second state while a first screen is output; acquire, in response to the input, a first image corresponding to the first screen output to the display (160); sequentially output, through the display (160), each of a plurality of first transition images having a different transparency of the first image; and output, through the display (160), a second image for the second state.

[0270] According to one embodiment, the first state may correspond to a home screen state in which one or more icons are displayed on a wallpaper image, the first image may correspond to an image of a home screen provided in the home screen state, the first image may include at least a portion of the wallpaper image and an image portion corresponding to one or more icons, and the second state may correspond to an AOD state in which a second image is output by overlaying a digital clock image on a modified image of the wallpaper image.

[0271] According to one embodiment, the first state may correspond to an app running state in which a screen for the app is displayed, the first image may correspond to an app image provided in the app running state, and the second state may correspond to an AOD state in which a second image is output by overlaying a digital clock image on a modified image of the wallpaper image.

[0272] According to one embodiment, the first state may correspond to a lock screen state in which a digital clock is displayed on a wallpaper image, the first image may correspond to an image of a lock screen provided in the lock screen state, the first image may include at least a portion of the wallpaper image and an image portion corresponding to the digital clock, and the second state may correspond to an AOD state in which the second image is output by overlaying the digital clock image on a modified image of the wallpaper image.

[0273] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may be caused to: output a first sub-transition image having a first transparency among a plurality of first transition images, output a second sub-transition image having a second transparency among the plurality of first transition images, and output a third sub-transition image having a third transparency among the plurality of first transition images.

[0274] In one embodiment, the first transparency may correspond to a transparency lower than the second transparency and the third transparency, and the third transparency may correspond to a transparency higher than the first transparency and the second transparency.

[0275] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may cause: while at least one of the plurality of first transition images is being output, to output a second image through the display (160).

[0276] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may be caused to: sequentially output, through the display (160), at least one of a plurality of second transition images generated based on a wall wallpaper image as a second image while at least one of a plurality of first transition images is output.

[0277] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: output a second image through the display (160) after outputting a plurality of first transition images.

[0278] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: sequentially output a plurality of second transition images generated based on a wall wallpaper image as second images through the display (160) after outputting a plurality of first transition images.

[0279] In one embodiment, the plurality of second transition images may be images generated by applying a preset image effect to the wallpaper image.

[0280] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may cause: while the second image is being output, to output a plurality of first transition images to be overlaid on the second image via the display (160).

[0281] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: determine, in response to an input, a first SoC of a battery (189) of the electronic device (101), determine a second image corresponding to the first SoC, and output the second image for the second state through the display (160).

[0282] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may be caused to: determine whether a selected wallpaper image is a single-layer image or a multi-layer image; determine a location of a graphic object to be output in a second state based on whether the wallpaper image is a single-layer image or a multi-layer image; generate a second image based on the wallpaper image; and output the graphic object together with the second image for the second state in response to an input.

[0283] According to one embodiment, a method for switching an operating state of an electronic device (101) may include an operation (305) of outputting a first screen for a first state through a display (160) of the electronic device (101), an operation (310) of receiving an input for changing from the first state to a second state while the first screen is being output, an operation (320) of obtaining a first image corresponding to the first screen output to the display (160) in response to the input, an operation (330) of sequentially outputting a plurality of first transition images each having a different transparency of the first image through the display (160), and an operation (340) of outputting a second image for a second state through the display (160).

[0284] According to one embodiment, an electronic device (101) includes a battery (189), a display (160), at least one processor (120), and a memory (130) storing instructions, and when the instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) may: in a first state in which a first power is used from the battery (189), output a first background image corresponding to a first frame of a specified video through the display (160), determine whether a specified condition is satisfied while the first background image is output in the first state, and if it is determined that the specified condition is satisfied, sequentially output a first intermediate image and a second intermediate image corresponding to a first intermediate frame and a second intermediate frame between the first frame and the second frame of the specified video, respectively, and in a second state in which a second power different from the first power is used from the battery (189), output a second background image corresponding to a second frame of the specified video different from the first frame through the display (160).

[0285] According to one embodiment, the first state may be one of an AOD state, a lock screen state, and an unlock screen state, and the second state may be another one of the AOD state, a lock screen state, and an unlock screen state that is different from the first state.

[0286] According to one embodiment, the instructions, when individually or collectively executed by at least one processor (120), may cause the electronic device (101) to output a first intermediate image and a second intermediate image, such that the first intermediate image has a first transparency or a first brightness, and the second intermediate image has a second transparency different from the first transparency or a second brightness different from the first brightness.

[0287] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may be caused to: output a first intermediate image and a second intermediate image such that a first transparency of the first intermediate image is higher than a second transparency of the second intermediate image.

[0288] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may be caused to: generate a first background image based on at least a portion of a first graphical object selected from among a first plurality of graphical objects included in a first frame; and generate a second background image based on at least a portion of a second graphical object selected from among a second plurality of graphical objects included in a second frame.

[0289] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: select a first graphical object and a second graphical object, respectively, to correspond to the same object.

[0290] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: select a first graphical object and a second graphical object, respectively, such that at least a portion of the second graphical object is different from the first graphical object.

[0291] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may be caused to: determine whether the position of the foreground object of the first candidate frame corresponds to the second position of the first graphic object when the position of the first graphic object output in the first mode is changed from the first position to the second position, and determine the second candidate frame among the frames of the first candidate group as the first frame when the position of the foreground object of the first candidate frame corresponds to the second position of the first graphic object.

[0292] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: generate a specified moving image based on a base image.

[0293] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: generate a specified video based on a base image using a generative artificial intelligence (AI) model.

[0294] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may be caused to: generate a moving image in which the positions of the graphic objects of each of the first frame corresponding to the graphic objects of the basic image, the positions of the graphic objects of the first intermediate frame, the positions of the graphic objects of the second intermediate frame, and the positions of the graphic objects of the second frame are designated to be different from each other.

[0295] According to one embodiment, an electronic device (101) includes a display (160), at least one processor (120), and a memory (130) storing instructions, wherein when the instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) may: determine a first frame based on a first graphical object displayed in a first state among a plurality of frames of a target video; determine a second frame based on a second graphical object displayed in a second state among a plurality of frames of the target video; output the first frame through the display (160) in the first state; receive an input for changing from the first state to the second state while the first frame is being output; and, in response to the input, sequentially output first intermediate frames between the first frame and the second frame through the display (160), and output the second frame through the display (160).

[0296] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may be configured to: determine whether a position of a foreground object of a first candidate frame among frames of a first candidate group set for a first state among a plurality of frames of a target video corresponds to a position of a first graphical object displayed in the first state, and if the position of the foreground object of the first candidate frame does not correspond to the position of the first graphical object displayed in the first state, determine the first candidate frame as the first frame.

[0297] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may be caused to: determine whether the position of the foreground object of the first candidate frame corresponds to the second position of the first graphical object when the position of the first graphical object displayed in the first state is changed from the first position to the second position, and determine the second candidate frame among the frames of the first candidate group as the first frame when the position of the foreground object of the first candidate frame corresponds to the second position of the first graphical object.

[0298] According to one embodiment, when the first state is a home screen state, the first image may be output as a wallpaper image in the home screen state.

[0299] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may be caused to: adjust the transparency or brightness of the second frame and output it when the second state is the AOD state.

[0300] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: generate a target video by generating a plurality of frames associated with a base image using a generative AI model.

[0301] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: generate each of a plurality of frames such that the position of a foreground object of the base image changes based on the base image.

[0302] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: determine, in response to an input, an output speed of first intermediate frames based on the input, and sequentially output the first intermediate frames through the display (160) at the output speed.

[0303] In one embodiment, the input is a touch drag input to the display, and the output speed can be determined based on the amount of change in the coordinates of the touch drag input.

[0304] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: determine, in response to an input, an output speed of first intermediate frames based on the input, and sequentially output the first intermediate frames through the display (160) at the output speed.

[0305] In one embodiment, the input is a touch drag input to the display, and the output speed can be determined based on the amount of change in the coordinates of the touch drag input.

[0306] According to one embodiment, when the instructions are individually or collectively executed by at least one processor (120), the electronic device (101) may: in response to an input, if the input is a touch drag input to a display, determine a second state among a plurality of states based on a movement direction of the touch drag input.

[0307] The embodiments described above may be implemented using hardware components, software components, and / or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may be implemented using a general-purpose computer or a special-purpose computer, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0308] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may, independently or collectively, command the processing device. The software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave, for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on a computer-readable recording medium.

[0309] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., alone or in combination, and the program commands recorded on the medium may be those specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0310] The hardware device described above may be configured to operate as one or more software modules to perform the operations of the embodiment, and vice versa.

[0311] Although the embodiments described above have been described with limited drawings, those skilled in the art will appreciate that various technical modifications and variations can be applied based on the described embodiments. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0312] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. In an electronic device (101), display (160); at least one processor (120); and Includes a memory (130) for storing instructions, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) causes: Through the above display (160), the first screen for the first state is output, While the above first screen is being output, an input for changing from the first state to the second state is received, In response to the above input, Obtaining a first image corresponding to the first screen output to the above display (160), Through the above display (160), each of a plurality of first transition images with different transparency of the first image is sequentially output, Through the above display (160), the second image for the second state is output. To do, Electronic device (101).

2. In paragraph 1, The above first state corresponds to a home screen state in which one or more icons are displayed on a wall wallpaper image, The first image corresponds to an image of a home screen provided in the home screen state, and the first image includes at least a portion of the wallpaper image and an image portion corresponding to one or more icons, The second state corresponds to an AOD (always one display) state that outputs the second image by overlaying a digital clock image on a modified image of the wall wallpaper image. Electronic devices (101).

3. In paragraph 1 or 2, The above first state corresponds to the app execution state in which the screen for the app is displayed, The above first image corresponds to the app image provided in the app execution state, The second state corresponds to the AOD state that outputs the second image by overlaying a digital clock image on a modified image of the wall wallpaper image. Electronic device (101).

4. In any one of paragraphs 1 to 3, The above first state corresponds to a lock screen state in which a digital clock is displayed on a wall wallpaper image, The first image corresponds to an image of a lock screen provided in the lock screen state, and the first image includes at least a portion of the wallpaper image and an image portion corresponding to the digital clock. The second state corresponds to an AOD state that outputs the second image by overlaying a digital clock image on a modified image of the wall wallpaper image. Electronic devices (101).

5. In any one of paragraphs 1 to 4, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) causes: Outputting a first sub-transition image having a first transparency among the plurality of first transition images, Outputting a second sub-transition image having a second transparency among the plurality of first transition images, Outputting a third sub-transition image having a third transparency among the plurality of first transition images Let's do it, The first transparency is lower than the second transparency and the third transparency, and the third transparency is higher than the first transparency and the second transparency. Electronic devices (101).

6. In any one of paragraphs 1 to 5, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) causes: While at least one of the plurality of first transition images is output, the second image is output through the display (160). To do, Electronic devices (101).

7. In any one of paragraphs 1 to 6, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) causes: While at least one of the plurality of first transition images is output, at least one of the plurality of second transition images generated based on the wall wallpaper image is sequentially output as the second image through the display (160). To do, Electronic device (101).

8. In any one of paragraphs 1 to 7, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) causes: After the output of the above plurality of first transition images, the second image is output through the display (160). To do, Electronic device (101).

9. In any one of paragraphs 1 to 8, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) causes: After the output of the plurality of first transition images, the plurality of second transition images generated based on the wall wallpaper image are sequentially output as the second images through the display (160). To do, Electronic device (101).

10. In any one of paragraphs 1 to 9, The above plurality of second transition images are images created by applying a preset image effect to the above wallpaper image. Electronic device (101).

11. In any one of paragraphs 1 to 10, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) causes: While the second image is being output, the plurality of first transition images are output so as to be overlaid on the second image through the display (160). To do, Electronic device (101).

12. In any one of paragraphs 1 to 11, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) causes: In response to the above input, Determine the first SoC (state of charge) of the battery (189) of the above electronic device (101), Determine the second image to correspond to the first SoC, Through the above display (160), the second image for the second state is output. To do, Electronic device (101).

13. In any one of paragraphs 1 to 12, When the above instructions are individually or collectively executed by the at least one processor (120), the electronic device (101) causes: Determines whether the selected wallpaper image is a single layer image or a multi-layer image, Determine the position of the graphic object output in the second state based on whether the above-mentioned wallpaper image is the single-layer image or the multi-layer image, Generating the second image based on the above wallpaper image, In response to the above input, Output the graphic object together with the second image for the second state. To do, Electronic device (101).

14. In a method for switching the operating state of an electronic device (101), An operation (305) of outputting a first screen for a first state through a display (160) of the electronic device (101); An operation (310) of receiving an input for changing from the first state to the second state while the first screen is being output; In response to the above input, An operation (320) of obtaining a first image corresponding to the first screen output to the display (160); An operation (330) of sequentially outputting each of a plurality of first transition images with different transparency adjustments of the first image through the display (160); and An operation (340) of outputting a second image for the second state through the above display (160) Including, How to switch between action states.

15. A computer-readable recording medium containing a program for performing the method of Article 14.

Images