Electronic device for generating user adaptive image and control method thereof

Abstract

An electronic device is disclosed. The electronic device of the present disclosure may comprise a display, and at least one processor operatively connected to the display, wherein the at least one processor: obtains user preference information; obtains, from a first application, information related to an event to be executed; obtains multiple conditions related to whether the event is executed; on the basis of the user preference information and the event information, generates an image or video corresponding to each of the multiple conditions; and on the basis that at least one of the multiple conditions is satisfied, displays the image or video corresponding to the satisfied condition on the display.

Description

Electronic device for generating user-adaptive images and method for controlling the same

[0001] Embodiments of the present disclosure relate to an electronic device for generating a user-adaptive image and a method for controlling the same.

[0002] The variety of services and additional features offered through electronic devices, such as smartphones, is steadily increasing. To enhance the utility of these devices and satisfy the diverse needs of users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices to offer a variety of features and differentiate themselves from competitors. Consequently, the various functions offered through electronic devices are also becoming increasingly sophisticated.

[0003] Additionally, electronic devices provide various GUIs (graphical user interfaces) for user interaction through displays.

[0004] According to one embodiment, an electronic device may include a display and at least one processor operatively connected to the display.

[0005] In one embodiment, the at least one processor may obtain user preference information.

[0006] In one embodiment, the at least one processor may obtain, from the first application, information related to an event to be executed.

[0007] According to one embodiment, the at least one processor may obtain a plurality of conditions related to whether the event is executed.

[0008] According to one embodiment, the at least one processor may generate an image or video corresponding to each of the plurality of conditions based on the user's preference information and the event information.

[0009] According to one embodiment, the at least one processor may display an image or video corresponding to the satisfied condition on the display based on whether at least one of the plurality of conditions is satisfied.

[0010] According to one embodiment, a method of controlling an electronic device may include an operation of obtaining user preference information.

[0011] According to one embodiment, a method of controlling an electronic device may include an operation of obtaining, from a first application, information related to an event to be executed.

[0012] According to one embodiment, a method of controlling an electronic device may include an operation of obtaining a plurality of conditions related to whether the event is executed.

[0013] According to one embodiment, a method for controlling an electronic device may include an operation of generating an image or video corresponding to each of the plurality of conditions based on the user's preference information and the event information.

[0014] According to one embodiment, a method of controlling an electronic device may include an operation of displaying an image or video corresponding to a satisfied condition based on at least one of the plurality of conditions being satisfied.

[0015] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions for an electronic device to obtain user preference information.

[0016] According to one embodiment, the one or more programs may include instructions for the electronic device to obtain, from the first application, information related to an event to be executed.

[0017] According to one embodiment, the one or more programs may include instructions for the electronic device to obtain a plurality of conditions related to whether the event is executed.

[0018] According to one embodiment, the one or more programs may include commands for the electronic device to generate images or videos corresponding to each of the plurality of conditions based on the user's preference information and the event information.

[0019] In one embodiment, the one or more programs may include commands that cause the electronic device to display an image or video corresponding to the satisfied condition on the display based on satisfaction of at least one of the plurality of conditions.

[0020] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0021] FIG. 2 is a flowchart illustrating an operation of generating a user-adaptive image of an electronic device according to one embodiment.

[0022] FIG. 3 is a diagram illustrating an operation of generating a user-adaptive image using an artificial intelligence model of an electronic device according to one embodiment.

[0023] FIG. 4 is a diagram illustrating an operation of generating a user-adaptive image using an artificial intelligence model of an electronic device according to one embodiment.

[0024] FIG. 5A is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether an event of an electronic device is executed according to an embodiment.

[0025] FIG. 5b is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether an event of an electronic device is executed according to an embodiment.

[0026] FIG. 5c is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether an event of an electronic device is executed according to an embodiment.

[0027] FIG. 6A is a drawing for explaining set conditions related to the position of an electronic device according to one embodiment.

[0028] FIG. 6b is a diagram illustrating a lock screen using a user-adaptive image displayed based on the location of an electronic device according to one embodiment.

[0029] FIG. 6c is a diagram illustrating a lock screen using a user-adaptive image displayed based on the location of an electronic device according to one embodiment.

[0030] FIG. 7A is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether a set value of an electronic device is achieved according to an embodiment.

[0031] FIG. 7b is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether a set value of an electronic device is achieved according to an embodiment.

[0032] FIG. 8 is a drawing for explaining a lock screen using a user-adaptive image displayed based on whether a set condition of an electronic device is satisfied according to an embodiment.

[0033] FIG. 9A is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether multiple events are executed in an electronic device according to an embodiment.

[0034] FIG. 9b is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether multiple events are executed in an electronic device according to an embodiment.

[0035] FIG. 9c is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether multiple events are executed in an electronic device according to an embodiment.

[0036] FIG. 10 is a diagram illustrating an operation of displaying a user-adaptive image on a wearable electronic device according to one embodiment.

[0037] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0038] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0039] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0040] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0041] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0042] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0043] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0044] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0045] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0046] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0047] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0048] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0049] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0050] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0051] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0052] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0053] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0054] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0055] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0056] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0057] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0058] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0059] FIG. 2 is a flowchart illustrating an operation of generating a user-adaptive image of an electronic device according to one embodiment.

[0060] Referring to FIG. 2, in operation 210, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) can obtain user preference information.

[0061] According to one embodiment, an electronic device can acquire user preference information based on user input received through a lock screen settings screen. For example, a screen for setting the lock screen may include a list of objects that can be included on the lock screen. For example, the list of objects may include items that reflect preference information, such as animals such as puppies and cats, plants such as flowers, and cartoon characters.

[0062] According to one embodiment, the electronic device can obtain user preference information based on text entered through a settings screen of a lock screen.

[0063] According to one embodiment, the electronic device may obtain user preference information based on the usage history of multiple applications installed on the electronic device.

[0064] In one embodiment, user preference information can be obtained in the same manner for the home screen as well as the lock screen.

[0065] In one embodiment, in operation 220, the electronic device may obtain information related to an event to be executed from a first application.

[0066] In one embodiment, the first application may be a calendar application. For example, the event may be at least one schedule entered by the user through the calendar application.

[0067] In one embodiment, the first application may be a health application. For example, the event may be whether a user has achieved a workout goal set through the health application. In one embodiment, the workout goal may be determined by the application or by user input.

[0068] In one embodiment, in operation 230, the electronic device may obtain a plurality of conditions related to whether an event is to be executed.

[0069] According to one embodiment, when the application related to the event is a calendar application, the electronic device can obtain multiple conditions before, during, and after execution of a schedule entered into the calendar application.

[0070] In one embodiment, the electronic device may be configured to obtain multiple conditions, such as being located before / after a time related to the event and / or within a set distance from the specific location, when the event-related application is a calendar application and the schedule entered in the calendar application is to visit a specific location.

[0071] In one embodiment, if the application related to the event is a health application, the electronic device may obtain multiple conditions, such as before exercise, during exercise, and completion of exercise goal achievement.

[0072] In one embodiment, the electronic device may obtain multiple conditions, such as receipt of a message from a specific sender and / or unconfirmation of a received message, when the application associated with the event is a messenger application and a specific sender is set as important.

[0073] In one embodiment, specific sender settings may be set not only through the messenger application, but also through the screen for setting the lock screen (or home screen).

[0074] In one embodiment, when a specific condition is set for generating an image or video through a screen for setting a lock screen (or home screen), the electronic device can obtain multiple conditions such as whether there is a time, location, and / or an input schedule.

[0075] In one embodiment, in operation 240, the electronic device may generate images or videos corresponding to a plurality of conditions, respectively, based on user preference information and event information.

[0076] In one embodiment, an electronic device may receive event-related information through a second application, different from the first application. In another embodiment, the electronic device may further utilize the related information to generate images or videos corresponding to multiple conditions. For example, the second application may include a weather application, a health application, a map application, a memo application, and / or a payment application.

[0077] In one embodiment, weather information, location information, exercise information, checklist information, and / or payment information related to an event may be obtained from a second application.

[0078] According to one embodiment, the electronic device may use user preference information, event information, and multiple conditions as input data for an artificial intelligence model stored in a memory (e.g., memory (130) of FIG. 1). According to one embodiment, the electronic device may obtain images or videos corresponding to each of the multiple conditions as output data of the artificial intelligence model.

[0079] In one embodiment, the AI ​​model may be trained using multiple images and conditions corresponding to each of the multiple images. For example, the conditions corresponding to each of the multiple images may include object information contained in the multiple images, object behavior information, contextual information related to the multiple images, weather information, and / or time information.

[0080] An operation of generating an image or video using an artificial intelligence model according to one embodiment will be described below with reference to FIGS. 3 and 4.

[0081] In one embodiment, the electronic device may use information obtained from the second application as input data for the artificial intelligence model. In another embodiment, the electronic device may display the information obtained from the second application in addition to images or videos, which are the output data of the artificial intelligence model.

[0082] In one embodiment, in operation 250, the electronic device may display an image or video corresponding to the satisfied condition on the display based on whether at least one of the plurality of conditions is satisfied.

[0083] According to one embodiment, the electronic device may generate a plurality of images or videos for each of a plurality of conditions, and then, based on whether at least one of the plurality of conditions is satisfied, display an image or video corresponding to at least one of the satisfied conditions among the plurality of images or videos.

[0084] According to one embodiment, examples of multiple conditions may be as shown in [Table 1] below.

[0085] [Table 1]

[0086]

[0087] Referring to [Table 1], the conditions may be related to at least one of the device time, device location, or device status, depending on the type of event. For example, if the event is schedule-related, the multiple conditions may include at least one of before, during, or after the event. According to one embodiment, the image or video display operation related to whether an event is executed will be described in more detail with reference to FIGS. 5A to 5C below.

[0088] In one embodiment, if the event relates to a visit to a specific location, the distance between the location and the device may be included as a condition. In one embodiment, the image or video display operation related to a visit to a specific location is described in more detail with reference to FIGS. 6A through 6C below.

[0089] In one embodiment, if the event is related to a target value, the multiple conditions may include at least one before or after the target value is achieved. In one embodiment, the image or video display operation related to the target value achievement will be described in more detail below with reference to FIGS. 7A and 7B.

[0090] In one embodiment, if the event is receiving a message from a specific sender, the condition may include at least one of receiving a message from the specific sender or not confirming the message. In one embodiment, the image or video displayed when a message is received from a specific sender is described in more detail below with reference to FIG. 8.

[0091] In one embodiment, the condition may include at least one of time, location, or schedule.

[0092] In one embodiment, the generated example may relate to an image or video corresponding to each of a plurality of conditions. For example, the generated example may include at least one of a situation, object, or information contained in the image or video.

[0093] According to one embodiment, information included in an image or video may be received from a second application as well as a first application associated with an event, as illustrated in [Table 2].

[0094] [Table 2]

[0095]

[0096] Referring to [Table 2], the electronic device can generate an image or video such as an 'example of use' based on information received from the first application and the second application related to the event.

[0097] According to one embodiment, when multiple events overlap in the same time zone, the electronic device may generate an image or video according to a condition as shown in [Table 3], and when the condition is satisfied, display an image or video corresponding to the satisfied condition.

[0098] [Table 3]

[0099]

[0100] Referring to [Table 3], if multiple events overlap, the electronic device can generate an image or video by reflecting all information about the multiple events. According to one embodiment, an embodiment in which multiple events overlap within the same time period will be described below with reference to FIGS. 9A to 9D .

[0101] In one embodiment, the electronic device may transmit an image or video corresponding to a satisfied condition to an external electronic device connected via a communication module, such that the external electronic device displays an image or video corresponding to the satisfied condition. For example, if the electronic device is connected to a smartwatch, the electronic device may transmit an image or video to the smartwatch, such that the smartwatch displays the generated image or video on the watch face.

[0102] In this way, by continuously generating multiple images or videos suitable for the user context and providing the user with an appropriate image or video among the generated images or videos at an appropriate time, the desired information can be provided together with the user's preferred images even if the user does not run the application.

[0103] FIG. 3 is a diagram illustrating an operation of generating a user-adaptive image using an artificial intelligence model of an electronic device according to one embodiment.

[0104] FIG. 4 is a diagram illustrating an operation of generating a user-adaptive image using an artificial intelligence model of an electronic device according to one embodiment.

[0105] Referring to FIG. 3, an electronic device (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may input user preferences (310) and event information (311) into an artificial intelligence model (320). According to one embodiment, the electronic device may obtain multiple images (330, 331) for the user preferences (310) and event information (311) from the artificial intelligence model (320).

[0106] According to one embodiment, the user preference (310) may be identified by user input. For example, it may be an object selected from an object list included in a settings screen, or it may be input as text by the user. For example, as illustrated in FIG. 4, the electronic device may acquire a specific character (410) as user preference information. According to one embodiment, the user preference information may include at least one of information regarding a preferred resolution (e.g., ultra realistic or 4K) or preferred brightness (e.g., cinematic lighting) in addition to the object type.

[0107] According to one embodiment, event information (311) may include a schedule entered through the application, a specific location visit schedule, a target number, or a specific sender. For example, as illustrated in FIG. 4 , event information (411) may include at least one of the following information: an event title (e.g., "Tennis Club"), a specific time (e.g., 12:00 PM on August 17), a specific location (e.g., "Penn Tennis Center"), or an attendee (e.g., "Rafa").

[0108] According to one embodiment, the event information (311) may include multiple conditions. For example, the multiple conditions may include at least one of: before the event, during the event, after the event, within a set distance from a specific location, before achieving a target, after achieving a target, or receiving a message from a specific sender.

[0109] According to one embodiment, the electronic device may obtain a plurality of images (330, 331) or videos corresponding to each of the plurality of conditions based on a plurality of conditions included in the user preference (310) and event information (311) input into the artificial intelligence model (320). For example, as illustrated in FIG. 4, the electronic device may input a specific character (410) and event information (411), which are user preference information, into the artificial intelligence model (420), and obtain a plurality of images (430, 431, 432) or videos corresponding to each of the plurality of conditions related to the event information (411) as output data. According to one embodiment, the plurality of images (430, 431, 432) will be described in more detail with reference to FIGS. 5A to 5C.

[0110] According to one embodiment, the electronic device may add information obtained from a first application related to event information (311) and a second application different from the first application to an image or video output from an artificial intelligence model (320). According to one embodiment, the electronic device may input information obtained from a second application related to event information (311) and different from the first application as input data to the artificial intelligence model (320) to obtain an image or video including information obtained from the second application.

[0111] FIG. 5A is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether an event of an electronic device is executed according to an embodiment.

[0112] Referring to FIG. 5A, the electronic device (101) (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a first image (430) or video generated to correspond to the pre-event condition, as a lock screen or home screen, when the time is 10:50 AM, which is before the event of 12:00 AM. For example, the first image (430) or video may include a specific character (510) moving in a hurry. In one embodiment, the first image (430) or video may include a specific character (510) moving in a hurry under the sun (511), based on weather information at 10:50 AM.

[0113] According to one embodiment, the first image (430) or video may include current situation information (512) including at least one of information on the time required to reach a certain location, information on the expected time of arrival, current temperature, or current weather information based on the distance between the current location of the electronic device (101) and the certain location.

[0114] In one embodiment, the first image (430) or video may include a list of necessary items (513) (e.g., racket, water, towel) based on at least one of the schedule content or the current weather.

[0115] FIG. 5b is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether an event of an electronic device is executed according to an embodiment.

[0116] Referring to FIG. 5B, when the time is 12:30 PM during an event, the electronic device (101) may display a second image (431) or video generated to correspond to the event condition as a lock screen or home screen. For example, the second image (431) or video may include a specific character (520) playing tennis. In one embodiment, the second image (431) or video may include a specific character (520) playing tennis on a tennis court under the sun, based on weather information at 12:30 PM.

[0117] In one embodiment, the second image (431) or video may include current situation information (521) including at least one of calories burned, water intake, and next rest time based on current temperature / humidity.

[0118] FIG. 5c is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether an event of an electronic device is executed according to an embodiment.

[0119] Referring to FIG. 5c, the electronic device (101) may display a third image (432) or video generated to correspond to the post-event condition at 13:50, as the lock screen or home screen. For example, the third image (432) or video may include a specific character (530) resting in front of a tennis court. In one embodiment, the third image (432) or video may include a photo or video taken during the event.

[0120] In one embodiment, the third image (432) or video may include current situation information (531) including at least one of exercise time, calories burned, messages between participants, settlement amount, or personal records achieved.

[0121] In this way, the electronic device can provide a lock screen or home screen containing different images and other information depending on the situation based on the event.

[0122] FIG. 6A is a drawing for explaining set conditions related to the position of an electronic device according to one embodiment.

[0123] FIG. 6b is a diagram illustrating a lock screen using a user-adaptive image displayed based on the location of an electronic device according to one embodiment.

[0124] FIG. 6c is a diagram illustrating a lock screen using a user-adaptive image displayed based on the location of an electronic device according to one embodiment.

[0125] Referring to FIG. 6A, an electronic device (101) (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may have a schedule for visiting a specific location (610) input. For example, the schedule for visiting a specific location (610) may be a schedule for receiving a repaired product.

[0126] According to one embodiment, the electronic device (101) may display a lock screen or home screen related to an event when entering a specific location (610) and a set distance (611) (e.g., 500 m) before the event. For example, as illustrated in FIG. 6B , at 13:50, which is before the event at 14:00, the electronic device (101) may display a first image (620) or video generated to correspond to the pre-event condition as the lock screen or home screen. For example, the first image (620) or video may include a repaired bag (621). According to one embodiment, the first image (620) or video may include information about an upcoming event (622).

[0127] In one embodiment, the first image (620) or video may further include information related to the time it takes to reach a specific location (610).

[0128] According to one embodiment, when the electronic device (101) moves further than a set distance (611) (e.g., 500 m) from a specific location (610) after a certain period of time, the electronic device (101) may display a second image (630) or video related to another event on the lock screen or home screen. According to one embodiment, if the current time is within a set time from the next event schedule, the second image (630) or video may be generated for the next event. According to one embodiment, if the current time is before a set time from the next event schedule, the second image (630) or video may be generated only with user preference information unrelated to the event. For example, as illustrated in FIG. 6C, if the conditions related to the previous event and the next event are not satisfied, the electronic device (101) may display a second image (630) (e.g., a puppy) or video generated based on user preference information on the lock screen or home screen.

[0129] FIG. 7A is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether a set value of an electronic device is achieved according to an embodiment.

[0130] Referring to FIG. 7A, the electronic device (101) (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a first image (710) or video generated to correspond to a condition before the target step is achieved, as a lock screen or home screen, when the event is 15,000 steps walked as set through a health application. For example, the first image (710) or video may include a specific character (711) walking. According to one embodiment, the first image (710) may include a specific character (711) walking under the sun, based on weather information at 13:50.

[0131] According to one embodiment, the first image (710) may include current step count information (712). According to one embodiment, the first image (710) may further include current temperature or current weather information.

[0132] According to one embodiment, the first image (710) may include information about a scheduled rest time based on at least one of continuous exercise amount or current weather.

[0133] FIG. 7b is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether a set value of an electronic device is achieved according to an embodiment.

[0134] Referring to FIG. 7B, if the event is 15,000 steps set through a health application, the electronic device (101) may display a second image (720) or video generated to correspond to the goal achievement condition on the lock screen or home screen. For example, the second image (720) or video may include an image (721) or video of crossing the finish line.

[0135] In one embodiment, the second image (720) may include information (722) indicating that the target has been achieved. In one embodiment, the second image (720) may further include at least one of the time taken to achieve the target, the number of calories burned, or the next target information.

[0136] FIG. 8 is a drawing for explaining a lock screen using a user-adaptive image displayed based on whether a set condition of an electronic device is satisfied according to an embodiment.

[0137] Referring to FIG. 8, the electronic device (101) (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may display a first image (810) or video generated to correspond to the conditions of receiving a message from a specific sender and not confirming the message, as a lock screen or home screen, if the event is a message reception from a specific sender. For example, the first image (810) or video may include an image (811) related to the specific sender. For example, if the specific sender is designated as a hospital, the first image (810) may include an image related to the hospital. According to one embodiment, if the hospital is related to a family member, the first image (810) may include an image related to the hospital where the family member is located.

[0138] In one embodiment, the first image (810) may include information (812) (e.g., an icon) indicating that the message is unconfirmed. This may allow the electronic device (101) to prompt the user to confirm the unconfirmed message.

[0139] FIG. 9A is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether multiple events are executed in an electronic device according to an embodiment.

[0140] Referring to FIG. 9A, an electronic device (101) (e.g., the electronic device (101) of FIG. 1 or the processor (120) of FIG. 1) may be in a state where a train trip is input as a first event from 8:00 to 10:41, and taking medication is input as a second event from 9:00 to 9:10. According to one embodiment, the electronic device (101) may display a first image (910) or video generated to correspond to the pre-event condition at 7:50, which is before the first and second events, as a lock screen or home screen. For example, the first image (910) or video may include a view outside a window (911) while inside a train and an image (912) of medicine on a table inside the train.

[0141] In one embodiment, the first image (910) or video may include a view outside the window (911) of clear weather, based on weather information at 7:50.

[0142] In one embodiment, the first image (910) or video may include information (913) of a second event that is an upcoming event.

[0143] According to one embodiment, the first image (910) or video may include current situation information including at least one of time remaining until the end of the train journey of the electronic device (101), current temperature, or current weather information.

[0144] FIG. 9b is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether multiple events are executed in an electronic device according to an embodiment.

[0145] Referring to FIG. 9B, the electronic device (101) may display a second image (920) or video corresponding to a condition indicating that a second event, medication, is imminent, on the lock screen or home screen at 8:58 AM, while the first event, train travel, is in progress. For example, the second image (920) or video may include a medicine image (921) as a whole.

[0146] In one embodiment, the second image (920) or video may include information (922) of a second event, which is an upcoming event. For example, the second image (920) or video may be displayed with emphasis, such as by adding highlights to the information (922) of the second event.

[0147] FIG. 9c is a diagram illustrating a lock screen using a user-adaptive image displayed based on whether multiple events are executed in an electronic device according to an embodiment.

[0148] Referring to FIG. 9c, the electronic device (101) may display a third image (930) or video generated to correspond to a condition in which the first event is running at 9:20 AM and the second event is occurring after the first event, as a lock screen or home screen. For example, the third image (930) or video may include an image (931) of a train on railroad tracks.

[0149] In one embodiment, the third image (930) or video may include an image (931) of a train on railroad tracks in clear weather, based on weather information at 9:20.

[0150] According to one embodiment, the third image (930) or the video electronic device (101) may include current situation information (932) including at least one of current temperature or current weather information.

[0151] FIG. 10 is a diagram illustrating an operation of displaying a user-adaptive image on a wearable electronic device according to one embodiment.

[0152] Referring to FIG. 10, an electronic device (e.g., an electronic device (101) of FIG. 1 or a processor (120) of FIG. 1) can transmit data to an external electronic device (104) (e.g., an electronic device (104) of FIG. 1) connected thereto via a communication module (e.g., a communication module (190) of FIG. 1). For example, the external electronic device (104) can be a smart watch.

[0153] For example, the electronic device may transmit the generated image or video based on user preference information and event information to an external electronic device (104) so ​​that the generated image or video is displayed.

[0154] In one embodiment, the external electronic device (104) may display a first image (1010) or video generated to correspond to a pre-event condition as a lock screen or home screen. For example, the first image (1010) or video may include a specific character (1011) moving quickly. In one embodiment, the first image (1010) or video may include a specific character (1011) walking under the sun based on weather information at 10:50 AM.

[0155] According to one embodiment, the first image (1010) or video may include current situation information including at least one of information on the time required to reach a certain location, information on the expected time of arrival, current temperature, or current weather information based on the distance between the current location of the electronic device and the certain location.

[0156] In one embodiment, the first image (1010) or video may include a list of necessary items (1012) (e.g., a racket, water, towel) based on at least one of the schedule content or the current weather.

[0157] In this way, images that are appropriate for the user's context on the electronic device can be continuously generated and displayed at appropriate times, providing the user with necessary information and aesthetic satisfaction without the application having to be executed.

[0158] According to one embodiment, an electronic device may include a display and at least one processor operatively connected to the display.

[0159] In one embodiment, the at least one processor may obtain user preference information.

[0160] In one embodiment, the at least one processor may obtain, from the first application, information related to an event to be executed.

[0161] According to one embodiment, the at least one processor may obtain a plurality of conditions related to whether the event is executed.

[0162] According to one embodiment, the at least one processor may generate an image or video corresponding to each of the plurality of conditions based on the user's preference information and the event information.

[0163] According to one embodiment, the at least one processor may display an image or video corresponding to the satisfied condition on the display based on whether at least one of the plurality of conditions is satisfied.

[0164] According to one embodiment, the at least one processor may obtain the user preference information based on user input received through a settings screen of the lock screen.

[0165] According to one embodiment, the at least one processor may obtain the user preference information based on a usage history of a plurality of applications installed on the electronic device.

[0166] In one embodiment, the first application may be a calendar application.

[0167] In one embodiment, the event may be a schedule entered by a user through the calendar application.

[0168] According to one embodiment, the at least one processor can obtain the plurality of conditions before, during, and after execution of the schedule.

[0169] In one embodiment, the first application may be a health application.

[0170] In one embodiment, the event may be the achievement of an exercise goal set through the health application.

[0171] According to one embodiment, the at least one processor may obtain the plurality of conditions of before exercise, during exercise, and completion of achievement of the exercise target.

[0172] According to one embodiment, the at least one processor may receive information related to the event through a second application different from the first application.

[0173] In one embodiment, the at least one processor may further use the relevant information to generate an image or video corresponding to each of the plurality of conditions.

[0174] According to one embodiment, the electronic device may further include a memory.

[0175] According to one embodiment, the at least one processor may use the user's preference information, the event information, and the plurality of conditions as input data of an artificial intelligence model stored in the memory.

[0176] According to one embodiment, the at least one processor may obtain an image or video corresponding to each of the plurality of conditions as output data of the artificial intelligence model.

[0177] According to one embodiment, the artificial intelligence model may be learned using a plurality of images and conditions corresponding to each of the plurality of images.

[0178] According to one embodiment, the electronic device may further include a communication module.

[0179] According to one embodiment, the at least one processor may transmit an image or video corresponding to the satisfied condition to an external electronic device connected via the communication module, such that the external electronic device displays an image or video corresponding to the satisfied condition.

[0180] According to one embodiment, a method of controlling an electronic device may include an operation of obtaining user preference information.

[0181] According to one embodiment, a method of controlling an electronic device may include an operation of obtaining, from a first application, information related to an event to be executed.

[0182] According to one embodiment, a method of controlling an electronic device may include an operation of obtaining a plurality of conditions related to whether the event is executed.

[0183] According to one embodiment, a method for controlling an electronic device may include an operation of generating an image or video corresponding to each of the plurality of conditions based on the user's preference information and the event information.

[0184] According to one embodiment, a method of controlling an electronic device may include an operation of displaying an image or video corresponding to a satisfied condition based on at least one of the plurality of conditions being satisfied.

[0185] According to one embodiment, the operation of obtaining the user preference information may obtain the user preference information based on a user input received through a settings screen of the lock screen.

[0186] According to one embodiment, the operation of obtaining the user preference information may obtain the user preference information based on the usage history of a plurality of applications installed on the electronic device.

[0187] In one embodiment, the first application may be a calendar application.

[0188] In one embodiment, the event may be a schedule entered by a user through the calendar application.

[0189] According to one embodiment, the operation of acquiring the plurality of conditions may acquire the conditions before, during, and after execution of the schedule.

[0190] In one embodiment, the first application may be a health application.

[0191] In one embodiment, the event may be the achievement of an exercise goal set through the health application.

[0192] According to one embodiment, the operation of acquiring the plurality of conditions may acquire the conditions before exercise, during exercise, and completion of achievement of the exercise target.

[0193] According to one embodiment, the operation of acquiring the plurality of conditions may receive information related to the event through a second application different from the first application.

[0194] In one embodiment, the operation of acquiring the plurality of conditions may further utilize the related information to generate an image or video corresponding to each of the plurality of conditions.

[0195] In one embodiment, the operation of generating the image or video may include an operation of using the user's preference information, the event information, and the plurality of conditions as input data of an artificial intelligence model stored in a memory of the electronic device.

[0196] According to one embodiment, the operation of generating the image or video may include an operation of obtaining an image or video corresponding to each of the plurality of conditions as output data of the artificial intelligence model.

[0197] According to one embodiment, the artificial intelligence model may be learned using a plurality of images and conditions corresponding to each of the plurality of images.

[0198] According to one embodiment, the control method of the electronic device may further include an operation of transmitting an image or video corresponding to the satisfied condition to an external electronic device connected through a communication module of the electronic device, such that the external electronic device displays the image or video corresponding to the satisfied condition.

[0199] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions for an electronic device to obtain user preference information.

[0200] According to one embodiment, the one or more programs may include instructions for the electronic device to obtain, from the first application, information related to an event to be executed.

[0201] According to one embodiment, the one or more programs may include instructions for the electronic device to obtain a plurality of conditions related to whether the event is executed.

[0202] According to one embodiment, the one or more programs may include commands for the electronic device to generate images or videos corresponding to each of the plurality of conditions based on the user's preference information and the event information.

[0203] In one embodiment, the one or more programs may include commands that cause the electronic device to display an image or video corresponding to the satisfied condition on the display based on satisfaction of at least one of the plurality of conditions.

[0204] In one embodiment, the one or more programs may include commands for the electronic device to obtain user preference information based on user input received through a settings screen of a lock screen.

[0205] In one embodiment, the one or more programs may include commands for the electronic device to obtain user preference information based on a usage history of a plurality of applications installed on the electronic device.

[0206] In one embodiment, the first application may be a calendar application.

[0207] In one embodiment, the event may be a schedule entered by a user through the calendar application.

[0208] In one embodiment, the one or more programs may include instructions for the electronic device to obtain the plurality of conditions before, during, and after execution of the schedule.

[0209] In one embodiment, the first application may be a health application.

[0210] In one embodiment, the event may be the achievement of an exercise goal set through the health application.

[0211] In one embodiment, the one or more programs may include instructions for the electronic device to obtain the plurality of conditions of before exercise, during exercise, and completion of achievement of the exercise target.

[0212] According to one embodiment, the one or more programs may include instructions for the electronic device to receive information related to the event through a second application different from the first application.

[0213] In one embodiment, the one or more programs may include commands for the electronic device to further use the relevant information to generate images or videos corresponding to each of the plurality of conditions.

[0214] According to one embodiment, the electronic device may further include a memory.

[0215] According to one embodiment, the one or more programs may include commands for the electronic device to use the user's preference information, the event information, and the plurality of conditions as input data for an artificial intelligence model stored in the memory.

[0216] According to one embodiment, the one or more programs may include commands for the electronic device to obtain images or videos corresponding to each of the plurality of conditions as output data of the artificial intelligence model.

[0217] According to one embodiment, the artificial intelligence model may be learned using a plurality of images and conditions corresponding to each of the plurality of images.

[0218] According to one embodiment, the electronic device may further include a communication module.

[0219] According to one embodiment, the one or more programs may include commands for transmitting an image or video corresponding to the satisfied condition to an external electronic device connected via the communication module, such that the electronic device displays the image or video corresponding to the satisfied condition.

[0220] Electronic devices according to the embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0221] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0222] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0223] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0224] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0225] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; and At least one processor operatively connected to said display, said at least one processor comprising: Obtain user preference information, From the first application, obtain information related to the event to be executed, Obtain multiple conditions related to whether the above event is executed, Based on the user's preference information and the event information, an image or video corresponding to each of the plurality of conditions is generated, An electronic device set to display an image or video corresponding to the satisfied condition on the display based on at least one of the above conditions being satisfied.

2. In paragraph 1, At least one processor of the above, An electronic device that obtains user preference information based on user input received through a settings screen of a lock screen.

3. In paragraph 1 or 2, At least one processor of the above, An electronic device that obtains user preference information based on the usage history of multiple applications installed on the electronic device.

4. In any one of paragraphs 1 to 3, The above first application, It's a calendar application, The above event is, An electronic device, the schedule of which is entered by the user through the above calendar application.

5. In paragraph 4, At least one processor of the above, An electronic device that obtains the conditions before, during, and after execution of the above schedule.

6. In any one of paragraphs 1 to 3, The above first application, It's a health application, The above event is, An electronic device that achieves exercise goals set through the above health application.

7. In paragraph 6, At least one processor of the above, An electronic device that obtains the conditions of before exercise, during exercise, and completion of the exercise target.

8. In any one of paragraphs 1 to 7, At least one processor of the above, Through the first application and a second application different from the first application, information related to the event is received, An electronic device that further uses the above related information to generate images or videos corresponding to each of the above multiple conditions.

9. In any one of paragraphs 1 to 8, memory; including more; At least one processor of the above, The above user's preference information, the above event information, and the above multiple conditions are used as input data for the artificial intelligence model stored in the above memory. Obtain images or videos corresponding to each of the above conditions as output data of the above artificial intelligence model, The above artificial intelligence model is, An electronic device that is learned using a plurality of images and conditions corresponding to each of the plurality of images.

10. In any one of paragraphs 1 to 9, further comprising a communication module; At least one processor of the above, An electronic device that transmits an image or video corresponding to at least one satisfied condition to an external electronic device, such that the external electronic device connected through the communication module displays an image or video corresponding to the satisfied condition.

11. In a method for controlling an electronic device, An action to obtain user preference information; An action to obtain information related to an event to be executed from a first application; An action for obtaining multiple conditions related to whether the above event is executed; An operation of generating an image or video corresponding to each of the plurality of conditions based on the user's preference information and the event information; and A method for controlling an electronic device, comprising: an operation of displaying an image or video corresponding to a satisfied condition based on at least one of the above conditions being satisfied.

12. In paragraph 11, The action of obtaining the above user preference information is: A control method of an electronic device, wherein the user preference information is obtained based on user input received through a settings screen of a lock screen.

13. In paragraph 11 or 12, The action of obtaining the above user preference information is: A method for controlling an electronic device, wherein the user preference information is obtained based on the usage history of multiple applications installed on the electronic device.

14. In any one of paragraphs 11 to 13, The above first application, It's a calendar application, The above event is, A method of controlling an electronic device, the schedule being entered by the user through the above calendar application.

15. In paragraph 14, The operation of obtaining the above multiple conditions is: A method for controlling an electronic device, wherein the above schedule is obtained before, during, and after execution by the above multiple conditions.

Images