Electronic device, method, and non-transitory computer-readable storage medium for displaying screen including widget
Patent Information
- Application Number
- PCT/KR2026/000384
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-06-27
- Filing Date
- 2026-01-07
- Publication Date
- 2026-08-27
Smart Images

Figure KR2026000384_27082026_PF_FP_ABST
Abstract
Description
Electronic device for displaying a screen including widgets, method, and non-transient computer-readable storage medium
[0001] The following descriptions relate to an electronic device, a method, and a non-transient computer-readable storage medium for displaying a screen including widgets.
[0002] A lock state may be a state intended to prevent an electronic device from executing functions outside the user's intent or to prevent another user from accessing the electronic device. In a locked state, the electronic device may display a lock screen. The lock screen may display pre-specified information (e.g., time or notifications) on a wallpaper (or background image).
[0003] An electronic device is disclosed. The electronic device may include at least one processor comprising a display and a processing circuit; and a memory comprising one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the display to show a screen comprising two widget areas through the display. A first widget of a first application may be displayed in the first widget area of the two widget areas, and a second widget of a second application may be displayed in the second widget area of the two widget areas. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause, while displaying the screen, to cause an artificial intelligence assistance application distinct from the first application and the second application to: identify an event based on user data, and, according to the identification of the event, to create a third widget using the user data. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the third widget to be displayed in the first widget area instead of the first widget among the two widget areas.
[0004] A method is disclosed. The method may be performed by an electronic device including a display. The method may include an operation of displaying a screen including two widget areas through the display. A first widget of a first application may be displayed in a first widget area among the two widget areas, and a second widget of a second application may be displayed in a second widget area among the two widget areas. While displaying the screen, the method may include, through an artificial intelligence assistance application distinct from the first application and the second application: an operation of identifying an event based on user data; an operation of generating a third widget using the user data according to the identification of the event; and an operation of displaying the third widget in place of the first widget in the first widget area among the two widget areas.
[0005] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may store a program comprising instructions. When the instructions are executed individually or collectively by at least one processor of an electronic device comprising a display, the electronic device may cause the electronic device to display a screen comprising two widget areas through the display. A first widget of a first application may be displayed in the first widget area of the two widget areas, and a second widget of a second application may be displayed in the second widget area of the two widget areas. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause, while displaying the screen, to cause an artificial intelligence assistance application distinct from the first application and the second application to: identify an event based on user data, and, according to the identification of the event, create a third widget using the user data. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the third widget to be displayed in the first widget area instead of the first widget among the two widget areas.
[0006] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
[0007] FIG. 2 is a drawing illustrating examples of screens displayed by an electronic device according to one embodiment.
[0008] FIG. 3 is a block diagram of an electronic device according to one embodiment.
[0009] FIG. 4 is a drawing illustrating an example of a screen displayed by an electronic device according to one embodiment.
[0010] FIGS. 5A and FIGS. 5B are drawings illustrating examples of screens displayed by an electronic device according to one embodiment.
[0011] FIG. 6 is a drawing illustrating an example of a screen displayed by an electronic device according to one embodiment.
[0012] FIGS. 7a, FIGS. 7b, FIGS. 7c, and FIGS. 7d are drawings illustrating examples of screens displayed by an electronic device according to one embodiment.
[0013] FIG. 8 is a drawing illustrating an example of a screen displayed by an electronic device according to one embodiment.
[0014] FIG. 9 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0015] FIG. 10 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0016] FIG. 11a is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0017] FIG. 11b is a diagram illustrating the operation of an electronic device processing data according to one embodiment.
[0018] FIG. 12 is a drawing illustrating an example of a screen that an electronic device displays according to a situation, according to one embodiment.
[0019] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.
[0020] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0021] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0022] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0023] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0024] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0025] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0026] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0027] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0028] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0029] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0030] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0031] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0032] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0033] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0034] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0035] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0036] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0037] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 664 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 6 ms or less) for realizing URLLC.
[0038] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0039] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0040] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0041] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0042] FIG. 2 is a drawing illustrating examples of screens displayed by an electronic device according to one embodiment.
[0043] Referring to FIG. 2, the electronic device (101) may display a widget screen (210) including two widget regions (211, 215). For example, the electronic device (101) may display a widget screen (210) including two widget regions (211, 215) through a display (260) based on the fulfillment of a specified condition. For example, the specified condition may be a condition for displaying a widget screen (210) including two widget regions (211, 215) through a display (260).
[0044] For example, the electronic device (101) may determine that a specified condition is satisfied based on turning on the display (260) while the electronic device (101) is in a locked state. For example, the electronic device (101) may determine that a specified condition is satisfied based on turning on the display (260) while the electronic device (101) is in a charging state. In one embodiment, the locked state may be a state in which access to the electronic device (101) is restricted. In one embodiment, restricted access to the electronic device (101) may include restricting the execution of applications other than allowed applications. In one embodiment, restricted access to the electronic device (101) may include restricting the display of information other than allowed information. In one embodiment, the lock screen may refer to a screen displayed on the display (260) while in a locked state. In the following, a state (or mode) in which a lock screen (or an AoD (always on display) screen switched from the lock screen) is displayed may be referred to as a normal mode. In the following, a state (or mode) in which screens (210, 240, 250) including a widget screen (210) (or an AoD screen switched from the widget screen (210)) are displayed may be referred to as a hub mode.
[0045] In one embodiment, two widget areas (211, 215) within the widget screen (210) may occupy most of the area of the widget screen (210). For example, each of the two widget areas (211, 215) may be a square (with rounded corners).
[0046] In one embodiment, two widget regions (211, 215) within the widget screen (210) may be arranged side by side within the widget screen (210) along the major axis direction (201) of the widget screen (210). In one embodiment, two widget regions (211, 215) within the widget screen (210) may be arranged to face each other with respect to the minor axis direction (205) of the widget screen (210).
[0047] In one embodiment, the electronic device (101) may selectively display different widgets in a first widget area (211) and a second widget area (215). In one embodiment, the electronic device (101) may display one widget in the first widget area (211) from a first set of widgets (221, 223, 225) which are set to be selectively displayed with respect to the first widget area (211). In one embodiment, the electronic device (101) may display one widget in the second widget area (215) from a second set of widgets (231, 233, 235, 237) which are set to be selectively displayed with respect to the second widget area (215).
[0048] In one embodiment, the widget may be classified as an information widget, a management widget, or a hybrid widget for information and management. In one embodiment, the information widget may display information elements provided by the application associated with the widget (e.g., current weather, information on the currently playing song, step count, exercise time). In one embodiment, the management widget may display function elements provided by the application associated with the widget (e.g., play next song, pause, answer call, hang up call). For example, the electronic device (101) may control some functions of the application associated with the widget in response to a selection of function elements provided by the management widget. In one embodiment, the hybrid widget may display information elements and function elements provided by the application associated with the widget. For example, the widget may be referred to as a mini-application for the application associated with the widget.
[0049] For example, a widget may include one or more objects to display information (or notifications) generated by an application. For example, one or more objects may include images and / or text.
[0050] For example, the electronic device (101) may display a selected widget from a first set of widgets (221, 223, 225) in the first widget area (211) according to an input (e.g., a swipe input) to the first widget area (211). For example, the electronic device (101) may display the widget (223 or 225) following the widget (221) according to a swipe input to the first widget area (211) where the widget (221) is displayed. For example, the electronic device (101) may display the widget (223) instead of the widget (221) in the first widget area (211) according to a downward swipe input to the first widget area (211) where the widget (221) is displayed. For example, the electronic device (101) may display a widget (225) instead of a widget (221) in the first widget area (211) in response to an upward swipe input to the first widget area (211) where the widget (221) is displayed.
[0051] For example, the electronic device (101) may display a selected widget from a second set of widgets (231, 233, 235, 237) in the second widget area (215) according to an input (e.g., a swipe input) to the second widget area (215). For example, the electronic device (101) may display the widget (233 or 235) following the widget (231) according to a swipe input to the second widget area (215) where the widget (231) is displayed. For example, the electronic device (101) may display the widget (233) instead of the widget (231) in the second widget area (215) according to a downward swipe input to the second widget area (215) where the widget (231) is displayed. For example, the electronic device (101) may display a widget (235) instead of a widget (231) in the second widget area (215) in response to an upward swipe input to the second widget area (215) where the widget (231) is displayed.
[0052] In one embodiment, the widgets (221, 223, 225, 231, 233, 235, 237) may be widgets of different applications. For example, the widgets (221, 225) may be widgets of an application associated with a schedule. For example, widget (223) may be a widget of a clock application. For example, widget (231) may be a widget of a map application. For example, widget (233) may be a widget of a weather application. For example, widget (235) may be a widget of a media player. For example, widget (237) may be a widget of a calendar application.
[0053] In one embodiment, the electronic device (101) may display another screen instead of the widget screen (210) based on user input (e.g., swipe input) while specified conditions are met. For example, the other screen may include a screen (240) displaying a photo and / or a screen (250) displaying a clock (e.g., a digital or analog clock). In one embodiment, the electronic device (101) may display the widget screen (210) instead of the other screen (240, 250) based on user input (e.g., swipe input) while specified conditions are met.
[0054] For example, the screen (240) for displaying photos may be a screen that sequentially displays one or more photos at specified time intervals. In one embodiment, the screen (240) for displaying photos may include one or more information elements (e.g., a clock).
[0055] For example, the electronic device (101) may display a screen (241) containing a family photo instead of a widget screen (210) while specified conditions are met. For example, the electronic device (101) may display a screen (245) containing a landscape photo instead of a widget screen (210) while specified conditions are met. For example, the electronic device (101) may change the photo within the screen displayed on the display (260) at specified time intervals. For example, the electronic device (101) may display a screen containing a different photo instead of the screen displayed on the display (260) depending on a swipe input for the screen displayed on the display (260). For example, the electronic device (101) may display a screen (245) containing a landscape photo instead of the screen (241) depending on a swipe input for the screen (241) containing a family photo.
[0056] For example, the screen (250) displaying the clock may be a screen displaying the current weather and / or the current time. In one embodiment, the screen (250) displaying the photo may include one or more information elements (e.g., weather information).
[0057] For example, the screen (250) displaying the clock may be a screen depicting the current weather. For example, the electronic device (101) may display a screen (251) containing a background depicting the current weather (e.g., clear daytime) and a digital clock instead of the widget screen (210) while specified conditions are met. For example, the electronic device (101) may display a screen (255) containing a background depicting the current weather (e.g., dark nighttime) and a digital clock instead of the widget screen (210) while specified conditions are met. For example, the electronic device (101) may display the screen (255) instead of the screen (251) depending on a swipe input to the screen (251).
[0058] In one embodiment, while displaying a widget screen (210) comprising two widget areas (211, 215), the electronic device (101) may change a widget displayed in at least one of the two widget areas (211, 215) according to an event. For example, the electronic device (101) may display a new widget (or a widget not set for the two widget areas (211, 215)) according to an event instead of a first set of widgets (221, 223, 225) and / or a second set of widgets (231, 233, 235, 237). Below, with reference to FIGS. 3 to 7d, an operation in which the electronic device (101) displays a new widget not set in a widget area may be described.
[0059] FIG. 3 is a block diagram of an electronic device according to one embodiment. FIG. 4 is a drawing illustrating an example of a screen displayed by an electronic device according to one embodiment. FIG. 5a and FIG. 5b are drawings illustrating examples of a screen displayed by an electronic device according to one embodiment.
[0060] Referring to FIG. 3, the electronic device (101) may include a processor (120), memory (130), an interface (177), a display (260), and a sensor (376). In one embodiment, the display (260) may correspond to the display module (160) of FIG. 1. In one embodiment, the sensor (376) may correspond to the sensor module (176) of FIG. 1.
[0061] In one embodiment, the electronic device (101) can obtain power from an external electronic device (301). For example, the electronic device (101) can obtain wired power and / or wireless power from an external electronic device (301) connected via a wired and / or wireless connection through an interface (177).
[0062] In one embodiment, the electronic device (101) can identify the orientation of the electronic device (101) through the sensor (376). For example, the orientation of the electronic device (101) may include a landscape and / or a portrait. For example, a landscape orientation may indicate an orientation of the electronic device (101) in which the major axis of the display (260) of the electronic device (101) is substantially parallel to the ground and the minor axis of the display (260) is substantially perpendicular to the ground. For example, a portrait orientation may indicate an orientation of the electronic device (101) in which the major axis of the display (260) of the electronic device (101) is substantially perpendicular to the ground and the minor axis of the display (260) is substantially parallel to the ground.
[0063] In one embodiment, the electronic device (101) can identify the mounting state of the electronic device (101) through a sensor (376). In one embodiment, the mounting state of the electronic device (101) may indicate a state in which the user is not holding the electronic device (101), identified through a grip sensor. In one embodiment, the mounting state of the electronic device (101) may indicate an upright state of the electronic device (101) (e.g., a state in which the direction of the display (260) is not parallel to the ground), identified through a gyro sensor.
[0064] In one embodiment, the memory (130) may include applications (311, 312, 313), an artificial intelligence (AI) module (320), user data (330), device data (340), and application data (350).
[0065] In one embodiment, the applications (311, 312, 313) may be widgets of general applications (e.g., schedule-related applications, clock applications, map applications, weather applications, media players, calendar applications, web browsers, and / or social media applications). For example, the general applications may be applications distinct from AI assistant applications.
[0066] In one embodiment, the AI module (320) may be an AI assistance application. In one embodiment, the AI module (320) may be associated with a system UI (user interface) associated with an operating system of the electronic device (101) (e.g., the operating system (142) of FIG. 1) and / or middleware (e.g., the middleware (144) of FIG. 1). For example, the fact that the AI module (320) is associated with a system UI may indicate that it can provide elements for displaying the overall UI (e.g., a lock screen, a home screen, a navigation bar, etc.). In one embodiment, the AI module (320) may monitor applications (311, 312, 313) (or a featured artificial intelligence module within the applications (311, 312, 313)) and, based on the monitoring results, display information to be provided to the user.
[0067] In one embodiment, the AI module (320) may acquire input based on natural language and / or output output based on natural language. For example, the AI module (320) may be an application that causes an AI model trained on vast data to generate output through input based on natural language (e.g., a prompt) and provides the generated output.
[0068] In one embodiment, the AI module (320) may include an AI model comprising at least one parameter associated with a neural network having a structure based on an encoder and / or decoder, such as a transformer. In one embodiment, the AI module (320) may include a bidirectional model based on learning about an encoder (e.g., BERT (bidirectional encoder representations from transformers)), or an auto-encoding model (e.g., a diffusion model). In one embodiment, the AI module (320) may include an auto-regressor model based on learning about a decoder (e.g., GPT (generative pre-trained transformer)). In one embodiment, the AI module (320) may include a sequence-to-sequence model based on learning about an encoder and / or decoder (e.g., stable diffusion, DALL-E 2). In one embodiment, the AI module (320) may include a large language model (LLM) for processing natural language based on massive parameters. In one embodiment, the AI module (320) may be a vision-language model for processing images and text (e.g., a contrastive language-image pre-training model, CLIP model). However, it is not limited thereto. The AI module (320) may include at least one parameter for driving a neural network such as a convolutional neural network (CNN), a recurrent neural network (RNN), a feedforward neural network (FNN), and / or a long short-term memory (LSTM).
[0069] In one embodiment, the AI module (320) may be an on-device model that is stored in memory (130) and executable via a processor (120). However, it is not limited thereto. The AI module (320) may be a cloud computing-based model that is stored in an external server (e.g., server (108) of FIG. 1) and executable via a processor of the server (108), with the execution result provided to the electronic device (101).
[0070] In one embodiment, the AI module (320) can generate a widget. In one embodiment, the AI module (320) can generate a widget while a widget screen (e.g., the widget screen (210) of FIG. 2) including two widget areas (e.g., two widget areas (211, 215) of FIG. 2) is displayed through the display (260).
[0071] In one embodiment, the AI module (320) can identify an event for creating a widget. In one embodiment, the AI module (320) can identify an event for creating a widget based on user data (330), device data (340), and / or application data (350). For example, the AI module (320) can identify an event for creating a widget to guide the user's schedule. For example, the AI module (320) can identify an event for creating a widget associated with a mode (or routine) of the electronic device (101) depending on whether the electronic device (101) is located at a specified location or / or the current time is a specified time. In one embodiment, the mode (or routine) of the electronic device (101) may be in a state where functions related to do not disturb, app usage restriction, power consumption (e.g., sleep mode), and / or sound mode (or volume) are set depending on the current activity, location, or situation. For example, a mode (or routine) may include modes for sleep, movie theater, driving, exercise, rest, or work.
[0072] In one embodiment, the AI module (320) may refrain from creating a widget based on an event while a screen (240) displaying a photo and / or a screen (250) displaying a clock is displayed on the display (260). In one embodiment, the AI module (320) may create a widget based on an event while a widget screen (210) is displayed instead of the screens (240, 250). For example, the AI module (320) may display the widget screen (210) upon receiving user input to display the widget screen (210) while the screens (240, 250) are displayed. Subsequently, the AI module (320) may create a widget to be displayed on the widget screen (210) based on an event identified while the screens (240, 250) are displayed and / or while the widget screen (210) is displayed. In one embodiment, the AI module (320) can set one or more objects included in a widget to be displayed on a widget screen (210) differently depending on the location of the electronic device (101), the state of the user, and / or a mode (or routine).
[0073] In one embodiment, user data (330) may include the user's schedule (e.g., appointment location, appointment time, appointment partner, purpose of appointment), and / or personal information (e.g., age, gender, name, hobbies, preferences, occupation, school, family). For example, user data (330) may include information entered directly by the user and / or information collected with the user's permission (through applications (311, 312, 313)).
[0074] In one embodiment, the device data (340) may include information indicating the states of the electronic device (101) (e.g., location, time, battery, charge status). In one embodiment, the application data (350) may include information obtained from the outside through applications (311, 312, 313) (e.g., a history of messaging with an external electronic device (e.g., 102 of FIG. 1) via social media).
[0075] Hereinafter, with reference to FIGS. 4, FIGS. 5a and FIGS. 5b, the operation of an electronic device (101) while displaying a widget screen including two widget areas (211, 215) can be described.
[0076] Referring to the state (401) of FIG. 4, the electronic device (101) can display a widget screen (411) through a display (260) (e.g., the display module (160) of FIG. 1).
[0077] In one embodiment, the electronic device (101) may display a widget screen (411) as specified conditions are met. For example, specified conditions may include the locking state of the electronic device (101) and / or obtaining power from an external electronic device (301).
[0078] For example, the electronic device (101) can display a widget screen (411) while the electronic device (101) is locked. For example, the electronic device (101) can display a widget screen (411) while the electronic device (101) is receiving power from an external electronic device (301).
[0079] In one embodiment, set widgets may be displayed in a first widget area (211) and a second widget area (215) within the screen (411). For example, the electronic device (101) may display one widget from a first set of widgets set to be selectively displayed in the first widget area (211) within the screen (411) in the first widget area (211). For example, the electronic device (101) may display one widget from a second set of widgets set to be selectively displayed in the second widget area (215) within the screen (411) in the second widget area (215).
[0080] For example, the electronic device (101) can display the next widget among the first set of widgets in the first widget area (211) according to an input in the long axis direction of the display (260) for the first widget area (211) (e.g., swipe input, or pan input). For example, the electronic device (101) can display the next widget among the second set of widgets in the second widget area (211) according to an input in the long axis direction of the display (260) for the second widget area (215) (e.g., swipe input, or pan input).
[0081] In one embodiment, the electronic device (101) can display a widget screen (411) in a landscape position of the electronic device (101).
[0082] In one embodiment, referring to the state (405) of FIG. 4, the electronic device (101) may display a widget screen (415) instead of a widget screen (411) as the posture of the electronic device (101) changes from a landscape posture to a portrait posture. In one embodiment, the electronic device (101) may display a widget screen (415) instead of a widget screen (411) as the posture of the electronic device (101) changes from a landscape posture to a portrait posture while a specified condition is met.
[0083] In one embodiment, as the posture of the electronic device (101) changes from a landscape posture to a portrait posture, the widgets displayed in the first widget area (211) and the second widget area (215) respectively within the screen (411) can be displayed in the first widget area (211) and the second widget area (215) respectively within the screen (415).
[0084] For example, the electronic device (101) can display the next widget among the first set of widgets in the first widget area (211) according to input in the short direction of the display (260) for the first widget area (211) (e.g., swipe input, or pan input). For example, the electronic device (101) can display the next widget among the first set of widgets in the second widget area (211) according to input in the short direction of the display (260) for the second widget area (215) (e.g., swipe input, or pan input).
[0085] In one embodiment, referring to FIG. 5a, the electronic device (101) may display a lock screen (511) instead of a widget screen (411) in a landscape position when a specified condition is not met. In one embodiment, the lock screen may include a wallpaper (or background image). In one embodiment, the lock screen may include a visual object indicating a locked state (e.g., a lock image) and / or a visual object indicating an area for obtaining biometric information (e.g., a fingerprint image). In one embodiment, the lock screen may include interactive objects (e.g., at least one widget (521), and / or one or more icons (523, 525)).
[0086] For example, the electronic device (101) may display a lock screen (511) instead of a widget screen (411) when power acquisition from an external electronic device (301) is interrupted in state (401). However, the embodiments are not limited thereto. For example, the electronic device (101) may display a lock screen (511) instead of a widget screen (411) even while a specified condition is met. For example, the electronic device (101) may display a lock screen (511) instead of a widget screen (411) based on user input even while a specified condition is met. For example, user input may be an input that causes the display of the lock screen (511) (e.g., a push on the power button).
[0087] For example, when the lock screen (511) is displayed, the widget screen (411) may be located on page -1 of the lock screen (511). For example, the widget screen (411) being located on page -1 of the lock screen (511) may indicate that it is located on a page at a specific position (e.g., left position) among the pages movable from the lock screen (511).
[0088] For example, in a state (501) where a lock screen (511) is displayed, the electronic device (101) may display a widget screen (411) instead of the lock screen (511) according to user input (531) for the lock screen (511). For example, the electronic device (101) may display a widget screen (411) instead of the lock screen (511) according to a first swipe input (from right to left) for the lock screen (511).
[0089] For example, in a state (503) where the widget screen (411) is displayed, the electronic device (101) may display a lock screen (511) instead of the widget screen (411) depending on other user inputs for the widget screen (411). For example, the electronic device (101) may display a lock screen (511) instead of the widget screen (411) depending on a second swipe input (from left to right) in the opposite direction to the first swipe input for the widget screen (411).
[0090] For example, in a state (501) where the lock screen (511) is displayed, the electronic device (101) may display a widget screen (411) instead of the lock screen (511) as specified conditions are met. For example, in a state (501) where the lock screen (511) is displayed, the electronic device (101) may display a widget screen (411) instead of the lock screen (511) as power is obtained from an external electronic device (301).
[0091] According to an embodiment, the electronic device (101) may display the home screen instead of the widget screen (411) as it is unlocked in a landscape position. For example, while the home screen is displayed, the widget screen (411) may be located on page -1 of the home screen. For example, the widget screen (411) being located on page -1 of the home screen may indicate that it is located on a page at a specific position (e.g., left position) among the pages movable from the home screen. For example, while the home screen is displayed, the electronic device (101) may display the widget screen (411) instead of the home screen in response to a first swipe input (from right to left) for the home screen. For example, while the widget screen (411) is displayed, the home screen may be displayed instead of the widget screen (411) in response to a second swipe input (from left to right) in the opposite direction to the first swipe input for the widget screen (411).
[0092] In one embodiment, referring to FIG. 5b, the electronic device (101) may display a lock screen (515) instead of a widget screen (415) when a specified condition is not met in a portrait pose. In one embodiment, the lock screen may include interactive objects (e.g., at least one widget (521), and / or one or more icons (523, 525)).
[0093] For example, the electronic device (101) may display a lock screen (515) instead of a widget screen (415) when power acquisition from an external electronic device (301) is interrupted in state (405). However, the embodiments are not limited thereto. For example, the electronic device (101) may display a lock screen (515) instead of a widget screen (415) even while a specified condition is met. For example, the electronic device (101) may display a lock screen (515) instead of a widget screen (415) based on user input even while a specified condition is met. For example, user input may be an input that causes the display of the lock screen (515) (e.g., a push on the power button).
[0094] For example, when the lock screen (515) is displayed, the widget screen (415) may be located on page -1 of the lock screen (515). For example, the widget screen (415) being located on page -1 of the lock screen (515) may indicate that it is located on a page at a specific position (e.g., left position) among the pages movable from the lock screen (515).
[0095] For example, in a state (505) where a lock screen (515) is displayed, the electronic device (101) may display a widget screen (415) instead of the lock screen (515) according to user input (531) for the lock screen (515). For example, the electronic device (101) may display a widget screen (415) instead of the lock screen (515) according to a first swipe input (from right to left) for the lock screen (515).
[0096] For example, in a state (507) where the widget screen (415) is displayed, the electronic device (101) may display the lock screen (515) instead of the widget screen (415) depending on other user inputs for the widget screen (415). For example, the electronic device (101) may display the lock screen (515) instead of the widget screen (415) depending on a second swipe input (from left to right) in the opposite direction to the first swipe input for the widget screen (415).
[0097] For example, in a state (505) where the lock screen (515) is displayed, the electronic device (101) may display a widget screen (415) instead of the lock screen (515) as specified conditions are met. For example, in a state (505) where the lock screen (515) is displayed, the electronic device (101) may display a widget screen (415) instead of the lock screen (515) as power is obtained from an external electronic device (301).
[0098] According to an embodiment, the electronic device (101) may display the home screen instead of the widget screen (415) as it is unlocked in a portrait position. For example, while the home screen is displayed, the widget screen (415) may be located on page -1 of the home screen. For example, the widget screen (415) being located on page -1 of the home screen may indicate that it is located on a page at a specific position (e.g., left position) among the pages movable from the home screen. For example, while the home screen is displayed, the electronic device (101) may display the widget screen (415) instead of the home screen in response to a first swipe input (from right to left) for the home screen. For example, while the widget screen (415) is displayed, the home screen may be displayed instead of the widget screen (415) in response to a second swipe input (from left to right) in the opposite direction to the first swipe input for the widget screen (415).
[0099] Hereinafter, with reference to FIGS. 6, 7a, 7b, 7c, and 7d, an operation in which an electronic device (101) displays a widget through an AI module (320) while displaying a widget screen including two widget areas (211, 215) can be described.
[0100] FIG. 6 is a drawing illustrating an example of a screen displayed by an electronic device according to one embodiment.
[0101] FIG. 6 can be explained with reference to FIGS. 1 to 5b.
[0102] Referring to FIG. 6, in state (601), the electronic device (101) may display a widget screen (411) including a first widget (611) in a first widget area (211) and a second widget (615) in a second widget area (215). In one embodiment, state (601) may indicate a state in which a specified condition for displaying the widget screen (411) is satisfied. In one embodiment, the first widget (611) may be a widget of an application (311). In one embodiment, the second widget (615) may be a widget of an application (312). For example, the application (311) may be a media player, and the application (312) may be a clock application.
[0103] In one embodiment, the electronic device (101) can collect and / or identify information through an AI module (320). For example, the AI module (320) can collect and / or identify information associated with widgets (611, 615) displayed in widget areas (211, 215). For example, the AI module (320) can identify information about a first widget (611) displayed in a first widget area (211) and / or an application (311) associated with the first widget (611). For example, information about the first widget (611) displayed in the first widget area (211) may include information displayed through the first widget (611) (e.g., information about media content being played). For example, information about an application (311) associated with the first widget (611) may include information about the application name, application type, and / or application function. In the following, information regarding the first widget (611) and / or the application (311) associated with the first widget (611) displayed in the first widget area (211) may be referred to as the first widget information.
[0104] For example, the AI module (320) can identify information about a second widget (615) displayed in the second widget area (215) and / or an application (312) associated with the second widget (615). For example, information about the second widget (615) displayed in the second widget area (215) may include information displayed through the second widget (615) (e.g., visual information). For example, information about an application (312) associated with the second widget (615) may include information about the application name, application type, and / or application function. In the following, information about the second widget (615) displayed in the second widget area (215) and / or an application (312) associated with the second widget (615) may be referred to as second widget information.
[0105] For example, the AI module (320) can collect and / or identify user data (330), device data (340), and / or application data (350).
[0106] In one embodiment, the electronic device (101) can determine whether to display a new widget on the screen (411) through the AI module (320).
[0107] In one embodiment, the electronic device (101) can determine whether to display a widget for suggestions on the screen (411) through the AI module (320). For example, the widget may be a widget for suggesting the execution of a new application, suggesting new content, suggesting external activities (e.g., exercise, attending a meeting), suggesting daily activities of the user (e.g., sleeping), and / or suggesting the termination of the execution of applications for power management of the electronic device (101). For example, the AI module (320) can determine whether to display the widget on the screen (411) as first widget information and / or second widget information are input as a prompt. For example, the AI module (320) can determine whether to display the widget on the screen (411) as first widget information, second widget information, user data (330), device data (340), and / or application data (350) are input as a prompt.
[0108] For example, the AI module (320) may generate a new widget (620) for a suggestion based on determining to display a widget for a suggestion. For example, the AI module (320) may identify one or more objects to be included in the new widget (620) for a suggestion. For example, in the case of a suggestion for new content, one or more objects to be included in the new widget (620) may include information about the new content (e.g., name, release date, creator), and / or information about a media player for playing the new content (e.g., name, and / or icon).
[0109] For example, the AI module (320) may obtain information (or associated data) about one or more objects to be included in a new widget (620) for a proposal from an associated application. In one embodiment, the associated application may be a media player for playing new content. In one embodiment, the associated application may be an application (or database) for providing information about new content.
[0110] For example, the AI module (320) can generate a new widget (620) for a proposal by inputting information obtained into one or more objects within a layout associated with the new widget (620).
[0111] For example, the AI module (320) can create a new widget (620) through the application (313) based on its decision to display a widget for a proposal. For example, the AI module (320) can instruct the application (313) associated with the new widget (620) for a proposal to create the new widget (620) based on its decision to display a widget for a proposal. For example, the AI module (320) can identify the application (313) that will create the new widget (620) for a proposal. For example, as the application (313) is identified, the AI module (320) can request the application (313) to create the new widget (620).
[0112] In one embodiment, with reference to state (605), the AI module (320) may display (or overlay) a new widget (620) on the first widget area (211) and / or the second widget area (215). For example, the AI module (320) may display (or overlay) a new widget (620) on the first widget area (211) that suggests content associated with the content of the first widget (611) within the first widget area (211).
[0113] In one embodiment, the electronic device (101) may execute an application (313) associated with the new widget (620) in accordance with user input (e.g., press input) for the new widget (620). For example, if the AI module (320) creates the new widget (620), the AI module (320) may display a new screen on the display (260) instead of the screen (411) in accordance with user input (e.g., press input) for the new widget (620). In one embodiment, the new screen may include a screen created by the AI module (320) and / or a screen created by another application by the AI module (320) instructing another application.
[0114] For example, if an application (313) other than the AI module (320) creates a new widget (620), the application (313) can display the screen of the application (313) on the display (260) instead of the screen (411) according to user input (e.g., press input) for the new widget (620).
[0115] FIGS. 7a, FIGS. 7b, FIGS. 7c, and FIGS. 7d are drawings illustrating examples of screens displayed by an electronic device according to one embodiment.
[0116] FIGS. 7a, FIGS. 7b, FIGS. 7c, and FIGS. 7d can be explained with reference to FIGS. 1 through 6.
[0117] Referring to FIG. 7a, in state (601), the electronic device (101) can display a widget screen (411) including a first widget (611) in a first widget area (211) and a second widget (615) in a second widget area (215).
[0118] In one embodiment, the electronic device (101) can collect and / or identify information through the AI module (320). For example, the AI module (320) can collect and / or identify user data (330), device data (340), and / or application data (350).
[0119] In one embodiment, the electronic device (101) can determine whether to display a new widget on the screen (411) through the AI module (320).
[0120] In one embodiment, the electronic device (101) can determine whether to display a new widget in the widget areas (211, 215) within the screen (411) through the AI module (320). For example, the new widget may be a widget that is distinct from the first set of widgets set in the first widget area (211) and / or the second set of widgets set in the second widget area (215). For example, the new widget may be a widget for playing new content, a widget for providing information about external activities (e.g., exercise, attending a meeting, attending an appointment), and / or a widget for providing information about the user's daily activities (e.g., sleeping). For example, the AI module (320) can determine whether to display the new widget within the screen (411) as the first widget information, the second widget information, user data (330), device data (340), and / or application data (350) are input as a prompt.
[0121] For example, the AI module (320) can generate a new widget (711) based on a decision to display a new widget.
[0122] For example, the AI module (320) can identify one or more objects to be included in the new widget (711). For example, in the case of providing information about an external activity, one or more objects to be included in the new widget (620) may include information about the schedule (e.g., destination, appointment time, attendees), and / or information about the destination (e.g., weather at the destination, method of getting to the destination).
[0123] For example, the AI module (320) may obtain information (or associated data) about one or more objects to be included in the new widget (711) from an associated application. In one embodiment, the associated application may be a schedule application for recording schedule information. In one embodiment, the associated application may be an application that provides traffic information for traveling to a destination. In one embodiment, the associated application may be an application that provides the weather of the destination.
[0124] For example, the AI module (320) can generate a new widget (711) for a proposal by inputting information obtained into one or more objects within a layout associated with the new widget (711).
[0125] For example, the AI module (320) may create a new widget (711) through an application (313) based on its decision to display a new widget (711). For example, the AI module (320) may instruct the application (313) associated with the new widget (711) to create the new widget (711) based on its decision to display a new widget (711). For example, the AI module (320) may identify the application (313) to create the new widget (711). For example, as the application (313) is identified, the AI module (320) may request the application (313) to create the new widget (711).
[0126] In one embodiment, referring to state (701), the AI module (320) may display a new widget (711) in either the first widget area (211) and / or the second widget area (215). For example, the AI module (320) may display a new widget (711) instead of the first widget (611) within the first widget area (211). When the new widget (711) is displayed instead of the first widget (611), the new widget (711) may be displayed in place of the first widget (611) through an animation in which the new widget (711) pushes out the first widget (611). For example, the new widget (711) pushing out the first widget (611) may include the first widget (611) moving in a specific direction (e.g., downward direction) while simultaneously the new widget (711) appears from above in a specific direction (e.g., downward direction). Accordingly, the electronic device (101) can display the first widget (611) again in the first widget area (211) instead of the new widget (711) in response to an upward swipe input to the first widget area (211) where the new widget (711) is displayed.
[0127] In one embodiment, the AI module (320) may display the new widget (711) instead of the widget displayed in either the first widget area (211) and / or the second widget area (215), based on an association with the new widget (711). For example, the association may include a first association between the new widget (711) and the widget (611) displayed in the first widget area (211), and a second association between the new widget (711) and the widget (615) displayed in the second widget area (215). For example, the first association may be a similarity (e.g., cosine similarity) between the content contained in the new widget (711) and the content contained in the widget (611). For example, the second association may be a similarity (e.g., cosine similarity) between the content contained in the new widget (711) and the content contained in the widget (615).
[0128] In one embodiment, the AI module (320) may display a new widget (711) in a widget area where a widget having a lower correlation between a first correlation and a second correlation is displayed. For example, if content related to content is displayed on widget (611), content related to a clock is displayed on widget (615), and the new widget (711) is related to a schedule, the AI module (320) may determine that the first correlation with widget (611) is lower than the second correlation with widget (615). Accordingly, the AI module (320) may display the new widget (711) in the first widget area (211) where widget (611) is displayed.
[0129] For example, the electronic device (101) may change the display of the remaining widget area (i.e., the second widget area (215)) based on user interaction (or user operation) with the new widget (711). For example, user interaction (or user operation) may include the execution of an application, a change in the orientation of the electronic device (101), and / or touch input to the new widget (711).
[0130] In one embodiment, the electronic device (101) may generate a widget that provides additional information associated with the new widget (711) through the AI module (320) in accordance with user input (e.g., press input) for the new widget (711). For example, the electronic device (101) may generate a widget that provides additional information associated with a selected object through the AI module (320) in accordance with user input (e.g., press input) for any one of the one or more objects included in the new widget (711). In one embodiment, the additional information may be information regarding the task sequence (e.g., departure to a destination, ordering at a destination, return from a destination to a starting point) of basic information (e.g., schedule information) associated with the new widget (711). For example, referring to FIG. 7b, the electronic device (101) can generate a widget (715) associated with an object (720) based on user input (730) for an object (720) of a new widget (711) generated by the AI module (320). For example, if the object (720) represents a travel time to a destination, the AI module (320) can generate a widget (715) for suggesting one or more means of travel to the destination. For example, if the object (720) represents information about the destination (e.g., restaurant name), the AI module (320) can generate a widget (715) for providing detailed information about the destination (e.g., menu). For example, if the object (720) represents information about an attendee (e.g., name), the AI module (320) can generate a widget (715) for providing detailed information about the attendee and / or contact information.
[0131] For example, the AI module (320) may display a new widget (715) instead of the second widget (615) within the second widget area (215). For example, referring to FIG. 7c, when the new widget (715) is displayed instead of the second widget (615), the new widget (715) may be displayed in place of the second widget (615) through an animation in which the new widget (715) pushes out the second widget (615). For example, the new widget (715) pushing out the second widget (615) may include the second widget (615) moving in a specific direction (e.g., from bottom to top) while simultaneously the new widget (715) emerges from below in a specific direction (e.g., from bottom to top). Accordingly, the electronic device (101) may display the second widget (615) in place of the new widget (715) in response to a downward swipe input to the second widget area (215) where the new widget (715) is displayed. For example, the AI module (320) may display the widget (715) in place of the second widget (615) through an animation when the new widget (715) associated with the widget (711) exists (e.g., when the new widget (715) is not displayed but is in a generated state).
[0132] For example, referring to the states (705, 707) of FIG. 7d, the electronic device (101) may display a new screen (740) on the display (260) instead of the screen (411) based on a change in the posture of the electronic device (101) (e.g., change from landscape posture to portrait posture). For example, the electronic device (101) may display a new screen (740) on the display (260) instead of the screen (411) based on the release of the mounting state of the electronic device (101). In one embodiment, the new screen (740) may include a screen (740) generated by the AI module (320) and / or a screen (740) generated by another application as instructed by the AI module (320). For example, as it is identified that the user is gripping the electronic device (101) through the grip sensor, the electronic device (101) can be determined to be released from the mounting state of the electronic device (101).
[0133] For example, the new screen (740) may include one or more areas (741, 743, 745, 747, 749). Each of the one or more areas (741, 743, 745, 747, 749) may be associated with content included in the widget (711). For example, area (741) may include schedule information that caused the creation of the widget (711). For example, area (743) may include information for contacting attendees included in the schedule information, and / or objects (e.g., icons of messenger applications, and / or icons of phone applications). For example, area (745) may include information indicating a route to a destination included in the schedule information, and / or information suggesting a means of transportation to the destination (e.g., icons indicating means of transportation). For example, the area (747) may include information indicating the menu of the destination included in the schedule information (e.g., menu and / or price). For example, the area (749) may include weather information according to the schedule information (e.g., weather at the destination and / or weather at a point in time after the appointment).
[0134] For example, a portion of the new screen (740) may be displayed within the display (260). For example, a portion of the new screen (740) corresponding to the size of the display (260) may be displayed within the display (260). For example, the new screen (740) may be scrolled within the display (260).
[0135] In one embodiment, the electronic device (101) may display a screen (411) on the display (260) instead of a new screen (740) based on a change in the posture of the electronic device (101) (e.g., changing from a portrait posture to a landscape posture). For example, the electronic device (101) may display a screen (411) on the display (260) instead of a new screen (740) based on a change in the state of the electronic device (101) to a mounted state.
[0136] FIG. 8 is a drawing illustrating an example of a screen displayed by an electronic device according to one embodiment.
[0137] FIG. 8 can be explained with reference to FIGS. 1 to 7d.
[0138] Referring to the state (801) of FIG. 8, the widget screen (811) may include an object (821) (e.g., a pin) for fixing the screen. For example, the electronic device (101) may maintain the display of the widget screen (811) for a specified length of time as the object (821) is activated (e.g., the pin is fixed). For example, as no user interaction (or touch input to the electronic device (101)) is detected during the specified time, the electronic device (101) may switch the widget screen (811) to an always-on-display (AoD) screen (815) (hereinafter referred to as the AoD screen).
[0139] For example, referring to the state (803) of FIG. 8, the AoD screen (815) may be a screen for low-power operation of the electronic device (101). The AoD screen (815) may include a background screen of a specified color (e.g., black, or a color of a specified color value (e.g., RGB 205 or less). In one embodiment, low-power operation of the electronic device (101) may include the processor (120) of the electronic device (101) being operated in a low-power state (e.g., the operating frequency of the processor (120) being lowered and / or some of the processors of the processor (120) entering a sleep state). In one embodiment, low-power operation of the electronic device (101) may include the display (260) of the electronic device (101) being operated in a low-power state (e.g., the screen refresh cycle displayed on the display (260) being extended and / or the brightness of the display (260) being reduced). In one embodiment, the AoD screen (815) may be moved finely within the display (260) to prevent and / or reduce burn-in of the display (260).
[0140] In one embodiment, the electronic device (101) may switch the widget screen (811) to an AoD screen (815) after displaying the widget screen (811) for a specified time while the electronic device (101) obtains power (or charges) from an external electronic device (301) and / or while the electronic device (101) is in a stationary state.
[0141] In one embodiment, the electronic device (101) may switch the widget screen (811) to a lock screen (515) (or a general AoD screen) after displaying the widget screen (811) for a specified time when the electronic device (101) does not obtain power from an external electronic device (301) or / or when the state of the electronic device (101) is not in a stationary state. In one embodiment, the electronic device (101) may switch the widget screen (811) to a lock screen (515) (or a general AoD screen) when the object (821) is deactivated (e.g., the pin is released). In one embodiment, the general AoD screen may be a screen in which the color of the lock screen (515) is converted to a specified color (e.g., black, or a color of a specified color value (e.g., RGB 205 or less).
[0142] In one embodiment, the electronic device (101) can switch the AoD screen (815) to a lock screen (515) (or a normal AoD screen) when an object (821) is deactivated (e.g., the pin is released) while the AoD screen (815) is being displayed.
[0143] For example, when the lock screen (515) is displayed, the widget screen (811) may be located on page -1 of the lock screen (515). For example, the widget screen (811) being located on page -1 of the lock screen (515) may indicate that it is located on a page at a specific position (e.g., left position) among the pages movable from the lock screen (515). For example, when the lock screen (515) is displayed, the electronic device (101) may display the widget screen (811) instead of the lock screen (515) in response to a swipe input from left to right of the lock screen (515).
[0144] FIG. 9 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0145] FIG. 9 may be described with reference to FIGS. 1 through 8. The operations of FIG. 9 may be performed by the electronic device (101) while a specified condition is satisfied. For example, the specified condition may be a condition for displaying a widget screen (210) including two widget areas (211, 215) through the display (260). For example, the electronic device (101) may determine that the specified condition is satisfied based on turning on the display (260) while the electronic device (101) is in a locked state. For example, the electronic device (101) may determine that the specified condition is satisfied based on turning on the display (260) while the electronic device (101) is in a charging state. In one embodiment, the locked state may be a state in which access to the electronic device (101) is restricted. In one embodiment, restricted access to the electronic device (101) may include restricted execution of applications other than allowed applications. In one embodiment, restricted access to the electronic device (101) may include restricted display of information other than allowed information. In one embodiment, the lock screen may refer to a screen displayed on the display (260) in a locked state.
[0146] Referring to FIG. 9, in operation 910, the electronic device (101) may display a widget screen (210) comprising two widget areas (211, 215). In one embodiment, a first widget (611) of an application (311) may be displayed in the first widget area (211) of the two widget areas (211, 215). In one embodiment, a second widget (615) of an application (312) may be displayed in the second widget area (215) of the two widget areas (211, 215). In one embodiment, the application (311) and the application (312) may be different applications. However, the embodiment is not limited thereto. For example, the application (311) and the application (312) may be the same application. In this case, the first widget (611) and the second widget (615) may be different widgets created by the same application. For example, the first widget (611) and the second widget (615) may be different widgets of the same application that display different content.
[0147] In one embodiment, the electronic device (101) may display a widget screen (210) including two widget areas (211, 215) in a hub mode. In one embodiment, the hub mode may represent a state (or mode) in which screens (210, 240, 250) including the widget screen (210) (or an AoD screen switched from the widget screen (210)) are displayed.
[0148] In operation 920, the electronic device (101) can determine whether an event is identified. In one embodiment, the event may be an event that causes the AI module (320) to create a new widget. For example, the new widget may be a widget that is distinct from a first set of widgets set to be selectively displayed for a first widget area (211) and / or a second set of widgets set to be selectively displayed for a second widget area (215). For example, the new widget may be a widget that is not set to be selectively displayed for the first widget area (211) and / or the second widget area (215).
[0149] In one embodiment, the electronic device (101) can determine whether an event is identified based on user data (330), device data (340), and / or application data (350).
[0150] In one embodiment, the electronic device (101) can determine whether an event is identified based on user data (330), device data (340), and / or application data (350). For example, the electronic device (101) can identify an event to create a widget to guide the user's schedule as the user's schedule is identified. For example, the electronic device (101) can identify an event to create a widget associated with a mode (or routine) of the electronic device (101) as the electronic device (101) is located at a specified location, and / or the current time is a specified time. In one embodiment, the mode (or routine) of the electronic device (101) may be in a state where functions related to do not disturb, app usage restriction, power consumption (e.g., sleep mode), and / or sound mode (or volume) are set according to current activity, location, or situation. For example, a mode (or routine) may include modes for sleep, movie theater, driving, exercise, rest, or work.
[0151] In operation 920, as an event is identified, the electronic device (101) can perform operation 930. In operation 920, as an event is not identified, the electronic device (101) can perform operation 910 again.
[0152] In operation 930, the electronic device (101) can generate a widget through the AI module (320). For example, the AI module (320) can generate the widget directly or indirectly by instructing the generation of the widget through an associated application. In one embodiment, the associated application may be a schedule application for recording schedule information. In one embodiment, the associated application may be an application for providing traffic information for traveling to a destination. In one embodiment, the associated application may be an application for providing the weather of the destination.
[0153] In operation 940, the electronic device (101) may display the generated widget instead of the widget displayed in either of the two widget regions (211, 215). In one embodiment, the electronic device (101) may display the generated widget instead of the widget displayed in either of the first widget region (211) and / or the second widget region (215), based on the association with the generated widget. In one embodiment, the electronic device (101) may display the generated widget in the widget region where the widget having the lower association between the first association and the second association is displayed. For example, the electronic device (101) may display the generated widget instead of the first widget (611) in the first widget region (211). When the generated widget is displayed instead of the first widget (611), the generated widget may be displayed through an animation in which the generated widget pushes the first widget (611).
[0154] FIG. 10 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0155] FIG. 10 can be explained with reference to FIGS. 1 to 9.
[0156] Referring to FIG. 10, in operation 1010, the electronic device (101) can identify the state of the electronic device (101). For example, the electronic device (101) can identify the state of the electronic device (101) through a sensor (376). For example, the state of the electronic device (101) can indicate whether the electronic device (101) is charged. For example, the state of the electronic device (101) can indicate the position of the electronic device (101). For example, the state of the electronic device (101) can indicate whether the electronic device (101) is mounted.
[0157] In operation 1020, the electronic device (101) can determine whether the electronic device (101) is in a mounted state. In one embodiment, the mounted state of the electronic device (101) may indicate a state in which the user is not holding the electronic device (101), identified through a grip sensor. In one embodiment, the mounted state of the electronic device (101) may indicate an upright state of the electronic device (101) (e.g., a state in which the direction of the display (260) is not parallel to the ground), identified through a gyro sensor.
[0158] Based on the state of the electronic device (101) being in a mounted state in operation 1020, the electronic device (101) can perform operation 1030. Based on the state of the electronic device (101) not being in a mounted state in operation 1020, the electronic device (101) can perform operation 1070.
[0159] In operation 1030, the electronic device (101) may display a screen according to the hub mode. For example, the electronic device (101) may display a widget screen (210) including two widget areas (211, 215). However, the embodiment is not limited thereto. For example, the electronic device (101) may display a screen (240) displaying a photo, and / or a screen (250) displaying a clock (e.g., a digital or analog clock).
[0160] In operation 1040, the electronic device (101) can determine whether the screen display is set to be maintained.
[0161] For example, the electronic device (101) can determine whether the object (821) is in an active state (e.g., fixed pin) while the widget screen (210) is displayed. For example, the electronic device (101) can determine whether the object (821) is in an active state (e.g., fixed pin) while the widget screen (210) is displayed.
[0162] For example, the electronic device (101) can determine that the screen display is set to be maintained when the widget screen (210) is displayed and the object (821) is activated (e.g., pin fixed). For example, the electronic device (101) can determine that the screen display is not maintained when the widget screen (210) is not displayed (e.g., screens (240, 250) are displayed) and / or the object (821) is deactivated (e.g., pin unfixed).
[0163] Based on the setting that the screen display is maintained in operation 1040, the electronic device (101) can perform operation 1050. Based on the setting that the screen display is not maintained in operation 1040, the electronic device (101) can perform operation 1060.
[0164] In operation 1050, the electronic device (101) can display an Always on Display (AoD) screen (815) according to the hub mode. For example, referring to state (803) of FIG. 8, the AoD screen (815) may be a screen for low-power operation of the electronic device (101). The AoD screen (815) may include a background screen of a specified color (e.g., black, or a color of a specified color value (e.g., RGB 205 or less).
[0165] In operation 1060, the electronic device (101) may display an AoD screen according to a normal mode. In one embodiment, the normal mode may indicate a state (or mode) in which a lock screen (or an AoD screen switched from the lock screen) is displayed. For example, the electronic device (101) may display an AoD screen in which the color of the lock screen (511) of FIG. 5a or the lock screen (515) of FIG. 5b is converted to a specified color (e.g., black, or a color of a specified color value (e.g., RGB 205 or less).
[0166] In operation 1070, the electronic device (101) can determine whether to display a screen according to the hub mode. For example, the electronic device (101) can determine whether to maintain the display of the widget screen (210) while the electronic device (101) is not in a mounted state.
[0167] For example, the electronic device (101) may decide to display a widget generated by the AI module (320) while the electronic device (101) is in a mounted state, and then, when the mounted state of the electronic device (101) is released, display a screen according to the hub mode to maintain the display of the widget generated by the AI module (320).
[0168] For example, the electronic device (101) may decide to display a screen according to normal mode when the AI module (320) does not display a widget generated in the mounting state of the electronic device (101).
[0169] Based on the determination in operation 1070 that a screen according to hub mode is displayed, the electronic device (101) can perform operation 1030. Based on the determination in operation 1070 that a screen according to hub mode is not displayed, the electronic device (101) can perform operation 1080.
[0170] In operation 1080, the electronic device (101) may display a screen according to a normal mode. In one embodiment, the electronic device (101) may display the lock screen (511) of FIG. 5a or the lock screen (515) of FIG. 5b.
[0171] FIG. 11a is a flowchart illustrating the operation of an electronic device according to one embodiment. FIG. 11b is a diagram illustrating the operation of an electronic device processing data according to one embodiment.
[0172] FIGS. 11a and FIGS. 11b can be described with reference to FIGS. 1 through 10.
[0173] Referring to FIG. 11a, in operation 1110, the electronic device (101) can collect data. In one embodiment, referring to FIG. 11b, the collected data (1120) may include application data (1121), system data (1123), context (1125), and / or account data (1127). In one embodiment, the application data (1121) may correspond to the application data (350) of FIG. 3. In one embodiment, the system data (1123) may correspond to the device data (340) of FIG. 3. In one embodiment, the context (1125) and / or account data (1127) may correspond to the user data (330) of FIG. 3.
[0174] Application data (1121) may be collected from its own application as well as from third-party applications. For example, application data (1121) may include real-time information (e.g., clock, calendar, weather, and / or location). Application data (1121) may include stored information (e.g., messages, call logs, contacts, and / or shopping).
[0175] For example, the system data (1123) may include information regarding notifications and / or time zones. For example, the system data (1123) may include information indicating the states of the electronic device (101) (e.g., location, time, battery, charge status).
[0176] For example, context (1125) may include information about visit history, places visited, travel routes, and / or event circumstances. For example, account data (1127) may include information about an account profile (e.g., personal information (e.g., age, gender, name, hobbies, preferences, occupation, school, family)), and / or people associated with the account (e.g., family, friends, colleagues).
[0177] In operation 1130, the electronic device (101) can analyze data. In one embodiment, the electronic device (101) can analyze data to identify events associated with a user. In one embodiment, the electronic device (101) can process data to predict and / or determine events for creating a widget based on collected data (1120).
[0178] In one embodiment, referring to FIG. 11b, the electronic device (101) can generate processed data (1160) based on collected data (1120). In one embodiment, the processed data (1160) may include personalized knowledge (1161), preferences (1163), patterns (1165), and / or events (1167).
[0179] For example, personalized knowledge (1161) may represent relationship information between the user and people around them. For example, an electronic device (101) may extract personalized knowledge (1161) from account data (1127) and / or application data (1121) (e.g., contacts, messages, and / or call logs).
[0180] For example, the preference (1163) may represent the user's preferences, tastes, and / or priorities. For example, the electronic device (101) may extract the preference (1163) from context (1125) (e.g., places visited), and / or application data (1121) (e.g., shopping, messages, and / or maps).
[0181] For example, the pattern (1165) may represent periodic information. For example, the electronic device (101) may extract the pattern (1165) from context (1125) (e.g., visit history, places visited, travel routes, and / or event situations), and / or application data (1121) (e.g., calendar, and / or shopping).
[0182] For example, an event (1167) may represent a scheduled event and / or a past event. For example, an electronic device (101) may extract an event (1167) from application data (1121) (e.g., messages, calendars, and / or maps), and / or system data (1123) (e.g., notifications).
[0183] In operation 1150, the electronic device (101) can store data. In one embodiment, the electronic device (101) can store processed data (1160).
[0184] Afterward, the electronic device (101) can generate a widget corresponding to an event based on the processed data (1160). Below, with reference to FIG. 12, an operation in which the electronic device (101) displays a widget corresponding to an event based on the processed data (1160) can be described.
[0185] FIG. 12 is a drawing illustrating an example of a screen that an electronic device displays according to a situation, according to one embodiment.
[0186] FIG. 12 can be explained with reference to FIGS. 1 to FIGS. 11b.
[0187] In one embodiment, referring to FIG. 12, the electronic device (101) can display a new widget (1210) in either a first widget area (211) and / or a second widget area (215) through an AI module (320). For example, the electronic device (101) can display a new widget (1210) through the AI module (320) based on the fulfillment of a specified condition. For example, the electronic device (101) can determine that a specified condition is fulfilled based on turning on the display (260) while the electronic device (101) is in a locked state. For example, the electronic device (101) can determine that a specified condition is fulfilled based on turning on the display (260) while the electronic device (101) is in a charging state.
[0188] For example, the electronic device (101) may display a new widget (1210) based on the spatial conditions being met to provide new information to the user. For example, the electronic device (101) may display a widget (1210) to provide new information on the display (260) at a designated time (e.g., 8:30 AM). For example, the electronic device (101) may display a widget (1210) to provide new information on the display (260) before the user engages in an external activity (or while staying in an internal space (e.g., home).
[0189] For example, the electronic device (101) can display a new widget (1210) based on processed data (1160) generated based on collected data (1120). For example, the electronic device (101) can display a new widget (1210) based on personalized knowledge (1161), preferences (1163), patterns (1165), and / or events (1167).
[0190] For example, the electronic device (101) may display a new widget (1210) based on time conditions being met for providing new information to the user. For example, the electronic device (101) may display a new widget (1210) based on space conditions being met for providing new information to the user. For example, the electronic device (101) may display a widget (1210) for providing new information on the display (260) at a designated time (e.g., 8:30 AM). For example, the electronic device (101) may display a widget (1210) for providing new information on the display (260) before the user engages in external activities (or while staying in an internal space (e.g., home).
[0191] For example, referring to FIG. 12, the widget (1210) may include a schedule (e.g., appointment partner (1211), destination (1215)), weather (e.g., time condition (1213), weather condition (1217)), and / or suggestions (e.g., supplies (1219)) as new information.
[0192] For example, referring to FIG. 12, the electronic device (101) can display new widgets (1230, 1250, 1270, 1290) based on time, weather, relationship information, and / or events (1167).
[0193] For example, the electronic device (101) can create and display a widget (1230) based on processed data (1160) associated with weather (e.g., time conditions (1231), weather conditions (1233)), and / or shopping (e.g., shopping history (1235), shopping items (1237)). For example, the electronic device (101) can create and display a widget (1250) based on processed data (1160) associated with relationship information (e.g., message time (1251), messaging partner (1253), message content (1255, 1257), message reminder (1255)) at 5:00 PM. For example, the electronic device (101) can create and display a widget (1270) based on processed data (1160) associated with a past event (e.g., past event (1271), scheduled event (1275)) at 5:00 PM.
[0194] For example, the electronic device (101) may generate and display a widget (1290) based on processed data (1160) associated with a pattern (e.g., time situation (1291), place situation (1293, 1295)), and / or relationship information (1297) at 5:00 PM. For example, the widget (1290) may include a suggestion (1298, 1299).
[0195] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure belongs.
[0196] As described above, the electronic device (101) may include a display (260), at least one processor (120) including a processing circuit; and a memory (130) that stores instructions and includes one or more storage media. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the display (260) to display a screen including two widget areas (211, 215). In the first widget area (211) of the two widget areas (211, 215), a first widget (611) of a first application (311) may be displayed, and in the second widget area (215) of the two widget areas (211, 215), a second widget (615) of a second application (312) may be displayed. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may, while displaying the screen, cause an event based on user data (330) through an artificial intelligence assistance application (320) that is distinct from the first application (311) and the second application (312), and, according to the identification of the event, cause a third widget (711) to be created using the user data (330). When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the third widget (711) to be displayed in place of the first widget area (211) among the two widget areas (211, 215).
[0197] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the third application (313) to be created based on the user data (330) through the artificial intelligence assistance application (320), the third application (313), the data associated with one or more objects to be included in the third widget (711) from the third application (313), and the data to be input into the one or more objects.
[0198] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) can, through the artificial intelligence assistance application (320): identify the third application (313) based on the user data (330), transmit a signal to the third application (313) causing the third application (313) to create the third widget (711), and cause the third application (313) to create the third widget (711) based on the signal.
[0199] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may identify user input for the third widget (711), and based on the user input, create a fourth widget (715) through the artificial intelligence assistance application (320), and cause the fourth widget (715) to be displayed in the second widget area (215) of the two widget areas (211, 215) instead of the second widget (615).
[0200] The screen including the two widget regions (211, 215) may be a first screen. When the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the creation of the third widget (711) through the artificial intelligence assistance application (320) based on the event while displaying the second screen that does not include the two widget regions (211, 215), and the creation of the third widget (711) through the artificial intelligence assistance application (320) based on the event while displaying the first screen that includes the two widget regions (211, 215).
[0201] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) receives user input toward the second screen while displaying the second screen, displays the first screen instead of the second screen according to the user input, and while displaying the first screen, causes the third widget (711) to be created through the artificial intelligence assistance application (320) based on the event.
[0202] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the screen including the two widget areas (211, 215) to be displayed through the display (260) while the state of the electronic device (101) is locked.
[0203] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may be caused to acquire power from an external electronic device (301), and while the state of the electronic device (101) is the lock state: while acquiring power, the screen may be displayed, and while the acquisition of power is interrupted, the lock screen may be displayed instead of the screen.
[0204] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may receive user input for the lock screen while displaying the lock screen switched from the screen while the power acquisition is interrupted, and, according to the user input, cause the screen to be displayed instead of the lock screen.
[0205] When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) displays the screen containing the third widget (711) while the electronic device (101) is in a landscape pose, and while the electronic device (101) is in a state of displaying the screen containing the third widget (711), identifies that the electronic device (101) is changing from the landscape pose to a portrait pose, and while the electronic device (101) is in a portrait pose: uses the user data (330) through the artificial intelligence assistance application (320) to create a screen, and causes the screen created through the artificial intelligence assistance application (320) to be displayed instead of the screen containing the third widget (711).
[0206] The first widget area (211) may be configured to selectively display a first set of widgets. The second widget area (215) may be configured to selectively display a second set of widgets. The third widget (711) may be distinguished from the first set of widgets and the second set of widgets.
[0207] The two widget areas (211, 215) may be arranged side by side within the screen along the long axis direction of the screen and arranged to face each other with respect to the short axis direction of the screen.
[0208] The method described above may be performed by an electronic device (101) including a display (260). The method may include the operation of displaying a screen including two widget areas (211, 215) through the display (260). A first widget (611) of a first application (311) may be displayed in the first widget area (211) of the two widget areas (211, 215), and a second widget (615) of a second application (312) may be displayed in the second widget area (215) of the two widget areas (211, 215). The above method may include, while displaying the screen, through an artificial intelligence assistance application (320) that is distinct from the first application (311) and the second application (312): an operation of identifying an event based on user data (330), an operation of creating a third widget (711) using the user data (330) according to the identification of the event, and an operation of displaying the third widget (711) instead of the first widget (611) in the first widget area (211) among the two widget areas (211, 215).
[0209] The above method may include, through the artificial intelligence assistance application (320): an operation of identifying a third application (313) based on the user data (330), an operation of obtaining data associated with one or more objects to be included in the third widget (711) from the third application (313), and an operation of creating the third widget (711) based on inputting the data to the one or more objects.
[0210] The above method may include the operation of identifying a third application (313) based on the user data (330) through the artificial intelligence assistance application (320), and the operation of creating the third widget (711) using the third application (313).
[0211] The above method may include the operation of identifying user input for the third widget (711), the operation of generating a fourth widget (715) through the artificial intelligence assistance application (320) based on the user input, and the operation of displaying the fourth widget (715) instead of the second widget (615) in the second widget area (215) among the two widget areas (211, 215).
[0212] The screen including the two widget areas (211, 215) may be a first screen. The method may include an operation of refraining from creating the third widget (711) through the artificial intelligence assistance application (320) based on the event while displaying the second screen that does not include the two widget areas (211, 215), and an operation of creating the third widget (711) through the artificial intelligence assistance application (320) based on the event while displaying the first screen including the two widget areas (211, 215).
[0213] The above method may include receiving user input toward the second screen while displaying the second screen, displaying the first screen instead of the second screen according to the user input, and generating the third widget (711) through the artificial intelligence assistance application (320) based on the event while displaying the first screen.
[0214] The above method may include the operation of displaying the screen including the two widget areas (211, 215) through the display (260) while the electronic device (101) is in a locked state.
[0215] The above method may include the operation of obtaining power from an external electronic device (301), and while the state of the electronic device (101) is the lock state: the operation of displaying the screen while obtaining the power, and the operation of displaying a lock screen instead of the screen while the acquisition of the power is interrupted.
[0216] A non-transitory computer-readable storage medium as described above may store a program containing instructions. When the instructions are executed individually or collectively by at least one processor (120) of an electronic device (101) including a display (260), the electronic device (101) may cause the display (260) to display a screen including two widget areas (211, 215). In the first widget area (211) of the two widget areas (211, 215), a first widget (611) of a first application (311) may be displayed, and in the second widget area (215) of the two widget areas (211, 215), a second widget (615) of a second application (312) may be displayed. When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may, while displaying the screen, cause an event based on user data (330) through an artificial intelligence assistance application (320) that is distinct from the first application (311) and the second application (312), and, according to the identification of the event, cause a third widget (711) to be created using the user data (330). When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101) may cause the third widget (711) to be displayed in place of the first widget area (211) among the two widget areas (211, 215).
[0217] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.
[0218] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0219] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0220] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0221] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0222] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., CD-ROM (compact disc read-only memory)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0223] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (101), Display (260), At least one processor (120) including a processing circuit; and The electronic device (101) includes a memory (130) that stores instructions and includes one or more storage media, and when the instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Through the above display (260), a screen including two widget areas (211, 215) is displayed, and in the first widget area (211) of the two widget areas (211, 215), a first widget (611) of a first application (311) is displayed, and in the second widget area (215) of the two widget areas (211, 215), a second widget (615) of a second application (312) is displayed. While displaying the above screen, through an artificial intelligence assistance application (320) that is distinct from the first application (311) and the second application (312): Identify events based on user data (330), Based on the identification of the above event, a third widget (711) is created using the user data (330), and Causing the third widget (711) to be displayed instead of the first widget (611) in the first widget area (211) among the two widget areas (211, 215), Electronic device (101).
2. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Through the above artificial intelligence assistance application (320): Based on the above user data (330), identify the third application (313), and Data associated with one or more objects to be included in the third widget (711) is obtained from the third application (313), and Based on inputting the above data into the one or more objects, causing the creation of the third widget (711), Electronic device (101).
3. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Through the above artificial intelligence assistance application (320): Based on the above user data (330), identify the third application (313), and The third application (313) transmits a signal to the third application (313) that causes the third application (313) to generate the third widget (711), and Based on the above signal, causing the third widget (711) to be generated using the third application (313), Electronic device (101).
4. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Identify user input for the above third widget (711), and Based on the above user input, a fourth widget (715) is created through the artificial intelligence assistance application (320), and Causing the fourth widget (715) to be displayed instead of the second widget (615) in the second widget area (215) among the two widget areas (211, 215). Electronic device (101).
5. In Claim 1, The screen including the two widget areas (211, 215) is the first screen, and When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), While displaying a second screen that does not include the two widget areas (211, 215) mentioned above, based on the event, the creation of the third widget (711) through the artificial intelligence assistance application (320) is refrained from, and While displaying the first screen including the two widget areas (211, 215), causing the third widget (711) to be generated through the artificial intelligence assistance application (320) based on the event, Electronic device (101).
6. In Claim 5, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), While displaying the second screen, receiving user input toward the second screen, Based on the above user input, the first screen is displayed instead of the second screen, and While displaying the first screen, causing the third widget (711) to be generated through the artificial intelligence assistance application (320) based on the event, Electronic device (101).
7. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), While the state of the electronic device (101) is locked, causing the screen including the two widget areas (211, 215) to be displayed through the display (260), Electronic device (101).
8. In Claim 7, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), Power is obtained from an external electronic device (301), and While the state of the electronic device (101) is the locked state: While acquiring the above power, display the above screen, and Causing to display a lock screen instead of the screen while the acquisition of the above power is interrupted, Electronic device (101).
9. In Claim 8, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), While the acquisition of the above power is interrupted, and while the lock screen switched from the above screen is displayed, user input for the lock screen is received, and Causing the screen to be displayed instead of the lock screen according to the above user input, Electronic device (101).
10. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor (120), the electronic device (101), While the posture of the electronic device (101) is in a landscape posture, the screen including the third widget (711) is displayed, and In the state of displaying the screen including the third widget (711), identifying that the posture of the electronic device (101) changes from the landscape posture to the portrait posture, and While the posture of the electronic device (101) is the portrait posture: Using the user data (330) through the artificial intelligence assistance application (320) above, a screen is generated, and Causing the screen generated through the artificial intelligence assistance application (320) to be displayed instead of the screen including the third widget (711), Electronic device (101).
11. In Claim 1, The first widget area (211) is configured so that a first set of widgets are selectively displayed, and The second widget area (215) is configured so that a second set of widgets are selectively displayed, and The third widget (711) is distinguished from the first set of widgets and the second set of widgets. Electronic device (101).
12. In Claim 1, The two widget regions (211, 215) above are Arranged side by side within the screen along the long axis direction of the screen, Arranged to face each other based on the short axis direction of the above screen Electronic device (101).
13. A method of an electronic device (101) including a display (260), The operation of displaying a screen including two widget areas (211, 215) through the above display (260), wherein a first widget (611) of a first application (311) is displayed in the first widget area (211) among the two widget areas (211, 215), and a second widget (615) of a second application (312) is displayed in the second widget area (215) among the two widget areas (211, 215). While displaying the above screen, through an artificial intelligence assistance application (320) that is distinct from the first application (311) and the second application (312): Action of identifying events based on user data (330), The operation of creating a third widget (711) using the user data (330) according to the identification of the above event, and The operation of displaying the third widget (711) instead of the first widget (611) in the first widget area (211) among the two widget areas (211, 215). method.
14. In Claim 13, Through the above artificial intelligence assistance application (320): An operation to identify a third application (313) based on the above user data (330), The operation of obtaining data associated with one or more objects to be included in the third widget (711) from the third application (313), and The operation of creating the third widget (711) based on inputting the above data into the one or more objects method.
15. In Claim 13, An operation to identify a third application (313) based on the user data (330) through the artificial intelligence assistance application (320), and The operation of creating the third widget (711) using the third application (313) method.