Electronic device for determining layout of image and one or more visual objects in lock screen and method thereof

Abstract

In an electronic device according to an embodiment of the present invention, a first background image of a lock screen and a widget object corresponding to a widget of the lock screen may be simultaneously displayed in an editing screen for editing the lock screen. The first background image may include a visual object area obtained using a source image. The electronic device may receive, through the editing screen, a second input for moving the widget object. In the electronic device, the lock screen may be edited by acquiring the second background image using the source image so that, in response to the release of the second input corresponding to the widget object moved to at least partially overlap the visual object area included in the first background image, the visual object area separates from the widget object moved by the second input. The second background image may be displayed together with the widget moved in the lock screen according to the second input.

Description

Electronic device and method for determining the layout of images and one or more visual objects within a lock screen

[0001] The present disclosure relates to an electronic device and method for determining the layout of an image and one or more visual objects within a lock screen.

[0002] The functions supported by portable electronic devices are increasing. Various software applications can be installed on electronic devices. Electronic devices can run multiple software applications simultaneously, based on multitasking. To protect privacy, electronic devices may have states and / or modes that restrict the execution of software applications.

[0003] The above information may be provided as background information to aid in understanding the present disclosure. None of the above is claimed to be prior art related to the present disclosure or to be used in making decisions related to prior art.

[0004] According to one embodiment, an electronic device may include a display, at least one processor including a processing circuit, and a memory including one or more storage media storing instructions. The at least one processor may be configured to individually or collectively execute instructions, and may be configured to cause the electronic device to receive a first input for displaying an editing screen for editing a lock screen. The at least one processor may be configured to individually or collectively execute instructions, and may be configured to cause the electronic device to simultaneously display, within the displayed editing screen in response to the first input, a first background image of the lock screen and a widget object corresponding to a widget of the lock screen. The first background image may include a visual object area obtained using a source image. The widget object may at least partially overlap the first background image. At least one processor may be configured to individually or collectively execute instructions, and cause the electronic device to receive, through the editing screen, a second input for moving the widget object while simultaneously displaying the first background image and the widget object. At least one processor may be configured to individually or collectively execute instructions, and cause the electronic device to edit the lock screen by obtaining a second background image using the source image, in response to a release of the second input corresponding to the widget object moved to at least partially overlap the visual object area included in the first background image, such that the visual object area is separated from the widget object moved by the second input. The second background image may be displayed together with the widget moved in response to the second input within the lock screen.At least one processor may be configured to individually or collectively execute instructions, wherein the electronic device is configured to cause, in response to a release of the second input corresponding to the widget object being moved away from the visual object area included in the first background image, to edit the lock screen using the first background image to be displayed on the lock screen together with the widget moved in accordance with the second input.

[0005] In one embodiment, a method of an electronic device including a display may be provided. The method may include receiving a first input for displaying an editing screen for editing a lock screen. The method may include simultaneously displaying, within the displayed editing screen in response to the first input, a first background image of the lock screen and a widget object corresponding to a widget of the lock screen. The first background image may include a visual object area obtained using a source image. The widget object may at least partially overlap the first background image. The method may include receiving, through the editing screen, a second input for moving the widget object while simultaneously displaying the first background image and the widget object. The method may include editing the lock screen by obtaining a second background image using the source image, such that the visual object area is separated from the widget object moved by the second input, in response to a release of the second input corresponding to the widget object moved to at least partially overlap the visual object area included in the first background image. The second background image may be displayed together with the widget moved according to the second input within the lock screen. The method may include an operation of editing the lock screen using the first background image to be displayed on the lock screen together with the widget moved according to the second input in response to a release of the second input corresponding to the widget object moved to a point away from the visual object area included in the first background image.

[0006] In one embodiment, a non-transitory computer-readable storage medium storing instructions may be provided. The instructions, when individually and / or collectively executed by at least one processor including a processing circuit of an electronic device including a display, may cause the electronic device to receive a first input for displaying an editing screen for editing a lock screen. The instructions, when executed by the processor, may cause the electronic device to simultaneously display, within the displayed editing screen in response to the first input, a first background image of the lock screen and a widget object corresponding to a widget of the lock screen. The first background image may include a visual object area obtained using a source image. The widget object may at least partially overlap the first background image. The instructions, when executed by the at least one processor, may cause the electronic device to receive, through the editing screen, a second input for moving the widget object while simultaneously displaying the first background image and the widget object. The instructions, when executed by at least one processor, may cause the electronic device to, in response to a release of the second input corresponding to the widget object moved to at least partially overlap the visual object area included in the first background image, edit the lock screen to obtain a second background image using the source image such that the visual object area is separated from the widget object moved by the second input. The second background image may be displayed together with the widget moved in response to the second input within the lock screen.The instructions, when executed by at least one processor, may cause the electronic device to, in response to a release of the second input corresponding to the widget object being moved away from the visual object area included in the first background image, edit the lock screen using the first background image to be displayed on the lock screen together with the widget moved in accordance with the second input.

[0007] According to an embodiment, an electronic device may include a display, at least one processor including a processing circuit, and a memory including one or more storage media storing instructions. The at least one processor may be configured to, individually or collectively, execute instructions, and cause the electronic device to, based on a first input for changing the layout of a lock screen, display on the display an editing screen related to the layout of the lock screen, the editing screen including an image and a visual object superimposed on the image. The at least one processor may be configured to, individually or collectively, execute instructions, and cause the electronic device to, based on a second input received through the editing screen for adjusting a position or size of the visual object, display the visual object within the editing screen using a position or size indicated by the second input. At least one processor may be configured to individually or collectively execute instructions, and may be configured to cause the electronic device to change a position or size of the image within the editing screen in response to the position or size of the visual object adjusted by the second input.

[0008] In one embodiment, a method of an electronic device including a display may be provided. The method may include, based on a first input for changing the layout of a lock screen, displaying an editing screen related to the layout of the lock screen, the editing screen including an image and a visual object superimposed on the image, on the display. The method may include, based on a second input for adjusting a position or size of the visual object received through the editing screen, displaying the visual object within the editing screen using the position or size indicated by the second input. The method may include, based on the position or size of the visual object adjusted by the second input, changing the position or size of the image within the editing screen.

[0009] In one embodiment, a non-transitory computer-readable storage medium storing instructions may be provided. The instructions, when individually and / or collectively executed by at least one processor including a processing circuit of an electronic device including a display, may cause the electronic device to, based on a first input for changing the layout of the lock screen, display on the display an editing screen related to the layout of the lock screen, the editing screen including an image and a visual object superimposed on the image. The instructions, when executed by the at least one processor, may cause the electronic device to, based on a second input received through the editing screen for adjusting a position or size of the visual object, display the visual object within the editing screen using a position or size indicated by the second input. The instructions, when executed by at least one processor, may cause the electronic device to change the position or size of the image within the editing screen based on the position or size of the visual object adjusted by the second input.

[0010] The above-described and other aspects, features, and advantages of some embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0011] FIG. 1 is a diagram illustrating an example user interface (UI) displayed by an electronic device according to various embodiments;

[0012] FIG. 2 is a block diagram illustrating an example configuration of an electronic device according to various embodiments;

[0013] FIG. 3 is a state transition diagram of an electronic device according to various embodiments;

[0014] FIGS. 4A, 4B, 4C, and 4D are diagrams illustrating exemplary states of an electronic device displaying an editing screen related to a lock screen according to various embodiments;

[0015] FIG. 5 is a flowchart illustrating exemplary operations of an electronic device according to various embodiments;

[0016] FIGS. 6A and 6B are diagrams illustrating exemplary states of an electronic device displaying an editing screen related to a lock screen according to various embodiments;

[0017] FIGS. 7A, 7B, and 7C are flowcharts illustrating exemplary operations of an electronic device according to various embodiments;

[0018] FIG. 8 is a flowchart illustrating exemplary operations of an electronic device according to various embodiments;

[0019] FIGS. 9A and 9B are diagrams illustrating exemplary states of an electronic device displaying a lock screen according to various embodiments;

[0020] FIG. 10 is a diagram illustrating exemplary states of an electronic device displaying an editing screen according to various embodiments;

[0021] FIGS. 11A, 11B, and 11C are diagrams illustrating exemplary states of an electronic device displaying an editing screen according to various embodiments;

[0022] FIG. 12 is a block diagram illustrating an exemplary electronic device within a network environment according to various embodiments.

[0023] Hereinafter, various embodiments of the present disclosure are described in more detail with reference to the attached drawings.

[0024] The various embodiments of the present disclosure and the terminology used therein are not intended to limit the technology described in the present disclosure to a specific embodiment, but should be understood to include various modifications, equivalents, and / or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar components. The singular expression may include plural expressions unless the context clearly indicates otherwise. In the present disclosure, expressions such as “A or B,” “at least one of A and / or B,” “A, B, or C,” or “at least one of A, B, and / or C” can include all possible combinations of the items listed together. Expressions such as “first,” “second,” “first,” or “second” can modify the corresponding components regardless of order or importance, and are only used to distinguish one component from another, but do not limit the corresponding components. When it is said that a component (e.g., a first component) is “(functionally or communicatively) connected” or “connected” to another component (e.g., a second component), said component may be directly connected to said other component, or may be connected via another component (e.g., a third component).

[0025] The term "module" as used herein includes a unit composed of hardware, firmware, or any combination thereof, and may be used interchangeably with terms such as logic, block, component, or circuit. A module may be an integrally formed component or a minimum unit or part thereof that performs one or more functions. For example, a module may be composed of an application-specific integrated circuit (ASIC).

[0026] FIG. 1 is a diagram illustrating an exemplary user interface (UI) displayed by an electronic device (101) according to various embodiments. Referring to FIG. 1, an electronic device (101) having the appearance of a mobile phone is illustrated. The electronic device (101) may have various form factors, such as, but not limited to, a smartphone, a laptop PC (personal computer), a tablet PC, a head-mounted display (HMD) device, a headset (or headphones), a watch, and other similar computing devices (not shown). The electronic device (101) may be referred to as a mobile device, a user terminal, a user equipment (UE), a multi-function device, a portable communication device, and / or a portable device. The form factor of the electronic device (101) is not limited to the exemplary form factors illustrated in FIG. 1. For example, the electronic device (101) may be included as an electronic control unit (ECU) in a vehicle (e.g., an electric vehicle (EV)). For example, the electronic device (101) may have a form factor that is wearable by a user, such as an HMD device and / or a watch, or may have a form factor that is implantable on a body part of the user. The disclosure is not limited thereto, and the electronic device (101) may have a form factor of an earbud and / or an earphone. An example of a hardware configuration included in the electronic device (101) is described in more detail with reference to FIG. 2.

[0027] According to one embodiment, the electronic device (101) may at least partially (or at least temporarily) restrict access to information stored in the electronic device (101) (e.g., photos, videos, images, text, contact information, payment information, biometric information, and / or other information generated by a software application running on the electronic device (101)) to protect privacy. A state (or mode) of the electronic device (101) that restricts access to information stored in the electronic device (101) may be referred to as a locked state (or locked mode). Different states of the electronic device (101) including the locked state, and the operation of the electronic device (101) in the states are described with reference to FIG. 3 .

[0028] Referring to FIG. 1, a lock screen (160), which is a screen displayed on a display (110) of an electronic device (101) while operating in a locked state, is illustrated. While the lock screen (160) is displayed, execution of functions other than those related to the lock screen (160) may be restricted. For example, based on authentication of a user of the electronic device (101), the electronic device (101) may conditionally execute the other functions. The lock screen (160) may include visual objects (e.g., visual objects (161, 163, 164, 165, 166)) related to at least one function permitted to be executed in the locked state among various functions supported by the electronic device (101).

[0029] For example, the electronic device (101) may display a visual object (161) (or clock widget) representing the current time calculated by the electronic device (101). The visual object (161) may be displayed based on the execution of a software application that provides time-related functions, such as a clock application. In terms of including a clock widget, the lock screen (160) may be referred to as a clockface (or face).

[0030] For example, the electronic device (101) may display a visual object (163) representing at least one notification message generated from the electronic device (101) in a locked state. The visual object (163) may be displayed based on the execution of a system service and / or a system application executed by the electronic device (101) for managing push messages and / or notification messages, such as a notification center. A visual object that has an appearance updated by a software application executing on the electronic device (101), such as the visual objects (161, 163), may be referred to as a UI (user interface) object, a widget, a widget object, a gadget object, and / or a gadget.

[0031] For example, the electronic device (101) may display a visual object (165) for executing a software application for making a phone call. For example, the electronic device (101) may display a visual object (164) mapped to a function for making an emergency call. The visual objects (164, 165) may be mapped to a software application that provides a function related to a phone call, such as a calling application. For example, the electronic device (101) may display a visual object (166) mapped to a function for controlling a camera. The visual object (166) may be mapped to a software application that provides a function related to the camera of the electronic device (101), such as a camera application.

[0032] Referring to FIG. 1, the electronic device (101) can display an image (169) together with visual objects (161, 163, 164, 165, 166) within a lock screen (160) that occupies the entire display area of ​​the display (110). The electronic device (101) can display the visual objects (161, 163, 164, 165, 166) as an overlay on the image (169). Although the operation of the electronic device (101) in relation to the image (169) is illustrated by way of example, the disclosure is not limited thereto. For example, the electronic device (101) can display a video, one or more three-dimensional graphical objects, and / or text instead of the image (169). The operation of the electronic device (101) described with reference to FIGS. 1 to 12 may be similarly performed or applied to other media content (e.g., video, and / or one or more three-dimensional graphical objects) displayed as if positioned under visual objects (161, 163, 164, 165, 166) as well as the image (169). The image (169) may be referred to as a background image and / or wallpaper.

[0033] In a different state than the locked state, the electronic device (101) may provide a function for editing the lock screen (160). Referring to FIG. 1, an editing screen displayed on the display (110) for editing the lock screen (160) is illustrated. The electronic device (101) may display the editing screen based on an input for changing or customizing the layout of the lock screen (160). The layout of the lock screen (160) may be related to the positional relationship of the image (169) and / or visual objects (161, 163, 164, 165, 166) visible through the lock screen (160).

[0034] Referring to FIG. 1, the electronic device (101) may display visual objects (121, 122, 123) for switching to or moving to another screen different from the editing screen. An embodiment in which the visual objects (121, 122, 123) are displayed along the bottom of the display (110) is illustrated, but the disclosure is not limited thereto. For example, a visual object (121) referred to as a recent application and / or recent apps button may be mapped to a function of displaying an execution screen selected from a list of one or more execution screens displayed on the display (110) in order to provide a list of the one or more execution screens displayed on the display (110). For example, a visual object (122) referred to as a home button may be mapped to a function of displaying a designated screen referred to as a home screen (or launcher screen). For example, a visual object (123) referred to as a back button may be mapped to a function of moving to an execution screen displayed prior to an editing screen currently being displayed on the display (110).

[0035] Within the exemplary editing screen of FIG. 1, the electronic device (101) may display a preview area (130) to provide a preview of the lock screen (160). Through the preview area (130) that partially occupies the display area of ​​the display (110), the electronic device (101) may guide or provide the appearance of the lock screen (160) changed by the editing screen. Within the preview area (130), the electronic device (101) may display an image (150) corresponding to an image (169) to be included in the lock screen (160). Within the preview area (130), the electronic device (101) may display visual objects (141, 142, 143, 144, 145, 146) superimposed on the image (150).

[0036] In one embodiment, visual objects (141, 142, 143, 144, 145, 146) may be displayed for adding, deleting, and / or modifying executable objects that are to be superimposed on an image (169) within the lock screen (160). For example, visual object (141) may be displayed for deleting and / or modifying (e.g., changing an attribute of visual object (161)) a visual object (161) included in the lock screen (160). For example, visual object (142) may be displayed for adding a widget to a location on the lock screen (160) corresponding to the visual object (142). For example, visual object (143) may be displayed for adding, deleting, and / or modifying a visual object (163) included in the lock screen (160). For example, a visual object (144) may be displayed for deleting and / or modifying a visual object (164) within a lock screen (160). For example, a visual object (145) may be displayed for deleting and / or modifying a visual object (165) within a lock screen (160). For example, a visual object (146) may be displayed for deleting and / or modifying a visual object (166) within a lock screen (160). By using an editing screen including a preview area (130), the electronic device (101) may provide a user with a what you see is what you get (WYSIWYG) experience related to the lock screen (160).

[0037] Within the exemplary editing screen of FIG. 1, the electronic device (101) may display a visual object (131) mapped to a function for changing an image (150) within the preview area (130). In response to an input for selecting a visual object (131) including designated text, such as wallpaper, the electronic device (101) may display a list of one or more images (or one or more videos) stored in the electronic device (101) or provided from an external electronic device connected to the electronic device (101) (e.g., a server associated with the lock screen (160)). In response to an input for selecting an image from the list, the electronic device (101) may change or replace the image (150) displayed within the preview area (130) with another image corresponding to the input.

[0038] Within the editing screen of FIG. 1, the electronic device (101) may display a visual object (133) mapped to a function for editing a frame (or outline) of an image (150) within the preview area (130). Within the editing screen of FIG. 1, the electronic device (101) may display a visual object (134) mapped to a function for applying a visual effect to an image (150) within the preview area (130). The function for applying a visual effect to the image (150) may include an operation for adjusting the color, saturation, and / or brightness of the image (150). The function for applying a visual effect to the image (150) may include an operation for combining or overlapping a designated image, referred to as a sticker, onto the image (150).

[0039] According to one embodiment, the electronic device (101) may display, on the display (110), an edit screen related to the layout of a lock screen (160) including an image (169) and visual objects (e.g., visual objects (161, 163, 164, 165, 166)) superimposed on the image (169). The electronic device (101) may receive a second input for adjusting a position or size of the visual object through the edit screen. In response to the second input, the electronic device (101) may display a visual object (e.g., visual objects (141, 142, 143, 144, 145, 146)) within the edit screen using the position or size indicated by the second input. Depending on the position, and / or the position and / or the size linked to the position and / or the size of the visual object adjusted by the second input, the electronic device (101) can change the position and / or the size of an image (e.g., image (150)) within the editing screen. The operation of the electronic device (101) related to the second input is described in more detail with reference to FIGS. 4A to 4D, FIGS. 5, 10, and FIGS. 11A to 11C.

[0040] The electronic device (101) may receive a third input for adjusting the position or size of an image (e.g., image (169)) of a lock screen through an editing screen. In response to the third input, the electronic device (101) may display an image (e.g., image (150)) within the editing screen using the position or size indicated by the third input. Depending on the position and / or size of the image (150) adjusted by the third input and the position and / or size linked to the position and / or size, the electronic device (101) may change the position and / or size of a visual object (e.g., at least one of the visual objects (141, 142, 143, 144, 145, 146)) within the editing screen.

[0041] Within the exemplary editing screen of FIG. 1, the electronic device (101) may display a visual object (132) mapped to a function for storing the layout of the lock screen (160) visible through the preview area (130). An input indicating selection of the visual object (132) may be referred to as an input for storing the layout of the lock screen (160). In response to the input for selecting the visual object (132), the electronic device (101) may store the image (150) displayed through the preview area (130), and the positional relationship and / or layout of one or more visual objects (e.g., visual objects (141, 142, 143, 144, 145, 146)). Using the stored layout, the electronic device (101) may display the lock screen (160).

[0042] For example, after receiving a fourth input for saving the layout adjusted by the second input and / or the third input through the editing screen, when the state of the electronic device (101) is switched to a designated state for displaying the lock screen (160), the electronic device (101) may display the lock screen (160) having the saved layout on the display (110). For example, the position and / or size of the image (169) and visual objects (161, 163, 164, 165, 166) within the lock screen (160) may correspond to the position and / or size of the image (150) and visual objects (141, 143, 144, 145, 146) within the editing screen.

[0043] According to one embodiment, the electronic device (101) may recommend a layout of the lock screen (160). While displaying the edit screen, in response to an input for adjusting the positions and / or sizes of visual objects (141, 142, 143, 144, 145, 146) associated with one or more widgets to be displayed on the lock screen (160), the electronic device (101) may change the position and / or size of the image (150) as well as the visual object corresponding to the input.

[0044] For example, in response to an input for changing the position and / or size of a visual object (141) corresponding to a visual object (161) within a lock screen (160), the electronic device (101) may move, enlarge, or reduce another visual object (e.g., visual objects (142, 143, 144, 145, 146)) and / or an image (150) that is different from the visual object (141). For example, in response to an input for adjusting an attribute of a visual object (161) within a lock screen (160) (e.g., a font, a color, and / or a size of text included in the visual object (161), the electronic device (101) may change the position, size, and / or color of another visual object and / or image (150) along with changing the shape of the visual object (161) according to the attribute.

[0045] For example, in response to an input for changing an image (150) within a lock screen (160), the electronic device (101) may replace the image (150) within the preview area (130) and change properties (e.g., position, size, color, and / or font) of visual objects (141, 142, 143, 144, 145, 146) superimposed on the image (150). Exemplary operations of the electronic device (101) receiving an input related to the image (150) are described in more detail with reference to FIGS. 6A, 6B, and 7A to 7C. Operations of the electronic device (101) receiving an input for changing the layout of the lock screen (160) displayed through the preview area (130) via an edit screen are described in more detail with reference to FIG. 8. An example of a lock screen (160) displayed by an electronic device (101) that performs the operations of FIGS. 1 to 8 is described in more detail with reference to FIGS. 9a and / or 9b.

[0046] As described above, according to one embodiment, the electronic device (101) may perform a function of recommending or automatically changing the layout of the lock screen (160). For example, the electronic device (101) may guide or display an optimized layout of widgets (e.g., visual objects (161, 163, 164, 165, 166)) and images (169) included in the lock screen (160). The layout may include not only a positional relationship between the widget and the image (169), but also a relationship between colors, brightnesses, and / or saturations of the widget and / or the image (169). The electronic device (101) may change or recommend the layout of the lock screen (160) in real time in response to an input for changing the layout of the lock screen (160). For example, widgets and / or images (169) visualized through the lock screen (160) may have positions, sizes, and / or colors that are linked to each other.

[0047] Hereinafter, with reference to FIG. 2, an exemplary hardware configuration of the electronic device (101) of FIG. 1 is described in more detail.

[0048] FIG. 2 is a block diagram illustrating an example configuration of an electronic device (101) according to various embodiments. The electronic device (101) of FIG. 1 may include the electronic device (101) of FIG. 2. According to one embodiment, the electronic device (101) may include at least one of a processor (210) (including a processing circuit), a memory (215), a display (110), and / or a sensor (220). The processor (210), the memory (215), the display (110), and / or the sensor (220) may be electronically and / or operably coupled with each other by an electronic component, such as a communication bus (202). Hereinafter, the operative coupling of electronic components may refer to a direct connection or an indirect connection established between electronic components, either wired or wireless, such that a second electronic component is controlled by a first electronic component among the electronic components. Although illustrated based on different blocks, the disclosure is not limited thereto, and some of the electronic components of FIG. 2 (e.g., at least a portion of the processor (210) and the memory (215)) may be included in a single integrated circuit such as a system on a chip (SoC). The type and / or number of electronic components included in the electronic device (101) is not limited to those illustrated in FIG. 2. For example, the electronic device (101) may include only some of the electronic components illustrated in FIG. 2.

[0049] A processor (210) of an electronic device (101) according to one embodiment may include a circuit (e.g., a processing circuit) for processing data based on one or more instructions. The circuit for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), a graphic processing unit (GPU), a neural processing unit (NPU), and / or an application processor (AP). For example, the number of processors (210) may be one or more. A processing circuit of a processor that loads (or fetches) instructions and performs calculations corresponding to the loaded instructions may be referred to as or referred to as a core circuit (or core). For example, the processor may have a multi-core processor structure including a plurality of core circuits, such as a dual core, a quad core, a hexa core, or an octa core. In one embodiment having a multi-core processor structure, the core circuits included in the processor (210) may be classified into a big core circuit (or performance core circuit) that processes instructions relatively quickly and a little core circuit (or efficiency core circuit) that processes instructions relatively slowly, depending on speed (e.g., clock frequency), power consumption, and / or cache memory. The functions and / or operations described with reference to the present disclosure may be individually and / or collectively performed by one or more processing circuits included in the processor (210). The processor (210) may include various processing circuits and / or multiple processors.For example, as used herein, including in the claims, the term "processor" may encompass various processing circuits, including at least one processor, one or more of which may be configured, individually and / or collectively, in a distributed manner to perform the various functions described herein. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform several functions, these expressions also cover, for example, but not limited to, situations where a processor performs some of the described functions and other processor(s) perform the remainder of the described functions, and situations where a single processor performs all of the described functions. Additionally, the at least one processor may comprise a combination of processors that perform the various functions described / described, for example, in a distributed manner. The at least one processor may execute program instructions to achieve or perform the various functions.

[0050] According to one embodiment, the memory (215) of the electronic device (101) may include circuitry for storing data and / or instructions input and / or output to the processor (210). For example, the memory (215) may include one or more storage media for storing information and / or instructions. The memory may include, for example, volatile memory, such as random-access memory (RAM), and / or non-volatile memory, such as read-only memory (ROM). The non-volatile memory may be referred to as storage. The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disk, a solid state drive (SSD), and an embedded multi media card (eMMC). The processor (210) of the electronic device (101) may execute instructions of a memory (215) within the electronic device (101) to perform functions and / or operations indicated by the instructions. For example, when the electronic device (101) includes at least one processor, the at least one processor may be configured to collectively or individually execute the instructions.

[0051] Referring to FIG. 2, the electronic device (101) may include a display (110). The disclosure is not limited thereto, and the display (110) may be omitted depending on the form factor of the electronic device (101). The display (110) of the electronic device (101) may output visualized information to a user. For example, the display (110) may be controlled by a controller, such as a graphic processing unit (GPU) and / or a processor (210), to output visualized information to the user. The display (110) may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs may include organic LEDs (OLEDs). The display (110) may include a flat panel display (FPD) and / or electronic paper. The disclosure is not limited thereto, and the display (110) may have an at least partially curved shape or a deformable shape. A display (110) having a deformable shape may be referred to as a flexible display.

[0052] Referring to FIG. 2, various exemplary shapes of an electronic device (101) are illustrated, which are distinguished according to the shape of the display (110). The electronic device (101-1) of the first shape may include a display (110) having a rectangular shape and a non-deformable shape. The electronic device (101-2) of the second shape may include a flexible display having a width greater than its height, and may include a folding axis (F) formed along the height direction of the flexible display. The electronic device (101-3) of the third shape may include a flexible display having a width shorter than its height, and may include a folding axis (F) formed along the width direction of the flexible display. The electronic device (101-4) of the fourth shape and / or the electronic device (101-5) of the fifth shape may include a flexible display that is retractable into a housing or retractable from a housing. The electronic device (101-4) of the fourth aspect may include a flexible display having a height greater than its width, and may include a flexible display that is retractable into the housing along the direction (V) of the height. The electronic device (101-5) of the fifth aspect may include a flexible display having a height shorter than its width, and may include a flexible display that is retractable from the housing along the direction (H) of the width.

[0053] In one embodiment, the electronic device (101) may include a sensor (e.g., a touch sensor panel (TSP)) for detecting an external object (e.g., a user's finger) on the display (110). For example, using the TSP, the electronic device (101) may detect an external object that is in contact with the display (110) or floating on the display (110). In response to detecting the external object, the electronic device (101) may execute a function associated with a specific visual object among visual objects displayed on the display (110) that corresponds to a location of the external object on the display (110).

[0054] According to one embodiment, the sensor (220) of the electronic device (101) may generate electrical information that can be processed by the processor (210) and / or the memory (215) from non-electronic information related to the electronic device (101), and may include various circuits. For example, the sensor (220) may include a global positioning system (GPS) sensor for detecting the geographic location of the electronic device (101). In addition to the GPS method, the sensor (220) may generate information indicating the geographic location of the electronic device (101) based on a global navigation satellite system (GNSS) such as, for example, Galileo, Beidou (compass). The information may be stored in the memory (215), processed by the processor (210), and / or transmitted to another electronic device distinct from the electronic device (101) via a communication circuit.

[0055] The sensor (220) is not limited to those described above, and may include an image sensor, an illuminance sensor, a proximity sensor, an inertial measurement unit (IMU), and / or a ToF sensor for detecting electromagnetic waves including light. The IMU may include at least one of an acceleration sensor, a gyro sensor, and / or a geomagnetic sensor. Referring to FIG. 2, a fingerprint sensor (222) is illustrated as an example of the sensor (220). The processor (210) may obtain information (e.g., a two-dimensional image of the fingerprint) about a fingerprint pattern (e.g., a path, trajectory, and / or pattern of the grooves and ridges) formed on a body part (e.g., a fingertip) that has come into contact with the fingerprint sensor (222) from the fingerprint sensor (222). Since a person has a unique fingerprint, the processor (210) may use the information obtained from the fingerprint sensor (222) to perform a function of authenticating a user. To authenticate a user, the electronic device (101) may include a sensor configured to obtain biometric information of the user, such as a fingerprint sensor (222). For example, the electronic device (101) may include an iris sensor and / or a time-of-flight (ToF) sensor configured to obtain a three-dimensional shape of the face.

[0056] In one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by the processor (210) may be stored in the memory (215) of the electronic device (101). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, a program, and / or a software application (hereinafter, “application”). For example, the electronic device and / or the processor may perform at least one of the operations of FIG. 5, FIGS. 7A to 7C, and / or FIG. 8 when a set of a plurality of instructions distributed in the form of an operating system, firmware, driver, and / or application is executed. Hereinafter, for example, the fact that an application is installed on an electronic device may refer to one or more instructions provided in the form of an application being stored in a memory of the electronic device, and the one or more applications being stored in a format (e.g., a file having an extension specified by an operating system of the electronic device) that is individually and / or collectively executable by at least one processor (e.g., processor (210)) of the electronic device.

[0057] Referring to FIG. 2, a lock screen application (230) may be installed in the memory (215) of the electronic device (101). The lock screen application (230) and / or instructions included in the lock screen application (230) (e.g., a package file storing the instructions) may be stored in a non-transitory computer-readable storage medium or may be published via a network (e.g., the Internet). The disclosure is not limited thereto, and the lock screen application (230) may be installed in the memory (215) as at least a part of the operating system of the electronic device (101).

[0058] The lock screen application (230) may include information indicating that the software application is executable in the locked state. The information may be stored in the metadata of the lock screen application (230) (e.g., metadata stored in a file named androidmanifest.xml). The information may include designated text and / or a flag indicating that the lock screen application (230) is executable in the locked state. When switching to the locked state, the processor (210) may execute the lock screen application (230) including the information in the metadata to display a lock screen (e.g., the lock screen (160) of FIG. 1) on the display (110). The processor (210) that executes the lock screen application (230) in the locked state may display the lock screen on the display (110). In a state other than the locked state, the processor (210) that executes the lock screen application (230) may display an editing screen for changing the layout of the lock screen.

[0059] In one embodiment, the locked state may be related to a state of hardware (e.g., processor (210)) included in the electronic device (101). Below, with reference to FIG. 3, different states of the electronic device (101) and / or the processor (210) are illustrated.

[0060] FIG. 3 illustrates a state transition diagram of an electronic device according to one embodiment. The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may switch to any one of the states described with reference to FIG. 3.

[0061] Referring to FIG. 3, the state of the electronic device can be divided into a low-power state and an active state depending on the state of the processor (e.g., the processor 210 of FIG. 2). The disclosure is not limited thereto, and the state of the electronic device may further include a state in which the electronic device and / or the processor consumes power below standby power or substantially does not consume power, such as an inactive state. The low-power state of the electronic device may refer to, for example, that the processor of the electronic device is turned off, receives a power signal having a voltage below a specified voltage, or that a portion of the processor (e.g., a portion of the processor referred to as a core circuit and / or processing circuit) is inactive. The active state of the electronic device may refer to, for example, that the processor of the electronic device is turned on, receives a power signal having a voltage above the specified voltage, or that the portion of the processor is activated. The low-power state may be referred to as an off state and / or a sleep state. The active state may be referred to as an on state, a wake-up state, and / or a high-power state. The active state may include the idle state.

[0062] Referring to FIG. 3, according to one embodiment, a locked state of an electronic device may include at least one of a state (330) of displaying a lock screen (e.g., a lock screen (160) of FIG. 1), a state (320) of displaying an always-on-display (AOD) screen, and / or a state (310) of disabling a display of the electronic device (e.g., a display (110) of FIGS. 1 and 2). In the states (310, 320, 330), the electronic device may block access to information stored in the electronic device and / or execution of software applications of the electronic device without user authentication.

[0063] Depending on whether the AOD function is activated, the electronic device may switch to a state (320) of displaying an AOD screen. The AOD function may cause the electronic device to keep the display active while the electronic device is turned on in order to reduce the frequency with which the electronic device switches to the active state. While the AOD function is running, the electronic device operating in a low power state may display an AOD screen including one or more widgets (e.g., a clock widget such as the visual object (161) of FIG. 1) in order to reduce unnecessary inputs for switching the state of the processor to the active state. Within the state (320) of displaying the AOD screen, if the display is covered and / or obscured by an external object, the electronic device may switch to a state (310).

[0064] In at least one of the states (310, 320) included in the low-power state, the electronic device may receive an input for switching the state of the processor to an active state. The input may be detected by a gesture of pressing a button exposed through a housing of the electronic device (e.g., a power button, a button for adjusting volume, and / or a button to which one or more designated functions are mapped). The input may be detected by a gesture of tapping a display of the electronic device. The input may be detected by an utterance including a designated keyword. The input may be detected by an action of moving and / or rotating the electronic device. The electronic device receiving the input may switch from at least one of the states (310, 320) to a state (330) of displaying a lock screen.

[0065] Within state (330), the electronic device may display a lock screen (e.g., lock screen (160) of FIG. 1) that occupies the entire display. While displaying the lock screen, the electronic device may use one or more widgets included in the lock screen to visualize information that is permitted to be accessed while displaying the lock screen. The layout of the lock screen may be changed by the operation of the electronic device described with reference to FIGS. 1 and 2.

[0066] While the lock screen is displayed (330), the electronic device may perform an operation for authentication. For example, in one embodiment including a fingerprint sensor (e.g., fingerprint sensor 222 of FIG. 2) disposed in a second layer below a first layer on which a display is disposed, the electronic device may obtain information from the fingerprint sensor in response to detecting an external object (e.g., a fingertip) in contact with a portion of the display overlapping the fingerprint sensor. By comparing the information obtained from the fingerprint sensor with information previously registered in the electronic device, the electronic device may authenticate a user of the external object (e.g., a user currently using the electronic device). The location of the fingerprint sensor is not limited to the above examples, and for example, the fingerprint sensor may be disposed on a side (e.g., a side and / or a back) different from the front side of the electronic device on which the display is disposed. For example, the fingerprint sensor may be integrated with a specific button (e.g., a power button) of the electronic device and may obtain information about a fingertip in contact with a surface of the specific button.

[0067] In one embodiment, within a state (330) of displaying a lock screen, the electronic device may activate a camera and / or a ToF sensor to obtain biometric information related to the face and / or eyes of the user facing the camera and / or the ToF sensor. The electronic device may authenticate the user by comparing the biometric information with biometric information previously registered in the electronic device. The camera and / or the ToF sensor may be positioned on the front side where the display of the electronic device is positioned, facing the external environment. Within the state (330), if the user authentication repeatedly fails, the electronic device may increase the interval for authenticating the user or request additional information for authentication.

[0068] While the operation of an electronic device for authenticating a user using biometric information has been described, the disclosure is not limited thereto. Within state (330), the electronic device may, in response to a designated gesture (e.g., a swipe gesture moving along a vertical direction of the display), display another screen for receiving a password and / or a personal identification number (PIN). The electronic device may authenticate the user by comparing the password and / or PIN received via the other screen with a previously registered password and / or PIN.

[0069] Within state (330), based on user authentication, the electronic device may switch to an unlocked state (340). Within state (340), the electronic device may display various screens on the display. For example, the electronic device may display a launcher screen (or home screen) configured to provide a list of software applications stored on the electronic device on the display. For example, the electronic device may display an editing screen for changing the layout of the lock screen displayed within state (330) on the display. Within state (340), in response to an input for executing a software application installed on the electronic device, the electronic device may execute a software application corresponding to the input and display an execution screen provided from the executed software application on the display.

[0070] Referring to FIG. 3, from a state (340) within an active state, the electronic device may switch to a low-power state based on a specified condition. For example, in response to a gesture of pressing a specified button (e.g., a power button) of the electronic device, the electronic device may switch from the state (340) to the low-power state, and / or to at least one of the states (310, 320, 330) within the locked state. For example, if, within the state (340), no user input (e.g., a touch input on a display) is received for a period exceeding a specified period (e.g., about 10 seconds), the electronic device may switch to the low-power state, and / or to at least one of the states (310, 320, 330) within the locked state.

[0071] While one embodiment has been described that requires switching to a state (330) associated with a lock screen in order to enter state (340), the disclosure is not limited thereto. For example, depending on whether the function to display a lock screen is activated, the electronic device may switch to state (330). Upon activating the function to display a lock screen, the electronic device may obtain or register information required for authentication from the user (e.g., biometric information for a fingerprint, iris, and / or face, and / or a password and / or a PIN). If the function to display a lock screen is not activated (or prior to activating the function to display a lock screen), the electronic device may directly switch from any of states (310, 320) to state (340) in response to an input for switching the state of the processor to an active state.

[0072] As described above, according to one embodiment, the electronic device may display a lock screen having a layout stored in the electronic device on the display when the state of at least one processor included in the electronic device is switched to a designated state for displaying the lock screen (e.g., state (330)). Hereinafter, exemplary operations of the electronic device for receiving an input for editing the layout within an editing screen related to the lock screen will be described in more detail with reference to FIGS. 4A to 4D.

[0073] Figures 4a, 4b, 4c, and 4d illustrate exemplary states (401, 402, 403, 404) of an electronic device (101) displaying an editing screen related to a lock screen. The electronic device (101) of Figures 1 to 2 and / or the processor (210) of Figure 2 may perform the operations of the electronic device (101) described with reference to Figures 4a to 4d.

[0074] FIGS. 4A through 4D are diagrams illustrating exemplary states (401, 402, 403, 404) of an electronic device (101) displaying an editing screen on a display (110) according to various embodiments. The electronic device (101) may display the exemplary screens of FIGS. 4A, 4B, 4C, and 4D (which may be referred to as FIGS. 4A through 4D) while executing the lock screen application (230) of FIG. 2 in an active state (e.g., state (340) of FIG. 3).

[0075] In one embodiment, the electronic device (101) may display an editing screen based on an input for changing the layout of the lock screen. The input may be received while a designated software application, such as a settings application, is running and configured to adjust settings and / or preferences of the electronic device (101). For example, the input may include an input for selecting a button, menu, and / or option related to the lock screen within a screen provided by the designated software application. For example, the input may include an input for selecting a button, menu, and / or option displayed by a designated gesture on the lock screen (e.g., a long-touch gesture by an external object in contact with the display for more than about 1.5 seconds).

[0076] Referring to FIG. 4A, a state (401) of displaying an editing screen on a display (110) is illustrated. The state (401) of FIG. 4A may include the state of FIG. 1 of displaying an editing screen on the display (110). By performing object recognition on an image (150) displayed on a preview area (130), the electronic device (101) may detect or determine a portion (410) related to a subject (e.g., a teddy bear) within the image (150). The object recognition may be performed using an algorithm that detects a subject and / or a foreground object within an image (150), such as a photograph. The algorithm may include a computational model for neural activity of animals, including humans, such as a convolutional neural network (CNN) and / or a long-short term memory (LSTM). The computational model may be referred to as an artificial neural network and / or a neural network. Part (410) may be referred to as a visual object area.

[0077] In one embodiment, object recognition for the image (150) may be completed prior to a state (401) of displaying an editing screen. For example, the electronic device (101) may obtain a result of performing the object recognition from metadata related to the image (150). Within the metadata, the electronic device (101) may identify or confirm data indicating the position, size, and / or shape of a portion (410) of the image (150) as the result. Together with the data, the electronic device (101) may identify or confirm data indicating the category, type, and / or class of the subject related to the portion (410) from the metadata.

[0078] Referring to FIG. 4A, in a state (401) of displaying an editing screen including a preview area (130) that guides the layout of a lock screen, the electronic device (101) may receive an input for changing the properties of a widget to be displayed on the lock screen. For example, the electronic device (101) may receive an input related to a visual object (141) corresponding to a clock widget. The input may be performed by a user to change the properties of the clock widget. In a state (401) of displaying an editing screen, the electronic device (101) may execute a software application (e.g., a clock application) corresponding to the clock widget to obtain information for displaying the visual object (141) in the preview area (130). The information may include parameters indicating the appearance of the visual object (141) and / or the clock widget, such as the position, shape, size, and / or color of the visual object (141).

[0079] In response to an input related to a visual object (141), the electronic device (101) may display a pop-up window (411) for changing the properties of a widget (e.g., a clock widget) corresponding to the visual object (141). The pop-up window (411) may be displayed as an overlay on the display (110) within a state (401) of displaying an editing screen. For example, the pop-up window (411) may occupy a portion (e.g., a portion including the bottom edge of the display area) of the entire display area of ​​the display (110) occupied by the editing screen. In a state (401) of displaying a visual object (141) by executing a software application different from the lock screen application, together with a lock screen application providing the editing screen, the electronic device (101) may display a pop-up window (411) provided by the software application in response to the input. For example, a pop-up window (411) may be provided from a software application executed by the electronic device (101) to provide a visual object (141).

[0080] Referring to FIG. 4A, an example of a pop-up window (411) that is displayed as an overlay on a display (110) within a state (401) is illustrated. When an input for changing a property of a clock widget is received using a visual object (141) associated with the clock widget, the electronic device (101) may display options for adjusting the layout of text (e.g., numbers and / or strings indicating a date and / or time) to be included in the clock widget within the pop-up window (411). Referring to FIG. 4A, within the pop-up window (411), the electronic device (101) may display images, icons, and / or visual objects corresponding to each of the options.

[0081] Referring to FIG. 4A, within a pop-up window (411), the electronic device (101) may display options (412) related to the color of text to be included in the clock widget. The options (412) may include at least one of a recommended color calculated by the electronic device (101), a plurality of designated colors within a color space, and / or a gradient color based on at least two colors. In response to an input selecting any one of the options (412), the electronic device (101) may change a property of the clock widget such that a color included in the clock widget has a color corresponding to the option associated with the input.

[0082] Referring to FIG. 4A, a state (402) of the electronic device (101) is illustrated after receiving an input for selecting one of the options (412). In response to the input, the electronic device (101) may hide or remove a pop-up window (411) being displayed on the display (110). In the state (402) after the pop-up window (411) is removed, the electronic device (101) may display a visual object (141) having a color associated with the option corresponding to the input in the preview area (130). Referring to the states (401, 402) of FIG. 4A, a first crop portion cropped from a source image of the electronic device (101) in the state (401) and a second crop portion cropped from the source image in the state (402) may be different from each other. For example, a visual object (141) may be displayed in the preview area (130) to represent a clock widget having properties changed by the input.

[0083] According to one embodiment, when the electronic device (101) receives an input for changing the properties of a widget of a lock screen, the electronic device (101) may change not only the properties of the widget, but also the properties (e.g., location, size, magnification, and / or color) of other widgets and / or images (150) to be displayed together with the widget within the lock screen. Referring to states (401, 402) of FIG. 4A, after receiving an input for changing the properties of a clock widget (e.g., color of text included in the clock widget) corresponding to a visual object (141) based on options (412), the electronic device (101) may enlarge the image (150) within the preview area (130). Enlarging the image (150) may include resetting or enlarging a portion to be cropped for display in the editing screen and / or the preview area (130) within a source image stored in the electronic device (101). Based on the enlargement of the image (150), the area of ​​the portion (410) related to the subject within the preview area (130) may be increased. For example, the electronic device (101) may change the position and / or size of at least a portion of the image (150) visible through the preview area (130) according to the color of the widget and / or the visual object (141) changed by the input. For example, the electronic device (101) may change the hue and / or saturation of at least a portion of the image (150) visible through the preview area (130) according to the color of the widget and / or the visual object (141) changed by the input.

[0084] For example, when an input is received to change the color of a clock widget corresponding to a visual object (141), the electronic device (101) may cause the representative color of at least a portion of the image (150) visible through the preview area (130) to match the color or have a hue and / or saturation similar to the color. For example, the electronic device (101) may change the representative color by changing the position and / or size of at least a portion of the image (150) visible through the preview area (130) within the image (150). Here, the representative color may include an average color, a most frequent color, and / or a mixture of the colors based on a specified formula of the colors of each of the pixels included in the image (150). The representative color may be referred to as a vibrant color. Within the state (402) of FIG. 4a, the representative color of the portion of the image (150) corresponding to the preview area (130) may match the color of the text of the clock widget expressed through the visual object (141), or may have a hue difference less than a threshold specified for the color.

[0085] Within the state (402) of FIG. 4a, in response to an input for selecting a visual object (132), the electronic device (101) may store the layout of the preview area (130) being displayed within the state (402). After the layout of the preview area (130) within the state (402) is stored, when the state of the electronic device (101) is switched to a locked state (e.g., state (330) of FIG. 3), the electronic device (101) may display a lock screen including one or more widgets arranged based on the layout (e.g., a clock widget corresponding to the visual object (141)) and an image (150) on the display (110). A portion of the image (150) visible through the lock screen may match a portion of the image (150) visible through the preview area (130) within the state (402) of FIG. 4a.

[0086] The input for changing the properties of a widget is not limited to the input for changing the color of the widget. Referring to FIG. 4B, within the state (401) of FIG. 4A, the electronic device (101) may receive an input for moving a visual object (141) corresponding to a clock widget. The input may include a drag gesture of an external object that comes into contact with a portion of the display (110) on which the visual object (141) is displayed. Depending on the path (431) along which the external object is dragged on the preview area (130) of the display (110), the electronic device (101) may change the position of the visual object (141) within the preview area (130), or may shift it. For example, the visual object (141) may be translated in parallel within the preview area (130) along the path (431).

[0087] Referring to FIG. 4b, when an external object moving along a path (431) is separated from the display (110) or moves outside the preview area (130), the electronic device (101) may stop adjusting the position of the visual object (141) along the path (431). Referring to FIG. 4b, a state (403) after the electronic device (101) stops adjusting the position of the visual object (141) is illustrated. Referring to FIG. 4b, in the state (403) after an input for moving the visual object (141) is completed (or released), the electronic device (101) may display the visual object (141) at the point in the preview area (130) where the input was completed. When visual objects (141, 142, 143) have positions that are linked to each other within the preview area (130), the electronic device (101) can display all of the visual objects (141, 142, 143) at the point within the preview area (130) where the input is completed.

[0088] Referring to FIG. 4B, visual objects (141, 142, 143) may be aligned according to their positions within the preview area (130). For example, within a state (401) where the visual objects (141, 142, 143) are arranged along the center of the horizontal axis of the preview area (130), the electronic device (101) may display the visual objects (141, 142, 143) such that the center points of the visual objects (141, 142, 143) are arranged along a vertical axis that equally divides the preview area (130) (e.g., center aligned). For example, when the visual objects (141, 142, 143) are moved closer to the right edge of the preview area (130) (403), the electronic device (101) may display the visual objects (141, 142, 143) such that the right edges of the visual objects (141, 142, 143) are arranged along a vertical axis parallel to the right edge of the preview area (130) (e.g., right aligned). Similarly, when the visual objects (141, 142, 143) are moved closer to the left edge of the preview area (130), the electronic device (101) may display the visual objects (141, 142, 143) such that the left edges of the visual objects (141, 142, 143) are arranged along a vertical axis adjacent to the left edge of the preview area (130) (e.g., left aligned).

[0089] According to one embodiment, when the electronic device (101) receives an input for moving a widget, it may not only move the widget corresponding to the input, but also change the properties of other widgets and / or images (150) to be displayed together with the widget within the lock screen. Referring to states (401, 403) of FIG. 4B, after receiving an input for moving a visual object (141) along a path (431) (e.g., a drag gesture based on an external object performed along the path (431), the electronic device (101) may change the position and / or size of the image (150) visible through the preview area (130). As the state (401) of FIG. 4B switches to state (403), the position within the preview area (130) where the subject-related portion (410) is visible may move away from the visual object (141). For example, the subject-related portion (410) may be changed to a portion that includes the lower left corner of the preview area (130). In addition to changing the position of the subject-related portion (410) within the preview area (130), the electronic device (101) may enlarge the portion (410) to increase the proportion and / or area of ​​the portion (410) within the preview area (130).

[0090] The electronic device (101) may, while receiving an input for moving a widget such as a visual object (141), move the widget corresponding to the input and change the position and / or size of the image (150) (e.g., the portion corresponding to the subject (410)). The disclosure is not limited thereto, and the electronic device (101) may, based on the release of the input, move the widget corresponding to the input and change the position and / or size of the image (150).

[0091] Within the state (403) of FIG. 4B, in response to an input indicating selection of a visual object (132), the electronic device (101) may store the layout of the preview area (130) being displayed within the state (403). For example, after the layout is stored, if the state of the electronic device (101) is switched to a locked state, the electronic device (101) may display a lock screen based on the layout on the display (110). For example, within the lock screen, a clock widget (e.g., a clock widget corresponding to the visual object (141)) may be displayed at a location corresponding to a location within the preview area (130) of the state (403) (e.g., at a location adjacent to the right edge of the display (110). For example, within the lock screen, an image (150) may be positioned at a location where a portion (410) related to a subject includes a lower left corner of the display (110). Referring to states (401, 403) of FIG. 4B, in each of states (401, 403), portions cropped from a source image stored in the electronic device (101) may be formed independently from the source image. For example, a first crop portion cropped from the source image in state (401) and a second crop portion cropped from the source image in state (403) may be different from each other or may at least partially overlap. The position and / or size of the first crop portion within the source image may be different from, or may be set independently of, the position and / or size of the second crop portion within the source image.

[0092] The input for changing the properties of the widget is not limited to input for changing the color and / or position of the widget. Referring to FIG. 4C, within the state (401) of FIG. 4A, the electronic device (101) may receive an input for changing the size of a visual object (141) corresponding to a clock widget. The input may include a pinch gesture of external objects (e.g., two fingers) that contact (substantially simultaneously) at least two points within a portion of the display (110) where the visual object (141) is displayed. For example, when the external objects that contact the portion of the display (110) where the preview area (130) is displayed approach each other, the distance between the external objects may be reduced. In the example, the electronic device (101) may reduce the size of the visual object (141) according to the reduced distance.

[0093] In an exemplary state (401) of FIG. 4c, one of the external objects that is in contact with a portion of the display (110) on which a visual object (141) is displayed may move along a path (441), and another external object may move along a path (442). When the external objects move substantially simultaneously along the paths (441, 442), a distance between the external objects may increase. The electronic device (101) may increase the size of the visual object (141) according to the increased distance. For example, the electronic device (101) may increase the size of the visual object (141) until the width and / or height of the visual object (141) increases to be greater than or equal to the width and / or height of the preview area (130).

[0094] Referring to FIG. 4c, when at least one of the external objects moving along the paths (441, 442) is separated from the display (110) or moved outside the preview area (130), the electronic device (101) may stop enlarging or reducing the visual object (141) depending on the distance between the external objects. Referring to FIG. 4c, a state (404) after the electronic device (101) stops adjusting the size of the visual object (141) is illustrated. Referring to FIG. 4c, in the state (404) after the input for adjusting the size of the visual object (141) is completed, the electronic device (101) may display the visual object (141) having the size adjusted by the input within the preview area (130).

[0095] In one embodiment, when the visual objects (141, 142, 143) have sizes that are linked to each other within the preview area (130), the electronic device (101) may enlarge or reduce all of the visual objects (141, 142, 143) using the sizes adjusted by the input. In the exemplary state (404) of FIG. 4c, the visual objects (142, 143) may also be enlarged according to the ratio by which the size (e.g., dimensions such as height, width, and / or area) of the visual object (141) is enlarged by the input that adjusts the size of the visual object (141). For example, when the visual object (141) is reduced by the input, the visual objects (142, 143) may also be reduced according to the ratio by which the size of the visual object (141) is reduced by the input.

[0096] According to one embodiment, when the electronic device (101) receives an input for adjusting the size of a widget, the electronic device (101) may not only enlarge or reduce the widget corresponding to the input, but also change or adjust the properties of other widgets and / or images (150) to be displayed together with the widget within the lock screen. Referring to states (401, 404) of FIG. 4c, when the electronic device (101) receives an input for enlarging a visual object (141) along paths (441, 442) (e.g., a pinch gesture based on external objects performed along paths (441, 442)), the electronic device (101) may change or adjust the position and / or size of the image (150) visible through the preview area (130).

[0097] As the state (401) of FIG. 4c is switched to the state (404), the size of the preview area (130) in which the subject-related portion (410) is visible may be enlarged. For example, the electronic device (101) may enlarge or reduce the portion (410) within the preview area (130) by using the ratio (e.g., the change in width, height, and / or area) by which the size of the visual object (141) is enlarged by the input. The disclosure is not limited thereto, and the electronic device (101) may enlarge or reduce the portion (410) within the preview area (130) such that the width and / or height of the subject-related portion (410) correspond to the width and / or height of the visual object (141) whose size has been changed by the input. Along with changing the size of the portion (410), the electronic device (101) can change or adjust the position of the portion (410) within the preview area (130) by using the position of the visual object (141) within the preview area (130) having the changed size.

[0098] Referring to states (401, 404) of FIG. 4c, a first crop portion (e.g., an image (150) displayed through a preview area (130) within state (401)) cropped from a source image stored in the electronic device (100) within state (401) and a second crop portion (e.g., an image (150) displayed through a preview area (130) within state (403)) cropped from a source image stored in the electronic device (100) within state (403) may be different from each other. For example, a position and / or size of the first crop portion within the source image may be different from a position and / or size of the second crop portion within the source image.

[0099] Within the state (404) of FIG. 4c, the electronic device (101) that has received an input indicating selection of a visual object (132) may store the layout of the preview area (130) of the state (404). After the layout of the preview area (130) of the state (404) is stored, when the state of the processor of the electronic device (101) is switched to a locked state or an input for displaying a lock screen is received, the electronic device (101) may display a lock screen having the stored layout. Within the lock screen, the clock widget may have the position and / or size of the visual object (141) displayed within the preview area (130) of the state (404). Within the lock screen, the image (150) may have the position, size, and / or magnification that were displayed within the preview area (130) of the state (404). The disclosure is not limited thereto, and the electronic device (101) that receives input related to a visual object (132) within the state (401) of FIGS. 4A to 4C may determine or store the layout of the preview area (130) in the state (401) as the layout of the lock screen.

[0100] Referring to FIG. 4d, exemplary states (405, 406) of an electronic device (101) providing a lock screen having a layout of state (404) of FIG. 4c are illustrated. Within state (404) of FIG. 4c, upon receiving an input for storing the layout of the lock screen and switching to a locked state, the electronic device (101) may display a lock screen as in state (405). The layout of the lock screen displayed within the display (110) may have a positional relationship between visual objects (141, 142, 143, 144, 145, 146) and images (150) that were stored within state (405).

[0101] Referring to FIG. 4D, in a state (405) of displaying a lock screen, the electronic device (101) may display one or more visual objects (461, 462, 463) for expressing notification messages. For example, the electronic device (101) may display one or more visual objects (461, 462, 463) based on a signal received from the electronic device (101) through a network, such as a push message, and / or an event generated by a software application executed by the electronic device (101). The positions at which the visual objects (461, 462, 463) are displayed may be related to the positions of widgets (e.g., visual objects (161, 163, 165, 166)) set in the state (404). For example, the electronic device (101) may display visual objects (461, 462, 463) in a location and / or area that does not overlap with the visual objects (161, 163) displayed on the display (110). Within the display (110), the visual objects (461, 462, 463) may be displayed below the visual objects (161, 163). As the number of notification messages increases, the number of visual objects (461, 462, 463) displayed through the display (110) may increase.

[0102] Referring to FIG. 4D, in a state (406) after a state (405), an area of ​​the display (110) occupied by visual objects (461, 462, 463) may increase. In one embodiment, the electronic device (101) may change the position and / or size of a portion (410) related to a subject (e.g., a visual object area) in a background image of the lock screen, based on a state of the display (110) that further includes visual objects (461, 462, 463). For example, the electronic device (101) may display the portion (410) by reducing its size so that the portion (410) is separated from (or not obscured by) the visual objects (461, 462, 463) within the lock screen. Within a state (406) of displaying a portion (410) at the bottom of the display (110), the electronic device (101) can reduce or move the portion (410) so that the portion (410) is away from the visual objects (165, 166) arranged at the bottom of the display (110).

[0103] In one embodiment of switching from state (405) to state (406) of FIG. 4d, an exemplary operation of reducing the size of a portion (410) has been described, but the disclosure is not limited thereto. For example, if the number of visual objects (461, 462, 463) within the display (110) is reduced (e.g., if a user input is received to remove at least one of the visual objects (461, 462, 463), the electronic device (101) may re-enlarge or move the portion (410) by utilizing the location and / or area of ​​the portion not occupied by the visual objects (461, 462, 463) within the display (110).

[0104] As described above, according to one embodiment, the electronic device (101) may receive an input for changing at least one of the properties (e.g., properties corresponding to position, size, and / or color, respectively) of one or more widgets included in the lock screen while displaying an editing screen for adjusting the layout of the lock screen. Based on the input, the electronic device (101) may change at least one property of the one or more widgets. Based on the input, the electronic device (101) may change at least one of the properties (e.g., properties corresponding to position, size, and / or color, respectively) of a background image (e.g., image (150) of FIGS. 4A to 4D) arranged below the one or more widgets within the lock screen. For example, in response to an input for changing the position of one or more widgets within a lock screen corresponding to the editing screen through an editing screen, the electronic device (101) may move the position of a portion (410) related to a subject of a background image within a preview area (130) of the editing screen to a position based on the changed position.

[0105] Hereinafter, with reference to FIG. 5, an exemplary flowchart for the operation of the electronic device (101) described with reference to FIGS. 4a to 4d is described in more detail.

[0106] FIG. 5 is a flowchart illustrating exemplary operations of an electronic device according to various embodiments. The electronic device (101) of FIGS. 1 to 2 and / or the processor (210) of FIG. 2 may perform the operations of the electronic device described with reference to FIG. 5. At least one of the operations of FIG. 5 may be related to the operations of the electronic device (101) described with reference to FIGS. 4A to 4D. The order in which the operations of FIG. 5 are performed is not limited to the order illustrated in FIG. 5. For example, the operations of FIG. 5 may be performed in a different order than the order illustrated in FIG. 5, or at least two of the operations of FIG. 5 may be performed substantially simultaneously (e.g., multitasking and / or multithreading).

[0107] Referring to FIG. 5, in operation (510), according to an embodiment, a processor of an electronic device may receive a user input for changing a property of a visual object. The user input of operation (510) may be received while displaying an editing screen for editing the layout of a lock screen (e.g., the lock screen (160) of FIG. 1). The processor may guide a lock screen having a layout adjusted by the editing screen through a preview area of ​​the editing screen (e.g., the preview area (130) of FIGS. 1 and 4A to 4D). Through the preview area, the processor may receive the user input of operation (510). Inputs received in states (401) of FIGS. 4A to 4D may be examples of the user input of operation (510). The visual object of operation (510) may correspond to a widget and / or an icon to be included in the lock screen as a visual object included in the preview area.

[0108] Referring to FIG. 5, in operation (520), a processor of an electronic device according to an embodiment may determine whether an attribute representing a color of a visual object has changed. The attribute of operation (520) may include the color of text, shapes, images, and / or videos included in the visual object. The attribute of operation (520) may include one or more numerical values ​​related to the color expressed using a color space of RGB, YUV (e.g., YCbCr), and / or HSV. If the attribute representing the color of the visual object has changed (520—Yes), the processor may perform operation (530). If the attribute representing the color of the visual object has not changed by the user input of operation (510) and / or is maintained (520—No), the processor may perform operation (540).

[0109] Referring to FIG. 5, in operation (530), according to an embodiment, a processor of an electronic device may change the position or size of an image within a preview area using a first color corresponding to a changed attribute. In response to a change in the attribute of operation (520), the processor performing operation (530) may determine the hue, saturation, and brightness of the first color corresponding to the changed color using an HSV color space based on hue, saturation, and brightness. The processor may determine or calculate a reference color to be used for changing the position or size of the image using the hue, saturation, and / or brightness. The reference color may be determined to be substantially the same as or similar to the first color. The reference color may include a vibrant color.

[0110] Within the operation (530), the processor may change the position and / or size of an image (e.g., image (150) of FIGS. 1 and 4A to 4D) within the preview area using the first color and / or a reference color determined using the first color. The processor may select, determine, or segment at least a portion of the image included in the preview area such that a representative color of at least a portion of the image visible through the preview area matches the reference color. While switching from state (401) of FIG. 4A to state (402), the processor may perform operation (530) of FIG. 5. According to operation (530), the processor that changed the position and / or size of the image may conditionally perform operation (540) of FIG. 5.

[0111] The disclosure is not limited thereto, and the processor may change the hue, saturation, and / or brightness of the visual object by comparing the color of the visual object changed by the properties of the operation (510) with the representative color of the image in the preview area. For example, to enhance the visibility of the visual object compared to the image displayed through the preview area, the processor may change the hue, saturation, and / or brightness of the visual object. For example, if the hue of the representative color is less than or equal to 44, or is less than or equal to 226 and less than or equal to 359, the processor may determine whether the color of the visual object corresponds to a color that is greater than 7 levels among 12 designated colors associated with the representative color. If the color of the visual object corresponds to a color that is greater than 7 levels, the processor may extract a color that has a brightness level that is greater than 65 levels among colors in the 8th to 10th levels among the 12 designated colors. Using the extracted color, the processor can change the hue and / or saturation of the visual object. For example, the processor can increase the hue of the visual object by 5 and increase the saturation by 30. If the color of the visual object corresponds to a color with a level less than 7, the processor can extract a color having a brightness level that is 35 less than the colors in levels 1 through 7. Using the extracted color, the processor can change the hue and / or saturation of the visual object. For example, the processor can increase the hue of the visual object by 5 and increase the saturation by 30.

[0112] For example, if the hue of the representative color of the image is within a second specified range that is greater than 45 and less than 89, the processor can determine whether the color of the visual object corresponds to a color that is greater than 6 levels among the 12 specified colors associated with the representative color. If the color of the visual object is greater than 6 levels, the processor can extract a color that has a brightness level that is 50 levels greater than the colors in steps 8 to 12. Using the extracted color, the processor can decrease the hue of the visual object by 10 and increase the saturation by 30. If the color of the visual object is less than 6 levels, the processor can extract a color that has a brightness level that is 50 levels less than the colors in steps 1 to 6. Using the extracted color, the processor can decrease the hue of the visual object by 10 and increase the saturation by 30.

[0113] For example, if the hue of the representative color of the image is within a third specified range that is greater than 90 and less than 226, the processor can determine whether the color of the visual object corresponds to a color that is greater than 7 levels among the 12 specified colors associated with the representative color. If the color of the visual object is greater than 7 levels, the processor can extract a color that has a brightness level that is 65 levels greater than the colors in steps 8 to 12. Using the extracted color, the processor can decrease the hue of the visual object by 10 and increase the saturation by 30. If the color of the visual object is less than 7 levels, the processor can extract a color that has a brightness level that is 35 levels less than the colors in steps 1 to 7. Using the extracted color, the processor can decrease the hue of the visual object by 10 and increase the saturation by 30.

[0114] Referring to FIG. 5 , in operation (540), a processor of an electronic device according to an embodiment may change a position and / or a size of an image within a preview area based on whether a property corresponding to a position and / or a size of a visual object has changed. The property of operation (540) may include coordinate values ​​representing a position and / or a size of a visual object within a preview area of ​​an editing screen. When the processor receives an input for changing a position and / or a size of a visual object, as described with reference to FIGS. 4B and 4C , the processor may perform operation (540). The processor performing operation (540) may change the position and / or the size of the image within the preview area by using a positional relationship, layout, and / or composition between at least a portion of an image included in the preview area and one or more visual objects corresponding to one or more widgets of the lock screen, respectively. The operation of changing the position and / or size of the image within the preview area may include the operation of adjusting the reference coordinate values ​​of the image within the preview area, and / or the operation of adjusting properties related to the magnification of the image. While switching from state (401) of FIG. 4b to state (403), and / or while switching from state (401) to state (404) of FIG. 4c, the processor may perform operation (540) of FIG. 5.

[0115] As described above, according to one embodiment, the processor of the electronic device may change properties of an image displayed together with one or more widgets within the lock screen in response to an input that changes the position and / or size of one or more visual objects corresponding to one or more widgets within the lock screen. The properties of the image changed by the electronic device may include the position, size, and / or color of the image within the lock screen.

[0116] According to one embodiment, an electronic device may change the positions and / or sizes of one or more widgets superimposed on an image to be displayed on a lock screen, depending on the image. Hereinafter, with reference to FIGS. 6A and 6B, exemplary operations of an electronic device that change the positions and / or sizes of one or more widgets included in a lock screen using an image associated with the lock screen are described in more detail.

[0117] FIGS. 6A and 6B are diagrams illustrating exemplary states of an electronic device displaying an editing screen related to a lock screen according to various embodiments. The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations of the electronic device described with reference to FIGS. 6A and 6B . At least one of the operations of FIGS. 6A and 6B may be related to the operations of the electronic device (101) described with reference to FIG. 5 .

[0118] Referring to FIGS. 6A and 6B, exemplary states of an electronic device (101) displaying an editing screen on a display (110) are illustrated. After completing authentication of a user of the electronic device (101), the electronic device (101) may, for example, execute the lock screen application (230) of FIG. 2 to display the exemplary screens of FIGS. 6A and 6B.

[0119] Within the lock screen, the electronic device (101) may display an image personalized by the user. In one embodiment of the electronic device (101) including one or more cameras, the image may be acquired or captured using the one or more cameras. The image may be stored in the memory of the electronic device (101) (e.g., memory (215) of FIG. 2) or downloaded from an external electronic device, such as a server.

[0120] Referring to FIG. 6A, an image (630) including a portion (632) related to a human face is illustrated. In response to an input related to a visual object (131) received while displaying an editing screen on the display (110), the electronic device (101) may display another screen, different from the editing screen, to receive another input for selecting an image to be included in the preview area (130) of the editing screen. The other screen may be provided by a software application configured to search or browse images and / or videos stored in the electronic device (101), such as a gallery application. Through the other screen, the electronic device (101) may receive an input for adding the image (630) to the lock screen. Upon receiving the input, the electronic device (101) may add the image (630) to the preview area (130).

[0121] In response to an input to add or change an image (630) to the lock screen, the electronic device (101) can search for a portion (632) related to a subject within the image (630). For example, the electronic device (101) can use metadata of the image (630) to determine or identify information representing the portion (632). For example, the electronic device (101) can use the image (630) and / or a neural network capable of receiving feature information about the image (630) to determine or identify information representing the portion (632).

[0122] From the exemplary image (630) of FIG. 6A, the electronic device (101) can identify or calculate at least one category associated with the subject from among designated categories for distinguishing the subject (e.g., categories for distinguishing people, animals, and / or various objects), as well as a portion (632) associated with the subject. The designated categories may be referred to as classes and / or types. The processor can identify or determine, from metadata of the image (630), one or more subjects associated with a portion (632) of the image (630). The portion (632) of the image (630) may be referred to as a foreground area and / or a foreground portion, from the perspective of including the subject. Other portions (e.g., portion (634)) within the image (630) other than the portion (632) may be referred to as a background area and / or a background portion.

[0123] Referring to FIGS. 6A and 6B , the preview area (130) may be divided into sub-areas (610, 620). The shape and / or size of the sub-areas (610, 620) indicated by dashed lines are exemplary and do not limit the disclosure. The sub-areas (610, 620) are illustrated for convenience of explanation, and the electronic device (101) may not display any visual object guiding the sub-areas (610, 620) on the display (110). The disclosure is not limited thereto, and in order to adjust the sub-areas (610, 620), the electronic device (101) may display a visual object (e.g., a frame) having a line shape representing a boundary line between the sub-areas (610, 620) on the display (110). The visual object may be moved by a user input such as a drag gesture. The location of the visual object within the preview area (130) that can be moved by the user input may represent the locations, shapes, and / or sizes of each of the sub-areas (610, 620).

[0124] The ratio of the areas occupied by the above sub-areas (610, 620) in the preview area (130) may be the same as the ratio of the sub-areas (610, 620) to be formed on the lock screen. In the exemplary state of FIG. 6A, the sub-area (610) including the lower side of the preview area (130) may be formed to emphasize a portion (632) that is a foreground object within the image (630). In the exemplary state of FIG. 6A, the sub-area (620) including the upper side of the preview area (130) may be formed to include visual objects (141, 142, 143) corresponding to widgets of the lock screen.

[0125] Referring to FIG. 6A, an electronic device (101) that detects a portion (632) related to a subject within a category for classifying a person (or a person's face) using metadata of an image (630) can emphasize the portion (632) within a preview area (130). For example, the electronic device (101) can make the position and / or size of the portion (632) within at least a portion of the image (630) visible through the preview area (130) different from the position and / or size of the portion (632) within the image (630). To emphasize the portion (632) within the preview area (130), the electronic device (101) can segment the portion (632) from the image (630).

[0126] For example, the electronic device (101) may display at least a portion of the image (630) (or a background portion of the image (630)) as the background of the preview area (130), and may display a portion (632) segmented from the image (630) in a sub-area (610) of the preview area (130). In the example, the background portion of the image (630) displayed as the background of the preview area (130) may be an image from which a portion (632) related to the subject has been removed, and the removed portion (632) may include a color (e.g., a representative color of the image (630) and / or the background portion) and / or a texture. For example, the electronic device (101) may synthesize another image from the image (630) from which a portion (632) related to the subject has been removed.

[0127] Referring to FIG. 6A, according to one embodiment, the electronic device (101) may determine the position and / or size of the portion (632) to be placed in the sub-region (610) based on the position and / or size of the portion (632) within the image (630). For example, the electronic device (101) may determine the reference position of the portion (632) within the sub-region (610) using the position of the horizontal coordinate (e.g., x-coordinate) of the center point (p1) of the portion (632) related to the subject. For example, when determining the horizontal coordinate of the reference position of the portion (632) within the sub-region (610) using the ratio between the horizontal coordinate and the horizontal length of the image (630), the electronic device (101) may determine the reference position of the portion (632) within the sub-region (610) using the ratio range of Table 1.

[0128]

[0129] The ratio_x in Table 1 is a ratio expressed as a percentage, and may refer to, for example, a ratio between the horizontal coordinate of the center point (p1) and the horizontal length of the image (630). The reference position in Table 1 may indicate the position of the horizontal coordinate of the center point of the portion (632) to be displayed within the preview area (130). Referring to Table 1 and FIG. 6A, when the ratio between the horizontal coordinate of the center point (p1) of the portion (632) and the horizontal length of the image (630) has a numerical value close to 50%, the electronic device (101) may determine the position of the portion (632) within the sub-area (610) such that the center point of the portion (632) is arranged on the vertical axis x2 within the sub-area (610).

[0130] Referring to FIG. 6A, the vertical axes x1, x2, and x3 of Table 1 are illustrated. The vertical axis x1 may be used to align a portion (632) associated with a subject when the portion (632) is adjacent to the left edge within the image (630). The vertical axis x2 may be used to align a portion (632) when the portion (632) is adjacent to the center of the image (630). The vertical axis x3 may be used to align a portion (632) when the portion (632) is adjacent to the right edge of the image (630).

[0131] In one embodiment, the electronic device (101) can change the size of a portion (632) displayed in a sub-region (610). For example, the electronic device (101) can enlarge or reduce the portion (632) so that the height of the portion (632) displayed in the sub-region (610) has a specified height (e.g., a product of a specified ratio and the height of the sub-region (610). Referring to FIG. 6A, an embodiment in which the electronic device (101) enlarges a portion (632) within the sub-region (610) is illustrated, but the disclosure is not limited thereto.

[0132] Referring to FIG. 6A, the electronic device (101) that detects a subject-related portion (632) and a background portion of the image (630) from an image (630) to be displayed in the preview area (130) can determine or change the hue, saturation, brightness, and / or luminance of the portion (632) and the background portion. For example, the electronic device (101) can determine or calculate a brightness difference between a background portion and a foreground portion (e.g., portion (632)) of the image (630) to be displayed through the lock screen. Using the brightness difference, the electronic device (101) can change at least one of the brightnesses of the background portion and the foreground portion. For example, the electronic device (101) can increase or decrease the brightness of the background portion in order to increase the brightness difference. The disclosure is not limited thereto.

[0133] Referring to FIG. 6A, in an exemplary state where an image (630) is at least partially displayed in the preview area (130), the electronic device (101) can determine properties of visual objects (141, 142, 143, 144, 145, 146) related to widgets included in the lock screen, based on properties of the image (630) displayed in the preview area (130). For example, the electronic device (101) can change properties (e.g., position, size, and / or color) of at least one of the visual objects (141, 142, 143, 144, 145, 146) by using color, hue, saturation, and / or brightness of at least a portion (e.g., a portion related to a subject (632), and a background portion) of the image (630) visible through the preview area (130).

[0134] For example, an electronic device (101) that receives an input for adding or changing an image (630) as a background of a lock screen may change the positions, sizes, and / or colors of at least one of the visual objects (141, 142, 143, 144, 145, 146) by using the color distribution of pixels included in the preview area (130) among at least a portion of the image (630) displayed through the preview area (130) of the editing screen. Based on changing the position of at least one of the visual objects (141, 142, 143, 144, 145, 146), the electronic device (101) may determine the color of at least one visual object having the changed position by using the color distribution of pixels of the image (630) corresponding to the changed position.

[0135] As described above, according to one embodiment, when editing the layout of a lock screen including an image (630) including a splittable foreground portion (e.g., portion (632)), the electronic device (101) may adjust the layout such that the foreground portion is emphasized within the lock screen. For example, the operation of the electronic device (101) to adjust the layout may include an operation of adjusting the position and / or size of the foreground portion within the lock screen, as well as an operation of adjusting properties of one or more widgets displayed together with the foreground portion within the lock screen. For example, the operation of the electronic device (101) to adjust the layout may include an operation of adjusting the color, hue, saturation, and / or brightness of at least a portion (e.g., the foreground portion and the background portion) of the image (630) included in the lock screen.

[0136] Referring to FIG. 6B, an image (650) is illustrated that includes a portion (652) related to an object (e.g., a flower pot). Within the exemplary state of FIG. 6B, which displays an editing screen for editing the layout of a lock screen including the image (650), the electronic device (101) may display the image (650) and visual objects (141, 142, 143, 144, 145, 146) superimposed on the image (650) in the preview area (130). The electronic device (101) may detect or identify the portion (652) related to the object in the image (650) from metadata of the image (650) or by performing an object recognition algorithm on the image (650). The electronic device (101) may also detect or identify information indicating a category, class, and / or type of the object.

[0137] In the state of FIG. 6b where a part (652) related to a subject included in a category for classifying an object is detected, the electronic device (101) can determine the position and / or size of the part (652) within the preview area (130) using the position and / or size of the part (652) within the sub-area (610) formed in the preview area (130) and / or the image (650). Referring to FIG. 6b, vertical axes x4, x5, and x6 for aligning the part (652) related to the subject classified into the category within the preview area (130) are illustrated. The vertical axes x4, x5, and x6 of FIG. 6b may correspond to the vertical axes x1, x2, and x3 of FIG. 6a, respectively. The horizontal coordinate (e.g., x-coordinate) of the part (652) within the preview area (130) may be determined using the ratio range of Table 2.

[0138]

[0139] The ratio_x in Table 2 is a ratio expressed as a percentage, and may refer to, for example, a ratio between the horizontal coordinate of the reference point (p2) of the portion (652) within the image (650) and the horizontal length of the image (650). The reference position in Table 2 may correspond to the position of the horizontal coordinate of the center point of the portion (652) within the preview area (130). Referring to Table 2 and FIG. 6B, when the ratio between the horizontal coordinate of the reference point (p2) and the horizontal length (e.g., width) of the image (650) exceeds 70%, the electronic device (101) may determine the position of the portion (652) within the preview area (130) such that the center point of the portion (652) is placed on the vertical axis x6 of the preview area (130).

[0140] Referring to FIG. 6B, each of the vertical axes x4, x5, and x6 may be formed to align a background portion (e.g., portion (654)) and a different foreground portion (e.g., portion (652)) of the image (650). For example, the vertical axis x4 may be used to position a foreground portion adjacent to the left edge of the image (650). For example, the vertical axis x5 may be used to position a foreground portion adjacent to the center of the image (650). For example, the vertical axis x6 may be used to position a foreground portion adjacent to the right edge of the image (650).

[0141] According to one embodiment, the electronic device (101) can change the size of a portion (652) positioned on one vertical axis (vertical axis x6 in the exemplary state of FIG. 6B) of the sub-region (610). For example, the electronic device (101) can enlarge or reduce the portion (652) within the sub-region (610) so that the portion (652) has a specified height within the sub-region (610).

[0142] Referring to FIG. 6B, the electronic device (101) that has determined the positional relationship between the foreground portion (e.g., portion (652)) and the background portion of the image (650) within the preview area (130) may use the positional relationship to change the properties of at least one of the visual objects (141, 142, 143, 144, 145, 146) within the preview area (130). The properties related to the widget to be displayed through the lock screen and changed by the positional relationship between the foreground portion and the background portion of the image (650) within the preview area (130) may include the position, size, color, hue, saturation, and / or brightness of the widget within the lock screen. Referring to FIG. 6B, an electronic device (101) that places a portion (652) at a position adjacent to the right edge of a preview area (130) (e.g., a position on the vertical axis x6) can move visual objects (141, 142, 143) according to the position of the portion (652). For example, the electronic device (101) can move the positions of visual objects (141, 142, 143) to positions adjacent to the left edge of the preview area (130).

[0143] Although an exemplary state in which the electronic device (101) places an image (e.g., images (630, 650)) to be placed on the preview area (130) and / or the lock screen in response to an input for selecting the image to be placed on the preview area (130) and / or the lock screen through the visual object (131) has been described, the disclosure is not limited thereto. For example, the electronic device (101) may, in response to an input for changing the position and / or size of a background image of the lock screen, received through the preview area (130), change not only the position and / or size of the background image, but also change the properties of one or more widgets within the lock screen. By linking the properties of the background image and / or one or more widgets included in the lock screen, the electronic device (101) may systematically change the layout of the lock screen.

[0144] Hereinafter, with reference to FIGS. 7A, 7B, and 7C (which may be referred to as FIGS. 7A to 7C), exemplary operations of an electronic device (101) for systematically changing the layout of the lock screen in response to an input for changing a property of a background image of the lock screen are described in more detail.

[0145] FIGS. 7A, 7B, and 7C are flowcharts illustrating exemplary operations of an electronic device according to various embodiments. The electronic device (101) of FIGS. 1 and 2, and / or the processor (210) of FIG. 2, may perform the operations of the electronic device described with reference to FIGS. 7A to 7C. At least one of the operations of FIGS. 7A to 7C may be related to the operations of the electronic device (101) described with reference to FIGS. 6A and / or 6B. The order in which the operations of FIGS. 7A to 7C are performed is not limited to the orders illustrated in FIGS. 7A to 7C. For example, the operations of FIGS. 7A to 7C may be performed in a different order than the order illustrated in FIGS. 7A to 7C, or may be performed at least partially substantially simultaneously. The operations of FIGS. 7A to 7C may be performed by a processor that controls a display (e.g., the display (110) of FIG. 2) to display an editing screen provided from the lock screen application (230) of FIG. 2.

[0146] Referring to FIG. 7A, in operation (710), according to one embodiment, a processor of an electronic device may recognize an image to be included in a lock screen (e.g., image (630) of FIG. 6A and / or image (650) of FIG. 6B). The operation of recognizing the image may include an operation of detecting a subject associated with at least a portion of the image using an object recognition algorithm. The operation of recognizing the image may include an operation of obtaining or confirming information associated with the subject from metadata of the image (e.g., metadata stored in an exchangeable image file format (EXIF) for an image having a JPEG format). The information associated with the subject stored in the metadata may indicate a position, shape, and / or size of a portion associated with the subject within the image (e.g., portion (632) of FIG. 6A and / or portion (652) of FIG. 6B).

[0147] Referring to FIG. 7A, in operation (720), according to one embodiment, the processor of the electronic device may determine whether a portion of the image related to a subject has been detected based on the recognition of operation (710). If the image was generated by capturing the sky, the image may not be related to all subjects recognizable by the object recognition algorithm. If a portion of the image related to a subject has not been detected (720—No), the processor may bypass performing operations (730, 740, 750). For example, the processor may perform operation (760) of FIG. 7A. If a portion of the image related to a subject has been detected (720—Yes), the processor may perform operation (730).

[0148] Referring to FIG. 7A, in operation (730), a processor of an electronic device according to an embodiment may determine whether a portion of an image can be separated from other portions. The portion of operation (730) may be a foreground portion of an image related to a subject. If the shape of the foreground portion has a shape of a circle, triangle, square, and / or other polygon, the processor may determine that the portion of operation (730) can be separated from other portions. If the shape of the foreground portion is relatively complex (e.g., in the shape of a tree branch) or a boundary line between the foreground portion and the background portion cannot be detected, the processor may determine that the portion of operation (730) cannot be separated from other portions.

[0149] Referring to FIG. 7A, if a portion of the image can be separated from other portions (730 - Yes), the processor can perform operation (740). If a portion of the image cannot be separated from other portions (730 - No), the processor can perform operation (760).

[0150] Referring to FIG. 7A, within operation (740), a processor of an electronic device according to an embodiment may determine a location and / or size of a portion of an operation (720) to be displayed on a lock screen. The processor may perform operation (740) using a category (or class, and / or type) of a subject associated with the portion, and / or a location and / or size of the portion within an image, as described above with reference to FIGS. 6A and 6B . The location of the portion of the operation (720) to be displayed on the lock screen may be related to a location of the portion within the image, a location of at least one reference axis (e.g., horizontal axes x1, x2, x3, x4, x5, x6 of FIGS. 6A and 6B ) on the lock screen.

[0151] In one embodiment, the size of a portion of the action (720) to be displayed on the lock screen may be related to the size of the portion within the image. For example, the size of the portion of the action (720) to be displayed on the lock screen may be related to the size of the portion (e.g., the size of the portion occupying the sub-region (610) of FIG. 6A and / or FIG. 6B) positioned in a preview area of ​​an edit screen corresponding to the lock screen (e.g., the preview area (130) of FIG. 6A and / or FIG. 6B). For example, when displaying a foreground portion with a size less than 50% of the size of a sub-region of the preview area (e.g., the sub-region (610) of FIG. 6A and / or FIG. 6B), the processor may enlarge the foreground portion or move the position of the foreground portion using the at least one reference axis.

[0152] Referring to FIG. 7A, within operation (750), a processor of an electronic device according to an embodiment may at least partially change a brightness level of at least a portion of an image to be displayed on the lock screen using a brightness level of a portion of operation (720) to be displayed on the lock screen. The at least a portion of the image to be displayed on the lock screen may be divided into a foreground portion and a background portion of the image detected by operation (720).

[0153] For example, if the difference in brightness levels between the foreground portion and the background portion is less than a specified difference, the processor may adjust the brightness level of either the foreground portion or the background portion. The specified difference may be related to a category of the foreground portion. For example, if the subject associated with the foreground portion falls into a first category for distinguishing animals and / or humans, the processor may compare the difference in brightness levels to a first specified difference (e.g., 45%). If the difference in brightness levels is less than the first specified difference, the processor may change the brightness level of either the foreground portion or the background portion.

[0154] For example, if the difference between the brightness levels is less than a first specified difference, the processor may change the brightness level of the background portion based on the brightness level of the foreground portion. For example, if the brightness level of the foreground portion is less than 15%, the processor may adjust the brightness level of the background portion to a brightness level that is 45% greater than the brightness level of the foreground portion (e.g., increase). For example, if the brightness level of the foreground portion is 15 or greater, the processor may adjust the brightness level of the background portion to a brightness level that is 45% less than the brightness level of the foreground portion (e.g., decrease). For example, as in the exemplary state of FIG. 6A, a processor that detects a portion (632) associated with a subject corresponding to a human face may compare the difference in brightness levels of the portion (632) and the background portion of the image (630) with the first specified difference, and may change the brightness level of at least one of the portion (632) and / or the background portion of the image (630).

[0155] For example, if a subject associated with a foreground portion is included in a second category for distinguishing objects, the processor may compare the difference in brightness levels of the foreground portion and the background portion with a second specified difference (e.g., 50%). If the difference in brightness levels is less than the second specified difference, the processor may change the brightness level of at least one of the foreground portion or the background portion.

[0156] For example, if the difference between the brightness levels is less than the second specified difference, the processor may determine whether to change the brightness level of the background portion based on the brightness level of the foreground portion. For example, if the brightness level of the foreground portion is less than 15%, the processor may adjust the brightness level of the background portion to a brightness level that is 45% greater than the brightness level of the foreground portion (e.g., increase). For example, if the brightness level of the foreground portion is 15 or greater, the processor may adjust the brightness level of the background portion to a brightness level that is 45% less than the brightness level of the foreground portion (e.g., decrease). For example, as in the exemplary state of FIG. 6B, a processor that detects a portion (652) associated with a subject, such as a flowerpot, may compare the difference in the brightness levels of the portion (652) and the background portion of the image (650) with the second specified difference, and may change the brightness level of at least one of the portion (652) and / or the background portion of the image (650).

[0157] Referring to FIG. 7A , in operation (760), according to one embodiment, a processor of an electronic device may determine a color of at least one visual object to be displayed along with an image on a lock screen. For example, the processor may determine a color of at least one visual object by using a color distribution of at least a portion (e.g., a combination of a foreground portion and a background portion) of an image to be displayed on the lock screen. The at least one visual object of operation (760) may include at least one widget included in the lock screen. As described above with reference to FIG. 6A and / or FIG. 6B , the processor may change other properties of the at least one visual object that are different from the color of operation (760), such as a location and / or a size.

[0158] Referring to FIG. 7A, in operation (770), according to one embodiment, a processor of an electronic device may display an image and at least one visual object superimposed on the image in a preview area of ​​an editing screen. The image in the preview area displayed by operation (770) may include a portion of operation (720). The location and / or size of the portion of operation (720) within the preview area may be determined by operation (740). The brightness levels of the foreground portion (e.g., the portion of operation (720)) and the background portion displayed in the preview area may be determined by operation (750). The color of the at least one visual object displayed in the preview area may be determined by operation (760).

[0159] Below, exemplary operations of each of the operations (740, 750) of FIG. 7a are described in more detail with reference to FIG. 7b and FIG. 7c.

[0160] Referring to FIG. 7B, the operations of the processor related to operation (740) of FIG. 7A are illustrated. For example, the processor may perform at least one of the operations of FIG. 7B while performing operation (740) of FIG. 7A. Referring to FIG. 7B, within operation (741), the processor of the electronic device according to one embodiment may determine whether a subject falls into a first category for classifying an animal and / or a person. Operation (741) of FIG. 7B may be performed upon detection of one or more subjects included in an image to be included in the lock screen. Based on an image including a subject included in the first category (741—Yes), the processor may perform operation (742). If the subject of operation (741) is not included in the first category (741—No), the processor may perform operation (743).

[0161] Referring to FIG. 7B , in operation (742), a processor of an electronic device according to an embodiment may move a portion of an image associated with a subject using a reference line for aligning a subject of a first category, and may enlarge the portion according to a size of a designated area of ​​the lock screen. The reference line of operation (742) may include horizontal axes x1, x2, and x3 of FIG. 6A . The processor may change the position of the portion of the image associated with the subject using the reference line of operation (742). The designated area of ​​operation (742) may correspond to at least a portion of the lock screen that is set to display a foreground portion within the lock screen, such as the sub-area (610) of FIG. 6A and / or FIG. 6B . The processor may enlarge or reduce the portion (e.g., the foreground portion) associated with the subject according to a width and / or height of the designated area of ​​operation (742).

[0162] Referring to FIG. 7B , in operation (743), the processor of the electronic device according to one embodiment may determine whether the subject falls into a second category for classifying objects. If the subject detected from the image falls into the second category (743 - Yes), the processor may perform operation (744). If the subject detected from the image falls into neither the first category nor the second category (743 - No), the processor may perform operation (745).

[0163] Referring to FIG. 7B , in operation (744), the processor of the electronic device according to one embodiment may move a portion of the image associated with the subject using a reference line for aligning the subject of the second category, and may enlarge the portion according to the size of the designated area. The reference line of operation (742) may include the horizontal axes x4, x5, and x6 of FIG. 6B . Operation (744) of FIG. 7B may be performed similarly to operation (742). For example, the processor may display the portion associated with the subject of operation (744) in a designated area of ​​the lock screen that is set to display a foreground portion (e.g., an area of ​​the lock screen corresponding to sub-area 610 of FIG. 6A and / or FIG. 6B ). The processor may enlarge or reduce the portion associated with the subject using the width and / or height of the designated area.

[0164] Referring to FIG. 7B , in operation (745), the processor of the electronic device according to one embodiment may determine not to enlarge or translate the image. For example, if the subject of the image does not fall into any of the first and second categories of operations (741, 743), the processor may perform operation (745) to display the image in the preview area without any image editing (e.g., segmenting the foreground portion, enlarging and / or reducing at least a portion of the image).

[0165] Referring to FIG. 7C, operations of the processor related to operation (750) of FIG. 7A are illustrated. For example, the processor may perform at least one of the operations of FIG. 7C while performing operation (750) of FIG. 7A. Referring to FIG. 7C, within operation (751), the processor of the electronic device according to one embodiment may determine whether a difference in brightness levels between a portion of an image related to a subject and another portion exceeds a specified difference. A portion of operation (751) may correspond to a foreground portion of the image of operation (751). Another portion of operation (751) may correspond to a background portion of the image of operation (751). The specified difference of operation (751) may match one of the specified categories for classifying the subject, among which the category is related to the subject of operation (751).

[0166] For example, if the subject of the action (751) is included in a first category for classifying people and / or animals, the designated difference of the action (751) may be a first designated difference (e.g., 45%) corresponding to the first category. For example, if the subject of the action (751) is included in a second category for classifying objects, the designated difference of the action (751) may be a second designated difference (e.g., 50%) corresponding to the second category. If the difference of the action (751) exceeds the designated difference (751-Yes), the processor may perform action (752). If the difference of the action (751) is less than or equal to the designated difference (751-No), the processor may perform action (753).

[0167] Referring to FIG. 7C, within operation (753), a processor of an electronic device according to an embodiment may determine whether a brightness level of a portion (e.g., a foreground portion) of operation (751) is below a specified threshold. If the brightness level has steps between 0 and 255, the specified threshold of operation (753) may correspond to 15. The 15 is an empirically established value, and the disclosure is not limited thereto. If the brightness level of operation (753) is below the specified threshold (753-Yes), the processor may perform operation (754). If the brightness level of operation (753) is equal to or greater than the specified threshold (753-No), the processor may perform operation (755).

[0168] Referring to FIG. 7c, within operation (754), the processor of the electronic device according to one embodiment may increase the brightness level of another portion. For example, the processor may change the brightness level of the background portion of the image to a level 45 higher than the brightness level of the foreground portion.

[0169] Referring to FIG. 7c, within operation (755), according to one embodiment, the processor of the electronic device may reduce the brightness level of another portion. For example, the processor may change the brightness level of the background portion of the image to a level 45 lower than the brightness level of the foreground portion.

[0170] Referring to FIG. 7C, in operation (752), according to one embodiment, the processor of the electronic device may store information regarding the color and / or brightness of another portion. For example, the processor may store information related to the color distribution of the background portion. The information may include the maximum and / or minimum values ​​of the saturation and / or brightness of pixels of the image included in the background portion. The information may indicate the size and / or position of the background portion that is different from the foreground portion within the image. The information of operation (752) may be used to adjust the properties of one or more widgets to be displayed together with the image within the lock screen. The information of operation (752) may be used to determine the color tone of the one or more widgets. For example, the processor may determine the color of the one or more widgets using the brightness of the background portion indicated by the information.

[0171] FIG. 8 is a flowchart illustrating exemplary operations of an electronic device according to various embodiments. The electronic device (101) of FIGS. 1 to 2 and / or the processor (210) of FIG. 2 may perform the operations of the electronic device described with reference to FIG. 8. At least one of the operations of FIG. 8 may be related to the operations of the electronic device described with reference to FIG. 5 and / or FIGS. 7A to 7C. The order in which the operations of FIG. 8 are performed is not limited to each of the orders illustrated in FIG. 8. For example, the operations of FIG. 8 may be performed in a different order than the order illustrated in FIG. 8. For example, at least two of the operations of FIG. 8 may be performed substantially simultaneously. The operations of FIG. 8 may be performed by a processor that controls a display (e.g., the display (110) of FIG. 2) to display an editing screen provided from the lock screen application (230) of FIG. 2.

[0172] Referring to FIG. 8, in operation (810), according to one embodiment, a processor of an electronic device may display an editing screen for changing the layout of a lock screen. By performing operation (810), the processor may switch to any one of the states (401, 402, 403, 404) of FIGS. 4A to 4C and the states of FIGS. 6A to 6B. The lock screen of operation (810) may include the lock screen (160) of FIG. 1.

[0173] Referring to FIG. 8, in operation (820), according to one embodiment, a processor of an electronic device may determine whether a first input for changing a property of a visual object included in a layout has been received. The first input may include an input for changing a position, size, and / or color of a visual object, as described with reference to FIGS. 4A to 4C . If the first input has been received (820—Yes), the processor may perform operation (830). If the first input has not been received (820—No), the processor displaying the editing screen may continuously (or repeatedly) check whether the first input and / or another input different from the first input has been received.

[0174] Referring to FIG. 8, in operation (830), according to one embodiment, a processor of an electronic device may display a visual object on an editing screen based on an attribute changed by a first input. To display a visual object having an attribute changed by the first input, the processor may perform operation (830).

[0175] Referring to FIG. 8, in operation (840), a processor of an electronic device according to an embodiment may change an image displayed together with a visual object according to a property changed by a first input. The image of operation (840) may be an image to be included in a lock screen (e.g., image (630) of FIG. 6A and / or image (650) of FIG. 6B). The processor may change a property of the image by using a property of the visual object changed by the first input by performing at least one of the operations of FIG. 5. The properties of the image changed by operation (840) may include a position, size, hue, saturation, brightness, and / or layout of the image within the lock screen. The layout of the image may include, for example, a position, size, hue, saturation, and / or brightness of a foreground portion of the image within the lock screen. The layout of the image may include, for example, a position, size, hue, saturation, and / or brightness of a background portion of the image within the lock screen.

[0176] Referring to FIG. 8, within operation (850), a processor of an electronic device according to one embodiment may determine whether a second input for changing an attribute of an image included in a layout has been received. The second input may include an input for changing an image to be included in a lock screen, or for changing the position and / or size of an image within the lock screen.

[0177] Referring to FIG. 8, in operation (860), a processor of an electronic device according to one embodiment may display an image on an editing screen according to an attribute changed by a second input. To display an image having an attribute changed by the second input, the processor may perform operation (860).

[0178] Referring to FIG. 8, in operation (870), a processor of an electronic device according to an embodiment may change a visual object superimposed on an image based on a property changed by a second input. While performing operation (870), the processor may perform at least one of the operations described with reference to FIGS. 7A to 7C. For example, the processor may change the position, size, and / or color of at least one visual object to be displayed together with an image within a lock screen based on the property of the image changed by the second input of operation (860).

[0179] Referring to FIG. 8, a processor that changes the layout of a lock screen according to a first input and / or a second input received through an editing screen may perform an operation (880). In operation (880), the processor of the electronic device according to one embodiment may determine whether a third input for saving the layout displayed through a preview area of ​​the editing screen has been received. The third input may include an input indicating a selection of a visual object (132) of FIG. 1 , FIG. 4A to FIG. 4C , FIG. 6A and / or FIG. 6B . In response to the input indicating a selection of a visual object (132) of FIG. 1 , FIG. 4A to FIG. 4C , FIG. 6A and / or FIG. 6B , the processor may display a pop-up window (or a dialog window, and / or a dialog message) on a display (e.g., the display (110) of FIG. 1 and / or FIG. 2 ) for confirming whether to save the layout of the lock screen visualized by the editing screen. The third input of operation (880) may include an input confirming storage of the layout, received via the pop-up window. If the third input of operation (880) is not received, or before receiving the third input of operation (880) (880-No), the processor may continue to display the edit screen of operation (810). While the edit screen is displayed, the processor may repeatedly change the layout of the lock screen in response to the first input and / or the second input. If the third input of operation (880) is received (880-Yes), the processor may perform operation (890).

[0180] Referring to FIG. 8, in operation (890), the processor of the electronic device according to one embodiment may store a layout to provide a lock screen having a layout at the time of receiving the third input. The layout may be stored as at least a portion of the setting values ​​managed by the lock screen application (230) of FIG. 2. After operation (890), when the state of the electronic device is switched to a low power state and / or a locked state, the processor may display a lock screen having a layout stored in a memory of the electronic device (e.g., memory (215) of FIG. 2) based on operation (890).

[0181] Hereinafter, exemplary operations of an electronic device displaying a lock screen having an edited (or saved) layout based on the operations described with reference to FIGS. 1 to 8 are described in more detail with reference to FIGS. 9A and / or 9B.

[0182] FIGS. 9A and 9B are diagrams illustrating exemplary states (901, 902, 903) of an electronic device (101) displaying a lock screen according to various embodiments. The electronic device (101) of FIGS. 1 and 2, and / or the processor (210) of FIG. 2, may perform the operations of the electronic device (101) described with reference to FIGS. 9A and 9B. The operations of the electronic device (101) described with reference to FIGS. 9A and 9B may be related to the operations of the electronic device (101) described with reference to FIGS. 1 to 8.

[0183] Referring to FIGS. 9A and / or 9B , exemplary states (901, 902, 903) of an electronic device (101) corresponding to any one of states (320, 330) of FIG. 3 are illustrated. State (901) of FIGS. 9A and / or 9B may be included in state (330) of FIG. 3 , which is configured to display a lock screen. Within the exemplary state (901) of FIG. 9A , the electronic device (101) may display a lock screen on the display (110). The lock screen may have a layout established by the operations described with reference to FIGS. 1 to 8 . For example, the lock screen may include an image (916) including a foreground portion (917), and visual objects (911, 912, 913, 914, 915) superimposed on the image (916).

[0184] In one embodiment, the electronic device (101) may display widgets (e.g., visual objects (911, 912)) provided from a software application configured to run in a locked state, overlaid on the image (916). For example, the visual object (911) may be a widget (e.g., a clock widget) generated based on the execution of a software application for counting the current time. For example, the visual object (912) may be a widget generated based on the execution of a software application for notifying an event (e.g., a notification message and / or a push message) that occurred in the electronic device (101).

[0185] In one embodiment, the electronic device (101) may display shortcuts (e.g., visual objects (913, 914, 915)) for launching software applications that are allowed access in the locked state, overlaid on the image (916). For example, visual object (913) may be included on the lock screen as a shortcut for launching a software application for emergency calling. For example, visual object (914) may be included on the lock screen as a shortcut for launching a software application for phone calls. For example, visual object (915) may be included on the lock screen as a shortcut for launching a software application for capturing images and / or videos.

[0186] Because the lock screen displayed within the state (901) of FIG. 9a has a layout based on the operations described with reference to FIGS. 1 to 8, the image (916) and visual objects (911, 912, 913, 914, 915) of the lock screen may have positions, sizes, and / or colors that are related to each other. For example, the color of at least one of the visual objects (911, 912, 913, 914, 915) may be related to the color of at least a portion of the image (916) (e.g., a foreground portion (917) and / or a background portion of the image (916) that is different from the foreground portion (917)). For example, the positions and / or sizes of at least one of the visual objects (911, 912, 913, 914, 915) may be related to the position and / or size of the foreground portion (917) within the lock screen. For example, at least a portion of an image (916) included in a lock screen may be associated with positions and / or sizes of visual objects (911, 912, 913, 914, 915).

[0187] States (902, 903) of FIG. 9A and / or FIG. 9B may be included in states (320) of FIG. 3. States (902, 903) of FIG. 9A and / or FIG. 9B may be states during which the processor of the electronic device (101) enters a low-power state. Within states (902, 903) of FIG. 9A and / or FIG. 9B, a screen displayed on the display (110) may be referred to as an AOD screen. From the perspective of having a layout linked to a lock screen displayed in a lock state prior to entering a low-power state, the AOD screen may be referred to as a second lock screen.

[0188] Within the exemplary state (902) of FIG. 9A, the electronic device (101) may display visual objects (911, 912) having colors related to the representative color of the image (916) displayed on the lock screen on the display (110). For example, the hue, saturation, and / or brightness of the visual objects (911, 912) displayed on the display (110) within the state (902) may correspond to the hue, saturation, and / or brightness of the visual objects (911, 912) displayed on the display (110) within the state (901). The disclosure is not limited thereto, and the hue, saturation, and / or brightness of the visual objects (911, 912) within the state (902) may differ from the hue, saturation, and / or brightness of the visual objects (911, 912) within the state (901) by a specified margin and / or a specified percentage. For example, the electronic device (101) within the state (902) may display a visual object (911) having a hue that is darker by a specified percentage than the hue of the visual object (911) within the state (901). Referring to FIG. 9A, within the state (902), the electronic device (101) may display only the visual objects (911, 912) among the image (916) and the visual objects (911, 912) on the display (110). Within a state (902) of displaying visual objects (911, 912), the remaining portion (920) different from the portion of the display area where the visual objects (911, 912) are displayed may be filled with black. For example, the electronic device (101) may deactivate or turn off pixels corresponding to the remaining portion (920) among the pixels of the display (110).

[0189] Within the state (903) of FIG. 9B, the electronic device (101) may display, on the display (110), an AOD screen including a foreground portion (917) of an image (916) related to a subject, and one or more visual objects (e.g., visual objects (911, 912)). Within the state (903) of displaying the AOD screen including the foreground portion (917) and the visual objects (911, 912), a portion (930) of the AOD screen that is different from the foreground portion (917) and the visual objects (911, 912) may be filled with a designated color. For example, the portion (930) of the image that is different from the foreground portion (917) may be replaced with the designated color or may be overwritten.

[0190] In one embodiment where the display (110) of the electronic device (101) corresponds to an OLED, a portion (930) of the AOD screen may be filled with black to preserve the life of the OLED. For example, the designated color displayed in the portion (930) different from the foreground portion (917) may be black. To express the designated color as black, the electronic device (101) may control the display (110) to deactivate pixels of the display (110) corresponding to the background portion different from the foreground portion (917) within the state (903) of displaying the AOD screen.

[0191] Within the exemplary state (903) of FIG. 9B , the colors of the visual objects (911, 912) included in the AOD screen may correspond to the colors of the visual objects (911, 912) within the state (901) and / or the state (902). Within the state (903) of FIG. 9B , the hue, saturation, and / or brightness of the foreground portion (917) included in the AOD screen may be related to the hue, saturation, and / or brightness of the foreground portion (917) within the state (901). For example, the hue, saturation, and / or brightness of the foreground portion (917) within the state (903) may match the hue, saturation, and / or brightness within the state (901). The disclosure is not limited thereto, and the hue, saturation, and / or lightness of the foreground portion (917) within state (903) may differ by a specified offset, and / or a specified percentage, from the hue, saturation, and / or lightness within state (901).

[0192] As described above, according to one embodiment, the electronic device (101) can display a lock screen that can be personalized by a user within a locked state including a low-power state of the processor. The layout of the lock screen can be changed through an editing screen provided in another state different from the locked state. While displaying the editing screen, the electronic device (101) can change the properties (e.g., the location, size, and / or color) of other elements of the layout in response to an input that changes the properties (e.g., the location, size, and / or color) of a specific element (e.g., a background image and / or a widget) of the layout.

[0193] FIG. 10 illustrates exemplary states (1001, 1002, 1003) of an electronic device (101) displaying an editing screen according to various embodiments. The electronic device (101) of FIGS. 1 to 2 and / or the processor (210) of FIG. 2 may perform the operation of the electronic device (101) described with reference to FIG. 10. The operation of the electronic device (101) described with reference to FIG. 10 may be related to the operation of the electronic device (101) described with reference to FIG. 5, FIGS. 7A to 7C, and / or FIG. 8.

[0194] Referring to FIG. 10, exemplary states (1001, 1002, 1003) of an electronic device (101) displaying an editing screen on a display (110) are illustrated. The electronic device (101) may display the exemplary screens of FIG. 10 while executing the lock screen application (230) of FIG. 2 in an active state (e.g., state (340) of FIG. 3). The exemplary screens of FIG. 10 may be referred to as editing screens. The editing screens may be displayed in response to an input for changing the layout of the lock screen.

[0195] Referring to FIG. 10, in a state (1001) of displaying an editing screen, the electronic device (101) may provide a preview of a lock screen including a background image and / or one or more widget objects through a preview area (130). For example, the preview area (130) may include an image (150) corresponding to a background image. For example, the preview area (130) may include visual objects (141, 143, 144, 145, 146) corresponding to each of the widget objects. For example, the preview area (130) may include visual objects (142) for adding or deleting a widget object to be included in the lock screen. The electronic device (101) may provide an option for adjusting the linkage of the background image and the widget object through the editing screen. Referring to FIG. 10, the electronic device (101) may display a visual object (1011) configured to receive an input related to the option on the preview area (130). The operation of the electronic device (101) related to the visual object (1011) is described with reference to FIGS. 11A, 11B, and 11C (which may be referred to as FIGS. 11A to 11C). Referring to FIG. 10, a visual object (1011) is illustrated that includes exemplary text such as “Unlink wallpaper” and has the form of a button, but the form and / or position of the visual object (1011) is not limited thereto.

[0196] In one embodiment, the electronic device (101) may provide or recommend a plurality of candidate layouts for the lock screen through the preview area (130). The electronic device (101) may provide, as the candidate layouts, a source image provided at least partially through the preview area (130), possible combinations of positional relationships and / or colors of visual objects included in the preview area (130) to represent widget objects to be included in the lock screen (e.g., visual objects (141, 143, 144, 145, 146)). The electronic device (101) may display one of the candidate layouts through the edit screen (or the preview area (130) of the edit screen). While displaying one of the candidate layouts (1001), the electronic device (101) may receive an input for replacing or changing the candidate layout displayed through the edit screen.

[0197] Referring to FIG. 10, an exemplary state (1001) is illustrated in which an image (150) corresponding to a first portion of a source image and visual objects (141, 143, 144, 145, 146) each corresponding to widget objects are displayed within a preview area (130). Within the state (1001), the electronic device (101) may receive a swipe gesture performed on the preview area (130). The swipe gesture may include a drag gesture performed along a horizontal axis of the preview area (130). The swipe gesture may include a drag gesture initiated on an image (150) displayed through the preview area (130). The swipe gesture may be performed by a user to change a candidate layout displayed through an editing screen (or the preview area (130)). In response to the above swipe gesture, the electronic device (101) can change the candidate layout (or layouts) of the lock screen displayed through the preview area (130).

[0198] Within an exemplary state (1001) of FIG. 10, in response to a drag gesture (e.g., a swipe gesture) initiated at a point (p1) within the preview area (130) and performed along a direction (1012) (e.g., parallel to the horizontal axis), the electronic device (101) may switch to a state (1002). Within the state (1002), the electronic device (101) may display a second portion of the source image within the preview area (130), which is different from the first portion of the source image that was displayed within the state (1001). Along with the second portion, the electronic device (101) may display visual objects (141, 143, 144, 145, 146) that respectively correspond to widget objects to be displayed on the lock screen.

[0199] Within state (1002), the electronic device (101) may display a portion (410) associated with a subject (e.g., a teddy bear) detected within the source image, enlarged according to the operations of FIG. 7A and / or FIG. 7B . Referring to state (1002) of FIG. 10 , the electronic device (101) may display another portion (e.g., a background portion) of the source image that is different from the portion (410) according to the color, saturation, and / or brightness adjusted to emphasize the portion (410) within the image (150) including the enlarged portion (410).

[0200] Within state (1002), the electronic device (101) can display visual objects (141, 142, 143, 144, 145, 146) having positions and / or colors adjusted based on the layout of the image (150) overlaid on an image (150) that at least partially corresponds to the source image. For example, the positions and / or colors of the visual objects (141, 142, 143, 144, 145, 146) within the preview area (130) can be changed or determined based on the operations of FIGS. 7A to 7C and / or 8. The colors of the visual objects (141, 142, 143, 144, 145, 146) displayed by the electronic device (101) within the state (1002) may be different from the colors of the visual objects (141, 142, 143, 144, 145, 146) displayed by the electronic device (101) within the state (1001).

[0201] In one embodiment of receiving an input for changing a candidate layout displayed through a preview area (130) via a swipe gesture, the electronic device (101) may change a candidate layout to be provided through the preview area (130) from among a plurality of candidate layouts, depending on the direction of the swipe gesture. For example, in response to a swipe gesture (or drag gesture) performed in a state (1002) starting from a point (p2) within the preview area (130) and along a direction (1022) (e.g., a direction parallel to the horizontal axis and directed to the left), the electronic device (101) may switch to or return to the state (1001). For example, within state (1002), in response to a swipe gesture performed along a direction (1023) (e.g., parallel to the horizontal axis and pointing to the right), starting at point (p3) within the preview area (130), the electronic device (101) may switch to state (1003). Exemplary operations of the electronic device (101) for swipe gestures along directions (1022, 1023) that are parallel to the horizontal axis and opposite to each other are described, but the disclosure is not limited thereto. For example, the electronic device (101) may perform an operation to change and / or replace a candidate layout, as described with reference to FIG. 10, in response to a swipe gesture that is parallel to the vertical axis.

[0202] Referring to FIG. 10, a state (1003) is illustrated that provides a candidate layout different from the candidate layouts displayed in each of the states (1001, 1002). Within the state (1003), the electronic device (101) may display, within the preview area (130), a third portion of the source image that is cropped differently from the portions of the source image displayed within the states (1001, 1002). For example, through the preview area (130), the electronic device (101) may display an image (150) that includes a portion (410) located to the left of the preview area (130) (e.g., at a position corresponding to the vertical axis x1 of FIG. 6A). The electronic device (101) can change or determine the color, saturation, and / or brightness of a background portion different from the portion (410) within the image (150) based on the color, saturation, and / or brightness of the portion (410).

[0203] Within the preview area (130), the electronic device (101) may display visual objects (141, 143, 144, 145, 146) each corresponding to a widget object to be displayed on the lock screen, overlapping the image (150) corresponding to the third portion. Within the preview area (130), the electronic device (100) may display a visual object (142) for adding a widget object to the lock screen. The positions, sizes, and / or colors of the visual objects (141, 142, 143, 144, 145, 146) displayed by the electronic device (101) within the state (1003) may be different from the positions, sizes, and / or colors of the visual objects (141, 142, 143, 144, 145, 146) displayed by the electronic device (101) within a state other than the state (1003). For example, the electronic device (101) may display the visual objects (141, 142, 143, 144, 145, 146) located on the right side of the preview area (130) as an overlay on an image (150) that includes a portion (410) located on the left side of the preview area (130). Within state (1003) of FIG. 10, similar to state (403) of FIG. 4b, the electronic device (101) can display visual objects (141, 142, 143, 144, 145, 146) aligned along the right edge of the preview area (130).

[0204] Referring to FIG. 10, within a state (1003), the electronic device (101) may receive an input for changing a candidate layout displayed through a preview area (130). For example, in response to a swipe gesture initiated at a point (p4) within the preview area (130) and performed in a direction (1034) toward the left and parallel to the horizontal axis, the electronic device (101) may switch from the state (1003) to the state (1002), or may return. For example, in response to a swipe gesture initiated at a point (p5) within the preview area (130) and performed in a direction (1035) toward the right and parallel to the horizontal axis, the electronic device (101) may switch to a state for providing another candidate layout in addition to the candidate layout displayed within the state (1003). Referring to FIG. 10, an embodiment of an electronic device (101) switching from a state (1003) to a state (1001) in response to a swipe gesture performed along a direction (1035) is illustrated, although the disclosure is not limited thereto. For example, to provide candidate layouts exceeding three candidate layouts each corresponding to states (1001, 1002, 1003), the electronic device (101) may switch to another state different from states (1001, 1002, 1003) in response to a swipe gesture performed along a direction (1035).

[0205] Referring to FIG. 10, while providing a plurality of candidate layouts through an editing screen, the electronic device (101) may receive an input for determining a candidate layout provided through the editing screen as a layout of the lock screen. For example, the input may include an input indicating selection of a visual object (132) (e.g., a touch input on the visual object (132). In response to the input, the electronic device (101) may determine a candidate layout displayed through a preview area (130) as a layout of the lock screen. For example, when receiving an input indicating selection of a visual object (132) within a state (1002), the electronic device (101) may store a combination of an image (150) and visual objects (141, 143, 144, 145, 146) displayed through the preview area (130) within the state (1002) as a layout of the lock screen. After receiving the above input, when switching to a locked state, the electronic device (101) can display a lock screen based on the stored layout on the display (110).

[0206] Hereinafter, exemplary operations of the electronic device (101) related to the visual object (1011) of FIG. 10 are described in more detail with reference to FIGS. 11A to 11C.

[0207] FIGS. 11A, 11B, and 11C illustrate exemplary states of an electronic device displaying an editing screen according to various embodiments. The electronic device (101) of FIGS. 1 to 2 and / or the processor (210) of FIG. 2 may perform the operations of the electronic device (101) described with reference to FIGS. 11A to 11C. The operations of the electronic device (101) described with reference to FIGS. 11A to 11C may be related to the operations of the electronic device (101) described with reference to FIGS. 5, 7A to 7C, and / or 8.

[0208] Referring to FIGS. 11A to 11C , exemplary states (1001, 1002, 1103, 1104, 1105, 1106, 1107) of an electronic device (101) displaying an editing screen are illustrated. While providing a preview of a lock screen through the editing screen, the electronic device (101) may receive an input for adjusting the position and / or size of any one of the background image and / or widget objects included in the lock screen. For example, in response to the input related to the widget object, the electronic device (101) may change the position and / or size of the background image. For example, in response to the input related to the background image, the electronic device (101) may change the position and / or size of the widget object. Whether to control all of the background image and widget objects in response to a single input may be changed based on the input related to the visual object (1011).

[0209] Referring to FIG. 11A, in response to a single input received within state (1001) (e.g., a swipe gesture starting from point (p1) and performed along direction (1012), the electronic device (101) can change all of the images (150) corresponding to the background image of the lock screen and all of the visual objects (e.g., visual objects (141, 143, 144, 145, 146)) corresponding to widget objects of the lock screen. For example, as in state (1002), the electronic device (101) can change the colors of the visual objects (141, 143, 144, 145, 146) and change the image (150). Within state (1002), the electronic device (101) may, in response to an input related to the visual object (1011), stop changing the widget object and background image in conjunction with each other. Within the exemplary state (1002) of FIG. 11A, the electronic device (101) may, in response to an input related to the visual object (1011), switch to state (1103).

[0210] Within the state (1103) of FIG. 11A, the electronic device (101) may display a visual object (1131) for linking and changing a widget object and a background image. For example, the electronic device (101) switching from the state (1002) to the state (1103) may stop displaying the visual object (1011) and display the visual object (1131) at the location where the visual object (1011) was displayed. Referring to FIGS. 11A to 11C, a visual object (1131) is illustrated that includes exemplary text such as “Link background” and has the form of a button, but the form and / or location of the visual object (1131) is not limited thereto. In response to an input indicating a selection of a visual object (1131), the electronic device (101) can switch from a state (1103) to a state (1002), and in response to an input to move one of the widget objects or the background image, can change the position and / or size of the other one of the widget objects or the background image.

[0211] Within a switched state (1103) based on an input related to a visual object (1011), the electronic device (101) may, in response to an input related to a widget object and / or a background image, move only the object (e.g., the widget object and / or the background image) related to the input, and may refrain from changing the position and / or size of other objects. Referring to FIG. 11B , within the state (1103), the electronic device (101) may receive an input to move a visual object (141) corresponding to a specific widget object (e.g., a clock widget) along a path (1111). The input may include a drag gesture performed along the path (1111). In response to the input, the electronic device (101) may switch from the state (1103) to the state (1104). Unlike the operation of changing the image (150) within the preview area (130) in response to an input for moving the visual object (141) along the path (431) described with reference to FIG. 4B, the electronic device (101) can move the visual object (141) (or other visual objects (142, 143) associated with the visual object (141)) and maintain the image (150) within the preview area (130). For example, the electronic device (101) can maintain or display an image (150) corresponding to a specific portion of the source image while switching from state (1103) to state (1104) based on the input.

[0212] Referring to FIG. 11B, within a state (1104) after receiving an input to move a visual object (141) along a path (1111), the electronic device (101) may change an image (150) in response to an input related to the visual object (1131). In response to the input related to the visual object (1131) received within the state (1104), the electronic device (101) may switch to a state (1105). When switching from the state (1104) to the state (1105), the electronic device (101) may stop or refrain from displaying the visual object (1131). When switching from the state (1104) to the state (1105), the electronic device (101) may display the visual object (1011). A visual object (1011) may be displayed based on the location where the visual object (1131) was displayed and / or the size of the visual object (1131).

[0213] While switching from state (1104) to state (1105) based on the above input, the electronic device (101) can perform cropping on the source image again by using the positional relationship between the visual objects (141, 142, 143, 144, 145, 146) and the subject-related portion (410) within the preview area (130). Referring to FIG. 11B, within the state (1105) displaying the positions of the visual objects (141, 142, 143) aligned to the right edge within the preview area (130), the electronic device (101) can display an image (150) obtained by cropping (or editing) the source image so that the subject-related portion (140) is aligned to the left edge within the preview area (130). For example, in response to an input related to a visual object (1131), the electronic device (101) may switch to a state (1105) in which both the visual object (1131) and the image (150) are changed, similar to switching from state (401) to state (403) in FIG. 4B.

[0214] Referring to FIG. 11C, within state (1103), the electronic device (101) may receive an input for changing the size of a visual object (141). For example, the electronic device (101) may identify or detect a gesture (e.g., a hand gesture such as a pinch-to-zoom gesture) indicated by external objects being simultaneously dragged along paths (1112, 1113). In response to the input, the electronic device (101) may enlarge the visual object (141) within the preview area (130), as in state (1106). Referring to state (1106) of FIG. 11c, unlike the operation of adjusting the image (150) in response to an input indicating enlargement of a visual object (141) described with reference to FIG. 4c, the electronic device (101) may only enlarge the size of the visual object (141) and refrain from adjusting the image (150).

[0215] Referring to FIG. 11C, the electronic device (101) may change the layout of the lock screen displayed through the preview area (130) or resume recommending in response to an input related to the visual object (1131). For example, within a state (1106), the electronic device (101) that receives an input related to the visual object (1131) may switch to a state (1107). When switching from the state (1106) to the state (1107), the electronic device (101) may change the position and / or size of the subject-related portion (410) within the preview area (130) by using the position and / or size of the enlarged visual object (141) within the preview area (130). An electronic device (101) that changes the position and / or size of a subject-related portion (410) can change the color, saturation, and / or brightness of a background portion different from the portion (410) within the preview area (130) according to the position and / or size of the portion (410) within the preview area (130).

[0216] Referring to FIG. 11c, when switching from state (1106) to state (1107), the electronic device (101) may stop displaying the visual object (1131) and display the visual object (1011) again. After switching to state (1107) that displays an editing screen including the visual object (1011), the electronic device (101) may change the position and / or size of the other one of the widget object or the background image in response to an input for changing the position and / or size of one of the widget object or the background image.

[0217] As described above, according to one embodiment, the electronic device (101) may determine, or change, based on an input regarding one of the background image and the widget object using the visual object (1011). For example, using the visual object (1011), the electronic device (101) may determine, or change, based on the input, whether to recommend a layout of the lock screen. For example, within the state (1002) of FIG. 11A, the electronic device (101) may receive, through the visual object (1011), an input to stop the function of changing the widget object and the background image in conjunction with each other, and / or the function of recommending a layout of the lock screen in response to a user input. For example, within the state (1103) of FIGS. 11A to 11C, the electronic device (101) may receive an input to activate a function for changing a widget object and a background image in conjunction with each other, and / or a function for recommending a layout of a lock screen in response to a user input, through a visual object (1131).

[0218] FIG. 12 is a block diagram of an exemplary electronic device (1201) within a network environment (1200), according to various embodiments. Referring to FIG. 12 , in the network environment (1200), the electronic device (1201) may communicate with the electronic device (1202) via a first network (1298) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1204) or the server (1208) via a second network (1299) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1201) may communicate with the electronic device (1204) via the server (1208). According to one embodiment, the electronic device (1201) may include a processor (1220), a memory (1230), an input module (1250), an audio output module (1255), a display module (1260), an audio module (1270), a sensor module (1276), an interface (1277), a connection terminal (1278), a haptic module (1279), a camera module (1280), a power management module (1288), a battery (1289), a communication module (1290), a subscriber identification module (1296), or an antenna module (1297). In various embodiments, the electronic device (1201) may omit at least one of these components (e.g., the connection terminal (1278)), or may have one or more other components added. In various embodiments, some of these components (e.g., sensor module (1276), camera module (1280), or antenna module (1297)) may be integrated into one component (e.g., display module (1260)).

[0219] The processor (1220) may include various processing circuits and / or multiple processors. For example, as used herein, including in the claims, the term "processor" may include various processing circuits, including at least one processor, one or more of which may be configured to perform the various functions described herein, individually and / or collectively, in a distributed manner. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform several functions, these expressions also cover, for example, but not limited to, a situation where a processor performs some of the described functions and other processor(s) perform the remainder of the described functions, and a situation where a single processor performs all of the described functions. Additionally, the at least one processor may include a combination of processors that perform the various functions described / described, for example, in a distributed manner. The at least one processor may execute program instructions to achieve or perform the various functions. The processor (1220) may control at least one other component (e.g., hardware or software component) of the electronic device (1201) connected to the processor (1220) by executing, for example, software (e.g., program (1240)), and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1220) may store commands or data received from other components (e.g., sensor module (1276) or communication module (1290)) in volatile memory (1232), process the commands or data stored in volatile memory (1232), and store result data in non-volatile memory (1234).According to one embodiment, the processor (1220) may include a main processor (1221) (e.g., a central processing unit or an application processor) or an auxiliary processor (1223) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1221). For example, when the electronic device (1201) includes the main processor (1221) and the auxiliary processor (1223), the auxiliary processor (1223) may be configured to use less power than the main processor (1221) or to be specialized for a given function. The auxiliary processor (1223) may be implemented separately from the main processor (1221) or as a part thereof.

[0220] The auxiliary processor (1223) may control at least a portion of functions or states associated with at least one component (e.g., a display module (1260), a sensor module (1276), or a communication module (1290)) of the electronic device (1201), for example, on behalf of the main processor (1221) while the main processor (1221) is in an inactive (e.g., sleep) state, or together with the main processor (1221) while the main processor (1221) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1223) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1280) or a communication module (1290)). In one embodiment, the auxiliary processor (1223) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1201) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1208)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0221] The memory (1230) can store various data used by at least one component (e.g., the processor (1220) or the sensor module (1276)) of the electronic device (1201). The data can include, for example, software (e.g., the program (1240)) and input data or output data for commands related thereto. The memory (1230) can include a volatile memory (1232) or a non-volatile memory (1234).

[0222] The program (1240) may be stored as software in memory (1230) and may include, for example, an operating system (1242), middleware (1244), or an application (1246).

[0223] The input module (1250) can receive commands or data to be used in a component of the electronic device (1201) (e.g., a processor (1220)) from an external source (e.g., a user) of the electronic device (1201). The input module (1250) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0224] The audio output module (1255) can output audio signals to the outside of the electronic device (1201). The audio output module (1255) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0225] The display module (1260) can visually provide information to an external party (e.g., a user) of the electronic device (1201). The display module (1260) may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling the device. In one embodiment, the display module (1260) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0226] The audio module (1270) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (1270) can acquire sound through the input module (1250), output sound through the sound output module (1255), or an external electronic device (e.g., electronic device (1202)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1201).

[0227] The sensor module (1276) can detect the operating status (e.g., power or temperature) of the electronic device (1201) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1276) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0228] The interface (1277) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1201) with an external electronic device (e.g., the electronic device (1202)). In one embodiment, the interface (1277) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0229] The connection terminal (1278) may include a connector through which the electronic device (1201) may be physically connected to an external electronic device (e.g., the electronic device (1202)). In one embodiment, the connection terminal (1278) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0230] The haptic module (1279) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1279) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0231] The camera module (1280) can capture still images and videos. According to one embodiment, the camera module (1280) may include one or more lenses, image sensors, image signal processors, or flashes.

[0232] The power management module (1288) can manage the power supplied to the electronic device (1201). According to one embodiment, the power management module (1288) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0233] A battery (1289) may power at least one component of the electronic device (1201). In one embodiment, the battery (1289) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0234] The communication module (1290) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1201) and an external electronic device (e.g., electronic device (1202), electronic device (1204), or server (1208)), and the performance of communication through the established communication channel. The communication module (1290) may operate independently from the processor (1220) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1290) may include a wireless communication module (1292) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1294) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1204) via a first network (1298) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1299) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1292) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1296) to verify or authenticate the electronic device (1201) within a communication network such as the first network (1298) or the second network (1299).

[0235] The wireless communication module (1292) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1292) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1292) may support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1292) may support various requirements specified in the electronic device (1201), an external electronic device (e.g., the electronic device (1204)), or a network system (e.g., the second network (1299)). According to one embodiment, the wireless communication module (1292) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0236] The antenna module (1297) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1297) may include an antenna including a radiator including a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1297) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1298) or the second network (1299), may be selected from the plurality of antennas by, for example, the communication module (1290). A signal or power may be transmitted or received between the communication module (1290) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1297).

[0237] According to various embodiments, the antenna module (1297) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0238] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0239] According to one embodiment, commands or data may be transmitted or received between the electronic device (1201) and an external electronic device (1204) via a server (1208) connected to a second network (1299). Each of the external electronic devices (1202, or 1204) may be the same or a different type of device as the electronic device (1201). According to one embodiment, all or part of the operations executed in the electronic device (1201) may be executed in one or more of the external electronic devices (1202, 1204, or 1208). For example, when the electronic device (1201) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1201) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1201). The electronic device (1201) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1201) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (1204) may include an Internet of Things (IoT) device. The server (1208) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1204) or server (1208) may be included within the second network (1299). The electronic device (1201) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0240] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, home appliances, or the like. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0241] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0242] The term "module" used in various embodiments of this document may include a unit implemented in hardware, and may be used interchangeably with terms such as logic, block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0243] Various embodiments of the present document may be implemented as software (e.g., a program (1040)) including one or more instructions stored in a storage medium (e.g., an internal memory (1036) or an external memory (1038)) readable by a machine (e.g., an electronic device (1001)). For example, a processor (e.g., a processor (1020)) of the machine (e.g., an electronic device (1001)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, a 'non-transitory' storage medium is a tangible device that does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0244] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0245] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added. The electronic device (1201) of FIG. 12 may be an example of the electronic device (101) described with reference to FIGS. 1 to 8, FIGS. 9a to 9b, FIG. 10, and FIGS. 11a to 11c.

[0246] In one embodiment, a method may be required to provide an editing screen for changing the layout of a lock screen. In one embodiment, a method may be required to adaptively change a positional relationship between an image included in the layout and at least one visual object while editing the layout of the lock screen using the editing screen. According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (1201) of FIG. 12) may include a display (e.g., the display (110) of FIG. 1), at least one processor including a processing circuit (e.g., the processor (210) of FIG. 2), and a memory including one or more media for storing instructions (e.g., the memory (215) of FIG. 2). At least one processor may be individually or collectively configured to execute instructions, and cause the electronic device to, based on a first input for changing the layout of a lock screen (e.g., the lock screen (160) of FIG. 1), display on the display an edit screen related to the layout of the lock screen, the edit screen including an image (e.g., the image (150) of FIG. 1) and a visual object (e.g., the visual objects (141, 142, 143, 144, 145, 146) of FIG. 1) superimposed on the image. At least one processor may be individually or collectively configured to execute instructions, and cause the electronic device to, based on a second input received through the edit screen for adjusting a position or a size of the visual object, display the visual object within the edit screen using a position or a size indicated by the second input.At least one processor may be configured to individually or collectively execute instructions, and may be configured to cause the electronic device to change a position or size of the image within the editing screen based on the position or size associated with the position or size of the visual object adjusted by the second input. In one embodiment, the electronic device may provide an editing screen for changing the layout of the lock screen. In one embodiment, the electronic device may adaptively change a positional relationship between an image included in the layout and at least one visual object while editing the layout of the lock screen using the editing screen.

[0247] For example, at least one processor may be individually or collectively configured to cause the electronic device to display the image within the editing screen based on a third input for adjusting the position or size of the image received through the editing screen using a position or size indicated by the third input. The instructions, when individually or collectively executed by the at least one processor, may be configured to cause the electronic device to change a position or size of the visual object within the editing screen based on a position or size associated with the position or size of the image adjusted by the third input.

[0248] For example, at least one processor may be configured, individually or collectively, to cause the electronic device to display the lock screen having the stored layout on the display based on a state of the at least one processor switching to a specific state for displaying the lock screen after receiving a fourth input for storing the layout adjusted by the second input or the third input through the editing screen.

[0249] For example, at least one processor may be individually or collectively configured to cause the electronic device to determine a location at which the visual object is to be displayed, using a color distribution of pixels included in a preview area of ​​the editing screen among pixels of the image. At least one processor may be individually or collectively configured to cause the electronic device to determine a color of the visual object, using a color distribution of pixels of the image corresponding to the determined location.

[0250] For example, the lock screen may be a first lock screen. At least one processor may be configured, individually or collectively, to cause the electronic device to control the display to display a second lock screen, based on the at least one processor entering a low-power state, a portion of the image associated with the subject and including the visual object. Within the second lock screen, other portions of the image, different from the subject, may be filled with a specific color.

[0251] For example, at least one processor may be individually or collectively configured to cause the electronic device to control the display to, when displaying the second lock screen, deactivate one or more pixels corresponding to the other portion of the image to represent the particular color, wherein the particular color is black.

[0252] For example, at least one processor may be individually or collectively configured to cause the electronic device, in response to the second input, to move a position of a portion of the image relative to the subject within the preview area within the editing screen based on a reference position.

[0253] For example, at least one processor may be individually or collectively configured to cause the electronic device, in response to the second input, to adjust a height of a portion of the image associated with the subject within the preview area of ​​the edit screen of the lock screen to a particular height.

[0254] In one embodiment, a method of an electronic device including a display may be provided. The method may include, based on a first input for changing the layout of a lock screen, displaying an editing screen related to the layout of the lock screen, the editing screen including an image and a visual object superimposed on the image, on the display. The method may include, based on a second input for adjusting a position or size of the visual object received through the editing screen, displaying the visual object within the editing screen using the position or size indicated by the second input. The method may include, based on the position or size of the visual object adjusted by the second input, changing the position or size of the image within the editing screen.

[0255] For example, the method may include an operation of displaying the image within the editing screen using a position or size indicated by the third input for adjusting the position or size of the image received through the editing screen. The method may include an operation of changing the position or size of the visual object within the editing screen based on the position or size linked to the position or size of the image adjusted by the third input.

[0256] For example, the method may include an operation of displaying the lock screen having the stored layout on the display based on a state of at least one processor of the electronic device switched to a specific state for displaying the lock screen, based on receiving a fourth input for storing the layout adjusted by the second input or the third input through the editing screen.

[0257] For example, the operation of changing the position or the size of the visual object may include an operation of determining a position at which the visual object is to be displayed by using a color distribution of pixels included in a preview area of ​​the editing screen among pixels of the image. The method may include an operation of determining a color of the visual object by using a color distribution of pixels of the image corresponding to the determined position.

[0258] For example, the lock screen may be a first lock screen. The method may include controlling the display, based on at least one processor of the electronic device entering a low-power state, to display a second lock screen including a portion of the image related to the subject and the visual object. Within the second lock screen, another portion of the image different from the subject may be filled with a specific color.

[0259] For example, the act of controlling the display to display the second lock screen may include the act of controlling the display to deactivate one or more pixels corresponding to the other portion of the image based on displaying the second lock screen to express a specific color, wherein the specific color is black.

[0260] For example, the action of changing the position or the size of the image may include an action of moving, in response to the second input, the position of a portion of the image related to the subject within a preview area within the editing screen based on a reference position.

[0261] For example, the action of changing the position or the size of the image may include, in response to the second input, an action of adjusting the height of a portion of the image related to the subject to a specific height within a preview area within the edit screen of the lock screen.

[0262] In one embodiment, as described above, a non-transitory computer-readable storage medium storing instructions may be provided. The instructions, when individually and / or collectively executed by at least one processor including a processing circuit of an electronic device including a display, may cause the electronic device to, based on a first input for changing the layout of the lock screen, display on the display an editing screen related to the layout of the lock screen, the editing screen including an image and a visual object superimposed on the image. The instructions, when executed by the at least one processor, may cause the electronic device to, based on a second input received through the editing screen for adjusting a position or size of the visual object, display the visual object within the editing screen using a position or size indicated by the second input. The instructions, when executed by at least one processor, may cause the electronic device to change the position or size of the image within the editing screen according to the position or size linked to the position or size of the visual object adjusted by the second input.

[0263] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the electronic device to display the image within the editing screen based on a third input for adjusting the position or size of the image received through the editing screen, using a position or size indicated by the third input. The instructions, when executed by at least one processor, may cause the electronic device to change a position or size of the visual object within the editing screen based on a position or size associated with the position or size of the image adjusted by the third input.

[0264] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the electronic device to display the lock screen having the stored layout on the display based on at least one processor switching to a specific state for displaying the lock screen based on receiving a fourth input through the editing screen for storing the layout adjusted by the second input or the third input.

[0265] For example, the instructions, when individually and / or collectively executed by at least one processor, may cause the electronic device to determine a location at which the visual object is to be displayed, using a color distribution of pixels included in a preview area of ​​the editing screen, among pixels of the image. The instructions, when executed by at least one processor, may cause the electronic device to determine a color of the visual object, using a color distribution of pixels of the image corresponding to the determined location.

[0266] According to one embodiment, an electronic device may include a display, at least one processor including a processing circuit, and a memory including one or more storage media storing instructions. The at least one processor may be configured to individually or collectively execute instructions, and may be configured to cause the electronic device to receive a first input for displaying an editing screen for editing a lock screen. The at least one processor may be configured to individually or collectively execute instructions, and may be configured to cause the electronic device to simultaneously display, within the displayed editing screen in response to the first input, a first background image of the lock screen and a widget object corresponding to a widget of the lock screen. The first background image may include a visual object area obtained using a source image. The widget object may at least partially overlap the first background image. At least one processor may be configured to individually or collectively execute instructions, and cause the electronic device to receive, through the editing screen, a second input for moving the widget object while simultaneously displaying the first background image and the widget object. At least one processor may be configured to individually or collectively execute instructions, and cause the electronic device to edit the lock screen by obtaining a second background image using the source image, in response to a release of the second input corresponding to the widget object moved to at least partially overlap the visual object area included in the first background image, such that the visual object area is separated from the widget object moved by the second input. The second background image may be displayed together with the widget moved in response to the second input within the lock screen.At least one processor may be configured to individually or collectively execute instructions, wherein the electronic device is configured to cause, in response to a release of the second input corresponding to the widget object being moved away from the visual object area included in the first background image, to edit the lock screen using the first background image to be displayed on the lock screen together with the widget moved in accordance with the second input.

[0267] For example, the first background image may correspond to a first crop portion of the source image, and the second background image may correspond to a second crop portion of the source image.

[0268] For example, the size and / or position of the first crop portion relative to the source image may be different from the size and / or position of the second crop portion relative to the source image.

[0269] For example, at least one processor may be configured to individually or collectively execute instructions, which cause the electronic device to receive a third input for adjusting a position of the first background image, received through the editing screen. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to edit the lock screen by obtaining a third background image using the source image, such that the visual object area included in the first background image moved by the third input overlaps the widget object, and moves the visual object area away from the widget object moved by the third input.

[0270] For example, at least one processor may be configured to individually or collectively execute instructions, and the electronic device may be configured to cause the display to display the lock screen having the stored layout based on a state of the at least one processor switched to a specific state for displaying the lock screen based on receiving a fourth input for storing the layout adjusted by the second input or the third input through the editing screen.

[0271] For example, at least one processor may be configured to individually or collectively execute instructions, and cause the electronic device to determine a location at which the widget is to be displayed, using a color distribution of pixels included in a preview area of ​​the editing screen, among pixels of the second background image. At least one processor may be configured to individually or collectively execute instructions, and cause the electronic device to determine a color of the widget, using a color distribution of pixels of the second background image corresponding to the determined location.

[0272] For example, the lock screen may be a first lock screen. The at least one processor may be configured, individually or collectively, to cause the electronic device to control the display to display a second lock screen including a visual object area and the widget, based on the at least one processor entering a low power state. Within the second lock screen, a portion different from the visual object area may be filled with a specified color.

[0273] For example, at least one processor may be configured, individually or collectively, to cause the electronic device to control the display to deactivate one or more pixels corresponding to a portion different from the visual object area based on displaying the second lock screen to represent the particular color, wherein the particular color is black.

[0274] For example, at least one processor may be individually or collectively configured to cause the electronic device, in response to the second input, to move a position of the visual object area relative to the subject within the editing screen based on a reference position.

[0275] For example, at least one processor may be individually or collectively configured to cause the electronic device, in response to the second input, to adjust a height of the visual object area within the preview area of ​​the edit screen of the lock screen to a particular height.

[0276] In one embodiment, a method of an electronic device including a display may be provided. The method may include receiving a first input for displaying an editing screen for editing a lock screen. The method may include simultaneously displaying, within the displayed editing screen in response to the first input, a first background image of the lock screen and a widget object corresponding to a widget of the lock screen. The first background image may include a visual object area obtained using a source image. The widget object may at least partially overlap the first background image. The method may include receiving, through the editing screen, a second input for moving the widget object while simultaneously displaying the first background image and the widget object. The method may include editing the lock screen by obtaining a second background image using the source image, such that the visual object area is separated from the widget object moved by the second input, in response to a release of the second input corresponding to the widget object moved to at least partially overlap the visual object area included in the first background image. The second background image may be displayed together with the widget moved according to the second input within the lock screen. The method may include an operation of editing the lock screen using the first background image to be displayed on the lock screen together with the widget moved according to the second input in response to a release of the second input corresponding to the widget object moved to a point away from the visual object area included in the first background image.

[0277] For example, the first background image may correspond to a first crop portion of the source image, and the second background image may correspond to a second crop portion of the source image.

[0278] For example, the size and / or position of the first crop portion relative to the source image may be different from the size and / or position of the second crop portion relative to the source image.

[0279] For example, the method may include an operation of receiving a third input for adjusting the position of the first background image, which is received through the editing screen. The method may include an operation of editing the lock screen by obtaining a third background image using the source image, based on the visual object area included in the first background image moved by the third input, such that the visual object area is separated from the widget object moved by the third input so as to overlap with the widget object.

[0280] For example, the method may include an operation of displaying the lock screen having the stored layout on the display based on a state of at least one processor of the electronic device switched to a specific state for displaying the lock screen, based on receiving a fourth input for storing the layout adjusted by the second input or the third input through the editing screen.

[0281] For example, the operation of editing the lock screen to obtain the second background image may include an operation of determining a location at which the widget is to be displayed by using a color distribution of pixels included in a preview area of ​​the editing screen among pixels of the second background image. For example, the operation of editing the lock screen to obtain the second background image may include an operation of determining a color of the widget by using a color distribution of pixels of the second background image corresponding to the determined location.

[0282] For example, the lock screen may be a first lock screen. For example, the method may include an operation of controlling the display to display a second lock screen including the visual object area and the widget based on at least one processor of the electronic device entering a low power state. Within the second lock screen, another portion of the image, different from the visual object area, may be filled with a specified color.

[0283] For example, the act of controlling the display to display the second lock screen may include the act of controlling the display to deactivate one or more pixels corresponding to a portion different from the visual object area based on displaying the second lock screen to express a specific color, wherein the specific color is black.

[0284] For example, the operation of editing the lock screen by obtaining the second background image may include an operation of moving, in response to the second input, the position of the visual object area related to the subject within the editing screen based on a reference position.

[0285] For example, the operation of editing the lock screen by obtaining the second background image may include an operation of adjusting the height of the visual object area within the preview area of ​​the edit screen of the lock screen to a specific height, in response to the second input.

[0286] In one embodiment, a non-transitory computer-readable storage medium storing instructions may be provided. The instructions, when individually and / or collectively executed by at least one processor including a processing circuit of an electronic device including a display, may cause the electronic device to receive a first input for displaying an editing screen for editing a lock screen. The instructions, when executed by the at least one processor, may cause the electronic device to simultaneously display, within the displayed editing screen in response to the first input, a first background image of the lock screen and a widget object corresponding to a widget of the lock screen. The first background image may include a visual object area obtained using a source image. The widget object may at least partially overlap the first background image. The instructions, when executed by the at least one processor, may cause the electronic device to receive, through the editing screen, a second input for moving the widget object while simultaneously displaying the first background image and the widget object. The instructions, when executed by at least one processor, may cause the electronic device to, in response to a release of the second input corresponding to the widget object moved to at least partially overlap the visual object area included in the first background image, edit the lock screen to obtain a second background image using the source image such that the visual object area is separated from the widget object moved by the second input. The second background image may be displayed together with the widget moved in response to the second input within the lock screen.The instructions, when executed by at least one processor, may cause the electronic device to, in response to a release of the second input corresponding to the widget object being moved away from the visual object area included in the first background image, edit the lock screen using the first background image to be displayed on the lock screen together with the widget moved in accordance with the second input.

[0287] As used herein, the term "if" may be understood as "when, upon," "in response to determining," or "in response to detecting," depending on the context. Similarly, "if it is determined to do," or "if [the stated condition or event] is detected," may optionally be understood as "upon determining," or "in response to determining," "upon detecting [the stated condition or event]," or "in response to detecting [the stated condition or event]."

[0288] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the disclosure may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0289] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0290] The method according to the disclosure may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program instructions, including ROM, RAM, and flash memory. In addition, examples of other media may include recording or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.

[0291] Although the various exemplary embodiments described above have been described by way of limited examples and drawings, those skilled in the art will recognize that various modifications and variations are possible based on the above teachings. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0292] While the disclosure has been illustrated and described with reference to various embodiments, it is to be understood that the various exemplary embodiments are intended to be illustrative and not limiting. Those skilled in the art will further recognize that various changes in form and detail may be made without departing from the full scope of the present disclosure, including the appended claims and their equivalents. It will also be understood that any of the embodiment(s) described herein may be used in combination with any other embodiment(s) described herein.

Claims

1. In electronic devices, display; At least one processor comprising a processing circuit; and A memory comprising one or more storage media storing instructions, At least one processor is individually or collectively configured to execute the instructions, wherein the electronic device: Receive a first input to display an editing screen for editing the lock screen; In the edit screen displayed in response to the first input above: A first background image of a lock screen, wherein the first background image includes a visual object area obtained using a source image, and A widget object corresponding to the widget of the above lock screen, the widget object at least partially overlapping on the first background image, and display them simultaneously; While simultaneously displaying the first background image and the widget object, a second input for moving the widget object is received through the editing screen, In response to the release of the second input corresponding to the widget object moved to at least partially overlap the visual object area included in the first background image, the lock screen is edited by obtaining a second background image using the source image so that the visual object area is separated from the widget object moved by the second input, and the second background image is displayed together with the widget moved according to the second input within the lock screen; and In response to the release of the second input corresponding to the widget object moved away from the visual object area included in the first background image, causing the lock screen to be edited using the first background image to be displayed on the lock screen together with the widget moved according to the second input. Electronic devices.

2. In claim 1, The first background image corresponds to a first crop portion of the source image, and the second background image corresponds to a second crop portion of the source image. Electronic devices.

3. In claim 2, The size and / or position of the first crop portion related to the source image is different from the size and / or position of the second crop portion related to the source image. Electronic devices.

4. In claim 1, At least one processor is individually or collectively configured to execute said instructions, wherein said electronic device, Receive a third input for adjusting the position of the first background image received through the above editing screen, configured to cause the lock screen to be edited by obtaining a third background image using the source image, based on the visual object area included in the first background image moved by the third input, so that the visual object area is separated from the widget object moved by the third input, so as to overlap with the widget object. Electronic devices.

5. In claim 4, At least one processor is individually or collectively configured to execute said instructions, wherein said electronic device, Based on receiving a fourth input for storing the layout adjusted by the second input or the third input through the editing screen, and based on the state of at least one processor switched to a specific state for displaying the lock screen, causing the lock screen having the stored layout to be displayed on the display. Electronic devices.

6. In claim 1, At least one processor is individually or collectively configured to execute said instructions, wherein said electronic device, Among the pixels of the second background image, the location where the widget is to be displayed is determined by using the color distribution of the pixels included in the preview area of ​​the editing screen; configured to cause the color of the widget to be determined by using the color distribution of pixels of the second background image corresponding to the determined position. Electronic devices.

7. In claim 1, The above lock screen includes a first lock screen, At least one processor is individually or collectively configured to execute said instructions, wherein said electronic device, configured to cause the display to be controlled to display a second lock screen including a visual object area and the widget, based on at least one processor entering a low power state; Within the second lock screen, a portion different from the visual object area is filled with a specific color. Electronic devices.

8. In claim 1, At least one processor is individually or collectively configured to execute said instructions, wherein said electronic device, configured to cause the display to be controlled to deactivate one or more pixels corresponding to a portion different from the visual object area, based on displaying the second lock screen, to express a specific color, wherein the specific color is black. Electronic devices.

9. In claim 1, At least one processor is individually or collectively configured to execute said instructions, wherein said electronic device, In response to said second input, configured to cause, within said editing screen, a position of said visual object area related to the subject to be moved based on a reference position; Electronic devices.

10. In claim 1, At least one processor is individually or collectively configured to execute said instructions, wherein said electronic device, In response to said second input, configured to cause, within the preview area of ​​said edit screen of said lock screen, to adjust the height of said visual object area to a specific height; Electronic devices.

11. A method for an electronic device including a display, An action for receiving a first input to display an editing screen for editing the lock screen; In the edit screen displayed in response to the first input above: A first background image of a lock screen, wherein the first background image includes a visual object area obtained using a source image, and A widget object corresponding to the widget of the above lock screen, the widget object at least partially overlapping on the first background image, Actions that display simultaneously; An action of receiving a second input for moving the widget object through the editing screen while simultaneously displaying the first background image and the widget object; An operation of editing the lock screen by obtaining a second background image using the source image, in response to a release of the second input corresponding to the widget object moved to at least partially overlap the visual object area included in the first background image, such that the visual object area is separated from the widget object moved by the second input, the second background image being displayed together with the widget moved according to the second input within the lock screen, and In response to the release of the second input corresponding to the widget object moved away from the visual object area included in the first background image, an operation of editing the lock screen using the first background image to be displayed on the lock screen together with the widget moved according to the second input. method.

12. In claim 11, The first background image corresponds to a first crop portion of the source image, and the second background image corresponds to a second crop portion of the source image. method.

13. In claim 11, The size and / or position of the first crop portion related to the source image is different from the size and / or position of the second crop portion related to the source image. method.

14. In claim 11, An action of receiving a third input for adjusting the position of the first background image, received through the above editing screen; Further comprising an action of editing the lock screen by obtaining a third background image using the source image, based on the visual object area included in the first background image moved by the third input, so that the visual object area is separated from the widget object moved by the third input, so as to overlap with the widget object. method.

15. In claim 11, Further comprising an operation of displaying the lock screen having the stored layout on the display based on a state of at least one processor switched to a specific state for displaying the lock screen, based on receiving a fourth input for storing the layout adjusted by the second input or the third input through the editing screen. method.

Images