Electronic device, method, and non-transitory computer-readable storage medium for displaying image and characters having different sizes on image

Abstract

An electronic device according to an embodiment may display an image on a display. The electronic device may identify a background region of the image, which is different from a foreground region of the image, on the basis of object recognition of the image. The electronic device may simultaneously display the image and a clock widget including a plurality of numbers. The plurality of numbers may include a first number located at a first position of the background region at a first height so that the first number is displayed as extending from a reference axis in the display toward an outline of the background region. The plurality of numbers may include a second number located at a second position of the background region at a second height so that the second number is displayed as extending from the reference axis toward the outline of the background region.

Description

An electronic device, method, and non-transient computer-readable storage medium that display an image and characters having different sizes on the image

[0001] The present disclosure relates to an electronic device, a method, and a non-transient computer-readable storage medium for displaying an image and characters having different sizes on said image.

[0002] The functions supported by portable electronic devices are increasing. Various software applications can be installed on electronic devices. Electronic devices can display information generated by software applications through widget objects displayed on a display. Widget objects having a size smaller than or equal to the size of the display area of ​​the display can be displayed concurrently or simultaneously with other widget objects on the display.

[0003] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. None of the foregoing shall be claimed as prior art related to the present disclosure, nor shall it be used to determine prior art.

[0004] According to one embodiment, an electronic device may include a display, at least one processor including a processing circuit, and a memory including one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause an image to be displayed on the display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause a background area of ​​the image that is different from a foreground area of ​​the image based on object recognition of the image. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause a clock widget including a plurality of numbers and the image to be displayed simultaneously. The plurality of numbers may include a first number located at a first position in the background area at a first height so as to be displayed as extending from a reference axis within the display toward the outline of the background area. The plurality of numbers above may include a second number located at a second position in the background area at a second height, so as to be indicated as extending from the reference axis toward the outline of the background area.

[0005] In one embodiment, a method of an electronic device may be provided. The electronic device may include a display. The method may include an operation of displaying an image on the display. The method may include an operation of identifying a background area of ​​the image that is different from a foreground area of ​​the image based on object recognition of the image. The method may include an operation of simultaneously displaying a clock widget including a plurality of numbers and the image. The plurality of numbers may include a first number located at a first position in the background area at a first height so as to be displayed as extending from a reference axis within the display toward the outline of the background area. The plurality of numbers may include a second number located at a second position in the background area at a second height so as to be displayed as extending from the reference axis toward the outline of the background area.

[0006] According to one embodiment, an electronic device may include a display, at least one processor including a processing circuit, and a memory including one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause an object display area in which at least one object is displayed on the image and a background area, which is an area other than the object display area, to be distinguished based on a boundary line when an image and a character set including a series of first and second characters, including one or more of characters, numbers, and symbols, are displayed on the display. The character display area in which the character set is displayed may be included and placed within the background area. At least a portion of the character boundary line forming the character display area may include a line section that is partially in contact with the boundary line or is spaced within a set distance from the boundary line.

[0007] FIG. 1 illustrates a user interface (UI) displayed by an electronic device according to one embodiment.

[0008] FIG. 2 illustrates a block diagram of an electronic device according to one embodiment.

[0009] FIG. 3 illustrates a flowchart of the operation of an electronic device displaying image and widget objects according to one embodiment.

[0010] FIG. 4 illustrates a flowchart of the operation of an electronic device that displays an editing screen related to the layout of image and widget objects, according to one embodiment.

[0011] FIG. 5 illustrates a flowchart of the operation of an electronic device that determines the layout of a widget object based on image analysis according to one embodiment.

[0012] FIGS. 6A, FIGS. 6B, and FIGS. 6C illustrate examples of electronic devices displaying image and widget objects.

[0013] FIG. 7 illustrates exemplary layouts of image and widget objects displayed by an electronic device according to one embodiment.

[0014] FIGS. 8A and FIGS. 8B illustrate exemplary layouts of image and widget objects displayed in each of electronic devices having various sizes.

[0015] FIGS. 9a and 9b illustrate exemplary states of an electronic device displaying an editing screen related to the layout of image and widget objects.

[0016] FIG. 10 illustrates a schematic diagram of the operation of an electronic device that changes the layout of a widget object based on user input.

[0017] FIG. 11 illustrates a schematic diagram of the operation of an electronic device that changes the position and / or layout of a widget object based on user input.

[0018] FIG. 12 illustrates an exemplary operation of an electronic device that changes the layout of image and widget objects based on user input received through an editing screen.

[0019] FIG. 13 illustrates an exemplary operation of an electronic device that changes the layout of a widget object based on user input received through an editing screen.

[0020] FIGS. 14a and FIGS. 14b illustrate an exemplary operation of an electronic device that changes the layout of widget objects superimposed on an image according to user input.

[0021] FIG. 15 illustrates a flowchart of the operation of an electronic device that determines the layout of a widget object to be displayed on an image based on object recognition of the image.

[0022] FIG. 16 illustrates a flowchart of the operation of an electronic device that determines the layout of a widget object to be displayed on an image based on object recognition of the image.

[0023] FIG. 17 illustrates exemplary layouts of different images and widget objects for said images.

[0024] FIG. 18 illustrates the operation of an electronic device that changes the size of characters included in a widget object.

[0025] FIG. 19 illustrates examples of the layout of a widget object displayed by an electronic device according to one embodiment.

[0026] FIG. 20 illustrates an exemplary operation of an electronic device that changes the layout of a widget object representing time according to another widget object.

[0027] FIG. 21 illustrates an exemplary operation of an electronic device that changes the thickness and / or color of a character contained in a widget object.

[0028] FIGS. 22a, FIGS. 22b, FIGS. 22c, and FIGS. 22d illustrate the operation of an electronic device that provides animation for a widget object.

[0029] FIGS. 23a and FIGS. 23b illustrate the operation of an electronic device that provides animation for a widget object.

[0030] FIG. 24 illustrates the operation of an electronic device that changes the layout of characters within a widget object displayed through a home screen.

[0031] FIG. 25 illustrates characters displayed by an electronic device according to one embodiment, according to sizes.

[0032] FIG. 26 illustrates characters displayed by an electronic device according to one embodiment, according to thickness and / or size.

[0033] FIG. 27 illustrates characters displayed by an electronic device according to one embodiment, according to thickness.

[0034] FIG. 28 illustrates characters displayed by an electronic device according to one embodiment, according to size.

[0035] FIG. 29 is a block diagram of an electronic device in a network environment according to various embodiments.

[0036] FIG. 30a and / or FIG. 30b illustrates exemplary states of an electronic device displaying a widget object.

[0037] FIG. 31 illustrates exemplary states of an electronic device displaying a widget object.

[0038] FIG. 32 illustrates exemplary states of an electronic device displaying a widget object.

[0039] FIG. 33 illustrates exemplary states of an electronic device displaying a widget object.

[0040] FIG. 34 illustrates exemplary states of an electronic device displaying a widget object.

[0041] FIG. 35 schematically illustrates the operation of an electronic device that determines the position and / or size of a widget object according to an image.

[0042] FIG. 36 illustrates exemplary states of an electronic device that changes the position, size, and / or shape of a widget object according to motion.

[0043] FIG. 37 illustrates screens containing widget objects having a position, size, and / or shape determined based on object recognition.

[0044] FIG. 38 illustrates exemplary screens displayed by an HMD device.

[0045] FIG. 39 illustrates screens displayed by an electronic device according to one embodiment.

[0046] FIG. 40 illustrates screens displayed by an electronic device according to one embodiment.

[0047] FIG. 41 illustrates an embodiment of an electronic device having the form of a multi-foldable mobile phone.

[0048] Hereinafter, various embodiments of this document will be described with reference to the attached drawings.

[0049] The various embodiments of this document and the terms used therein are not intended to limit the technology described in this document to specific embodiments and should be understood to include various modifications, equivalents, and / or substitutions of such embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar components. A singular expression may include a plural expression unless the context clearly indicates otherwise. In this document, expressions such as “A or B,” “at least one of A and / or B,” “A, B or C,” or “at least one of A, B and / or C” may include all possible combinations of items listed together. Expressions such as “first,” “second,” “first,” or “second” may modify the components, regardless of order or importance, and are used only to distinguish one component from another and do not limit the components. When it is mentioned that a certain (e.g., 1st) component is “(functionally or telecommunicationally) connected” or “connected” to another (e.g., 2nd) component, said certain component may be directly connected to said other component or connected through another component (e.g., 3rd component).

[0050] As used in this document, the term “module” includes a unit composed of hardware or firmware and may be used interchangeably with terms such as logic, block, component, or circuit. A module may be a component formed as a whole, or a minimum unit or part thereof that performs one or more functions. For example, a module may be composed of an application-specific integrated circuit (ASIC).

[0051] FIG. 1 illustrates a user interface (UI) displayed by an electronic device (101) according to one embodiment. Referring to FIG. 1, an electronic device (101) having the appearance of a mobile phone is shown. The electronic device (101) may be referred to as a mobile device, a user terminal, user equipment (UE), a multifunction device, a portable communication device, and / or a portable device. An example of a hardware configuration included in the electronic device (101) is described with reference to FIG. 2 and / or FIG. 29.

[0052] Referring to FIG. 1, an exemplary state of an electronic device (101) that displays a screen including an image (120) on a display (110) is illustrated. The screen of FIG. 1 may be referred to as a lock screen, a home screen, a default screen, and / or a cover screen. According to one embodiment, the electronic device (101) may display a widget object (150) together with the image (120), as in the screen of FIG. 1. The image (120) may be referred to as a background image of the screen. The widget object (150) may be displayed based on the execution of a system service, a system application, and / or a software application executed by the electronic device (101). The widget object (150) may be referred to as a widget, a gadget object, and / or a gadget.

[0053] Referring to FIG. 1, an electronic device (101) may display a widget object (150) representing the current time (or the time in a specific time zone set by the user). The widget object (150) may be referred to as a clock widget, a clock widget object, a clock gadget, and / or a clock gadget object in terms of a widget representing time. An exemplary widget object (150) is illustrated that includes characters representing hours (151, 152), characters representing minutes (154, 155), and a character (153) separating hours and minutes (e.g., a colon or other delimiter), but the visual object included in the widget object (150) is not limited thereto. In order to enhance the readability (or visibility) of the widget object (150) (or the characters (151, 152, 153, 154, 155) included in the widget object (150)), the electronic device (101) can change the widget object (150) according to the image (120) (or the content of the image (120).

[0054] Referring to FIG. 1, the electronic device (101) can identify or segment a foreground area (130) corresponding to a foreground object (or subject) from an image (120). In the present disclosure, the foreground area (130) may be referred to as a subject area, an object area, and / or an object display area. By using the location of the foreground area (130) within the display (110) (or image (120)), the electronic device (101) can determine or change the location, size, and / or other attributes (e.g., color, text thickness) of a widget object (150) within the display (110).

[0055] Referring to FIG. 1, an electronic device (101) that identifies a foreground area (130) of an image (120) may display a widget object (150) superimposed on a background area of ​​the image (120) that is different from the foreground area (130) (e.g., a part of the background area (140)). Since the widget object (150) does not overlap with the foreground area (130), a user viewing the widget object (150) can clearly see both the foreground area (130), which is the main content of the image (120), and the widget object (150). In other words, the foreground area (130) may not be obscured by the widget object (150), and the widget object (150) may not be obscured by the foreground area (130).

[0056] In one embodiment, to enhance the readability and / or aesthetics of a widget object (150), the electronic device (101) may determine the sizes of the characters (151, 152, 153, 154, 155) included in the widget object (150) according to the parts of the background area where the characters (151, 152, 153, 154, 155) are each located (individually or independently). To indicate time, the characters (151, 152, 153, 154, 155) of the widget object (150) may not overlap each other or may be spaced apart from each other. The characters (151, 152, 153, 154, 155) occupying different parts of the background area of ​​the image (120) may be extended (or stretched) individually (or independently) according to the sizes of said parts. In the view that at least one character is extended, the widget object (150) may be referred to as an extended (or variable) clock widget. An exemplary operation of an electronic device (101) that displays a widget object (150) in a form linked to the foreground area (130) of an image (120) by extending the characters (151, 152, 153, 154, 155) individually (or independently) is described with reference to FIGS. 3 through 24.

[0057] According to one embodiment, an electronic device (101) may use a variable font to extend each of the characters (151, 152, 153, 154, 155) individually (or independently). The variable font may include a font in which the thickness (or weight), height, and / or width of the characters can be changed (e.g., increased and / or decreased). The variable font may be defined by file(s) configured to define a typeface (or fontface, or fonttype) (e.g., font file(s) having the extensions ttf, otf, woff, eot, and / or svg). Embodiments are not limited thereto, but the variable font may be defined by a vector graphic representing the characters (or a vector graphic file(s) storing information representing said vector graphic). An exemplary operation of an electronic device (101) that extends a character (e.g., characters (151, 152, 153, 154, 155)) based on a variable font and said variable font is described with reference to FIGS. 25 through 28.

[0058] FIG. 2 illustrates a block diagram of an electronic device (101) according to one embodiment. The electronic device (101) of FIG. 1 may include the electronic device (101) of FIG. 2. According to one embodiment, the electronic device (101) may include at least one of a processor (210), a memory (215), or a display (110). The processor (210), the memory (215), and / or the display (110) may be electrically and / or operably coupled with each other by an electronic component such as a communication bus (202). Hereinafter, operably coupled electronic components may mean that a direct connection or an indirect connection between electronic components is established by wire or wirelessly so that a second electronic component is controlled by a first electronic component. Although illustrated based on different blocks, the embodiment is not limited thereto, and some of the electronic components of FIG. 2 (e.g., at least some of the processor (210) and memory (215)) may be included in a single integrated circuit such as a system on a chip (SoC). The type and / or number of electronic components included in the electronic device (101) are not limited to those illustrated in FIG. 2. For example, the electronic device (101) may include only some of the electronic components illustrated in FIG. 2.

[0059] A processor (210) of an electronic device (101) according to one embodiment may include a circuit (e.g., a processing circuit) for processing data based on one or more instructions. The circuit for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), a graphic processing unit (GPU), a neural processing unit (NPU), and / or an application processor (AP). For example, the number of processors (210) may be one or more. A processing circuit of a processor that loads (or fetches) instructions and performs calculations corresponding to the loaded instructions may be referred to as a core circuit (or core) or referenced. For example, the processor may have the structure of a multi-core processor including a plurality of core circuits, such as a dual core, a quad core, a hexa core, or an octa core. In one embodiment having the structure of a multi-core processor, the core circuits included in the processor (210) may be classified into big core circuits (or performance core circuits) that process instructions relatively quickly and little core circuits (or efficiency core circuits) that process instructions relatively slowly, depending on speed (e.g., clock frequency), power consumption, and / or cache memory. The functions and / or operations described with reference to the present disclosure may be performed individually and / or collectively by one or more processing circuits included in the processor (210).

[0060] According to one embodiment, the memory (215) of the electronic device (101) may include circuits for storing data and / or instruction(s) that are input to and / or output to the processor (210). For example, the memory (215) may include one or more storage media for storing information and / or instructions. The memory may include, for example, volatile memory such as RAM (random-access memory) and / or non-volatile memory such as ROM (read-only memory). Non-volatile memory may be referred to as storage. Volatile memory may include, for example, at least one of DRAM (dynamic RAM), SRAM (static RAM), Cache RAM, and PSRAM (pseudo SRAM). Non-volatile memory may include, for example, at least one of PROM (programmable ROM), EPROM (erasable PROM), EEPROM (electrically erasable PROM), flash memory, hard disk, compact disk, SSD (solid state drive), and eMMC (embedded multi media card). A processor (210) of an electronic device (101) may execute instructions in memory (215) within the electronic device (101) to perform functions and / or operations indicated by said instructions. For example, if the electronic device (101) includes at least one processor, said at least one processor (e.g., processor (210)) may be configured to execute said instructions collectively or individually.

[0061] Referring to FIG. 2, the electronic device (101) may include a display (110). The embodiment is not limited thereto, and the display (110) may be omitted depending on the form factor of the electronic device (101). The display (110) of the electronic device (101) may output visualized information to a user. For example, the display (110) may be controlled by a controller such as a GPU (graphic processing unit), DPU (display processing unit), and / or a processor (210) to output visualized information to a user. The display (110) may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs may include organic LEDs (OLEDs). The display (110) may include a flat panel display (FPD) and / or electronic paper. The embodiments are not limited thereto, and the display (110) may have at least a partially curved shape or a deformable shape. A display (110) having a deformable shape may be referred to as a flexible display.

[0062] In one embodiment, the electronic device (101) may include a sensor (e.g., a touch sensor panel (TSP)) for detecting an external object (e.g., a user's finger) on the display (110). For example, using the TSP, the electronic device (101) may detect an external object that is in contact with the display (110) or floating on the display (110). In response to the detection of the external object, the electronic device (101) may execute a function related to a specific visual object corresponding to the position of the external object on the display (110) among the visual objects being displayed on the display (110).

[0063] Referring to FIG. 2, exemplary form factors of an electronic device (101) comprising a processor (210), memory (215), and / or a display (110) (e.g., a bar-shaped mobile phone (291), foldable mobile phones (292, 293), a head-mounted display (HMD) device (294), and / or a watch (295)) are illustrated. The form factors of the electronic device (101) are not limited to the examples of FIG. 2. For example, the electronic device (101) may have the form factors of a tablet PC, a laptop PC, and / or a desktop PC. For example, the electronic device (101) may be included as an electronic control unit (ECU) within a vehicle (e.g., an electric vehicle, EV). For example, the electronic device (101) may have an implantable form factor for a part of a user's body. The embodiments are not limited thereto, and the electronic device (101) may have the form factor of an earbud and / or earphone.

[0064] In one embodiment, one or more instructions (or commands) representing operations and / or operations to be performed on data by a processor (210) may be stored in the memory (215) of the electronic device (101). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, a program, and / or a software application (hereinafter referred to as an application). For example, the electronic device and / or processor may perform at least one of the operations of FIGS. 3 to 5 and / or FIGS. 15 to 16 when a set of a plurality of instructions distributed in the form of an operating system, firmware, a driver, and / or application is executed. In the following, the statement that an application is installed on an electronic device means that one or more instructions provided in the form of an application are stored in the memory of the electronic device, and that said one or more applications (or instructions representing said one or more applications) are stored individually and / or collectively in an executable format (e.g., a file having an extension specified by the operating system of the electronic device) by at least one processor of the electronic device (e.g., processor (210)).

[0065] Below, with reference to FIG. 3 and / or FIG. 4, an exemplary operation of the processor (210) and / or electronic device (101) of FIG. 2 is described.

[0066] FIG. 3 illustrates a flowchart of the operation of an electronic device for displaying image and widget objects according to one embodiment. The operation described with reference to FIG. 3 may be performed by the electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2. The order in which the operations of FIG. 3 are performed is not limited to the order shown in FIG. 3. For example, the electronic device (101) of FIG. 1 and 2 and / or the processor (210) may perform the operations of FIG. 3 in an order different from the order shown in FIG. 3. For example, at least two of the operations of FIG. 3 may be performed substantially simultaneously (e.g., multi-threading and / or multi-tasking).

[0067] Referring to FIG. 3, within operation (310), according to one embodiment, an electronic device can identify a type of subject within an image (e.g., image (120) of FIG. 1). For example, the electronic device can identify or recognize at least one subject included in the image based on object recognition. In the present disclosure, object recognition may include the function of the electronic device to identify features of an image (or video) as an image processing algorithm (e.g., subject(s) appearing to be captured within the image and / or the type, category, and / or genre of the image, such as a landscape photograph or a portrait photograph).

[0068] For example, to perform object recognition, an artificial intelligence model may be executed by an electronic device. The artificial intelligence model may include an algorithm for simulating human (or biological) neural activity, such as inference and / or learning, a software application for executing said algorithm, hardware capable of executing said software application, or any combination thereof. The hardware may include a processor (e.g., processor (210) of FIG. 2) comprising an NPU, a CME (compute matrix engine), a GPU, or any combination thereof. The artificial intelligence model may be referred to as a neural network and / or a trained model (e.g., in terms of being trained for object recognition). Based on object recognition, the electronic device may identify or acquire information about a subject appearing to be captured within an image. said information may include the location, width, height, shape, and / or size of region(s) (e.g., foreground region (130) of FIG. 1) corresponding to the subject(s) within the image. The above information may include the type (or category, class, and / or name) of the subject(s) identified from the image.

[0069] Referring to FIG. 3, the electronic device can identify or determine the type of image from among a person photo (311), an animal photo (312), an object photo (313), and / or a landscape photo (314) based on an operation (310). For example, if at least one person (or a body part of said at least one person including a face) is identified from the image based on object recognition, the electronic device can determine the type of the image as a person photo (311). For example, if an animal different from a person (e.g., a dog and / or a cat) is identified from the image based on object recognition, the electronic device can determine the type of the image as an animal photo (312). For example, if an object different from a person and / or animal (e.g., a desk, a pen, and / or a book, etc.) is identified from the image based on object recognition, the electronic device can determine the type of the image as an object photo (313). For example, if natural elements such as terrain, buildings, mountains, trees, and / or clouds are identified from an image based on object recognition, the electronic device may determine the type of the image as a landscape photograph (314). As described above, the type of the image may be related to the type of subject identified from the image. The type of the image described above may be used to determine the positional relationship between the image and the widget object.

[0070] Referring to FIG. 3, in operation (320), according to one embodiment, an electronic device may determine at least a portion of an image to be displayed on a screen. For example, the electronic device may determine or obtain at least a portion of an image to be displayed on a screen based on cropping, expanding, zooming, enlarging, upscaling, or scaling up, and / or reducing, shrinking, downsizing, downscaling, or scaling down.

[0071] Referring to FIG. 3, the electronic device may perform an action (320) according to the type of subject of the image (or the type of image determined based on said subject type) determined based on the action (310). For example, referring to action (321), only a part (e.g., upper body) of a subject (e.g., person, cat, and / or dog) may be identified from an image classified as a portrait (311) and / or an animal photograph (312). In the above example, the electronic device may determine at least a portion of the image to be displayed through the screen such that the subject is displayed from the boundary line of the part of the subject within the screen, as in action (324). For example, the electronic device may divide and / or crop the image so that the boundary line of the foreground area (or the edge of the image in contact with the foreground area) becomes the edge of the screen.

[0072] For example, by referring to action (322), a subject (e.g., a building, a mountain, and / or a cloud) associated with a landscape photograph (314) may be identified. In the above example, the electronic device may determine the position of the image so that the identified subject is displayed at a designated position on the screen, such as in action (325). The designated position may include the position of the center point of the screen or a position spaced apart from the center point (e.g., a position below the center). Based on actions (322, 325), the image may be modified (e.g., cropped, enlarged, and / or reduced) so that the landscape-related subject is placed at the designated position of action (325).

[0073] For example, by referring to action (323), the entire subject can be identified from an image classified as a person photo (311) and / or an animal photo (312). In the above example, the electronic device may determine at least a portion of the image to be displayed on the screen such that a specific part of the subject (or a specific body part), including a face, is displayed at a designated location on the screen, such as in action (326). The designated location may include the location of the center point of the screen, or a location spaced apart from the center point (e.g., a location below the center). Based on actions (323, 326), the image may be modified (e.g., cropped, enlarged, and / or reduced) so that the face of a person and / or animal is placed at the designated location of action (326).

[0074] In one embodiment, the designated location of the operation (326) may be related to the size of the image. For example, if the height of the image is greater than the width of the image (e.g., portrait image or vertical image), the electronic device may determine at least a portion of the image to be displayed on the screen so that the subject is positioned in one direction of the screen (e.g., left direction). For example, if the width of the image is greater than the height of the image (e.g., landscape image or horizontal image), the electronic device may determine at least a portion of the image to be displayed on the screen so that a specific part of the subject, including the face, is positioned at the center point of the screen.

[0075] Referring to FIG. 3, within operation (330), an electronic device according to one embodiment may determine an area where text is to be displayed (e.g., area (140) of FIG. 1) on a screen that includes at least a portion of an image determined based on operation (320). The text of operation (330) may include text contained in a widget object (e.g., characters (151, 152, 153, 154, 155) of FIG. 1). The area of ​​operation (330) may be included in a background area different from the foreground area of ​​the image where the subject is shown to exist (e.g., foreground area (130) of FIG. 1). If a plurality of background areas that appear to be divided into the foreground area are identified, the electronic device may determine the larger background area among the identified plurality of background areas as the area where text is to be displayed. If the size (or area) of the background area is larger than the minimum size (or minimum area) of the area where text is to be displayed, the electronic device may change the size (e.g., thickness, width, and / or height) of the text. The operation of the electronic device for changing the size of the text may include changing the sizes of the characters included in the text individually (or independently), as described above with reference to FIG. 1. By changing the sizes of the characters individually (or independently), the electronic device may cause the characters to be displayed along the boundary line (or outline of the foreground area) of the foreground area and the background area. By using the characters displayed along the boundary line, the electronic device may increase or enhance the aesthetics of the characters.

[0076] Referring to FIG. 3, within operation (340), an electronic device according to one embodiment may display at least a portion of an image and text determined based on operation (320). The text may be displayed in an area determined based on operation (330). A screen displayed on the display (110) of FIG. 1 may be an example of a screen displayed based on operation (340).

[0077] As described above, since text (or a widget object containing said text) is displayed in a remaining area (e.g., a background area) that is different from the foreground area of ​​an image identified based on object recognition, said text may not overlap with (or may not obscure) the foreground area (or the foreground object depicted by said foreground area). Accordingly, the electronic device can maintain or enhance the visibility of both the foreground area and the text.

[0078] According to one embodiment, an electronic device may provide a mode and / or function (e.g., an editing mode and / or an editing function) for editing a widget object including an image and / or text to be displayed on a screen. Hereinafter, with reference to FIG. 4, an exemplary operation of an electronic device for editing an image and / or widget object according to user input is described.

[0079] FIG. 4 illustrates a flowchart of the operation of an electronic device that displays an editing screen related to the layout of image and widget objects, according to one embodiment. The operation described with reference to FIG. 4 may be performed by the electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2. The order in which the operations of FIG. 4 are performed is not limited to the order shown in FIG. 4. For example, the electronic device (101) of FIG. 1 and 2 and / or the processor (210) may perform the operations of FIG. 4 in an order different from the order shown in FIG. 4. For example, at least two of the operations of FIG. 4 may be performed substantially simultaneously (e.g., multi-threading and / or multi-tasking). The operations of FIG. 4 may be related to the operations of FIG. 3.

[0080] Referring to FIG. 4, within operation (410), an electronic device according to one embodiment may display an editing screen for editing an array of image and widget objects. The editing screen of operation (410) may include screens illustrated in FIG. 9a, FIG. 9b, FIG. 10, FIG. 11, FIG. 12, FIG. 13, FIG. 14a, FIG. 14b, and / or FIG. 17. The editing screen of operation (410) may be displayed based on user input for editing a lock screen and / or a cover screen. For example, the user input may include user input for selecting a menu (or option) for editing a lock screen and / or a cover screen. In the above example, the electronic device may display the editing screen of operation (410) based on identifying a click and / or touch of the menu. While displaying the editing screen of operation (410), the electronic device may perform the remaining operations of FIG. 4 (e.g., operation (420)).

[0081] Referring to FIG. 4, within operation (420), an electronic device according to one embodiment may check whether a condition for changing a widget object according to the content of an image is satisfied. The condition of operation (420) may be related to the result of identifying subject(s) from an image, as described with reference to FIG. 3, as a condition related to the image. For example, if a foreground area of ​​an image in which a subject such as a person or animal (e.g., a dog and / or a cat) is depicted is identified, the electronic device may determine that the condition of operation (420) is satisfied. The condition of operation (420) may be related to whether a background area of ​​an image different from the foreground area identified from the image can be separated based on object recognition. For example, if a background area cannot be separated from the image (e.g., the size of the background area is too small, or the boundary line between the background area and the foreground area is too complex), the electronic device may determine that the condition of operation (420) is not satisfied. For example, if the background area can be separated from the image (furthermore, if the size of the separated background area is larger than the minimum size of the widget object), the electronic device can determine that the condition of operation (420) is satisfied.

[0082] Referring to FIG. 4, if the condition of operation (420) is satisfied (420-Yes), the electronic device may perform operation (440). If the condition of operation (420) is not satisfied (420-No), the electronic device may perform operation (430). In operation (430), according to one embodiment, the electronic device may display image and widget objects according to a basic layout. The basic layout may be defined so that the widget object is placed at a designated location within the screen (e.g., a center point of the screen or a location spaced along a designated direction, such as a vertical direction from said center point). The location within the screen where the widget object is displayed in the basic layout may be referred to as the basic location (or starting location, or original location) of the widget object.

[0083] Referring to FIG. 4, in operation (440), an electronic device according to one embodiment may determine the position and / or size of a widget object by using the background area of ​​an image. For example, the electronic device may determine the position and / or size of a widget object such that the widget object is contained within the background area (e.g., the outline of the background area wraps around the widget object), or such that the widget object overlaps at least partially with the background area. To ensure the widget object is contained within the background area, the electronic device may determine the position and / or size of the widget object by using the shape and / or size of the background area. Depending on the shape, position, and / or size of the background area within the portion of the image set to be displayed through the image and / or screen, the position and / or size of the widget object may be determined differently.

[0084] Below, with reference to FIG. 5, an exemplary operation of an electronic device for determining the position and / or size of a widget object based on the operation (440) of FIG. 4 is described.

[0085] FIG. 5 illustrates a flowchart of the operation of an electronic device that determines the layout of a widget object based on the analysis of an image, according to one embodiment. The operation described with reference to FIG. 5 may be performed by the electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2. The order in which the operations of FIG. 5 are performed is not limited to the order shown in FIG. 5. For example, the electronic device (101) of FIG. 1 and 2 and / or the processor (210) may perform the operations of FIG. 5 in an order different from the order shown in FIG. 5. For example, at least two of the operations of FIG. 5 may be performed substantially simultaneously (e.g., multi-threading and / or multi-tasking). The operations of FIG. 5 may be related to the operations of FIG. 3 and 4 (e.g., the operation (440) of FIG. 4). For example, depending on identifying that the condition of FIG. 4 is satisfied, the electronic device may perform at least one of the operations of FIG. 5.

[0086] Referring to FIG. 5, in operation (510), an electronic device according to one embodiment can identify a background area within an image that is different from a foreground area within an image where a foreground object is located, based on object recognition. For example, referring to FIG. 1, the electronic device can identify a foreground area (130) and a background area from an image (120) based on operation (510) of FIG. 5. The electronic device can identify the background area of ​​operation (510) by performing operation (310) of FIG. 3. For example, the electronic device can obtain or identify at least one bounding box representing the background area (or coordinate values ​​representing the vertices of said at least one bounding box) and / or map information representing said background area.

[0087] Referring to FIG. 5, in operation (520), an electronic device according to one embodiment may determine the position of a widget object based on a background area within an image. The electronic device may determine the position of a widget object based on the position and / or size of the background area within the screen. For example, if the background area includes a vertical center axis within the screen, the electronic device may determine the position of the widget object such that the widget object is positioned on the vertical center axis (e.g., the center point of the widget object is positioned on the vertical center axis). For example, if the background area includes a center point within the screen (or a reference point defined for displaying the widget object), the electronic device may determine the center point (or the reference point) as the position of the widget object.

[0088] Referring to FIG. 5, within operation (530), an electronic device according to one embodiment may determine the attributes of a plurality of characters included in a widget object. The attributes of operation (530) may include thickness, font size (e.g., width and / or height), and / or color. The electronic device may determine the attributes of a plurality of characters included in a widget object individually and / or independently. For example, the electronic device may determine the attributes of the characters according to the position of the characters within a background area. For example, the electronic device may determine the maximum height of the characters that may be included in the background area as the height of the characters. The embodiments are not limited thereto, and the electronic device may determine the height of the characters as the smaller of the maximum height and a specified threshold height. When a plurality of characters are spaced apart from each other, the heights of the plurality of characters may be determined independently because the height of the background area differs at each of the positions of the plurality of characters. For example, the heights of the plurality of characters may be determined differently.

[0089] Referring to FIG. 5, within operation (540), an electronic device according to one embodiment may display a plurality of characters having different sizes (e.g., height) according to a determined attribute. When the heights of the plurality of characters are determined to be the maximum height that can be included in the background area, the plurality of characters may fill the background area in a vertical direction (e.g., the characters of FIG. 1 (151, 152, 153, 154, 155)).

[0090] In one embodiment, an electronic device may perform an operation (540) using font file(s). For example, a plurality of font files representing characters having different sizes (e.g., heights) may be stored within the electronic device (e.g., in the memory (215) of FIG. 2). For example, a specific font file may be used to display characters of a first height, and another font file may be used to display characters of a second height. The electronic device may display a first character among the characters by applying a first font file among the plurality of font files. The electronic device may identify the first font file among the plurality of font files by an attribute determined based on an operation (530) for the first character. For example, the attribute may include the file name of the first font file and / or an index assigned to the first font file. While displaying a first character to which a first font file is applied, the electronic device may display a second character among the characters by applying a second font file among the plurality of font files. The electronic device may identify the second font file by using attributes determined based on the operation (530) for the second character.

[0091] In one embodiment, a plurality of font files stored in an electronic device may include different indices (or unique values). The indices may each correspond to different sizes (e.g., different heights).

[0092] In one embodiment, an electronic device may perform an operation (540) using a graphic object representing a character (e.g., a graphic object represented by a vector graphic file). The graphic object may include an extendable section according to a size (or height) determined based on the operation (530). For example, the electronic device may identify a graphic object corresponding to a first character among a plurality of characters. The electronic device may extend the graphic object using a size (or height) determined based on the operation (530) for the first character. For example, the electronic device may extend the extendable section of the graphic object. In the above example, the remaining section of the graphic object (e.g., an unextendable section) may not be extended, or may be extended in proportion to the ratio between the base size and the determined size. In the above example, the electronic device may display the extended graphic object at a position within the screen set to display the first character. While displaying the extended graphic object representing the first character, the electronic device may extend a graphic object corresponding to a second character among the plurality of characters. The electronic device can visualize the second character using an extended graphic object. An exemplary operation of the electronic device displaying a character using a font file and / or a graphic object is described with reference to FIGS. 25 through 28.

[0093] Hereinafter, exemplary layouts of images and / or widget objects displayed based on the operation of the electronic device described with reference to FIGS. 3 to 5 are described with reference to FIGS. 6a to 6c.

[0094] FIGS. 6a, 6b, and 6c illustrate examples of electronic devices displaying image and widget objects. Referring to FIGS. 6a, 6b, and 6c, screens displayed in each of the different form factors of the electronic device (101) of FIG. 2 (e.g., bar-shaped mobile phone (291), foldable mobile phone (292), and / or watch (295)) are illustrated.

[0095] Referring to FIGS. 6a through 6c, an electronic device may display an image on a display (e.g., the display (110) of FIG. 2). Referring to FIG. 6a, the electronic device may identify a background area of ​​an image that is different from the foreground area (611) of the image based on object recognition of the image. The electronic device may simultaneously display a clock widget (613) containing a plurality of numbers and an image. The clock widget (613) may be included in the background area. The plurality of numbers included in the clock widget (613) may include a first number located at a first position in the background area at a first height so as to be displayed as extending from a reference axis (612) (e.g., an axis referred to as a reference line and / or a horizontal line) within the display toward the outline of the background area (e.g., a boundary line between the background area and the foreground area (611)). A plurality of numbers included in the clock widget (613) may include a second number located at a second position in the background area at a second height so as to be displayed as extended from the reference axis (612) toward the outline.

[0096] Referring to FIG. 6a, a clock widget (613) is shown, comprising numbers positioned between the outline of a person's head depicted in the foreground area (611) and a reference axis (612). The numbers included in the clock widget (613) may be aligned with the central axis (e.g., vertical central axis) of the display and / or the image displayed through the display. The widths of the numbers included in the clock widget (613) may be equal to each other, and the heights of the numbers may be determined individually (or independently) according to the shape of the background area of ​​the image different from the foreground area (611), according to the operation described with reference to FIG. 3 through 5.

[0097] Referring to FIG. 6a, in one embodiment where the electronic device has the form factor of a foldable mobile phone (292), a screen (e.g., a cover screen and / or a lock screen) including a clock widget (613) and an image may be displayed on the cover display of the foldable mobile phone (292) (e.g., a display (844) described later with reference to FIG. 8a). In one embodiment where the electronic device has the form factor of a bar-shaped mobile phone (291), a screen including a clock widget (613) and an image may be displayed on the display of the mobile phone (291). In one embodiment where the electronic device has the form factor of a watch (295), a screen including a clock widget (613) and an image may be displayed on the circular display of the watch (295). Referring to FIG. 6a, the size of the display of the electronic device (e.g., width, height, and / or aspect ratio between width and height) may vary depending on the form factor, and the electronic device may change the layout of the image and / or clock widget (613) depending on the size of the display.

[0098] Referring to FIG. 6a, a clock widget (613) is shown that includes characters positioned sequentially along a horizontal direction (e.g., numbers indicating hours and / or minutes and a colon character separating hours and minutes), but the orientation of the characters within the clock widget (613) is not limited thereto. Referring to FIG. 6b, a clock widget (623) is shown that includes characters positioned in vertical and horizontal directions. For example, in the clock widget (623), a first set of numbers indicating the current hour may be displayed along a horizontal direction, and below the first set of numbers, a second set of numbers indicating the current minute may be displayed along a horizontal direction. The embodiment is not limited thereto, and the clock widget (623) may include a first set of numbers indicating the current hour displayed along a vertical direction, and a second set of numbers indicating the current minute displayed along a vertical direction next to the first set (e.g., to the right or to the left). Referring to FIG. 6b, the widths of the numbers within the clock widget (623), arranged along the horizontal direction from the reference axis (622), may be equal to each other. The heights of the numbers arranged along the vertical direction within the clock widget (623) may be equal to each other.

[0099] Referring to FIG. 6b, screens displayed on each of electronic devices having different form factors (e.g., foldable mobile phone (292), bar-shaped mobile phone (291), and / or watch (295)) are illustrated. In each of the screens, the electronic device may display a watch widget (623) comprising characters having a shape that extends from a reference axis (622) to a foreground area (621) of an image. For example, the electronic device may simultaneously display a character set comprising one or more characters of letters, numbers, and / or symbols, and an image on the display. While the electronic device simultaneously displays the character set and the image on the display, it may distinguish between an object display area (e.g., foreground area (621)) where at least one object (e.g., subject) is displayed on the image, and a background area which is an area other than the object display area.

[0100] Referring to FIG. 6c, a clock widget (633) including characters positioned in a vertical and horizontal direction is illustrated. The clock widget (633) may include a first set of numbers representing the current hour and a second set of numbers representing the current minute. The numbers of the first set may be displayed along the horizontal direction, and the numbers of the second set may be displayed along the horizontal direction below the numbers of the first set. The embodiment is not limited thereto, but the numbers of the first set may be displayed along the vertical direction, and the numbers of the second set may be displayed along the vertical direction next to (e.g., to the right or to the left) the numbers of the first set. Referring to FIG. 6c, a clock widget (633) arranged along the vertical direction on a reference axis (632) is illustrated. The heights and widths of the numbers of the clock widget (633) may all be the same.

[0101] Referring to FIG. 6c, screens displayed on each of electronic devices having different form factors (e.g., foldable mobile phone (292), bar-shaped mobile phone (291), and / or watch (295)) are illustrated. In each of the screens, the electronic device may display a watch widget (633) comprising characters having a shape that extends from a reference axis (632) into the foreground area (631) of an image. The height of the watch widget (633) may be determined to fill the background area of ​​the image different from the foreground area (631).

[0102] FIG. 7 illustrates exemplary layouts (701, 702, 703, 704, 705, 706) of image and widget objects displayed by an electronic device according to one embodiment. Referring to FIG. 7, screens displayed in each of different form factors (e.g., a foldable mobile phone (292) and / or a watch (295)) of the electronic device (101) of FIG. 2 are illustrated.

[0103] Referring to FIG. 7, exemplary layouts (701, 702, 703, 704, 705, 706) of a screen (e.g., lock screen and / or cover screen) including an image and a clock widget (e.g., clock widgets (720, 740)) superimposed on the image are shown. The layouts (701, 702, 703, 704) may be displayed on the cover display of a foldable mobile phone (292) (e.g., display (844) described later with reference to FIG. 8a).

[0104] Referring to the layouts (701, 702, 705) of FIG. 7, the electronic device may display a clock widget (720) containing characters arranged horizontally (e.g., “09:36”). Referring to the layouts (701, 702, 705), the electronic device may display the characters (e.g., “09:36”) within the clock widget (720) along the outline of the foreground area (710) and / or background area of ​​the image (e.g., the boundary of the foreground area (710) and the background area). Since the foreground area (710), identified based on object recognition, is identified along the outline of the subject depicted in the image, the characters within the clock widget (720) may be displayed along said curved outline. In other words, the y-coordinates of the characters within the clock widget (720) may be determined independently (or may not coincide with each other).

[0105] Referring to the layouts (703, 704, 706) of FIG. 7, the electronic device may display a clock widget (740) containing characters (e.g., “0936”) arranged in vertical and horizontal directions. Referring to the layouts (703, 704, 706), the characters within the clock widget (740) may be displayed to fill a background area different from the foreground area (730) of the image. Since the foreground area (730) is identified as a curved shape based on the subject depicted in the image, the characters within the clock widget (740) may be placed along the curved outline of the background area.

[0106] Referring to the layouts (705, 706) of FIG. 7, in one embodiment in which the electronic device has a form factor of a watch (295) including a display having a circular shape, the electronic device may determine the layout of a watch widget (e.g., watch widgets (720, 740)) based on the shape of the display as well as the shape of the foreground area (e.g., foreground areas (710, 730)). For example, referring to the layouts (705, 706), the electronic device may determine the attributes (e.g., height, size, and / or position) of the characters so that the characters within the watch widget (720, 740) are arranged along the boundary of the foreground area (710, 730) and are not located outside the display area of ​​the circular display.

[0107] Hereinafter, with reference to FIG. 8a and / or FIG. 8b, exemplary operation of an electronic device displaying a widget object (e.g., clock widgets (720, 740) of FIG. 7) displayed in different form factors is described.

[0108] FIGS. 8a and 8b illustrate exemplary layouts of image and widget objects displayed in each of electronic devices having various sizes. Referring to FIG. 8a, a screen (811) displayed by an electronic device having the form factor of a watch (295) is shown. Since the watch (295) has the form of a circular display, within the screen (811), the foreground area (820) of the image may be located below the center point of the screen (811), and the widget object (830) may be located above the center point. The widget object (830) may include characters indicating the current time (“09:06”) along with characters indicating the date (“Fri, November 10”). The characters indicating the date may be displayed at a fixed (or designated) location independently of the position of the foreground area (820) and / or background area within the screen (811). The characters indicating the current time can be extended along the contour of a background area different from the foreground area (820), based on the operation described with reference to FIGS. 1 through 7.

[0109] Referring to FIGS. 8a and 8b, a screen (812) displayed by an electronic device having the form factor of a foldable mobile phone (292) is illustrated. In one embodiment having the form factor of a foldable mobile phone (292), the electronic device may include a first housing (841), a second housing (842), and a hinge assembly (843) that rotatably connects the first housing (841) and the second housing (842). The electronic device may include a display (844) located on one side of the first housing (841) (e.g., the rear side of the electronic device). The display (844) may be referred to as a cover display. Referring to FIG. 8a, a folded state of the electronic device is illustrated in which the first housing (841) and the second housing (842) are completely superimposed when viewing the display (844). In the folded state, the screen (812) may be displayed on the display (844). Within the screen (812), the image may be positioned or cropped so that the foreground area (820) is aligned with the horizontal line of the screen (812) (or a line located below the horizontal line and parallel to the horizontal line). Within the screen (812), the widget object (830) may be aligned on a reference line located above the horizontal line of the screen (812). The widget object (830) may include characters (“09:06”) extending from the reference line toward the outline of the background area of ​​the image, which is different from the foreground area (820). The heights of the characters may be increased so that the foreground area (820) is not obscured by the characters.

[0110] Referring to FIG. 8b, in one embodiment in which the electronic device has the form factor of a foldable mobile phone (292), an unfolded state of the electronic device is shown, in which the angle between the first housing (841), the hinge assembly (843), and the second housing (842) corresponds substantially to 180º. In one embodiment in which the electronic device has the form factor of a foldable mobile phone (292), the electronic device may include a display (845) (e.g., a flexible display and / or a main display) extending from one side of the first housing (841) (e.g., the front side of the electronic device) to one side of the second housing (842) (e.g., the front side of the electronic device).

[0111] The screen (813) of FIG. 8b may be displayed on the display (845) of a foldable mobile phone (292), the display of a bar-shaped mobile phone (291), and / or the display (854) of a foldable mobile phone (293). In one embodiment having the form factor of the foldable mobile phone (293) of FIG. 8b, the electronic device may include a first housing (851), a second housing (852), and a hinge assembly (853) that rotatably connects the first housing (851) and the second housing (852). A display (854) (e.g., a cover display) may be positioned on one side of the first housing (851) (e.g., the rear side of the electronic device). Referring to FIG. 8b, within the screen (813), the foreground area (820) of the image and the widget object (830) may not overlap each other. The characters of the widget object (830) can be extended without overlapping with the foreground area (820).

[0112] Referring to FIG. 8b, a screen (814) displayed by an electronic device having the form factor of a foldable mobile phone (293) is illustrated. In one embodiment having the form factor of a foldable mobile phone (293), the electronic device may include a display (855) (e.g., a flexible display and / or a main display) extending from one side of a first housing (851) (e.g., the front side of the electronic device) to one side of a second housing (852) (e.g., the front side of the electronic device). Within the screen (814) having the largest size, an image may have a foreground area (820) positioned at the center of the screen (814), and a widget object (830) may be positioned over the foreground area (820) at the center of the screen (814). Characters included in the widget object (830) may extend along the outline of the foreground area (820) and / or background area from a reference line.

[0113] Hereinafter, with reference to FIGS. 9a and 9b, an embodiment of an electronic device that displays an editing screen for a screen (e.g., a lock screen and / or a cover screen) including an image and widget object (830) is shown.

[0114] FIGS. 9a and 9b illustrate exemplary states (901, 902, 903) of an electronic device (101) that displays an editing screen related to the layout of image and widget objects. The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operation of the electronic device (101) described with reference to FIG. 9a and / or FIG. 9b.

[0115] Referring to FIGS. 9a and 9b, exemplary states (901, 902, 903) of an electronic device (101) for displaying an editing screen for a cover screen (or lock screen) including an image and a widget object (e.g., a widget object (150) of FIG. 1) are shown. Referring to state (901), the editing screen displayed by the electronic device (101) may include a preview area (913) for guiding the layout of the cover screen. Through the preview area (913), the electronic device (101) may display a visual object (914) corresponding to an image to be included in the cover screen and a widget object to be displayed on the image.

[0116] Referring to FIG. 9a, along with the editing screen, the electronic device (101) may display visual objects for switching the screen displayed on the display (e.g., the editing screen displayed in state (901)) through the area (918). The visual objects may include a visual object for switching the first screen displayed on the display to the second screen that was displayed prior to the first screen (e.g., a visual object referred to as a back button). The visual objects may include a visual object for displaying a designated screen referred to as the launcher screen (or home screen) (e.g., a visual object referred to as a home button). The visual objects may include a visual object for displaying a list of screens that were displayed on the display (e.g., a visual object referred to as recent apps).

[0117] Referring to the exemplary state (901) of FIG. 9a, the editing screen displayed by the electronic device (101) may include a visual object (911) (or a UI (user interface) object) for changing an image to be displayed on the cover screen. A user input indicating the selection of the visual object (911) (e.g., a touch input to the visual object (911)) may be referred to as a user input for changing an image to be displayed on the cover screen. Based on the user input associated with the visual object (911), the electronic device (101) may display a screen for selecting and / or changing the image (e.g., a screen provided by a gallery application).

[0118] Referring to the exemplary state (901) of FIG. 9a, the editing screen displayed by the electronic device (101) may include a visual object (912) for determining the cover screen based on the layout displayed through the preview area (913). A user input indicating the selection of the visual object (912) (e.g., a touch input to the visual object (912)) may be referred to as a user input for determining the layout of the cover screen as the layout displayed through the preview area (913). Based on the user input to the visual object (912), the electronic device (101) may stop displaying the editing screen based on the state (901).

[0119] Referring to the exemplary state (901) of FIG. 9a, an editing screen displayed by an electronic device (101) may include an area (915) containing options for changing the font of a widget object (e.g., a widget object corresponding to a visual object (914). Through the area (915), the electronic device (101) may receive user input for changing the font of characters included in the widget object. Based on the user input, the electronic device (101) may display a visual object (914) representing a widget object (or characters within the widget object) to which the font corresponding to the user input has been applied.

[0120] Referring to the exemplary state (901) of FIG. 9a, an editing screen displayed by an electronic device (101) may include an area (917) containing options for changing the color of characters within a widget object. The options displayed through the area (917) may include an option to automatically determine the color of the characters within the widget object based on the color of an image displayed together with the widget object. Based on user input for selecting the option, the electronic device (101) may display a notification message such as “Color changes according to the background image” (e.g., in the form of a pop-up window). Through the area (917), the electronic device (101) may receive user input for changing the color of the characters included in the widget object. Based on the user input, the electronic device (101) may display a visual object (914) representing a widget object (or characters within the widget object) having a color corresponding to the user input.

[0121] Referring to the exemplary state (901) of FIG. 9a, the editing screen displayed by the electronic device (101) may include an area (916) containing options for changing the shape of the widget object. Through the area (916), the electronic device (101) may display options corresponding to various shapes of the widget object (e.g., shapes containing characters with variable fonts, shapes of analog clocks).

[0122] For example, through the area (916), the electronic device (101) may display a visual object (921) corresponding to an option for displaying a widget object containing characters having a variable font. Based on user input indicating the selection of the visual object (921), the electronic device (101) may display a preview area (931) containing characters having heights extended within a background area different from the foreground area (940) of the image. Through the preview area (931), the electronic device (101) may display a visual object (951) representing a widget object containing said characters. Based on user input indicating the selection of the visual object (921), the electronic device (101) may display (overlapping) a visual object (922) (e.g., a visual object having a “V” shape) representing the selection of said visual object (921) on said visual object (921).

[0123] Referring to FIG. 9a, prior to receiving user input indicating the selection of a visual object (921), the electronic device (101) may display a preview area (932) containing a visual object (952) representing a widget object having a basic layout. Through the preview area (932), the electronic device (101) may display a visual object (952) representing a widget object containing characters having a fixed (or corresponding to a default value) height.

[0124] Referring to FIG. 9b, exemplary states (902, 903) of an electronic device (101) displaying an editing screen including a preview area (961) representing the layout of a cover screen are illustrated. In state (902), the electronic device (101) may display options for adjusting the font and / or color of a widget object to be included in the cover screen through an area (962). Through the area (962), the electronic device (101) may display options (964) for changing the font of the characters of the widget object, options (965) for changing the thickness of the characters, and options (967) for changing the color of the characters. Through the area (962), the electronic device (101) may display options (968) for individually changing the heights of the characters of the widget object. Based on user input for the above option (968), the electronic device (101) may change the heights of the characters of the widget object independently or change the characters of the widget object to the same height. Based on user input received through the area (962), the electronic device (101) may change the attributes of the widget object displayed through the preview area (961).

[0125] Referring to FIG. 9b, within state (903), the electronic device (101) may display options for controlling the layout of a widget object to be included on a cover screen through area (963). Through area (963), the electronic device (101) may display options (971, 972) for independently changing the heights of the characters of the widget object based on a variable font. For example, option (971) may be an option corresponding to a widget object containing characters arranged along a horizontal direction, which displays characters having heights determined based on the operation described with reference to FIG. 3 through 5. For example, option (972) may be an option corresponding to a widget object containing characters arranged along a horizontal and vertical direction, which displays characters having heights determined based on the operation described with reference to FIG. 3 through 5. Through the area (963), the electronic device (101) can display options (973) for displaying a widget object having characters having a specified height. In response to user input received through the area (963), the electronic device (101) can change the attributes of the widget object displayed through the preview area (961).

[0126] Through a preview area (e.g., preview areas (913, 961)) displayed through FIG. 9a and / or FIG. 9b, the electronic device (101) may receive user input for changing the position and / or size of an image and / or widget object within the cover screen. The user input may include user input for changing the position and / or size of a widget object within the cover screen. User input for changing the position and / or size of a widget object may include, for example, a drag gesture, a swipe gesture, and / or a pinch-to-zoom gesture for a visual object (914) in FIG. 9a. User input for changing the position and / or size of an image may include, for example, a drag gesture, a swipe gesture, and / or a pinch-to-zoom gesture for an image displayed through the preview area (913) in FIG. 9a.

[0127] Hereinafter, with reference to FIGS. 10 to 14b, an exemplary operation of an electronic device (101) that changes the layout of an image and / or widget object of a cover screen based on user input received through an editing screen is described.

[0128] FIG. 10 illustrates a schematic diagram of the operation of an electronic device (101) that changes the layout of a widget object (1040) based on user input. The electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2 can perform the operation of the electronic device (101) described with reference to FIG. 10.

[0129] Referring to FIG. 10, an exemplary state of an electronic device (101) displaying an editing screen including a preview area (1010) for a cover screen is illustrated. The preview area (1010) of FIG. 10 may correspond to the preview area (913) of FIG. 9a. The editing screen may include a visual object (1020) corresponding to an option for individually changing the heights of the characters of a widget object. The visual object (1020) may correspond to the visual object (921) of FIG. 9a.

[0130] Referring to FIG. 10, through a preview area (1010), the electronic device (101) can receive user input to change the position and / or size of an image or widget object included in the cover screen. For example, if the foreground area (1130) within the image to be displayed on the cover screen is enlarged according to user input, the electronic device (101) can display a visual object (1040) representing a widget object located within a background area that is reduced according to the enlarged foreground area (1130), such as in the preview area (1011). If the foreground area (1130) is enlarged according to the user input and characters having a minimum height cannot be displayed through the background area, the electronic device (101) can display a visual object (1040) representing a widget object containing characters having a basic height, such as in the preview area (1012). Referring to the exemplary preview area (1012) of FIG. 10, the size of the background area within the image is reduced by the enlarged foreground area (1130), so the electronic device (101) may stop changing the characters according to the background area. Based on the stoppage, the electronic device (101) may display a visual object (1040) corresponding to a widget object containing characters having a base height.

[0131] Referring to FIG. 10, through a preview area (1010), the electronic device (101) can receive user input for moving an image. For example, after the foreground area (1130) is moved according to the user input, the electronic device (101) can display a visual object (1040) representing a widget object placed in a background area different from the foreground area (1130) and / or the foreground area (1130) that was moved by the user input, such as in the preview area (1013). For example, through the preview area (1013), the electronic device (101) can display a widget object (1040) that includes characters that are moved over the foreground area (1130) and have heights extended from the background area above the foreground area (1130).

[0132] Referring to FIG. 10, through a preview area (1010), the electronic device (101) can receive user input to change the position and / or size of a widget object. For example, if the size of the widget object to be displayed on the cover screen is reduced to less than the minimum size based on the user input, the electronic device (101) can display a visual object (1040) representing a widget object having a basic size, such as in the preview area (1014). Referring to the exemplary preview area (1014) of FIG. 10, the electronic device (101) can display the visual object (1040) superimposed on the foreground area (1130).

[0133] Referring to FIG. 10, the dashed line displayed with the visual object (1040) can represent a character boundary line. The character boundary line can be omitted from the cover screen.

[0134] FIG. 11 illustrates a schematic diagram of the operation of an electronic device (101) that changes the position and / or layout of a widget object based on user input. The electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2 can perform the operation of the electronic device (101) described with reference to FIG. 11.

[0135] Referring to FIG. 11, an exemplary editing screen for a cover screen (or lock screen) including an image and a widget object (e.g., the widget object (150) of FIG. 1) is illustrated. The electronic device (101) may display a preview area (1110) to guide the layout of the cover screen through the editing screen. The electronic device (101) may display a visual object (1111) to change the image to be displayed on the cover screen superimposed on the preview area (1110). For a description of the visual object (1111), refer to the description of the visual object (911) of FIG. 9a. The electronic device (101) may include a visual object (1112) to determine the cover screen based on the layout displayed through the preview area (1110), superimposed on the preview area (1110). For a description of the visual object (1112), refer to the description of the visual object (912) of FIG. 9a.

[0136] Referring to FIG. 11, through a preview area (1110), the electronic device (101) may display a visual object (1130) representing a widget object. The electronic device (101) may receive user input based on the visual object (1130) (e.g., user input identified based on a drag gesture and / or pinch-to-zoom gesture on the visual object (1130)). The electronic device (101) may display a preview area (1110) representing a widget object that has been moved or whose size and shape have been changed based on the user input. For example, based on user input (e.g., a drag gesture and / or voice input) to move the visual object (1130) to the right edge of the preview area (1110), the electronic device (101) may display a visual object (1131) representing a widget object adjacent to the right edge. The visual object (1131) may represent a widget object that has been moved based on the user input and includes characters having heights extended within a background area different from the foreground area (1120). In this way, when the widget object moves in the left and right directions, the left and right widths of the visual object (1130) and the visual object (1131) can be maintained identically.

[0137] For example, based on user input (e.g., drag gesture and / or voice input) to move a visual object (1130) to the left edge of the preview area (1110), the electronic device (101) may display a visual object (1132) representing a widget object adjacent to the left edge. As with the visual objects (1131, 1132), the electronic device (101) may change the characters of the widget object at a position changed according to user input so as not to overlap with the foreground area (1120). Thus, when the widget object moves to the left or right, the left and right widths of the visual object (1130) and the visual object (1132) may be maintained the same.

[0138] For example, based on user input (e.g., pinch-to-zoom gesture and / or voice input) to extend a visual object (1130) toward the right edge and / or left edge of a preview area (1110), the electronic device (101) may display a visual object (not shown) representing a widget object extended toward the right edge and / or left edge, or a visual object (not shown) representing a widget object reduced toward the opposite direction of the right edge and / or left edge.

[0139] In the above-described embodiment, movement, enlargement, and reduction in the left and right directions were explained, but movement, enlargement, and reduction may also be performed in the up and down directions within the background area. In this way, when the size of the widget object is changed in the left and right directions and / or in the up and down directions, the width between the left and right and / or the height between the top and bottom of the visual object (1130) before the change and the visual object (not shown) after the change may be changed.

[0140] More specifically, the visual object (1130) may be distinguished from the background area by a character boundary line, which may include upper, lower, left, and right boundary lines. At least one of the upper, lower, left, or right boundary lines may move in the left or right direction within the background area based on the user's touch input, or at least one of the upper or lower boundary lines may move in the up or down direction within the background area. By moving at least one of the upper, lower, left, or right boundary lines in the up, down, left, or right direction, the character display area where the visual object (1130) is displayed may be moved, enlarged, and reduced within the background area. Accordingly, at least one of the width and / or height of a series of characters (including one or more of letters, numbers, and symbols) placed within the character display area where the visual object (1130) is displayed may increase or decrease. That is, the visual object (not shown) may represent a widget object whose size and shape are changed based on the user input, and which includes characters having heights extended within a background area different from the foreground area (1120).

[0141] Alternatively, for example, the width and / or height of a series of characters (including one or more of letters, numbers, and symbols) placed within the character display area where the visual object (1130) is displayed may remain the same without change.

[0142] However, regardless of whether a change in the width and / or height of a series of characters occurs during the process of changing the position or size of the character display area, at least a portion of the character boundary line forming the character display area may include a line section that partially touches the boundary line (1120) of the object display area or is spaced within a set distance from the boundary line (1120).

[0143] Referring to FIG. 11, an electronic device (101) may receive user input for overlapping a widget object on a foreground area (1120). The user input may be identified based on a gesture (e.g., a drag gesture) for moving a visual object (1130) corresponding to the widget object to the foreground area (1120). Based on the user input, the electronic device (101) may display a visual object (1133) representing the widget object overlapping on the foreground area (1120). For example, the electronic device (101) may display a visual object (1133) representing a widget object containing characters having the same height on the foreground area (1120). Based on the user input for overlapping a widget object on the foreground area (1120), the electronic device (101) may determine the color of the widget object (e.g., the color of the characters included in the widget object) based on the color distribution of the foreground area (1120). For example, the characters of a widget object represented through a visual object (1133) may have different colors from the characters of a widget object represented through visual objects (1131, 1132).

[0144] FIG. 12 illustrates an exemplary operation of an electronic device (101) that changes the layout of an image and widget object based on user input received through an editing screen. The electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operation of the electronic device (101) described with reference to FIG. 12. With reference to FIG. 12, an exemplary editing screen for a cover screen (or lock screen) including an image and widget object (e.g., a widget object (150) of FIG. 1) is illustrated. For a description of the editing screen of FIG. 12, refer to the description of the editing screen of FIG. 11.

[0145] According to one embodiment, an electronic device (101) may display a cover screen including an image divided (or cropped) based on a frame (1210). Referring to FIG. 12, an editing screen for the cover screen is illustrated as an example. A frame (1210) having the shape of a heart is illustrated as an example, but the shape of the frame (1210) is not limited thereto. The electronic device (101) may provide options for changing the shape of the frame (1210) through the editing screen.

[0146] Referring to FIG. 12, along with an image contained in a frame (1210), the electronic device (101) may display a widget object comprising characters arranged along the frame (1210) (or the outline of the frame (1210). Referring to FIG. 12, within a preview area (1110), the electronic device (101) may display a visual object (1130) corresponding to the widget object. For example, the characters of the widget object may have heights determined along the outline of a background area different from the area where the frame (1210) is displayed.

[0147] In one embodiment, the electronic device (101) may receive user input to change the position and / or size of an image included in a frame (1210) through a preview area (1110). The user input may be identified based on a drag gesture and / or pinch-to-zoom gesture for the image. For example, based on user input to enlarge the foreground area (1220) of the image, the electronic device (101) may display a preview area (1110) containing an enlarged foreground area (1221). Referring to FIG. 12, if the size of the enlarged foreground area (1221) based on user input exceeds the size of the frame (1210), the electronic device (101) may display a foreground area (1221) having a size that exceeds the frame (1210).

[0148] Referring to FIG. 12, while displaying a foreground area (1221) having a size exceeding that of a frame (1210), the electronic device (101) can change the heights of the characters of a widget object based on the outline of the foreground area (1221). Referring to FIG. 12, a visual object (1131) may represent a widget object including characters having heights changed based on the outline of the foreground area (1221). For example, the characters of the widget object may have heights adjusted along the outline of a background area that is different from the area where the combination of the foreground area (1221) and the frame (1210) is displayed.

[0149] Referring to FIG. 12, while displaying a foreground area (1221) having a size exceeding that of a frame (1210), the electronic device (101) may receive user input to move a widget object. For example, the electronic device (101) may display a visual object (1132) representing the widget object moved based on the user input. The visual object (1132) may represent the widget object, which includes characters having heights adjusted according to the shape of the background area at the position moved based on the user input.

[0150] FIG. 13 illustrates an exemplary operation of an electronic device (101) that changes the layout of a widget object based on user input received through an editing screen. The electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operation of the electronic device (101) described with reference to FIG. 13. With reference to FIG. 13, an exemplary editing screen for a cover screen (or lock screen) including an image and a widget object (e.g., a widget object (150) of FIG. 1) is illustrated. For a description of the editing screen of FIG. 13, refer to the description of the editing screen of FIG. 9a.

[0151] Referring to FIG. 13, within the preview area (913) of the editing screen, the electronic device (101) may display a visual object (1320) representing an image including a foreground area (1310) and a widget object superimposed on the image. The visual object (1320) may include characters located in a background area different from the foreground area (1310) and having heights independently determined according to the shape of the background area.

[0152] According to one embodiment, an electronic device (101) may receive user input to move a widget object to a specific area of ​​an image through an editing screen. For example, the electronic device (101) may receive user input related to an area (1330) of an image. The user input may be identified based on a long-touch gesture of touching the area (1330) for a period exceeding a specified period (e.g., about 1.5 seconds). Based on the user input related to the area (1330), the electronic device (101) may display a visual object (1323) within a preview area (913) representing a widget object superimposed on the area (1330). The visual object (1323) may represent a widget object including characters having a color determined according to the color distribution of the area (1330).

[0153] According to one embodiment, an electronic device (101) may receive user input through an editing screen to determine (or select) an area (1340) that does not overlap with a widget object. For example, the electronic device (101) may receive user input related to the area (1340). Based on user input related to the area (1340), the electronic device (101) may display a visual object (1324) representing a widget object placed in a remaining area different from the area (1340). For example, based on user input for moving a widget object, the electronic device (101) may display a visual object (1324) representing a widget object that is moved so as not to overlap with the area (1340).

[0154] Widget objects superimposed on an image on a cover screen are not limited to widget objects representing the current time (e.g., clock widget). Hereinafter, with reference to FIG. 14a and / or FIG. 14b, an embodiment of an electronic device (101) that displays a cover screen including a plurality of widget objects is described.

[0155] FIGS. 14a and 14b illustrate an exemplary operation of an electronic device (101) that changes the layout of widget objects superimposed on an image according to user input. The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operation of the electronic device (101) described with reference to FIGS. 14a and / or FIG. 14b. With reference to FIGS. 14a and / or FIG. 14b, an exemplary editing screen for a cover screen (or lock screen) including an image and a plurality of widget objects is illustrated. For a description of the editing screen of FIGS. 14a and / or FIG. 14b, the description of the editing screen of FIG. 11 may be referenced.

[0156] Referring to FIG. 14a, within the preview area (1110) of the editing screen, the electronic device (101) may display a visual object (1420) representing an image including a foreground area (1410) and a clock widget superimposed on said image. The visual object (1420) may represent a clock widget including characters having heights adjusted along the outline of said background area within a background area of ​​an image different from the foreground area (1410). Referring to FIG. 14a, within the editing screen, the electronic device (101) may display a visual object (1430) for adding a widget object to the cover screen. An exemplary visual object (1430) having the form of a button including designated text such as “Add widget” is illustrated, but the embodiment is not limited thereto. Referring to FIG. 14a, based on user input related to a visual object (1430), the electronic device (101) can display visual objects (1440, 1441, 1442, 1443) representing a plurality of widget objects.

[0157] Referring to the exemplary visual object (1440) of FIG. 14a, a plurality of widget objects added based on the user input may have a position linked to a clock widget corresponding to the visual object (1420). Based on user input to move the clock widget and / or the plurality of widget objects through an editing screen, the electronic device (101) may display the clock widget and the plurality of widget objects moved together with the clock widget, such as the visual objects (1422, 1442). An embodiment is illustrated in which a plurality of widget objects are displayed below the clock widget based on user input for the visual object (1430), but the embodiment is not limited thereto. For example, as with the visual objects (1441, 1420), the electronic device (101) may determine the positions of the plurality of widget objects to be next to the clock widget (e.g., to the right of the clock widget).

[0158] Referring to FIG. 14a, while displaying a visual object (1422) corresponding to a clock widget and a visual object (1442) corresponding to a plurality of widget objects, the electronic device (101) may receive user input to change the image of the cover screen. Based on the user input, the electronic device (101) may change the image displayed through the preview area (1110). Based on the user input, the electronic device (101) may change the positions of the clock widget and the plurality of widget objects to default positions. For example, the electronic device (101) may display a visual object (1423) representing the clock widget changed to a default position and a visual object (1443) representing the plurality of widget objects changed to the default position.

[0159] Referring to FIG. 14b, while displaying a visual object (1423) representing a clock widget and a visual object (1443) representing a plurality of widget objects, the electronic device (101) may receive user input to move a specific widget object. For example, based on user input to move the widget objects represented by the visual object (1443), the electronic device (101) may display a visual object (1444) representing the widget objects moved based on the user input without moving the visual object (1423) representing the clock widget.

[0160] FIG. 15 illustrates a flowchart of the operation of an electronic device for determining the layout of widget objects (e.g., widget objects (1542, 1544)) to be displayed on an image (1500) based on object recognition of the image (1500). The operation described with reference to FIG. 15 may be performed by the electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2. The order in which the operations of FIG. 15 are performed is not limited to the order shown in FIG. 15. For example, the electronic device (101) of FIG. 1 and 2 and / or the processor (210) may perform the operations of FIG. 15 in an order different from the order shown in FIG. 15. For example, at least two of the operations of FIG. 15 may be performed substantially simultaneously (e.g., multi-threading and / or multi-tasking). The operation of FIG. 15 may be related to the operations of FIG. 3 to FIG. 5.

[0161] Referring to FIG. 15, in operation (1510), an electronic device according to one embodiment can identify a foreground area (1512) within an image (1500) based on object recognition. For example, the electronic device can identify a foreground area (1512) having a shape that includes curved sections and / or straight sections.

[0162] Referring to FIG. 15, in operation (1520), an electronic device according to one embodiment can determine a rectangular candidate region (1514) in a background region within an image (1500) that is different from a foreground region (1512). For example, the electronic device can identify or determine a candidate region (1514) having the largest size in a rectangular shape in the background region.

[0163] Referring to FIG. 15, in operation (1530), an electronic device according to one embodiment may determine the layout of a widget object based on a determined candidate region (1514). For example, when displaying a widget object containing characters arranged horizontally, the electronic device may determine the area (1532) extending from the candidate region (1514) to the foreground region (1512) as the layout of the widget object. For example, when displaying a widget object containing characters arranged vertically, the electronic device may determine the area (1534) extending from the candidate region (1514) to the foreground region (1512) as the layout of the widget object.

[0164] Referring to FIG. 15, within operation (1540), an electronic device according to one embodiment may display a widget object on an image based on a determined layout. For example, using area (1532), the electronic device may display a widget object (1542) containing characters arranged horizontally. For example, using area (1534), the electronic device may display a widget object (1544) containing characters arranged vertically. Within the widget object (1544), the characters may occupy the upper half (e.g., “12”) and the lower half (e.g., “34”) of area (1534), respectively.

[0165] Referring to FIG. 15, the characters included in the widget object (1542) may be adjacent in the horizontal direction. The vertical lengths of the characters within the horizontally adjacent widget object (1542) may differ from each other. Referring to the widget object (1544) of FIG. 15, the horizontal lengths of the characters within the vertically adjacent widget object (1544) may differ from each other.

[0166] FIG. 16 illustrates a flowchart of the operation of an electronic device for determining the layout of widget objects (e.g., widget objects (1641, 1642)) to be displayed on an image (1601) based on object recognition of the image (1601). The operation described with reference to FIG. 16 may be performed by the electronic device (101) of FIG. 1 and 2 and / or the processor (210) of FIG. 2. The order in which the operations of FIG. 16 are performed is not limited to the order shown in FIG. 16. For example, the electronic device (101) of FIG. 1 and 2 and / or the processor (210) may perform the operations of FIG. 16 in an order different from the order shown in FIG. 16. For example, at least two of the operations of FIG. 16 may be performed substantially simultaneously (e.g., multi-threading and / or multi-tasking). The operation of FIG. 16 may be related to the operations of FIG. 3 through 5 and / or FIG. 16.

[0167] Referring to FIG. 16, in operation (1610), an electronic device according to one embodiment may divide an image (1601) to obtain cells. For example, the electronic device may identify a plurality of cells corresponding to each part of the image (1601). Referring to FIG. 16, exemplary cells having the form of a grid are illustrated. The electronic device may divide the image (1601) into m × n cells according to the resolution of the image (1601). The m and n may change according to the resolution of the image (1601). The width of a cell may be the width of the image (1601) divided by n, and the height of a cell may be the height of the image (1601) divided by m. For example, when dividing an image (1601) having a resolution of 1080 × 2400 based on m = 12 and n = 6, 72 cells (= 12 × 6) having a size of 180 × 200 can be divided from the image (1601). Using the cells divided (or obtained) from the image (1601), the electronic device can identify or mask the cells containing the subject.

[0168] Referring to FIG. 16, within operation (1620), an electronic device according to one embodiment can identify cells corresponding to a background area based on object recognition of an image. For example, the electronic device can determine, or check, based on object recognition, whether each of the plurality of cells of operation (1610) depicts a foreground object. The electronic device can identify a background area including at least one cell in which a foreground object is not depicted. The object recognition may be performed to identify a foreground object (or subject) classified into a designated category.

[0169] In one embodiment, the electronic device can identify a bounding box representing a foreground area based on object recognition. Among a plurality of cells of operation (1610), the electronic device can determine at least one cell that overlaps with the bounding box as an area where a widget object cannot be placed (e.g., an unusable area). The electronic device can set at least one cell that does not overlap with the bounding box as a candidate cell where a widget object can be placed. Referring to FIG. 16, the cells (or candidate cells) corresponding to the background area may have a pattern of diagonals.

[0170] Referring to FIG. 16, within operation (1630), an electronic device according to one embodiment can determine the layout of a widget object using identified cells. For example, the electronic device can determine the layout of a widget object using cells arranged in a horizontal direction and / or a vertical direction among the cells identified based on operation (1620). The electronic device can determine the layout of a widget object based on cells that overlap with a reference axis among the cells of operation (1620). The electronic device can determine the layout of a widget object based on cells located on the center axis (e.g., a horizontal center axis or a vertical center axis) of the image (1601) among the cells of operation (1620). If the widget object cannot be placed on the center axis of the image (1601), the electronic device can determine the layout of the widget object using cells that have the widest rectangular shape among the cells of operation (1620).

[0171] The electronic device can determine the layout of a widget object based on the minimum size of the widget object. The electronic device can identify the region having the largest size among the cells of the operation (1620). The electronic device can determine the layout of the widget object using the identified region. The electronic device can determine the layout of the widget object based on the location furthest from cells different from the cells of the operation (1620) (e.g., cells overlapping with the foreground region). For example, the electronic device can determine the layout of the widget object based on the cell at the point furthest from the center coordinates of the foreground region by comparing the coordinates of the cells.

[0172] Referring to FIG. 16, the electronic device can identify an area (1631) for displaying a widget object containing characters arranged along a horizontal direction among the cells of operation (1620). The embodiment is not limited thereto, and the electronic device can identify an area (1632) for displaying a widget object containing characters arranged along a vertical direction among the cells of operation (1620).

[0173] Referring to FIG. 16, in operation (1640), an electronic device according to one embodiment may display a widget object together with an image (1601) based on a determined layout. For example, an electronic device that identifies a region (1631) may display a widget object (1641) containing characters placed in the region (1631). The characters within the widget object (1641) may have heights that extend toward cells corresponding to the foreground region. An electronic device that identifies a region (1632) may display a widget object (1642) containing characters placed in the region (1632). The characters within the widget object (1642) may have heights that extend toward cells corresponding to the foreground region.

[0174] FIG. 17 illustrates exemplary layouts of different images and widget objects for said images. The electronic device (101) and / or processor (210) of FIG. 1 and 2 may perform the operation of the electronic device (101) described with reference to FIG. 17. With reference to FIG. 17, an exemplary editing screen for a cover screen (or lock screen) including images and widget objects is illustrated. For a description of the editing screen of FIG. 17, refer to the description of the editing screen of FIG. 11.

[0175] Referring to FIG. 17, the electronic device (101) may display a visual object (1715) representing a widget object placed in a first background area different from the first foreground area (1712) within a preview area (1110), based on identifying a first foreground area (1712) of a first image. Based on user input indicating the selection of the visual object (1111), the electronic device (101) may receive user input to change the first image displayed through the preview area (1110) to another image (e.g., a second image (1720), a third image (1730), a fourth image (1740), and / or a fifth image (1750)).

[0176] Referring to FIG. 17, based on user input to change the image set to be displayed through the cover screen from the first image to the second image (1720), the electronic device (101) may display a visual object (1725) representing the second image (1720) and a widget object superimposed on the second image (1720) in the preview area (1110). Along with the second image (1720) including a foreground area (1722), the electronic device (101) may display a visual object (1725) representing a widget object that includes characters included in the background area of ​​the second image (1720) and extending toward the outline of the background area.

[0177] Referring to FIG. 17, based on user input specifying a third image (1730) as a background image for a cover screen, the electronic device (101) may display a visual object (1735) representing the third image (1730) and a widget object in a preview area (1110). Based on object recognition for the third image (1730), which is a landscape photograph containing buildings (e.g., the landscape photograph (314) of FIG. 3), the electronic device (101) may identify a foreground area (1732) depicting the buildings and / or a background area different from the foreground area (1732). The electronic device (101) may display a visual object (1735) representing a widget object located on the background area. Through the visual object (1735), the electronic device (101) may visualize the characters of the widget object that extend from the background area toward the foreground area (1732).

[0178] Referring to FIG. 17, based on user input setting a fourth image (1740), which is a landscape photograph, as a background image of a cover screen, the electronic device (101) can display a visual object (1745) corresponding to the fourth image (1740) and a widget object in a preview area (1110). The widget object displayed by the visual object (1745) may include characters located in a background area different from the foreground area (1742) of the fourth image (1740) and having sizes extended toward the outline of the background area. The heights of the characters may be determined individually (or independently) according to the shape of the background area.

[0179] The size and / or shape of the cover screen is not limited to the embodiments described above. For example, the electronic device (101) may receive user input to select a fifth image (1750) as a background image of the cover screen having a width greater than its height. Based on the user input, the electronic device (101) may display a cover screen including a widget object superimposed on the fifth image (1750) together with the fifth image (1750). Within the editing screen, the electronic device (101) may display a visual object (1755) corresponding to the widget object together with the fifth image (1750). Using the visual object (1755), the electronic device (101) may display characters within the widget object within the editing screen, having heights extended along the outline of the background area, within a background area different from the foreground area (1752) of the fifth image (1750).

[0180] FIG. 18 illustrates the operation of an electronic device (101) that changes the size of characters included in a widget object (1810). The electronic device (101) and / or processor (210) of FIG. 1 and 2 may perform the operation of the electronic device (101) described with reference to FIG. 18. With reference to FIG. 18, an embodiment of an electronic device (101) that displays a cover screen (or lock screen) including an image and a widget object (1810) is illustrated.

[0181] Referring to FIG. 18, a widget object (1810) may include characters that are extended so as not to overlap with the foreground area (1820) of the image. The characters may include numbers representing the current time. Characters placed in a background area of ​​the image different from the foreground area (1820) may be spaced apart. The characters included in the widget object (1810) may have a minimum height (1830). Referring to FIG. 18, a widget object (1810) including characters having heights exceeding the minimum height (1830) is illustrated as an example. Characters within the widget object (1810) may have heights greater than the minimum height (1830). Characters within the widget object (1810) may have increased heights to fill the background area of ​​the image different from the foreground area (1820). Referring to FIG. 18, the height of the character having the longest height within the widget object (1810) may be a combination of the minimum height (1830) and the height (1840).

[0182] In one embodiment, the maximum height of the characters included in the widget object (1810) may be set to a specified percentage (e.g., about 60%) of the total height of the screen. That is, the characters included in the widget object (1810) may extend to a height less than or equal to the maximum height, even if the foreground area (1820) does not exist or is reduced.

[0183] FIG. 19 illustrates examples of layouts of widget objects (150) displayed by an electronic device (101) according to one embodiment. The electronic device (101) and / or processor (210) of FIG. 1 and 2 may perform the operation of the electronic device (101) described with reference to FIG. 19. An electronic device (101) having the form factor of a foldable mobile phone (292) of FIG. 2 is illustrated, but embodiments are not limited thereto.

[0184] Referring to FIG. 19, different states (1901, 1902) of a widget object (150) are illustrated. The states (1901, 1902) of the widget object (150) may be associated with a format representing time. The format may be associated with an option and / or setting value associated with the widget object (150) (e.g., a setting value entered by a user based on a settings menu and / or a settings application).

[0185] Referring to the state (1901) of FIG. 19, when configured to display time based on a 24-hour format, the electronic device (101) can display the current time using two characters (151, 152). For example, if the current time is between 1 and 9 o'clock, the electronic device (101) can display “01” to “09”.

[0186] Referring to the state (1902) of FIG. 19, when configured to display time based on a 12-hour format, the electronic device (101) may display the current time using a variable number of characters. For example, if the current time is from 1 to 9 o'clock, the electronic device (101) may display “1” through “9”. Referring to the state (1902) of FIG. 19, when displaying “1” through “9” to display the current time, the electronic device (101) may display the current time using only the character (152) without the character (151). Within the state (1902) of FIG. 19, the electronic device (101) may (further) display text indicating AM or PM along with the characters (152, 153, 154, 155). In all of the states (1901, 1902) of FIG. 19, characters within the widget object (150) can be displayed using the same reference axis.

[0187] FIG. 20 illustrates an exemplary operation of an electronic device (101) that changes the layout of a time-representing widget object (e.g., widget objects (2010, 2030)) according to another widget object (e.g., widget objects (2020, 2040)). The electronic device (101) and / or processor (210) of FIG. 1 and 2 may perform the operation of the electronic device (101) described with reference to FIG. 20. An electronic device (101) having the form factor of a foldable mobile phone (292) of FIG. 2 is illustrated, but embodiments are not limited thereto.

[0188] Referring to FIG. 20, exemplary states (2001, 2002) of an electronic device (101) displaying a cover screen including a widget object (2010) are illustrated. The electronic device (101) may display a widget object (2010) including characters having independently determined heights within a background area of ​​an image, based on the operation described with reference to FIGS. 1 through 19. The heights of the characters included in the widget object (2010) may change (dynamically) depending on the background area as well as other objects (e.g., widget object (2020)) displayed together with the widget object (2010).

[0189] For example, referring to the states (2001, 2002) of FIG. 20, the electronic device (101) may display a widget object (2020) for a specific function (e.g., a function for running a camera application). In the state (2001) of displaying the widget object (2020), the electronic device (101) may display the widget object (2020) together with a widget object (2010) having a height (h1). The widget object (2020) may be placed below the widget object (2010). The widget object (2020) may be set to disappear from the display depending on the state of the electronic device (101) (e.g., a state referred to as AOD (always-on-display)). Referring to state (2002) of FIG. 20, when a widget object (2020) disappears from the cover screen (e.g., when it is determined that a condition for hiding the widget object (2020) is satisfied), the electronic device (101) may display a widget object (2010) having a height (h2) that exceeds a height (h1). Referring to states (2001, 2002) of FIG. 20, the widget object (2010) having an increased height (h2) may occupy a portion of the display where the widget object (2020) was displayed.

[0190] For example, referring to the states (2003, 2004) of FIG. 20, the electronic device (101) may display a widget object (2040) for a specific function (e.g., a function for executing a software application referred to as a Now-Brief). The widget object (2040) may include natural language sentences based on artificial intelligence (e.g., greetings such as “Good morning” as well as suggestions such as “Let’s sleep”). The widget object (2040) may be referred to as a “Now Bar.” In the state (2003) of displaying the widget object (2040), the electronic device (101) may display a widget object (2030) having a height (h3) on top of the widget object (2040). The widget object (2040) may be displayed or disappear depending on user input and / or time. Referring to the state (2004) of FIG. 20, when the widget object (2040) is not displayed, the electronic device (101) may display a widget object (2030) having a height (h4) that exceeds the height (h3). Referring to the states (2003, 2004) of FIG. 20, the widget object (2030) having the increased height (h4) may occupy a portion of the display where the widget object (2040) was displayed.

[0191] In one embodiment, the electronic device (101) may provide a continuous (or uninterrupted) transition (e.g., an animation-based transition) between states (2003, 2004). For example, if it is decided to display a widget object (2040) within state (2004), the electronic device (101) may gradually reduce the height (h4) of the widget object (2030). While the widget object (2030) is gradually reduced, the electronic device (101) may begin to display the widget object (2040). For example, the widget object (2040) may also gradually increase in size or gradually move toward the position of the widget object (2040) within state (2003).

[0192] FIG. 21 illustrates an exemplary operation of an electronic device (101) that changes the thickness and / or color of character(s) included in a widget object (2100). The electronic device (101) and / or processor (210) of FIG. 1 and 2 may perform the operation of the electronic device (101) described with reference to FIG. 21. An electronic device (101) having the form factor of a foldable mobile phone (292) of FIG. 2 is illustrated, but embodiments are not limited thereto.

[0193] In one embodiment, the electronic device (101) may determine or change the attributes (e.g., thickness, size, height, width, and / or color) of the characters included in the widget object (2100) using the color of the image over which the widget object (2100) is superimposed. For example, the electronic device (101) may determine the thicknesses and / or colors of the characters within the widget object (2100) based on the color of the background area of ​​the image. Referring to FIG. 21, cover screens (2101, 2102, 2103, 2104) including a widget object (2100) having different shapes depending on the image and / or position within the image are shown. Referring to the cover screens (2101, 2102), the electronic device (101) may determine the attributes of the characters included in the widget object (2100) based on the position of the widget object (2100) within the image. For example, depending on the color of the portion of the image superimposed with the widget object (2100), the electronic device (101) may determine the colors and / or thicknesses of the characters included in the widget object (2100). In the above example, the electronic device (101) may change or determine the heights of the characters within the widget object (2100) individually (or independently) based on the operation described above with reference to FIGS. 1 to 20.

[0194] Referring to the exemplary cover screens (2103, 2104) of FIG. 21, the electronic device (101) can determine the colors and / or thicknesses of the characters of the widget object (2100) within the image. In one embodiment, the electronic device (101) may include an illuminance sensor. The electronic device (101) can obtain or identify information about ambient light (e.g., illuminance data) using the illuminance sensor. Using said information, the electronic device (101) can determine the thicknesses and / or colors of the characters of the widget object (2100). For example, to reduce and / or prevent glare caused by the characters of the widget object (2100), the electronic device (101) can determine or change the thicknesses and / or colors of the characters of the widget object (2100) using said illuminance data.

[0195] In one embodiment, the electronic device (101) may determine the color of the characters of the widget object (2100) as the complementary color of the color of the background area of ​​the image in order to visually highlight the widget object (2100) with respect to the image. The embodiment is not limited thereto, and the electronic device (101) may change or determine the color of the characters of the widget object (2100) according to the current time of the electronic device (101). For example, the electronic device (101) may determine the color and / or thickness of the characters of the widget object (2100) using the current time of the electronic device (101), the color of the background area of ​​the image where the widget object (2100) is located (e.g., the primary color), and / or illuminance data.

[0196] FIGS. 22a, FIGS. 22b, FIGS. 22c, and FIGS. 22d illustrate the operation of an electronic device (101) that provides animation for a widget object. The electronic device (101) and / or processor (210) of FIGS. 1 and 2 may perform the operation of the electronic device (101) described with reference to FIGS. 22a through 22d. An electronic device (101) having the form factor of a foldable mobile phone (292) of FIG. 2 is illustrated, but embodiments are not limited thereto.

[0197] In one embodiment, the electronic device (101) may display an AOD screen depending on whether the AOD function is enabled. The AOD function may be defined to continuously display minimal information, such as the current time, on the display in order to reduce the frequency with which the electronic device (101) switches to an active state. The screen defined to continuously display the minimal information may be referred to as the AOD screen. While displaying the AOD screen, the electronic device (101) may enter a low-power state. In the low-power state, the processor (e.g., the processor (210) of FIG. 2) may be turned off at least temporarily (or periodically).

[0198] Referring to FIG. 22a, a state (2201) of an electronic device (101) that displays an AOD screen is shown. The state (2201) of the electronic device (101) that displays an AOD screen may be included in a low-power state (or low-power mode) of the electronic device (101). In the state (2201), the electronic device (101) may display a widget object (2210) representing the current time, along with at least a portion of an image set to be displayed on a cover screen (or lock screen). Referring to FIG. 22a, the widget object (2210) may include characters having a basic height (or basic size). In other words, in the state (2201), the electronic device (101) may display a widget object (2210) including characters having the same size.

[0199] In state (2201), the electronic device (101) may receive user input to change the mode of the electronic device (101) from a mode that displays an AOD screen. The user input may be detected by a gesture of pressing a button exposed through the housing of the electronic device (101) (e.g., a power button, a button for volume control, and / or a button mapped to one or more designated functions). The user input may be detected by a gesture of tapping the display of the electronic device (101). The user input may be detected by a utterance containing a designated keyword. The user input may be detected by an action of moving or / or rotating the electronic device (101). Based on the user input, the electronic device (101) may switch from a mode for displaying an AOD screen to another mode (e.g., a mode for displaying a cover screen).

[0200] Referring to FIG. 22a, within a state (2201) included in a mode for displaying an AOD screen, the electronic device (101) may switch to a state (2202) in response to user input for changing the mode of the electronic device (101). The state (2202) may be a mode for displaying a cover screen (or lock screen). The cover screen displayed within the state (2202) may include a layout determined based on the operation described with reference to FIG. 1 through FIG. 21. For example, within the state (2202), the electronic device (101) may display a widget object (2210) containing characters that are located in a background area of ​​an image different from the foreground area (2220) of the image and have sizes (or heights) that extend toward the outline of the background area. For example, when receiving user input while displaying an image and widget object (2210) within an AOD screen, the electronic device (101) may change (e.g., increase or decrease) the height of at least one character among the characters included in the widget object (2210). The change may be performed gradually (e.g., animation) while changing from state (2201) to state (2202). The change is described with reference to FIG. 22b.

[0201] The embodiments are not limited thereto, and the electronic device (101) may switch from state (2202) to state (2201) as it is determined that a condition for displaying an AOD screen within state (2202) (e.g., when user input for displaying an AOD screen is received, or when no user input is received for a specified period within state (2202)) is satisfied. While changing from state (2202) to state (2201), the electronic device (101) may change (e.g., increase or decrease) the height of at least one character among the characters included in the widget object (2210).

[0202] Referring to FIG. 22b, cover screens displayed by the electronic device (101) during the transition from state (2201) of FIG. 22a to state (2202) are illustrated as examples. Referring to FIG. 22b, at time t1, the electronic device (101) can display an AOD screen based on state (2201). Referring to FIG. 22b, from time t1 to time t2, the electronic device (101) can (gradually) increase the heights of the characters contained in the widget object (2210). At time t2, the electronic device (101) can display a widget object (2210) containing characters having a maximum height based on state (2203). In state (2203), the characters within the widget object (2210) may have a maximum height in a background area different from the foreground area (2220). From time t2 to time t3, the electronic device (101) can (gradually) reduce the heights of the characters contained in the widget object (2210). For example, at time t3, the electronic device (101) can display the widget object (2210) based on the state (2202).

[0203] Referring to FIG. 22c, the electronic device (101) may include a camera that is at least partially visible through a hole in the display (110). Referring to FIG. 22c, an embodiment of the electronic device (101) is illustrated, comprising cameras superimposed on each of two holes. The electronic device (101) may provide an animation such as a widget object (2230) being extracted from in-screen regions (2235) corresponding to the holes.

[0204] Referring to FIG. 22c, at time t1, the electronic device (101) may display a cover screen (or lock screen) containing only an image. The screen displayed at time t1 may be an AOD screen. At time t1, the electronic device (101) may receive user input (or wake-up input for the electronic device (101)) to display a widget object (2230). Based on the user input, the electronic device (101) may play an animation in which the characters of the widget object (2230) are progressively moved from areas (2235) up to time t5. Based on the user input, the electronic device (101) may progressively increase the heights of the characters of the widget object (2230) up to time t5. Referring to FIG. 22c, within the time interval between time t1 and time t5, the widths of the characters of the widget object (2230) may be maintained, and the heights of the characters of the widget object (2230) may be gradually increased. The embodiment is not limited thereto.

[0205] Referring to FIG. 22d, a state (2204) of an electronic device (101) displaying an AOD screen and a state (2205) of an electronic device (101) displaying a cover screen are illustrated. In state (2204), the electronic device (101) may display a widget object (2241) containing characters having specified heights (or specified sizes). An exemplary state (2204) is illustrated in which the width of the widget object (2241) corresponds to the width of the display (or the display area of ​​said display) of the electronic device (101), but the embodiment is not limited thereto. In state (2204), the electronic device (101) may receive user input to change the mode of the electronic device (101). In response to said user input, the electronic device (101) may switch from state (2204) to state (2205). In state (2205), the electronic device (101) may display a widget object (2251) containing characters arranged so as not to overlap with the foreground area (2252) of the image. While transitioning from state (2204) to state (2205), the electronic device (101) may play visual effects and / or animations, such as changing a widget object (2241) to a widget object (2251).

[0206] FIGS. 23a and 23b illustrate the operation of an electronic device (101) that provides animation for a widget object (e.g., widget objects (2310, 2320)). The electronic device (101) and / or processor (210) of FIGS. 1 and 2 may perform the operation of the electronic device (101) described with reference to FIGS. 23a and 23b. An electronic device (101) having the form factor of a foldable mobile phone (292) of FIG. 2 is illustrated, but embodiments are not limited thereto.

[0207] Referring to FIG. 23a, different states (2301, 2302, 2303) of a cover screen displayed on a display (110) are illustrated. For example, an electronic device (101) may periodically and / or repeatedly move a widget object (2310) within the cover screen based on identifying a specified event, such as an alarm. For example, referring to state (2301) of FIG. 23a, the electronic device (101) may display the widget object (2310) at the left edge of the cover screen at time t1. At time t2, after time t1, the electronic device (101) may display the widget object (2310) at a position adjacent to the center of the cover screen, as in state (2302). At time t3, after time t2, the electronic device (101) may display the widget object (2310) at the right edge of the cover screen, as in state (2303).

[0208] Comparing the time points t1, t2, and t3 of FIG. 23a, the widget object (2310) may be progressively moved from the left edge of the cover screen to the right edge. After time point t3, the widget object (2310) may be moved back from the right edge to the left edge. The embodiment is not limited thereto, but at time point t3, the electronic device (101) may switch to state (2301) to (repeatedly) play an animation of the widget object (2310) moving from the left edge to the right edge of the cover screen. While moving from the left edge to the right edge of the cover screen, the characters of the widget object (2310) may not (continuously) overlap (or may be separated) from the foreground area (2312) within the image.

[0209] Referring to FIG. 23b, different states (2304, 2305, 2306) of a cover screen displayed on a display (110) are illustrated. For example, the electronic device (101) may dynamically change the characters of a widget object (2320) included in the cover screen based on identifying a designated event, such as an alarm. For example, referring to state (2304) of FIG. 23b, the electronic device (101) may display all the characters of the widget object (2320) according to a first thickness at time t1. At time t2 after time t1, the electronic device (101) may change the thickness of a first part of the characters of the widget object (2320) (e.g., “36”) among the characters representing “09:36”) to a second thickness different from the first thickness (e.g., a second thickness exceeding the first thickness), as in state (2305). In state (2305), the electronic device (101) can display a second part of the characters of the widget object (2320) (e.g., “09:”) based on the first thickness (continued). At time t3 after time t2, the electronic device (101) can display all the characters of the widget object (2320) according to the second thickness, as in state (2306).

[0210] Comparing time points t1, t2, and t3, the thicknesses of the characters within the widget object (2320) may increase sequentially starting from the rightmost character (e.g., “6”). After time point t3, the electronic device (101) may restore the thickness of the second part of the characters of the widget object (2320) to the first thickness while maintaining the thickness of the first part of the characters of the widget object (2320) at the second thickness, as in state (2305). The embodiment is not limited thereto, and after time point t3, the electronic device (101) may restore, change, or reset all the thicknesses of the characters of the widget object (2320) to the first thickness, as in state (2304).

[0211] As described above, according to one embodiment, the electronic device (101) can apply visual effects and / or animations to characters within a widget object (2320) to notify of events such as alarms. The operation of determining the heights of characters within the widget object (2320) is not limited to the cover screen (or lock screen). Hereinafter, with reference to FIG. 24, an exemplary operation of the electronic device (101) changing the heights of characters within the widget object (2320) on a different screen from the cover screen (e.g., a home screen referred to as a launcher screen) is described.

[0212] FIG. 24 illustrates the operation of an electronic device (101) that changes the layout of characters within a widget object (e.g., widget objects (2410, 2420, 2430, 2440, 2450)) displayed through a home screen. The electronic device (101) and / or processor (210) of FIG. 1 and 2 may perform the operation of the electronic device (101) described with reference to FIG. 24. With reference to FIG. 2, a bar-shaped mobile phone (291) is illustrated, but embodiments are not limited thereto.

[0213] Referring to FIG. 24, an exemplary state of an electronic device (101) displaying a home screen is illustrated. The home screen may be referred to as a launcher screen. An exemplary home screen including widget objects (2410, 2420, 2430, 2440, 2450) is illustrated, but the layout of the home screen is not limited thereto.

[0214] In one embodiment, the electronic device (101) may display a widget object (2410) containing characters having variable heights. The heights of the characters included in the widget object (2410) may be independently determined based on the operation described above with reference to FIGS. 1 to 23b. In one embodiment, within a home screen including a background image, the electronic device (101) may display a widget object (2410) containing characters having independently determined heights within a background area different from the foreground area of ​​the background image.

[0215] Referring to the widget object (2450) of FIG. 24, the electronic device (101) can independently change the heights of the characters (2455) based on the positional relationship between the image and the characters (2455) included in the widget object (2450). For example, within the background area of ​​the image included in the widget object (2450), the electronic device (101) can change (e.g., increase) the heights of the characters (2455) so that the characters (2455) face the outline of the background area.

[0216] FIG. 25 illustrates characters displayed by an electronic device according to one embodiment, according to sizes. The electronic device (101) and / or processor (210) of FIG. 1 and 2 can perform the operation of the electronic device described with reference to FIG. 25.

[0217] Referring to FIG. 25, a first set (2510) of characters having a first height and a second set (2520) of characters having a second height greater than the first height are illustrated. Numbers 0 through 9 and symbols such as a colon (:) are illustrated as examples, but the characters that can be displayed along the first height or the second height are not limited to the characters illustrated in FIG. 25. As described in other drawings including FIG. 26, the heights of characters that an electronic device can display are also not limited to the first height and / or the second height.

[0218] Referring to FIG. 25, the electronic device may have parts marked with dots in the characters of the second set (2520) that are extendable sections (or extendable parts) of the characters. In other words, the remaining parts of the parts marked with dots in the characters of the second set (2520) may be non-extendable sections (or non-extendable parts) of the characters. For example, the electronic device may change the heights of the characters by changing (e.g., extending or shrinking) the parts marked with dots in the characters of the second set (2520) at a faster rate than the remaining parts. For example, the electronic device may shrink the extendable section of the corresponding character in the second set (2520) and maintain the non-extendable section to obtain or display the character included in the first set (2510). Similarly, to display a character of a height exceeding the second height, the electronic device may extend the extendable section of the character in the second set (2520) and maintain the non-extendable section.

[0219] In one embodiment, vector graphic information (or vector graphic file) representing characters (e.g., characters of a first set (2510) and / or a second set (2520)) may be stored in an electronic device. The vector graphic information may include information about characters of a specific size (e.g., a specific width and / or a specific height) and about extensible sections (and / or non-extensible sections) of said characters. The electronic device may use said vector graphic information to change (e.g., extend or reduce) the heights of the characters as described with reference to FIGS. 1 through 24.

[0220] In one embodiment, font files distinguished by various attributes (e.g., height, width, and / or thickness) may be stored in an electronic device. The electronic device may identify, among the font files, a font file corresponding to the size of a character as described with reference to FIGS. 1 to 24. The electronic device may use the identified font file to display a character having a size determined by the operation described with reference to FIGS. 1 to 24.

[0221] Below, with reference to FIG. 26, characters displayed by each of the font files stored in the electronic device are illustrated.

[0222] FIG. 26 illustrates characters displayed by an electronic device according to one embodiment, according to thickness and / or size. Referring to FIG. 26, characters having a variable height (or size) are illustrated by an electronic device that performs the operation described with reference to FIG. 1 to FIG. 25.

[0223] Referring to FIG. 26, examples of the characters “00:88” displayed by an electronic device are illustrated. Based on the operation described with reference to FIGS. 1 through 25, the electronic device may change the height and / or thickness of the characters so that the background area of ​​the image displayed with the characters is filled. Referring to FIG. 26, a diagram (2600) arranged according to height (x-axis) and thickness (y-axis) is illustrated, showing examples of characters displayed by the electronic device based on the above operation. An embodiment in which the shape of the characters is determined according to 10 height levels and 15 thickness levels is illustrated, but the embodiment is not limited thereto. For example, the electronic device may display characters according to up to 1000 height levels and / or thickness levels.

[0224] In one embodiment, font files for displaying characters corresponding to each of the height levels and / or thickness levels may be stored in an electronic device. For example, a first font file for displaying a character (2610) of a first height level and a first thickness level may be stored in an electronic device. For example, a second font file for displaying a character (2620) of a tenth height level and a first thickness level may be stored in an electronic device. For example, a third font file for displaying a character (2630) of a first height level and a fifteenth thickness level may be stored in an electronic device. For example, a fourth font file for displaying a character (2640) of a tenth height level and a fifteenth thickness level may be stored. In one embodiment where the shape of the character is determined according to ten height levels and fifteen thickness levels, 150 font files may be stored in an electronic device. Among 150 font files, the electronic device can display characters of a widget object using a font file corresponding to the stored height and / or thickness based on the operation described with reference to FIGS. 1 to 25. Since the height and / or thickness of the characters of the widget object are determined independently, different font files can be applied to each of the characters of the widget object.

[0225] Below, with reference to FIGS. 27 and FIGS. 28, the shapes of the characters (2610, 2620, 2630, 2640) shown in FIGS. 26 are described.

[0226] FIG. 27 illustrates characters displayed by an electronic device according to one embodiment, according to thickness. The electronic device (101) and / or processor (210) of FIG. 1 and 2 can perform the operation of the electronic device described with reference to FIG. 27.

[0227] Referring to FIG. 27, among characters (2610, 2630) having the same height (e.g., a first height level) and different thicknesses, characters (2710, 2720) corresponding to “6” are shown. For example, the character (2710) may have a first height level and a first thickness level. For example, the character (2720) may have a first height level and a fifteenth thickness level. Referring to FIG. 27, a dashed-line curve representing the shape of the character (2720) may be shown superimposed on the character (2710). Characters (2710, 2720) having different thicknesses may have the same curvature and / or the same style so that they can be recognized by the user as the same typeface.

[0228] FIG. 28 illustrates characters displayed by an electronic device according to one embodiment, according to size. The electronic device (101) and / or processor (210) of FIG. 1 and 2 can perform the operation of the electronic device described with reference to FIG. 28.

[0229] Referring to FIG. 28, among characters (2630, 2640) having different heights and the same thickness level (e.g., a 15th thickness level), characters (2820, 2830) corresponding to “6” are shown. For example, the character (2820) may have a 1st height level and a 15th thickness level. For example, the character (2830) may have a 10th height level and a 15th thickness level.

[0230] Referring to FIG. 28, a character (2820) may include extendable parts (2821, 2822, 2823, 2824) indicated by a dot pattern. With a vector graphic representing the character (2820) identified, an electronic device may extend the extendable parts (2821, 2822, 2823, 2824) of the character (2820) to obtain or display a character (e.g., character (2830)) of a specific height level (e.g., a tenth height level). If characters (2820, 2830) having different height levels are defined by different font files, the characters (2820, 2830) represented by the font files may have an extended or reduced form based on the extension of the extendable parts (2821, 2822, 2823, 2824).

[0231] In one embodiment, the extensible parts (2821, 2822, 2823, 2824) may be extended proportionally according to a height determined by the electronic device. For example, the electronic device, which determines to double the height of a character (2820) based on the operation described with reference to FIGS. 1 through 27, may extend the extensible parts (2821, 2822, 2823, 2824) evenly to obtain or display a character having double the height. The embodiments are not limited thereto, and the electronic device may extend or reduce certain parts among the extensible parts (2821, 2822, 2823, 2824) differently from other parts.

[0232] For example, depending on the decision of the electronic device to extend the character (2820), among the extendable parts (2821, 2822, 2823, 2824), the parts (2823, 2824) located at the bottom of the character may be extended faster than the remaining parts (2821, 2822). In this case, the character (2820) may be extended such that the bottom part of the character (2820) has a longer shape than the top part of the character.

[0233] As described above, an electronic device according to one embodiment can dynamically change (e.g., extend or contract) the sizes of the characters of a widget object. For example, a first character among the characters may have a first height, and a second character among the characters may have a second height. The first height and the second height may be related to the shape of the background area overlapping with the characters. For example, the first height may be determined such that a first character located in a first part of the background area fills the first part. For example, the second height may be determined such that a second character located in a second part of the background area fills the second part. In other words, the electronic device may display characters that are extended or contracted to fill the background area.

[0234] Below, with reference to FIG. 29, an exemplary hardware configuration of the electronic device (101) of FIG. 1 and / or FIG. 2 is described.

[0235] FIG. 29 is a block diagram of an electronic device (2901) in a network environment (2900) according to various embodiments. Referring to FIG. 29, in the network environment (2900), the electronic device (2901) may communicate with an electronic device (2902) through a first network (2998) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (2904) or a server (2908) through a second network (2999) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (2901) may communicate with the electronic device (2904) through a server (2908). According to one embodiment, the electronic device (2901) may include a processor (2920), memory (2930), input module (2950), sound output module (2955), display module (2960), audio module (2970), sensor module (2976), interface (2977), connection terminal (2978), haptic module (2979), camera module (2980), power management module (2988), battery (2989), communication module (2990), subscriber identification module (2996), or antenna module (2997). In some embodiments, at least one of these components (e.g., connection terminal (2978)) may be omitted from the electronic device (2901), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (2976), camera module (2980), or antenna module (2997)) may be integrated into a single component (e.g., display module (2960)).

[0236] The processor (2920) can, for example, execute software (e.g., program (2940)) to control at least one other component (e.g., hardware or software component) of the electronic device (2901) connected to the processor (2920) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (2920) can store commands or data received from other components (e.g., sensor module (2976) or communication module (2990)) in volatile memory (2932), process the commands or data stored in volatile memory (2932), and store the resulting data in non-volatile memory (2934). According to one embodiment, the processor (2920) may include a main processor (2921) (e.g., a central processing unit or an application processor) or an auxiliary processor (2923) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (2901) includes a main processor (2921) and an auxiliary processor (2923), the auxiliary processor (2923) may be configured to use less power than the main processor (2921) or to be specialized for a specified function. The auxiliary processor (2923) may be implemented separately from the main processor (2921) or as part thereof.

[0237] The auxiliary processor (2923) may control at least some of the functions or states associated with at least one component of the electronic device (2901) (e.g., display module (2960), sensor module (2976), or communication module (2990)) on behalf of the main processor (2921) while the main processor (2921) is in an inactive (e.g., sleep) state, or together with the main processor (2921) while the main processor (2921) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (2923) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (2980) or communication module (2990)). According to one embodiment, the auxiliary processor (2923) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (2901) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (2908)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0238] The memory (2930) can store various data used by at least one component of the electronic device (2901) (e.g., processor (2920) or sensor module (2976)). The data may include, for example, software (e.g., program (2940)) and input or output data for related commands. The memory (2930) may include volatile memory (2932) or non-volatile memory (2934).

[0239] The program (2940) may be stored as software in memory (2930) and may include, for example, an operating system (2942), middleware (2944), or an application (2946).

[0240] The input module (2950) can receive commands or data to be used for a component of the electronic device (2901) (e.g., processor (2920)) from outside the electronic device (2901) (e.g., user). The input module (2950) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0241] The sound output module (2955) can output a sound signal to the outside of the electronic device (2901). The sound output module (2955) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0242] The display module (2960) can visually provide information to an external (e.g., user) of the electronic device (2901). The display module (2960) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (2960) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0243] The audio module (2970) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (2970) can acquire sound through the input module (2950) or output sound through the sound output module (2955) or an external electronic device (e.g., electronic device (2902)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (2901).

[0244] The sensor module (2976) can detect the operating state of the electronic device (2901) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (2976) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0245] The interface (2977) may support one or more specified protocols that can be used for the electronic device (2901) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (2902)). According to one embodiment, the interface (2977) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0246] The connection terminal (2978) may include a connector through which the electronic device (2901) can be physically connected to an external electronic device (e.g., electronic device (2902)). According to one embodiment, the connection terminal (2978) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0247] The haptic module (2979) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (2979) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0248] The camera module (2980) can capture still images and video. According to one embodiment, the camera module (2980) may include one or more lenses, image sensors, image signal processors, or flashes.

[0249] The power management module (2988) can manage the power supplied to the electronic device (2901). According to one embodiment, the power management module (2988) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0250] The battery (2989) can supply power to at least one component of the electronic device (2901). According to one embodiment, the battery (2989) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0251] The communication module (2990) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (2901) and an external electronic device (e.g., electronic device (2902), electronic device (2904), or server (2908)), and the performance of communication through the established communication channel. The communication module (2990) may include one or more communication processors that operate independently of the processor (2920) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (2990) may include a wireless communication module (2992) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (2994) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (2904) via a first network (2998) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (2999) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (2992) can identify or authenticate the electronic device (2901) within a communication network such as the first network (2998) or the second network (2999) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (2996).

[0252] The wireless communication module (2992) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (2992) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (2992) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (2992) can support various requirements specified in the electronic device (2901), external electronic device (e.g., electronic device (2904)), or network system (e.g., second network (2999)). According to one embodiment, the wireless communication module (2992) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0253] An antenna module (2997) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (2997) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (2997) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (2998) or a second network (2999), may be selected from the plurality of antennas, for example, by a communication module (2990). A signal or power may be transmitted or received between the communication module (2990) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (2997).

[0254] According to various embodiments, the antenna module (2997) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0255] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0256] According to one embodiment, commands or data may be transmitted or received between the electronic device (2901) and an external electronic device (2904) through a server (2908) connected to a second network (2999). Each of the external electronic devices (2902, or 704) may be the same or a different type of device as the electronic device (2901). According to one embodiment, all or part of the operations performed on the electronic device (2901) may be performed on one or more of the external electronic devices (2902, 2904, or 2908). For example, if the electronic device (2901) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (2901) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (2901). The electronic device (2901) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (2901) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (2904) may include an Internet of Things (IoT) device. The server (2908) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (2904) or server (2908) may be included within the second network (2999). The electronic device (2901) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0257] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0258] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0259] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware and may be used interchangeably with terms such as logic, block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0260] Various embodiments of the present document may be implemented as software (e.g., program (2940)) comprising one or more instructions stored in a storage medium (e.g., internal memory (2936) or external memory (2938)) readable by a machine (e.g., electronic device (2901)). For example, a processor (e.g., processor (2920)) of the machine (e.g., electronic device (2901)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0261] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0262] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0263] FIGS. 30a and / or FIGS. 30b illustrates exemplary states (3001, 3002, 3003, 3004) of an electronic device displaying a widget object (3010). The electronic device (101) and / or processor (210) of FIGS. 1 and 2 may perform the operation of the electronic device (101) described with reference to FIGS. 30a and / or FIGS. 30b.

[0264] Referring to FIG. 30a, a widget object (3010) may include characters located within a background area different from the foreground area (3090) based on the operation described with reference to FIGS. 1 through 29. While displaying a lock screen containing the widget object (3010), the electronic device (101) may identify a notification message. The notification message may be generated based on SMS (short message service), IM (instant messaging), push notifications, and / or the execution of a software application in a background state. Based on identifying the notification message, the electronic device (101) may display a UI object based on the notification message within the lock screen.

[0265] In the exemplary state (3001) of FIG. 30a, the electronic device (101) may display a UI object (3012) corresponding to a notification message. When the UI object (3012) is added to the screen (e.g., the lock screen displayed in state (3001)), the position of the foreground area (3090) may be adjusted. For example, in the exemplary state (3001) of FIG. 30a, the foreground area (3090) may be moved downward along the vertical direction. The UI object (3012) may be positioned on the reference axis (R). The reference axis (R) may correspond to the bottom of the widget object (3010).

[0266] In one embodiment, one or more notification messages may be identified. When additional notification messages are identified, the electronic device (101) may move the foreground area (3090). For example, the foreground area (3090) may be moved so that the foreground area (3090) is not obscured by a plurality of notification messages (or UI objects corresponding to each of the plurality of notification messages). Referring to the states (3001, 3002) of FIG. 30a, the notification messages may be stacked with respect to the reference axis (R). For example, while displaying a UI object (3012) corresponding to a first notification message, the electronic device (101) that identifies a second notification message may display a UI object (3023) corresponding to the second notification message below the UI object (3012). To prevent the foreground area (3090) from being obscured by UI objects (3012, 3023), the electronic device (101) can move the foreground area (3090) (e.g., move it down along the vertical direction).

[0267] Because the display of the electronic device (101) has a limited size, when UI objects (3012, 3023) corresponding to notification messages are displayed below the reference axis (R), the foreground area (3090) may be obscured by the additional UI objects. According to one embodiment, the electronic device (101) may display UI objects above the reference axis (R) so that the foreground area (3090) is not obscured. Referring to the state (3003) of FIG. 30b, when UI objects (3012, 3023, 3024) corresponding to each of the three notification messages are displayed below the reference axis (R), the foreground area (3090) may be obscured by at least one of the UI objects (3012, 3023, 3024) (e.g., the UI object (3024) located at the very bottom).

[0268] Referring to FIG. 30b, the electronic device (101) can determine the positions of UI objects (3012, 3023, 3024) so ​​that the foreground area (3090) is not obscured by at least one of the UI objects (3012, 3023, 3024). For example, the electronic device (101) can sequentially display the UI objects (3012, 3023, 3024) on the foreground area (3090). For example, if the height below the reference axis (R) is less than the sum of the heights of the UI objects (3012, 3023, 3024) and the height of the foreground area (3090), the electronic device (101) can display the UI objects (3012, 3023, 3024) so ​​that at least one of the UI objects (3012, 3023, 3024) is displayed above the reference axis (R). The electronic device (101) can reduce the heights of the characters of the widget object (3010) so that the widget object (3010) is not obscured by at least one of the UI objects (3012, 3023, 3024).

[0269] After the state (3003) of FIG. 30b, as the number of notification messages to be displayed on the lock screen increases, the heights of the characters of the widget object (3010) may continue to decrease. Within the state (3004) of FIG. 30b, while displaying a specified number (e.g., 4) of UI objects (3012, 3023, 3024, 3025), the heights of the characters of the widget object (3010) may decrease to a minimum height. After the state (3004), additionally identified notification messages may be placed below the UI object (3025) within the scrollable area where the UI objects (3012, 3023, 3024, 3025) are located.

[0270] Although an embodiment in which UI objects (3012, 3023, 3024, 3025) are stacked according to the chronological order in which the notification messages were identified has been described, the embodiment is not limited thereto. For example, the electronic device (101) may display UI objects (3012, 3023, 3024, 3025) according to the reverse chronological order in which the notification messages were identified (e.g., newest first).

[0271] FIG. 31 illustrates exemplary states (3101, 3102) of an electronic device (101) displaying a widget object (3110). The electronic device (101) and / or processor (210) of FIG. 1 and 2 can perform the operation of the electronic device (101) described with reference to FIG. 31.

[0272] Referring to FIG. 31, the electronic device (101) can display a widget object (3110) having a shape determined based on the recognition of the foreground area (3190). The electronic device (101) can determine the heights of the characters included in the widget object (3110) based on the operation described with reference to FIGS. 1 through 29, FIG. 30a and / or FIG. 30b. Referring to FIG. 31, while displaying the widget object (3110), the electronic device (101) can identify a notification message. In the state of identifying the first notification message (3101), the electronic device (101) can display a UI object (3112) corresponding to the first notification message within the background area above the foreground area (3190). To prevent the UI object (3112) from obscuring the widget object (3110), the electronic device (101) can reduce the height of the widget object (3110).

[0273] Referring to FIG. 31, within the state (3102) after identifying the first notification message, the electronic device (101) can identify a second notification message. When the second notification message is identified, the electronic device (101) can display a UI object (3123) corresponding to the second notification message below the UI object (3112) corresponding to the first notification message. The UI objects (3112, 3123) can be positioned within the background area above the foreground area (3190). For example, the electronic device (101) can move the position of the UI object (3112) upward along the vertical direction of the display. The electronic device (101) can display the UI object (3123) between the foreground area (3190) and the moved UI object (3112). To prevent the widget object (3110) from being obscured by a UI object (3112) moving along the vertical direction of the display, the electronic device (101) can reduce the height of the widget object (3110) (e.g., the heights of characters within the widget object (3110)). When notification messages continue to occur, UI objects corresponding to the notification messages can continue to be stacked (or accumulated) on the foreground area (3190). As UI objects are stacked, the electronic device (101) can reduce the height of the widget object (3110).

[0274] FIG. 32 illustrates exemplary states (3201, 3202) of an electronic device displaying a widget object (3210). The electronic device (101) and / or processor (210) of FIG. 1 and 2 can perform the operation of the electronic device (101) described with reference to FIG. 32.

[0275] Referring to FIG. 32, the electronic device (101) can display a widget object (3210) including characters having a shape that extends toward the boundary of the foreground area (3290). The widget object (3210) can be displayed based on the operation of the electronic device (101) described with reference to FIG. 1 through FIG. 31.

[0276] Referring to the state (3201) of FIG. 32, the electronic device (101) that has identified the first notification message can display a UI object (3212) corresponding to the first notification message on the foreground area (3290), similar to the state (3101) of FIG. 31. The electronic device (101) can reduce the height of the widget object (3210) so that the widget object (3210) is not obscured by the UI object (3212).

[0277] In one embodiment, when the height of the widget object (3210) is reduced to a reference height, the electronic device (101) may move the foreground area (3290) to increase the size of the area where UI objects corresponding to notification messages (e.g., UI objects (3212, 3223) of FIG. 32) are to be displayed. Referring to FIG. 32, within a state (3202) following state (3201), the electronic device (101) that has identified the second notification message may move the foreground area (3290) (or a background image including the foreground area (3290)) downward along the vertical direction of the display. The electronic device (101) may display the UI object (3223) corresponding to the second notification message on the moved foreground area (3290). Referring to the states (3201, 3202) of FIG. 32, the foreground area (3290) can be moved, and the position and / or size of the widget object (3210) can be fixed. UI objects (3212, 3223) can be positioned between the foreground area (3290) and the widget object (3210).

[0278] FIG. 33 illustrates exemplary states (3301, 3302, 3303) of an electronic device displaying a widget object (3310). The electronic device (101) and / or processor (210) of FIG. 1 and 2 can perform the operation of the electronic device (101) described with reference to FIG. 33.

[0279] Referring to FIG. 33, in state (3301), the electronic device (101) can display a widget object (3310) based on the shape of a background area different from the foreground area (3312). In state (3301), based on identifying notification message(s), the electronic device (101) can display UI object(s) corresponding to the notification message(s). Referring to state (3302) of FIG. 33, the electronic device (101) can display UI objects (3320) corresponding to a plurality of notification messages. Referring to state (3302) of FIG. 33, too many UI objects (3320) can obscure the foreground area (3312). To display the UI objects (3320), the electronic device (101) can display the widget object (3310) according to the minimum height. A widget object (3310) that is displayed according to the minimum height can display characters that have the same height (e.g., minimum height).

[0280] In the state (3302) of FIG. 33, the electronic device (101) that identifies a time-based event, such as an alarm, can visually highlight the widget object (3310) as in the state (3303). For example, the electronic device (101) can increase the heights of the characters contained in the widget object (3310) according to the shape of the foreground area (3312). Referring to the state (3303) of FIG. 33, the electronic device (101) can move the UI objects (3320) (downward along the vertical direction of the display). For example, the electronic device (101) can move the UI objects (3320) so that the widget object (3310) with increased height is not obscured by the UI objects (3320). For example, because the characters of the widget object (3310) extend to the foreground area (3312) (or the boundary line of the background area different from the foreground area (3312)), the electronic device (101) can move the UI objects (3320) based on the position and / or size of the foreground area (3312). For example, the UI objects (3320) can be moved to the foreground area (3312).

[0281] FIG. 34 illustrates exemplary states (3401, 3402, 3403) of an electronic device (101) displaying a widget object (3410). The electronic device (101) and / or processor (210) of FIG. 1 and 2 can perform the operation of the electronic device (101) described with reference to FIG. 34.

[0282] Referring to FIG. 34, the electronic device (101) may display a widget object (3410) containing characters located in a background area different from the foreground area (3412). While displaying a lock screen containing the widget object (3410), the electronic device (101) may display a widget object (3414) having content independent of the widget object (3410). Referring to an exemplary state (3401) of FIG. 34, the electronic device (101) may display a widget object (3414) for controlling the playback of music. In one embodiment, based on user input received through the widget object (3414), the electronic device (101) may display an image (3420), such as an album cover.

[0283] Referring to the exemplary states (3402, 3403) of FIG. 34, based on the user input, the electronic device (101) can display an image (3420) on the display. Based on the user input, the electronic device (101) can change the height of the widget object (3410) so that the widget object (3410) is not obscured by the image (3420). For example, as in state (3402), the electronic device (101) can reduce the height of the widget object (3410) to a reference height (e.g., minimum height). For example, as in state (3403), the electronic device (101) can display the widget object (3410) having a height that extends to the image (3420) displayed on the display. Since the characters included in the widget object (3410) extend to the rectangular image (3420), the heights of the characters may be equal to each other within the state (3403).

[0284] FIG. 35 schematically illustrates the operation of an electronic device that determines the position and / or size of a widget object (3510) according to an image. Referring to FIG. 35, a screen (e.g., a lock screen) containing a widget object (3510) may include a plurality of images that are scrolled according to user input. For example, while displaying a first image in state (3501), the electronic device (101) may display a widget object (3510) having a shape based on a first foreground area (3512) of the first image. In state (3501), the electronic device (101) may receive user input to change the first image displayed through the display to another image. The user input may include, for example, a drag gesture (or swipe gesture) performed along one direction of the display (e.g., a horizontal direction or a vertical direction). Based on the above user input, the electronic device (101) can switch to any one of the states (3501, 3502, 3503, 3504).

[0285] Referring to state (3502) of FIG. 35, while displaying the second image, the electronic device (101) may display a widget object (3510) within a background area different from the second foreground area (3522) of the second image. The position of the widget object (3510) within the background area and / or the heights of the characters within the widget object (3510) may be changed based on the shape of the outline of the background area different from the foreground area (3522). Similarly, referring to state (3503) of FIG. 35, while displaying the third image, the electronic device (101) may change or determine the attributes of the widget object (3510) based on recognizing the third foreground area (3532) of the third image. Similarly, referring to the state (3504) of FIG. 35, the electronic device (101) can display a widget object (3510) having an extended shape within a background area different from the foreground area (3542) of the fourth image. By switching between states (3501, 3502, 3503, 3504) according to user input, the electronic device (101) can display a widget object (3510) that adaptively changes according to the image displayed through the display.

[0286] FIG. 36 illustrates exemplary states (3601, 3602) of an electronic device that changes the position, size, and / or shape of a widget object (3610) according to motion. The electronic device and / or processor (210) of FIG. 1 through 35 may perform the operation of the electronic device described with reference to FIG. 36. An electronic device having the form factor of a foldable mobile phone (292) is illustrated as an example, but embodiments are not limited thereto.

[0287] Referring to FIG. 36, the electronic device can recognize foreground regions (3612, 3614) of an image. In the exemplary state (3601) of FIG. 36, the electronic device can display a widget object (3610) in a background region distinct from the foreground regions (3612, 3614). The characters of the widget object (3610) can be extended within the background region so as not to overlap with the foreground regions (3612, 3614).

[0288] In one embodiment, the electronic device may identify the orientation of the electronic device using a gyroscope sensor and / or an accelerometer sensor. For example, the state (3601) of FIG. 36 may be an exemplary state of the electronic device that has identified the orientation (d1). The electronic device may move the foreground regions (3612, 3614) differently according to the movement of the electronic device identified based on the gyroscope sensor and / or accelerometer sensor (e.g., movement based on rotational movement and / or translational movement). For example, the electronic device may make the movement speeds (or distances) of each of the foreground regions (3612, 3614) different according to the identified movement of the electronic device in order to visualize the three-dimensional movement of the foreground regions (3612, 3614).

[0289] Referring to FIG. 36, a state (3602) following state (3601) is illustrated. An electronic device that has identified a direction (d2) within state (3602) can determine the positions (or distances or speeds) of each of the foreground regions (3612, 3614) based on the positional relationship between the directions (d1, d2). State (3602) of FIG. 36 may be a state after at least one of the foreground regions (3612, 3614) has been moved based on the determined positions. Referring to state (3602) of FIG. 36, the electronic device (101) can display a widget object (3610) within a background region different from the moved foreground regions (3612, 3614). As the shape, position, and / or size of the background area changes depending on the movement of the foreground areas (3612, 3614), the shape, position, and / or size of the widget object (3610) (e.g., the height of at least one of the characters included in the widget object (3610)) may also change.

[0290] FIG. 37 illustrates screens (3701, 3702, 3703, 3704) comprising widget objects having a position, size, and / or shape determined based on object recognition. The electronic device (101) of FIG. 1 to 36 can display at least one of the screens (3701, 3702, 3703, 3704) illustrated in FIG. 37.

[0291] Referring to FIG. 37, based on object recognition, the location where a widget object is to be displayed and / or the attributes of the widget object (e.g., the heights of the characters included in the widget object) can be determined in various ways. Referring to the first screen (3701) and / or the second screen (3702), the electronic device can determine the attributes (e.g., the location, shape, and / or heights of the characters) of a widget object (e.g., widget objects (3710, 3720)) to be displayed on the image using the shape, location, and / or inclination of a wall identified from the image. Referring to the third screen (3703), the electronic device can display a widget object (3730) having a shape corresponding to a plane (e.g., one side of a box) identified in the image. A user viewing the widget object (3730) may perceive that the widget object (3730) is printed on the plane. Referring to the fourth screen (3704), the electronic device can warp the widget object (3740) according to the posture of the person identified in the image.

[0292] FIG. 38 illustrates exemplary screens (3801, 3802) displayed by an HMD device (292). An embodiment having the form factor of the HMD device (292) is described, but the embodiment is not limited thereto. For example, the electronic device of FIG. 1 through 37 can perform the operation of the HMD device (292) described with reference to FIG. 38.

[0293] Referring to FIG. 38, the HMD device (292) can display a screen containing a widget object (3820) while being worn by a user (3810). Referring to an exemplary screen (3801) of FIG. 38, the HMD device (292) can display the widget object (3820) based on a visual object (3830) within the screen (3801). The visual object (3830) may correspond to an external object captured through the camera of the HMD device (292). The visual object (3830) may correspond to a virtual object included in the VR environment displayed through the HMD device (292). The HMD device (292) can display the widget object (3820) based on binocular parallax so that the widget object (3820) has the same sense of distance as the visual object (3830). For example, the binocular parallax of the visual object (3830) may be the same as the binocular parallax of the widget object (3820).

[0294] Referring to FIG. 38, the HMD device (292) can track or identify the gaze position of a user (3810) wearing the HMD device (292). Based on the detected gaze position, the HMD device (292) can identify the position within the screen (3801) that the user (3810) is looking at. Referring to the screen (3802) of FIG. 38, the HMD device (292) that identifies a gaze position that is different (or not overlapping) from a visual object (3830) and / or a widget object (3820) can apply a visual effect, such as blur, to the widget object (3820) that has the same binocular parallax as the visual object (3830).

[0295] FIG. 39 illustrates screens (3901, 3902, 3903) displayed by an electronic device according to one embodiment. The electronic device (101) of FIG. 1 and 2 may display at least one of the screens (3901, 3902, 3903) described with reference to FIG. 39 on a display. The screens (3901, 3902, 3903) may include an image (e.g., a background image) and a widget object that is at least partially superimposed on the image. The widget object may include characters representing time. Based on the operation described above with reference to FIG. 1 through 38, the electronic device may adaptively change the height of the characters so that the characters of the widget object extend within a background area different from the foreground area (3910) without the widget object overlapping with the foreground area (3910) of the image.

[0296] Referring to the screen (3901) of FIG. 39, the electronic device can determine the heights of the characters included in the widget object using a group (3912) that includes all of the characters. For example, the electronic device can extend the characters (e.g., increase the heights of the characters collectively) within the background area so that none of the characters included in the group (3912) overlap with the foreground area (3910) and the characters included in the group (3912) have the same height. Based on this extension, the characters included in the group (3912) may have the same height and may be extended toward the foreground area (3910) within a background area different from the foreground area (3910). In other words, the characters included in the group (3912) may have the minimum height among the maximum heights of the characters extended within the background area.

[0297] Referring to the screen (3902) of FIG. 39, the electronic device may determine the heights of the characters included in the widget object individually (or independently) in each of the groups (3922, 3924, 3926). For example, group (3922) may include characters representing hours. For example, group (3924) may include a separator (e.g., a colon) separating hours and minutes. For example, group (3926) may include characters representing minutes. The electronic device may determine the heights of the characters included in group (3922) as the maximum height at which all of the characters do not overlap with the foreground area (3910). For example, the characters included in group (3922) may have the same height and may extend toward the foreground area (3910) within the background area. The electronic device may determine the height of the characters included in group (3924) as the maximum height that does not overlap with the foreground area (3910). The electronic device may determine the heights of the characters included in group (3926) as the maximum height that prevents all of the characters from overlapping with the foreground area (3910). The heights of each of the groups (3922, 3924, 3926) may be different from each other (or independent of each other). The heights of the characters included in each of the groups (3922, 3924, 3926) may be the same from each other.

[0298] Referring to the screen (3903) of FIG. 39, the heights of the characters (3931, 3932, 3934, 3935, 3936) included in the widget object can be determined individually (or independently). The characters (3931, 3932, 3934, 3935, 3936) can be placed at different locations within a background area different from the foreground area (3910). Each of the characters (3931, 3932, 3934, 3935, 3936) can be extended toward the foreground area (3910) at a corresponding location. Because the foreground area (3910) has a curved (or non-straight) boundary line, the heights of the characters (3931, 3932, 3934, 3935, 3936) extending toward the foreground area (3910) may differ from each other. The characters (3931, 3932, 3934, 3935, 3936) may extend within the background area without overlapping with the foreground area (3910).

[0299] FIG. 40 illustrates screens (4001, 4002, 4003) displayed by an electronic device according to one embodiment. The electronic device (101) of FIG. 1 and 2 may display at least one of the screens (4001, 4002, 4003) described with reference to FIG. 40 on a display. The screens (4001, 4002, 4003) may include an image (e.g., a background image) and a widget object that is at least partially superimposed on the image. The widget object may include characters representing a time interval. Based on the operation described with reference to FIG. 1 to 39, the electronic device may extend or reduce the heights of the characters included in the widget object within a background area different from the foreground area (4010).

[0300] Referring to the screen (4001) of FIG. 40, the electronic device may make the characters included in a group (4012) have the same height and extend within a background area different from the foreground area (4010). A widget object included in the screen (4001) may include the characters included in the group (4012). For example, the electronic device may extend the heights of the characters having the same height included in the group (4012) so that the group (4012) does not overlap with the foreground area (4010). For example, the height of the group (4012) may be maximized within a background area different from the foreground area (4010). Referring to the screen (4001) of FIG. 40, the group (4012) having the maximized height may not overlap with the foreground area (4010). Within the group (4012), the electronic device may display characters having the same height. For example, the heights and widths of the characters included in group (4012) may be half the height and width of each of the group (4012).

[0301] Referring to the screen (4002) of FIG. 40, the electronic device may determine the heights of the characters using a group of characters (4022) representing hours and a group of characters (4024) representing minutes. Widget objects within the screen (4002) may include the groups (4022, 4024). For example, the electronic device may determine or extend the heights of the characters representing hours, the characters representing minutes, and the segments separating hours and minutes individually (or independently). For example, an embodiment is illustrated in which the group (4024) (e.g., a group of characters representing minutes) has a greater height than the group (4022) (e.g., a group of characters representing hours), but the embodiment is not limited thereto.

[0302] Referring to the screen (4003) of FIG. 40, the electronic device can determine or extend the heights of the characters (4031, 4032, 4033, 4034) included in the widget object individually (or independently). For example, the characters (4031, 4033) arranged along the vertical direction may have the same height and may be extended so as not to overlap with the foreground area (4010). The characters (4032, 4034) may be arranged along the vertical direction, may have the same height, and may be extended within the background area so as not to overlap with the foreground area (4010).

[0303] FIG. 41 illustrates an embodiment of an electronic device (4100) having the form of a multi-foldable mobile phone. The electronic device (4100) of FIG. 41 may be an example of the electronic device (101) of FIG. 1 and / or FIG. 2.

[0304] Referring to FIG. 41, an electronic device (4100) according to one embodiment may include a first housing part (4101), a second housing part (4102), and a third housing part (4103). In this disclosure, the term “housing part” may be used interchangeably with the terms “housing,” “rigid housing,” and / or “rigid part.” The electronic device (4100) may include a first hinge assembly (4105) that rotatably connects the first housing part (4101) and the second housing part (4102). The electronic device (4100) may include a second hinge assembly (4106) that rotatably connects the second housing part (4102) and the third housing part (4103). The electronic device (4100) may include a display (4107) extending from one side of the first housing part (4101) (e.g., one side of the first housing part (4101) referred to as the front side) across the second housing part (4102) to the third housing part (4103). The display (4107) may be located on the front side of the first housing part (4101), the second housing part (4102), and the third housing part (4103). The display (4107) may be referred to as a flexible display.

[0305] Referring to FIG. 41, exemplary states (4191, 4192) of the electronic device (4100) are illustrated. State (4191) may correspond to a folded state of the electronic device (4100) in which only a portion of the display (4107) located on the first housing part (4101) is visible. In the folded state, the angle between the first housing part (4101) and the second housing part (4102) may be substantially 0º. In the folded state, the angle between the second housing part (4102) and the third housing part (4103) may also be substantially 0º. In the folded state, the size of the visible display (4107) may be minimized. In the folded state, the rear side of the first housing part (4101) may come into contact with the rear side of the second housing part (4102). In the folded state, the front side of the second housing part (4102) can come into contact with the front side of the third housing part (4103).

[0306] Referring to FIG. 41, within a state (4191) included in a folded state, the electronic device (4100) may display a cover screen on a portion of a display (4107) placed on one side (e.g., front side) of a first housing part (4101). The cover screen may include a widget object (4120) placed based on the operation described above with reference to FIG. 1 through FIG. 40. For example, the widget object (4120) may include characters placed in a background area different from the foreground area (4110) of the image displayed together with the widget object (4120), and extending toward the foreground area (4110) within the background area.

[0307] Referring to FIG. 41, state (4192) may correspond to an unfolded state of the electronic device (4100). In the unfolded state, all angles between the first housing part (4101), the second housing part (4102), and the third housing part (4103) may be substantially 180º. In the unfolded state, the entire display (4107) may form a flat plane. Referring to FIG. 41, in state (4192) included in the unfolded state, the electronic device (4100) may display a cover screen across the entire display (4107). The cover screens displayed in each of the states (4191, 4192) may differ from one another. For example, when transitioning from a folded state (4191) to an unfolded state (4192), the electronic device (4100) may move the foreground area (4110) and the widget object (4120) to the center of the display (4107). Referring to state (4192), the widget object (4120) may be positioned over the foreground area (4110) based on the movement.

[0308] In one embodiment, a method may be required to display a widget object (e.g., a clock widget) containing characters in a superimposed manner on an image. In one embodiment, a method may be required to individually determine the sizes of the characters of the widget object according to the shape of the background area of ​​the image. In one embodiment, a method may be required to determine the positions and / or sizes of the characters of the widget object using a boundary line between the background area and the foreground area of ​​the image. An electronic device (e.g., the electronic device (101) of FIG. 1 and / or the electronic device (2901) of FIG. 29) according to one embodiment as described above may include a display (e.g., the processor (110) of FIG. 1), at least one processor (e.g., the processor (210) of FIG. 2) including a processing circuit, and a memory (e.g., the memory (215) of FIG. 2) including one or more storage media for storing instructions. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause an image (e.g., image (120) of FIG. 1) to be displayed on the display. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause a background area of ​​the image that is different from a foreground area of ​​the image (e.g., foreground area (130) of FIG. 1) based on object recognition of the image. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause a clock widget (e.g., widget object (150) of FIG. 1) including a plurality of numbers and the image to be displayed simultaneously. The plurality of numbers may include a first number located at a first position in the background area at a first height so as to be displayed as extended from a reference axis within the display toward the outline of the background area.The plurality of numbers may include a second number located at a second position in the background area at a second height, so as to be displayed as extended from the reference axis toward the outline of the background area. According to one embodiment, an electronic device may display a widget object (e.g., a clock widget) containing characters superimposed on an image. According to one embodiment, the electronic device may individually determine the sizes of the characters of the widget object according to the shape of the background area of ​​the image. According to one embodiment, the electronic device may determine the positions and / or sizes of the characters of the widget object using a boundary line between the background area and the foreground area of ​​the image.

[0309] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify a plurality of font files representing numbers having different heights. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display the first number by applying a first font file among the plurality of font files. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display the second number by applying a second font file among the plurality of font files.

[0310] For example, the file names of the plurality of font files mentioned above include different indices, and the indices may correspond to the different heights respectively.

[0311] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify a graphic object corresponding to the first number, and the graphic object may include an extendable section. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to extend the extendable section according to the first height and display the graphic object at the first position.

[0312] For example, when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to receive user input for changing the mode of the electronic device. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the height of the first number to change from the first height to the second height based on the user input received while displaying the image and the clock widget.

[0313] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the heights of the plurality of numbers to change based on the user input received while displaying the image and the clock widget.

[0314] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the thicknesses or colors of the plurality of numbers to be determined based on the color of the background area.

[0315] For example, the electronic device may include an illuminance sensor. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to acquire illuminance data using the illuminance sensor. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to determine the thicknesses of the plurality of numbers based on the acquired illuminance data.

[0316] For example, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify a plurality of cells corresponding to each of the parts of the image. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to determine, based on the object recognition, whether each of the plurality of cells depicts a foreground object. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify a background region including at least one cell in which the foreground object is not depicted.

[0317] For example, the object recognition above may be performed to identify the foreground object classified into a designated category.

[0318] In one embodiment as described above, a method of an electronic device may be provided. The electronic device may include a display. The method may include an operation of displaying an image on the display. The method may include an operation of identifying a background area of ​​the image that is different from a foreground area of ​​the image based on object recognition of the image. The method may include an operation of simultaneously displaying a clock widget including a plurality of numbers and the image. The plurality of numbers may include a first number located at a first position in the background area at a first height so as to be displayed as extending from a reference axis within the display toward the outline of the background area. The plurality of numbers may include a second number located at a second position in the background area at a second height so as to be displayed as extending from the reference axis toward the outline of the background area.

[0319] For example, the operation of simultaneously displaying the clock widget and the image may include the operation of identifying a plurality of font files representing numbers having different heights. The operation of simultaneously displaying the clock widget and the image may include the operation of displaying the first number by applying a first font file among the plurality of font files. The operation of simultaneously displaying the clock widget and the image may include the operation of displaying the second number by applying a second font file among the plurality of font files.

[0320] For example, the file names of the plurality of font files mentioned above include different indices, and the indices may correspond to the different heights respectively.

[0321] For example, the operation of simultaneously displaying the clock widget and the image may include an operation of identifying a graphic object corresponding to the first number, and the graphic object may be caused to include an extendable section. The operation of simultaneously displaying the clock widget and the image may include an operation of extending the extendable section according to the first height to display the graphic object at the first position.

[0322] For example, the above method may include an operation of receiving user input for changing the mode of the electronic device. The above method may include an operation of changing the height of the first number from the first height to the second height based on the user input received while displaying the image and the clock widget.

[0323] For example, the above-mentioned changing operation may include an operation to change the heights of the plurality of numbers based on the user input received while displaying the image and the clock widget.

[0324] For example, the operation of simultaneously displaying the clock widget and the image may include the operation of determining the thicknesses or colors of the plurality of numbers based on the color of the background area.

[0325] For example, the operation of simultaneously displaying the clock widget and the image may include the operation of acquiring illuminance data using an illuminance sensor of the electronic device. The operation of simultaneously displaying the clock widget and the image may include the operation of determining the thicknesses of the plurality of numbers based on the acquired illuminance data.

[0326] For example, the identifying operation may include an operation of identifying a plurality of cells corresponding to each of the parts of the image. The identifying operation may include an operation of determining whether each of the plurality of cells depicts a foreground object based on the object recognition. The identifying operation may include an operation of identifying a background area that includes at least one cell in which the foreground object is not depicted.

[0327] According to one embodiment as described above, an electronic device may include a display, at least one processor including a processing circuit, and a memory including one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause an object display area in which at least one object is displayed on the image and a background area, which is an area other than the object display area, to be positioned between a boundary line based on the outline of at least a part of the object, when the character display area in which at least a part of the character set is displayed is simultaneously displayed on the display, such that the character display area in which at least a part of the character set is displayed is positioned within the background area. At least a part of the character boundary line forming the character display area may be determined based on the boundary line.

[0328] For example, at least a portion of the character boundary line forming the character display area may include a line section that is partially in contact with the boundary line or is spaced apart from the boundary line while maintaining a set distance along the boundary line.

[0329] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the object display area to be changed based on the occurrence of an event, the background area to be changed according to the change in the object display area, and the position or size of the character display area within the changed background area to be changed.

[0330] For example, the character boundary line includes upper, lower, left, and right boundary lines, and when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the object display area to change based on the occurrence of the event, and based on the change in the object display area, cause at least one of the left or right boundary lines to move in the left or right direction within the background area, or cause at least one of the upper or lower boundary lines to move in the up or down direction within the background area, thereby causing the position or size of the character display area to change within the background area.

[0331] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the object display area to change based on the occurrence of an event, and the character display area to change based on the change in the object display area, thereby causing the shape of the character boundary line to change. As the shape of the character boundary line changes, the vertical length and horizontal width of the first character and the second character may not change.

[0332] For example, the vertical lengths of the first character and the second character adjacent to each other in the horizontal direction may be equal to each other, or the horizontal lengths of the first character and the second character adjacent to each other in the vertical direction may be equal to each other.

[0333] For example, the vertical lengths of the first character and the second character adjacent to each other in the horizontal direction may be different from each other. The horizontal lengths of the first character and the second character adjacent to each other in the vertical direction may be different from each other.

[0334] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the shape of the character boundary line to change dynamically as the character display area changes. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause at least one of the horizontal length or vertical width of the first character and the second character to change as the shape of the character boundary line changes.

[0335] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause at least one of the thickness, color, or brightness of at least one of the first character or the second character to change or vibrate, depending on what is determined to satisfy a specified condition.

[0336] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the size of the character set to be changed according to the determination that a specified condition is satisfied, the size of the character display area to be changed according to the change in the size of the character set, and the location of at least one of the object display area or a popup panel for displaying notification information to be changed according to the change in the size of the character display area.

[0337] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause a change in the object display area to occur based on at least one of the following: a change in the position or size of the object due to a user's touch input to the image; a change in the object due to replacement with another image different from the image; a change in the position of the object to an area other than the area where the pop-up panel is displayed as a pop-up panel for displaying notification information is displayed on the display; or a change in the position of the object due to a change in the degree of physical tilt or shape of the electronic device.

[0338] For example, at least a portion of the character boundary line may include a line section that partially touches or is spaced apart from at least one of a boundary line based on the contour of at least a portion of the object or the outline of the pop-up panel while maintaining a set distance.

[0339] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may identify a user input for changing the character display area and, based on the user input, place the character display area at a different location within the background area, or, based on the user input, place the character display area within the object display area, such that at least a portion of the character boundary line partially touches the boundary line or includes a line section spaced apart from the boundary line while maintaining a set distance along the boundary line.

[0340] For example, the electronic device further includes at least one camera, and when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the image captured by the at least one camera to be displayed in real time on the display, and the character display area to be placed within the background area or the character display area to be placed within the object display area, wherein at least a portion of the character boundary line partially touches the boundary line or includes a line section spaced apart from the boundary line while maintaining a set distance along the boundary line.

[0341] For example, depending on the movement of the user holding the electronic device or the change in the focal length of the camera, the object display area may be changed, created, or destroyed, and as the object display area is changed, created, or destroyed, the position, shape, or size of the character display area may be changed.

[0342] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the sharpness of the first character and the second character to change according to a change in the focal length of the camera.

[0343] For example, when the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify user input for changing the character display area. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to place the character display area at a different location within the background area or at least a portion within the object display area based on the user input.

[0344] In a method of an electronic device according to one embodiment as described above, the electronic device includes a display, and when a character set including one or more of a character, a number, and a symbol, and a series of first and second characters, and an image are simultaneously displayed on the display, the method comprises: an object display area in which at least one object is displayed on the image and a background area which is an area other than the object display area, with a boundary line based on the outline of at least a part of the object placed between them; and a character display area in which at least a part of the character set is displayed is placed within the background area, and at least a part of the character boundary line forming the character display area may be determined based on the boundary line.

[0345] According to one embodiment as described above, an electronic device may include a display, at least one processor including a processing circuit, and a memory including one or more storage media for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause an object display area in which at least one object is displayed on the image and a background area, which is an area other than the object display area, to be positioned with a boundary line based on the outline of at least a part of the object, and a character display area in which at least a part of the character set is displayed to be included within the background area. At least a part of the character boundary line forming the character display area may be determined based on the boundary line.

[0346] For example, at least a portion of the character boundary line forming the character display area may include a line section that is partially in contact with the boundary line or is spaced apart from the boundary line while maintaining a set distance along the boundary line.

[0347] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the object display area to be changed based on the occurrence of an event, the background area to be changed according to the change in the object display area, and the position or size of the character display area within the changed background area to be changed.

[0348] For example, the character boundary line includes an upper boundary line, a lower boundary line, a left boundary line, and a right boundary line, and when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the object display area to change based on the occurrence of an event, and based on the change in the object display area, cause at least one of the left or right boundary line to move in the left or right direction within the background area, and / or cause at least one of the upper or lower boundary line to move in the up or down direction within the background area, thereby causing the position or size of the character display area to change within the background area.

[0349] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the shape of the character boundary line to change dynamically as the object display area changes based on the occurrence of an event, and as the character display area changes based on the change in the object display area. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause at least one of the vertical length or horizontal width of the first character and the second character to change as the shape of the character boundary line changes.

[0350] For example, the vertical lengths of the first character and the second character adjacent to each other in the horizontal direction may be equal to each other, and / or the horizontal lengths of the first character and the second character adjacent to each other in the vertical direction may be equal to each other.

[0351] For example, the vertical lengths of the first character and the second character adjacent to each other in the horizontal direction may be different from each other, and / or the horizontal lengths of the first character and the second character adjacent to each other in the vertical direction may be different from each other.

[0352] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause at least one of the thickness, color, or brightness of at least one of the first character or the second character to change or vibrate, depending on what is determined to satisfy a specified condition.

[0353] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the size of the character set to be changed according to the determination that a specified condition is satisfied, the size of the character display area to be changed according to the change in the size of the character set, and the location of at least one of the object display area or a popup panel for displaying notification information to be changed according to the change in the size of the character display area.

[0354] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause a change in the object display area to occur based on at least one of a change in the position or size of the object due to a user's touch input to the image, a change in the object due to replacement with another image different from the image, a change in the position of the object to an area other than the area where the pop-up panel is displayed as a pop-up panel for displaying notification information is displayed on the display, and / or a change in the position of the object due to a change in the degree of physical tilt or shape of the electronic device.

[0355] For example, at least a portion of the character boundary line may include a line section that partially touches or is spaced apart from at least one of a boundary line based on the contour of at least a portion of the object or the outline of the pop-up panel while maintaining a set distance.

[0356] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may identify a user input for changing the character display area and, based on the user input, place the character display area at another location within the background area, and / or, based on the user input, place the character display area within the object display area, such that at least a portion of the character boundary line partially touches the boundary line or includes a line section spaced apart along the boundary line while maintaining a set distance from the boundary line.

[0357] For example, the electronic device may include at least one camera, and when the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the image captured by the at least one camera to be displayed in real time on the display, and the character display area to be placed within the background area, and / or the character display area to be placed within the object display area, wherein at least a portion of the character boundary line may partially touch the boundary line or include a line section spaced apart from the boundary line while maintaining a set distance along the boundary line.

[0358] For example, depending on the movement of the user holding the electronic device or the change in the focal length of the camera, the object display area may be changed, created, or destroyed, and as the object display area is changed, created, or destroyed, the position, shape, or size of the character display area may be changed.

[0359] For example, when the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the sharpness of the first character and the second character to change according to a change in the focal length of the camera.

[0360] As used herein, the term “if” will be understood, depending on the context, to mean “when, upon,” “in response to a decision,” or “in response to a detection.” Similarly, “when decided to,” or “when [the mentioned condition or event] is detected,” will be understood, optionally, to mean “when decided,” or “in response to a decision,” “when [the mentioned condition or event] is detected,” or “in response to detecting [the mentioned condition or event].”

[0361] The device described above may be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. For example, the device and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.

[0362] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or instruct the processing unit independently or collectively. Software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0363] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may continuously store a program executable by a computer, or temporarily store it for execution or download. Additionally, the medium may be various recording or storage means in the form of a single or several hardware combined, and may not be limited to a medium directly connected to a computer system but may exist distributed over a network. Examples of media may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and media configured to store program instructions, including ROM, RAM, and flash memory. Additionally, other examples of media may include recording or storage media managed by app stores that distribute applications or sites and servers that supply or distribute various other software.

[0364] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, suitable results can be achieved even if the described techniques are performed in a different order than described, and / or the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0365] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.

Claims

1. In an electronic device, display; At least one processor including a processing circuit; and Memory, comprising one or more storage media that store instructions, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Displaying an image on the above display; Based on object recognition of the above image, identify a background area of ​​the above image that is different from the foreground area of ​​the above image; and A clock widget including multiple numbers and the image are caused to be displayed simultaneously, and the multiple numbers are: A first number positioned at a first position in the background area at a first height so as to be displayed as extending from a reference axis within the display toward the outline of the background area; and A second number located at a second position in the background area at a second height, such that it is indicated as being extended from the reference axis toward the contour of the background area, Electronic device.

2. In claim 1, when the instructions are executed individually or collectively by the at least one processor, the electronic device, Identify multiple font files representing numbers having different heights; Displaying the first number by applying the first font file among the plurality of font files above; and Causing to display the second number by applying the second font file among the plurality of font files above. Electronic device.

3. In Claim 2, The file names of the plurality of font files mentioned above include different indices, and the indices correspond to the different heights, respectively. Electronic device.

4. In claims 1 to 3, when the instructions are executed individually or collectively by the at least one processor, the electronic device, Identify a graphic object corresponding to the first number above, wherein the graphic object includes an extendable section; and causing the graphic object to be displayed at the first position by extending the extendable section according to the first height. Electronic device.

5. In claims 1 to 4, when the instructions are executed individually or collectively by the at least one processor, the electronic device, Receiving user input to change the mode of the above electronic device; and Causing the height of the first number to change from the first height to the second height based on the user input received while displaying the above image and the above clock widget, Electronic device.

6. In claim 5, when the instructions are executed individually or collectively by the at least one processor, the electronic device, Causing to change the heights of the plurality of numbers based on the user input received while displaying the above image and the above clock widget, Electronic device.

7. In claims 1 to 6, when the instructions are executed individually or collectively by the at least one processor, the electronic device, Causing to determine the thicknesses or colors of the plurality of numbers based on the color of the background area above, Electronic device.

8. In claims 1 to 7, It further includes an illuminance sensor; and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Acquire illuminance data using the above illuminance sensor; and Causing to determine the thicknesses of the plurality of numbers based on the above-mentioned acquired illuminance data, Electronic device.

9. In claims 1 to 8, when the instructions are executed individually or collectively by the at least one processor, the electronic device, Identifying multiple cells corresponding to each part of the above image, and Based on the above object recognition, determine whether each of the plurality of cells depicts a foreground object (depict); and Causing the above-mentioned foreground object to identify the above-mentioned background area including at least one cell that is not depicted, Electronic device.

10. In claim 9, the object recognition is, Performed to identify the above foreground object classified into a designated category, Electronic device.

11. In a method of an electronic device, the electronic device includes a display, and The operation of displaying an image on the above display; An operation to identify a background area of ​​an image that is different from a foreground area of ​​an image based on object recognition of the image; and The operation includes a clock widget including multiple numbers and simultaneously displaying the image, wherein the multiple numbers are: A first number positioned at a first position in the background area at a first height so as to be displayed as extending from a reference axis within the display toward the outline of the background area; and A second number located at a second position in the background area at a second height, such that it is indicated as being extended from the reference axis toward the contour of the background area, method.

12. In an electronic device, display; At least one processor including a processing circuit; and Memory, comprising one or more storage media that store instructions, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: When a character set including one or more of letters, numbers, and symbols, and a series of first and second characters, and an image are simultaneously displayed on the display, An object display area in which at least one object is displayed on the above image and a background area, which is an area other than the object display area, are arranged with a boundary line based on the outline of at least a part of the object in between; A character display area in which at least a portion of the above character set is displayed is caused to be included and placed within the above background area, and At least a portion of the character boundary line forming the above character display area is, Determined based on the above boundary line, Electronic device.

13. In Claim 12, At least a portion of the character boundary line forming the above character display area is, A line section including a line segment that is partially in contact with the above boundary line or spaced apart from the above boundary line while maintaining a set distance along the above boundary line. Electronic device.

14. In Claim 12, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: The display area of ​​the above object is changed based on the occurrence of an event, and Depending on the change in the object display area, the background area is changed, and Causing the position or size of the character display area to change within the changed background area, Electronic device.

15. In Claim 14, The above character boundary line includes an upper boundary line, a lower boundary line, a left boundary line, and a right boundary line, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device: The display area of ​​the above object is changed based on the occurrence of an event, and Based on the change in the object display area above, At least one of the above left or right boundary lines is moved to the left or right direction within the background area, and / or By causing at least one of the above upper or lower boundary lines to move in the upward and downward directions within the background area, Causing the position or size of the above character display area to change within the above background area, Electronic device.

Images