Method for displaying items and electronic device supporting same

Abstract

An electronic device disclosed in the present document may comprise: a display; a memory; and at least one processor including the display and processing circuitry. The memory may store one or more instructions which, when individually or collectively executed by the at least one processor, cause the electronic device to: determine an item group including at least one icon for executing an application installed in the electronic device; receive a gesture input of a user through the display; determine a first object corresponding to the gesture input; and arrange, on the display, one or more items included in the item group, on the basis of the shape of the first object.

Description

Methods of displaying items and electronic devices supporting the same

[0001] Embodiments disclosed in this document relate to a method for displaying items on a display and an electronic device supporting the same.

[0002] A variety of portable electronic devices, such as smartphones and tablet PCs, are being released. These devices can perform a variety of functions, such as making calls, browsing the Internet, playing videos, or playing music, using applications.

[0003] The home screen of an electronic device can display various items. For example, items (or content) such as icons for launching applications, stickers (sticker images), and widgets can be displayed on the home screen.

[0004] Recently, devices with expandable or shrinkable displays, such as foldable or rollable devices, have been released. When the display expands, the layout of items displayed on the home screen is maintained or simply rearranged. Alternatively, when the display shrinks, the items displayed on the home screen simply revert to the layout they had before the display was expanded.

[0005] An electronic device according to one embodiment may include a display, a memory, and at least one processor including the display and processing circuitry. The memory may store one or more instructions, which, when individually or collectively executed by the at least one processor, cause the electronic device to determine an item group including at least one icon for executing an application installed on the electronic device, receive a user's gesture input through the display, determine a first object corresponding to the gesture input, and arrange one or more items included in the item group on the display based on a shape of the first object.

[0006] A method for displaying one or more items according to one embodiment may include an operation performed on an electronic device, the operation including determining an item group including at least one icon for executing an application installed on the electronic device, an operation receiving a user's gesture input through a display of the electronic device, an operation determining a first object corresponding to the gesture input, and an operation arranging one or more items included in the item group on the display based on a shape of the first object.

[0007] A non-transitory computer-readable medium may store at least one instruction that, when executed individually or collectively by at least one processor of an electronic device, causes the electronic device to perform the following actions: determining a group of items including at least one icon for executing an application installed on the electronic device; receiving a user's gesture input through a display of the electronic device; determining a first object corresponding to the gesture input; and arranging one or more items included in the group of items on the display based on a shape of the first object.

[0008] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0009] Figure 2 is a flowchart illustrating a process for displaying items according to one embodiment.

[0010] FIGS. 3A through 3C each illustrate a home screen displayed on an electronic device with an expanded display according to one embodiment.

[0011] FIG. 4 illustrates a home screen displayed on an electronic device with a reduced display according to one embodiment.

[0012] Figure 5 illustrates a home screen on which widgets are placed according to one embodiment.

[0013] Figure 6 illustrates a home screen on which stickers and widgets are placed according to one embodiment.

[0014] FIG. 7 illustrates a home screen with grid restrictions according to one embodiment.

[0015] Figure 8 illustrates a home screen in which items are placed in real time according to one embodiment.

[0016] FIG. 9 illustrates a home screen without grid restrictions according to one embodiment.

[0017] FIG. 10 illustrates a home screen without grid restrictions and with items placed in real time according to one embodiment.

[0018] Figure 11 illustrates a home screen according to widget arrangement according to one embodiment.

[0019] Figure 12 illustrates a home screen according to gestures and number of items according to one embodiment.

[0020] Figure 13 illustrates a home screen according to a gesture and number of items according to one embodiment.

[0021] Figure 14 illustrates a home screen according to gestures and number of items according to one embodiment.

[0022] FIG. 15 illustrates a home screen that receives gesture input on a page-by-page basis according to one embodiment.

[0023] Fig. 16 shows a home screen according to a change in the background image according to one embodiment.

[0024] Figure 17 illustrates the settings of a home screen according to one embodiment.

[0025] In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0026] Hereinafter, various embodiments of this document will be described with reference to the attached drawings. However, this is not intended to limit the technology described in this document to specific embodiments, and it should be understood that various modifications, equivalents, and / or alternatives of the embodiments of this document are included. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0027] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with the electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (or display) (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0028] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0029] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where artificial intelligence is performed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0030] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0031] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0032] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0033] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0034] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0035] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0036] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0037] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0038] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0039] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0040] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0041] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0042] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0043] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0044] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0045] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0046] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0047] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0048] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0049]

[0050] Figure 2 is a flowchart illustrating a method for displaying items according to one embodiment.

[0051] Referring to FIGS. 1 and 2 , in operation 210, the processor (120) may determine an item group including at least one item. The at least one item may include an icon for executing an application installed on the electronic device (101). Alternatively, the at least one item may include a folder icon or sticker image for opening a specific folder.

[0052] According to one embodiment, the processor (120) can determine items selected by user input from a list of applications installed in the electronic device (101) (hereinafter, app list) as an item group.

[0053] According to one embodiment, the processor (120) may determine items currently displayed on the home screen as an item group.

[0054] According to one embodiment, the processor (120) may determine items to be included in an item group based on information about the way or history of a user using the electronic device (101). For example, the processor (120) may include icons of applications that the user has frequently executed or has recently used frequently in the item group.

[0055] In operation 220, the processor (120) may receive a user's gesture input (or interaction input) through the display (160). The gesture input may be an input of touching a part of the user's body on the display (160) and drawing a line, figure, or shape and moving it.

[0056] In one embodiment, a gesture input may occur after a group of items is selected from an app list. Alternatively, a gesture input may occur after a specified condition is satisfied on the home screen (e.g., a long-touch input occurs on the home screen). Alternatively, a gesture input may be multiple touch inputs occurring within a specified time period or a specified number of times.

[0057] In operation 230, the processor (120) may determine an object (hereinafter, “gesture object”) corresponding to the gesture input. The processor (120) may determine a gesture object having a high degree of similarity to the shape of the gesture input.

[0058] For example, the processor (120) may compare objects recognized from a webpage frequently visited by the user, objects recognized from a gallery app displaying captured images, and objects included in a pre-stored database related to gesture input with at least a portion of the gesture input (e.g., comparison of boundaries (outermost boundary, inner boundary), comparison of the center, or comparison of a specific portion). For example, the processor (120) may determine an object having an outermost boundary with a high degree of similarity to the gesture input as a gesture object. However, the present invention is not limited thereto, and similarities between objects may be compared in various ways to determine a gesture object.

[0059] According to one embodiment, the processor (120) may determine a line, such as a curve or straight line, corresponding to a gesture input as a gesture object. In this case, the processor (120) may determine information (e.g., length, size, shape) about the line, which is a gesture object, based on information (e.g., movement distance, thickness, shape) of the gesture input.

[0060] In operation 240, the processor (120) may arrange items included in an item group on the display (160) based on the shape of a gesture object corresponding to a gesture input. For example, if the gesture object is determined to be an animal character, the processor (120) may arrange items included in the item group on the display (160) along the boundary of the animal character. For another example, if the gesture object is determined to be a line such as a curved or straight line, the processor (120) may arrange items included in the item group on the display (160) along the line of the gesture object.

[0061] According to one embodiment, the processor (120) may arrange items included in an item group along a gesture object, and additionally place other items (e.g., stickers, widgets) in various ways inside, outside, or around the gesture object.

[0062] According to one embodiment, in the case of a foldable / rollable device, the processor (120) can determine whether the display area (active area, area where items are arranged on the home screen) is expanded or reduced. The processor (120) can deform a gesture object in response to the expansion or reduction of the display area, and arrange items based on the deformed gesture object.

[0063] Additional information regarding how the processor (120) places items including stickers, widgets or icons based on gesture input may be provided through the drawings below.

[0064] Below, various embodiments are provided for placing items on the home screen based on a user's gesture input. These embodiments can be combined in various ways. For example, the processor (120) can apply an artificial intelligence (AI) model or logic to place various items, including icons, stickers, or widgets, on the home screen based on a gesture input.

[0065] Below, we focus on, but are not limited to, cases where gesture input occurs on the home screen. For example, gesture input may occur on the locked screen or when the screen is off.

[0066]

[0067] FIGS. 3A through 3C each illustrate a home screen displayed on an electronic device with an expanded display according to one embodiment.

[0068] Referring to FIG. 1 and FIG. 3A, the first screen (301) and the second screen (302) may be home screens displayed when the display (160) of the electronic device (101) is in the first state (or reduced state, minimized state).

[0069] In the first screen (301), the processor (120) can receive a user's gesture input (or interaction input) (310). The gesture input (310) can be an input of touching a part of the user's body on the display (160) and moving while drawing a line, figure, or shape.

[0070] According to one embodiment, the display (160) may include a first display area (301a) and a second display area (301b). The first display area (301a) may be an area with a relatively large area where a large number of items are arranged. The second display area (301b) may be an area with a relatively small area where a small number of frequently used items are arranged. The gesture input (310) may be an input generated in the first display area (301a) of the display (160).

[0071] In the second screen (302), the processor (120) can determine a gesture object (e.g., a shape, a figure, a character) (320) corresponding to the user's gesture input (310). The processor (120) can determine a gesture object (320) having a shape or form similar to the line of the user's gesture input (310).

[0072] According to one embodiment, the processor (120) may determine the gesture object (320) by reflecting the user's preference. For example, the processor (120) may compare the gesture input (310) with an object recognized from a webpage frequently visited by the user, an object recognized from a gallery app displaying captured images, or an object included in a pre-stored database related to the gesture input (310). The processor (120) may determine an object with a high degree of similarity to the gesture input (310) as the gesture object (320).

[0073] According to one embodiment, the processor (120) may store pre-learning information about the user. For example, the processor (120) may analyze the user's pattern of using the electronic device (101) to generate and store pre-learning information about the user's preference for shapes, figures, characters, or animals. The processor (120) may determine a gesture object (320) with a high preference for each user based on the pre-learning information about the user.

[0074] For example, the processor (120) may input the user's personal information (e.g., age, gender) into an artificial intelligence model within the electronic device (101) to determine a gesture object (320). The processor (120) may determine the preference of each user based on pre-learning information about the user (e.g., the user's preferred shape, animal, and person information) and determine a gesture object (320) corresponding to the preference of each user.

[0075] For example, even when drawing the same shape, the processor (120) can determine the gesture object (320) as a bear character for user A and as a cat character for user B, based on the preference based on each user's prior learning information.

[0076] According to one embodiment, the processor (120) may place items on at least a portion of the boundary, inside, or outside of the gesture object (320) by reflecting the shape of the gesture object (320). For example, the processor (120) may place items along the object boundary (320a) of the gesture object (320). The placed items may be icons for executing an application, folder icons, or stickers (sticker images). The act of placing items along the object boundary (320a) may include an act of placing items similar to the shape or pattern of the gesture object (320).

[0077] Below, the discussion focuses on, but is not limited to, the case of placing items along the boundary (320a) of the gesture object (320).

[0078] According to one embodiment, the processor (120) may place items selected by a separate user input along the object boundary (320a) prior to generating the gesture input (310). Alternatively, the processor (120) may place items placed on the home screen along the object boundary (320a) prior to generating the gesture input (310).

[0079] According to one embodiment, if the total length of the items arranged along the object boundary (320a) is shorter than the length of the object boundary (320a), the processor (120) may arrange at least one sticker (320b) along the object boundary (320a) together with the items. Conversely, if the total length of the arranged items is longer than the length of the object boundary (320a), the processor (120) may create a folder and store items exceeding the length of the object boundary (320a) in the folder. The processor (120) may arrange a folder icon along with the items on the object boundary (320a).

[0080] According to one embodiment, the third screen (303) may be a home screen displayed in a second state (or first expanded state) in which the display (160) of the electronic device (101) is primarily expanded. In the second state, the display area where items are displayed may be expanded compared to the first state. For example, the third screen (303) may be displayed when a foldable device is unfolded or a rollable device is slid and unfolded.

[0081] According to one embodiment, in the third screen (303), the processor (120) may arrange items along the object boundary (320a) of the gesture object (320) in the same or similar manner as in the second screen (302). The processor (120) may maintain the arrangement of the gesture object (320) and items in the same manner as in the second screen (302), or may partially change the arrangement of the items by partially enlarging the gesture object (320).

[0082] According to one embodiment, the processor (120) may input information about the gesture object (320) (e.g., object type, characteristics) and the size of the display (e.g., change in the size of the display area of ​​the display) into the generative artificial intelligence to determine images, objects, and items to be placed on the third screen (303). According to one embodiment, as an example of an operation of determining images, objects, and items to be placed on the third screen (303), the processor (120) may enlarge or reduce the size of at least a portion of the gesture object (320) in proportion to the change in the size of the display area of ​​the display.

[0083] According to one embodiment, the processor (120) may add a widget (331) or a separate background sticker (335) to an empty space around the gesture object (320). The widget (331) may be placed separately from the gesture object (320) so as not to overlap with the gesture object (320). The background sticker (335) may be placed separately from the gesture object (320) so as not to overlap with the gesture object (320), and may be placed so as to overlap at least a portion of the background sticker (335) with the gesture object (320). The background sticker (335) may have a different shape or size from the sticker (320b) placed along the object boundary (320a).

[0084] In one embodiment, the fourth screen (304) may be a home screen displayed in a secondarily expanded third state (or second expanded state, maximum expanded state) of the display (160) of the electronic device (101). In the third state, the display area where items are displayed may be expanded more than in the second state.

[0085] In one embodiment, on the fourth screen (304), the processor (120) may display an extended object (340) associated with the gesture object (320). The extended object (340) may be an object similar to the gesture object (320) but larger in size. For example, if the gesture object (320) is a bear's face, the extended object (340) may be a shape that includes both the bear's face and body.

[0086] According to one embodiment, the processor (120) may place items along the boundary (340a) of the extended object (340). The length of the boundary (340a) may be longer than the object boundary (320a) of the gesture object (320). In the third state, the processor (120) may place a greater number of items (icons or stickers) than in the second state. The processor (120) may additionally place icons of applications that are frequently used or likely to be used among icons not selected by the user along the boundary (340a). Alternatively, the processor (120) may bring some of the icons contained in a folder on the second screen (302) or the third screen (304) to the home screen and place them along the boundary (340a), or bring all of the icons contained in the folder to the home screen and place them along the boundary (340a) and temporarily delete the folder.

[0087] The processor (120) can add a widget (341) or a separate background sticker (345) to the surrounding empty space of the extended object (340). The widget (341) can be placed separately from the outside of the extended object (340) so as not to overlap with the extended object (340). Alternatively, the widget (331) can be placed so as not to overlap with items placed along the boundary (340a) or object boundary (324a) within the extended object (340).

[0088] In one embodiment, the background sticker (345) may be positioned separately from the expanded object (340) so as not to overlap, or may be positioned so as to overlap at least a portion of the expanded object (340). The background sticker (345) may have a different shape or size than the sticker (340b) positioned along the boundary (340a). The background sticker (345) may be displayed overlapping items along the boundary (340a) and may be part of the background image.

[0089] Referring to FIG. 1 and FIG. 3B, the fifth screen (305) and the sixth screen (306) may be home screens displayed on the display (160) of the electronic device (101) in the first state (or reduced state, minimized state).

[0090] According to one embodiment, in the fifth screen (305), the processor (120) may receive a user's gesture input (350). The gesture input (350) may be an input of touching a part of the user's body on the display (160) and moving while drawing a line, figure, or shape.

[0091] According to one embodiment, in the sixth screen (306), the processor (120) may determine a gesture object (e.g., a shape, a figure, a character) (360) corresponding to the user's gesture input (350). The processor (120) may determine a gesture object (360) (e.g., a heart) that is similar to the shape or line of the user's gesture input (350).

[0092] In one embodiment, the processor (120) may place items along an object boundary (360a) of a gesture object (360). For example, the placed items may be an icon for executing an application, a folder icon, or a sticker.

[0093] According to one embodiment, the processor (120) may additionally display a separate background sticker (365) in an empty space around the gesture object (360). The background sticker (365) may be positioned separately so as not to overlap with the gesture object (360), or may be positioned so as to overlap at least a portion of the background with the gesture object (360). The background sticker (365) may be part of the background, or may be positioned in a lower layer so as not to obscure items being positioned thereon.

[0094] According to one embodiment, the seventh screen (307) may be a home screen displayed in a second state (or first expanded state) in which the display (160) of the electronic device (101) is primarily expanded. In the second state, the display area where items are displayed may be expanded compared to the first state.

[0095] In the seventh screen (307), the processor (120) may display a first expanded object (370) that is an enlarged gesture object (360). The first expanded object (370) may have a shape identical to or similar to the gesture object (360) and may be an object larger than the gesture object (360). The size of the first expanded object (370) may be determined according to the size of the display on which the seventh screen (307) is displayed (e.g., the display area of ​​the display). The processor (120) may place items along the object boundary (370a) of the first expanded object (370).

[0096] According to one embodiment, the processor (120) may add a widget (371) or a separate background sticker (375) to an empty space outside the first extended object (370) or inside the first extended object (370). For example, the widget (371) may be positioned inside the first extended object (370) so as not to overlap with the object boundary (370a) or items positioned along the object boundary (370a). The background sticker (375) may be positioned so as to overlap with the first extended object (370) and may be displayed as part of the background.

[0097] In one embodiment, the eighth screen (308) may be a home screen displayed in a secondarily expanded third state (or second expanded state, maximum expanded state) of the display (160) of the electronic device (101). In the third state, the display area where items are displayed may be expanded more than in the second state.

[0098] According to one embodiment, in the eighth screen (308), the processor (120) may display a second expanded object (380) that is an enlarged version of the first expanded object (370). The second expanded object (380) may have a shape identical to or similar to the gesture object (360) or the first expanded object (370), and may be an object larger than the gesture object (360) or the first expanded object (370). The processor (120) may place items along the object boundary (380a) of the second expanded object (380).

[0099] According to one embodiment, the length of the object boundary (380a) of the second extended object (380) may be longer than the length of the object boundary (370a) of the first extended object (370). The processor (120) may place a greater number of items (icons or stickers) than in the second state. The processor (120) may additionally place icons of applications that are frequently used or have a high probability of being used among icons not selected by the user.

[0100] According to one embodiment, the processor (120) may display widgets (381, 382) or at least one separate background sticker (385) outside or inside the second extended object (380). The internal widget (381) may be positioned so as not to overlap with the object boundary (380a) or items positioned along the object boundary (380a) inside the gesture object (320). The internal widget (381) may have a different shape or size from the widget (371) inside the first extended object (370). The external widget (382) may be positioned so as not to overlap with the object boundary (380a) or items positioned along the object boundary (380a) outside the gesture object (320). The background sticker (385) may be positioned in various ways around the second extended object (380) and may be a part of the background.

[0101] Referring to FIG. 1 and FIG. 3c, the ninth screen (3901) and the tenth screen (3902) may be home screens displayed on the display (160) of the electronic device (101) in the first state (or reduced state, minimized state).

[0102] According to one embodiment, in the ninth screen (3901), the processor (120) may receive a user's gesture input (3910). The gesture input (3910) may be an input of touching a part of the user's body on the display (160) and drawing and moving a shape or figure.

[0103] According to one embodiment, in the tenth screen (3902), the processor (120) may determine a gesture object (e.g., a shape, a figure, a character) (3920) corresponding to a user's gesture input (3910). The processor (120) may determine a gesture object (3920) similar to the shape or line of the user's gesture input (3910).

[0104] According to one embodiment, the processor (120) may place items along a portion of a boundary of a gesture object (3920). For example, if the gesture object (3920) is in the shape of a yacht, the processor (120) may place items (e.g., an icon for launching an application, a sticker, or a folder icon) along a boundary of a first portion (e.g., the hull of the yacht) (3920a) of a relatively large gesture object (3920). The processor (120) may not place icons, stickers, or folder icons along a boundary of a second portion (e.g., the flag of the yacht) (3920b) of a relatively small gesture object (3920).

[0105] According to one embodiment, the eleventh screen (3903) may be a home screen displayed in a second state (or first expanded state) in which the display (160) of the electronic device (101) is primarily expanded. In the second state, the display area where items are displayed may be expanded compared to the first state.

[0106] According to one embodiment, in the eleventh screen (3903), the processor (120) may display a first associated object (3930) and a second associated object (3940) associated with the gesture object (3920) based on generative artificial intelligence. The processor (120) may analyze the gesture object (3920) and generate a prompt corresponding to the gesture object (3920). For example, the prompt may include information about the gesture object (3920) (e.g., object type, characteristics) and information about the size of the display. Based on the generated prompt, the processor (120) may generate and place a first associated object (3930) (e.g., a sea) or a second associated object (3940) (e.g., a different type of yacht) that is associated with the gesture object (3920) (e.g., a yacht) and has a size optimized for the size of the display through generative artificial intelligence.

[0107] According to one embodiment, the processor (120) may place items along the inner boundary (3930a) of the first associated object (3930). The processor (120) may not place separate items along the outer boundary (3930b) of the second associated object (3940).

[0108] According to one embodiment, the processor (120) may add a widget (3931) or a separate background sticker to an empty space around the first associated object (3930) or inside the first associated object (3930). For example, the widget (3931) may be positioned along the outer boundary (3930b) so as not to overlap with items positioned along the inner boundary (3930a).

[0109] According to one embodiment, the 12th screen (3904) may be a home screen displayed in a secondarily expanded third state (or, second expanded state, maximum expanded state) of the display (160) of the electronic device (101). In the third state, the display area where items are displayed may be expanded more than in the second state.

[0110] According to one embodiment, in the 12th screen (3904), the processor (120) may display an expanded object (3940) that is an expanded gesture object (3920). The expanded object (3940) may have a shape identical to or similar to the gesture object (3920) and may be larger than the first expanded object (370). The processor (120) may place icons and stickers (3945) along a first boundary (3940a) of a first portion of the expanded object (3940) where no separate widget is placed. The processor (120) may not place separate items along a second boundary (3940b) of a second portion of the expanded object (3940) where a separate widget (3941) is placed. The processor (120) may display the widget (3941) inside the second portion of the expanded object (3940).

[0111]

[0112] FIG. 4 illustrates a home screen displayed on an electronic device with a reduced display according to one embodiment.

[0113] Referring to FIGS. 1 and 4, the first screen (401) and the second screen (402) may be home screens displayed in a third state (or, a maximum expansion state) in which the display (160) of the electronic device (101) is fully expanded.

[0114] According to one embodiment, in the first screen (401), the processor (120) may receive a user's gesture input (or interaction input) (410). The gesture input (410) may be an input of touching a part of the user's body on the display (160) and drawing and moving a shape or figure.

[0115] According to one embodiment, in the second screen (402), the processor (120) may determine a gesture object (e.g., a shape, a figure, a character) (420) corresponding to the user's gesture input (410). The processor (120) may determine a gesture object (420) similar to the shape or line of the user's gesture input (410).

[0116] According to one embodiment, the processor (120) may determine a gesture object (420) by reflecting the user's preference. The processor (120) may compare the gesture input (410) with objects recognized from web pages frequently visited by the user, objects recognized from a gallery app displaying captured images, and objects included in a pre-stored database related to the gesture input (410). The processor (120) may determine an object with a high degree of similarity to the gesture input (410) as the gesture object (420).

[0117] According to one embodiment, the processor (120) can place items along the object boundary (420a) of the gesture object (420). For example, the placed items can be an icon for running an application, a folder icon, or a sticker (sticker image).

[0118] According to one embodiment, the processor (120) may add a widget (421) or a separate background sticker (425) to the empty space around the gesture object (420). The widget (421) may be placed separately from the gesture object (420) so as not to overlap with the gesture object (420). The background sticker (425) may be placed separately from the gesture object (420) so as not to overlap with the gesture object (420), or may be placed so as to overlap at least a portion of the background sticker (425). The background sticker (425) may have a different shape or size from the sticker (420b) placed along the object boundary (420a).

[0119] According to one embodiment, the third screen (403) may be a home screen displayed in a second state (or first reduced state) in which the display (160) of the electronic device (101) is primarily reduced. In the third screen (403) of the second state, the display area where items are displayed may be reduced compared to the first screen (401) and the second screen (402) of the third state. For example, the third screen (403) may be displayed when a foldable electronic device is folded or a rollable electronic device is slid and stored.

[0120] According to one embodiment, in the third screen (403), the processor (120) may place items along the object boundary (420a) of the gesture object (420), identically or similarly to the second screen (402). The processor (120) may partially remove or reduce a widget (431) or background sticker (435) placed in an empty space around the gesture object (420).

[0121] According to one embodiment, the fourth screen (404a) and the fifth screen (404b) may be home screens displayed on the display (160) of the electronic device (101) in the first state (or, the second reduced state, minimized state).

[0122] In one embodiment, the fourth screen (404a) may be the first page of the home screen in the first state. In the first state, the processor (120) may maintain the gesture object (420) and remove all surrounding widgets or background stickers.

[0123] According to one embodiment, the fifth screen (404b) may be the second page of the home screen in the first state. The processor (120) may switch between the fourth screen (404a) and the fifth screen (404b) by a page switching input (425).

[0124] According to one embodiment, on the second page of the fifth screen (404b), the processor (120) may display a simplified object (440) corresponding to the external shape of the gesture object (420) and may not display any surrounding widgets or background stickers. A widget (441) may be displayed inside the simplified object (440), and no separate items may be displayed on the border of the simplified object (440).

[0125]

[0126] Figure 5 illustrates a home screen on which widgets are placed according to one embodiment.

[0127] Referring to FIGS. 1 and 5, in the application selection screen (501), the processor (120) can display a list of applications (app list) installed on the electronic device (101). Multiple icons can be selected by a specified user input. For example, when a long press input occurs, a user interface for selecting at least one of the app list can be displayed.

[0128] According to one embodiment, after at least one application is selected, if a designated start input (e.g., a long press input) (515) occurs, the processor (120) may switch from the application selection screen (501) to the home screen (502). After switching to the home screen (502), a gesture input (530) using a body part of the user (500) may begin. The start input (515) and the gesture input (530) may be continuous inputs in a state where a touch is maintained.

[0129] According to one embodiment, a first widget (521) may be placed on the home screen (502) by default or user input. The first widget (521) may have a first size.

[0130] According to one embodiment, in the home screen (503) and the home screen (504), the gesture input (530) may be an input that draws a shape similar to a specific pattern (e.g., a circle) around the first widget (521). If the area selected by the gesture input (530) overlaps the first widget (521) by a specified ratio or more or includes the first widget (521), the processor (120) may determine that the first widget (521) is selected by the gesture input (530).

[0131] According to one embodiment, on the home screen (505) and the home screen (506), the processor (120) may display a second widget (551) that is a modified version of the first widget (521) in a basic form. The second widget (551) may perform the same or similar function as the first widget (521). The second widget (551) may have a second size that is reduced in length or size compared to the first widget (521) so that items can be placed around it.

[0132] According to one embodiment, when a first widget (521) is selected by a gesture input (530) on the home screen (505), the processor (120) may place items around a second widget (551). For example, the processor (120) may place the items along the widget boundary (551a) outside the second widget (551) or aligned with the widget boundary (551a) so that the items do not overlap with the second widget (551).

[0133] According to one embodiment, on the home screen (506), the processor (120) may place items around the second widget (551) and additionally display a sticker (555). The sticker (555) may be placed adjacent to a corner of the second widget (551). The sticker (555) may be displayed when the length of the widget boundary (551a) is greater than the sum of the lengths of the items or at a point where it is difficult to place items due to the grid structure.

[0134] According to one embodiment, the home screen (505) and the home screen (506) discuss a form in which items are arranged around the second widget (551), but this is not limited thereto. For example, if space is secured to arrange items around the first widget (521), items can be displayed around the first widget (521) without changing the first widget (521) to the second widget (551).

[0135]

[0136] Figure 6 illustrates a home screen on which stickers and widgets are placed according to one embodiment.

[0137] Referring to FIGS. 1 and 6, in the application selection screen (601), the processor (120) can display a list of applications (app list) installed on the electronic device (101). Multiple icons can be selected by a specified user input. For example, when a long press input occurs, a user interface for selecting at least one of the app list can be displayed.

[0138] After at least one application is selected, if a designated start input (e.g., a long press input) (615) occurs, the processor (120) can switch from the application selection screen (601) to the home screen (602). After switching to the home screen (602), a gesture input (630) using a body part of the user (600) can be initiated. The start input (615) and the gesture input (630) can be continuous inputs in a state where a touch is maintained.

[0139] According to one embodiment, the home screen (602) may display representative images (or overlapping images) (621) of a plurality of items to be arranged by a gesture input (630). For example, the representative image (621) may be displayed with a specified transparency to notify the user that the items are being arranged by the gesture input (630). During the process of the gesture input (630), the representative image (621) may be fixed at a specified location or may follow the periphery of the gesture input (630).

[0140] According to one embodiment, various shapes can be drawn on the home screen (603) by a gesture input (630). The gesture input (630) may be an input of touching a part of the user's (600) body on the display (160) and moving while drawing a line, figure, or shape.

[0141] According to one embodiment, in the home screen (604) and the home screen (605), if there is no grid limitation, the processor (120) can freely arrange items along the boundary of the gesture object (640). For example, a screen without grid limitation (e.g., a home screen) may be a screen type in which the positions where items (e.g., icons) can be arranged are not predetermined in a grid form and can be freely arranged.

[0142] According to one embodiment, on the home screen (604), the processor (120) may determine a gesture object (or selection area) (e.g., a heart) (640) corresponding to the gesture input (630). The gesture object (640) may not be displayed on the home screen (604), but may be recognized by the arrangement of items. The processor (120) may arrange items along the boundary of the gesture object (e.g., a heart). The processor (120) may display a background sticker (645) as part of the background.

[0143] According to one embodiment, on the home screen (605), the processor (120) may arrange items along the boundary of the gesture object (650). The processor (120) may display a widget (651) inside the gesture object (650). The widget (651) may be determined as a widget of an application that the user frequently uses or is likely to use. The size of the widget (651) may be determined to be a size that can be included inside the gesture object (650). The processor (120) may arrange stickers, widgets, or app items in various ways by artificial intelligence (AI) logic.

[0144]

[0145] FIG. 7 illustrates a home screen with grid restrictions according to one embodiment.

[0146] Referring to FIGS. 1 and 7, in the application selection screen (701), the processor (120) can display a list of applications (app list) installed on the electronic device (101). Multiple icons can be selected by a specified user input. For example, when a long press input occurs, a user interface for selecting at least one of the app list can be displayed.

[0147] After at least one application is selected, if a designated start input (e.g., a long press input) (715) occurs, the processor (120) can switch from the application selection screen (701) to the home screen (702). After switching to the home screen (702), a gesture input (730) using a body part of the user (700) can be initiated. The start input (715) and the gesture input (730) can be continuous inputs in a state where a touch is maintained.

[0148] On the home screen (702), representative images (721) of multiple items to be arranged by a gesture input (730) are displayed with a specified transparency to notify the user that the items are being arranged by the gesture input (730). During the process of the gesture input (730), the representative image (721) can follow the path of the gesture input (730).

[0149] On the home screen (703) and the home screen (704), lines and shapes can be drawn by a gesture input (730). The gesture input (730) may be a continuous touch input using a body part of the user (700). A representative image (721) may follow the path of the gesture input (730).

[0150] On the home screen (705), the processor (120) can determine a gesture object (or selection area) (e.g., heart) (750) corresponding to the gesture input (730).

[0151] The processor (120) can place items within, on, and / or along the boundary of a gesture object (e.g., a heart) (750). If there is a grid limitation, the processor (120) can place items in a standardized form (751) according to the arrangement of the internal grid of the gesture object (740). A screen with grid limitations (e.g., a home screen) may be a screen type in which the positions where items (e.g., icons) can be placed are predetermined in a grid form, so that the positions or number of items (e.g., icons) that can be placed are limited. The gesture object (750) may not be displayed on the home screen (705), but may be recognized by the arrangement of items.

[0152]

[0153] Figure 8 illustrates a home screen in which items are placed in real time according to one embodiment.

[0154] Referring to FIGS. 1 and 8, in the application selection screen (801), the processor (120) can display a list of applications (app list) installed on the electronic device (101). Multiple icons can be selected by a specified user input. For example, when a long press input occurs, a user interface for selecting at least one of the app list can be displayed.

[0155] After at least one application is selected, if a designated start input (e.g., a long press input) (815) occurs, the processor (120) can switch from the application selection screen (801) to the home screen (802). After switching to the home screen (802), a gesture input (830) using a body part of the user (800) can be initiated. The start input (815) and the gesture input (830) can be continuous inputs in a state where a touch is maintained.

[0156] On the home screen (802), representative images (821) of multiple items to be arranged by a gesture input (830) are displayed with a specified transparency to notify the user that the items are being arranged by the gesture input (830). During the process of the gesture input (830), the representative image (821) can follow the path of the gesture input (830).

[0157] On the home screen (803), a line or shape can be drawn by a gesture input (830). The gesture input (830) can be a continuous touch input using a body part of the user (800).

[0158] On the home screen (804) and home screen (805), the processor (120) can place items in real time along the line where the gesture input (830) occurs. If there are grid restrictions, the processor (120) can place items considering the line where the gesture input (830) occurs and the grid layout.

[0159] On the home screen (806), the processor (120) can determine a gesture object (or selection area) (e.g., a heart) (860) corresponding to the gesture input (830). When the gesture object (e.g., a heart) (860) is determined, the processor (120) can correct the arrangement of the items arranged in real time by artificial intelligence (AI) logic. The processor (120) can arrange the items within, on, and / or along the boundary of the gesture object (e.g., a heart) (860). When there is a grid limitation, the processor (120) can arrange the items in a standardized shape (861) according to the shape of the internal grid of the gesture object (840). The gesture object (860) is not displayed on the home screen (806), and the gesture object (860) can be recognized by the arrangement shape of the items.

[0160]

[0161] FIG. 9 illustrates a home screen without grid restrictions according to one embodiment.

[0162] Referring to FIGS. 1 and 9, in the application selection screen (901), the processor (120) can display a list of applications (app list) installed on the electronic device (101). Multiple icons can be selected by a specified user input. For example, when a long press input occurs, a user interface for selecting at least one of the app list can be displayed.

[0163] After at least one application is selected, if a designated start input (e.g., a long press input) (915) occurs, the processor (120) can switch from the application selection screen (901) to the home screen (902). After switching to the home screen (902), a gesture input (930) using a body part of the user (900) can be initiated.

[0164] On the home screen (902), representative images (or overlapping images) (921) of multiple items to be arranged by a gesture input (930) are displayed with a specified transparency to notify the user that the items are being arranged by the gesture input (930). During the process of the gesture input (930), the representative image (921) can follow the path of the gesture input (930).

[0165] On the home screen (903), home screen (904), and home screen (905), a line or shape can be drawn by a gesture input (930). The gesture input (930) can be a continuous touch input using a body part of the user (900). The representative image (921) can be displayed with a specified transparency and follow the path of the gesture input (930).

[0166] On the home screen (906), the processor (120) can determine a gesture object (or selection area) (e.g., a heart) (960) corresponding to the gesture input (930). The processor (120) can place items on the boundary of the gesture object (e.g., a heart) (960). If there is no grid limitation, the processor (120) can place items in a free shape (961) along the boundary of the gesture object (960). The gesture object (960) is not displayed on the home screen (905), and the gesture object (960) can be recognized by the arrangement of the items.

[0167]

[0168] FIG. 10 illustrates a home screen without grid restrictions and with items placed in real time according to one embodiment.

[0169] Referring to FIGS. 1 and 10, in the application selection screen (1001), the processor (120) can display a list of applications (app list) installed on the electronic device (101). Multiple icons can be selected by a specified user input. For example, when a long press input occurs, a user interface for selecting at least one of the app list can be displayed.

[0170] After at least one application is selected, if a designated start input (e.g., a long press input) (1015) occurs, the processor (120) can switch from the application selection screen (1001) to the home screen (1002). After switching to the home screen (1002), a gesture input (1030) using a body part of the user (1000) can be initiated.

[0171] On the home screen (1003), home screen (1004), and home screen (1005), a desired shape of the user (1000) can be drawn by a gesture input (1030). The processor (120) can arrange items in real time along the line where the gesture input (1030) occurs. If there is no grid restriction, the processor (120) can freely arrange items by reflecting the line where the gesture input (1030) occurs. For example, the processor (120) can arrange items with a specified transparency along the path of the gesture input (1030).

[0172] On the home screen (1006), the processor (120) can determine a gesture object (or selection area) (e.g., heart) (1060) corresponding to the gesture input (1030). When the gesture object (e.g., heart) (1060) is determined, the processor (120) can correct the arrangement of the items arranged in real time by artificial intelligence (AI) logic.

[0173] The processor (120) can place items on the boundary of a gesture object (e.g., a heart) (1060). If there is no grid limitation, the processor (120) can place items in a free shape (1061) along the boundary of the gesture object (1060). The gesture object (1060) is not displayed on the home screen (1006), but the gesture object (1060) can be recognized by the arrangement of the items.

[0174]

[0175] Figure 11 illustrates a home screen according to widget arrangement according to one embodiment.

[0176] Referring to FIGS. 1 and 11, in the application selection screen (1101), the processor (120) may display an app list. Multiple items may be selected by a specified user input. For example, when a long press input occurs, a user interface for selecting at least one app from the app list may be displayed.

[0177] After at least one application is selected, if a designated start input (e.g., a long press input) (1115) occurs, the processor (120) can switch from the application selection screen (1101) to the home screen (1102). After switching to the home screen (1102), a gesture input (1130) using a body part of the user (1100) can be initiated.

[0178] On the home screen (1102), representative images (or overlapping images) (1121) of multiple items to be arranged by a gesture input (1130) are displayed with a specified transparency to notify the user that the items are being arranged by the gesture input (1130). During the process of the gesture input (1130), the representative image (1121) can follow the path of the gesture input (1130).

[0179] According to one embodiment, the home screen (1102) may have widgets (1125) placed therein by default or user input.

[0180] A gesture input (1130) may occur on the home screen (1103), home screen (1104), and home screen (1105). The gesture input (1130) may be an input drawn so as not to overlap with the widget (1125) or to overlap within a specified ratio (e.g., 5%).

[0181] On the home screen (1106), if the gesture input (1130) is drawn so as not to overlap with the widget (1125) or to overlap within a specified ratio (e.g., 5%), the processor (120) may determine the line that does not overlap with the widget (1125) as a gesture object (1160). The processor (120) may place items along the gesture object (1160). The items may be placed so as not to overlap with the widget (1125).

[0182] The gesture object (1160) is not displayed on the home screen (1106), and the gesture object (1160) can be recognized by the arrangement of items.

[0183]

[0184] Figure 12 illustrates a home screen according to gestures and number of items according to one embodiment.

[0185] Referring to FIGS. 1 and 12, in the application selection screen (1201), the processor (120) can display a list of applications (app list) installed on the electronic device (101). Multiple icons can be selected by a specified user input. For example, when a long press input occurs, a user interface for selecting at least one of the app list can be displayed.

[0186] After at least one application is selected, if a designated start input (e.g., a long press input) (1215) occurs, the processor (120) can switch from the application selection screen (1201) to the home screen (1202). After switching to the home screen (1202), a gesture input (1220) using a body part of the user (1200) can be initiated.

[0187] On the home screen (1202), a gesture input (1220) may occur. The gesture input (1220) may be a line-shaped input directed in a specified direction. For example, the gesture input (1220) may be an input that starts from the left edge of the display and extends to the right edge. The processor (120) may determine a straight line starting from the left edge of the display and ending at the right edge as a gesture object (not shown).

[0188] In the home screen (1203) and the home screen (1204), a plurality of items (1222) can be spread out to be arranged along the line of the gesture object in an overlapping form (1221).

[0189] In the home screen (1205), if the arrangement length of a plurality of items is longer than the length of the gesture object, the processor (120) may arrange a plurality of gesture objects in the same or similar form and arrange the plurality of items along the plurality of gesture objects. For example, the processor (120) may arrange some (1222) of the plurality of items along the first line of the gesture object. The processor (120) may arrange other some (1223) of the plurality of items along the second line of the gesture object.

[0190]

[0191] Figure 13 illustrates a home screen according to a gesture and number of items according to one embodiment.

[0192] Referring to FIGS. 1 and 13, in the application selection screen (1301), the processor (120) can display a list of applications (app list) installed on the electronic device (101). Multiple icons can be selected by a specified user input. For example, when a long press input occurs, a user interface for selecting at least one of the app list can be displayed.

[0193] After at least one application is selected, if a designated start input (e.g., a long press input) (1315) occurs, the processor (120) can switch from the application selection screen (1301) to the home screen (1302). After switching to the home screen (1302), a gesture input (1330) using a body part of the user (1300) can be initiated.

[0194] On the home screen (1302), a gesture input (1320) may occur. The gesture input (1320) may be a line-shaped input directed in a specified direction. For example, the gesture input (1320) may be an input that starts from the upper left corner of the display and extends to the lower right corner. The processor (120) may determine a straight line starting from the upper left corner of the display and ending at the lower right corner as a gesture object (not shown).

[0195] On the home screen (1302), a representative image (or overlapping image) (1321) of a plurality of items to be arranged by a gesture input (1320) may be displayed with a specified transparency to notify the user that the items are being arranged by the gesture input (630). During the process of the gesture input (1320), the representative image (1321) may be fixed at a specified location or may follow the periphery of the gesture input (1320).

[0196] In the home screen (1303) and home screen (1304), multiple items can be changed from a duplicated form (1321) to a spread form (1322) arranged along the line of the gesture object.

[0197] In the home screen (1305), if the arrangement length of a plurality of items is longer than the length of a gesture object, the processor (120) can arrange a plurality of gesture objects in the same or similar form and arrange a plurality of items along the plurality of gesture objects.

[0198] For example, the processor (120) may arrange a first group (1322) of the plurality of items along a first line of the gesture object. The processor (120) may arrange a second group (1323) of the plurality of items along a second line of the gesture object. The processor (120) may arrange a third group (1324) of the plurality of items along a third line of the gesture object.

[0199]

[0200] Figure 14 illustrates a home screen according to gestures and number of items according to one embodiment.

[0201] Referring to FIGS. 1 and 14, a gesture input (1410) may occur on a home screen (1401) and a home screen (1402). The gesture input (1410) may be an input in the form of a line facing a specified direction. For example, the gesture input (1420) may be an input starting from the left edge of the display and extending to the right edge at the bottom of the display. The processor (120) may determine a straight line starting from the left edge of the display and ending at the right edge as a gesture object (not shown). The processor (120) may arrange a plurality of items (1410) along the line of the gesture object.

[0202] In the home screen (1403), if the arrangement length of a plurality of items is longer than the length of a gesture object, the processor (120) can arrange a plurality of gesture objects in the same or similar form and arrange a plurality of items along the plurality of gesture objects.

[0203] For example, the processor (120) may arrange a first group (1421) of the plurality of items along a first line of the gesture object. The processor (120) may arrange a second group (1422) of the plurality of items along a second line of the gesture object.

[0204] In the home screen (1404a) and the home screen (1404b), the processor (120) can switch between the home screen (1404a) and the home screen (1404b) by a page switching input (1445). If the arrangement length of a plurality of items is longer than the length of a gesture object, the processor (120) can arrange a plurality of gesture objects in the same or similar form on different pages. The processor (120) can arrange a plurality of items according to a plurality of gesture objects arranged on different pages.

[0205] For example, in the home screen (1404a), the processor (120) may arrange a first group (1421) of the plurality of items along a first line of a first page. In the home screen (1404b), the processor (120) may arrange a second group (1422) of the plurality of items along a second line of a second page.

[0206] On the home screen (1406), if the arrangement length of a plurality of items is longer than the length of the gesture object, the processor (120) may create a folder and store some of the plurality of items in the folder. The processor (120) may arrange some of the plurality of items (1461) and a folder icon (1462) along the gesture object (not shown).

[0207]

[0208] FIG. 15 illustrates a home screen that receives gesture input on a page-by-page basis according to one embodiment.

[0209] Referring to FIGS. 1 and 15, the processor (120) can configure the home screen into a plurality of pages. The processor (120) can switch pages of the home screen by a page switching input (1525).

[0210] On the first page (1501a) of the home screen, a gesture input (1510) may occur. The gesture input (1510) may be an input of touching a body part of the user (1500) on the display (160) and moving while drawing a shape or figure.

[0211] On the first page (1501b) of the home screen, the processor (120) may determine a first gesture object (e.g., a heart shape, a figure) corresponding to the user's first gesture input (1510). The processor (120) may determine a first gesture object (e.g., a heart) having a shape similar to the shape of the user's first gesture input (1510). The processor (120) may place items along the boundary of the first gesture object. For example, the placed items may be an icon for executing an application, a folder icon, or a sticker image. The processor (120) may display various background stickers (1511, 1513).

[0212] When a page change input (1525) occurs, the processor (120) can change the page of the home screen.

[0213] On the second page (1502a, 1502b) of the home screen, a second gesture input (1520) different from the first gesture input (1510) on the first page (1501a, 1501b) may be initiated by a touch input of a body part of the user (1500). The second gesture input (1520) may be an input of touching a body part of the user (1500) on the display (160) and drawing and moving a shape or figure.

[0214] A plurality of item images (1521) are displayed around the second gesture input (1520) with a specified transparency so that they can move together along the path of the gesture input (1520).

[0215] On the second page (1502c) of the home screen, the processor (120) can determine a second gesture object (e.g., a shape, a figure, a character) (1530) corresponding to the user's gesture input (1520). The processor (120) can determine a gesture object (1530) similar to the shape of the user's gesture input (1520).

[0216] The processor (120) can place items along the object boundary (1530a) of the gesture object (1530). For example, the placed items may be an icon for running an application, a folder icon, or a sticker.

[0217]

[0218] Fig. 16 shows a home screen according to a change in the background image according to one embodiment.

[0219] Referring to FIGS. 1 and 16, in the first screen (1601), the processor (120) can place a plurality of items (1610) along a gesture object (e.g., a heart) determined according to a user's gesture input.

[0220] In the second screen (1602), the processor (120) can change the background image based on a specified setting or user input. For example, the background image can include a first area (1621) of a first color and a second area (1622) of a second color.

[0221] In the third screen (1603), when the background image is changed, the processor (120) can rearrange the plurality of items according to the characteristics of the background image. The processor (120) can compare the color of each of the plurality of items (1610) with the first color and the second color, and divide the plurality of items (1610) into a first group (1631) similar to the first color and a second group (1632) similar to the second color.

[0222] In Fig. 16, the first group (1631) and the second group (1632) are exemplarily arranged in a line shape, but the present invention is not limited thereto. For example, the first group (1631) may be arranged in the first area (1621) to correspond to a reduced shape of the gesture object (e.g., a small heart), and the second group (1632) may be arranged in the second area (1622) to correspond to a reduced shape of the gesture object (e.g., a small heart).

[0223]

[0224] Fig. 17 illustrates the settings of a home screen according to one embodiment. Fig. 17 is exemplary and is not limiting.

[0225] Referring to FIG. 1 and FIG. 17, in the first screen (1701), the processor (120) can display a second screen (1702) for changing the home screen when a specified user input (e.g., long touch input) (1710) occurs.

[0226] In the second screen (1702), the processor (120) can display a third screen (1703) for setting the home screen in detail when a user input (1720) occurs in the setting button of the home screen.

[0227] In the third screen (1703), the processor (120) may display a plurality of lists related to the settings of the home screen. When the home screen grid settings option (1731) is selected (1730) from among the plurality of lists, the processor (120) may display a fourth screen (1704) including a user interface for grid settings.

[0228] A user interface for grid setup may include a first area (1741) containing grid layout related options and a second area (1742) displaying examples of layout of items.

[0229] When an option (1741a) regarding arrangement of multiple items by gesture input is selected in the first area (1741), the processor (120) can display an example (1742a) regarding arrangement of multiple items by gesture input in the second area (1742).

[0230]

[0231] Electronic devices often have a simple way of rearranging items on the home screen when the display size is expanded or reduced. When the display size is expanded, the items displayed on the home screen are either maintained or simply rearranged. Alternatively, when the display size is reduced, the items displayed on the home screen simply revert to their previous arrangement before the display size was expanded.

[0232] An electronic device according to an embodiment may include a display, a memory, and at least one processor including the display and processing circuitry. The memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to determine an item group including at least one icon for executing an application installed on the electronic device, receive a user's gesture input through the display, determine a first object corresponding to the gesture input, and arrange items included in the item group on the display based on a shape of the first object.

[0233] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to determine at least one additional item associated with the group of items and to display the at least one additional item along with the items on the display.

[0234] In one embodiment, the at least one additional item may be a widget, a sticker image, or a separate item not included in the group of items.

[0235] According to one embodiment, the instructions, when executed by the at least one processor, cause the electronic device to place the widget on the display without overlapping the first boundary of the first object or the items.

[0236] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to arrange the sticker image or the separate item on a first boundary of the first object.

[0237] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to place the sticker image inside or outside a first boundary of the first object, or to display the sticker image on the display as part of a background overlapping the first boundary.

[0238] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to arrange the items on a first boundary of the first object.

[0239] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to arrange the items by comparing the length of the first boundary with the array length of the items.

[0240] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to arrange the sticker image on or along the first boundary if the length of the first boundary is longer than the length of the array of items.

[0241] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to create a folder storing at least some of the items, and to arrange an icon of the folder along or at the first boundary together with another portion of the items, if the length of the first boundary is shorter than the arrangement length of the items.

[0242] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to detect a change in the size of the display, change the size or shape of the first object to create a second object, and arrange the items on the display based on the shape of the second object.

[0243] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to create a second object associated with the first object and larger in size than the first object, and to arrange the items at or along a second boundary of the second object when the size of the display is expanded.

[0244] In one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to arrange recommended items associated with the user along or at the second boundary.

[0245] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to create a third object associated with the first object and smaller in size than the first object, and to arrange the items at or along a third boundary of the third object when the size of the display is reduced.

[0246] In one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to create a folder for storing at least some of the items, and to arrange an icon of the folder along or at the third boundary together with another portion of the items.

[0247] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to arrange the items based on the shape of the first object and the grid arrangement when a grid limit is set on the display.

[0248] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to determine the first object as a plurality of objects having the same shape, and to arrange the items based on the arrangement shapes of the plurality of objects.

[0249] A method for displaying items according to one embodiment may include an operation performed on an electronic device, determining an item group including at least one icon for executing an application installed on the electronic device, an operation for receiving a user's gesture input through a display of the electronic device, an operation for determining a first object corresponding to the gesture input, and an operation for arranging items included in the item group on the display based on a shape of the first object.

[0250] In one embodiment, the method may further comprise determining at least one additional item associated with the group of items, and displaying the at least one additional item together with the items on the display.

[0251] According to one embodiment, the method may include an operation of detecting a change in the size of the display, an operation of changing the size or shape of the first object to create a second object, and an operation of arranging the items on the display based on the shape of the second object.

[0252] An electronic device according to one embodiment disclosed in this document can arrange items on a home screen in various ways based on a user's gesture input.

[0253] An electronic device according to one embodiment disclosed in this document can place items along the boundary of an object determined by a gesture input, and place additional items according to the length of the items.

[0254] An electronic device according to one embodiment disclosed in this document can reduce, enlarge, or change an object determined based on a gesture input when the display size is expanded or reduced. The electronic device can then arrange items based on the changed object to provide a variety of user experiences.

[0255]

[0256] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish the corresponding component from other corresponding components and do not limit the corresponding components in any other respect (e.g., importance or order). When a component (e.g., a first) is referred to as "coupled" or "connected" to another (e.g., a second) component, with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0257] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0258] Various embodiments of the present document may be implemented as software (e.g., program (10)) including one or more instructions stored in a storage medium (e.g., built-in memory (1436) or external memory (138)) readable by a machine (e.g., electronic device (1401)). For example, a processor (e.g., processor (1420)) of the machine (e.g., electronic device (1401)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0259] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0260] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; memory; and At least one processor comprising processing circuitry, The above memory, when executed individually or collectively by the at least one processor, causes the electronic device to: Determine a group of items including at least one icon for executing an application installed on the electronic device, Through the above display, the user's gesture input is received, Determine a first object corresponding to the above gesture input, An electronic device storing one or more instructions for arranging one or more items included in the item group on the display based on the shape of the first object.

2. In the first paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, Determine at least one additional item associated with the above group of items, An electronic device that displays at least one additional item on the display together with the one or more items.

3. In the second paragraph, the at least one additional item An electronic device that is a widget, sticker image, or separate item not included in the above group of items.

4. In the third paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, An electronic device that displays the widget on the display without overlapping the first boundary of the first object or the one or more items.

5. In the third paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, An electronic device that arranges the sticker image or the separate item along the first boundary of the first object.

6. In the third paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, An electronic device that displays the sticker image on the first side or the second side of the first boundary of the first object, or displays the sticker image on the display as part of a background overlapping the first boundary.

7. In the first paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, An electronic device that arranges one or more items included in the item group along the first boundary of the first object.

8. In the 7th paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, An electronic device that arranges one or more items included in the item group based on a comparison of the length of the first boundary and the array length of the one or more items.

9. In the 8th paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, An electronic device that arranges sticker images along the first boundary based on the length of the first boundary being longer than the array length of one or more items.

10. In the 8th paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, If the length of the first boundary is shorter than the array length of the one or more items, create an icon of a folder that stores at least a portion of the one or more items, An electronic device that arranges the icon of the folder along the first border together with other parts of the one or more items.

11. In the first paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, Detect changes in the size of the above display, Based on detecting a change in the size of the above display, a second object is created using the first object, An electronic device that arranges one or more items on the display based on the shape of the second object.

12. In the 11th paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, Based on the change in the size of the display being expanded, a second object is created that is associated with the first object and is larger than the first object, An electronic device that arranges one or more items along a second boundary of the second object.

13. In the 12th paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, An electronic device that arranges recommended items related to a user along said second boundary together with said one or more items.

14. In the 11th paragraph, when the one or more instructions are executed by the at least one processor, the electronic device, Based on the change in the size of the display being reduced, a third object is created that is associated with the first object and is smaller in size than the first object, An electronic device that arranges one or more items along a third boundary of the third object.

15. A method for displaying one or more items performed on an electronic device, An action of determining a group of items including at least one icon for executing an application installed on the electronic device; An action of receiving a user's gesture input through the display of the electronic device; An operation of determining a first object corresponding to the above gesture input; and A method comprising: an operation of arranging one or more items included in the item group on the display based on the shape of the first object.

Images