Method and device for displaying screen on basis of user input

Abstract

This electronic device may comprise: a display; at least one processor including a processing circuit; and a memory including one or more storage media for storing instructions, wherein the instructions, when executed by the processor, cause the electronic device to: determine similarity between a first page and a second page while displaying at least a part of the first page and at least a part of the second page through windows individually corresponding thereto on the display; enable concurrent scroll between the first page and the second page on the basis of the similarity between the first page and the second page; and on the basis of obtaining a swipe input while the concurrent scroll is enabled, apply the obtained swipe input to the first page and the second page.

Description

Method and device for displaying a screen based on user input

[0001] Below, a technology for displaying a screen based on user input is disclosed.

[0002] Various electronic devices, such as smart phones, tablet PCs, portable multimedia players (PMPs), personal digital assistants (PDAs), laptop personal computers, and wearable devices, are becoming widespread.

[0003] Electronic devices can display pages stored on the device on their displays. However, due to display size limitations, they cannot display all stored pages. The electronic device can display other portions of the page when it receives user input to scroll the page.

[0004] An electronic device comprises a display; at least one processor including a processing circuit; and a memory including one or more storage media storing instructions, wherein when the instructions are executed by the at least one processor, the electronic device can cause the electronic device to determine a similarity between the first page and the second page while displaying at least a portion of a first page and at least a portion of a second page through individually corresponding windows through the display, enable concurrent scrolling between the first page and the second page based on the similarity between the first page and the second page, and apply the acquired swipe input to the first page and the second page based on acquiring a swipe input while the simultaneous scrolling is enabled.

[0005] A method performed by an electronic device may include: determining a similarity between a first page and a second page while displaying at least a portion of a first page and at least a portion of a second page through individually corresponding windows via a display; enabling concurrent scrolling between the first page and the second page based on the similarity between the first page and the second page; and applying the acquired swipe input to the first page and the second page based on acquiring a swipe input while the simultaneous scrolling is enabled.

[0006] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0007] FIG. 2 is a flowchart illustrating an example of a method for an electronic device to display multiple pages according to various embodiments.

[0008] FIG. 3 is a diagram illustrating an example of an operation in which an electronic device according to various embodiments applies simultaneous scrolling to multiple pages.

[0009] FIG. 4 is a diagram illustrating examples of a page, a plurality of contents, and a display area according to various embodiments.

[0010] FIG. 5A is a diagram illustrating an example of an operation in which an electronic device according to various embodiments applies simultaneous scrolling to multiple pages using a simultaneous scroll object.

[0011] FIG. 5b is a diagram illustrating an example of an operation of an electronic device according to various embodiments to apply simultaneous scrolling to multiple pages using a simultaneous scroll object displayed when simultaneous scrolling is enabled.

[0012] FIG. 6 is a diagram illustrating an example of an operation in which an electronic device according to various embodiments applies simultaneous scrolling to multiple pages having different lengths.

[0013] FIG. 7 is a diagram illustrating an example of an operation of an electronic device according to various embodiments to switch between enabling and disabling simultaneous scrolling through a graphic object indicating whether simultaneous scrolling is enabled.

[0014] FIG. 8 is a diagram illustrating an example of an operation of an electronic device applying a scale adjustment input to multiple pages according to various embodiments.

[0015] Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the attached drawings, identical components are assigned the same reference numerals regardless of the drawing numbers, and redundant descriptions thereof will be omitted.

[0016] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0017] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0018] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0019] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0020] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0021] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0022] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0023] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0024] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0025] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0026] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0027] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0028] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0029] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0030] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0031] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0032] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0033] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0034] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0035] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0036] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0037] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0038] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104) or the server (108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0039] FIG. 2 is a flowchart illustrating an example of a method for an electronic device to display multiple pages according to various embodiments.

[0040] An electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1) can display a plurality of pages and apply an acquired user input (e.g., swipe input) to at least one page among the plurality of pages.

[0041] In operation (210), the electronic device can determine similarity between the first page and the second page while displaying at least a portion of the first page and at least a portion of the second page through individually corresponding windows.

[0042] In one embodiment, the page may include a web page. The web page may be provided as a wired and / or wireless Internet page via an Internet Protocol-based network (e.g., network (199) or server (108) of FIG. 1). The web page may have a uniform resource locator (URL) address for defining a connection path. The web page may be implemented in the form of, for example, a hypertext markup language (HTML) document or an extensible markup language (XML) document. The web page may be part of a website, which is a collection of interconnected web pages. For example, the electronic device may display at least a portion of the web page based on obtaining user input specifying the web page.

[0043] According to one embodiment, a page may include a screen provided by an application (e.g., application 146 of FIG. 1). For example, the page may correspond to a virtual space provided by the application. For example, the page may include a page corresponding to a chat room provided by a messaging application. For example, the page may include a page corresponding to a wish list provided by a shopping application. While executing the application, the electronic device may display at least a portion of the page corresponding to the virtual space based on obtaining user input to the page corresponding to the virtual space provided by the application.

[0044] A page may include multiple pieces of content. The content may include at least one of text, images, videos, or interfacing objects. Interfacing objects are components implemented to interact with the user, such as buttons or icons implemented to display different content and / or transition to different pages in response to user input.

[0045] An electronic device according to one embodiment can display corresponding pages through windows. Each window can individually correspond to a page (e.g., one-to-one correspondence). When the electronic device simultaneously displays a first page and a second page, the first page and the second page can be displayed through a first window corresponding to the first page and a second window corresponding to the second page.

[0046] As will be described in more detail later in FIG. 4, when an electronic device displays a page via a display, a portion of the page may be displayed, and the area of ​​the page displayed via the display may change based on user input. In various embodiments of the present disclosure, at least a portion of the page displayed via the display may be expressed as a display area.

[0047] An electronic device according to one embodiment can determine similarity between a first page and a second page.

[0048] Similarity between pages may include at least one of the following: similarity between the content contained within the pages, similarity in the layout of the content, or similarity between the applications providing the pages. Similarity between content may include visual similarity, similarity in substance, or similarity in function between the content contained within the pages.

[0049] According to one embodiment, the electronic device can determine similarity between pages based on similarity at the content level and similarity at the layout level.

[0050] For example, an electronic device may obtain information about contents placed on a first page and information about contents placed on a second page. The information about the contents may include at least one of an identifier of the contents (e.g., a resource identifier (resource ID)), a name, a location (e.g., coordinates), a size, a type of the contents (e.g., a text type, an image type, an interfacing object type (e.g., a button)), or a location of the contents in the structure of the page.

[0051] When an electronic device simultaneously displays first content on a first page and second content on a second page through a display, the electronic device can obtain information about the first content on the first page and information about the second content on the second page. The electronic device can use the information about the first content and the information about the second content to determine the similarity between the first content and the second content.

[0052] The structure of a page may refer to a hierarchical structure composed of contents included in the page. The structure of the page may include, for example, a tree structure and a list structure. The structure of the page may include a plurality of nodes, and each node may correspond to a content or a content group (also referred to as a 'view group' in the present disclosure) having a plurality of contents. In various embodiments of the present disclosure, each content included in the page may be expressed as a view, and the structure of the page may be expressed as a component tree, a view tree, or a view hierarchy. The location of the content in the structure of the page may include, for example, the location of a node corresponding to the content or a node corresponding to a content group (or view group) including the content in the structure of the page.

[0053] According to one embodiment, the electronic device can obtain information about the content of a page (e.g., a user interface component (UI component)) using a user interface development tool (e.g., UIAutomator2 of Android).

[0054] An electronic device may determine content-level similarity based on the similarity between each piece of content on a first page and each piece of content on a second page. Content-level similarity may include visual similarity between the pieces of content. Visual similarity may include color similarity or matching of at least some of the visual appearances of each piece of content. Content-level similarity may include functional similarity between the pieces of content. For example, functional similarity may be high when the pieces of content are all interfacing objects, or when the interfacing objects perform the same function (e.g., linking to another page).

[0055] The electronic device can determine layout-level similarity, which indicates similarity between the positions of content within a page, based on the positions of each content within a first page and each content within a second page. The layout-level similarity may include similarity between the positions of content within a page structure. The layout-level similarity may be determined between each content within a first page and each content within a second page.

[0056] The electronic device can determine similarity between the first page and the second page based on similarity of the determined content level and similarity of the determined layout level.

[0057] In one embodiment, an electronic device can determine the similarity between a first page and a second page using a similarity determination model. The electronic device can determine a similarity score between the first page and the second page by applying the similarity determination model to input data.

[0058] A similarity determination model may refer to a model generated and / or trained to output output data including a similarity score between the first and second pages by being applied to input data based on the first and second pages. In one embodiment, the similarity determination model may be implemented based on a machine learning model, and may include, for example, a neural network (e.g., convolutional neural networks (CNN)).

[0059] The input data of the similarity determination model (hereinafter also referred to as "input data") can be generated based on the first page and the second page. For example, the input data can be generated based on a first image based on the first page and a second image based on the second page. For example, the input data can include first partial input data including text extracted from a plurality of contents of the first page and second partial input data including text extracted from a plurality of contents of the second page. Images or videos (e.g., multiple image frames) included in a page can be converted into text through image captioning.

[0060] Input data according to one embodiment may include information about content.

[0061] According to one embodiment, the electronic device can determine similarity between the first page and the second page based on a first application providing the first page and a second application providing the second page.

[0062] For example, the electronic device may determine similarity between a first page and a second page based on whether the first application is similar to the second application.

[0063] For example, an electronic device may determine the similarity between a first page and a second page based on whether the first application is of the same type as the second application. The type of application may be distinguished based on the properties of the service provided to the user through the application. The type of application may include, for example, at least one of a shopping type, a message type, a search type, a securities type, a bank type, a card type, a call type, a video playback type, a webtoon type, or a map type. The electronic device may determine that the first page is similar to the second page based on whether the first page and the second page are provided through the same type of application. The type of application may be determined in advance as information set in the application and / or as a type selected by the user.

[0064] For example, the electronic device may determine the similarity between the first page and the second page based on the first application and the second application being mapped by the user. The first application and the second application may be mapped by the user.

[0065] For example, an electronic device may generate an application folder containing two or more applications among a plurality of applications installed on the electronic device based on user input. The electronic device may determine that a first page is similar to a second page based on the fact that the first application and the second application are included in one application folder.

[0066] For example, an electronic device may designate a plurality of applications (e.g., two applications, three applications) as an application pair based on user input. When the electronic device obtains user input for the application pair, the electronic device may display a screen (e.g., at least a portion of a page) of each of the plurality of applications through a window individually corresponding to the plurality of applications included in the application pair. The electronic device may determine that the first page is similar to the second page based on the fact that the first application and the second application are designated as the same application pair.

[0067] In operation (220), the electronic device may enable concurrent scrolling between the first page and the second page based on similarity between the first page and the second page.

[0068] In one embodiment, the electronic device may enable simultaneous scrolling based on a similarity score between the first and second pages. For example, the electronic device may determine whether to enable simultaneous scrolling by comparing the similarity score to a threshold similarity score.

[0069] In one embodiment, the electronic device may enable simultaneous scrolling based on determining that the first page is similar to the second page. For example, the electronic device may enable simultaneous scrolling between the first page and the second page based on the first page and the second page being provided by the same application. For example, the electronic device may enable simultaneous scrolling between the first page and the second page based on the first application being of the same type as the second application. For example, the electronic device may enable simultaneous scrolling between the first page and the second page based on the first application and the second application being mapped by the user.

[0070] In various embodiments of the present disclosure, simultaneous scrolling is not limited to being enabled based on the relationship between pages. For example, the electronic device may enable simultaneous scrolling based on user input.

[0071] According to one embodiment, an electronic device may enable simultaneous scrolling based on user input indicating that simultaneous scrolling is enabled. For example, the electronic device may display a graphical object corresponding to the enabling of simultaneous scrolling (hereinafter also referred to as an "enable object"). The electronic device may enable simultaneous scrolling based on obtaining user input for the enable object.

[0072] An electronic device may disable simultaneous scrolling based on user input indicating that simultaneous scrolling is to be disabled. For example, the electronic device may display a graphic object corresponding to the disabling of simultaneous scrolling (hereinafter also referred to as a "disable object"). The electronic device may disable simultaneous scrolling based on obtaining user input regarding the disable object.

[0073] The enable object and the disable object may be implemented and / or displayed as a single graphic object. The electronic device may switch between enabling and disabling simultaneous scrolling based on user input to the graphic object. In one embodiment, the electronic device may determine whether to enable or disable simultaneous scrolling based on the user's selection when the user desires simultaneous scrolling between a first page and a second page. An embodiment of switching between enabling and disabling simultaneous scrolling based on user input to the graphic object is described in more detail below with reference to FIG. 7.

[0074] In one embodiment, the electronic device may enable simultaneous scrolling based on a history of simultaneous scrolling applied between pages. The history of simultaneous scrolling applied may include a first record of simultaneous scrolling applied to a first page and a second page, and / or a second record of restricting the application of simultaneous scrolling to the first page and the second page. The history of simultaneous scrolling applied may be built by user, by user group (e.g., a user group designated by age, gender, and / or interests), and / or comprehensively without distinction of users (or user groups).

[0075] The first record and / or the second record may each include at least one of: whether simultaneous scrolling is applied, an identifier (e.g., URL address) of the first page or the second page, information about an application providing the first page or the second page, at least a portion of the content included in the first page or the second page, input data of a similarity determination model based on the first page and the second page, or output data (e.g., a similarity score) of a similarity determination model.

[0076] According to one embodiment, the first record and / or the second record may further include, respectively, whether the automatically determined simultaneous scrolling enablement was toggled by user input.

[0077] For example, the electronic device may automatically enable or disable simultaneous scrolling (e.g., independently of user input) based on similarity between pages. Subsequently, the electronic device may manually (e.g., dependent on user input) enable or disable simultaneous scrolling upon detecting user input. The electronic device may generate and / or store a first record when disabling simultaneous scrolling based on similarity between pages and subsequently enabling simultaneous scrolling in response to detected user input. The electronic device may generate and / or store a second record when enabling simultaneous scrolling based on similarity between pages and subsequently disabling simultaneous scrolling in response to detected user input.

[0078] The electronic device may enable simultaneous scrolling between the first page and the second page if there is a record in the history that applies simultaneous scrolling between the first page and the second page. The electronic device may disable simultaneous scrolling between the first page and the second page if there is a record in the history that restricts the application of simultaneous scrolling between the first page and the second page. If there are multiple records regarding the first page and the second page, the electronic device may determine whether to enable simultaneous scrolling based on some of the records (e.g., the most recent record) or a record that has a greater number of records among the records that applied simultaneous scrolling or the records that restrict the application of simultaneous scrolling.

[0079] The electronic device may determine whether to enable simultaneous scrolling using a similarity detection model trained based on history. For example, based on a first record, training input data and a true similarity score for training the similarity detection model may be determined. The true similarity score may be determined as a score exceeding a threshold similarity score. Based on a second record, training input data and a true similarity score for training the similarity detection model may be determined. The true similarity score may be determined as a score less than or equal to a threshold similarity score.

[0080] According to one embodiment, the first similarity determination model may be a model generated and / or trained based on data from a plurality of users (e.g., all users). The second similarity determination model may be a model that is further trained (e.g., fine-tuned) using a history of simultaneous scrolling collected from a specific user and / or a specific user group based on the first similarity determination model. Consequently, the second similarity determination model may be customized for a specific user and / or a specific user group. The electronic device may obtain the second similarity determination model based on the history of simultaneous scrolling from the first similarity determination model, and enable simultaneous scrolling between the first page and the second page using the second similarity determination model. However, the similarity determination model according to various embodiments of the present disclosure is not limited to being further trained based on a history from a specific user and / or a specific user group, and the similarity determination model may be further trained without distinction between users and / or user groups.

[0081] In operation (230), the electronic device may apply the acquired swipe input to the first page and the second page based on acquiring the swipe input while simultaneous scrolling is enabled.

[0082] A swipe input may refer to an input for moving a display area of ​​a page within a page in a specific direction (e.g., a scroll direction). The swipe input may have a swipe direction and a swipe speed. According to one embodiment, the swipe input may be detected in an area corresponding to at least one of a first page or a second page. According to one embodiment, the swipe input may be detected in an area corresponding to a graphic object (e.g., a simultaneous scroll object) for a plurality of pages (e.g., the first page and the second page). An example of an embodiment in which a swipe input is detected in an area corresponding to a page is described in more detail below in FIG. 3, and an example of an embodiment in which a swipe input is detected in an area corresponding to a graphic object for a plurality of pages is described in more detail below in FIGS. 5A and 5B.

[0083] For example, when the electronic device detects a continuous user input from a first point to a second point on a display module (e.g., the display module (160) of FIG. 1), the electronic device may acquire a swipe input from the first point to the second point. The continuous user input from the first point to the second point may mean that at least a part of the display module and an object (e.g., the user's finger, an electronic pen) are in contact with each other at the first point on the display, and the object moves from the first point on the display to the second point on the display while the contact between the display module and the object is maintained. The swipe direction of the swipe input may be set in the direction from the second point to the first point, and the swipe speed of the swipe input may be set based on the distance between the first point and the second point or the length of time during which the swipe input is acquired.

[0084] However, the swipe input is not limited to a continuous user input from a first point to a second point, and the swipe input can be obtained based on a user operation on an input device (e.g., a mouse wheel) for obtaining the swipe input.

[0085] Applying a swipe input to a page may mean moving a display area within the page. For example, a scroll direction and a scroll speed may be determined based on the swipe input. The electronic device may determine the scroll direction based on the swipe direction of the swipe input. For example, the electronic device may determine the swipe direction in the same direction as the swipe direction. For example, the electronic device may determine the direction most similar to the swipe direction (e.g., the candidate scroll direction that forms the smallest angle with the swipe direction) among a plurality of candidate scroll directions as the scroll direction. The electronic device may determine the scroll speed based on the swipe speed of the swipe input. For example, the electronic device may determine the scroll speed as a constant multiple of the swipe speed (e.g., a value obtained by multiplying the swipe speed by a predetermined constant).

[0086] An electronic device can move the display area of ​​a page in the scroll direction within the page. The electronic device can move the display area of ​​the page based on the scroll speed within the page. The movement of the display area within the page is described in more detail below in FIG. 4.

[0087] The electronic device may apply a swipe input to both the first page and the second page based on the simultaneous scrolling being enabled. The electronic device may move the display area of ​​the first page in the scroll direction within the first page, and move the display area of ​​the second page in the scroll direction within the second page.

[0088] According to one embodiment, the electronic device may also apply the same scroll speed between the first page and the second page. For example, the distance between the first display area of ​​the page (e.g., the display area before the swipe input is applied) and the second display area of ​​the page (e.g., the display area after the swipe input is applied) may be the same between the first and second pages. The distance between the display areas may be determined by the distance between the reference points of the display areas (e.g., the center points of the display areas).

[0089] According to one embodiment, the electronic device may apply a scroll speed based on the similarity between the content of the first page and the content of the second page. For example, the electronic device may move a first display area displayed through a display among the first pages in response to a swipe input based on the simultaneous scrolling being enabled. The electronic device may display the first content included in the moved first display area through a window corresponding to the first page. According to one embodiment, the first content may refer to at least a portion of the content included in the first display area.

[0090] The electronic device can determine second content corresponding to the first content based on similarity in content level and similarity in layout level. The electronic device can move the second display area displayed on the second page to include the second content. The electronic device can display the second content of the second page through a window corresponding to the second page. The electronic device can control the scroll speed to move the second display area to include the second content.

[0091] According to one embodiment, when displaying first content at a first location in a window corresponding to a first page, the electronic device may determine a second location corresponding to the first location among areas corresponding to a window corresponding to a second page, and display the second content at the determined second location. The first location and the second location may be locations having the same height on the corresponding windows.

[0092] According to one embodiment, the second content may refer to content selected as corresponding to the first content based on content level similarity and layout level similarity among the contents included in the second page. According to one embodiment, as described above in operation (230), the electronic device may determine content level similarity and layout level similarity between the first content and the second content based on information about the contents. The electronic device may determine a correspondence between at least some of the contents included in the first page and at least some of the contents included in the second page based on at least one of the structures of the first page and the second page, content level similarity between the contents, or layout level similarity between the contents.

[0093] For example, the electronic device may apply the swipe input to the second page even if the swipe input is detected only in an area corresponding to the first page (e.g., a window corresponding to the first page). The electronic device may detect the swipe input to the first page even if the swipe input is not directly detected for the second page (e.g., the swipe input is not detected in an area corresponding to the second page), and apply the swipe input to the second page as well if simultaneous scrolling between the first and second pages is enabled.

[0094] The electronic device may restrict the application of the acquired swipe input to the first page and the second page based on the simultaneous scroll being disabled. For example, the electronic device may move the display area of ​​the first page within the first page and maintain (e.g., not change) the display area of ​​the second page.

[0095] FIG. 3 is a diagram illustrating an example of an operation in which an electronic device according to various embodiments applies simultaneous scrolling to multiple pages.

[0096] According to one embodiment, an electronic device (e.g., electronic device (101) of FIG. 1) can display a display area of ​​a first page through a first window (311) and a display area of ​​a second page through a second window (312) on a screen (310).

[0097] The electronic device may acquire a swipe input (313) in an area corresponding to the second window (312). The electronic device may determine whether to enable simultaneous scrolling between the first page and the second page. For example, the electronic device may enable simultaneous scrolling based on similarity between the content of the first page and the content of the second page. Acquisition of the swipe input (313) and enabling of the simultaneous scrolling may be performed at independent times. For example, simultaneous scrolling may be enabled or disabled after the swipe input (313) is acquired, and / or simultaneous scrolling may be enabled or disabled after the swipe input (313) is acquired.

[0098] An electronic device may display a graphical object indicating that simultaneous scrolling is enabled based on the fact that simultaneous scrolling is enabled. The graphical object indicating that simultaneous scrolling is enabled may, for example, include a box bounding windows. As an example in FIG. 3 , the electronic device may display a graphical object (314) surrounding a first window (311) and a second window (312) on a screen (310) based on the fact that simultaneous scrolling between the first window (311) and the second window (312) is enabled. Although not explicitly illustrated in FIG. 3 , the electronic device may restrict the display of the graphical object (314) based on the fact that simultaneous scrolling between the first window (311) and the second window (312) is disabled.

[0099] The electronic device can apply a swipe input to both the first page and the second page. The electronic device can move the display area of ​​the first page displayed through the first window (321) on the screen (320) within the first page based on the scroll direction of the swipe input (313). The electronic device can move the display area of ​​the second page displayed through the second window (322) on the screen (320) within the second page based on the scroll direction of the swipe input (313). For example, as illustrated in FIG. 3, the electronic device can display a graphic object (324) based on the simultaneous scrolling between the first page and the second page being enabled.

[0100] FIG. 4 is a diagram illustrating examples of a page, a plurality of contents, and a display area according to various embodiments.

[0101] An electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1) can display at least a portion of a page (410) through a display (e.g., display module (160) of FIG. 1).

[0102] A page (410) according to one embodiment may include a plurality of contents. Each content included in the page (410) may be arranged in at least a portion of the page (410). For example, in FIG. 4 , the page (410) may include a first content (411-1), a second content (411-2), a third content (411-3), a fourth content (411-4), a fifth content (411-5), a sixth content (411-6), a seventh content (411-7), an eighth content (411-8), a ninth content (411-9), and a tenth content (411-10). Each content in the page (410) may be arranged as illustrated in FIG. 4 . The first content (411-1), the third content (411-3), the fourth content (411-4), the eighth content (411-8), and the ninth content (411-9) may include text. The second content (411-2), the sixth content (411-6), and the seventh content (411-7) may include images. The fifth content (411-5) and the tenth content (411-10) may include videos.

[0103] For example, in FIG. 4, the electronic device may display a first display area (420) among pages (410) on a screen (401). The first display area (420) may include second content (411-2), third content (411-3), fourth content (411-4), fifth content (411-5), sixth content (411-6), and seventh content (411-7). The first display area (420) may not include first content (411-1), eighth content (411-8), ninth content (411-9), and tenth content (411-10) among the contents included in the page (410).

[0104] An electronic device may acquire a swipe input (414) for a page (410) while displaying a first display area (420) among pages (410). The swipe input (414) may have a scroll direction (e.g., a direction from top to bottom of the electronic device as illustrated in FIG. 4). Based on acquiring the swipe input (414), the electronic device may move the display area within the page (410). For example, the electronic device may change the display area from the first display area (420) to the second display area (430) within the page (410).

[0105] An electronic device may display a first display area (430) among pages (410) on a screen (402). The second display area (430) may include third content (411-3), fourth content (411-4), fifth content (411-5), sixth content (411-6), seventh content (411-7), and eighth content (411-8). The first display area (420) may not include the first content (411-1), second content (411-2), ninth content (411-9), and tenth content (411-10) among the contents included in the page (410).

[0106] FIG. 5A is a diagram illustrating an example of an operation in which an electronic device according to various embodiments applies simultaneous scrolling to multiple pages using a simultaneous scroll object.

[0107] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1) may display a simultaneous scroll object (513a) based on displaying at least a portion of a first page and at least a portion of a second page. The electronic device may obtain a swipe input (514a) through the simultaneous scroll object (513a), and apply the obtained swipe input (514a) to the first page and the second page.

[0108] In one embodiment, the electronic device is configured such that simultaneous scrolling between a first page and a second page is enabled or disabled independently based on at least one of similarity between the pages, a user input indicating whether simultaneous scrolling is enabled, or a history of simultaneous scrolling being applied, and a swipe input (514a) obtained through a simultaneous scroll object (513a) can be applied to both the first page and the second page.

[0109] For example, even if the electronic device has disabled simultaneous scrolling based on similarity between the first and second pages, the swipe input (514a) can be applied to both the first and second pages based on obtaining the swipe input (514a) through the simultaneous scroll object (513a). For example, even if the electronic device has disabled simultaneous scrolling based on a user input indicating disabling the simultaneous scrolling, the swipe input (514a) can be applied to both the first and second pages based on obtaining the swipe input (514a) through the simultaneous scroll object (513a).

[0110] As shown in FIG. 5a, the electronic device can display a display area of ​​a first page through a first window (511a) and a display area of ​​a second page through a second window (512a) on a screen (510a). The electronic device can display a simultaneous scroll object (513a). For example, the electronic device can display the simultaneous scroll object (513a) in an area adjacent to or overlapping both the first window (511a) and the second window (512a). However, the simultaneous scroll object (513a) is not limited to being displayed in an area adjacent to or overlapping both the first window (511a) and the second window (512a), and the simultaneous scroll object (513a) may also be displayed at a location spaced apart from at least one of the first window (511a) or the second window (512a).

[0111] An electronic device can obtain a swipe input (514a) through a simultaneous scroll object (513a) on a screen (510a). Based on the swipe input (514a) obtained through the simultaneous scroll object (513a), the electronic device can apply the swipe input (514a) to a first page and a second page. The electronic device can move a display area of ​​a first page displayed through a first window (521a) on a screen (520a) within the first page based on the scroll direction of the swipe input (514a). The electronic device can move a display area of ​​a second page displayed through a second window (522a) on the screen (520a) within the second page based on the scroll direction of the swipe input (514a).

[0112] In FIG. 5A, the electronic device primarily describes, but is not limited to, displaying a simultaneous scroll object (513a) based on displaying at least a portion of a first page and at least a portion of a second page. According to one embodiment, the electronic device may display the simultaneous scroll object (513a) based on enabling simultaneous scrolling between the first page and the second page. Displaying the simultaneous scroll object (513a) based on enabling simultaneous scrolling is described in more detail below in FIG. 5B.

[0113] FIG. 5b is a diagram illustrating an example of an operation of an electronic device according to various embodiments to apply simultaneous scrolling to multiple pages using a simultaneous scroll object displayed when simultaneous scrolling is enabled.

[0114] An electronic device according to one embodiment may display a split screen object (513b) based on displaying at least a portion of a first page and at least a portion of a second page on a screen (510b). The split screen object (513b) may include a graphic object related to performing a function for a plurality of windows (e.g., a function for swapping windows corresponding to a plurality of pages, a function for switching between left-right arrangement and top-bottom arrangement, a function for registering to an application pair) in a split screen in which the electronic device simultaneously displays portions of a plurality of pages through a plurality of windows. The electronic device may provide a function for the plurality of windows based on detecting a user input for the split screen object (513b).

[0115] An electronic device according to one embodiment may display either a split screen object (513b) or a simultaneous scroll object (523b) based on whether simultaneous scrolling between the first page and the second page is enabled when displaying at least a portion of a first page and at least a portion of a second page. The electronic device may set the position and / or size at which the split screen object (513b) is displayed to be the same when simultaneous scrolling is disabled, and the position and / or size at which the simultaneous scroll object (523b) is displayed to be the same when simultaneous scrolling is enabled.

[0116] For example, the electronic device may display a split screen object (513b) based on the fact that simultaneous scrolling between the first page and the second page is disabled on the screen (510b). While displaying the split screen object (513b), the electronic device may detect a swipe input for the first page and restrict the swipe input from being applied to the first page and the second page. Similarly, while displaying the split screen object (513b), the electronic device may detect a swipe input for the second page and restrict the swipe input from being applied to the first page.

[0117] An electronic device according to one embodiment may display a simultaneous scroll object (523b) on a screen (520b) based on the simultaneous scrolling between a first page and a second page being enabled. The electronic device may display the simultaneous scroll object (523b) based on the simultaneous scrolling being enabled, and while displaying the simultaneous scroll object (523b), may apply a swipe input (524b) to the first page and the second page based on obtaining a swipe input (524b) through the simultaneous scroll object (523b).

[0118] The electronic device can move the display area of ​​the first page displayed through the first window (531b) on the screen (530b) within the first page based on the scroll direction of the swipe input (524b). The electronic device can move the display area of ​​the second page displayed through the second window (532b) on the screen (530b) within the second page based on the scroll direction of the swipe input (524b).

[0119] The electronic device may acquire a swipe input in an area corresponding to a window (e.g., a first window (521b), a second window (522b)) independently of the simultaneous scroll object (523b) while displaying the simultaneous scroll object (523b) on the screen (520b). For example, the electronic device may acquire a swipe input (525b) in an area corresponding to the second window (522b) on the screen (520b). Based on acquiring a swipe input (525b) independent of the simultaneous scroll object (523b) while displaying the simultaneous scroll object (523b), the electronic device may apply the swipe input to the second page and restrict the application of the swipe input to the first page. The electronic device may move the display area of ​​the second page in a scroll direction determined based on the swipe input (525b) and restrict the movement of the display area of ​​the first page (e.g., maintain the display area).

[0120] On the screen (540b), the electronic device can maintain the display area of ​​the first page displayed through the first window (541b). The electronic device can move the display area of ​​the second page displayed through the second window (542b) in the scroll direction. As a result, the display area of ​​the first page remains unchanged, while the display area of ​​the second page can be changed.

[0121] FIG. 6 is a diagram illustrating an example of an operation in which an electronic device according to various embodiments applies simultaneous scrolling to multiple pages having different lengths.

[0122] An electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1) can move an area displayed through a display within a first page and a second page in the scroll direction of a swipe input. For example, the electronic device can move the display area of ​​the first page in the scroll direction within the first page. The electronic device can move the display area of ​​the second page in the scroll direction within the second page.

[0123] In FIG. 6, the electronic device can display a first page (611) and a second page (612). The electronic device can display a display area (613) of the first page (611) and a display area (614) of the second page (612).

[0124] The electronic device can obtain a swipe input for at least one of the first page (611) or the second page (612). The electronic device can apply the swipe input to both the first page (611) and the second page (612). The scroll direction of the swipe input can be, for example, from top to bottom in FIG. 6.

[0125] The electronic device can move an area displayed through the display among the first page (621) from the display area (613) to the display area (623). The electronic device can move an area displayed through the display among the second page (622) from the display area (614) to the display area (624).

[0126] According to one embodiment, the electronic device may stop the movement of an area displayed within a page based on the area displayed within one of the first page or the second page reaching the end of the page. The electronic device may move an area displayed within another page in the scroll direction based on the area displayed within the other page not reaching the end of the other page.

[0127] A visible area within a page that reaches the end of the page may mean that there are no other areas within the page that are positioned in the scroll direction from the visible area of ​​the page (e.g., the viewable area).

[0128] For example, the electronic device can obtain a swipe input in the longitudinal direction (601) of the page or in the direction opposite to the longitudinal direction (601) of the page. For example, in the first page (611) of FIG. 6, the longitudinal direction (601) of the page can be defined as a direction from top to bottom. When the page has a rectangular shape, among the four sides of the page, the first side (602) and the second side (603) that are perpendicular to the longitudinal direction (601) of the page can be defined as the end of the page. For example, in FIG. 6, among the first side (602) and the second side (603), the upper side can be expressed as the first side (602), and the lower side can be expressed as the second side (603).

[0129] If the display area is adjacent to the second side (603) and the scroll direction is in the longitudinal direction of the page (601), the display area may be determined to have reached the end of the page. If the display area is spaced apart from the second side (603) and the scroll direction is in the longitudinal direction of the page (601), the display area may be determined to have not reached the end of the page. If the display area is adjacent to the first side (602) and the scroll direction is opposite to the longitudinal direction of the page (601), the display area may be determined to have reached the end of the page. If the display area is spaced apart from the first side (602) and the scroll direction is opposite to the longitudinal direction of the page (601), the display area may be determined to have not reached the end of the page.

[0130] Referring to FIG. 6, the electronic device may obtain a swipe input for at least one of a first page (621) or a second page (622). The electronic device may apply the swipe input to the first page (621) and the second page (622) depending on whether simultaneous scrolling is enabled. The swipe input may have a length direction (601) of the page as a scroll direction. The electronic device may stop moving the display area (623) of the first page (621) based on the display area (623) of the first page (621) reaching the end of the first page (621). For example, the electronic device may maintain the display area of ​​the first page (631) as the display area (623) or the display area (633). The electronic device may move the displayed area of ​​the second page (632) from the display area (624) to the display area (634) based on the display area (624) of the second page (622) not reaching the end of the second page (622).

[0131] The electronic device may restrict movement of the display area (623) of the first page (621) based on the display area (623) of the first page (621) reaching the end of the first page (621), even if a swipe input for the first page (621) is obtained.

[0132] The electronic device can obtain a swipe input for at least one of the first page (631) or the second page (632). The swipe input can have a length direction (601) of the page as a scroll direction. The electronic device can maintain an area of ​​the first page (641) that is displayed through the display as the display area (633) or the display area (643) based on whether the display area (633) of the first page (631) has reached the end of the first page (631). The electronic device can move an area of ​​the second page (642) that is displayed from the display area (634) to the display area (644) based on whether the display area (634) of the second page (632) has not reached the end of the second page (632).

[0133] The electronic device may obtain a swipe input for at least one of the first page (641) or the second page (642). The swipe input may have a length direction (601) of the page as a scroll direction. The electronic device may stop (e.g., limit) moving the display areas of the first page (641) and the second page (642) based on the display area (643) of the first page (641) reaching the end of the first page (641) and the display area (644) of the second page (642) reaching the display area of ​​the second page (642).

[0134] FIG. 7 is a diagram illustrating an example of an operation of an electronic device according to various embodiments to switch between enabling and disabling simultaneous scrolling through a graphic object indicating whether simultaneous scrolling is enabled.

[0135] An electronic device (e.g., electronic device (101) of FIG. 1) according to one embodiment may display a graphic object indicating whether simultaneous scrolling is enabled through a display (e.g., display module (160) of FIG. 1). The graphic object may be displayed as a first graphic representation (713) when simultaneous scrolling is enabled, and may be displayed as a second graphic representation (723) when simultaneous scrolling is disabled.

[0136] The electronic device can enable and disable simultaneous scrolling based on detecting user input (714) for a graphical object. For example, if simultaneous scrolling is enabled, the electronic device can disable simultaneous scrolling based on user input (714) for the graphical object. The electronic device can display the graphical object by changing from a first graphical representation (713) to a second graphical representation (723). If simultaneous scrolling is disabled, the electronic device can enable simultaneous scrolling based on user input for the graphical object. The electronic device can display the graphical object by changing from a second graphical representation (723) to a first graphical representation (713).

[0137] Referring to FIG. 7, according to one embodiment, an electronic device may display a display area of ​​a first page through a first window (711) and a display area of ​​a second page through a second window (712) on a screen (710). On the screen (710), the electronic device may display a graphic object indicating whether simultaneous scrolling between the first page and the second page is enabled. In FIG. 7, simultaneous scrolling between the first page and the second page may be enabled. The electronic device may display the graphic object as a first graphic representation (713) indicating enablement of simultaneous scrolling. On the screen (710), the electronic device may detect a user input (714) for the graphic object.

[0138] On the screen (720), the electronic device can switch simultaneous scrolling from enabled to disabled based on a user input (714). The electronic device can change the graphic object to a second graphic representation (723) and display it. On the screen (720), the electronic device can obtain a swipe input (724) for a second page in an area corresponding to a second window (722). Based on the simultaneous scrolling being disabled, the electronic device can apply the swipe input to the second page and restrict the application of the swipe input to the first page. The electronic device can move the display area of ​​the second page in a scroll direction determined based on the swipe input and restrict the movement of the display area of ​​the first page (e.g., maintain the display area).

[0139] On the screen (730), the electronic device can maintain the display area of ​​the first page displayed through the first window (731). The electronic device can move the display area of ​​the second page displayed through the second window (732) in the scroll direction. As a result, the display area of ​​the first page remains unchanged, and the display area of ​​the second page can be changed.

[0140] FIG. 8 is a diagram illustrating an example of an operation of an electronic device applying a scale adjustment input to multiple pages according to various embodiments.

[0141] An electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1) may, while displaying a plurality of pages, apply a scale adjustment input (813) to at least one page among the plurality of pages.

[0142] The electronic device may obtain a magnification adjustment input (813) that instructs to zoom in or zoom out for at least one of the first page or the second page.

[0143] The magnification adjustment input (813) may refer to an input for adjusting the magnification applied to display a page on a display. The magnification adjustment input (813) may have a reference point, an adjustment direction (e.g., increase, decrease), or an adjustment amount.

[0144] The electronic device may enable concurrent magnification adjustment between the first and second pages based on similarity between the first and second pages. As described above in FIG. 2 , the similarity between the pages may include at least one of similarity between the contents included in the pages, similarity in the layout of the contents, or similarity between the applications providing the pages.

[0145] An electronic device may enable simultaneous scaling, similar to the operation for enabling simultaneous scrolling. For example, the electronic device may enable simultaneous scaling based on the similarity between a first page and a second page. The electronic device may determine the similarity between the first page and the second page using a similarity determination model. For example, the electronic device may enable simultaneous scaling based on a first application providing the first page and a second application providing the second page. For example, the electronic device may enable or disable simultaneous scrolling based on a user input indicating the enabling or disabling of simultaneous scaling.

[0146] The electronic device can apply the acquired scaling input (813) to the first page and the second page based on the simultaneous scaling being enabled.

[0147] Applying a scale adjustment input (813) to a page may mean changing the scale at which the page is displayed. The scale at which the page is displayed may be adjusted in the direction of adjustment (e.g., increasing or decreasing) based on the reference point of the scale adjustment input (813) (e.g., center).

[0148] The electronic device may apply the acquired scaling input (813) to at least one page based on the fact that simultaneous scaling is disabled, and may restrict the application of the acquired scaling input (813) to at least one page and to another page. For example, the electronic device may obtain the scaling input (813) for one of the first page or the second page. The electronic device may apply the scaling input (813) to one of the first page or the second page. The electronic device may restrict the application of the scaling input (813) to another page of the first page or the second page based on the fact that simultaneous scaling is disabled.

[0149] Referring to FIG. 8, the electronic device can display a display area of ​​a first page through a first window (811) and a display area of ​​a second page through a second window (812) on a screen (810).

[0150] On the screen (810), the electronic device may acquire a magnification input (813) in an area corresponding to the second window (812). For example, the magnification input (813) may indicate zoom-in. The electronic device may determine whether to enable simultaneous magnification between the first page and the second page. For example, the electronic device may enable simultaneous magnification based on similarity between the content of the first page and the content of the second page. Acquisition of the magnification input (813) and enabling of the simultaneous magnification may be performed at independent times. For example, simultaneous magnification may be enabled or disabled after the magnification input (813) is acquired, and / or simultaneous magnification may be enabled or disabled after the magnification input (813) is acquired.

[0151] The electronic device can apply a magnification input to both the first page and the second page. The electronic device can change the magnification of the first page displayed through the first window (821) and the magnification of the second page displayed through the second window (822) on the screen (820) based on the magnification input (813). For example, the electronic device can display the first page on the screen (820) at a higher magnification than on the screen (810) and display the second page on the screen (820) at a higher magnification than on the screen (810).

[0152] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0153] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0154] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0155] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0156] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0157] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0158] The embodiments described above may be implemented using hardware components, software components, and / or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may be implemented using a general-purpose computer or a special-purpose computer, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and software applications running on the operating system. Furthermore, the processing device may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0159] Software may include computer programs, codes, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, or computer storage medium or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on a computer-readable recording medium.

[0160] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., alone or in combination, and the program commands recorded on the medium may be those specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0161] The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Claims

1. In an electronic device (101), display (160); At least one processor (120) comprising a processing circuit; and A memory (130) comprising one or more storage media storing instructions, When the above instructions are executed by the at least one processor (120), the electronic device (101) causes: While displaying at least a part of a first page and at least a part of a second page through individually corresponding windows via the display (160), determining similarity between the first page and the second page, Based on the similarity between the first page and the second page, concurrent scrolling between the first page and the second page is enabled, While the above simultaneous scroll is enabled, based on obtaining a swipe input (313; 414; 514; 724), the obtained swipe input (313; 414; 514; 724) is applied to the first page and the second page. To do, Electronic devices (101).

2. In paragraph 1, When the above instructions are executed by the at least one processor (120), the electronic device (101) causes: Obtain information about the contents placed on the first page and information about the contents placed on the second page, Determine the similarity of the content level including the visual similarity between the contents based on the similarity between each content of the first page and each content of the second page, Based on the location of each content within the first page and the location of each content within the second page, similarity at the layout level, which indicates similarity between locations within the pages among the contents, is determined, Based on the similarity of the determined content level and the similarity of the determined layout level, the similarity between the first page and the second page is determined. To do, Electronic devices (101).

3. In any one of paragraphs 1 and 2, When the above instructions are executed by the at least one processor (120), the electronic device (101) causes: Based on the above simultaneous scroll being enabled, the first display area displayed through the display among the first pages is moved according to the swipe input, Displaying the first content included in the moved first display area through a window corresponding to the first page; Based on the similarity of the content level and the similarity of the layout level, the second content corresponding to the first content is determined, Move the second display area displayed through the display among the second pages so that the second content is included, Display the second content of the second page through a window corresponding to the second page To do, Electronic devices (101).

4. In any one of paragraphs 1 to 3, When the above instructions are executed by the at least one processor (120), the electronic device (101) causes: Enable said concurrent scrolling based on user input indicating that said concurrent scrolling is enabled. To do, Electronic devices (101).

5. In any one of paragraphs 1 to 4, When the above instructions are executed by the at least one processor (120), the electronic device (101) causes: Enabling the simultaneous scrolling based on the first application providing the first page and the second application providing the second page To do, Electronic devices (101).

6. In any one of paragraphs 1 to 5, When the above instructions are executed by the at least one processor (120), the electronic device (101) causes: Displaying a simultaneous scroll object (513) based on displaying at least a portion of the first page and at least a portion of the second page; Based on obtaining the swipe input (313; 414; 514; 724) through the simultaneous scroll object (513), applying the obtained swipe input (313; 414; 514; 724) to the first page and the second page To do, Electronic device (101).

7. In any one of paragraphs 1 to 6, When the above instructions are executed by the at least one processor (120), the electronic device (101) causes: Move the area displayed through the display (160) within the first page and the second page in a scroll direction determined based on the swipe input (313; 414; 514; 724), Stopping the movement of the area displayed within the page based on the area displayed within the first page or the second page reaching the end of the page, Moving an area displayed within another page in the scroll direction based on whether the area displayed within another page among the first page or the second page has not reached the end of the other page. To do, Electronic device (101).

8. In any one of paragraphs 1 to 7, When the above instructions are executed by the at least one processor (120), the electronic device (101) causes: Through the above display (160), a graphic object indicating whether the simultaneous scroll is enabled is displayed, Toggle enabling and disabling of the simultaneous scroll based on detecting user input to the graphic object. To do, Electronic device (101).

9. In any one of paragraphs 1 to 8, When the above instructions are executed by the at least one processor (120), the electronic device (101) causes: Enable simultaneous scrolling based on the history of simultaneous scrolling between pages. To do, Electronic device (101).

10. In any one of paragraphs 1 to 9, When the above instructions are executed by the at least one processor (120), the electronic device (101) causes: Obtain a magnification adjustment input (813) that instructs to zoom in or zoom out for at least one of the first page or the second page, Enable concurrent magnification adjustment between the first page and the second page based on the similarity between the first page and the second page. Electronic devices (101).

11. In a method performed by an electronic device (101), An operation of determining similarity between the first page and the second page while displaying at least a portion of a first page and at least a portion of a second page through individually corresponding windows via a display (160); An operation of enabling concurrent scrolling between the first page and the second page based on the similarity between the first page and the second page; and An operation of applying the acquired swipe input (313; 414; 514; 724) to the first page and the second page based on acquiring a swipe input (313; 414; 514; 724) while the above simultaneous scroll is enabled. A method including:

12. In paragraph 11, The action that enables the above simultaneous scrolling is: An action of obtaining information about contents placed on the first page and information about contents placed on the second page; An operation of determining content level similarity including visual similarity between contents based on the similarity between each content of the first page and each content of the second page; An operation of determining layout level similarity indicating similarity between locations within a page among contents based on the location of each content within the first page and the location of each content within the second page; and An operation for determining the similarity between the first page and the second page based on the similarity of the determined content level and the similarity of the determined layout level, method.

13. In any one of paragraphs 11 to 12, The operation of applying the acquired swipe input (313; 414; 514; 724) to the first page and the second page is as follows: An operation of moving a first display area displayed through the display among the first pages according to the swipe input, based on the simultaneous scroll being enabled; An action of displaying first content included in the moved first display area through a window corresponding to the first page; An operation of determining second content corresponding to the first content based on similarity of content level and similarity of layout level; An action of moving the second display area displayed through the display among the second pages so that the second content is included; and Including an action of displaying second content of the second page through a window corresponding to the second page; method.

14. In any one of paragraphs 11 to 13, The action that enables the above simultaneous scrolling is: An operation for enabling said simultaneous scrolling based on user input indicating that said simultaneous scrolling is enabled, method.

15. A computer-readable recording medium storing one or more computer programs including instructions for performing the method of any one of claims 11 to 14.

Images