Window processing method and device, equipment, medium and program product

Abstract

The embodiment of the invention discloses a window processing method and device, equipment, a medium and a program product. The method comprises the steps that an application program is started in a terminal; receiving a window linkage operation for the first window interface and the second window interface; and in response to the window linkage operation, displaying the first window interface and the second window interface in the application program in a linkage manner. By adopting the embodiment of the invention, different window interfaces in the same application program can be linked, and the display flexibility of interface contents in different window interfaces is improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, in particular to the field of the Internet, and specifically to a window processing method, a window processing device, a computer device, a computer-readable storage medium, and a computer program product. Background Art

[0002] The application supports the multi-window function, that is, the same application supports opening multiple window interfaces at the same time. Taking the application as a browser as an example, the browser is an application with functions such as retrieving, displaying and transmitting information resources. The same browser supports opening multiple window interfaces at the same time, and each window interface can be used to display different or the same interface content.

[0003] It has been found in practice that currently applications provide a separate window display mode. For example, each window interface opened in the same browser is displayed independently of each other, or the browser can only display the interface content of one window interface among multiple window interfaces at a time. This separate window display mode is not conducive to viewing the content of multiple window interfaces, resulting in insufficient flexibility in the display of interface content in the same application. Summary of the invention

[0004] The embodiments of the present application provide a window processing method, apparatus, device, medium and program product, which can link different window interfaces in the same application program and improve the flexibility of displaying interface content in different window interfaces.

[0005] On the one hand, an embodiment of the present application provides a window processing method, the method comprising:

[0006] Launching an application in a terminal, wherein the application includes a first window interface and a second window interface;

[0007] Receiving a window linkage operation for the first window interface and the second window interface;

[0008] In response to the window linkage operation, the first window interface and the second window interface are displayed in a linkage manner in the application; the linkage display includes: the first window interface is displayed on the second window interface, or the second window interface is displayed on the first window interface, and when the content of one window interface changes, the content of the other window interface is controlled in a linkage manner.

[0009] On the other hand, an embodiment of the present application provides a window processing device, the device comprising:

[0010] A starting unit, used to start an application in the terminal, wherein the application includes a first window interface and a second window interface;

[0011] A processing unit, configured to receive a window linkage operation for the first window interface and the second window interface;

[0012] The processing unit is also used to respond to the window linkage operation to link the display of the first window interface and the second window interface in the application; when the first window interface is displayed on the second window interface, or the second window interface is displayed on the first window interface, and when the content of one window interface changes, the other window interface is linked to control the content change.

[0013] In one implementation, the processing unit, when receiving the window linkage operation for the first window interface and the second window interface, is specifically configured to:

[0014] Display the selection window; the selection window is used to display the window logo of the window interface in the open state in the application;

[0015] In the selection window, a selection operation for a first window identifier of a first window interface and / or a second window identifier of a second window interface is received.

[0016] In one implementation, the application further includes a third window interface, which is another window interface in the application except the first window interface and the second window interface; the processing unit, when used to display the selection window, is specifically used to:

[0017] Display the window interface in the application; the window interface includes any of the following: a first window interface, a second window interface or a third window interface;

[0018] According to the window selection operation existing in the window interface, a selection window is displayed.

[0019] In one implementation, the window selection operation includes any of the following:

[0020] A gesture operation performed in the window interface; the gesture operation includes one or more of a sliding operation, a long press operation, a single click operation, and a double click operation; or,

[0021] A selection operation for a linkage control; the linkage control is displayed in the window interface, or the linkage control is displayed in a control window, and the control window is triggered to display by the window interface; or,

[0022] Input operation for input shortcut keys.

[0023] In one implementation, if the window interface is a third window interface, and the window identifier on which the selection operation is performed in the selection window includes the first window identifier and the second window identifier, the processing unit is further configured to:

[0024] Configure the layer level of the display layer of the first window interface and the layer level of the display layer of the second window interface;

[0025] When the first window interface and the second window interface are displayed in linkage, the window interface of the display layer with a higher layer level is displayed as a floating window on the window interface of the display layer with a lower layer level.

[0026] In one implementation, the first window interface is used to guide the operation of content editing of the second window interface and the third window interface; if the window interface is the first window interface, and the second window identifier in the selection window and the third window identifier of the third window interface are selected, the linkage display is that the first window interface is displayed on the second window interface;

[0027] The first window interface is displayed on the second window interface, including:

[0028] The first interface content corresponding to the first window interface is displayed on the second window interface; the first interface content is used to provide operation guidance for content editing of the interface content currently displayed in the second window interface;

[0029] The processing unit is also used to:

[0030] The second interface content in the first window interface is displayed on the third window interface; the second interface content is used to provide operation guidance for content editing of the interface content currently displayed in the third window interface.

[0031] In one implementation, the first window interface and the third window interface are used to guide the operation of editing the content of the second window interface; if the window interface is the second window interface, and the first window identifier in the selection window and the third window identifier of the third window interface are selected, the linkage display is that the first window interface is displayed on the second window interface;

[0032] The first window interface is displayed on the second window interface, including:

[0033] The first interface content corresponding to the first window interface is displayed on the second window interface;

[0034] The processing unit is also used to:

[0035] Displaying the third interface content in the third window interface on the second window interface;

[0036] Among them, the first interface content and the third interface content are both used to provide operation guidance for content editing of the interface content currently displayed in the second window interface.

[0037] In one implementation, the first window interface and the second window interface are both displayed on a display screen in the terminal; and the processing unit, when receiving the window linkage operation for the first window interface and the second window interface, is specifically configured to:

[0038] Receiving a drag operation on the first window interface, and dragging the first window interface into the second window interface in the form of a thumbnail;

[0039] If the thumbnail corresponding to the first window interface meets the linkage condition in the second window interface, a step of linking and displaying the first window interface and the second window interface in the application in response to the window linkage operation is triggered.

[0040] In one implementation, the thumbnail corresponding to the first window interface satisfies the linkage condition in the second window interface, including:

[0041] The duration of the thumbnail corresponding to the first window interface staying in the second window interface is greater than the first duration threshold; or

[0042] The thumbnail of the first window interface is dragged to the linkage area in the second window interface.

[0043] In one implementation, if the application is in a window linkage recognition state, the processing unit, when receiving the window linkage operation for the first window interface and the second window interface, is specifically configured to:

[0044] If it is recognized that the first window interface and the second window interface have linkage attributes, then linkage prompt information is output; the linkage prompt information includes a confirmation option; wherein the linkage attributes between the first window interface and the second window interface include: the first window interface is used to guide the operation of content editing of the second window interface;

[0045] A selection operation for a confirmation option is received, triggering the step of displaying the first window interface and the second window interface in a linkage manner in the application in response to the window linkage operation.

[0046] In one implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, and the floating window includes a folding option, the processing unit is further used to:

[0047] In response to a trigger operation on the folding option, folding and displaying the floating window in the second window interface;

[0048] The processing unit is also used to:

[0049] In response to the restoration operation on the floating window, the floating window is displayed in the second window interface.

[0050] In one implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, the processing unit is further configured to:

[0051] Performing a position adjustment operation on the floating window in the second window interface;

[0052] According to the position adjustment operation, the display position of the floating window is updated in the second window interface.

[0053] In one implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, when the content of one window interface changes, the linkage control of the other window interface to change the content includes any of the following:

[0054] In response to the change operation on the interface content in the second window interface, the interface content in the first window interface is synchronously updated and displayed in the first window interface, and the interface content in the first window interface is synchronously updated and displayed in the floating window; or,

[0055] In response to a change operation on the first interface content in the floating window, synchronously updating and displaying the interface content in the first window interface in the first window interface, and synchronously updating and displaying the interface content in the second window interface in the second window interface;

[0056] The update rule of synchronous update includes any one of the following: synchronous update based on the matching degree between the interface content in the first window interface and the interface content in the second window interface; or synchronous update based on the operation information of the change operation.

[0057] In one implementation, if the first window interface is used to guide the operation of content editing in the second window interface, and the second window interface includes one or more editing areas to be edited, and the first window interface is used to display tutorial information corresponding to each editing area, then the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window;

[0058] The first window interface is displayed on the second window interface in the form of a floating window, including:

[0059] A floating window is displayed on the second window interface, and the floating window displays the target tutorial information included in the first window interface; the target tutorial information refers to: the tutorial information corresponding to the editing area to be edited in the second window interface included in the first window interface.

[0060] In one implementation, the first window interface includes a tutorial video, which consists of a series of consecutive video frames. The video frames serve as tutorial information to guide the content editing operation of the second window interface. The second window interface includes S editable regions to be edited. According to the editing order of the editable regions, the s-th editable region is in an edited state, and the (s + 1)-th editable region is in a to-be-edited state. S is an integer greater than 1, s is an integer, and 1 ≤ s < S. The processing unit is further configured to:

[0061] If it is detected that the residence time of the (s + 1)-th editable region in the second window interface in the to-be-edited state is greater than the second time threshold, pause the playback of the tutorial video in the first window interface. Among the multiple video frames displayed in the first window interface during the pause, the video frame has an operation guiding effect on the (s + 1)-th editable region.

[0062] If it is detected that the (s + 1)-th editable region changes from the to-be-edited state to the edited state, continue to play the tutorial video in the first window interface.

[0063] On the other hand, an embodiment of the present application provides a computer device, which includes:

[0064] A processor for loading and executing a computer program;

[0065] A computer-readable storage medium storing a computer program, which when executed by the processor, implements the above window processing method.

[0066] On the other hand, an embodiment of the present application provides a computer-readable storage medium storing a computer program, which is adapted to be loaded and executed by a processor to implement the above window processing method.

[0067] On the other hand, an embodiment of the present application provides a computer program product, which includes a computer program, which when executed by a processor, implements the above window processing method.

[0068] In an embodiment of the present application, after a user opens or starts an application in a terminal, two window interfaces, such as a first window interface and a second window interface, can be opened in the application. If the user has a linkage requirement for linking the two window interfaces, the user is supported to perform a window linkage operation on the first window interface and the second window interface in the application. Among them, the first window interface and the second window interface after the window linkage operation are performed are associated, specifically, the first window interface and the second window interface can be linked and displayed in the application; the so-called linkage display may include: ① a window interface of linkage display is displayed on another window interface; such as the first window interface is displayed on the second window interface, or the second window interface is displayed on the first window interface, where a window interface is displayed on the other window interface, more specifically, the interface content included in a window interface is displayed on the other window interface. ② When the content of one of the two window interfaces displayed in linkage changes, the content of the other window interface is controlled to change in linkage, such as when the first window interface (specifically the interface content in the first window interface) is displayed on the second window interface, assuming that the interface content of the second window interface changes, the interface content in the first window interface located on the second window interface may also change. It can be seen that by linking different window interfaces in the same application, on the one hand, the interface contents of different window interfaces can be integrated into one window interface. Compared with the independent display of the first window interface and the second window interface, the flexibility of the display of the interface contents in the application is improved, so that the user does not need to frequently switch window interfaces or frequently change eyes to obtain the interface contents in different window interfaces. Only one window interface needs to be focused on to obtain the interface contents in different window interfaces at the same time. On the other hand, the update of the interface contents of one window interface can be linked to control the update of the interface contents in another window interface. Through the adaptive update of the interface contents in different window interfaces, the intelligence of the interface content display is effectively improved, the time of the user to adjust the interface contents in different window interfaces is saved, and the update efficiency of the interface contents in different window interfaces is improved to a certain extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0070] Figure 1a The present invention is a schematic diagram showing multiple window interfaces in an existing browser;

[0071] Figure 1bIt is a schematic diagram of displaying multiple window interfaces in another existing browser;

[0072] Figure 2a is a schematic diagram of the architecture of a window processing system provided by an exemplary embodiment of the present application;

[0073] Figure 2b is a schematic diagram of the architecture of another window processing system provided by an exemplary embodiment of the present application;

[0074] Figure 3 is a flowchart of a window processing method provided by an exemplary embodiment of the present application;

[0075] Figure 4 is a schematic diagram of opening a browser in a terminal provided by an exemplary embodiment of the present application;

[0076] Figure 5 It is a schematic diagram of a floating window permanently displayed in a browser provided by an exemplary embodiment of the present application;

[0077] Figure 6 is a schematic diagram of a window selection operation provided by an exemplary embodiment of the present application;

[0078] Figure 7a It is a schematic diagram of a linkage control directly displayed on a window interface provided by an exemplary embodiment of the present application;

[0079] Figure 7b It is a schematic diagram of a linkage control displayed in a control window provided by an exemplary embodiment of the present application;

[0080] Figure 8 is a schematic diagram of invoking a selection window through a shortcut key provided by an exemplary embodiment of the present application;

[0081] Fig. 9 It is a schematic diagram of an exemplary embodiment of the present application, in which a window interface is a first window interface and a second window mark is selected in a selection window;

[0082] Fig.10 It is a schematic diagram of an exemplary embodiment of the present application, in which a window interface is a third window interface, and a first window identifier and a second window identifier are selected in a selection window;

[0083] Fig.11a is a schematic diagram of a batch linkage window interface provided by an exemplary embodiment of the present application;

[0084] Fig.11b is a schematic diagram of another batch linkage window interface provided by an exemplary embodiment of the present application;

[0085] Fig.12 is a schematic diagram of a layer configuration window provided by an exemplary embodiment of the present application;

[0086] Fig.13 It is a schematic diagram of realizing window linkage through a drag operation provided by an exemplary embodiment of the present application;

[0087] Fig.14a is a schematic diagram of a linkage condition provided by an exemplary embodiment of the present application;

[0088] Fig.14b is a schematic diagram of another linkage condition provided by an exemplary embodiment of the present application;

[0089] Fig.15 is a schematic diagram of a linkage prompt information provided by an exemplary embodiment of the present application;

[0090] Fig.16 is a flowchart of another window processing method provided by an exemplary embodiment of the present application;

[0091] Fig.17a is a schematic diagram of a folding floating window provided by an exemplary embodiment of the present application;

[0092] Fig.17b is a schematic diagram of restoring a floating window provided by an exemplary embodiment of the present application;

[0093] Fig.18 is a schematic diagram of adjusting the display area of ​​a floating window provided by an exemplary embodiment of the present application;

[0094] Fig.19 is a schematic diagram of closing a floating window provided by an exemplary embodiment of the present application;

[0095] Fig. 20 is a schematic diagram of controlling the display position of a floating window provided by an exemplary embodiment of the present application;

[0096] Fig.21a It is a schematic diagram of displaying all interface contents in a first sub-interface in a floating window provided by an exemplary embodiment of the present application;

[0097] Figure 21b It is a schematic diagram of a first interface content displayed in a floating window customized by a user provided by an exemplary embodiment of the present application;

[0098] Fig.22a It is a schematic diagram of synchronously updating the interface contents in the floating window and the first window interface when the interface contents in the second window interface change, provided by an exemplary embodiment of the present application;

[0099] Figure 22b It is a schematic diagram of synchronously updating the interface contents in the first window interface and the second window interface when the interface contents in the floating window interface change, provided by an exemplary embodiment of the present application;

[0100] Fig.23 It is a schematic diagram of realizing synchronous update of interface content based on distance mapping relationship provided by an exemplary embodiment of the present application;

[0101] Fig.24 It is a schematic diagram of displaying tutorial information corresponding to an editing area in a floating window provided by an exemplary embodiment of the present application;

[0102] Fig.25a is a schematic diagram of displaying redundant information in a floating window provided by an exemplary embodiment of the present application;

[0103] Fig.25b is a schematic diagram of displaying a floating window at a position adjacent to an editing area provided by an exemplary embodiment of the present application;

[0104] Fig.25c It is a schematic diagram of sliding and displaying hidden interface content in a floating window provided by an exemplary embodiment of the present application;

[0105] Fig.25d is a schematic diagram of displaying a floating window at a position adjacent to each editing area in a second window interface provided by an exemplary embodiment of the present application;

[0106] Fig.26 is a schematic diagram of a first window interface including a tutorial video provided by an exemplary embodiment of the present application;

[0107] Fig. 27 It is a background process diagram of a window processing method provided by an exemplary embodiment of the present application;

[0108] Fig.28 is a structural schematic diagram of a window processing device provided by an exemplary embodiment of the present application;

[0109] Fig.29 It is a structural diagram of a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0110] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0111] The following is an explanation of some terms and concepts involved in the embodiments of the present application:

[0112] (1) The embodiments of the present application involve applications, which may refer to computer programs for completing one or more specific tasks. By classifying applications according to different dimensions (such as the operation mode and function of the application), the types of the same application under different dimensions can be obtained, among which: ① According to the operation mode of the application, the application may include but is not limited to: client, the so-called client (also known as application client, client (Application, APP)) refers to an application installed and running in the terminal; such as a browser installed in the terminal. The application may also refer to an installation-free application, that is, an application that can be used without downloading and installing. This type of application is also commonly known as a mini-program, which usually runs in the client as a subprogram. The application may also refer to a web application on the Internet; etc. ② According to the functional type of the application, the application may include but is not limited to: Instant Messaging (IM) application, an IM application refers to an application for instant communication of messages and social interaction based on the Internet, and an IM application may include but is not limited to: social applications, map applications with social interaction functions, and game applications, etc. Content interaction application, a content interaction application refers to an application that can realize content interaction, such as online banking, personal space, and browser applications.

[0113] (2) The embodiments of the present application also relate to a multi-window function of an application. The multi-window function of an application may refer to: a function of opening multiple window interfaces (Window interface) of the same application on the display screen of a terminal; that is, the same application may include multiple window interfaces in an open state at the same time. Among them, a window interface refers to a service interface or a user interface that displays the interface content in an application in the form of a window; the interface content included in each window interface in the multiple window interfaces may be the same or different. Several exemplary applications and window interfaces are given below; among them: optionally, the application is a client, specifically a social client with social functions, then the social client may include window interfaces corresponding to different social sessions. For example, social session 1 and social session 2 are opened in a social client; wherein social session 1 refers to a social session in which a conversation is conducted between social object 1 and social object 2, then the window interface 1 corresponding to the social session 1 is used to present the content of the conversation between social object 1 and social object 2; similarly, social session 2 refers to a social session in which a conversation is conducted between social object 1 and social object 3, then the window interface 2 corresponding to the social session 2 is used to present the content of the conversation between social object 1 and social object 3; thus, it can be seen that the interface content (or conversation content) in the window interface 1 corresponding to social session 1 is different from the interface content (or conversation content) in the window interface 2 corresponding to social session 2. Optionally, the application is a client, specifically a browser with functions such as retrieval, display and transmission of web information resources, then the browser may include window interfaces corresponding to different web applications. For example, if web applications provided by multiple websites are opened in the browser, then the browser needs to provide at least one window interface to present the interface content of the web applications provided by each website; for example, the interface content in web application 1 provided by website 1 is presented through window interface 1, and the interface content in web application 2 provided by website 2 is presented through window interface 2.

[0114] Based on the above introduction to the application and the window interface, for ease of understanding, the embodiments of the present application are subsequently described using the application as a browser with a multi-window function as an example, which is specially explained here.

[0115] In actual applications, there are roughly two display modes for multiple window interfaces provided by mainstream browsers, namely: multiple window interfaces are switched and displayed, or multiple window interfaces are displayed independently. Among them: ① The display mode of multiple window interfaces switching and displaying can mean that only one window interface of the browser can be displayed on the display screen of the terminal at a time, and other window interfaces of the browser can be displayed by switching. Figure 1aAs shown, assuming that the browser includes window interface 1 and window interface 2 in an open state, the window identifier 102 of window interface 1 in the browser and the window identifier 103 of window interface 2 in an open state can be displayed in the window bar 101 of the browser; if window interface 1 is currently displayed in the browser, then the window identifier 102 of the window interface 1 in the window bar 101 is in a selected state, indicating that window interface 1 is in a display state; further, when the window identifier is switched in the window bar 101, such as selecting the window identifier 103 of window interface 2, the display can be switched from window interface 1 to the window interface 2 indicated by the window identifier 103 in the browser. ② The display mode of independently displaying multiple window interfaces can refer to: at least two window interfaces of the browser can be displayed simultaneously on the display screen of the terminal, and the display or hiding (such as minimization) of each window interface is not affected by other window interfaces. As Figure 1b As shown, assuming that the browser includes window interface 1 and window interface 2 in an open state, window interface 1 and window interface 2 can be displayed simultaneously on the display screen of the terminal; and when the user closes a window interface (such as window interface 1) on the display screen, it does not affect the display or hiding of another window interface (such as window interface 2).

[0116] It can be seen that the different window interfaces provided by mainstream browsers are mutually restricted or independent of each other; specifically, the display of interface contents in different window interfaces is mutually restricted (e.g., only the interface contents in one window interface can be displayed at a time), or mutually independent (e.g., different interface contents are displayed in different window interfaces). It can be seen that no matter whether the multiple window interfaces provided by mainstream browsers are mutually restricted or independent of each other, any window interface can only display the interface contents included in that window interface.

[0117] In order to improve the flexibility of displaying interface contents in different window interfaces in a browser, the embodiment of the present application provides a window processing scheme, which can realize displaying interface contents included in different window interfaces in one window interface of the browser by window linkage (or simply linkage) of at least two window interfaces in an open state in the browser; specifically, displaying interface contents in other window interfaces in one window interface, thereby realizing flexible display of interface contents in different window interfaces. For the convenience of explanation, the example of the number of window interfaces to be linked is 2 is taken as an example, and is specially explained here.

[0118] The general content of the window processing scheme provided by the embodiment of the present application may include: first, the user can start an application (such as a browser) in the terminal, and can also open two window interfaces in the application, such as the first window interface and the second window interface. Then, if the user has a linkage demand for the two window interfaces; such as the first window interface is used as an editing tutorial for the second window interface, then the user may hope that the interface content in the first window interface can be displayed in (or on) the second window interface, so that the user can observe the interface content in the two window interfaces; then, the user can perform a window linkage operation on the first window interface and the second window interface in the application. Finally, the terminal (specifically the application) responds to the window linkage operation and displays the first window interface and the second window interface in the application in a linkage manner. Among them, the linkage display of the first window interface and the second window interface may include: ① linkage display of interface content, such as the first window interface and the second window interface can be displayed in the same window interface (the same window interface can refer to the first window interface or the second window interface, such as the first window interface is displayed in the second window interface, or the second window interface is displayed on the first window interface). ② linkage update of interface content, such as when the interface content in one window interface changes, linkage control of the interface content in another window interface changes accordingly.

[0119] It can be seen that by linking different window interfaces in the same application, not only can the interface contents of different window interfaces be integrated into one window interface, but also the flexibility of displaying the interface contents in the application can be improved compared to the independent display of the first window interface and the second window interface, so that the user does not need to frequently switch window interfaces or frequently change eyes to obtain the interface contents in different window interfaces, but only needs to focus on a single window interface to simultaneously obtain the interface contents in different window interfaces displayed in linkage. Moreover, the update of the interface contents of one window interface of at least two window interfaces displayed in linkage can control the update of the interface contents in other window interfaces in linkage. Through the adaptive changes of the interface contents in different window interfaces, the intelligence of the interface content display can be effectively improved, saving the time of users to adjust the interface contents in different window interfaces, and improving the update efficiency of the interface contents in different window interfaces to a certain extent.

[0120] The window processing scheme provided in the embodiment of the present application can be executed by a computer device; the embodiment of the present application does not limit the type and number of computer devices. Specifically, the computer device may include a terminal and / or a server; in other words, the information processing scheme proposed in the embodiment of the present application can be executed by a terminal, by a server, or by a terminal and a server together. Among them:

[0121] The terminal may include, but is not limited to: smart phones (such as Android phones, IOS phones, etc.), tablet computers, personal computers, portable personal computers, mobile Internet devices (Mobile Internet Devices, MID for short), smart TVs, vehicle-mounted devices, head-mounted devices, smart TVs or smart homes, etc., which can be touch-screen smart devices. The embodiments of the present application do not limit the types of terminals, which are explained here. Furthermore, the aforementioned applications may be deployed in the terminal, such as a browser installed and running in the terminal. The server is a background server corresponding to the terminal, which is used to interact with the terminal, specifically to interact with the application (such as a browser) deployed in the terminal, so as to provide computing and application service support for the application deployed in the terminal. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and basic cloud computing services such as big data and artificial intelligence platforms.

[0122] Based on the above introduction to the terminal and the server, in order to facilitate understanding of the window processing scheme involved in the embodiment of the present application, the following is combined with Figure 2a A schematic diagram of the architecture of the window processing system corresponding to the window processing solution when the computer device is a terminal is given; and, combined with Figure 2b A schematic diagram of the architecture of the window processing system corresponding to the window processing solution when the computer device includes a terminal and a server is given. Among them:

[0123] (1) The computer device is a terminal; that is, the window processing solution provided in the embodiment of the present application can be executed by the terminal. Figure 2aAs shown, after the user uses the terminal 201 to start the browser, the user can open multiple window interfaces through the browser. If the object has a linkage requirement for the first window interface and the second window interface in the multiple window interfaces, such as hoping that the interface content in the first window interface can be displayed in the second window interface, so as to facilitate viewing the interface content in the two window interfaces in one window interface. Then the object can perform a window linkage operation on the first window interface and the second window interface in the browser. At this time, the terminal can obtain the interface content to be displayed on the second window interface from the first window interface according to the actual linkage requirement according to the window linkage operation, and display the interface content in the second window interface in the form of a floating layer, so as to achieve the goal of linkage display of the interface content in the first window interface and the second window interface. Furthermore, if there is a change operation for the interface content in the second window interface, and the change operation is used to update the interface content displayed in the second window interface, then the terminal can analyze the interface content included in the first window interface (including the interface content currently displayed in the first window interface and the interface content to be displayed in the first window interface (such as some content hidden due to the limited display area of ​​the first window interface)) according to the change operation existing in the second window interface, so as to link and update the interface content in the first window interface displayed in the second window interface, thereby realizing the linked update of the interface content displayed in multiple window interfaces.

[0124] (2) The computer device is a terminal and a server; that is, the window processing solution provided in the embodiment of the present application can be executed by the terminal and the server together. Figure 2bAs shown, after using terminal 201 to start the browser, multiple window interfaces can be opened through the browser. If the object has a linkage requirement for the first window interface and the second window interface in the multiple window interfaces, such as hoping that the interface content in the first window interface can be displayed in the second window interface, so as to facilitate viewing the interface content in the two window interfaces in one window interface. Then the object can perform a window linkage operation on the first window interface and the second window interface in the browser. At this time, the terminal can generate a window linkage request according to the window linkage operation and send the window linkage request to the server 202. In this way, the server 202 can respond to the window linkage request, obtain the interface content to be displayed on the second window interface from the first window interface according to the actual linkage requirement, and return the interface content to the terminal 201. Finally, the terminal 201 renders this part of the interface content in the form of a floating layer on the second window interface to achieve the goal of displaying the interface content in different window interfaces (such as the first window interface and the second window interface) in one window interface (such as the second window interface). Furthermore, if the terminal 201 detects that there is a change operation in the second window interface, the change operation can be transmitted to the browser 202, so that the server 202 obtains the new interface content in the first window interface according to the change operation and returns it to the terminal 201 for rendering and display, so as to achieve the effect of linkage control of the update of interface content in different window interfaces.

[0125] Based on the above Figure 2a and Figure 2b The following is also required for the description of the exemplary process of executing the window processing scheme on the computer device:

[0126] ① In the case where the computer device includes a terminal and a server, that is, when the window processing solution provided in the embodiment of the present application is jointly executed by the terminal and the server, the terminal and the server can be directly or indirectly connected via wired or wireless communication, and the present application does not impose any restrictions on this.

[0127] ② The above-mentioned embodiments of the present application Figure 2a and Figure 2b The system shown is to more clearly illustrate the technical solution of the embodiment of the present application, and does not constitute a limitation on the technical solution provided by the embodiment of the present application. It is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solution provided by the embodiment of the present application is also applicable to similar technical problems.

[0128] ③The window processing scheme provided in the embodiment of the present application can be applied to any scenario where window linkage is desired. Moreover, when the first window interface and the second window interface are displayed in linkage, the first window interface can be displayed on the second window interface according to the user's business needs, or the second window interface can be displayed on the first window interface. This embodiment of the present application does not limit this. Moreover, the embodiment of the present application does not limit the number of window interfaces displayed in linkage. For example, in addition to displaying the first window interface on the second window interface according to user needs, a third window interface can also be displayed. The third window interface is a window interface provided by the application that is different from both the first window interface and the second window interface.

[0129] For example, the window processing scheme provided by the embodiment of the present application can be applied to a tutorial scenario, where the so-called tutorial scenario refers to a scenario in which the interface content contained in one of the two window interfaces can serve as an operational guide for the content editing of the interface content in the other window interface (e.g., in an online drawing scenario, it is often necessary to open a tutorial window interface and a drawing window interface, and the user can refer to the interface content in the tutorial window interface to implement drawing step by step in the drawing window interface). In this scenario, the user needs to open a first window interface and a second window interface, such as the first window interface is a tutorial window interface, and the second window interface is an operation window interface (such as the drawing window interface mentioned above), and the interface content in the tutorial window interface can serve as an operational guide for the content editing of the interface content in the operation window interface. Then, after the user performs window linkage operations on the tutorial window interface and the operation window interface, the tutorial window interface can be displayed in a floating layer on the operation window interface, specifically, the interface content in the tutorial window interface that matches the interface content currently displayed in the operation window interface is displayed. The interface content in the tutorial window interface that matches the interface content currently displayed in the operation window interface refers to the interface content in the tutorial window interface that can provide operation guidance for content editing of the interface content to be edited currently displayed in the operation window interface.

[0130] Furthermore, if the user has completed editing the interface content currently displayed in the operation window interface according to the interface content in the first window interface displayed in a floating layer form, the user can perform a change operation on the operation window interface, such as sliding the operation window interface to reveal the hidden interface content to be edited; at this time, through linkage control, the new interface content in the tutorial window interface that matches the new interface content in the operation window interface can be automatically displayed in a floating layer form (specifically in the form of a floating window) to facilitate the user to continue to edit the operation window interface. It can be seen that the interface content in the tutorial window interface can be displayed in the operation window interface by using the embodiment of the present application, so that the user does not need to frequently view different window interfaces, but only focuses on the operation window interface to refer to the tutorial information to implement the content editing of the operation window interface, which has a better guiding effect on the user.

[0131] ④ The collection and processing of relevant data in the embodiments of this application should be strictly in accordance with the requirements of relevant national laws and regulations. The acquisition of personal information requires the knowledge or consent of the individual subject (or the legal basis for obtaining information), and the subsequent use and processing of data shall be carried out within the scope of authorization of laws and regulations and the subject of personal information. For example, when the embodiments of this application are applied to specific products or technologies, such as when collecting operations performed by the object in the window interface provided by the browser, it is necessary to obtain the permission or consent of the object, and the collection, use and processing of relevant data (such as the collection and release of the bullet screen posted by the object, etc.) need to comply with the relevant laws, regulations and standards of the relevant regions.

[0132] Based on the window processing scheme described above, the embodiment of the present application proposes a more detailed window processing method. The window processing method proposed in the embodiment of the present application will be described in detail below in conjunction with the accompanying drawings.

[0133] Figure 3 A flowchart of a window processing method provided by an exemplary embodiment of the present application is shown; the window processing method can be executed by a computer device in the aforementioned system, such as a terminal; the window processing method may include but is not limited to steps S301-S303:

[0134] S301: Start an application in a terminal.

[0135] As described above, the application involved in the embodiment of the present application can be any application that supports the multi-window function, such as the application can be a browser that supports displaying different window interfaces provided by different websites, or multiple window interfaces provided by the same website. The application is deployed and runs in the terminal. When the user has the need to use the application, the application can be started and opened through the terminal; specifically, the application logo of the application can be displayed on the display screen of the terminal, so that the user can start the application in the terminal by performing a trigger operation on the application logo, and the window interface provided by the application is displayed on the display screen of the terminal.

[0136] See also Figure 4 , Figure 4 is a schematic diagram of starting an application in a terminal provided by an exemplary embodiment of the present application; Figure 4 Assuming that the application is a client deployed in a computer device (i.e., a terminal), the application identifier 401 of the client (such as a chart or text name used to uniquely identify the client) can be displayed on the display screen of the terminal. In response to the triggering operation of the application identifier 401, indicating that the user wants to open the client, the window interface 402 of the client is triggered to be displayed. At this time, the window interface 402 can be any service interface provided by the client (such as the main service interface, or the service interface when the user last exited the client). In this way, the user can perform corresponding operations in the opened client and trigger the display of corresponding other window interfaces.

[0137] It should be noted that Figure 4 The present application embodiment provides an exemplary application as a client, and when the application identifier of the client is directly displayed on the display screen of the terminal, a flowchart of opening the client by triggering the application identifier on the display screen is provided. In actual applications, depending on the different operation modes of the application (such as the application is a small program, or the application identifier of the application is not directly displayed on the terminal screen but is hidden), the path for the user to open the application in the terminal is different. Figure 4 The schematic diagram shown does not limit the application startup process. Figure 4 The style of the interface diagram shown is consistent with the style of the display screen of a smart computer, that is, the terminal is a smart computer at this time; however, when the terminal is in other forms, such as a smart home or a smart watch, the style of the corresponding interface diagram may change, and the comparison is not limited.

[0138] S302: Receive a window linkage operation for the first window interface and the second window interface.

[0139] S303: In response to the window linkage operation, the first window interface and the second window interface are linked and displayed in the application.

[0140] In steps S302-S303, after the user starts the application in the terminal, multiple window interfaces (such as 2 or 3 window interfaces, etc.) can be opened in the application according to the operation requirements. Furthermore, if the user has a linkage requirement for at least two window interfaces among the multiple window interfaces in the application that are open, the user can perform a window linkage operation on the at least two window interfaces, and the terminal (specifically the application) can respond to the window linkage operation and display the at least two window interfaces in the application in a linkage manner. For ease of explanation, the embodiment of the present application takes the example that the window interface in the open state in the application includes at least a first window interface and a second window interface, and the user has a linkage requirement for the first window interface and the second window interface, then the first window interface and the second window interface can be displayed in a linkage manner in the application.

[0141] The following is an introduction to the specific implementation process of several exemplary window linkage operations for the first window interface and the second window interface provided in the embodiment of the present application, wherein:

[0142] 1. Executing a window linkage operation for the first window interface and the second window interface includes: an operation of selecting a window identifier in a selection window; specifically, it may include two parts, namely: triggering display of the selection window, and executing a selection operation for the window identifier of the window interface to be linked in the selection window.

[0143] Part 1: Trigger the display of the selection window.

[0144] The selection window is a window provided by an application (such as a browser) for displaying or showing the window identifier of a window interface in an open state in the application. The window identifier of a window interface can be used to uniquely identify the window interface, such as the name of a website providing the window interface, all or part of the text information contained in the first line of text in the window interface, the title of the window interface, etc., without limitation.

[0145] The embodiment of the present application does not limit the triggering display method of the selection window in the application. Two exemplary processes for triggering the display of the selection window in the application are given below; wherein:

[0146] (1) The selection window is triggered and displayed in the application when the application is started; that is, assuming that the application is a browser, no matter how many window interfaces are opened in the browser, as long as the browser is opened, the selection window can be displayed in the browser. In this way, when the user browses any window interface in the browser, the selection window can realize window linkage between at least two window interfaces, simplifying the linkage operation and shortening the linkage path.

[0147] For example, a schematic diagram of selecting a window to reside in a browser can be seen in Figure 5 ;exist Figure 5 The selection window 501 is displayed on the browser in the form of a floating window. For example, when the browser is started, only the main window interface 502 of the browser is displayed on the display screen of the terminal, and the window identifier 5021 of the main window interface 502 is displayed in the selection window 501. Further, if the user continues to open the window interface 503 in the browser, the display content in the selection window 501 can be updated and displayed, specifically, the window identifier 5031 of the window interface 503 is automatically added in the selection window 501. Similarly, if the user closes the main window interface 502 in the browser, the window identifier 5021 of the main window interface 502 can be automatically deleted in the selection window 501. By the above-mentioned method of automatically updating the window identifier in the selection window, the synchronization between the window interface opened by the browser and the window identifier in the selection window can be ensured, so that the user can accurately realize the window linkage through the selection window.

[0148] It should be noted that Figure 5 This is just an exemplary display style and display position of the selection window when it is resident in the browser provided by the embodiment of the present application; in actual application, the display style and display position of the selection window in the browser may change. For example, in order to facilitate the user to intuitively perceive the function of the selection window (i.e., the function of the linkage window), the embodiment of the present application also supports outputting prompts in the browser so that the user can know through the prompt that the window interface can be linked through the selection window; among which, an exemplary "prompt" can be seen in Figure 5 , Figure 5 In the example, a dynamic or static character icon 504 is displayed in an adjacent area of ​​the selection window, and the gesture of the character icon points to the selection window to serve as a prompt.

[0149] (2) The selection window is triggered to display from a certain window interface in the application; that is, assuming that the application is a browser, the selection window can be bound to the window interface, and the user can trigger the display of the selection window from a specified or arbitrary window interface.

[0150] In a specific implementation, it is assumed that the window interface in the application that is in an open state includes the first window interface and the second window interface mentioned above, and also includes a third window interface, and the third window interface is a window interface other than the first window interface and the second window interface in the application; then when the window interface of the application (such as the first window interface, the second window interface or the third window interface) is displayed on the display screen, the display selection window can be triggered according to the window selection operation existing in the window interface. Among them, the window selection operation performed in the window interface may include but is not limited to any of the following:

[0151] ① Gesture operations performed in the window interface, including one or more of sliding operations (such as operations in which a finger (or cursor, electronic pen, etc.) is continuously pressed and moved in the playback interface), long press operations (such as operations in which a finger is continuously pressed on a display position in the playback interface), single click operations (such as operations in which a single finger is clicked on a display position in the playback interface), and double click operations (such as operations in which two fingers are simultaneously clicked on two display positions in the playback interface, or operations in which an external device (such as a mouse) is used to click on the same display position in the playback interface twice in succession).

[0152] Combine the following Figure 6 Taking the browser as an example, the schematic diagrams of the above-mentioned gesture operations are introduced. Figure 6 As shown in the first figure, if the user performs a sliding operation in any window interface in the browser, the terminal can trigger the display of the selection window in response to the sliding operation; wherein the sliding operation performed in the window interface can be in any direction (such as along the horizontal direction, vertical direction or diagonal direction of the display screen, etc.). Figure 6 As shown in the second figure, if the user performs a long press operation in any window interface in the browser, then the selection window can be triggered to be displayed in response to the long press operation; wherein the display position touched by the long press operation in the window interface can be any display position in the window interface, and this is not limited. Figure 6 As shown in the third figure, if the user performs a single-click operation in any window interface of the browser, then the single-click operation can trigger the display of the selection window; wherein the display position touched by the single-click operation in the window interface can be any display position, and this is not limited. Figure 6 As shown in the fourth figure, if the user performs a double-click operation in any window interface in the browser, then a display selection window can be triggered in response to the double-click operation; the double-click operation here can be a two-finger click operation, or a single-finger click operation on the same display position, wherein, regardless of whether the double-click operation is a single-finger or two-finger operation, the display position touched by the double-click operation in the window interface can be any display position in the window interface.

[0153] It is understandable that the gesture operation used to trigger the display selection window is not limited to the several exemplary operations given above. When the terminal is deployed with a camera, the above-mentioned gesture operation can also be performed remotely, and does not require direct contact with the display screen of the terminal; specifically, the user can perform gesture operations in the air, at which time the terminal can collect the user's gesture operations through the camera, and identify and subsequently process the gesture operations. This hidden operation that does not require the user to directly contact the display screen greatly simplifies the operation process and can adapt to richer application scenarios (such as the display selection window can be triggered remotely in the vehicle-mounted scenario to achieve window linkage, which improves the simplicity of operation and ensures the safety of the driver compared to the need to directly contact the display screen).

[0154] ② For the selection operation of the linkage control, the linkage control is displayed in the window interface or the linkage control is displayed in the control window, and the control window is triggered to display through the window interface. In other words, the linkage control is an option, key, component or button used to trigger the display of the selection window; thus, in response to the selection operation for the linkage control, the display of the selection window can be triggered.

[0155] For example, the schematic diagram of the linkage control being directly displayed on the window interface can be seen in Figure 7a ;like Figure 7a As shown, the toolbar 701 of the browser includes controls corresponding to various functions (such as the collection function, the personalization function, or the history viewing function, etc.) provided by the browser. In response to the triggering of any control, the service interface corresponding to the corresponding function can be entered to implement subsequent operations. The toolbar 701 includes a linkage control 702, so that the user can directly trigger the linkage control 702 in the toolbar 701 to quickly call up the selection window to implement window linkage.

[0156] For example, the schematic diagram of the linkage control displayed in the control window can be seen in Figure 7b ;like Figure 7b As shown, more options 703 are displayed in the window interface of the browser (or the toolbar of the browser); in response to the user's triggering operation on the update option 703, a control window 704 can be triggered to display, and the control window 704 is used to display controls corresponding to one or more functions provided by the browser. The functions provided by the browser here can refer to the above-mentioned related description. The control window 704 includes a linkage control 702, so that the user can quickly call up the selection window by selecting the linkage control 702 in the control window 704.

[0157] It should be understood that the specific implementation process of triggering the display of the selection window through the linkage control is not limited to the above Figure 7a and Figure 7bFor example, the option for triggering the display of the linkage window including the linkage control may also be other options in the toolbar, and is not limited to more options 703. The embodiment of the present application does not limit the triggering display mode of the linkage control.

[0158] ③ Input operation of inputting shortcut keys. Specifically, when the browser is open, you can input shortcut keys through the virtual input area or the physical input device to quickly call up the selection window in the browser. Among them, the virtual input area may refer to a virtual keyboard displayed on the terminal screen, and the physical input device may be an external device of the terminal, such as a physical keyboard or a physical drawing board; in this way, the selection window can be quickly called up by inputting shortcut keys in the virtual input area or the physical input device. It is worth noting that the shortcut key for calling up the selection window may include at least one character, such as the shortcut key is the character "S" or the character "L", and the shortcut key may also include multiple characters, such as the characters "Ctrl" and "Q", etc.; the embodiment of the present application does not limit the composition of the shortcut keys.

[0159] An exemplary schematic diagram of quickly calling up the selection window through a shortcut key can be seen in Figure 8 ;like Figure 8 The browser shown in the figure displays a virtual keyboard 801. At this time, the user can quickly call up the selection window by entering a shortcut key in the virtual keyboard 801. If the shortcut key for calling up the selection window is "(+," then the "(+," entered in the virtual keyboard 801 can automatically display the selection window and hide the virtual keyboard 801. It should be understood that Figure 8 An exemplary display style of the virtual keyboard is given by taking the display screen of a smart computer as an example; when the terminal is a smart phone, since the display screen of the smart phone is in a vertical direction, the display style of the virtual keyboard will change accordingly, and the embodiments of the present application are not limited to this.

[0160] To sum up, the embodiments of the present application provide users with a variety of implementation methods for triggering the display of a selection window. Users can choose any of the above methods to trigger the display of a selection window according to their own operating habits. These rich implementation methods are in line with the user's operating habits without the need for users to learn new operating methods, thereby reducing learning costs.

[0161] Part 2: Perform selection operations in the selection window.

[0162] The above content mainly introduces the implementation method of triggering the display of the selection window. The following introduces the specific operation of realizing the window linkage between the first window interface and the second window interface in the selection window. As described above, the selection window can be used to display the window identification of the window interface in the application; specifically, the selection window can be used to display the window identification of all or part of the window interfaces in the application that are open. Optionally, the selection window can display the interface identification of each window interface in all the window interfaces in the application that are open. Optionally, the selection window can display the window identification of some window interfaces in the application that are open; wherein, some window interfaces may refer to: the window interface of multiple window interfaces in the application that are open except for the window selection operation (i.e., the operation used to evoke the selection window) that is executed. For the convenience of explanation, the embodiments of the present application will be introduced later by taking the window identification of some window interfaces in the application that are open in the selection window as an example, which is specially explained here.

[0163] The following takes the application as a browser, the window interfaces in the browser that are open are the first window interface, the second window interface and the third window interface, and the window interfaces to be linked in the browser include the first window interface and the second window interface as an example, and introduces the selection operation for the window identifier in the selection window. In a specific implementation, the selection operation for the first window identifier of the first window interface to be linked, and / or the second window identifier of the second window interface is received in the selection window, and the first window interface and the second window interface are displayed in a linked manner in the application. It should be noted that, depending on the different window interfaces hidden in the application, the window identifier (such as the first window identifier and / or the second window identifier) ​​selected in the selection window is different, where:

[0164] In one implementation, it is assumed that the window interface on which the window selection operation is executed in the browser is the first window interface, and the selection window is displayed in the form of a floating window on the first window interface. Then, the selection window may include the second window identifier of the second window interface, and may include or exclude the first window identifier of the first window interface. In this implementation, if the user wants to link the first window interface and the second window interface, the user may perform a selection operation on the second window identifier of the second window interface in the selection window. At this time, the terminal receives the selection operation on the second window identifier of the second window interface in the selection window, triggering the step of linking the first window interface and the second window interface in the browser. Exemplarily, when the window interface on which the window selection operation is executed in the browser is the first window interface, a schematic diagram of selecting the second window identifier of the second window interface in the selection window can be seen. Fig. 9 ;like Fig. 9The selection window shown includes a second window identifier 901 of the second window interface. In this way, when the terminal receives a user's selection operation for the second window identifier 901 in the selection window, the first window interface and the second window interface can be linked and displayed in the browser.

[0165] In another implementation, it is assumed that the window interface on which the window selection operation is executed in the browser is the second window interface, and the selection window is displayed in the second window interface in a floating form. Then, the selection window may include the first window identifier of the first window interface, and may include or exclude the second window identifier of the second window interface. In this implementation, if the user wants to link the first window interface and the second window interface, the user can perform a selection operation on the first window identifier of the first window interface in the selection window. At this time, the terminal receives the selection operation on the first window identifier of the first window interface in the selection window, triggering the execution of the step of linking the display of the first window interface and the second window interface in the browser.

[0166] It can be seen from the above two implementation methods that when the window interface currently displayed in the browser (or the window interface whose layer level is lower than the display level of the display layer of the selection window, and the selection window is displayed above the window interface in visual effect) is any window interface among the multiple window interfaces to be linked, it is only necessary to select the window identifiers of the other window interfaces among the multiple window interfaces to be linked except the any window interface in the selection window; in this way, the terminal (specifically the application) can link the window interface corresponding to the window identifier selected in the selection window with the window interface currently displayed in the browser by default.

[0167] In other implementations, it is assumed that the window interface on which the window selection operation is executed in the browser is the third window interface, and the selection window is displayed in the third window interface in a floating form. Then, the selection window may include the first window identifier of the first window interface and the second window identifier of the second window interface. In this implementation, if the user wants to link the first window interface and the second window interface, the user can perform a selection operation on the first window identifier of the first window interface and the window identifier of the second window interface in the selection window. At this time, the terminal receives the selection operation on the first window identifier and the second window identifier in the selection window, triggering the step of linking the first window interface and the second window interface in the browser. Exemplarily, the window interface on which the window selection operation is executed in the browser is the third window interface, and the schematic diagram of selecting the first window identifier and the second window identifier in the selection window can be seen in Fig.10 ;like Fig.10The selection window shown includes a first window identifier 1001 of a first window interface and a second window identifier 1002 of a second window interface. Thus, when the terminal receives a user's selection operation for the first window identifier 1001 and the second window identifier 1002 in the selection window, the first window interface and the second window interface can be linked and displayed in the browser.

[0168] For further information, see Fig. 9 or Fig.10 It can be seen that the linkage display of the first window interface and the second window interface in the application includes: displaying one window interface on another window interface; such as displaying the first window interface on the second window interface, or displaying the second window interface on the first window interface. Specifically, the window interface to be linked is displayed on another window interface in the form of a floating window, and the floating window may include the interface content in the window interface. For example, the first window interface to be linked is displayed on the second window interface in the form of a floating window (such as Fig.10 As shown), the floating window includes the interface content of the first window interface; for another example, the second window interface is displayed on the first window interface in the form of a floating window, and the floating window includes the interface content of the second window interface. Among them, the layer level of the display layer of each window interface to be linked during linkage display can be the default, or confirmed according to the application scenario, or customized by the user; the lower the layer level of the display layer of the window interface, the closer the display position of the window interface is to the bottom layer in terms of visual effect. The following is a detailed introduction to several exemplary methods of determining the layer level, including:

[0169] ① The layer level of the display layer of each window interface to be linked can be the default when the linkage is displayed. For example, if the window selection operation is applied to any window interface to be linked, then the layer level of the display layer of the default window interface is lower, that is, the layer level of the display layer of other window interfaces except the window interface among the multiple window interfaces to be linked is higher than the layer level of the display layer of the window interface, so that the other window interface is displayed on the window interface in the form of a floating window.

[0170] ② The layer level of the display layer of each window interface to be linked during linkage display can be determined according to the application scenario. For example, the application scenario is a tutorial scenario, such as the first window interface is used as an editing tutorial to provide operational guidance for content editing of the interface content in the second window interface. In this implementation, in order to facilitate users to edit content according to the editing tutorial, the layer level of the display layer of the first window interface used as the editing tutorial can be set to be higher than the layer level of the display layer of the second window interface to be edited by default; in terms of visual effect, the interface content in the first window interface is displayed on the second window interface in the form of a floating window.

[0171] It is worth noting that, considering that the same editing tutorial may be used as an editing tutorial for multiple window interfaces to be edited at the same time, the embodiment of the present application also supports performing a window selection operation in the first window interface as an editing tutorial, so that the window interfaces to be edited can be selected in batches in the selection window that triggers the display; this method of batch selecting window interfaces to be edited, compared to selecting an editing tutorial for each window interface to be edited, can avoid frequent and repeated selection operations, effectively improve the linkage speed and efficiency, and enhance the user's linkage experience. In a specific implementation, if the first window interface is used as an editing tutorial to guide the content editing of the second window interface and the third window interface, and the window selection operation acts on the first window interface, and the second window identifier in the selection window and the third window identifier of the third window interface are selected, then the linkage display of the first window interface and the second window interface is that the first window interface is displayed on the second window interface. In detail, the first window interface is displayed on the second window interface and specifically includes: the first interface content corresponding to the first window interface is displayed on the second window interface, and the first interface content is used to provide operation guidance for content editing of the interface content currently displayed in the second window interface, that is, the first interface content in the first window interface displayed in the second window interface is a partial interface that has guiding significance for the interface content currently displayed in the second window interface. Further, considering that the third window logo in the selection window is also selected, indicating that the third window interface also uses the first window interface as an editing tutorial, the second interface content in the first window interface is displayed on the third window interface; the second interface content is used to provide operation guidance for content editing of the interface content currently displayed in the third window interface, that is, the second interface content in the first window interface displayed in the third window interface is a partial interface that has guiding significance for the interface content currently displayed in the third window interface.

[0172] A schematic diagram of an exemplary batch linkage window interface can be found in Fig.11a ;like Fig.11aAs shown, when a window selection operation is performed in the first window interface, a selection window can be triggered to display, and the selection window includes a second window identifier 1101 of the second window interface and a third window identifier 1102 of the third window interface. If the user wants to use the first window interface as an editing tutorial for both the second window interface and the third window interface, the user can perform a selection operation on the second window identifier 1101 and the third window identifier 1102 in the selection window, and the first window interface can be used as an editing tutorial for both the second window interface corresponding to the second window identifier 1101 and the third window interface corresponding to the third window identifier 1102. At this time, the first interface content in the first window interface (part of the interface content that matches the current interface content to be edited in the second window interface) can be displayed in the form of a floating window on the second window interface; and the second interface content in the first window interface (part of the interface content that matches the current interface content to be edited in the third window interface) can be displayed in the form of a floating window on the third window interface.

[0173] Similarly, considering that the content editing of the same window interface to be edited may require multiple editing tutorials for operation guidance, therefore, the embodiment of the present application also supports the execution of a window selection operation in the second window interface to be edited, so that the window interface as the editing tutorial can be selected in batches in the selection window that triggers the display; this method of batch selecting the window interface as the editing tutorial, compared to multiple linkages of the same window interface to be edited and different window interfaces as editing tutorials, can avoid frequent and repeated selection operations, effectively improve the linkage speed and efficiency, and enhance the user's linkage experience. In a specific implementation, if the first window interface and the third window interface are simultaneously used as editing tutorials to guide the content editing of the second window interface, and the window selection operation acts on the second window interface, and the first window identifier and the third window identifier in the selection window are selected, then the linkage display of the first window interface and the second window interface is the first window interface displayed on the second window interface. In detail, the first window interface is displayed on the second window interface and specifically includes: the first interface content corresponding to the first window interface is displayed on the second window interface, and the first interface content is used to provide operation guidance for content editing of the interface content currently displayed in the second window interface, that is, the first interface content in the first window interface displayed in the second window interface is a partial interface that has guiding significance for the interface content currently displayed in the second window interface. Further, considering that the third window logo of the third window interface in the selection window is also selected, indicating that the third window interface is also used as an editing tutorial for the second window interface, the third interface content in the third window interface is displayed on the second window interface; the third interface content is used to provide operation guidance for content editing of the interface content currently displayed in the second window interface, that is, the second interface content in the first window interface and the third interface content in the third window interface displayed in the second window interface are partial interfaces that have guiding significance for the interface content currently displayed in the second window interface.

[0174] A schematic diagram of an exemplary batch linkage window interface can be found in Fig.11b ;like Fig.11bAs shown, when a window selection operation is performed in the second window interface, a selection window can be triggered to be displayed, and the selection window includes the first window identifier 1103 of the first window interface and the third window identifier 1102 of the third window interface. If the user wants to use the first window interface and the third window interface as editing tutorials for the second window interface at the same time, the user can perform a selection operation on the first window identifier 1103 and the third window identifier 1102 in the selection window, and at this time, the first window interface and the third window interface can be used as editing tutorials for the second window interface at the same time. At this time, the first interface content in the first window interface (part of the interface content that matches the current interface content to be edited in the second window interface) can be displayed in the form of a floating window on the second window interface; and, the third interface content in the third window interface (part of the interface content that matches the current interface content to be edited in the second window interface) can be displayed in the form of a floating window on the second window interface. Among them, the embodiment of the present application does not limit the display method of the first interface content and the third interface content on the second window interface; as Fig.11b The first interface content and the second interface content shown can be displayed in the same floating window, or can be displayed in different floating windows respectively, which is not limited.

[0175] It can be seen that the embodiment of the present application not only supports batch selection of multiple editing tutorials to be linked for the window interface to be edited (such as the second window interface), but also supports batch selection of multiple window interfaces to be edited for the window interface serving as the editing tutorial (such as the first window interface); compared to only linking one window interface serving as the editing tutorial and the window interface to be edited each time, it can avoid frequent and redundant linkage operations, shorten the path of batch linkage, and effectively improve the efficiency of batch linkage.

[0176] ③ The layer level of the display layer of each window interface to be linked during linkage display can be customized by the user. Fig.10, assuming that the window interface on which the window selection operation is executed in the browser is the third window interface, then when the first window identifier and the second window identifier in the selection window evoked from the third window interface are subjected to the selection operation, in order to further determine the linkage display method between the first window interface corresponding to the first window identifier and the second window interface corresponding to the second window identifier. The embodiment of the present application also supports the user to configure the layer level of the display layer for the first window interface and the second window interface on which the selection operation is executed; in this way, when the first window interface and the second window interface are displayed in linkage, the window interface with a high layer level of the configured display layer (such as the first window interface) is specifically displayed in a floating layer form on the window interface with a low layer level of the display layer (such as the second window interface). This method of user-defined layer levels of the display layers of each window interface to be linked meets the user's needs for personalized definition of layer levels and enhances the user's linkage experience. In a specific implementation, a confirmation option is included in the selection window. In response to the user's triggering operation for the confirmation option, indicating that the user has completed the selection of the window identifier, the display layer configuration window can be triggered; in this way, the user can configure in the layer configuration window the layer level of the display layer of the first window interface corresponding to the first window identifier on which the selection operation is executed in the selection window, and the layer identifier of the display layer of the second window interface corresponding to the second window identifier on which the selection operation is executed in the selection window; then, in accordance with the configured layer level of the display layer of the first window interface and the layer level of the display layer of the second window interface, the first window interface and the second window interface are linked to be displayed in the application. A schematic diagram of an exemplary map layer configuration window can be seen in FIG. Fig.12 ;like Fig.12 As shown in the layer configuration window 1201, the drop-down option 1202 can be used to select the layer level of the display layer of the first window interface to be greater than (or smaller than) the layer level of the display layer of the second window interface. Then, when the first window interface and the second window interface are displayed in linkage, the first window interface (specifically the interface content in the first window interface) can be displayed as a floating window on the second window interface according to the configuration.

[0177] It should be understood that Fig.12 The content and style of the layer configuration window shown are exemplary. In actual applications, the content and style of the layer configuration window may change, and the configuration operations performed in the layer configuration window (such as not configuring the layer level through the drop-down options, but directly inputting the layer level relationship between the two window interfaces) may also be different, which is specially explained here. In addition, for the convenience of explanation, the subsequent embodiments are introduced by taking the first window interface and the second window interface linked display including: the first window interface is displayed on the second window interface in the form of a floating window as an example, which is specially explained here.

[0178] 2. Executing a window linkage operation on the first window interface and the second window interface includes: a drag operation.

[0179] In an embodiment of the present application, if it is determined that the user wants to link the first window interface and the second window interface, a drag operation can be performed on the first window interface and the second window interface to quickly realize the window linkage between the first window interface and the second window interface. Among them, the drag operation can refer to the process of moving the window interface after selecting a certain window interface. Optionally, the drag operation can be described as: continuously pressing any display position in the window interface to activate (or select) the window interface, and also maintaining the operation of pressing any display position in the window interface during the movement. Optionally, the drag operation can also be described as: continuously pressing any display position in the window interface to activate (or select) the window interface, and then no longer pressing any position in the window interface, and the window interface can also follow the cursor (or touch focus) to move. It is worth noting that when the window interface described above moves, or when the window interface moves with the cursor, the thumbnail corresponding to the window interface moves, and the window interface remains in the original display position and display style. Among them, the thumbnail corresponding to the window interface can refer to: a small image after compressing the image corresponding to the window interface; the thumbnail is used to load web pages with more graphics or pictures in the browser more quickly, has the advantages of being small and fast loading speed, and can realize fast browsing of web pages.

[0180] The following is combined with Fig.13 The specific implementation process of realizing window linkage between the first window interface and the second window interface by dragging and dropping is introduced by taking the case where both the first window interface and the second window interface to be linked are displayed on the display screen of the terminal, and the user wants to display the first window interface as a floating window on the second window interface as an example. Fig.13In the application, the first window interface 1301 and the second window interface 1302 are both displayed on the display screen of the terminal (such as displayed side by side); if the user has the need to link the first window interface 1301 and the second window interface 1302, specifically, the interface content in the first window interface 1301 is displayed in the second window interface in the form of a floating window. Then, the user can perform a long press operation at any display position in the first window interface 1301 to activate the first window interface 1301; after activation, the thumbnail 1303 corresponding to the first window interface 1301 will be displayed on the display screen, and the thumbnail 1303 can be specifically displayed in the area adjacent to the cursor 1304 (or displayed in the touch focus (such as the focus when a finger or electronic pen touches the display screen)). Then, the user can drag the thumbnail 1303, or drag the thumbnail by moving the cursor 1304. At this time, the terminal receives the drag operation on the first window interface 1301 (specifically the thumbnail 1303 corresponding to the first window interface 1301), and drags the first window interface into the second window interface in the form of a thumbnail. Finally, if the thumbnail corresponding to the first window interface meets the linkage condition in the second window interface, it is determined that the first window interface and the second window interface are successfully linked, triggering the step of linking and displaying the first window interface and the second window interface in the application in response to the window linkage operation.

[0181] It should be noted that: ① In the process of dragging the thumbnail corresponding to the first window interface to move, the embodiment of the present application supports the first window interface to remain unchanged (such as the display position and display size in the display screen do not change); in this way, even if the first window interface and the second window interface are successfully linked, the independence of the first window interface can be maintained, and the user can perform operations such as web page updates in the first window interface as needed.

[0182] ② The thumbnail corresponding to the first window interface satisfies the linkage condition in the second window interface, including but not limited to: the thumbnail corresponding to the first window interface stays in the second window interface for a time period greater than the first time threshold (the embodiment of the present application does not limit the specific time of the first time threshold, such as the first time threshold is 3 seconds). Or, the thumbnail of the first window interface is dragged to the linkage area in the second window interface (such as the designated area in the second window interface).

[0183] Exemplarily, the thumbnail corresponding to the first window interface satisfies the linkage condition in the second window interface, including: the thumbnail corresponding to the first window interface stays in the second window interface for a time period greater than a first time period threshold. Fig.14aAs shown, after the thumbnail of the first window interface is dragged to the second window interface, in order to facilitate the user to intuitively perceive the stay time of the thumbnail of the first window interface, a time mark 1401 can be displayed in the second window interface, such as the time mark in the form of a circular clock or a horizontal axis, and the time mark is displayed at a specified position in the second window interface or in an area adjacent to the thumbnail, etc. In this way, if the user drags the thumbnail of the first window interface to the second window interface due to an error operation, the user can observe the time mark 1401 and release the thumbnail in time when the stay time is less than the first time threshold, so as to avoid the linkage between the first window interface and the second window interface due to the error operation.

[0184] Exemplarily, the thumbnail corresponding to the first window interface satisfies the linkage condition in the second window interface, including: the thumbnail of the first window interface is dragged to the linkage area in the second window interface. Fig.14b As shown, when the thumbnail of the first window interface is just dragged to the second window interface, the prompt information 1402 of the linkage area can be output in the second window interface, and the prompt information 1402 is used to prompt the specific position of the linkage area in the second window interface; in this way, when the user wants linkage, he can continue to drag the thumbnail corresponding to the first window interface to the linkage area, and release it in the linkage area (for example, when the thumbnail is continuously pressed, the pressing of the thumbnail can be canceled; for example, when the thumbnail follows the movement of the cursor, the thumbnail can be released by clicking) to achieve successful linkage between the first window interface and the second window interface.

[0185] It should be understood that the above Fig.14a and Fig.14b The specific implementation process of the drag operation shown is exemplary and does not limit the embodiments of the present application.

[0186] Based on the two exemplary window linkage operations provided above (such as implementing window linkage operations by selecting a window, or dragging operations), it should also be noted that the above contents are only several exemplary window linkage operations provided in the embodiments of the present application; in actual applications, the window linkage operations performed on the first window interface and the second window interface are not limited to the above-mentioned ones.

[0187] For example: the window linkage operation performed on the first window interface and the second window interface may also include a voice input operation. Specifically, after starting the browser in the terminal, the microphone deployed in the terminal can be started according to the user's needs, so that the microphone can collect voice signals in the physical environment of the user; and perform voice analysis on the collected voice signals, and when the analysis shows that the voice signal is used to indicate the linkage of the two window interfaces, the two window interfaces can be automatically linked in the browser. The above-mentioned method of quickly linking window interfaces through voice signals does not require the user to perform operations on the display screen. When the user is not convenient to touch the display screen, it can achieve accurate linkage of the window interfaces and enhance the user's linkage experience.

[0188] For another example: As described above, in some special scenarios, there is a certain relationship between the first window interface and the second window interface. For example, in a tutorial scenario, the first window interface and the second window interface have a linkage attribute (for example, the linkage attribute between the first window interface and the second window interface includes: the first window interface is used to guide the content editing of the second window interface), then the window linkage operation performed on the first window interface and the second window interface may also include: a confirmation operation for the linkage prompt information output by the application. Specifically, the application can configure a window linkage recognition function, which enables the application to automatically recognize the linkage attributes of multiple window interfaces in an open state; the window linkage recognition function can be turned on by default, or can be turned on or off by the user's own control.

[0189] In actual application, assuming that the window linkage recognition function of the application is turned on, that is, the application is in the window linkage recognition state, then if the application actively recognizes that the first window interface and the second window interface have linkage attributes, then the linkage prompt information is output, and the linkage prompt information includes a confirmation option. At this time, if the user wants to link the first window interface and the second window interface, the user can perform a selection operation for the confirmation option in the linkage prompt information. At this time, the terminal receives the selection operation for the confirmation option and determines that the window linkage operation for the first window interface and the second window interface is obtained. Then, the terminal triggers the execution of the step of linking the first window interface and the second window interface in the application in response to the window linkage operation; specifically, the first interface content in the first window interface as an editing tutorial is displayed on the second window interface to be edited. Among them, the first interface content displayed in the floating window on the second window interface can be the interface content currently displayed or hidden in the first window interface, and is used to guide the content editing of the interface content currently displayed in the second window interface.

[0190] A schematic diagram of an exemplary linkage prompt information can be seen from Fig.15 ;like Fig.15 As shown, after the window linkage recognition function is turned on in the browser, the browser can actively identify whether the window interfaces in the open state have linkage attributes (specifically, it can be to analyze whether the interface contents included in each window interface match each other, etc.). If it is detected that the first window interface can be used as an editing tutorial for the second window interface, the browser actively outputs linkage prompt information 1501; the linkage prompt information 1501 is used to prompt whether to link the first window interface and the second window interface; the linkage prompt information 1501 also includes a cancel option 1503 and a confirmation option 1502. When the user performs a trigger operation on the confirmation option 1502, it means that the user wants to link the first window interface and the second window interface, so the step of linking the first window interface and the second window interface in the application is triggered; conversely, when the user performs a trigger operation on the cancel option 1503, it means that the user does not want to link the first window interface and the second window interface, so the linkage prompt information 1501 is canceled on the display screen.

[0191] In summary, the embodiments of the present application can integrate the interface contents of different window interfaces into one window interface by linking different window interfaces in the same application. Compared with the independent display of the first window interface and the second window interface, the flexibility of displaying the interface contents in the application is improved, so that the user does not need to frequently switch window interfaces or frequently change eyes to obtain the interface contents in different window interfaces. The user only needs to focus on one window interface to obtain the interface contents in different window interfaces at the same time. In addition, the embodiments of the present application support a variety of window linkage operations, and the user can perform window linkage operations on the first window interface and the second window interface according to their own operating habits, thereby improving the user's linkage experience. In addition, the embodiments of the present application also support batch linkage of multiple window interfaces, shorten the path of linkage of different windows, simplify batch linkage operations, and improve the speed and efficiency of window linkage.

[0192] Fig.16 A flowchart of a window processing method provided by an exemplary embodiment of the present application is shown; the window processing method can be executed by a computer device in the aforementioned system, such as a terminal and a server; the window processing method may include but is not limited to steps S1601-S1604:

[0193] S1601: Start an application in the terminal.

[0194] S1602: Receive a window linkage operation for the first window interface and the second window interface.

[0195] It should be noted that the specific implementation process shown in steps S1601-S1602 can be found in the aforementioned Figure 3The relevant description of the specific implementation process shown in steps S301-S302 in the illustrated embodiment is not repeated here.

[0196] S1603: In response to the window linkage operation, display a window interface to be linked displayed on another window interface.

[0197] As described above, the linkage display of the first window interface and the second window interface may include: displaying the first window interface on the second window interface in the form of a floating window, or displaying the second window interface on the first window interface in the form of a floating window. For ease of understanding, it can be considered that the layer level of the display layer of the window interface displayed in the form of a floating window is higher than the layer level of the display layer of another window interface. Among them, the layer level relationship between the layer level of the display layer of the first window interface and the layer level of the display layer of the second window interface may specifically include: default (such as the layer level of the display layer of the window interface with a window selection operation is lower than the layer level of the display layer without a window selection operation by default); or, set according to the application scenario (such as in the tutorial scenario, the layer level of the display layer of the first window interface used for editing the tutorial is higher than the layer level of the display layer of the second window interface to be edited by default, and in terms of visual effect, the first interface content in the first window interface is displayed on the second window interface in the form of a floating window); or, user-defined (such as the user can specify the layer level relationship between the two window interfaces as needed). For ease of explanation, it is taken as an example that the layer level of the display layer of the second window interface is lower than the layer level of the display layer of the first window interface, that is, the first interface content in the first window interface is displayed on the second window interface in the form of a floating window.

[0198] It is worth noting that the embodiment of the present application does not limit the display area of ​​the floating window, nor does it limit the font size and font type of the text included in the first interface content displayed in the floating window. For example, the display width of the floating window can be 20% of the window width of the second window interface opened by the browser, and the display length of the floating window can be 30% of the window length of the second window interface opened by the browser; for another example, the font size of the text included in the first interface content displayed in the floating window can be 14px (pixel), and the font can be Kaiti.

[0199] Based on the above description of the floating window, the following points need to be explained in the embodiment of the present application:

[0200] (1) Considering that the floating window has a display area, when the floating window is displayed on the second window interface, it will inevitably block part of the interface content in the second window interface, which is not conducive to the user to view or operate the blocked part of the interface content in the second window interface. Based on this, the embodiment of the present application supports folding and restoring the floating window, which helps users to flexibly control the appearance and hiding of the floating window according to their viewing needs. In a specific implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, and the floating window includes a folding option, then when the user performs a trigger operation on the folding option, it means that the user wants to hide the floating window. At this time, in response to the trigger operation on the folding option, the floating window is folded and displayed in the second window interface. Among them, folding and displaying the floating window can be simply understood as minimizing the floating window, so that the folded floating window will not block the interface content in the second window interface. Exemplarily, the schematic diagram of blocking and displaying the floating window through the folding option in the second window interface can be seen. Fig.17a ;like Fig.17a The floating window shown includes a folding option 1701. In response to a trigger operation for the folding option 1701, the floating window can be folded and displayed in the second window interface; Fig.17a In the example, the floating window is folded and displayed in the form of icon 1702. It should be understood that the folding display of the floating window may also include other forms, which are not limited thereto.

[0201] Furthermore, when the user has a need to view the interface content (such as the first interface content) in the floating window, the embodiment of the present application also supports restoring the folded floating window to display the floating window on the second window interface, so that the user can more easily view the interface content in the floating window. In a specific implementation, the terminal responds to the restoration operation on the floating window and restores the floating window in the second window interface; wherein, depending on the different ways of folding the floating window, the restoration operation on the floating window is also different. For example, the floating window after folding is Fig.17a If the user clicks the icon 1702 (or drags the icon 1702 toward the middle of the screen), the terminal determines that a restoration operation for the floating window has been received. Fig.17b .

[0202] (2) The embodiment of the present application also supports the user to adjust the display area of ​​the floating window, and flexibly control the display and hiding of part of the interface content blocked by the floating window. In a specific implementation, an adjustment option is displayed in the floating window, and the user can flexibly adjust the display area of ​​the floating window by triggering the adjustment option. For example, a schematic diagram of the floating window including the adjustment option can be seen in Fig.18 ;exist Fig.18 The first adjustment option 1801 and the second adjustment option 1802 are included; wherein the first adjustment option 1801 can adjust the window width and window length of the floating window at the same time, and the second adjustment option 1802 is mainly used to adjust the window length of the floating window. It should be understood that the embodiment of the present application does not limit the adjustment method for the display area of ​​the floating window; for example, the floating window may also include a third adjustment option, and the third adjustment option is mainly used to adjust the window width of the floating window; for another example, the adjustment option in the floating window can also be in a hidden state, and only after the cursor or touch focus falls into the floating window, the adjustment option is displayed, so that the user can intuitively perceive that the display area of ​​the floating window is adjustable.

[0203] (3) The embodiment of the present application also supports the user to close the window linkage between the first window interface and the second window interface; when the user does not have the linkage demand, the window linkage can be disconnected in time, so that the entire process of window linkage can be controlled by the user, thereby improving the user's linkage experience. In a specific implementation, a close option is included in the floating window, and in response to the user's trigger operation on the close option, indicating that the user wants to close the floating window and cancel the window linkage between the first window interface and the second window interface, the floating window can be canceled in the second window interface. Further, the embodiment of the present application also supports outputting a close prompt message before the floating window is closed, and the close prompt message is used to ask the user whether to close the floating window; if the user confirms to close (such as performing a confirmation operation on the close prompt message, or the user confirms to close by default when the continuous display time of the close prompt message reaches a certain threshold (such as 3 seconds)), then the step of canceling the display of the floating window in the second window interface is executed, and the linkage relationship between the first window interface and the second window interface is disconnected in the background.

[0204] An exemplary interface diagram for closing a floating window can be found in Fig.19 ;like Fig.19The floating window shown includes a close option 1901. When the user wants to close the floating window, that is, to cancel the window linkage relationship between the first window interface and the second window interface, the user can perform a trigger operation on the close option 1901 in the floating window; at this time, the display of the floating window can be directly canceled, or a close prompt message 1902 can be output on the display screen, and in response to the user's confirmation operation on the close prompt message 1902, the display of the floating window can be canceled in the second length and width interface.

[0205] (4) The embodiment of the present application also supports the user controlling the display position of the floating window in the second window interface; in this way, the user can dynamically adjust the display position of the floating window in the second window interface as needed according to his or her own viewing needs for the interface content in the second window interface, thereby improving the flexibility of the display position of the floating window on the second window interface. In a specific implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, then the user can perform a position adjustment operation on the floating window in the second window interface, and the terminal can update the display position of the floating window in the second window interface according to the position adjustment operation. Among them, the position adjustment operation for the floating window may include: setting the floating window to an adjustable state, and controlling the floating window in the adjustable state to move on the second window interface. In detail, the method of setting the floating window to an adjustable state may include but is not limited to: performing a gesture operation (such as a long press operation, a double-click operation, or a triple-click operation, etc.) on the floating window to convert the floating window from a display position non-adjustable state to an adjustable state; or, through an external device (such as a mouse) right-click operation, triggering the display of an option sub-window corresponding to the floating window, the option sub-window including a position adjustment option, responding to the trigger operation for the position adjustment option to convert the floating window from a display position non-adjustable state to an adjustable state; and so on.

[0206] A schematic diagram of an exemplary control of the display position of the floating window can be seen in Fig. 20 ;like Fig. 20As shown, by performing a long press operation on any display position in the floating window, the floating window can be set to an adjustable state, so that the floating window in the adjustable state can be controlled to move on the second window interface to adjust the display position of the floating window. Alternatively, an external mouse can be used to perform a right-click operation on any display position in the floating window, and an option sub-window 2001 can be output on the display screen, and the option sub-window 2001 includes at least a position adjustment option 2002; in this way, the user can set the floating window to an adjustable state by triggering the position adjustment option 2002, thereby controlling the floating window in the adjustable state to move on the second window interface to adjust the display position of the floating window. Further, similar to the process of controlling the movement of the thumbnail corresponding to the first window interface described above, when controlling the floating window to move in the second window interface, the movement of the floating window can be controlled by continuously pressing and dragging, or the floating window can move following the movement of the cursor or touch focus (in this process, the user does not need to continuously press the floating window), and this is not limited.

[0207] It should be understood that the above implementations (1)-(4) are only several exemplary transformation functions (such as minimizing or closing, etc.) provided for the floating window in the embodiment of the present application. In actual applications, according to the user's transformation requirements for the floating window, the embodiment of the present application also supports some additional transformation functions for the floating window. The above transformation functions do not limit the embodiment of the present application and are specifically explained here.

[0208] S1604: If the content of one window interface changes, the other window interface is controlled to change its content.

[0209] It should be understood that the display area of ​​the terminal display screen is limited, and the webpage content contained in a webpage provided by the website is often rich, so it is difficult for the window interface provided by the browser to display all the webpage content at once. In this way, by performing operations such as sliding (such as sliding up and down in the vertical direction) or turning pages (such as turning pages left and right in the horizontal direction) on the window interface, sliding or turning pages in the window interface to display the hidden part of the webpage content.

[0210] For ease of understanding, taking the linkage display of the first window interface being displayed in the form of a floating window on the second window interface as an example, the floating window displayed in the second window interface only displays all or part of the interface content currently displayed in the first window interface. For example, assume that the first window interface corresponds to N first sub-interfaces, each first sub-interface includes part of the web page content to be displayed in the first window interface; the second window interface corresponds to M second sub-interfaces, each second sub-interface includes part of the web page content to be displayed in the second window interface; N and M are integers greater than or equal to 1. If the interface content currently displayed in the first window interface is the i-th first sub-interface among the N first sub-interfaces, i is an integer, and 1≤i≤N, the interface content currently displayed in the second window interface is the j-th second sub-interface among the M second sub-interfaces, j is an integer, and 1≤j≤M. In this case, a window linkage operation is performed on the first window interface and the second window interface, and the layer level of the display layer of the first window interface is set higher than the layer level of the display layer of the second window interface. Then, all or part of the interface content in the i-th first sub-interface can be displayed in a floating window, and the floating window is displayed on the j-th second sub-interface displayed by the second window interface, so as to realize the linkage display between the first window interface and the second window interface.

[0211] Furthermore, the first interface content to be displayed in the floating window in the i-th first sub-interface may be a default one or a user-defined one. Fig.21a As shown, assuming that the first interface content to be displayed in the floating window in the i-th first sub-interface can be the default, and the entire interface content contained in the i-th first sub-interface is displayed in the floating window 2101 by default; then, the floating window 2101 displayed on the second window interface (specifically the j-th second sub-interface) includes the entire interface content contained in the i-th first sub-interface (such as a screenshot of the i-th first sub-interface). Figure 21b As shown, assuming that the first interface content to be displayed in the floating window in the i-th first sub-interface can be customized by the user; then, after the first window interface and the second window interface are linked, the user can select (such as by screenshot or copying, etc.) part of the interface content to be linked and displayed in the i-th first sub-interface (or other first sub-interfaces) currently displayed in the first window interface, and display the part of the interface content in the floating window 2101, and the floating window 2101 is displayed on the second window interface. It can be seen that the user can independently select the interface content to be linked and displayed from the first window interface, allowing the user to link as needed, thereby improving the user's linkage experience.

[0212] Furthermore, if the content of one of the two window interfaces displayed in linkage changes, the embodiment of the present application also supports linkage control of the other window interface to change the content, so as to realize linkage change of linkage content and improve the intelligence of content change when different windows are linked. Among them, taking the linkage display as the first window interface displayed in the form of a floating window on the second window interface as an example, when the content of one of the two window interfaces displayed in linkage changes, linkage control of the other window interface to change the content includes any of the following:

[0213] ① In response to the change operation on the interface content in the second window interface, the interface content in the first window interface is synchronously updated and displayed in the first window interface, and the interface content in the first window interface is synchronously updated and displayed in the floating window. Fig.22a As shown, assuming that a change operation is performed in the second window interface, the terminal responds to the change operation by using the j+2th second sub-interface among the M second sub-interfaces to update and display the jth second sub-interface; then, according to the update rule of synchronous update, the interface content displayed in the first window interface can be changed, so that the interface content in the first window interface can be kept displayed in real time in the floating window. Of course, this solution mainly realizes the linkage of the two windows through the floating window. Therefore, when there is a change operation in the second window interface, only the first interface content in the floating window can be kept updated synchronously, while the first window interface remains independent (that is, whether its interface content changes is not affected by the changes in the content of the second window interface and the floating window).

[0214] ② In response to the change operation on the first interface content in the floating window, the interface content in the first window interface is synchronously updated and displayed in the first window interface, and the interface content in the second window interface is synchronously updated and displayed in the second window interface. Figure 22b As shown, assuming that there is a change operation in the floating window, indicating that the user wants to update the first interface content displayed in the floating window, the floating window can be regarded as a reduced version of the first window interface, and N first sub-interfaces can be updated and displayed in the floating window. In addition, according to the update rule of synchronous update, the interface content in the first window interface is updated so that the interface content displayed in the first window interface is consistent with the interface content displayed in the floating window (such as completely the same, or partially the same); at the same time, the second sub-interface displayed in the second window interface is updated. Of course, when the interface in the floating window changes, the interface content in the first window interface can also be kept unchanged to ensure the independence of the first window interface and facilitate the user to independently operate the first window interface.

[0215] It should be noted that, depending on whether the linked first window interface and the second window interface have a linkage attribute (i.e., whether the first window interface is used to guide the content editing of the interface content in the second window interface), the update rules of the above-mentioned synchronous update are different.

[0216] Optionally, if there is no linkage attribute between the first window interface and the second window interface, that is, the first window interface and the second window interface may be two user-defined window interfaces that do not have a tutorial relationship, then the update rules for synchronous updates may include: synchronous updates based on the operation information of the change operation. Taking the change operation as a sliding operation performed in the vertical direction as an example, the update operation may specifically include: there is a distance mapping relationship between the floating window and the second window interface (similarly, there is also this distance mapping relationship between the floating window and the first window interface), and the distance mapping relationship is used to indicate: the first sliding distance of the sliding operation performed in the floating window corresponds to the second sliding distance in the second window interface; wherein the specific values ​​of the first sliding distance and the second sliding distance are determined according to the window widths of the floating window and the second window interface. Fig.23 As shown, assuming that the sliding operation performed in the floating window is to slide 1 cm upward in the vertical direction, and the distance mapping relationship indicates that the 1 cm in the floating window corresponds to 2 cm in the second window interface, and the sliding directions in the two windows are the same; then, when the first sliding distance generated by the sliding operation performed in the floating window is 1 cm, the second sliding distance in the second window interface can be mapped to 2 cm according to the distance mapping relationship, then the second sub-interface after the change along the sliding direction is updated and displayed in the second window interface according to the second sliding distance; or, the first sub-interface after the change along the sliding direction is updated and displayed in the first window interface according to the first sliding distance, and the updated interface content in the first window interface is synchronously displayed in the floating window. It should be understood that Fig.23 The introduction is made by taking the case where a change operation (such as a sliding operation) exists in a floating window as an example; when the change operation exists in the second window interface, the specific implementation process of the linkage control content change is similar and will not be repeated here.

[0217] Optionally, if the first window interface and the second window interface have linkage properties, then the update rules for synchronous update may include: synchronous update according to the matching degree between the interface content in the first window interface and the interface content in the second window interface. In the tutorial scenario, the higher the matching degree between the interface content in the first window interface and the interface content in the second window interface, the more likely this part of the interface content in the first window interface is to be a content that guides the editing of the content in the second window interface; conversely, the lower the matching degree between the interface content in the first window interface and the interface content in the second window interface, the less likely this part of the interface content in the first window interface is to be a content that guides the editing of the content in the second window interface.

[0218] That is to say, when the first window interface and the second window interface have linkage properties (i.e., the first window interface is used to guide the content editing of the second window interface), the embodiment of the present application supports automatically updating the content between the three windows (i.e., the first window interface, the second window interface, and the floating window) according to the matching degree between the first window interface and the second window interface (specifically, the matching degree between the interface contents) when a change operation is detected. Relying on the content matching degree to achieve content updates between multiple windows can ensure that the interface content that has an operational guiding effect on the content editing of the interface content to be edited currently displayed in the second window interface is always displayed in the floating window, which facilitates the user to edit the content of the interface content in the second window interface in the tutorial scenario, and improves the user's editing efficiency and accuracy for the second window interface.

[0219] To facilitate understanding of the interface content displayed in the floating window in the tutorial scenario, and the linkage display of the content in multiple windows; the following takes the case where the first window interface is used to guide the content editing of the second window interface, and the second window interface includes one or more editing areas to be edited, and the first window interface is used to display the tutorial information corresponding to (or matching) each editing area in the second window interface (the tutorial information corresponding to any editing area can be used to guide the content editing of the editing area). In this tutorial scenario, the linkage display of the first window interface and the second window interface is as follows: the first window interface is displayed on the second window interface in the form of a floating window. In addition, the first window interface is displayed on the second window interface in the form of a floating window, including: a floating window is displayed on the second window interface, and the target tutorial information included in the first window interface is displayed in the floating window, and the target tutorial information refers to: the tutorial information corresponding to the editing area to be edited in the second window interface contained in the first window interface. In this way, the content of the interface in the second window interface can be quickly edited through the tutorial information displayed in the floating window in the second window interface, thereby improving the editing speed and efficiency.

[0220] For an exemplary diagram of displaying tutorial information in a floating window, see Fig.24 ;like Fig.24 As shown, it is assumed that the first window interface is a tutorial for editing an image (or picture) provided by a website, and the first window interface includes various steps required for editing a picture, wherein each step is tutorial information; the second window interface is an edited interface for implementing picture creation, and the user can refer to the editing steps in the first window interface in the second window interface to create a personalized picture. In the specific implementation:

[0221] On the one hand, if the terminal detects a window linkage operation for the first window interface and the second window interface, a floating window 2401 is displayed in the second window interface, and the interface content in the first window interface that is used to guide the operation of the interface content to be edited currently displayed in the second window interface is displayed in the floating window 2401. For example, the second window interface includes an editing area 2402 and an editing area 2403; wherein, the tutorial information corresponding to the editing area 2402 in the first window interface is tutorial information 2404, and the tutorial information corresponding to the editing area 2403 in the first window interface is tutorial information 2405. In this way, the user can focus on the second window interface and edit each editing area in the second window interface according to the tutorial information in the floating window interface to create a picture without frequently switching windows to interrupt the creation process, thereby improving the continuity of picture creation. It is worth noting that the tutorial information displayed in the floating window 2401 can be directly displayed in the interface content currently displayed in the first window interface, or it can belong to the hidden interface content in the first window interface (such as the hidden interface content that needs to be displayed by sliding due to the limited display area of ​​the window), and the embodiments of the present application are not limited to this.

[0222] On the other hand, if the user has finished editing the currently displayed editing area in the second window interface according to the tutorial information in the floating window 2401, and still wants to continue editing the hidden editing area in the second window interface, the user can perform a sliding operation in the second window interface to reveal the hidden editing area (such as editing area 2406) in the second window interface. In this case, the terminal can automatically update and display the tutorial information 2407 matching the currently displayed editing area 2406 (i.e., the hidden editing area) in the floating window in response to the user's sliding operation on the second window interface. In this way, the user does not need to actively update the tutorial information in the floating window 2401, but the terminal automatically updates it, which can reduce the time spent by the user to find new tutorial information from the first window interface, thereby realizing the intelligence of content linkage. Furthermore, when the editing area to be edited in the second window interface changes, the embodiment of the present application also supports automatic updating of the tutorial information in the first window interface, so that the tutorial information updated and displayed in the first window interface is tutorial information that matches the new editing area in the second window interface; in this way, the user can edit the new editing area to be edited in the second window interface by referring to the first window interface and the floating window at the same time.

[0223] Above Fig.24 This article mainly introduces the interface of linkage display in the tutorial scenario, and then explains the background technology of linkage display. Specifically, the background technology of linkage display can be roughly divided into three steps, namely:

[0224] Step 1: Obtain feature information of each first sub-interface in the first window interface, and feature information of each second sub-interface in the second window interface. Among them, the web page content corresponding to the first window interface is divided into multiple first sub-interfaces by default, and the web page content in the second window interface is divided into multiple second sub-interfaces by default; and the feature information of the sub-interface (such as embedding features) can be used to characterize the semantic features of the interface content included in the sub-interface. In detail, the interface elements constituting the web page content may include elements such as text and pictures, and these interface elements are presented as background codes on the technical side. Therefore, the terminal (or server) can obtain the background code corresponding to the sub-interface (such as the first sub-interface or the second sub-interface), and directly analyze the background code to analyze and obtain the semantic information of the text constituting the sub-interface. If the sub-interface contains an image, then after the terminal obtains the image from the background code, it can perform image recognition processing on the image to identify the semantic features of the image (such as the language of the text in the image (such as Chinese or English, etc.), the semantics expressed by the text, etc.).

[0225] Among them, the embodiment of the present application does not limit the specific process of image recognition processing, such as using an OCR (optical character recognition) algorithm to perform OCR recognition on the image to obtain the semantic information of the image. Among them, the OCR algorithm is an optical character recognition, which mainly converts the image shape into text characters. The specific process of OCR recognition can be simply summarized into two parts, namely text detection and text recognition; among them, text detection is mainly used to find the area where the text is located from the image (such as obtaining the base64 (a representation method based on 64 printable characters to represent binary data) encoding information of the image, and identifying all features of the image through SIFT (Scale-invariant feature transform) or HAAR algorithm (an algorithm for calculating image feature values), so as to find the location of the text based on the features), and text recognition is used to identify the area where the text is located to obtain the semantic information of the text, and use the semantic information of the text as the semantic information of the image.

[0226] Step 2: Compare the characteristic information of each second sub-interface in the second window interface with the characteristic information of each first sub-interface in the first window interface to obtain a comparison result; the comparison result is used to indicate the degree of match between a second sub-interface in the second window interface and a first sub-interface in the first window interface. The higher the degree of match, the closer the semantics expressed by the second sub-interface and the first sub-interface, that is, the interface content (or tutorial information) contained in the first sub-interface is more likely to be the interface content used to guide the operation of the interface content (such as the editing area) in the second sub-interface; then, when displaying in linkage, the interface content in the first sub-interface needs to be displayed in a floating window, so that the floating window can help the user quickly edit the content in the second sub-interface displayed in the second window interface (specifically, edit the content in the editing area). For ease of understanding, the embodiment of the present application supports treating the comparison result as an "intermediate container". If the comparison result indicates that the matching degree between the second sub-interface and the first sub-interface (or called confidence, i.e., the degree of credibility of the first sub-interface as an editing tutorial for the second sub-interface) is greater than a matching degree threshold (e.g., 60%), indicating that there is a linkage attribute between the first sub-interface and the second sub-interface, then the intermediate container may include: the tutorial information in the first sub-interface to be displayed in the second window interface. On the contrary, if the comparison result indicates that the matching degree between the second sub-interface and the second sub-interface is less than or equal to the matching degree threshold, indicating that there is no linkage attribute between the first sub-interface and the second sub-interface, then the intermediate container does not include any information.

[0227] Step 3: Display the interface content (such as tutorial information) in the first sub-interface in the floating window according to the comparison result. Specifically, display the tutorial information included in the "middle container" in step 2 in the floating window.

[0228] Based on the above steps 1 to 3, it is possible to select the first sub-interface with the highest matching degree for each second sub-interface in the second window interface from the multiple first sub-interfaces corresponding to the first window interface, so that when the second sub-interface is presented in the second window interface, the tutorial information in the first sub-interface matching the second sub-interface can be displayed in the floating window, which not only ensures the accuracy of the tutorial information in the floating window, but also facilitates the user to quickly edit the content of the second sub-interface. It is also worth mentioning that the process of feature information extraction and comparison shown in steps 1 and 2 can be a preset action; that is, when the first window interface and the second window interface opened in the browser have linkage attributes, the terminal can first analyze the sub-interfaces in the first window interface and the second window interface to extract the feature information of each sub-interface; by setting steps 1 and 2 as preset actions, the linkage speed and efficiency can be improved to a certain extent.

[0229] Based on the above Fig.24The linkage interface and the description of the background technology shown in the tutorial scenario also need to explain the following points:

[0230] (1) The embodiments of the present application do not limit the specific display form of the interface content displayed in the floating window. Fig.24 As shown, the display form of the interface content displayed in the floating window is: the complete tutorial information in the first window interface; for example, the first window interface displays "Step 1: Insert characters "XXX"...", then the tutorial information "Step 1: Insert characters "XXX"..." is also displayed in the floating window; in this case, the "middle container" includes the complete tutorial information in the first window interface (specifically, the first sub-interface). However, in actual applications, the display form of the interface content displayed in the floating window can also be: the difference information between the tutorial information in the first window interface and the editing area to be edited in the second window interface; in this implementation, (first window interface-second window interface) = middle container, that is, the redundant information in the interface content in the first window interface compared to the interface content in the second window interface (i.e., the non-tutorial part) is placed in the "middle container" to facilitate subsequent display in the second window interface in the form of a floating window. For example, the first window interface displays "Step 1: Insert characters "XXX"...", and the second window interface contains the editing area "1. Please insert characters", then the difference information between the first window interface and the second window interface is "XXX"; in this case, only "XXX" can be displayed in the floating window, so that the user can intuitively perceive the content that needs to be edited in the second window interface. An exemplary schematic diagram of displaying redundant information in a floating window can be seen in Fig.25a .

[0231] (2) In order to make the floating window more directional, that is, to be able to directly associate the first interface content in the floating window with the editing interface in the second window interface; the embodiment of the present application also supports displaying only the tutorial information corresponding to one editing area at a time in the floating window (or the redundant information mentioned in the implementation method (1)), and displaying the floating window at an adjacent position to the editing area. In this way, according to the display position of the floating window on the second window interface, the floating window can be pointed to a certain editing area, so that the user can intuitively perceive which editing area the interface content included in the floating window is for performing operation guidance. Compared with including more tutorial information in the floating window, it can avoid the user from searching for tutorial information for a certain editing area from the floating window to a certain extent, thereby improving the editing speed and efficiency. An exemplary schematic diagram of displaying a floating window at a position adjacent to an editing area can be seen in Fig.25b .

[0232] In addition, considering that the display area of ​​the floating window is limited, and the first interface content to be displayed in the floating window in the first window interface is often large, this may result in that the interface content may not be displayed in the floating window at once; in order to facilitate users to view all interface content in the floating window, in addition to supporting the use of the aforementioned description to adjust the display size of the floating window to display all interface content, the embodiment of the present application also supports performing sliding operations (such as sliding left and right or sliding up and down, etc.) in the floating window to slide and display part of the hidden interface content in the floating window. Fig.25c When sliding horizontally in the floating window, you can slide left and right to display the hidden interface content (or tutorial information); as the interface content appears and hides, the user can intuitively perceive the changes in the interface content through the dynamic display of icon 2501 in the floating window.

[0233] Furthermore, considering that at least two editing areas may be displayed in the second window interface at a time, when the floating window only includes tutorial information corresponding to one editing area, the embodiment of the present application also supports automatically updating and displaying the tutorial information corresponding to the next editing area in the floating window by triggering the floating window; improving the intelligence of updating the content of the first interface in the floating window, and to a certain extent also improving the speed and efficiency of editing. Fig.25c , a next option 2501 can be displayed in the floating window; when the user clicks the next option 2502, the tutorial information corresponding to the next editing area adjacent to the current editing area and to be edited can be displayed in the floating window, and the floating window can be displayed in a position adjacent to the next editing area.

[0234] Furthermore, in addition to Fig.25c As shown, triggering the next option in the floating window realizes the updating of the first interface content in the floating window and the updating of the display position of the floating window to ensure that each editing area in the second window interface can be guided by the floating window; the embodiment of the present application also supports batch display of the floating windows corresponding to each editing area in the second window interface, and each floating window displays the tutorial information corresponding to the corresponding editing area. That is to say, a floating window is displayed at a position adjacent to an editing area, and the floating window displays tutorial information for guiding the editing area to edit the content. Exemplarily, the schematic diagram of displaying a floating window at a position adjacent to each editing area in the second window interface can be seen in Fig.25d ; For example, the floating window 2503 corresponding to the editing area “1. Please insert characters”, and the floating window 2504 corresponding to the editing area “2. Please add components”.

[0235] (3) As described above, the first window interface (specifically, the first sub-interface in the first window interface) can play an operational guidance role in content editing of the interface content in the second window interface through the tutorial information contained therein. The tutorial information contained in the first window interface can be as follows: Fig.25c The graphic content shown can also be a tutorial video; that is, the first window interface can include a tutorial video, which includes multiple video frames that are read continuously, and the video content of the video frames can be used as tutorial information to guide the operation of content editing in the second window interface. In this implementation, according to the editing progress of each editing area in the second window interface, the pause or play of the tutorial video in the first window interface can be automatically controlled; in this way, the user can be accurately guided to edit each editing area by controlling the pause and play of the tutorial video, which ensures the accuracy of the operation guidance and improves the intelligence of the guidance.

[0236] The embodiment of the present application can specifically determine whether it is necessary to pause the tutorial video by detecting the dwell time of the window screenshot in the second window interface; wherein the window screenshot can be simply understood as the display area where the editing area to be edited in the second window interface is located. For example, the second window interface includes editing area 1, editing area 2 and editing area 3 from top to bottom. When editing area 1 needs to be edited, the window screenshot is located in the display area where editing area 1 is located, and when editing area 2 needs to be edited, the window screenshot is located in the display area where editing area 2 is located.

[0237] Among them, when the first window interface includes a tutorial video, the background technical method for realizing automatic pause or play includes: supporting frame extraction processing of the tutorial video, such as extracting 1200 video frames from a 25-minute tutorial video at 25FPS (i.e., extracting 25 frames per second), and then performing image recognition processing on the 1200 video frames according to the image recognition described above to obtain feature information of each video frame; and comparing the extracted feature information with the editing area contained in the window screenshot in the second window interface. If the comparison result indicates that the video frame corresponding to the feature information is used to guide the content editing of the editing area contained in the window screenshot, and the stay time of the editing area in the waiting editing state is greater than the second time threshold, then ensuring that the content editing in the second window interface is stuck on the editing area, and keeping the current video frame of the tutorial video in the first window interface unchanged, to ensure that the user has enough time to refer to the video frame to edit the content of the editing area until the editing of the editing area is completed.

[0238] For ease of explanation, it is assumed that the second window interface includes S editable regions to be edited. According to the editing order of the editable regions, the s-th editable region is in an edited state, and the (s + 1)-th editable region is in an unedited state; S is an integer greater than 1, s is an integer, and 1 ≤ s < S. In a specific implementation, if it is detected that the residence time of the (s + 1)-th editable region in the second window interface in the unedited state is greater than the second time threshold, the tutorial video is paused in the first window interface; among the multiple video frames displayed in the first window interface when pausing, the video frame has an operation guiding effect on the (s + 1)-th editable region. Further, if it is detected that the (s + 1)-th editable region changes from the unedited state to the edited state, indicating that the (s + 1)-th editable region has been edited, the tutorial video is continued to be played in the first window interface to complete the editing of the subsequent editable regions. A schematic diagram of an exemplary first window interface including a tutorial video can be seen Fig.26 ; as Fig.26 shown, when the editable region 2601 is in the unedited state for a long time (i.e., the window frame capture includes this editable region 2601), the tutorial video is paused in the first window interface to ensure that the tutorial video always includes tutorial information for guiding the content editing of this editable region 2601. If the editable region 2601 changes from the unedited state to the edited state, the tutorial video can be continued to be played.

[0239] It should be understood that the above implementation manners (1)-(3) are some exemplary extended contents in the tutorial scenario and will not limit the embodiments of the present application. In practical applications, the embodiments of the present application may also include some other optional implementation manners in the tutorial scenario.

[0240] The foregoing embodiments mainly illustrate the interface or some background technologies in the window processing method provided by the embodiments of the present application. Next, in combination with Fig. 27 , and taking the application as a browser and the computer device as a terminal and a server as an example, the background interaction process for jointly implementing the window processing method by the terminal and the server is given. As Fig. 27As shown, first, the user can start the browser through the terminal, and perform the interface opening operation of opening the first window interface and the second window interface to be linked in the browser; in this way, the terminal can send an interface opening request to the server based on the interface opening operation. Then, the server receives the interface opening request sent by the terminal, and obtains the first window identifier of the first window interface and the second window identifier of the second window interface in response to the interface opening request, wherein the window identifier of the window interface can specifically be a link address used to uniquely identify the window interface; the server returns the first window identifier and the second window identifier to the terminal, so that the terminal can obtain the interface content in the two window interfaces based on the first window identifier and the second window identifier for rendering and display. Secondly, the user can perform the window linkage operation for the first window interface and the second window interface in the browser, and at this time the terminal can feedback the window linkage operation to the server (such as by sending a signal to the server); in this way, the server can compare the interface content in the first window interface and the interface content in the second window interface in response to the window linkage operation, so as to match the corresponding tutorial information for the interface content currently displayed in the second window interface from the second window interface, and return the tutorial information to the terminal. Finally, after receiving the tutorial information returned by the server, the terminal may display the tutorial information in the form of a floating window in the second window interface.

[0241] As described above, the first window interface may include a tutorial video; in this case, the server may extract frames from the tutorial video and compare the extracted video frames with the interface content in the second window interface to find a video frame from the tutorial video that matches the interface content currently displayed in the second window interface; the server also returns the video frame (or the content included in the video frame) to the terminal, so that the terminal displays a floating window for guiding content editing in the second window interface based on the video frame. Furthermore, the terminal also supports returning the dwell time of the window frame in the second window interface to the server, so that when the server determines that the dwell time of the window frame is greater than the second duration threshold, it sends an instruction to control the tutorial video to pause to the terminal; and, when it is detected that the dwell time is less than or equal to the second duration threshold, it sends an instruction to control the tutorial video to continue playing to the terminal.

[0242] It should be noted that Fig. 27 The overall background process of the window processing method is introduced from the perspective of the interaction between the terminal and the server. The more detailed specific implementation process of a process in the above background technical process can be found in the above related description, which will not be repeated here.

[0243] In the embodiment of the present application, on the one hand, it supports the linkage of different window interfaces in the same application, and can realize the integration of the interface contents of different window interfaces into one window interface. Compared with the independent display of the first window interface and the second window interface, the flexibility of the display of the interface contents in the application is improved, so that the user does not need to frequently switch the window interface or frequently change the eyes to obtain the interface contents in different window interfaces. Only one window interface needs to be focused on to obtain the interface contents in different window interfaces at the same time. On the other hand, it supports a variety of window linkage operations, and the user can perform window linkage operations for the first window interface and the second window interface according to their own operating habits, thereby improving the user's linkage experience; it also supports batch linkage of multiple window interfaces, shortens the path of linkage of different windows, simplifies batch linkage operations, and improves the speed and efficiency of window linkage. On the other hand, it supports linkage control of the content change of another window interface when the content of one of the two window interfaces displayed in linkage changes; this intelligent content linkage method can not only guide users more directly and accurately, but also eliminates the need for users to manually search for tutorial information, simplifying operations while improving linkage experience.

[0244] The method of the embodiment of the present application is described in detail above. In order to facilitate better implementation of the above scheme of the embodiment of the present application, the device of the embodiment of the present application is provided below accordingly.

[0245] Fig.28 A schematic diagram of the structure of a window processing device provided by an exemplary embodiment of the present application is shown; the window processing device can be used to perform Figure 3 or Fig.16 Some or all of the steps in the method embodiment shown. Fig.28 , the window processing device includes the following units:

[0246] A starting unit 2801 is used to start an application in the terminal, where the application includes a first window interface and a second window interface;

[0247] The processing unit 2802 is used to receive a window linkage operation for the first window interface and the second window interface;

[0248] Processing unit 2802 is also used to respond to the window linkage operation to link and display the first window interface and the second window interface in the application; when the first window interface is displayed on the second window interface, or the second window interface is displayed on the first window interface, and when the content of one window interface changes, the other window interface is linked and controlled to change its content.

[0249] In one implementation, the processing unit 2802 is configured to receive the window linkage operation for the first window interface and the second window interface, specifically to:

[0250] Display the selection window; the selection window is used to display the window logo of the window interface in the open state in the application;

[0251] In the selection window, a selection operation for a first window identifier of a first window interface and / or a second window identifier of a second window interface is received.

[0252] In one implementation, the application further includes a third window interface, which is another window interface in the application except the first window interface and the second window interface; the processing unit 2802 is used to display the selection window, specifically to:

[0253] Display the window interface in the application; the window interface includes any of the following: a first window interface, a second window interface or a third window interface;

[0254] According to the window selection operation existing in the window interface, a selection window is displayed.

[0255] In one implementation, the window selection operation includes any of the following:

[0256] A gesture operation performed in the window interface; the gesture operation includes one or more of a sliding operation, a long press operation, a single click operation, and a double click operation; or,

[0257] A selection operation for a linkage control; the linkage control is displayed in the window interface, or the linkage control is displayed in a control window, and the control window is triggered to display by the window interface; or,

[0258] Input operation for input shortcut keys.

[0259] In one implementation, if the window interface is the third window interface, and the window identifier on which the selection operation is performed in the selection window includes the first window identifier and the second window identifier, the processing unit 2802 is further configured to:

[0260] Configure the layer level of the display layer of the first window interface and the layer level of the display layer of the second window interface;

[0261] When the first window interface and the second window interface are displayed in linkage, the window interface of the display layer with a higher layer level is displayed as a floating window on the window interface of the display layer with a lower layer level.

[0262] In one implementation, the first window interface is used to guide the operation of content editing of the second window interface and the third window interface; if the window interface is the first window interface, and the second window identifier in the selection window and the third window identifier of the third window interface are selected, the linkage display is that the first window interface is displayed on the second window interface;

[0263] The first window interface is displayed on the second window interface, including:

[0264] The first interface content corresponding to the first window interface is displayed on the second window interface; the first interface content is used to provide operation guidance for content editing of the interface content currently displayed in the second window interface;

[0265] The processing unit 2802 is further configured to:

[0266] The second interface content in the first window interface is displayed on the third window interface; the second interface content is used to provide operation guidance for content editing of the interface content currently displayed in the third window interface.

[0267] In one implementation, the first window interface and the third window interface are used to guide the operation of editing the content of the second window interface; if the window interface is the second window interface, and the first window identifier in the selection window and the third window identifier of the third window interface are selected, the linkage display is that the first window interface is displayed on the second window interface;

[0268] The first window interface is displayed on the second window interface, including:

[0269] The first interface content corresponding to the first window interface is displayed on the second window interface;

[0270] The processing unit 2802 is further configured to:

[0271] Displaying the third interface content in the third window interface on the second window interface;

[0272] Among them, the first interface content and the third interface content are both used to provide operation guidance for content editing of the interface content currently displayed in the second window interface.

[0273] In one implementation, the first window interface and the second window interface are both displayed on a display screen in the terminal; the processing unit 2802 is used to receive the window linkage operation for the first window interface and the second window interface, specifically to:

[0274] Receiving a drag operation on the first window interface, and dragging the first window interface into the second window interface in the form of a thumbnail;

[0275] If the thumbnail corresponding to the first window interface meets the linkage condition in the second window interface, a step of linking and displaying the first window interface and the second window interface in the application in response to the window linkage operation is triggered.

[0276] In one implementation, the thumbnail corresponding to the first window interface satisfies the linkage condition in the second window interface, including:

[0277] The duration of the thumbnail corresponding to the first window interface staying in the second window interface is greater than the first duration threshold; or

[0278] The thumbnail of the first window interface is dragged to the linkage area in the second window interface.

[0279] In one implementation, if the application is in the window linkage recognition state, the processing unit 2802 is configured to receive the window linkage operation for the first window interface and the second window interface, specifically to:

[0280] If it is recognized that the first window interface and the second window interface have linkage attributes, then linkage prompt information is output; the linkage prompt information includes a confirmation option; wherein the linkage attributes between the first window interface and the second window interface include: the first window interface is used to guide the operation of content editing of the second window interface;

[0281] A selection operation for a confirmation option is received, triggering the step of displaying the first window interface and the second window interface in a linkage manner in the application in response to the window linkage operation.

[0282] In one implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, and the floating window includes a folding option, the processing unit 2802 is further configured to:

[0283] In response to a trigger operation on the folding option, folding and displaying the floating window in the second window interface;

[0284] The processing unit 2802 is further configured to:

[0285] In response to the restoration operation on the floating window, the floating window is displayed in the second window interface.

[0286] In one implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, the processing unit 2802 is further configured to:

[0287] Performing a position adjustment operation on the floating window in the second window interface;

[0288] According to the position adjustment operation, the display position of the floating window is updated in the second window interface.

[0289] In one implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, when the content of one window interface changes, the linkage control of the other window interface to change the content includes any of the following:

[0290] In response to a change operation on the interface content in the second window interface, synchronously update and display the interface content in the first window interface, and synchronously update and display the interface content in the first window interface in the floating window; or,

[0291] In response to a change operation on the first interface content in the floating window, synchronously update and display the interface content in the first window interface, and synchronously update and display the interface content in the second window interface in the second window interface;

[0292] Among them, the update rules for synchronous update include any one of the following: synchronous update according to the matching degree between the interface content in the first window interface and the interface content in the second window interface; or, synchronous update according to the operation information of the change operation.

[0293] In one implementation, if the first window interface is used to guide the operation of editing the content of the second window interface, and the second window interface includes one or more editing areas to be edited, and the first window interface is used to display the tutorial information corresponding to each editing area, the linked display is that the first window interface is displayed on the second window interface in the form of a floating window;

[0294] The first window interface is displayed on the second window interface in the form of a floating window, including:

[0295] There is a floating window displayed on the second window interface, and the target tutorial information included in the first window interface is displayed in the floating window; the target tutorial information refers to: the tutorial information corresponding to the editing area to be edited in the second window interface included in the first window interface.

[0296] In one implementation, the first window interface includes a tutorial video, the tutorial video includes a series of multiple video frames, and the video frames are used as tutorial information to guide the operation of editing the content of the second window interface; the second window interface includes S editing areas to be edited, and according to the editing order of the editing areas, the s-th editing area is in an edited state, and the s + 1-th editing area is in a to-be-edited state; S is an integer greater than 1, and s is an integer, and 1 ≤ s < S; the processing unit 2802 is further configured to:

[0297] If it is detected that the residence time of the s + 1-th editing area in the second window interface in the to-be-edited state is greater than the second time threshold, pause playing the tutorial video in the first window interface; where, the video frame displayed in the first window interface when paused is the video frame among the multiple video frames that has an operation guiding effect on the s + 1-th editing area;

[0298] If it is detected that the s + 1-th editing area changes from the to-be-edited state to the edited state, continue playing the tutorial video in the first window interface.

[0299] According to one embodiment of the present application, Fig.28 The various units in the window processing device shown can be individually or completely combined into one or several other units to form, or one (some) of the units can be further divided into multiple functionally smaller units to form, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In practical applications, the function of one unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the window processing device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units and can be implemented by the collaboration of multiple units. According to another embodiment of the present application, it can be executed by running on a general computing device such as a computer including processing elements and storage elements such as a central processing unit (CPU), a random access storage medium (RAM), and a read-only storage medium (ROM). Fig.18 A computer program (including program code) for each step involved in the corresponding method shown in FIG. Fig.28 The window processing device shown in the embodiment of the present application is implemented by the window processing method. The computer program can be recorded on a computer-readable recording medium, for example, and loaded into the above-mentioned computing device through the computer-readable recording medium and run therein.

[0300] In the embodiment of the present application, by linking different window interfaces in the same application, on the one hand, the interface contents of different window interfaces can be integrated into one window interface, which improves the flexibility of displaying the interface contents in the application compared to the independent display of the first window interface and the second window interface, so that the user does not need to frequently switch window interfaces or frequently change eyes to obtain the interface contents in different window interfaces, but only needs to focus on a single window interface to simultaneously obtain the interface contents in different window interfaces. On the other hand, the update of the interface contents of one window interface can be linked to control the update of the interface contents in another window interface, and the intelligent display of the interface contents can be effectively improved through the adaptive changes of the interface contents in different window interfaces, saving the time of the user to adjust the interface contents in different window interfaces, and improving the update efficiency of the interface contents in different window interfaces to a certain extent.

[0301] Fig.29 FIG. 1 shows a schematic diagram of a computer device provided by an exemplary embodiment of the present application. Fig.29, the computer device includes a processor 2901, a communication interface 2902 and a computer-readable storage medium 2903. The processor 2901, the communication interface 2902 and the computer-readable storage medium 2903 can be connected via a bus or other means. The communication interface 2902 is used to receive and send data. The computer-readable storage medium 2903 can be stored in the memory of the computer device, the computer-readable storage medium 2903 is used to store a computer program, the computer program includes program instructions, and the processor 2901 is used to execute the program instructions stored in the computer-readable storage medium 2903. The processor 2901 (or CPU (Central Processing Unit)) is the computing core and control core of the computer device, which is suitable for implementing one or more instructions, and is specifically suitable for loading and executing one or more instructions to implement the corresponding method flow or corresponding function.

[0302] The embodiment of the present application also provides a computer-readable storage medium (Memory), which is a memory device in a computer device for storing programs and data. It is understandable that the computer-readable storage medium here can include both built-in storage media in the computer device and, of course, extended storage media supported by the computer device. The computer-readable storage medium provides a storage space that stores the processing system of the computer device. In addition, one or more instructions suitable for being loaded and executed by the processor 2901 are also stored in the storage space, and these instructions can be one or more computer programs (including program codes). It should be noted that the computer-readable storage medium here can be a high-speed RAM memory, or a non-volatile memory, such as at least one disk storage; optionally, it can also be at least one computer-readable storage medium located away from the aforementioned processor.

[0303] In one embodiment, the computer-readable storage medium stores one or more instructions; the processor 2901 loads and executes the one or more instructions stored in the computer-readable storage medium to implement the corresponding steps in the above-mentioned window processing method embodiment; in a specific implementation, the one or more instructions in the computer-readable storage medium are loaded by the processor 2901 and the following steps are executed:

[0304] Launching an application in a terminal, wherein the application includes a first window interface and a second window interface;

[0305] Receiving a window linkage operation for the first window interface and the second window interface;

[0306] In response to the window linkage operation, the first window interface and the second window interface are displayed in a linkage manner in the application; the first window interface is displayed on the second window interface, or the second window interface is displayed on the first window interface, and when the content of one window interface changes, the other window interface is controlled to change its content in a linkage manner.

[0307] In one implementation, one or more instructions in the computer-readable storage medium are loaded by the processor 2901 and when receiving the window linkage operation for the first window interface and the second window interface, the following steps are specifically performed:

[0308] Display the selection window; the selection window is used to display the window logo of the window interface in the open state in the application;

[0309] In the selection window, a selection operation for a first window identifier of a first window interface and / or a second window identifier of a second window interface is received.

[0310] In one implementation, the application further includes a third window interface, which is another window interface in the application except the first window interface and the second window interface; one or more instructions in the computer-readable storage medium are loaded by the processor 2901 and specifically perform the following steps when executing the display selection window:

[0311] Display the window interface in the application; the window interface includes any of the following: a first window interface, a second window interface or a third window interface;

[0312] According to the window selection operation existing in the window interface, a selection window is displayed.

[0313] In one implementation, the window selection operation includes any of the following:

[0314] A gesture operation performed in the window interface; the gesture operation includes one or more of a sliding operation, a long press operation, a single click operation, and a double click operation; or,

[0315] A selection operation for a linkage control; the linkage control is displayed in the window interface, or the linkage control is displayed in a control window, and the control window is triggered to display by the window interface; or,

[0316] Input operation for input shortcut keys.

[0317] In one implementation, if the window interface is the third window interface, and the window identifier on which the selection operation is performed in the selection window includes the first window identifier and the second window identifier, then one or more instructions in the computer-readable storage medium are loaded by the processor 2901 and the following steps are further executed:

[0318] Configure the layer level of the display layer of the first window interface and the layer level of the display layer of the second window interface;

[0319] When the first window interface and the second window interface are displayed in linkage, the window interface of the display layer with a higher layer level is displayed as a floating window on the window interface of the display layer with a lower layer level.

[0320] In one implementation, the first window interface is used to guide the operation of content editing of the second window interface and the third window interface; if the window interface is the first window interface, and the second window identifier in the selection window and the third window identifier of the third window interface are selected, the linkage display is that the first window interface is displayed on the second window interface;

[0321] The first window interface is displayed on the second window interface, including:

[0322] The first interface content corresponding to the first window interface is displayed on the second window interface; the first interface content is used to provide operation guidance for content editing of the interface content currently displayed in the second window interface;

[0323] The one or more instructions in the computer readable storage medium are loaded by the processor 2901 and further perform the following steps:

[0324] The second interface content in the first window interface is displayed on the third window interface; the second interface content is used to provide operation guidance for content editing of the interface content currently displayed in the third window interface.

[0325] In one implementation, the first window interface and the third window interface are used to guide the operation of editing the content of the second window interface; if the window interface is the second window interface, and the first window identifier in the selection window and the third window identifier of the third window interface are selected, the linkage display is that the first window interface is displayed on the second window interface;

[0326] The first window interface is displayed on the second window interface, including:

[0327] The first interface content corresponding to the first window interface is displayed on the second window interface;

[0328] The one or more instructions in the computer readable storage medium are loaded by the processor 2901 and further perform the following steps:

[0329] Displaying the third interface content in the third window interface on the second window interface;

[0330] Among them, the first interface content and the third interface content are both used to provide operation guidance for content editing of the interface content currently displayed in the second window interface.

[0331] In one implementation, the first window interface and the second window interface are both displayed on a display screen in the terminal; one or more instructions in the computer-readable storage medium are loaded by the processor 2901 and are specifically used to:

[0332] Receiving a drag operation on the first window interface, and dragging the first window interface into the second window interface in the form of a thumbnail;

[0333] If the thumbnail corresponding to the first window interface meets the linkage condition in the second window interface, a step of linking and displaying the first window interface and the second window interface in the application in response to the window linkage operation is triggered.

[0334] In one implementation, the thumbnail corresponding to the first window interface satisfies the linkage condition in the second window interface, including:

[0335] The duration of the thumbnail corresponding to the first window interface staying in the second window interface is greater than the first duration threshold; or

[0336] The thumbnail of the first window interface is dragged to the linkage area in the second window interface.

[0337] In one implementation, if the application is in the window linkage recognition state, one or more instructions in the computer-readable storage medium are loaded by the processor 2901 and when receiving the window linkage operation for the first window interface and the second window interface, the following steps are specifically performed:

[0338] If it is recognized that the first window interface and the second window interface have linkage attributes, then linkage prompt information is output; the linkage prompt information includes a confirmation option; wherein the linkage attributes between the first window interface and the second window interface include: the first window interface is used to guide the operation of content editing of the second window interface;

[0339] A selection operation for a confirmation option is received, triggering the step of displaying the first window interface and the second window interface in a linkage manner in the application in response to the window linkage operation.

[0340] In one implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, and the floating window includes a folding option, then one or more instructions in the computer-readable storage medium are loaded by the processor 2901 and the following steps are further executed:

[0341] In response to a trigger operation on the folding option, folding and displaying the floating window in the second window interface;

[0342] The one or more instructions in the computer readable storage medium are loaded by the processor 2901 and further perform the following steps:

[0343] In response to the restoration operation on the floating window, the floating window is displayed in the second window interface.

[0344] In one implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, one or more instructions in the computer-readable storage medium are loaded by the processor 2901 and the following steps are further executed:

[0345] Performing a position adjustment operation on the floating window in the second window interface;

[0346] According to the position adjustment operation, the display position of the floating window is updated in the second window interface.

[0347] In one implementation, if the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, when the content of one window interface changes, the linkage control of the other window interface to change the content includes any of the following:

[0348] In response to the change operation on the interface content in the second window interface, the interface content in the first window interface is synchronously updated and displayed in the first window interface, and the interface content in the first window interface is synchronously updated and displayed in the floating window; or,

[0349] In response to a change operation on the first interface content in the floating window, synchronously updating and displaying the interface content in the first window interface in the first window interface, and synchronously updating and displaying the interface content in the second window interface in the second window interface;

[0350] The update rule of synchronous update includes any one of the following: synchronous update based on the matching degree between the interface content in the first window interface and the interface content in the second window interface; or synchronous update based on the operation information of the change operation.

[0351] In one implementation, if the first window interface is used to guide the operation of content editing in the second window interface, and the second window interface includes one or more editing areas to be edited, and the first window interface is used to display tutorial information corresponding to each editing area, then the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window;

[0352] The first window interface is displayed on the second window interface in the form of a floating window, including:

[0353] A floating window is displayed on the second window interface, and the target tutorial information included in the first window interface is displayed in the floating window; the target tutorial information refers to the tutorial information corresponding to the editing area to be edited in the second window interface included in the first window interface.

[0354] In one implementation, the first window interface includes a tutorial video, and the tutorial video includes a series of consecutive video frames. The video frames are used as tutorial information to guide the content editing of the second window interface; the second window interface includes S editing areas to be edited. According to the editing order of the editing areas, the s-th editing area is in an edited state, and the (s + 1)-th editing area is in a to-be-edited state; S is an integer greater than 1, s is an integer, and 1 ≤ s < S; one or more instructions in the computer-readable storage medium are loaded and executed by the processor 2901 to perform the following steps:

[0355] If it is detected that the residence time of the (s + 1)-th editing area in the second window interface in the to-be-edited state is greater than the second time threshold, the tutorial video is paused in the first window interface; when pausing, the video frame displayed in the first window interface is the video frame among the multiple video frames that has an operation guiding effect on the (s + 1)-th editing area;

[0356] If it is detected that the (s + 1)-th editing area changes from the to-be-edited state to the edited state, the tutorial video is continued to be played in the first window interface.

[0357] Based on the same inventive concept, the principle and beneficial effect of the computer device provided in the embodiments of the present application for solving problems are similar to the principle and beneficial effect of the window processing method in the method embodiments of the present application. The principle and beneficial effect of the method implementation can be referred to. For the sake of brevity, it will not be elaborated here.

[0358] The embodiments of the present application further provide a computer program product or a computer program. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to enable the computer device to execute the above window processing method.

[0359] Those of ordinary skill in the art can realize that, combining the units and algorithm steps of the examples described in the embodiments disclosed in the present application, they can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0360] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instruction can be stored in a computer-readable storage medium or transmitted by a computer-readable storage medium. The computer instruction can be transmitted from a website site, a computer, a server or a data center to another website site, a computer, a server or a data center by wired (for example, coaxial cable, optical fiber, digital line (DSL)) or wireless (for example, infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data processing device such as a server, a data center, etc. that contains one or more available media integration. Available media can be magnetic media (for example, floppy disk, hard disk, tape), optical media (for example, DVD), or semiconductor media (for example, solid-state drive (Solid State Disk, SSD)) and the like.

[0361] The above description is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technical object familiar with the technical field can easily think of changes or replacements within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A window processing method, characterized in that: include: Launching an application in a terminal, wherein the application includes a first window interface and a second window interface; receiving a window linkage operation for the first window interface and the second window interface; In response to the window linkage operation, the first window interface and the second window interface are displayed in linkage in the application; the linkage display includes: the first window interface is displayed on the second window interface, or the second window interface is displayed on the first window interface, and when the content of one window interface changes, the other window interface is controlled to change its content in linkage.

2. The method according to claim 1, characterized in that The receiving the window linkage operation for the first window interface and the second window interface includes: Display a selection window; the selection window is used to display the window identification of the window interface in the application program that is in an open state; In the selection window, a selection operation for a first window identifier of the first window interface and / or a second window identifier of the second window interface is received.

3. The method according to claim 2, characterized in that The application further includes a third window interface, and the third window interface is another window interface in the application except the first window interface and the second window interface; The display selection window includes: Displaying a window interface in the application; the window interface includes any one of the following: the first window interface, the second window interface or the third window interface; According to the window selection operation existing in the window interface, a selection window is displayed.

4. The method according to claim 3, characterized in that The window selection operation includes any of the following: A gesture operation performed in the window interface; the gesture operation includes one or more of a sliding operation, a long pressing operation, a single clicking operation and a double clicking operation; or, A selection operation for a linkage control; the linkage control is displayed in the window interface, or the linkage control is displayed in a control window, and the control window is triggered to display by the window interface; or, Input operation for input shortcut keys.

5. The method according to claim 3, characterized in that If the window interface is the third window interface, and the window identifier on which the selection operation is performed in the selection window includes the first window identifier and the second window identifier, the method further includes: Configuring a layer level of a display layer of the first window interface and a layer level of a display layer of the second window interface; When the first window interface and the second window interface are displayed in linkage, the window interface of the display layer with a higher layer level is displayed as a floating window on the window interface of the display layer with a lower layer level.

6. The method according to claim 3, characterized in that The first window interface is used to guide the operation of content editing of the second window interface and the third window interface; if the window interface is the first window interface, and the second window mark in the selection window and the third window mark in the third window interface are selected, the linkage display is that the first window interface is displayed on the second window interface; The first window interface is displayed on the second window interface, including: The first interface content corresponding to the first window interface is displayed on the second window interface; the first interface content is used to provide operation guidance for content editing of the interface content currently displayed in the second window interface; The method further comprises: The second interface content in the first window interface is displayed on the third window interface; the second interface content is used to provide operation guidance for content editing of the interface content currently displayed in the third window interface.

7. The method according to claim 3, characterized in that The first window interface and the third window interface are used to guide the operation of editing the content of the second window interface; if the window interface is the second window interface, and the first window mark in the selection window and the third window mark in the third window interface are selected, the linkage display is that the first window interface is displayed on the second window interface; The first window interface is displayed on the second window interface, including: The first interface content corresponding to the first window interface is displayed on the second window interface; The method further comprises: Displaying the third interface content in the third window interface on the second window interface; The first interface content and the third interface content are both used to provide operation guidance for content editing of the interface content currently displayed in the second window interface.

8. The method according to claim 1, characterized in that The first window interface and the second window interface are both displayed on a display screen of the terminal; and the receiving of the window linkage operation for the first window interface and the second window interface includes: receiving a drag operation on the first window interface, and dragging the first window interface into the second window interface in the form of a thumbnail; If the thumbnail corresponding to the first window interface meets the linkage condition in the second window interface, the step of responding to the window linkage operation and linking the first window interface and the second window interface in the application is triggered.

9. The method according to claim 8, characterized in that The thumbnail corresponding to the first window interface satisfies the linkage condition in the second window interface, including: The duration of the thumbnail corresponding to the first window interface staying in the second window interface is greater than a first duration threshold; or The thumbnail of the first window interface is dragged to the linkage area in the second window interface.

10. The method according to claim 1, characterized in that If the application is in a window linkage recognition state, the receiving of the window linkage operation for the first window interface and the second window interface includes: If it is identified that the first window interface and the second window interface have linkage attributes, then linkage prompt information is output; the linkage prompt information includes a confirmation option; wherein the linkage attributes between the first window interface and the second window interface include: the first window interface is used to guide the operation of editing the content of the second window interface; A selection operation for the confirmation option is received, triggering the step of responding to the window linkage operation and linking the first window interface and the second window interface in the application.

11. The method according to claim 1, characterized in that If the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, and the floating window includes a folding option, the method further includes: In response to a triggering operation on the folding option, folding and displaying the floating window in the second window interface; The method further comprises: In response to a restore operation on the floating window, the floating window is displayed in the second window interface.

12. The method according to claim 1, characterized in that If the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, the method further includes: Performing a position adjustment operation on the floating window in the second window interface; According to the position adjustment operation, the display position of the floating window is updated in the second window interface.

13. The method according to claim 1, characterized in that If the linkage display is that the first window interface is displayed on the second window interface in the form of a floating window, when the content of one window interface changes, the linkage controls the content of another window interface to change, including any of the following: In response to a change operation on the interface content in the second window interface, synchronously updating and displaying the interface content in the first window interface in the first window interface, and synchronously updating and displaying the interface content in the first window interface in the floating window; or, In response to a change operation on the first interface content in the floating window, synchronously updating and displaying the interface content in the first window interface in the first window interface, and synchronously updating and displaying the interface content in the second window interface in the second window interface; The update rule of the synchronous update includes any one of the following: performing synchronous update according to the matching degree between the interface content in the first window interface and the interface content in the second window interface; or performing synchronous update according to the operation information of the change operation.

14. The method according to claim 1, wherein: If the first window interface is used to guide the operation of content editing in the second window interface, and the second window interface includes one or more editing areas to be edited, and the first window interface is used to display tutorial information corresponding to each editing area, then the linkage display is that the first window interface is displayed in the form of a floating window on the second window interface; The first window interface is displayed on the second window interface in the form of a floating window, including: A floating window is displayed on the second window interface, and the floating window displays the target tutorial information included in the first window interface; The target tutorial information refers to: the tutorial information corresponding to the editing area to be edited in the second window interface contained in the first window interface.

15. The method according to claim 14, characterized in that The first window interface includes a tutorial video, the tutorial video includes a plurality of continuous video frames, and the video frames are used as tutorial information to guide the operation of content editing in the second window interface; the second window interface includes S editing areas to be edited, and according to the editing order of the editing areas, the sth editing area is in an edited state, and the s+1th editing area is in a state to be edited; S is an integer greater than 1, and s is an integer, and 1≤s <S; The method further comprises: If it is detected that the duration of the stay of the s+1th editing area in the second window interface in the waiting-to-edit state is greater than the second duration threshold, the tutorial video is paused in the first window interface; wherein the video frame displayed in the first window interface during the pause is a video frame among the multiple video frames that has an operation guidance effect on the s+1th editing area; If it is detected that the (s+1)th editing area changes from the to-be-edited state to the edited state, the tutorial video continues to be played in the first window interface.

16. A window processing device, characterized in that: include: A starting unit, configured to start an application program on a display screen of a terminal, wherein the application program includes a first window interface and a second window interface; A processing unit, configured to receive a window linkage operation for the first window interface and the second window interface; The processing unit is also used to respond to the window linkage operation to link the display of the first window interface and the second window interface in the application; when the first window interface is displayed on the second window interface, or the second window interface is displayed on the first window interface, and when the content of one window interface changes, the other window interface is linked to be controlled to change its content.

17. A computer device, characterized in that: a processor adapted to execute a computer program; A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by the processor, the window processing method according to any one of claims 1 to 15 is implemented.

18. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor and executing the window processing method according to any one of claims 1 to 15.

19. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the window processing method according to any one of claims 1 to 15 is implemented.

Images