Display method, storage medium and electronic device

Abstract

The present invention relates to the technical field of mobile terminals, and discloses a display method, a storage medium, and an electronic device. The method adds a custom display function to an application window. When the electronic device detects a user's operation on the application window, such as when the electronic device detects a user's operation of adding a certain application as a floating window or a user's operation of taking a screenshot of the application window, the electronic device can display a self-selection box on the floating window or the screenshot window, and in response to the user's selection operation of a certain area in the display interface of the floating window or the screenshot window through the self-selection box, the display content of the selected area is separately presented in a floating window of the same size as the self-selection box, so that the display content of the floating window meets the user's personalized needs, and because the floating window only presents a part of the complete interface of the application, the size of the floating window is small and it is not easy to block the display interface of other application windows.

Description

Technical Field

[0001] The present invention relates to the technical field of mobile terminals, and in particular to a display method, a storage medium and an electronic device. Background Art

[0002] Existing terminal devices generally support multi-tasking window mode. Users can add an application on the device as a window of any size and float it above other application interfaces or device display interfaces as needed. This type of window is called a floating window. When the user opens other applications, the floating window can remain on top and suspended, allowing the user to perform multi-tasking operations on the device.

[0003] However, when a user is only interested in the display content of a certain area in a certain application, it is impossible to intercept the display content of the area and present it separately in a floating window. Often, only the display content of the complete interface of the application can be presented in the floating window, which is not conducive to user experience. Summary of the invention

[0004] The embodiments of the present invention provide a display method, a storage medium and an electronic device, which can customize the display content in a floating window according to the personalized needs of users, thereby improving the user experience.

[0005] In a first aspect, the present invention provides a display method applied to an electronic device, the method comprising: detecting a first operation of a user to perform a floating display on a first application interface of a first application; generating a self-selection box on the first application interface of the first application in response to the first operation; and floatingly displaying in a first window a first area of ​​the first application interface selected by the user through the self-selection box.

[0006] In the embodiment of the present invention, the first operation can be used to represent Figure 2B The user clicks button 23A in the operation, that is, the user clicks button 23A to suspend the display interface of the video application (i.e., the first application interface). Although the display interface of the video application is already a suspended display interface, combined with Figure 2E As shown, after the user clicks button 23A, the display interface of window 25 (ie, the first window) is also a floating display interface, and the display interface of window 25 is an interface in the display interface of the video application.

[0007] It can be understood that the user clicks button 23A to suspend the interface in the display interface of the video application again, and which part of the interface in the display interface of the video application is suspended is determined by the selection area of ​​the self-selection box. Among them, corresponding prompt information can be added to button 23A, such as "specify APP display range", to prompt the user to select the first area of ​​the first application interface by clicking the "specify APP display range" button 23A.

[0008] Combination Figure 2C As shown, in response to the first operation, a self-selection box (i.e., selection box 24) is generated on the first application interface of the first application, and the electronic device can present the display content of the area selected by the self-selection box (i.e., the first area) separately in a floating window (i.e., the first window), so that the display content of the floating window meets the user's personalized needs.

[0009] In a possible implementation of the first aspect, the method further includes: in response to the first operation, generating a focus area according to an application type of the first application; and acquiring the first area after the focus area is adjusted by the user.

[0010] In an embodiment of the present invention, focus areas can be pre-configured for different application types according to different application types, such as the focus area of ​​a video application is a video playback area, the focus area of ​​a navigation application is a map navigation area, etc., or the user can also pre-configure personalized focus areas for different application types according to different application types. This allows the electronic device to respond to the first operation, obtain the application type of the first application and the pre-configured focus area corresponding to the application type, so as to control the self-selection box to automatically focus on the focus area. Among them, when the focus area can meet the user's display requirements, the user can use the focus area as the first area, and when the focus area cannot meet the user's display requirements, the user can adjust the self-selection box to adjust the focus area to obtain the first area that can meet the user's display requirements.

[0011] In a possible implementation of the first aspect above, the first operation is a screenshot operation; in response to the screenshot operation, a screenshot area is generated on a first application interface of a first application; and the first area after the user adjusts the screenshot area is obtained.

[0012] In an embodiment of the present invention, the first operation can be used to represent Figure 3BIn the example, the user takes a screenshot of the display interface of the video application (i.e., the first application interface), that is, the user takes a screenshot of the display interface of the video application in order to display the display interface of the video application in a suspended state. Although the first operation is a screenshot operation at this time, combined with 3E, after the user takes a screenshot of the display interface of the video application, the display interface of window 33 (i.e., the first window) is also a suspended display interface, and the display interface of window 33 is an interface in the display interface of the video application.

[0013] It can be understood that the user takes a screenshot of the display interface of the video application in order to suspend the interface in the display interface of the video application, and which part of the interface in the display interface of the video application is suspended is determined by the selection area of ​​the self-selection box.

[0014] Combination Figure 2B As shown, in response to the first operation, a self-selection box (i.e., a screenshot box 32) is generated on the first application interface of the first application, and the screenshot area of ​​the screenshot operation is selected through the self-selection box to obtain the first area. The electronic device can present the display content of the area selected by the self-selection box (i.e., the first area) separately in a floating window (i.e., the first window), so that the display content of the floating window meets the user's personalized needs.

[0015] In a possible implementation of the first aspect, the method further includes: detecting an adjustment operation of the user on the self-selection box; and selecting the first area in response to the adjustment operation.

[0016] In an embodiment of the present invention, the user can adjust the size and position of the self-selection box, thereby adjusting the first area selected by the self-selection box, so that the first area meets the personalized needs of the user.

[0017] For example, when the user does not want to display the display content of the above-mentioned focus area or the selected area in the first window, the user can adjust the focus area or the selected area through the self-selection box to obtain the first area that meets the user's display requirements; for another example, when the display content of the above-mentioned focus area or the selected area meets the user's display requirements, the user can also directly use the focus area or the selected area as the first area.

[0018] In a possible implementation of the first aspect, the operation of adjusting the self-selection box includes at least one of the following operations: an operation of enlarging the self-selection box; an operation of shrinking the self-selection box; an operation of moving the self-selection box.

[0019] In an embodiment of the present invention, for example Figures 2C to 2D The operation of shrinking the self-selection box can be adjusted by dragging the border of the self-selection box; or Figures 3C to 3DThe operation of moving the self-selection box allows users to move the position of the self-selection box by clicking and dragging it.

[0020] It can be understood that the user adjusts the size and position of the self-selection box so that the first area selected by the self-selection box meets the user's display requirements.

[0021] In a possible implementation of the first aspect above, the method also includes: prompting the user to confirm the first area of ​​the first application interface selected through the self-selection box; in response to the user's confirmation operation, floatingly displaying the first area of ​​the first application interface selected by the user through the self-selection box in the first window.

[0022] In an embodiment of the present invention, a prompt button may be loaded on the first application interface to prompt the user to confirm the first area of ​​the first application interface selected by the self-selection box by clicking the button.

[0023] For example Figure 2D and Figure 2E As shown, after the user clicks button 23A (i.e., confirms the operation), the display content of the area (i.e., the first area) selected by the selection box 24 (i.e., the self-selection box) can be suspended and displayed through the window 25 (i.e., the first window); or as shown in FIG. Figure 3D and Figure 3E As shown, after the user clicks button 31A (ie, confirms the operation), the display content of the area (ie, the first area) selected by the selection box 32 (ie, the self-selection box) can be suspended and displayed through the window 33 (ie, the first window).

[0024] In a possible implementation of the first aspect, the method further includes: a second application interface of a second application is also displayed on the screen of the electronic device, and the first window is displayed floating above the second application interface.

[0025] In an embodiment of the present invention, for example Figure 2E As shown, the display screen of the mobile phone 20 displays a window 21 for displaying the display interface of the chat application (ie, the second application) and a window 25 (ie, the first window) for displaying the display interface of the video application (ie, the first application); or as Figure 3F As shown, the display screen of the mobile phone 30 displays the display interface of the chat application (ie, the second application) and the window 33 (ie, the first window) for displaying the display interface of the video application (ie, the first application).

[0026] It can be understood that, by floating the first window on the second application interface, the first application and the second application are displayed on the screen of the electronic device at the same time, and the user can view the first application and the second application interface at the same time on the screen of the electronic device. And the content displayed in the first window for displaying the first application is the display content of the first area of ​​the first application interface that the user customizes through the self-selection box, so that the display content of the first window meets the personalized needs of the user and improves the user experience.

[0027] In a possible implementation of the first aspect, the first area includes at least one of the following areas: a partial area of ​​the first application interface; or an entire area of ​​the first application interface.

[0028] In an embodiment of the present invention, the user may select a portion of the first application interface through a self-selection box, or may select the entire area of ​​the first application interface.

[0029] In a possible implementation of the first aspect, the size and shape of the first window are the same as the size and shape of the self-selection box.

[0030] In an embodiment of the present invention, when a user selects a partial area of ​​the first application interface using a self-selection box, the floating display interface of the first window is the portion of the first application interface corresponding to the partial area in the first application interface, so that the size of the first window is smaller and not easy to block the display interface of other application windows.

[0031] In a possible implementation of the first aspect, the self-selection box includes at least one of the following shapes: a straight-sided rectangle, an arc-sided rectangle, an ellipse, a heart shape, a circle, a star, a straight-sided triangle, and an arc-sided triangle.

[0032] In a possible implementation of the first aspect above, the method also includes: detecting a second operation performed by the user to restore the display of the first application interface of the first application; and displaying the first application interface of the first application on the screen of the electronic device in response to the second operation.

[0033] In an embodiment of the present invention, the second operation can be used to represent Figure 2E The user clicks the button 25A in the example shown, or the second operation can also be used to represent the following example: Figure 3F The operation shown is that the user clicks button 33A.

[0034] In a second aspect, the present invention provides a display device for use in an electronic device, the device comprising: a detection module for detecting a first operation of a user to perform a floating display on a first application interface of a first application; a generation module for generating a self-selection box on the first application interface of the first application in response to the first operation; and a display module for floatingly displaying in a first window a first area of ​​the first application interface selected by the user through the self-selection box.

[0035] In a third aspect, an embodiment of the present invention provides a readable storage medium having instructions stored thereon, which, when executed on an electronic device, enables the electronic device to implement any one of the display methods provided by the first aspect and various possible implementations of the first aspect.

[0036] In a fourth aspect, an embodiment of the present invention provides an electronic device, comprising: a memory for storing instructions executed by one or more processors of the electronic device; and a processor, which is one of the processors of the electronic device, for executing the instructions stored in the memory to implement any one of the display methods provided by the first aspect and various possible implementations of the first aspect.

[0037] In a fifth aspect, an embodiment of the present invention provides a program product, which includes instructions, and when the instructions are executed by an electronic device, the electronic device can implement any display method provided by the first aspect and various possible implementations of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1A According to some embodiments of the present invention, a schematic diagram of an application scenario of the display method is shown;

[0039] Figure 1B According to some embodiments of the present invention, a schematic diagram of another application scenario of the display method is shown;

[0040] Figure 2A According to some embodiments of the present invention, a schematic diagram showing a user opening an application through a sidebar is shown;

[0041] Figure 2B According to some embodiments of the present invention, a schematic diagram showing a user clicking a custom display button is shown;

[0042] Figure 2C According to some embodiments of the present invention, a schematic diagram showing a user adjusting a frame selection area is shown;

[0043] Figure 2D According to some embodiments of the present invention, a schematic diagram of an electronic device automatically selecting a focus area is shown;

[0044] Figure 2EAccording to some embodiments of the present invention, a schematic diagram of separately presenting display contents of a framed area or a focus area through a floating window is shown;

[0045] Figure 2F According to some embodiments of the present invention, a schematic diagram is shown of restoring a floating window after a user clicks a restore button;

[0046] Figure 3A According to some embodiments of the present invention, a schematic diagram of a video application being displayed in full screen is shown;

[0047] Figure 3B According to some embodiments of the present invention, a schematic diagram of a user performing a screenshot operation using a knuckle is shown;

[0048] Figure 3C According to some embodiments of the present invention, a schematic diagram showing a user adjusting a clipping area is shown;

[0049] Figure 3D According to some embodiments of the present invention, another schematic diagram is shown in which a user clicks a custom display button;

[0050] Figure 3E According to some embodiments of the present invention, a schematic diagram of separately presenting the display content of a selected area through a floating window is shown;

[0051] Figure 3F According to some embodiments of the present invention, a schematic diagram of displaying a floating window on top is shown;

[0052] Figure 3G According to some embodiments of the present invention, another schematic diagram of restoring a floating window after a user clicks a restore button is shown;

[0053] Figure 4A According to some embodiments of the present invention, a schematic diagram of a software structure of the electronic device 100 is shown;

[0054] Figure 4B According to some embodiments of the present invention, a schematic diagram of another software structure of the electronic device 100 is shown;

[0055] Figure 5A According to some embodiments of the present invention, a flow chart of an interaction step of Embodiment 1 of the display method is shown;

[0056] Figure 5B According to some embodiments of the present invention, a flow chart of an interaction step of Embodiment 2 of the display method is shown;

[0057] Figure 5CAccording to some embodiments of the present invention, a flow chart of an interaction step of Embodiment 3 of the display method is shown;

[0058] Fig. 6A According to some embodiments of the present invention, a flow chart of a method step of Embodiment 1 of the display method is shown;

[0059] Figure 6B According to some embodiments of the present invention, a flow chart of a method step of Embodiment 2 of the display method is shown;

[0060] Figure 6C According to some embodiments of the present invention, a schematic flow chart of a method step of Embodiment 3 of the display method is shown;

[0061] Figure 7 According to some embodiments of the present invention, a schematic diagram of the hardware structure of the electronic device 100 is shown. DETAILED DESCRIPTION

[0062] Illustrative embodiments of the present invention include, but are not limited to, a display method, a storage medium, and an electronic device.

[0063] The technical solution of the present invention is introduced below in conjunction with the accompanying drawings.

[0064] It can be understood that the multi-tasking window mode means that different interfaces of multiple applications can be displayed in different windows on the display screen of the same electronic device, or different interfaces of an application can be displayed in different windows on the display screen of the same electronic device. Through the multi-tasking window mode, users can operate multiple applications on the display screen of the electronic device at the same time.

[0065] For example, when a user opens a video application on an electronic device and is watching a video, and receives a chat message from a friend through a chat application, the user can display the video application in the form of a floating window. When the user opens the chat application, the chat application window can be displayed in full screen on the display screen of the electronic device, and the floating window of the video application is placed on top of the chat application window, that is, the video application window and the chat application window are displayed on the display screen of the electronic device at the same time, so that the user can reply to the friend's message while watching the video normally.

[0066] As mentioned above, in some embodiments, when the electronic device presents the display interface of an application in the form of a floating window, it can often only present the display content of the complete interface of the application in the floating window. To avoid blocking other application interfaces under the floating window, the user can only adjust the overall size of the floating window through the zoom function of the floating window.

[0067] However, when the window is reduced as a whole, the display resolution of the window will be reduced, and the window size reduction is limited. When the preset size is reached, the reduced window will be automatically closed, affecting the user experience.

[0068] For example Figure 1A As shown, two windows are displayed on the display screen of the mobile phone 12. Window 12A is presented as the interface of the chat application, and window 12A is displayed in full screen. Window 12B is presented as the interface of the video application, and window 12B is a floating window, and window 12B floats above window 12A.

[0069] When the mobile phone 12 detects that the user's finger clicks the lower left corner of the window 12B and moves in the direction of the arrow ( Figure 1A Left figure), triggering the zoom function of the floating window, so that the window 12B can be displayed in a proportional form of reduction or enlargement as the user's finger moves ( Figure 1A The right figure shows that the window 12B is reduced in proportion as the user's finger moves).

[0070] It can be understood that, since window 12B presents a complete interface of the application, window 12B is relatively large and is likely to block the interface of other windows (such as window 12A). Figure 1A After the window 12B in the image is reduced as a whole, the display resolution of the window 12B will be reduced, and the window size reduction is limited. When the preset size is reached, the reduced window will be automatically closed, affecting the user experience.

[0071] In other embodiments, some applications in the electronic device support the "picture-in-picture" function and have their own trigger button, and the user can use the trigger button to control the electronic device to display the display content of the focus area in the application interface separately in a floating window.

[0072] Among them, the "picture-in-picture" function can be used to indicate that after the electronic device detects a trigger operation by the user (such as clicking a trigger button), the electronic device can respond to the trigger operation, automatically obtain the focus area in the triggered application interface, and present the display content of the focus area separately in a floating window.

[0073] However, the focus area of ​​the above application interface is usually preset according to the needs of most users or pre-configured according to the application type. When the user's demand for the focus area changes, the above-mentioned "picture-in-picture" function cannot obtain the focus area after the user's changed demand, which is not conducive to user experience.

[0074] For example Figure 1BAs shown, two windows are displayed on the display screen of the mobile phone 11, window 11A is presented as the interface of the chat application, and window 11A is displayed in full screen, and window 11B is presented as the interface of the video application, and window 11B is a floating window, and window 11B is suspended above window 11A.

[0075] The mobile phone 11 detects that the user clicks the trigger button 11B1 in the video application with his finger ( Figure 1B After that, the mobile phone 11 can automatically obtain the current video playing area in the video application, and present the display content of the video playing area separately in the window 11B ( Figure 1B Right picture), allowing users to chat with friends while watching videos.

[0076] It is understandable that since the focus area of ​​the application interface is usually preset according to the needs of most users or pre-configured according to the application type, when the user's demand for the focus area changes, the above-mentioned "picture-in-picture" function cannot obtain the focus area after the user's changed demand, affecting the user experience.

[0077] To solve the above problems, the present invention provides a display method, which adds a customized display function to an application window, so that when an electronic device detects a user's operation on an application window, such as when the electronic device detects that a user adds an application as a floating window or that a user takes a screenshot of an application window, the electronic device can display a self-selection box on the floating window or the screenshot window, and the electronic device can respond to the user's selection operation of a certain area in the display interface of the floating window or the screenshot window through the self-selection box, and present the display content of the selected area separately in a floating window of the same size as the self-selection box, so that the display content of the floating window meets the user's personalized needs, and because the floating window only presents part of the interface in the complete interface of the application (the interface of the area selected by the user through the self-selection box), the size of the floating window is small and it is not easy to block the display interface of other application windows.

[0078] For example, when the electronic device detects that a user adds an application as a floating window to display the complete interface of the application, the custom display function of the floating window is triggered, and a custom display button is displayed on the floating window.

[0079] The electronic device may generate a selection box (i.e., a self-selection box) in the floating window in response to a user clicking the custom display button, and obtain display content of the area selected by the selection box in response to the user adjusting the size and position of the selection box, and present the display content of the selected area separately in a floating window of the same size as the selection box, so that the display content of the floating window meets the personalized needs of the user;

[0080] Alternatively, the electronic device can respond to a user clicking the custom display button to obtain a focus area of ​​the application type displayed corresponding to the floating window, generate a selection box for selecting the focus area in the display interface of the floating window, and present the display content of the focus area separately in a floating window of the same size as the selection box, so that the display content of the floating window meets the user's personalized needs.

[0081] For another example, when an electronic device detects that a user takes a screenshot of an application window that displays the complete interface of an application, the electronic device can display a selection box (i.e., a self-selection box) corresponding to the screenshot operation on the application window, trigger the custom display function of the application window, and display a custom display button on the application window.

[0082] In response to the user's click operation on the custom display button, the electronic device may separately present the display content of the area selected by the selection box in a floating window of the same size as the selection box, so that the display content of the floating window meets the user's personalized needs;

[0083] Alternatively, the electronic device can respond to the user's click operation on the custom display button and the user's adjustment operation on the size and position of the screenshot box by separately presenting the display content of the area selected by the screenshot box in a floating window of the same size as the screenshot box, so that the display content of the floating window meets the user's personalized needs.

[0084] Specifically, in some embodiments of the present invention, when the electronic device detects that a user has added an application as a floating window to display the complete interface of the application, it triggers the opening of a custom display function of the floating window corresponding to the complete interface of the application and generates a custom display button on the floating window.

[0085] When the electronic device detects that the user clicks the custom display button, the electronic device generates a selection box in the display interface of the floating window in response to the click operation of the custom display button. The user can change the size and position of the selection box by dragging the border of the selection box, and then select the area that he wants to present separately.

[0086] When the electronic device detects that the user clicks the custom display button again, it means that the user has completed the area selection. In response to the click operation of the custom display button again, the electronic device can present the display content of the area selected by the user in a floating window separately. At this time, the window size of the floating window is the same as the area size of the selected area.

[0087] At the same time, when the electronic device presents the display content of the area selected by the user in a floating window alone, it triggers the restoration function of the floating window and generates a restoration button on the floating window.

[0088] When the electronic device detects that the user clicks the restore button, the electronic device responds to the click operation of the restore button, obtains the display window of the application before triggering the custom display function (i.e., the floating window displaying the complete interface of the application), and restores the floating window used to separately present the display content of the selected area to a floating window displaying the complete interface of the application.

[0089] In some embodiments, Figure 2A As shown, two windows are displayed on the display screen of mobile phone 20. Window 21 is presented as the interface of the chat application, and window 21 is displayed in full screen. Window 22 is presented as the interface of the sidebar. Window 22 includes a clock, video, music, browser and camera applications, and window 22 is suspended above window 21.

[0090] After detecting that the user clicks the video application with a finger, the mobile phone 20 can trigger the video application to be opened in the form of a floating window and present the complete interface of the video application ( Figure 2B ).

[0091] In some embodiments, Figure 2B As shown, when the mobile phone 20 detects that the user adds a video application as a floating window 23 and presents the complete interface of the video application through the floating window 23, the mobile phone 20 can trigger the custom display function of the floating window 23 and generate a custom display button 23A at the bottom of the floating window 23.

[0092] Among them, the custom display button 23A can add corresponding prompt information, such as "specify APP display range", to prompt the user that they can customize the display range of the video application by clicking the "specify APP display range" button 23A.

[0093] In some embodiments, Figure 2C As shown, the mobile phone 20 detects that the user clicks the "specify APP display range" button 23A ( Figure 2B ), a selection box 24 is generated in the display interface of the floating window 23. In the display interface of the floating window 23, the area selected by the selection box 24 is displayed completely transparently, and the area not selected by the selection box 24 is displayed semi-transparently, so that the user can distinguish the selected area of ​​the selection box 24 through transparency.

[0094] like Figure 2C As shown, the user can control the size and position of the area framed by the selection box 24 by dragging the border of the selection box 24. For example, the user can drag the border of the lower right corner of the selection box 24 up in the direction of the arrow to frame the video playback area in the video application.

[0095] At the same time, the custom display button 23A can change the prompt information, such as "OK", to prompt the user to confirm the area selected by the selection box 24 by clicking the button 23A.

[0096] In some embodiments, Figure 2D As shown, after the user completes the selection of the area in the selection box 24, he clicks the "OK" button 23A, that is, clicks the custom display button 23A again. In response to the click operation of the custom display button again, the mobile phone 20 displays the display content of the area selected by the selection box 24 separately in the floating window 25 ( Figure 2E ), at this time, the window size of the floating window 25 is the same as the area size of the framed area.

[0097] Among them, the interface size of the video playback area presented by the floating window 25 and the floating window 23 is the same, that is, the interface resolution of the video playback area presented by the two is the same. However, since the floating window 25 only presents the interface of the video playback area, the overall size of the floating window 25 is smaller than the overall size of the floating window 23, and it is not easy to block the interface of the window 21. At the same time, since the interface presented by the floating window 25 is a user-defined framed interface, the display content of the floating window 25 meets the personalized needs of the user, improving the user experience satisfaction.

[0098] In some embodiments, Figure 2E As shown, when the mobile phone 20 presents the display content of the area selected by the selection box 24 in the floating window 25 alone, the recovery function of the floating window 25 is triggered to start, and a recovery button 25A is generated on the floating window 25.

[0099] The restore button 25A may be added with corresponding prompt information, such as “one-click restore”, to prompt the user that the floating window 25 may be restored to the floating window 23 by clicking the “one-click restore” button 25A.

[0100] In some embodiments, Figure 2F As shown, after the mobile phone 20 detects that the user clicks the "one-key restore" button 25A, the mobile phone 20 responds to the click operation of the "one-key restore" button 25A, obtains the display window (floating window 23) of the video application before the custom display function is triggered, and restores the floating window 25 to the floating window 23 ( Figure 2B ).

[0101] In some embodiments of the present invention, focus areas can be pre-configured for different application types according to different application types, such as the focus area of ​​a video application is a video playback area, the focus area of ​​a navigation application is a map navigation area, etc., or the user can also pre-configure personalized focus areas for different application types according to different application types.

[0102] When the electronic device detects for the first time that the user clicks the custom display button, the electronic device may obtain the type of application and the pre-configured focus area corresponding to the type, so as to control the selection box to automatically select the focus area.

[0103] For example, when the user sets the focus area of ​​a video type application as the video playback area, the mobile phone 20 detects Figure 2B After the user clicks the "Specify APP Display Range" button, the mobile phone 20 can automatically obtain the video playback area and control the selection box 24 to automatically select the video playback area (such as Figure 2D As shown), the user does not need to manually select the focus area (as shown Figure 2C shown).

[0104] Among them, if the focus area currently framed by the selection box 24 cannot meet the needs of the current user, the user can also control the size and position of the area framed by the selection box 24 by dragging the border of the selection box 24, that is, re-select the focus area, so that the display content finally framed and presented in the floating window meets the user's personalized needs.

[0105] It is understandable that the user can simultaneously operate multiple application windows (such as Figure 2E At the same time, the display interface of one of the application windows (such as the floating window 25) displayed by the mobile phone 20 is the display interface of any area (such as the area framed by the selection box 24) in the display interface of any application (such as a video application) customized by the user, so that the display interface of the application window meets the interface display requirements of the application selected by the user, and thus the application window can be personalized for the current user of the electronic device, thereby improving the user experience.

[0106] Specifically, in other embodiments of the present invention, when the electronic device detects that a user has taken a screenshot of an application window interface (at this time the window displays the complete interface of the application), it triggers the opening of the custom display function of the application window and adds a custom display button on the corresponding screenshot interface.

[0107] When the electronic device detects that the user clicks the custom display button, the electronic device can present the display content of the selected area corresponding to the user's screenshot operation separately in a floating window in response to the click operation of the custom display button. At this time, the window size of the floating window is the same as the area size of the selected area.

[0108] At the same time, when the electronic device presents the display content of the user-selected area separately in the floating window, it triggers the restoration function of the floating window and generates a restoration button on the floating window.

[0109] When the electronic device detects that the user clicks the restore button, the electronic device obtains the display window of the application before triggering the custom display function (i.e., the window displaying the complete interface of the application) in response to the click operation of the restore button, and restores the floating window to the window displaying the complete interface of the application.

[0110] In some embodiments, Figure 3A As shown, a window 31 is displayed on the display screen of the mobile phone 30, the window 31 is displayed in full screen, and the window 31 presents a complete interface of the video application.

[0111] In some embodiments, Figure 3B As shown, the user uses a knuckle to perform a screenshot operation on the display interface of window 31, such as the user uses a knuckle to draw a screenshot box 32 on the display interface of window 31. Mobile phone 30 can take a screenshot of the interface in the screenshot box 32 in response to the user's screenshot operation and save it.

[0112] In some embodiments, Figure 3C As shown, after detecting that the user has taken a screenshot of the interface of the window 31 , the mobile phone 30 triggers the custom display function of the window 31 and adds a custom display button 31A on the screenshot interface.

[0113] Among them, in the screenshot interface of window 31, the area selected by the selection box 32 is displayed completely transparently, and the area not selected by the selection box 32 is displayed semi-transparently, so that the user can distinguish the selected area of ​​the selection box 32 through transparency.

[0114] The custom display button 31A may be added with corresponding prompt information, such as “small window display”, to prompt the user that the display content of the selected area may be presented separately in a floating window by clicking the button 31A.

[0115] In some embodiments, the user can change the size, position and shape of the selection box 32 in the screenshot interface so that the display interface of the selection box 32 meets the user's personalized needs.

[0116] like Figure 3C As shown, the user can click on the selection box 32 and drag it upward along the arrow to the video playback area of ​​the video application, or the user can also adjust the shape of the selection box 32 through the shape button provided in the screenshot function, such as rectangle, ellipse, heart shape, etc., and the present invention is not limited here.

[0117] In some embodiments, Figure 3DAs shown, after the user drags the selection box 32 to the video playing area of ​​the video application, the user clicks the "small window display" button 31A. The mobile phone 30 can respond to the click operation of the "small window display" button 31A by separately presenting the display content of the area selected by the selection box 32 in the floating window 33 ( Figure 3E ), at this time, the window size of the floating window 33 is the same as the area size of the selected area.

[0118] In some embodiments, Figure 3E As shown, the mobile phone 30 presents the display content of the area selected by the selection box 32 separately in the floating window 33, and floats it on the main interface of the mobile phone 30.

[0119] When the mobile phone 30 presents the display content of the area selected by the selection box 32 in the floating window 33 alone, the restoration function of the floating window 33 is triggered and a restoration button 33A is generated on the floating window 33 .

[0120] The restore button 33A may be added with corresponding prompt information, such as “one-click restore”, to prompt the user that the floating window 33A may be restored to the window 31 by clicking the “one-click restore” button.

[0121] In some embodiments, Figure 3F As shown, when the user opens other application windows (such as chat applications) and displays them in full screen, the floating window 33 is in a top state, that is, the floating window 33 is located above the chat application window. The user can chat with friends through the chat application while watching videos through the video application on the mobile phone 30.

[0122] Among them, the floating window 33 only presents the display content of the selected area separately, and the floating window 33 is small and is not easy to block the chat application interface or the main interface of the mobile phone 30. At the same time, because the interface presented by the floating window 33 is a user-defined interface, the display content of the floating window 33 meets the personalized needs of the user, and improves the user experience satisfaction.

[0123] In some embodiments, Figure 3G As shown, after the mobile phone 30 detects that the user clicks the "one-key restore" button 33A, the mobile phone 30 responds to the click operation of the "one-key restore" button 33A, obtains the display window (window 31) of the video application before triggering the custom display function, and restores the floating window 33 to window 31.

[0124] It is understandable that the user can simultaneously operate multiple application windows (such as Figure 3FAt the same time, the display interface of one of the application windows (such as the floating window 33) displayed by the mobile phone 20 is the display interface of any area (such as the area selected by the selection box 32) in the display interface of any application (such as a video application) customized by the user, so that the display interface of the application window meets the interface display requirements of the application selected by the user, and thus the application window can be personalized for the current user of the electronic device, thereby improving the user experience.

[0125] It can be understood that the above-mentioned mobile phones 11, 12, 20 and 30 are only described as one or more examples of electronic devices. In other embodiments, the electronic devices may include but are not limited to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA) or special cameras (such as SLR cameras, card cameras), etc. The embodiments of the present invention do not impose any restrictions on the specific types of electronic devices.

[0126] It can be understood that the above-mentioned video application is only described as an example of an application that triggers the custom display function. In other embodiments, the application that triggers the custom display function can be any application on the electronic device that meets the triggering conditions, and the present invention is not limited here.

[0127] For example, when an electronic device detects that a user adds an application as a floating window, it triggers the opening of a custom display function of the floating window where the application is located; for another example, when an electronic device detects that a user takes a screenshot of an application window interface, it triggers the opening of a custom display function of the window where the application is located.

[0128] Figure 4A A schematic diagram of the software structure of an electronic device 100 of the present invention is shown.

[0129] like Figure 4A As shown, the layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system applied to the electronic device can be divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer.

[0130] The application layer can include a series of application packages.

[0131] like Figure 4A As shown, the application package may include applications (Application, APP) such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0132] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0133] like Figure 4A As shown, the application framework layer may include a window manager, an activity manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0134] The Window Manager Service (WMS) is used to manage window programs. WMS can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0135] In some embodiments, WMS can be used to start, add, and delete windows. Figure 2A and Figure 2B As shown, when the WMS detects that the user clicks on the video application icon and wants to open the window interface of the video application, the WMS can add a floating window 23 to present the complete interface of the video application through the floating window 23.

[0136] In some embodiments, WMS can be used for window size and level management, such as Figure 2B As shown, the floating window 23 is located above the window 21; or Figure 2D and 2E As shown, the WMS can respond to the user clicking on the custom display button and change the size of the floating window 23 to the size of the floating window 25 according to the size of the area selected by the selection box 24, and present the display content of the area selected by the selection box 24 separately in the floating window 25; or as shown in 2E and 2F, the WMS can respond to the user clicking on the restore button and restore the size of the floating window 25 to the size of the floating window 23, and restore the display interface of the floating window 23.

[0137] The Activity Manager Service (AMS) is used to manage the activities running in the system, including processes, applications, services, tasks, etc.

[0138] In some embodiments of the present invention, Figure 4B As shown, each activity 401 includes a window 402 (PhoneWindow). In the Android system, PhoneWindow is used to represent an example of a window. It can be understood that each Activity includes an example of a window (PhoneWindow).

[0139] The window 402 includes multiple views, such as a root view 403 (Decor View) and a content view (ContentView). The root view 403 is used to represent the entire window interface of the window 402. There may be multiple content views, such as a content view 404A, a content view 404B, and a content view 404C. The multiple content views are used to represent each content column in the entire window interface. Figure 4B It shows the inclusion relationship among activity 401, window 402, root view 403, and content view. The dimensions and sizes of each root view 403 and content view are set according to the actual application.

[0140] For example, Figure 3A As shown, a window 31 is displayed in the display screen of the mobile phone 30, and the window 31 is displayed in full screen, and the window 31 presents a complete interface of the video application. It can be understood that when the video application is opened by the user and runs on the mobile phone 30, the video application at this time is an activity of the mobile phone 30, and the window corresponding to the activity is the window 31. Since the window 31 is displayed in full screen, it can be understood that the interface corresponding to the root view is the display interface of the entire display screen of the mobile phone 30, and the video playback area 31D, the bullet screen selection area 31B, and the selection area 31C in the window 31 correspond to different content views respectively.

[0141] Among them, different content views correspond to different types. For example, the content view of the video playback area 31D corresponds to the video playback type, the content view of the barrage selection area 31B corresponds to the barrage selection type, and the content view of the selection area 31C corresponds to the selection type. The type of content view can be set according to the type of different applications.

[0142] In some embodiments, target content views can be configured for different applications according to the types of different applications, and the target content view can be used as the focus area of ​​the application. For example, the focus area of ​​a video application is a content view of a video playback type, and the focus area of ​​a navigation application is a content view of a map navigation type, etc., or users can also make customized configurations according to different needs, which are not limited here.

[0143] Another example Figure 2B As shown, the chat application and the video application correspond to two different activities in the mobile phone 20. Figure 3A The difference is, Figure 2B The interface of the video application in is presented by a floating window 23, and Figure 3A The video application interface in the window 31 is presented, then Figure 2B The content view of the activity corresponding to the video application in the video is the floating window 23, and the interface corresponding to the content view of the window corresponding to the video application is the entire display interface of the floating window 23.

[0144] Content providers are used to store and retrieve data and make it accessible to applications. The data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0145] The view system may be a display system of an electronic device, capable of managing and modifying the display style of an application to be displayed by the electronic device. The view system may obtain a display function corresponding to the dark mode according to the display style parameters included in the display parameters stored in the electronic device.

[0146] The phone manager is used to provide communication functions to the electronic device, such as the management of call status (including answering, hanging up, etc.).

[0147] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0148] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages. It can stay for a short time and then disappear automatically without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0149] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0150] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0151] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0152] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0153] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0154] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0155] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0156] A 2D graphics engine is a drawing engine for 2D drawings.

[0157] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0158] Understandably, Figure 4A The software structure of the electronic device 100 shown is only an example. In other embodiments, the software structure of the electronic device 100 may include more or fewer layers, each layer may include more or fewer modules, or may be other operating system structures, such as Android. TM 、iOS TM , Windows TM Etc., no limitation is made here.

[0159] Combine the following Figure 2B and 3B Scenes and Figure 4A and 4B The technical scheme of the present invention is further described in detail.

[0160] Embodiment 1

[0161] First, taking the example of an electronic device detecting that a user has added an application as a floating window to display the complete interface of the application, triggering the custom display function of opening a floating window corresponding to the complete interface of the application, the user can customize the framed area to present the display content of the framed area separately in a floating window of the same window size as the framed area, the technical solution of the present application is introduced in detail.

[0162] Specifically, in some embodiments of the present invention, Figure 5A A flowchart showing an interactive step of a display method is shown, comprising the following steps:

[0163] S411A: The application 401 generates a trigger event in response to a user operation.

[0164] In some embodiments, Figure 2A As shown, in response to a user's click operation on the video application, the application 401 generates a trigger event for calling the window service 402 to create a first floating window, so as to present the complete interface of the video application through the created first floating window.

[0165] S411B: The application 401 sends a trigger event to the window service 402 .

[0166] In some embodiments, the application 401 sends the generated trigger event for creating the first floating window using the window service 402 to the window service 402, so that the window service 402 creates the first floating window after receiving the trigger event.

[0167] S412A: After receiving the trigger event, the window service 402 creates a first floating window.

[0168] In some embodiments, Figure 2B As shown, the windows service 402 receives the above Figure 2A After the triggering event in, a floating window 23 is created, and the complete interface of the video application is presented through the floating window 23.

[0169] S412B: The window service 402 sends notification information of the completion of creation of the first floating window to the root view service 403 .

[0170] In some embodiments, the window service 402 sends the notification information of the completion of the creation of the first floating window to the root view service 403, so that the root view service 403 performs the next step (such as creating a corresponding button) after receiving the notification information.

[0171] S413A: The root view service 403 creates a custom display button and a restore button according to the received notification information.

[0172] In some embodiments, Figure 2B As shown, when the window service 402 creates the floating window 23 and presents the complete interface of the video application through the floating window 23, the custom display function of the floating window 23 is triggered, and the custom display button 23A and the restore button 25A are created through the root view service 403 ( Figure 2E ), and configure the first response event for the custom display button 23A, and the second response event for the restore button 25A.

[0173] S413B: The root view service 403 sends the custom display button and the restore button to the application 401 .

[0174] In some embodiments, the custom display button 23A is loaded to the bottom of the first floating window after step S413B, such as Figure 2B As shown, the custom display button 23A is loaded to the bottom of the floating window 23 after step S413B; and the restore button 25A is loaded to the bottom of the second floating window after step S416, as shown in FIG. Figure 2E As shown, the restore button 25A is loaded to the bottom of the floating window 25 after step S416.

[0175] S414A: The application 401 obtains first coordinate information of the selected area in response to the user clicking the custom display button and the user selecting a custom area in the first floating window.

[0176] In some embodiments, after the user clicks the custom display button, a first response event is triggered, i.e., the custom display function of the first floating window is turned on, so that the user can select a custom area of ​​the first floating window to present the display content of the selected area separately in the second floating window.

[0177] For example Figure 2C and 2D As shown, after detecting that the user clicks the "specify APP display range" button 23A, a selection box 24 is generated in the display interface of the floating window 23, and the user can control the area selected by the selection box 24 by dragging the border of the selection box 24.

[0178] S414B: The application 401 sends the first coordinate information of the selected area to the root view service 403 .

[0179] In some embodiments, Figure 2D As shown, the size of the area selected by the selection box 24 is the first coordinate information of the above-mentioned area, wherein: Figure 2D The area selected by the selection box 24 is the ContentView of the video player class in the video application.

[0180] S415A: The root view service 403 generates a first adjustment request according to the first coordinate information.

[0181] S415B: The root view service 403 sends the first adjustment request to the window server 404 .

[0182] In some embodiments, the root view service 403 sends the size of the user-defined framed area to the window server 404, so that the window server 404 adjusts the first floating window according to the size of the framed area to obtain a second floating window with the same size as the framed area.

[0183] S416: The window server 404 adjusts the first floating window to a second floating window adapted to the first coordinate information according to the first adjustment request, and presents the display content in the framed area separately in the second floating window.

[0184] In some embodiments, Figure 2E As shown, the window server 404 adjusts the floating window 23 (first floating window) to the same size as the Content View of the video player class in the video application, the floating window 25 (second floating window), and presents the display content in the Content View of the video player class separately in the floating window 25. At the same time, the restore button 25A is loaded at the bottom of the floating window 25.

[0185] S417A: In response to the user clicking the restore button, the application 401 obtains the second coordinate information of the first floating window.

[0186] In some embodiments, after the user clicks the restore button, a second response event is triggered, that is, the second floating window is restored to the first floating window. Figure 2E and 2F As shown, after detecting that the user clicks the “one-key restore” button 25A, the floating window 25 generates a response event to restore to the floating window 23 .

[0187] S417B: The application 401 sends the second coordinate information to the root view service 403 .

[0188] In some embodiments, Figure 2B As shown, the size of the floating window 23 is the coordinate information of the floating window 23, that is, the second coordinate information of the first floating window.

[0189] S418A: The root view service 403 generates a second adjustment request according to the second coordinate information.

[0190] S418B: The root view service 403 sends a second adjustment request to the window server 404 .

[0191] In some embodiments, the root view service 403 sends the size of the first floating window to the window server 404, so that the window server 404 adjusts the second floating window according to the size of the first floating window.

[0192] S419: the window server 404 restores the second floating window to the first floating window adapted to the second coordinate information according to the second adjustment request, and restores the display interface of the first floating window.

[0193] In some embodiments, Figure 2F As shown, the window server 404 restores the floating window 25 (the second floating window) to the floating window 23 (the first floating window), and restores the display interface of the floating window 23, that is, the complete interface of the video application.

[0194] In other embodiments of the present invention, Figure 5A The process shown in the figure further describes the technical solution of the present invention in detail. Specifically, Fig. 6A A flow chart showing steps of a method of displaying a method comprises the following steps:

[0195] S611: In response to a user operation, the window service 402 creates a first floating window to present a complete interface of the application 401.

[0196] In some embodiments, Figure 2A As shown, the window service 402 creates a floating window 23 in response to a click operation of a user's finger on a video application, so as to present a complete interface of the video application through the floating window 23 .

[0197] S612: The root view service 403 creates a custom display button and a restore button.

[0198] In some embodiments, Figure 2B As shown, when the window service 402 creates the floating window 23 and presents the complete interface of the video application through the floating window 23, the custom display function of the floating window 23 is triggered. The custom display button 23A and the restore button 25A are created by the view service 403 ( Figure 2E ), and configure the first response event for the custom display button 23A and the second response event for the restore button 25A.

[0199] In some embodiments, the custom display button 23A is loaded to the bottom of the first floating window after step S612, such as Figure 2BAs shown, the custom display button 23A is loaded to the bottom of the floating window 23 after step S612; and the restore button 25A is loaded to the bottom of the second floating window after step S614B, as shown in FIG. Figure 2E As shown, the restore button 25A is loaded to the bottom of the floating window 25 after step S614B.

[0200] S613: The application 401 detects that the button click operation is a custom display button or a restore button.

[0201] In some embodiments, when the detected button click operation is a custom display button, jump to step S614A; when the detected button click operation is a restore button, jump to step S615A.

[0202] S614A: The application 401 enables the custom display function of the first floating window, and selects a custom area for the first floating window.

[0203] In some embodiments, the application 401 triggers a first response event in response to the user clicking the custom display button, that is, turning on the custom display function of the first floating window, so that the user can select a custom area of ​​the first floating window to display the display content of the selected area in the second floating window. Figure 2C and 2D As shown, after detecting that the user clicks the "specify APP display range" button 23A, a selection box 24 is generated in the display interface of the floating window 23, and the user can control the area selected by the selection box 24 by dragging the border of the selection box 24.

[0204] S614B: The window server 404 creates a second floating window according to the framed area, and presents the display content of the framed area separately in the second floating window.

[0205] In some embodiments, Figure 2E As shown, the window server 404 adjusts the floating window 23 (first floating window) to the same size as the area framed by the selection box 24, and displays the display content of the framed area in the floating window 25. At the same time, the restore button 25A is loaded at the bottom of the floating window 25.

[0206] S615A: The application 401 obtains the first floating window.

[0207] In some embodiments, in response to the user clicking the restore button, the application 401 triggers a second response event, that is, restores the second floating window to the first floating window. Figure 2E and 2FAs shown, after detecting that the user clicks the "one-key restore" button 25A, the size of the floating window 23 is obtained.

[0208] S615B: The window server 404 restores the second floating window to the first floating window, and restores the display interface of the first floating window.

[0209] In some embodiments, Figure 2F As shown, the window server 404 restores the floating window 25 (the second floating window) to the floating window 23 according to the size of the floating window 23 (the first floating window), and restores the display interface of the floating window 23, that is, the complete interface of the application 401.

[0210] It can be understood that through the above method, the user can customize the framed area in the first floating window, and present the display content of the framed area separately in the second floating window, so that the display content of the second floating window meets the user's personalized needs. Since the second floating window only presents part of the interface in the complete interface in the first floating window (the interface of the user-defined framed area), the second floating window is smaller in size and is not easy to block other application window interfaces on the electronic device.

[0211] It can be understood that through the above method, the user can view the display interface of multiple application windows in the electronic device at the same time, so as to perform task operations on the corresponding applications loaded in the multiple application windows. At the same time, the display interface of one of the application windows (such as the second floating window) displayed by the electronic device is the display interface of any area in the display interface of any application selected by the user, so that the display interface of the application window meets the interface display requirements of the application selected by the user, and thus the application window can be personalized for the current user of the electronic device, thereby improving the user experience.

[0212] Embodiment 2

[0213] The following is an example in which, when an electronic device detects that a user has added an application as a floating window to display the complete interface of the application, the custom display function of the floating window corresponding to the complete interface of the application is triggered to open, and the electronic device can automatically select the focus area to present the display content of the focus area separately in the floating window. The technical solution of the present application is described in detail.

[0214] Specifically, in some embodiments of the present invention, Figure 5B A flow chart showing another method step of the display method is shown. Figure 5B The flowchart shown is similar to that of the first embodiment described above. Figure 5A The flowchart is similar to that shown in FIG. 5A , and the only difference is that Figure 5BS424A, S424B, S425A, S425B and S426 in the flowchart shown, so only S424A, S424B, S425A, S425B and S426 are described in detail below:

[0215] S424A: The application 401 generates a focus area request notification in response to the user clicking the custom display button.

[0216] In some embodiments, after the user clicks the custom display button, a third response event is triggered, that is, a response event that turns on the custom display function of the first floating window and queries the focus area of ​​the first floating window to display the display content of the focus area separately in the third floating window. Figure 2B and 2D As shown, after detecting that the user clicks the “specify APP display range” button 23A, a selection box 24 is generated in the display interface of the floating window 23 and the focus area is selected by the selection box 24 .

[0217] S424B: The application 401 sends a focus area request notification to the root view service 403 .

[0218] In some embodiments, the root view service 403 may query and obtain the focus area in the first floating window according to the received focus area request notification.

[0219] S425A: The root view service 403 queries the third coordinate information of the focus area according to the focus area request notification, and generates a third adjustment request.

[0220] In some embodiments, the focus area can be pre-set according to the types of different applications, such as the focus area of ​​a video type application is the video playback area, and the focus area of ​​a navigation type application is the map navigation area. The focus area of ​​the type of application is queried by obtaining the type of application.

[0221] For example Figure 2B As shown, the application corresponding to the floating window 23 that generates the response event is of the video type, and the focus area corresponding to the floating window 23 is the video playback area, that is, Figure 2D The area selected by the selection box 24. It can be understood that Figure 2D The area selected by the selection box 24 is the Content View of the video playback class in the video application, and the size of the Content View is the third coordinate information of the focus area.

[0222] S425B: The root view service 403 sends the third adjustment request to the window server 404 .

[0223] In some embodiments, the root view service 403 sends the size of the focus area to the window server 404, so that the window server 404 adjusts the first floating window according to the size of the focus area to obtain a third floating window of the same size as the focus area.

[0224] S426: The window server 404 adjusts the first floating window to a third floating window adapted to the third coordinate information according to the third adjustment request, and presents the display content in the focus area separately in the third floating window.

[0225] In some embodiments, Figure 2E As shown, the window server 404 adjusts the floating window 23 (the first floating window) to the same size as the Content View of the video player class in the video application, the floating window 25 (the third floating window), and presents the display content in the Content View of the video player class separately in the floating window 25. At the same time, the restore button 25A is loaded at the bottom of the floating window 25.

[0226] In other embodiments of the present invention, Figure 5B The process shown in the figure further describes the technical solution of the present invention in detail. Specifically, Figure 6B A flow chart showing the steps of a method of displaying a method is shown. Figure 6B The flowchart shown is similar to that of the first embodiment described above. Fig. 6A The flowchart is similar to that described above. Fig. 6A The flowchart shown is different only in that Figure 6B S624A and S624B in the flowchart shown, so only S624A and S624B are described in detail below:

[0227] S624A: The application 401 enables the custom display function of the first floating window and queries the focus area of ​​the first floating window.

[0228] In some embodiments, the application 401 triggers a third response event in response to a click of the custom display button, i.e., a response event that turns on the custom display function of the first floating window and queries the focus area of ​​the first floating window to present the display content of the focus area separately in the third floating window. Figure 2B and 2D As shown, after detecting that the user clicks the “specify APP display range” button 23A, a selection box 24 is generated in the display interface of the floating window 23 and the focus area is selected through the selection box 24 .

[0229] In some embodiments, the focus area can be pre-set according to the types of different applications, such as the focus area of ​​a video type application is the video playback area, and the focus area of ​​a navigation type application is the map navigation area. The focus area of ​​the type of application is queried by obtaining the type of application.

[0230] For example Figure 2B As shown, the application corresponding to the floating window 23 that generates the response event is of the video type, and the focus area corresponding to the floating window 23 is the video playback area, that is, Figure 2D The area selected by the selection box 24. It can be understood that Figure 2D The area selected by the selection box 24 is the Content View of the video playback class in the video application.

[0231] S624B: The window server 404 creates a third floating window according to the focus area, and presents the display content of the focus area separately in the third floating window.

[0232] In some embodiments, Figure 2E As shown, the window server 404 adjusts the floating window 23 (first floating window) to the same size as the framed area, the floating window 25 (third floating window), and presents the display content of the framed area separately in the floating window 25. At the same time, the restore button 25A is loaded to the bottom of the floating window 25.

[0233] It can be understood that through the above method, the root view service 403 can automatically select the focus area according to the application type in the first floating window, and present the display content of the focus area separately in the third floating window, that is, the focus area can be automatically selected without the user manually selecting the focus area, thereby improving the user experience and making the display content of the third floating window meet the user's personalized needs. Moreover, since the third floating window only presents part of the interface (the interface of the focus area) in the complete interface in the first floating window, the third floating window is smaller in size and is not easy to block other application window interfaces on the electronic device.

[0234] It can be understood that through the above method, the user can view the display interface of multiple application windows in the electronic device at the same time, so as to perform task operations on the corresponding applications loaded in the multiple application windows. At the same time, the display interface of one of the application windows (such as the third floating window) displayed by the electronic device is the display interface of any area in the display interface of any application selected by the user, so that the display interface of the application window meets the interface display requirements of the application selected by the user, and thus the application window can be personalized for the current user of the electronic device, thereby improving the user experience.

[0235] Embodiment 3

[0236] The following is a detailed description of the technical solution of the present application by taking an example in which, when an electronic device detects that a user has taken a screenshot of an application window interface (at this time the window displays the complete interface of the application), the custom display function of the application window is triggered to be enabled. The user can present the display content of the selected area corresponding to the screenshot operation separately in a floating window, or the user can customize the selected area to present the display content of the selected area separately in a floating window.

[0237] Specifically, in some embodiments of the present invention, Figure 5C A flowchart showing another method step of the display method comprises the following steps:

[0238] S431A: The application 401 generates a trigger event in response to a user operation.

[0239] In some embodiments, Figure 3A As shown, a window 31 is displayed on the display screen of the mobile phone 30, and the window 31 is displayed in full screen, and the window 31 presents a complete interface of the video application. Figure 3B As shown, application 401 responds to the user's screenshot operation of the display interface of window 31 using the knuckles, such as the user drawing a selection box 32 on the display interface of window 31 using the knuckles, so that application 401 generates a trigger event for taking a screenshot of the area selected by the selection box 32.

[0240] S431B: The application 401 sends the trigger event to the root view service 403 .

[0241] In some embodiments, the application 401 sends the trigger event to the root view service 403, so that the root view service 403 performs the next step of processing (such as creating a corresponding button) after receiving the trigger event.

[0242] S432A: The root view service 403 creates a custom display button and a restore button according to the received trigger event.

[0243] In some embodiments, Figure 3C As shown, after the application 401 generates a trigger event for taking a screenshot of the area selected by the screenshot box 32, the root view service 403 creates a custom display button 31A and a restore button 33A ( Figure 3E ), and configure a fourth response event for the custom display button 31A, and a fifth response event for the restore button 33A.

[0244] S432B: The root view service 403 sends the custom display button and the restore button to the application 401 .

[0245] In some embodiments, the custom display button is loaded to the top of the window 31 after step S432B, such as Figure 3C As shown, the custom display button 31A is loaded to the top of the window 31 after step S432B; and the restore button is loaded to the bottom of the fourth floating window after step S435, as shown in FIG. Figure 3E As shown, the restore button 33A is loaded to the bottom of the floating window 33 after step S435.

[0246] S433A: In response to the user clicking the custom display button, the application 401 obtains the clipped area of ​​the original window and the fourth coordinate information of the clipped area.

[0247] In some embodiments, after the user clicks the custom display button, a fourth response event is triggered, that is, the intercepted area of ​​the original window is obtained to present the display content of the intercepted area separately in the fourth floating window. The original window is used to represent the window (window 31) used to present the display interface of the application 401 before the screenshot operation.

[0248] Users can adjust the selected area, such as Figure 3C As shown, the user can click on the selection box 32 and drag the selection box 32 upwards, so that the selection box 32 moves to the video playback area of ​​the video application. Figure 3D As shown, when it is detected that the user clicks the "small window display" button 31A, the application 401 can respond to the click operation of the "small window display" button 31A and obtain the fourth coordinate information of the selection area corresponding to the selection box 32.

[0249] S433B: The application 401 sends the fourth coordinate information of the selected area to the root view service 403 .

[0250] In some embodiments, the size of the selected area corresponding to the selection box 32 is the fourth coordinate information of the selected area.

[0251] S434A: The root view service 403 generates a fourth adjustment request according to the fourth coordinate information.

[0252] S434B: The root view service 403 sends a fourth adjustment request to the window server 404 .

[0253] In some embodiments, the root view service 403 sends the size of the user's selected area to the window server 404, so that the window server 404 creates a fourth floating window according to the size of the selected area.

[0254] S435: the window server 404 creates a fourth floating window adapted to the fourth coordinate information according to the fourth adjustment request, and presents the display content in the clipped area separately in the fourth floating window.

[0255] In some embodiments, Figure 3D and 3E As shown, the window server 404 creates a floating window 33 (fourth floating window) of the same size as the selection box 32, and Figure 3D The display content of the selection box 32 is presented separately in the floating window 33. At the same time, the restore button 33A is loaded to the bottom of the floating window 33.

[0256] S436A: In response to the user clicking the restore button, the application 401 obtains the fifth coordinate information of the original window.

[0257] In some embodiments, after the user clicks the restore button, a fifth response event is triggered, that is, the fourth floating window is restored to be displayed as the original window. Figure 3F and 3G As shown, after detecting that the user clicks the “one-key restore” button 33A, the floating window 33 generates a response event to restore to the window 31 .

[0258] S436B: The application 401 sends the fifth coordinate information to the root view service 403 .

[0259] In some embodiments, Figure 3A As shown, the size of window 31 is the coordinate information of window 23, that is, the fifth coordinate information of the original window.

[0260] S437A: The root view service 403 generates a fifth adjustment request according to the fifth coordinate information.

[0261] S437B: The root view service 403 sends the fifth adjustment request to the window server 404 .

[0262] In some embodiments, the root view service 403 sends the size of the original window to the window server 404, so that the window server 404 adjusts the fourth floating window according to the size of the original window.

[0263] S438: The window server 404 restores the fourth floating window to the original window adapted to the fifth coordinate information according to the fifth adjustment request, and restores the display interface of the original window.

[0264] In some embodiments, Figure 3G As shown, the window server 404 adjusts the floating window 33 (the fourth floating window) to the window 31 (the original window), and restores the display interface of the window 31.

[0265] In other embodiments of the present invention, Figure 5C The process shown in the figure further describes the technical solution of the present invention in detail. Specifically, Figure 6C A flow chart showing steps of a method of displaying a method comprises the following steps:

[0266] S631: The application 401 obtains the selected area in the original window in response to the user operation.

[0267] In some embodiments, Figure 3A and 3B As shown, application 401 responds to the user taking a screenshot of the display interface of window 31 using a finger joint, such as the user drawing a selection box 32 on the display interface of window 31 using a finger joint, and obtains the selection area of ​​the selection box 32.

[0268] S632: The root view service 403 creates a custom display button and a restore button.

[0269] In some embodiments, Figure 3C As shown, after the application 401 obtains the selected area of ​​the selection box 32, the root view service 403 creates a custom display button 31A and a restore button 33A ( Figure 3E ), and configure a fourth response event for the custom display button 31A, and a fifth response event for the restore button 33A.

[0270] S633: The application 401 detects that the button click operation is a custom display button or a restore button.

[0271] In some embodiments, when the detected button click operation is a custom display button, jump to step S634A; when the detected button click operation is a restore button, jump to step S635A.

[0272] S634A: The application 401 enables the custom display function of the original window and obtains the selected area of ​​the original window.

[0273] In some embodiments, the application 401 triggers a fourth response event in response to a click of the custom display button, namely, obtaining the intercepted area of ​​the original window to present the display content of the intercepted area separately in the fourth floating window. As shown in FIG3D , after detecting that the user clicks the “Small Window Display” button 31A, the application 401 can obtain the size of the intercepted area corresponding to the interception box 32 in response to the click operation of the “Small Window Display” button 31A.

[0274] S634B: The window server 404 creates a fourth floating window according to the selected area, and presents the display content of the selected area separately in the fourth floating window.

[0275] In some embodiments, Figure 3D and 3E As shown, the window server 404 creates a floating window 33 (fourth floating window) of the same size as the selection box 32, and Figure 3D The display content of the selection box 32 is presented separately in the floating window 33. At the same time, the restore button 33A is loaded to the bottom of the floating window 33.

[0276] S635A: The application 401 obtains the original window.

[0277] In some embodiments, the application 401 triggers a fifth response event in response to clicking the restore button, that is, restoring the fourth floating window to display as the original window. Figure 3F and 3G As shown, after detecting that the user clicks the “one-key restore” button 33A, the floating window 33 generates a response event to restore to the window 31 .

[0278] S635B: The window server 404 restores the fourth floating window to the original window, and restores the display interface of the original window.

[0279] In some embodiments, Figure 3G As shown, the window server 404 adjusts the floating window 33 (the fourth floating window) to the window 31 (the original window), and restores the display interface of the window 31.

[0280] It can be understood that through the above method, the user can present the display content of the selected area in the screenshot operation separately in the fourth floating window, or the user can customize the adjustment of the selected area and then present the display content of the selected area separately in the fourth floating window, so that the display content of the fourth floating window meets the user's personalized needs, and because the fourth floating window only presents part of the interface (the interface of the selected area) in the complete interface of the original window, the size of the fourth floating window is smaller and it is not easy to block other application window interfaces on the electronic device.

[0281] It can be understood that through the above method, the user can view the display interface of multiple application windows in the electronic device at the same time, so as to perform task operations on the corresponding applications loaded in the multiple application windows. At the same time, the display interface of one of the application windows (such as the fourth floating window) displayed by the electronic device is the display interface of any area in the display interface of any application selected by the user, so that the display interface of the application window meets the interface display requirements of the application selected by the user, and thus the application window can be personalized for the current user of the electronic device, thereby improving the user experience.

[0282] Figure 7 According to some embodiments of the present invention, a schematic diagram of a hardware structure of an electronic device 100 is shown.

[0283] It should be understood that the structure shown in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present invention, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0284] like Figure 7 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0285] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. The controller can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. In some embodiments, the processor 110 can execute the instructions corresponding to the display methods provided in the aforementioned embodiments.

[0286] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0287] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0288] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 can be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface to realize the touch function of the electronic device 100.

[0289] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0290] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0291] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to realize the function of playing music through a Bluetooth headset.

[0292] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to realize the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to realize the display function of the electronic device 100.

[0293] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0294] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0295] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only for illustrative purposes and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present invention, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0296] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device 100 through the power management module 141.

[0297] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0298] The wireless communication function of the electronic device 100 can be implemented by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modulation and demodulation processor and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, antenna 1 can be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0299] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G / 6G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0300] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0301] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and filters it, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0302] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), 5G and subsequent evolution standards, BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. GNSS may include the global positioning system (GPS), the global navigation satellite system (GLONASS), the Beidou navigation satellite system (BDS), the quasi-zenith satellite system (QZSS) and / or the satellite-based augmentation systems (SBAS).

[0303] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0304] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0305] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor. ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0306] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0307] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0308] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0309] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0310] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing files such as music and videos in the external memory card.

[0311] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor. For example, in some embodiments, the internal memory 121 may be used to temporarily store instructions of the display method provided in the aforementioned embodiments.

[0312] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0313] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0314] In the accompanying drawings, some structural or method features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be required. Instead, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. In addition, the inclusion of structural or method features in a particular figure does not mean that such features are required in all embodiments, and in some embodiments, these features may not be included or may be combined with other features.

[0315] It should be noted that the units / modules mentioned in the various device embodiments of the present invention are all logical units / modules. Physically, a logical unit / module can be a physical unit / module, or a part of a physical unit / module, or can be implemented as a combination of multiple physical units / modules. The physical implementation of these logical units / modules themselves is not the most important. The combination of functions implemented by these logical units / modules is the key to solving the technical problems proposed by the present invention. In addition, in order to highlight the innovative part of the present invention, the above-mentioned device embodiments of the present invention do not introduce units / modules that are not closely related to solving the technical problems proposed by the present invention, which does not mean that there are no other units / modules in the above-mentioned device embodiments.

[0316] It should be noted that in the examples and description of this patent, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "including one" do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0317] While the present invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention.

Claims

1. A display method, applied to an electronic device, characterized in that: include: Detecting a first operation of a user performing a floating display on a first application interface of a first application, floatingly displaying a complete interface of the first application interface in a first window, and generating an adjustment button for adjusting a display range of the window; Detecting a first click operation of the user on the adjustment button, and generating a self-selection box in the first window; Detecting a user's adjustment operation on the self-selection box, and determining a first area of ​​the first application interface in the first window, wherein the adjustment operation includes: adjusting the size and position of the self-selection box; detecting a second click operation of the user on the adjustment button, adjusting the first window to a second window corresponding to the size and shape of the self-selection box, floatingly displaying a portion of the first application interface corresponding to the first area of ​​the first application interface in the second window, and generating a restore button for restoring the window, wherein the window size of the second window is smaller than the window size of the first window; detecting a third click operation of the user on the restore button, restoring the second window to be displayed as the first window, and floatingly displaying a complete interface of the first application interface in the first window; Wherein, the method further comprises: A second application interface of a second application is also displayed on the screen of the electronic device, and the first window or the second window is displayed floating above the second application interface, wherein the second application interface is a full-screen display interface.

2. The method according to claim 1, characterized in that: Also includes: In response to the first click operation, generating a self-selection box corresponding to a focus area of ​​the application type according to the application type of the first application; Detecting a user's adjustment operation on the self-selection box; In response to the adjustment operation, a first area after the focus area is adjusted by the user is obtained.

3. The method according to claim 1, characterized in that The first operation is a screenshot operation; In response to the screenshot operation, generating a self-selection box corresponding to the screenshot area on the first application interface of the first application; Detecting a user's adjustment operation on the self-selection box; In response to the adjustment operation, a first area after the user adjusts the selected area is obtained.

4. The method according to claim 1, characterized in that: The adjustment operation on the self-selection box includes at least one of the following operations: An operation of expanding the self-selection box; An operation of reducing the self-selection box; An operation of moving the self-selection box.

5. The method according to claim 1, characterized in that Also includes: Prompting the user to confirm the first area of ​​the first application interface selected through the self-selection box; In response to the user's confirmation operation, the first area of ​​the first application interface selected by the user through the self-selection box is displayed in a floating manner in the second window.

6. The method according to claim 1, characterized in that The shape of the self-selection box includes at least one of the following shapes: a straight-sided rectangle, an arc-sided rectangle, an ellipse, a heart shape, a circle, a star shape, a straight-sided triangle, and an arc-sided triangle.

7. A computer-readable storage medium, characterized in that: The readable storage medium stores instructions, which, when executed on an electronic device, enable the electronic device to implement the method according to any one of claims 1 to 6.

8. An electronic device, characterized in that: include: a memory for storing instructions to be executed by one or more processors of the electronic device; and a processor, which is one of the processors of the electronic device, configured to execute instructions stored in the memory to implement the method according to any one of claims 1 to 6.

Images