Method and device for determining display content of auxiliary screen, electronic equipment, medium and product

Abstract

The invention provides an auxiliary screen display content determination method and device, electronic equipment, a medium and a product, and the method comprises the steps: responding to a floating window triggering operation of a user, and displaying a floating window page on a main screen; for any core element, adding the core element in the floating window page in response to an adding operation of a user on the core element; the core element is used for indicating a basic building block, selected by a user, in an APP in a main screen; in response to a folding operation of a user on the folding screen mobile phone, projecting the core elements on the floating window page to the secondary screen, so that the user can add the core elements into the floating window page according to own preferences, and when the folding screen mobile phone is folded, projecting the core elements on the floating window page to the secondary screen; the personalized customization capability meets the using habits and requirements of different users, the design flexibility is improved, and then the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of foldable screen mobile phone applications, and in particular to a method, device, electronic device, medium and product for determining content displayed on a secondary screen. Background Art

[0002] Currently, the functions of the secondary screen are usually limited to the display of fixed elements, but the display of fixed elements limits the user's choice space, and the content elements displayed on the secondary screen are often inconsistent with the user's actual usage habits. Users may want to display some core elements that they think are important or frequently used, as well as their frequently used applications, shortcuts or information flows, etc. on the secondary screen, but due to the lack of customization options, users cannot adjust the content displayed on the secondary screen according to their preferences and needs. They can only passively accept the default settings provided by the manufacturer. The design flexibility is poor, resulting in a poor user experience. Summary of the invention

[0003] The present application provides a method, device, electronic device, medium and product for determining content displayed on a secondary screen, so as to improve the flexibility of design and thus improve the user experience.

[0004] In a first aspect, an embodiment of the present application provides a method for determining content displayed on a secondary screen, which is applied to a foldable screen mobile phone, wherein the foldable screen mobile phone includes a main screen and a secondary screen, and the method includes:

[0005] In response to a floating window triggering operation by a user, displaying a floating window page on the main screen;

[0006] For any core element, in response to a user's adding operation on the core element, the core element is added to the floating window page; the core element is used to indicate a basic building block in the APP in the main screen selected by the user;

[0007] In response to the user's folding operation on the foldable screen mobile phone, the core elements located on the floating window page are projected onto the secondary screen.

[0008] Optionally, in response to a user's operation of adding the core element, adding the core element to the floating window page includes:

[0009] In response to the user dragging the core element and stopping the dragging at the first position in the floating window page, adding the core element at the first position in the floating window page;

[0010] Correspondingly, in response to the user's folding operation on the foldable screen mobile phone, projecting the core elements on the floating window page to the secondary screen includes:

[0011] In response to the user's folding operation on the folding screen mobile phone, the core elements located on the floating window page are projected onto the secondary screen according to the first positions corresponding to each core element, wherein the relative positions of each core element on the floating window page are the same as their relative positions on the secondary screen.

[0012] Optionally, when the size of the floating window page is the same as the size of the secondary screen, the display size of the core element in the floating window page is the original size;

[0013] When the size of the floating window page is equal to the size of the secondary screen after proportional scaling, the display size of the core element in the floating window page is k times the original size, where k is the scaling ratio.

[0014] Optionally, in response to a user's folding operation on the foldable screen mobile phone, projecting the core elements on the floating window page onto the secondary screen includes:

[0015] In the manual combination mode, in response to a user's folding operation on the foldable screen mobile phone, the core elements on the floating window page are projected onto the secondary screen;

[0016] The method further comprises:

[0017] In the smart combination mode, in response to the user's folding operation on the folding screen mobile phone, the core elements determined based on the display determination model are projected onto the secondary screen, wherein the input of the display determination model includes: the size of the secondary screen.

[0018] Optionally, also include:

[0019] In response to a user's removal operation on the core element, removing the core element from the floating window page;

[0020] In response to a user's moving operation on the core element, moving the core element in the floating window page from an initial position to a target position;

[0021] In response to the user's adding operation, and / or removing operation, and / or moving operation, the display determination model is trained a second time based on the first core element corresponding to the adding operation and the relative position of the first core element in the floating window page, and / or the second core element corresponding to the removing operation, and / or the third core element corresponding to the moving operation and the position of the third core element before and after the movement.

[0022] Optionally, projecting the core elements determined based on the display determination model onto the secondary screen includes:

[0023] Inputting the user's usage of the mobile phone before folding and the size of the secondary screen into the display determination model to determine a plurality of backup elements and the priority corresponding to each backup element;

[0024] Selecting a plurality of standard elements from the plurality of spare elements, wherein the size of the standard elements is smaller than a first preset threshold, or the size of the standard elements remains recognizable when compressed to the first preset threshold;

[0025] According to the priority corresponding to each standard element, the core elements are screened out from multiple standard elements, and the screened out core elements are projected onto the secondary screen.

[0026] In a second aspect, an embodiment of the present application provides a device for determining content displayed on a secondary screen, which is applied to a folding screen mobile phone, wherein the folding screen mobile phone includes a main screen and a secondary screen, and the device includes:

[0027] A display module, configured to display a floating window page on the main screen in response to a floating window triggering operation by a user;

[0028] An adding module, for adding any core element to the floating window page in response to a user's adding operation on the core element; the core element is used to indicate a basic building block in the APP in the main screen selected by the user;

[0029] The projection module is used to project the core elements on the floating window page onto the secondary screen in response to the user's folding operation on the folding screen mobile phone.

[0030] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a processor, and a memory communicatively connected to the processor;

[0031] The memory stores computer-executable instructions;

[0032] The processor executes the computer-executable instructions stored in the memory to implement the method described in the first aspect above.

[0033] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, they are used to implement the method described in the first aspect above.

[0034] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which implements the method described in the first aspect when executed by a processor.

[0035] The present application provides a method, device, electronic device, medium and product for determining the content displayed on a secondary screen, the method comprising: displaying a floating window page on the main screen in response to a user's floating window trigger operation; for any core element, adding the core element to the floating window page in response to a user's adding operation on the core element; the core element is used to indicate the basic building blocks in the APP in the main screen selected by the user; in response to the user's folding operation on the folding screen mobile phone, projecting the core elements located on the floating window page to the secondary screen, so that the user can add core elements to the floating window page according to his or her preferences, and when the folding screen mobile phone is folded, the core elements on the floating window page are projected to the secondary screen. This personalized customization capability meets the usage habits and needs of different users, improves the flexibility of design, and thus improves the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0037] Figure 1 An application scenario diagram provided for an embodiment of the present application;

[0038] Figure 2 A schematic diagram of a flow chart of a method for determining content displayed on a secondary screen provided in an embodiment of the present application;

[0039] Figure 3 A system architecture diagram provided for an embodiment of the present application;

[0040] Figure 4 A flowchart of another method for determining the secondary screen display content provided in an embodiment of the present application;

[0041] Figure 5 A schematic diagram of the structure of a device for determining the secondary screen display content provided in an embodiment of the present application;

[0042] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0043] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0044] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0045] With the development of technology, the design of user interface (UI) and user experience (UX) has become increasingly important. Designers are exploring how to most effectively use the secondary screen space to display weather, time, notifications or shortcuts, while ensuring that the interaction logic with the main screen is consistent and natural.

[0046] Currently, the functions of the secondary screen are usually limited to the display of fixed elements, but the display of fixed elements limits the user's choice space, and the content elements displayed on the secondary screen are often inconsistent with the user's actual usage habits. Users may want to display some core elements that they think are important or frequently used, as well as their frequently used applications, shortcuts or information flows, etc. on the secondary screen, but due to the lack of customization options, users cannot adjust the content displayed on the secondary screen according to their preferences and needs. They can only passively accept the default settings provided by the manufacturer. The design flexibility is poor, resulting in a poor user experience.

[0047] In view of this, the present application provides a method for determining the content displayed on the secondary screen, which can display a floating window page on the main screen in response to the user's floating window trigger operation; for any core element, in response to the user's adding operation on the core element, the core element is added to the floating window page; in response to the user's folding operation on the folding screen mobile phone, the core elements located on the floating window page are projected to the secondary screen, so that the user can add core elements to the floating window page according to his or her preferences, and when the folding screen mobile phone is folded, the core elements on the floating window page are projected to the secondary screen. This personalized customization capability meets the usage habits and needs of different users, improves the flexibility of design, and thus improves the user experience.

[0048] Figure 1 An application scenario diagram provided for an embodiment of the present application, such as Figure 1 As shown, the processor in the foldable screen mobile phone responds to the user's floating window trigger operation and displays a floating window page on the main screen. The floating window page is as shown in FIG. Figure 1As shown in the orange box in the figure, for any core element, in response to the user's adding operation on the core element, the core element is added to the floating window page. The current temperature "72°F" and the current date "Tue, Sep 24" in the orange box are the core elements added to the floating window page by the user. The gray box below the orange box is the operation interface of an APP (Application). The user can select the core element from the operation interface and add it to the floating window page. Finally, when the user folds the folding screen mobile phone, the core elements on the floating window page are projected to the secondary screen.

[0049] The technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0050] Figure 2 A flowchart of a method for determining the secondary screen display content provided in an embodiment of the present application is provided. The execution subject of the present embodiment can be any device with a data processing function. The present application is specifically described using the processor in the folding screen mobile phone as the execution subject. Figure 2 As shown, a method for determining the secondary screen display content provided in an embodiment of the present application is applied to a folding screen mobile phone, wherein the folding screen mobile phone includes a main screen and a secondary screen, and the method may include:

[0051] Step 201: In response to a floating window triggering operation by a user, a floating window page is displayed on the main screen.

[0052] Among them, the floating window trigger operation can be any operation that can trigger the display of a floating window page on the main screen. This application does not limit this. Exemplarily, it can be continuously pressing the main screen for more than a first preset time.

[0053] Specifically, the user performs a floating window triggering operation, and the processor displays a floating window page on the main screen in response to the user's floating window triggering operation.

[0054] Step 202: For any core element, in response to the user's adding operation on the core element, add the core element to the floating window page; the core element is used to indicate the basic building block in the APP in the main screen selected by the user.

[0055] Among them, the adding operation is any operation that can add the core element to the floating window page, and this application does not limit this. Exemplarily, it can be an operation of dragging the core element to the floating window page.

[0056] Exemplarily, the basic building blocks in a weather app may include: current temperature, maximum temperature of the day, minimum temperature of the day, temperature range of the day, real-time wind volume, etc. The basic building blocks in a communication app may include: a dialog box with a friend, a chat record (which may be text, voice or image), etc.

[0057] Specifically, for any core element, the processor adds the core element to the floating window page in response to the user's adding operation on the core element.

[0058] Optionally, in response to a user's operation of adding the core element, adding the core element to the floating window page includes:

[0059] In response to the user dragging the core element and stopping the dragging at the first position in the floating window page, adding the core element at the first position in the floating window page;

[0060] Correspondingly, in response to the user's folding operation on the foldable screen mobile phone, projecting the core elements on the floating window page to the secondary screen includes:

[0061] In response to the user's folding operation on the folding screen mobile phone, the core elements located on the floating window page are projected onto the secondary screen according to the first positions corresponding to each core element, wherein the relative positions of each core element on the floating window page are the same as their relative positions on the secondary screen.

[0062] Specifically, when the user drags the core element and stops dragging at the first position in the floating window page, the core element will be added at the first position in the floating window page, that is, the position where the user stops dragging is the position where the core element is added.

[0063] In response to the user's folding operation on the folding screen mobile phone, the processor projects the core elements on the floating window page to the secondary screen according to the first positions corresponding to each core element, and the relative positions of each core element on the floating window page are the same as their relative positions on the secondary screen.

[0064] In this way, users can drag core elements to specific locations in the floating window page according to their needs and preferences. They can not only design the core elements displayed in the secondary screen, but also design the position of each core element in the secondary screen, further improving the flexibility of the design and enhancing the user experience.

[0065] Optionally, when the size of the floating window page is the same as the size of the secondary screen, the display size of the core element in the floating window page is the original size;

[0066] When the size of the floating window page is equal to the size of the secondary screen after proportional scaling, the display size of the core element in the floating window page is k times the original size, where k is the scaling ratio.

[0067] Specifically, the size of the floating window page can be the same as or different from the size of the secondary screen. The size of the floating window page can be the same as the size of the secondary screen, and the display size of the core element in the floating window page is the original size corresponding to the core element.

[0068] When the size of the floating window page is different from the size of the secondary screen, and the size of the floating window page is k times the size of the secondary screen, where k is the corresponding scaling ratio, k is a number greater than 0, the display size of the core element in the floating window page is k times the original size of the core element.

[0069] Exemplarily, if the size of the floating window page is 0.5 times the size of the secondary screen, the display size of the core element in the floating window page is 0.5 times the original size of the core element.

[0070] In this way, when the size of the floating page is the same as that of the secondary screen, the core elements are displayed at their original size. When the size of the floating page is equal to the size of the secondary screen after being scaled in proportion, the display size of the core elements is also scaled in the same proportion. This processing method ensures the consistency of the visual experience when the user switches between the floating page and the secondary screen, further improving the user experience.

[0071] Step 203: In response to the user's folding operation on the foldable screen mobile phone, the core elements located on the floating window page are projected onto the secondary screen.

[0072] Specifically, when a user performs a folding operation on a foldable screen mobile phone, the processor projects the core elements on the floating window page to the secondary screen in response to the user's folding operation on the foldable screen mobile phone.

[0073] The present application provides a method for determining the content displayed on the secondary screen, which can display a floating window page on the main screen in response to the user's floating window trigger operation; for any core element, in response to the user's adding operation on the core element, the core element is added to the floating window page; the core element is used to indicate the basic building blocks in the APP in the main screen selected by the user; in response to the user's folding operation on the folding screen mobile phone, the core elements located on the floating window page are projected to the secondary screen, so that the user can add core elements to the floating window page according to his or her preferences, and when the folding screen mobile phone is folded, the core elements on the floating window page are projected to the secondary screen. This personalized customization capability meets the usage habits and needs of different users, improves the flexibility of design, and thus improves the user experience.

[0074] Optionally, in response to a user's folding operation on the foldable screen mobile phone, projecting the core elements on the floating window page onto the secondary screen includes:

[0075] In the manual combination mode, in response to a user's folding operation on the foldable screen mobile phone, the core elements on the floating window page are projected onto the secondary screen;

[0076] Accordingly, the method for determining the secondary screen display content provided by the present application also includes:

[0077] In the smart combination mode, in response to the user's folding operation on the folding screen mobile phone, the core elements determined based on the display determination model are projected onto the secondary screen, wherein the input of the display determination model includes: the size of the secondary screen.

[0078] Specifically, when determining the content to be displayed on the secondary screen, the user can choose a manual combination mode or a smart combination mode. If the user selects the manual combination mode, the processor projects the core elements on the floating window page to the secondary screen in response to the user's folding operation of the folding screen mobile phone.

[0079] If the user selects the smart combination mode, the processor projects the core elements determined based on the display determination model onto the secondary screen in response to the user's folding operation on the foldable screen mobile phone. The display determination module is used to determine the core elements, and the input of the display determination module includes the size of the secondary screen, that is, the display determination module considers the size of the secondary screen when determining the core elements.

[0080] In this way, in manual combination mode, users can independently select which core elements need to be displayed on the secondary screen. This mode provides a high degree of flexibility and personalization, meeting the requirements of users to customize the interface according to their own needs and preferences. In intelligent combination mode, the core elements are automatically selected for projection through the display determination model, reducing the user's operating burden. This mode is suitable for users who want to rely on the system's intelligent judgment to optimize the displayed content.

[0081] Optionally, the method for determining the secondary screen display content provided by the present application further includes:

[0082] In response to a user's removal operation on the core element, removing the core element from the floating window page;

[0083] In response to a user's moving operation on the core element, moving the core element in the floating window page from an initial position to a target position;

[0084] In response to the user's adding operation, and / or removing operation, and / or moving operation, the display determination model is trained a second time based on the first core element corresponding to the adding operation and the relative position of the first core element in the floating window page, and / or the second core element corresponding to the removing operation, and / or the third core element corresponding to the moving operation and the position of the third core element before and after the movement.

[0085] Among them, the removal operation is any operation that can remove the core element from the floating window page. This application is not limited to this. Exemplarily, it can be to drag the core element located in the floating window page and stop the dragging at a location outside the floating window page.

[0086] The moving operation is any operation that can move the core element from the initial position to the target position. This application does not limit this. For example, the core element located in the floating window page can be dragged and the dragging can be stopped at the target position.

[0087] Specifically, in the manual combination mode, the processor removes the core element from the floating window page in response to the user's removal operation on the core element; the processor moves the core element in the floating window page from an initial position to a target position in response to the user's move operation on the core element; the processor performs secondary training on the display determination model in response to the user's add operation, and / or remove operation, and / or move operation, according to the first core element corresponding to the add operation and the relative position of the first core element in the floating window page, and / or the second core element corresponding to the remove operation, and / or the third core element corresponding to the move operation and the corresponding positions before and after the move of the third core element.

[0088] In this way, by retraining the display determination model, the system can learn the user's operating habits and preferences. This continuous learning and optimization process enables the model to more accurately predict and meet user needs, improving the intelligence of the system.

[0089] Optionally, projecting the core elements determined based on the display determination model onto the secondary screen includes:

[0090] Inputting the user's usage of the mobile phone before folding and the size of the secondary screen into the display determination model to determine a plurality of backup elements and the priority corresponding to each backup element;

[0091] Selecting a plurality of standard elements from the plurality of spare elements, wherein the size of the standard elements is smaller than a first preset threshold, or the size of the standard elements remains recognizable when compressed to the first preset threshold;

[0092] According to the priority corresponding to each standard element, the core elements are screened out from multiple standard elements, and the screened out core elements are projected onto the secondary screen.

[0093] Exemplarily, the user's usage situation may include: multiple apps used by the user, usage duration, usage frequency, usage start time and end time corresponding to each basic building block in each app, etc.

[0094] Specifically, the processor inputs the user's usage of the phone before folding and the size of the secondary screen into the display determination model, and the display determination model can output multiple spare elements and the priority corresponding to each spare element; then the processor selects multiple standard elements from the multiple spare elements, wherein the size of the standard element is smaller than a first preset threshold, or the size of the standard element remains recognizable when compressed to the first preset threshold; the multiple standard elements are sorted according to the priority corresponding to each standard element to obtain a standard element sequence, wherein the standard element that is closer to the front in the standard element sequence has a higher priority, the first n standard elements are taken as core elements, and the selected core elements are projected onto the secondary screen.

[0095] In this way, by analyzing the user's usage and the size of the secondary screen, the display determination model can intelligently identify multiple backup elements and assign priorities to each element. This intelligent content selection mechanism ensures that the content displayed on the secondary screen is highly matched with the user's actual needs and usage habits. When screening standard elements, the size and recognizability of the elements are considered to ensure that the content is still clearly identifiable even when the size is compressed, so that users can get a better visual experience on a limited screen. Finally, through priority sorting and screening, the most important and relevant core elements are projected on the secondary screen. This method reduces unnecessary information interference, enables users to focus on key content, and improves the quality of user experience.

[0096] Figure 3 A system architecture diagram provided for an embodiment of the present application, such as Figure 3As shown in the figure, in this architecture: the application layer is responsible for direct interaction with the user, including an application programming interface (API) for developing applications that support dual-screen display, a widget framework for organizing and displaying various information widgets, and user interaction logic for a smooth user experience. The system service layer provides underlying support, including dual-screen management services to coordinate the display and switching of content on the main and secondary screens, screen adaptation services to ensure that applications and interfaces can be correctly laid out on different screens, energy management services to optimize battery usage, and notification services to ensure that information can be pushed to the secondary screen in a timely and accurate manner. The hardware abstraction layer serves as a bridge between software and hardware, including display drivers to control screen display effects, hinge state detection to sense the opening and closing status of the phone, touch screen input processing to ensure accurate response to touch commands, and battery management to monitor and adjust power consumption. The hardware layer is the basis for all functional implementations, including core components such as the main and secondary display screens, precision hinges, batteries, and processors.

[0097] Figure 4 A flowchart of another method for determining the secondary screen display content provided in an embodiment of the present application is shown as follows: Figure 4 As shown, it is divided into intelligent combination mode and manual combination mode.

[0098] In Smart Combination mode:

[0099] 1. Display content on the main screen and use artificial intelligence (AI) algorithms to automatically extract core elements. For example, when displaying weather content, it may not be possible to display all content on a small screen or a screen with large differences. The AI ​​algorithm will extract the core elements of the main screen display (such as the weather conditions of the day or the real-time weather conditions) according to the screen size and other attributes that need to be projected.

[0100] 2. Rearrange the extracted core elements on the new screen for drawing and display. Unrecognizable elements are not processed. Unrecognizable elements are mainly special elements that cannot be recognized by the large model's visual ability, such as animals that the model has not learned. This will cause the model to be unable to understand the content it contains. AI will increase the recognition rate through continuous learning of image pages. Elements that cannot be displayed on the secondary screen are also not processed. Elements that cannot be displayed on the co-pilot screen mainly include elements whose size has exceeded the secondary screen size.

[0101] 3. The elements extracted by the AI ​​algorithm and the way they are arranged and combined are the better results obtained by the large model through learning ability training data.

[0102] In manual combination mode:

[0103] 1. The results generated by the intelligent combination method may not satisfy the user (because everyone has different aesthetic needs), so the entire solution will also be manually arranged and combined according to the user's intentions.

[0104] 2. On the user's home screen, the user can enter the active editing page by long pressing the page, and extract the core atomic elements of the page by dragging and dropping, such as the day's temperature, the day's weather conditions, real-time wind volume and other information.

[0105] 3. After extracting these elements, users can assemble them to their favorite positions on the floating frame page. The display of the floating frame is standardized according to the size attributes of the secondary screen. The size ratio of the weather floating frame and the secondary screen size are displayed and edited in the same ratio.

[0106] 4. After the user assembles the atomic components, click OK to draw the assembly page into a layout and project it onto the screen where it needs to be displayed. At the same time, the result data will be trained into the AI ​​large model to improve the friendliness of the AI ​​model's intelligent recognition (improve AI capabilities based on user preferences).

[0107] Another shooting method provided in the embodiment of the present application can achieve the following beneficial effects:

[0108] 1. Seamless information flow: Information synchronization and interaction between the main screen and the secondary screen become smooth. The applications or information viewed by users on the main screen can continue to be displayed or operated on the secondary screen in the form of widgets, achieving a continuous experience. The secondary screen effect content is displayed based on user habits.

[0109] 2. Personalized interface: Users can customize their own widget layout on the secondary screen according to their own habits and needs, such as weather forecast, schedule reminder, music control, etc., to quickly access commonly used functions and enhance the personalized experience.

[0110] 3. Enhanced auxiliary functions: In specific scenarios, the secondary screen can be used as an auxiliary display for the main screen, such as providing framing preview or control options when shooting, displaying maps or additional information when playing games, controlling the playback progress when watching videos, etc., enriching the usage scenarios.

[0111] Corresponding to the above-mentioned method for determining the secondary screen display content, the embodiment of the present application further provides a device for determining the secondary screen display content. Figure 5 This is a schematic diagram of a structure of a device for determining the secondary screen display content provided in an embodiment of the present application. Figure 5 As shown, the device is applied to a folding screen mobile phone, the folding screen mobile phone includes a main screen and a sub-screen, and the device includes:

[0112] Display module 501, used for displaying a floating window page on the main screen in response to a floating window triggering operation by a user;

[0113] An adding module 502 is used for adding any core element to the floating window page in response to a user's adding operation on the core element; the core element is used to indicate a basic building block in the APP in the main screen selected by the user;

[0114] The projection module 503 is used to project the core elements on the floating window page onto the secondary screen in response to the user's folding operation on the folding screen mobile phone.

[0115] Optionally, when adding the core element to the floating window page in response to the user's adding operation on the core element, the adding module 502 is specifically configured to:

[0116] In response to the user dragging the core element and stopping the dragging at the first position in the floating window page, adding the core element at the first position in the floating window page;

[0117] Correspondingly, in response to the user's folding operation on the foldable screen mobile phone, projecting the core elements on the floating window page to the secondary screen includes:

[0118] In response to the user's folding operation on the folding screen mobile phone, the core elements located on the floating window page are projected onto the secondary screen according to the first positions corresponding to each core element, wherein the relative positions of each core element on the floating window page are the same as their relative positions on the secondary screen.

[0119] Optionally, when the size of the floating window page is the same as the size of the secondary screen, the display size of the core element in the floating window page is the original size;

[0120] When the size of the floating window page is equal to the size of the secondary screen after proportional scaling, the display size of the core element in the floating window page is k times the original size, where k is the scaling ratio.

[0121] Optionally, the projection module 503 is specifically used for:

[0122] In the manual combination mode, in response to a user's folding operation on the foldable screen mobile phone, the core elements on the floating window page are projected onto the secondary screen;

[0123] The projection module 503 is further used for:

[0124] In the smart combination mode, in response to the user's folding operation on the folding screen mobile phone, the core elements determined based on the display determination model are projected onto the secondary screen, wherein the input of the display determination model includes: the size of the secondary screen.

[0125] Optionally, the projection module 503 is further used for:

[0126] In response to a user's removal operation on the core element, removing the core element from the floating window page;

[0127] In response to a user's moving operation on the core element, moving the core element in the floating window page from an initial position to a target position;

[0128] In response to the user's adding operation, and / or removing operation, and / or moving operation, the display determination model is trained a second time based on the first core element corresponding to the adding operation and the relative position of the first core element in the floating window page, and / or the second core element corresponding to the removing operation, and / or the third core element corresponding to the moving operation and the position of the third core element before and after the movement.

[0129] Optionally, when the projection module 503 projects the core element determined based on the display determination model onto the secondary screen, it is specifically configured to:

[0130] Inputting the user's usage of the mobile phone before folding and the size of the secondary screen into the display determination model to determine a plurality of backup elements and the priority corresponding to each backup element;

[0131] Selecting a plurality of standard elements from the plurality of spare elements, wherein the size of the standard elements is smaller than a first preset threshold, or the size of the standard elements remains recognizable when compressed to the first preset threshold;

[0132] According to the priority corresponding to each standard element, the core elements are screened out from multiple standard elements, and the screened out core elements are projected onto the secondary screen.

[0133] The specific implementation principle and effect of the device for determining the secondary screen display content provided in the embodiment of the present application can be found in the aforementioned embodiment and will not be repeated here.

[0134] Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 6 As shown, the electronic device of this embodiment may include:

[0135] at least one processor 601; and

[0136] A memory 602 communicatively connected to the at least one processor;

[0137] The memory 602 stores instructions that can be executed by the at least one processor 601, and the instructions are executed by the at least one processor 601 to enable the electronic device to execute the method described in any of the above embodiments.

[0138] Optionally, the memory 602 may be independent or integrated with the processor 601 .

[0139] The implementation principle and technical effects of the electronic device provided in this embodiment can be found in the aforementioned embodiments and will not be described in detail here.

[0140] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions. When a processor executes the computer-executable instructions, the method described in any of the above embodiments is implemented.

[0141] An embodiment of the present application further provides a computer program product, including a computer program, which implements the method described in any of the above embodiments when executed by a processor.

[0142] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules can be combined or integrated into another system, or some features can be ignored or not executed.

[0143] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the method described in each embodiment of the present application.

[0144] It should be understood that the above-mentioned processor can be a processing unit (Central Processing Unit, CPU), or other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application-specific integrated circuits (Application Specific Integrated Circuit, ASIC), etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the application can be directly embodied as being executed by a hardware processor, or executed by a combination of hardware and software modules in the processor. The memory may include a high-speed random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage, and can also be a USB flash drive, a mobile hard disk, a read-only memory, a disk or an optical disk, etc.

[0145] The above storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The storage medium can be any available medium that can be accessed by a general or special-purpose computer.

[0146] An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the storage medium can also exist as discrete components in an electronic device or a main control device.

[0147] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0148] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0149] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0150] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for determining the secondary screen display content, characterized in that: Applied to a foldable screen mobile phone, the foldable screen mobile phone includes a main screen and a secondary screen, and the method includes: In response to a floating window triggering operation by a user, displaying a floating window page on the main screen; For any core element, in response to a user's adding operation on the core element, the core element is added to the floating window page; the core element is used to indicate a basic building block in the APP in the main screen selected by the user; In response to the user's folding operation on the foldable screen mobile phone, the core elements located on the floating window page are projected onto the secondary screen.

2. The method according to claim 1, characterized in that In response to the user's operation of adding the core element, adding the core element to the floating window page includes: In response to the user dragging the core element and stopping the dragging at the first position in the floating window page, adding the core element at the first position in the floating window page; Correspondingly, in response to the user's folding operation on the foldable screen mobile phone, projecting the core elements on the floating window page to the secondary screen includes: In response to the user's folding operation on the folding screen mobile phone, the core elements located on the floating window page are projected onto the secondary screen according to the first positions corresponding to each core element, wherein the relative positions of each core element on the floating window page are the same as their relative positions on the secondary screen.

3. The method according to claim 1, characterized in that When the size of the floating window page is the same as the size of the secondary screen, the display size of the core element in the floating window page is the original size; When the size of the floating window page is equal to the size of the secondary screen after proportional scaling, the display size of the core element in the floating window page is k times the original size, where k is the scaling ratio.

4. The method according to any one of claims 1 to 3, characterized in that: In response to a user's folding operation on the foldable screen mobile phone, projecting the core elements on the floating window page onto the secondary screen includes: In the manual combination mode, in response to a user's folding operation on the foldable screen mobile phone, the core elements on the floating window page are projected onto the secondary screen; The method further comprises: In the smart combination mode, in response to the user's folding operation on the folding screen mobile phone, the core elements determined based on the display determination model are projected onto the secondary screen, wherein the input of the display determination model includes: the size of the secondary screen.

5. The method according to claim 4, characterized in that Also includes: In response to a user's removal operation on the core element, removing the core element from the floating window page; In response to a user's moving operation on the core element, moving the core element in the floating window page from an initial position to a target position; In response to the user's adding operation, and / or removing operation, and / or moving operation, the display determination model is trained a second time based on the first core element corresponding to the adding operation and the relative position of the first core element in the floating window page, and / or the second core element corresponding to the removing operation, and / or the third core element corresponding to the moving operation and the position of the third core element before and after the movement.

6. The method according to claim 4, characterized in that Project the core elements determined based on the display determination model to the secondary screen, including: Inputting the user's usage of the mobile phone before folding and the size of the secondary screen into the display determination model to determine a plurality of backup elements and the priority corresponding to each backup element; Selecting a plurality of standard elements from the plurality of spare elements, wherein the size of the standard elements is smaller than a first preset threshold, or the size of the standard elements remains recognizable when compressed to the first preset threshold; According to the priority corresponding to each standard element, the core elements are screened out from multiple standard elements, and the screened out core elements are projected onto the secondary screen.

7. A device for determining the content displayed on a secondary screen, characterized in that: Applied to a foldable screen mobile phone, the foldable screen mobile phone includes a main screen and a secondary screen, and the device includes: A display module, configured to display a floating window page on the main screen in response to a floating window triggering operation by a user; An adding module, for adding any core element to the floating window page in response to a user's adding operation on the core element; the core element is used to indicate a basic building block in the APP in the main screen selected by the user; The projection module is used to project the core elements on the floating window page onto the secondary screen in response to the user's folding operation on the folding screen mobile phone.

8. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 6 when executed by a processor.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images