A display method, device and medium based on cross-screen collaboration

Abstract

The present disclosure provides a display method, device and medium based on cross-screen collaboration, the method comprising: displaying an identifier in a first display frame, the identifier being an identifier in a current display page or a non-current display page of a second device; the identifier being an application identifier or a file identifier; receiving an open control signal for at least one identifier in the first display frame; sending the open control signal and the coordinate information of the open control signal in the first display frame to the second device through the projection connection; obtaining the open page of the second device in response to the open control signal for the at least one identifier through the projection connection; calling a setting display application to display the open page in the second display frame. In the present disclosure, in the scenario of cross-screen collaboration, the limitation of the display frame on the first device for displaying the screen image of the second device is broken, providing users with an out-of-frame display experience under cross-screen collaboration.

Description

Technical Field

[0001] The present disclosure relates to the technical field of data processing of mobile devices, and in particular to a display method, device and medium based on cross-screen collaboration. Background Art

[0002] After two devices establish cross-screen collaboration, you can project the screen of the first device to the second device, so that the two devices can display the screen of the first device synchronously. Figure 1 As shown, after the mobile phone and computer establish cross-screen collaboration, the screen of the mobile phone is projected to the computer, and the two display the screen of the mobile phone synchronously. Summary of the invention

[0003] In view of this, the present disclosure provides a display method, device and medium based on cross-screen collaboration.

[0004] According to a first aspect of an embodiment of the present disclosure, a method for displaying information in cross-screen collaboration is provided, which is applied to a first device that has established a screen projection connection with a second device, including:

[0005] Displaying an identifier in the first display frame, where the identifier is an identifier in a current display page or a non-current display page of the second device; the identifier is an application identifier or a file identifier;

[0006] receiving an opening control signal for at least one mark in the first display frame;

[0007] Sending the opening control signal and the coordinate information of the opening control signal in the first display frame to the second device through the screen projection connection;

[0008] Acquire, through the screen projection connection, an opening page of the second device in response to an opening control signal for the at least one identifier;

[0009] The setting display application is called to display the open page in the second display frame.

[0010] In one embodiment, the calling of the setting display application to display the open page in the second display frame includes:

[0011] When the number of the at least one identifier is greater than 1, determining more than one second display frame, the number of the more than one second display frame being the same as the number of the at least one identifier;

[0012] The setting display application is called to display the opening page in response to the opening control signal for the different identification in different second display frames.

[0013] In one embodiment, the method further comprises:

[0014] receiving a display control signal for a display page located in the second display frame;

[0015] determining an update page in response to the second control signal according to the type of the display control signal and / or the coordinate information of the display control signal in the second display frame;

[0016] The update page is displayed in the second display frame.

[0017] In one embodiment, the method further comprises:

[0018] Through the screen projection connection, the display control signal for the display page located in the second display frame is sent to the second device, so that the second device displays a response page in response to the display control signal.

[0019] In one embodiment, displaying a logo in the first display frame includes:

[0020] A screen display picture of the second device is displayed in the first display frame, wherein the screen display picture includes the logo.

[0021] In one embodiment, the method further comprises:

[0022] The identifier is an application identifier, and when the identifier is displayed in the control panel, the operation in response to the opening control signal is to call the setting display application to display the opening page in the second display frame, and to send the opening control signal of the application identifier to the second terminal;

[0023] The displaying of the logo in the first display frame includes:

[0024] A control panel for the second device is displayed in the first display frame, wherein the control panel includes the logo.

[0025] According to a second aspect of an embodiment of the present disclosure, a method for displaying information in cross-screen collaboration is provided, which is applied to a second device that has established a screen projection connection with a first device, including:

[0026] Through the screen projection connection, receiving an opening control signal and the coordinate information of the opening control signal in a first display frame and sending the same to the second device; the first display frame is a display frame in which a logo is displayed in the first device;

[0027] Determine an identifier corresponding to the opening control signal according to the coordinate information;

[0028] determining an opening page in response to an opening control signal for the at least one identifier;

[0029] The open page is sent to the first device through the screen projection connection.

[0030] In one embodiment, the method further comprises:

[0031] Receiving, through the screen projection connection, a display control signal for a display page located in a second display frame of the first device;

[0032] Determine the response page corresponding to the display control signal;

[0033] The response page is displayed.

[0034] According to a third aspect of an embodiment of the present disclosure, a device for displaying information in cross-screen collaboration is provided, which is applied to a first device that has established a screen projection connection with a second device, including:

[0035] A first display module is configured to display an identifier in a first display frame, wherein the identifier is an identifier in a current display page or a non-current display page of the second device; the identifier is an application identifier or a file identifier;

[0036] A first receiving module is configured to receive an opening control signal for at least one mark in the first display frame;

[0037] A first sending module is configured to send the opening control signal and the coordinate information of the opening control signal in the first display frame to the second device through the screen projection connection;

[0038] an acquisition module, configured to acquire, through the screen projection connection, an opening page of the second device in response to an opening control signal for the at least one identifier;

[0039] The second display module is configured to call a setting display application to display the open page in a second display frame.

[0040] In one embodiment, the second display module is configured to use the following method to call a setting display application to display the open page in the second display frame:

[0041] When the number of the at least one identifier is greater than 1, determining more than one second display frame, the number of the more than one second display frame being the same as the number of the at least one identifier;

[0042] The setting display application is called to display the opening page in response to the opening control signal for the different identification in different second display frames.

[0043] In one embodiment, the device further comprises:

[0044] A second receiving module is configured to receive a display control signal for a display page located in the second display frame;

[0045] A first determining module is configured to determine an update page in response to the second control signal according to the type of the display control signal and / or the coordinate information of the display control signal in the second display frame;

[0046] The third display module is configured to display the update page in the second display frame.

[0047] In one embodiment, the device further comprises:

[0048] The second sending module is configured to send the display control signal for the display page located in the second display frame to the second device through the screen projection connection, so that the second device displays a response page in response to the display control signal.

[0049] In one embodiment, the first display module is further configured to display the logo in the first display frame using the following method:

[0050] A screen display picture of the second device is displayed in the first display frame, wherein the screen display picture includes the logo.

[0051] In one embodiment, the device further comprises:

[0052] A setting module is configured to set the identifier as an application identifier and to perform the following settings for the application identifier: when the identifier is displayed in the control panel, the operation in response to the opening control signal is to call a setting display application to display the opening page in the second display frame, and to send the opening control signal for the application identifier to the second terminal;

[0053] The first display module is further configured to display the logo in the first display frame using the following method:

[0054] A control panel for the second device is displayed in the first display frame, wherein the control panel includes the logo.

[0055] According to a fourth aspect of an embodiment of the present disclosure, a device for displaying information in cross-screen collaboration is provided, which is applied to a second device that has established a screen projection connection with a first device, including:

[0056] A third receiving module is configured to receive an opening control signal and coordinate information of a first display frame where the opening control signal is located, and send the information to the second device through the screen projection connection; the first display frame is a display frame where a logo is displayed in the first device;

[0057] A second determination module is configured to determine an identifier corresponding to the opening control signal according to the coordinate information;

[0058] A third determination module is configured to determine an open page in response to an open control signal for the at least one identifier;

[0059] The third sending module is configured to send the open page to the first device through the screen projection connection.

[0060] In one embodiment, the fourth receiving module is configured to receive a display control signal for a display page located in the second display frame of the first device through the screen projection connection;

[0061] A fourth determining module is configured to determine a response page corresponding to the display control signal;

[0062] The fourth display module is configured to display the response page.

[0063] According to a fifth aspect of an embodiment of the present disclosure, a device for displaying information in cross-screen collaboration is provided, including:

[0064] processor;

[0065] a memory for storing processor-executable instructions;

[0066] The processor is configured to execute executable instructions in the memory to implement the steps of the method for displaying information in cross-screen collaboration.

[0067] According to a sixth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, on which executable instructions are stored, characterized in that when the executable instructions are executed by a processor, the steps of the method for displaying information in the cross-screen collaboration are implemented.

[0068] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: in the scenario of cross-screen collaboration, the limitation of the display frame on the first device for displaying the screen image of the second device is broken, and an out-of-frame display experience under cross-screen collaboration is provided to the user; when the screen size of the first device is larger than the screen size of the second device, the large screen advantage of the first device is fully utilized to provide the user with a better visual experience.

[0069] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0071] Figure 1 It is a schematic diagram of screen projection display in the prior art;

[0072] Figure 2 is a flowchart of a display method based on cross-screen collaboration and applied to a first device according to an exemplary embodiment;

[0073] Figure 3 is a flowchart of a display method based on cross-screen collaboration and applied to a first device according to an exemplary embodiment;

[0074] Figure 4 is a display schematic diagram based on cross-screen collaboration according to an exemplary embodiment;

[0075] Figure 5 is a display schematic diagram based on cross-screen collaboration according to an exemplary embodiment;

[0076] Figure 6 is a display schematic diagram based on cross-screen collaboration according to an exemplary embodiment;

[0077] Figure 7 is a display schematic diagram based on cross-screen collaboration according to an exemplary embodiment;

[0078] Figure 8 is a display schematic diagram based on cross-screen collaboration according to an exemplary embodiment;

[0079] Fig. 9 is a display schematic diagram based on cross-screen collaboration according to an exemplary embodiment;

[0080] Fig.10 It is a display schematic diagram based on cross-screen collaboration according to an exemplary embodiment.

[0081] Fig.11 is a flowchart of a display method based on cross-screen collaboration and applied to a second device according to an exemplary embodiment;

[0082] Fig.12 is a structural diagram of a display device based on cross-screen collaboration and applied to a first device according to an exemplary embodiment;

[0083] Fig.13 is a structural diagram of a display device based on cross-screen collaboration and applied to a second device according to an exemplary embodiment;

[0084] Fig.14 It is a structural diagram of a display device based on cross-screen collaboration according to an exemplary embodiment. DETAILED DESCRIPTION

[0085] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the embodiments in the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the embodiments in the present disclosure as detailed in the appended claims.

[0086] In an embodiment of the present disclosure, a display method based on cross-screen collaboration is provided, which is applied to a first device that has established a screen projection connection with a second device. The first device may be a TV, a desktop computer, a tablet computer, or other device.

[0087] Reference Figure 2 , Figure 2 FIG. 1 is a flow chart of a display method based on cross-screen collaboration according to an exemplary embodiment. Figure 2 As shown, this method includes:

[0088] Step S21, displaying an identifier in the first display frame, wherein the identifier is an identifier in a current display page or a non-current display page of the second device; the identifier is an application identifier or a file identifier;

[0089] Step S22, receiving an opening control signal for at least one mark in the first display frame;

[0090] Step S23, sending the opening control signal and the coordinate information of the opening control signal in the first display frame to the second device through the screen projection connection;

[0091] Step S24, obtaining, through the screen projection connection, an opening page of the second device in response to an opening control signal for the at least one identifier;

[0092] Step S25, calling a setting display application to display the open page in the second display frame.

[0093] In one embodiment, the open page is a single-level page, and the open page contains all the contents in the single-level page, including text, pictures, and the like.

[0094] In one embodiment, the open page is a multi-level page, and the open page includes the content of each level of the multi-level page. When the display application is called in step S25 to display the open page in the second display frame, after receiving an operation instruction for the open page, a display result in response to the operation instruction is determined, and the display result is the content of the page under the path corresponding to the operation instruction, and the display result is displayed in the second display frame. For example, the user views the content of each level of the page by clicking.

[0095] In one embodiment, the size of the second display frame is greater than the size of the first display frame, for example, the size of the second display frame is greater than twice the size of the first display frame.

[0096] In this embodiment, in the scenario of cross-screen collaboration, the limitation of the display frame on the first device for displaying the screen image of the second device is broken, and an out-of-frame display experience is provided for the user under cross-screen collaboration. When the screen size of the first device is larger than the screen size of the second device, the large screen advantage of the first device is fully utilized to provide the user with a better visual experience.

[0097] In one embodiment, the first device and the second device are devices of different categories, and the first operating system supported by the first device is different from the second operating system supported by the second device. For example, when the first device is a computer and the second device is a mobile phone, the operating system of the computer is the first system (such as Microsoft operating system) and the operating system of the mobile phone is the second system (such as Android system).

[0098] In the existing screen projection scheme, the screen display of the mobile phone is projected to the computer, the display frame is displayed on the computer, and the screen display of the mobile phone is displayed in the display frame. Because the cross-screen processing platform used to process cross-screen collaboration does not include a communication mechanism for manual interaction operation signals, it is impossible to transmit the manual interaction operation signal received by the first device to the second device, so the user's operation on the icon or file in the display frame on the computer side cannot be notified to the second device, and thus the operation linkage from the computer side to the mobile phone side cannot be realized.

[0099] In order to realize cross-operating system notification, the human-computer interaction operation information on the first device side is notified to the second device side. In the cross-screen processing platform for processing cross-screen collaboration, a communication mechanism for manual interaction operation signals is added. This communication mechanism can convert the manual interaction operation signal received by the first device from a form that conforms to the first operating system to a form that conforms to the second operating system, so that the second device can be informed of the manual interaction operation signal. Among them, the human-computer interaction operation information of the first device refers to the control information input by the user through the manual interaction device. For example, when the manual interaction device is a touch screen, the human-computer interaction operation information is a touch signal; when the manual interaction device is a keyboard and mouse device, the human-computer interaction operation information is the control signal corresponding to the keyboard and mouse device. The human-computer interaction operation information includes: mouse double-click, mouse box selection, mouse wheel up, mouse wheel down, keyboard confirmation open, keyboard shortcut key combination, etc.

[0100] This communication mechanism includes a conversion rule, which is a conversion rule for the human-computer interaction operation of the first device to the human-computer interaction operation of the second device. In this rule, the first human-computer interaction operation received by the first device determines the first event corresponding to this operation in the first system, determines that this first event corresponds to the second event in the second operating system, and determines the mapping relationship between this first event and the second event. For example: the first human-computer interaction operation received by the first device is a double-click operation of the left mouse button, the corresponding first event is a double-click event of the left mouse button, the second event corresponding to this first event is a touch single-click event, and the operation corresponding to the second event is a touch single-click operation.

[0101] The present disclosure provides a display method based on cross-screen collaboration, which includes: Figure 2 The method shown in the figure, and: in step S25, calling the setting display application to display the open page in the second display frame includes:

[0102] When the number of the at least one identifier is greater than 1, determining more than one second display frame, the number of the more than one second display frame being the same as the number of the at least one identifier;

[0103] The setting display application is called to display the opening page in response to the opening control signal for the different identification in different second display frames.

[0104] For example, a first device displays multiple application identifiers in a first display frame, and receives a box selection operation instruction and a confirmation opening instruction, wherein the box selection operation instruction is to select two application identifiers by a mouse, and the confirmation opening instruction is to confirm the opening instruction input by a keyboard. The first device determines two second display frames, displays an opening page corresponding to the first application identifier in the first display frame, and displays an opening page corresponding to the second application identifier in the second display frame.

[0105] After receiving a closing instruction for a second display frame, the first device closes the second display frame.

[0106] In this embodiment, for the opening control signals for multiple identifiers at the same time, after obtaining multiple opening pages, different opening pages are displayed respectively through different second display frames, so as to facilitate the user to view different applications or files.

[0107] The present disclosure provides a display method based on cross-screen collaboration, which includes: Figure 2 The method shown, and: Figure 3 As shown, the method also includes:

[0108] Step S26, receiving a display control signal for the display page located in the second display frame;

[0109] Step S27, determining an update page in response to the second control signal according to the type of the display control signal and / or the coordinate information of the display control signal in the second display frame;

[0110] Step S28, displaying the update page in the second display frame.

[0111] In one embodiment, the opened page is a single-level page, and the display control signal received in step S26 includes a control signal for viewing the previous part of the content, a control signal for viewing the next part of the content, a control signal for turning up a page, a control signal for turning down a page, and the like.

[0112] In one embodiment, the opened page is a single-level page, and the display control signal received in step S26 includes viewing a sub-page in the set-level page, viewing all controls in the previous-level page, viewing all controls in the next-level page, viewing the previous part of the content control signal, viewing the next part of the content control signal, turning the page up control signal, turning the page down control signal, etc.

[0113] In one embodiment, after step S26, it also includes: sending the display control signal for the display page located in the second display frame to the second device through the screen projection connection, so that the second device displays a response page in response to the display control signal.

[0114] The following two examples illustrate this.

[0115] Example 1:

[0116] The display page is a text content display page.

[0117] The page opened by the second device in response to the opening control signal for the at least one identifier obtained in step S24 includes all text contents of the page. Due to the limited size of the second display frame, only a part of the content can be displayed.

[0118] The content displayed in the second display frame is the first 20% of all the text content. When the display control signal received for the display page located in the second display frame is a downward signal of the mouse wheel, the downward signal is determined to determine that the update page is corresponding to the first 10% to 30% of the text content, and this updated page is displayed.

[0119] The slide signal is sent to the second device, so that the second device displays the text content corresponding to the slide signal. Alternatively, the slide signal does not need to be sent to the second device, and the second device can view other content according to the user operation, and the second display frame of the first device is not synchronized with the screen display of the first device.

[0120] Example 2:

[0121] The display page is a multi-level page, which includes a plurality of first-level controls, each of which corresponds to a plurality of second-level controls, and each of which corresponds to text content.

[0122] The opening page of the second device in response to the opening control signal of the at least one identifier obtained in step S24 includes text content corresponding to each level of control in this multi-level page. Due to the limited size of the second display frame, only a part of the content can be displayed.

[0123] The second display frame displays multiple first-level controls by default, as well as all second-level controls corresponding to the first first-level control and text content corresponding to the first second-level control. The display control signal received for the display page located in the second display frame is a mouse click signal, and the click signal is for the second second-level control under the first first-level control in the second display frame, and the text content corresponding to the second-level control is displayed.

[0124] The slide down signal is sent to the second device, so that the second device displays the text content corresponding to the secondary control. Alternatively, the slide down signal does not need to be sent to the second device, and the second device can view other content according to the user operation, and the second display frame of the first device is not synchronized with the screen display of the first device.

[0125] In this embodiment, when the user performs an operation in the second display frame, the corresponding required display can be performed, so that the user can view detailed information through the large-size display frame.

[0126] The present disclosure provides a display method based on cross-screen collaboration, which includes: Figure 2 The method shown, and: displaying the logo in the first display frame in step S21, includes: displaying a screen display picture of the second device in the first display frame, and the screen display picture includes the logo.

[0127] That is, the first display frame is a display frame used to synchronously display the screen display image of the second device.

[0128] The following two examples are used to illustrate this.

[0129] Example 1:

[0130] The mobile phone projects the screen display image onto the computer, and the computer displays a first display frame, in which the screen display image of the mobile phone is displayed. The screen display image includes the application logo of the "Note" application.

[0131] The user double-clicks the "Note" logo with the computer mouse. Through the cross-system mechanism in the cross-screen processing platform, it is determined that the double-click operation signal in the computer operating system corresponds to the single-click operation signal in the mobile phone operating system, and the single-click operation signal is sent to the mobile phone. The mobile phone determines that the page opened for this single-click operation signal is the open page of the "Note" application. This open page is a multi-level page. After receiving the open page obtained from the mobile phone, the computer can hide the first display frame used to synchronize the mobile phone screen, such as Figure 4 As shown, the setting display application is called to display the open page in the second display frame. The open page displays all controls in non-sub-pages and a sub-page. The sub-page is the sub-page corresponding to the default control in the last level non-sub-page. The mobile phone side can synchronously display the corresponding display interface of the open page in the mobile phone's operating system, such as Figure 5 As shown, when the user clicks the A2 control in the second level page in the second display frame, the subpage in the second display frame displays the information of the subpage corresponding to the A2 control. The computer sends this click information to the mobile phone, and the mobile phone displays the information of the subpage corresponding to the A2 control and the path to reach this subpage. The mobile phone side can also not display synchronously with the content in the second display frame. After sending the open page to the computer, the mobile phone side performs corresponding processing according to the user's touch operation on the mobile phone, without synchronization with the second display frame of the computer.

[0132] In this example, the computer displays the contents of the open page through a large-size display frame, overcoming the shortcoming of limited display content on a small mobile phone screen and making it easier for users to view page information using a computer.

[0133] Example 2:

[0134] like Figure 6 As shown, the mobile phone projects the screen display picture to the computer, and the computer displays a first display frame, and the screen display picture of the mobile phone is displayed in the first display frame. The screen display picture includes a communication dialog box of an instant messaging application, and the communication dialog box includes a picture logo.

[0135] The user double-clicks the image logo with the computer mouse, and through the cross-system mechanism in the cross-screen processing platform, it is determined that the double-click operation signal in the computer operating system corresponds to the single-click operation signal in the mobile phone operating system, and the single-click operation signal is sent to the mobile phone. The mobile phone responds to the single-click operation signal and determines that the page opened for the single-click operation signal is a large picture display frame of the picture corresponding to the image logo. The mobile phone displays the opened page, and the computer receives the opened page obtained from the mobile phone. Figure 7 As shown, the setting display application is called to display the open page in the second display frame.

[0136] The present disclosure provides a display method based on cross-screen collaboration, which includes: Figure 2The method shown, and: the method also includes:

[0137] The identifier is an application identifier, and when the identifier is displayed in the control panel, the operation in response to the opening control signal is to call the setting display application to display the opening page in the second display frame, and to send the opening control signal of the application identifier to the second terminal;

[0138] Displaying the logo in the first display frame in step S21 includes: displaying a control panel for the second device in the first display frame, wherein the control panel includes the logo.

[0139] In one embodiment, the method further includes: displaying a screen display image of the second device in a third display frame.

[0140] The following is an example to illustrate this.

[0141] Example 1:

[0142] When the "note" logo is set to be displayed in the control panel, the operation in response to the opening control signal is to call the setting display application to display its corresponding opening page in the second display frame, and send the opening control signal of the application logo to the second terminal.

[0143] like Figure 8 As shown, after the mobile phone and the computer establish cross-screen collaboration, the computer displays a control panel in the first display frame, which includes three application logos, and the third application logo is "Notes". In other cases, the screen display of the mobile phone can also be displayed in the third display frame, and the screen display does not include the application logo of "Notes".

[0144] The user double-clicks the "Note" logo in the first display frame with the computer mouse. Through the cross-system mechanism in the cross-screen processing platform, it is determined that the double-click operation signal for the "Note" logo in the computer operating system corresponds to the single-click operation signal for the "Note" logo in the mobile phone operating system. This single-click operation signal is sent to the mobile phone. The mobile phone determines that the page opened for this single-click operation signal is the opening page of the "Note" application. The computer receives the opening page obtained from the mobile phone. This opening page is a multi-level page, such as Fig. 9 As shown, the setting display application is called to display the open page in the second display frame. The open page displays all controls in non-sub-pages and a sub-page. The sub-page is the sub-page corresponding to the default control in the last level non-sub-page. The mobile phone side can synchronously display the corresponding display interface of the open page in the mobile phone's operating system, and, as shown in FIG. Fig.10As shown, when the user clicks the A2 control in the second level page in the second display frame, the subpage in the second display frame displays the information of the subpage corresponding to the A2 control. The computer sends this click information to the mobile phone, and the mobile phone displays the information of the subpage corresponding to the A2 control and the path to reach this subpage. The mobile phone side can also not display synchronously with the content in the second display frame. After sending the open page to the computer, the mobile phone side performs corresponding processing according to the user's touch operation on the mobile phone, without synchronization with the second display frame of the computer.

[0145] In other examples, the processing of the "File Management" application is similar to that of the "Notes" application.

[0146] In an embodiment of the present disclosure, a display method based on cross-screen collaboration is provided, and the method is applied to a second device that has established a screen projection connection with a first device. The second device may be a mobile phone.

[0147] Reference Fig.11 , Fig.11 FIG. 1 is a flow chart of a display method based on cross-screen collaboration according to an exemplary embodiment. Fig.11 As shown, this method includes:

[0148] Step S111, receiving an opening control signal and coordinate information of a first display frame where the opening control signal is located, and sending the information to the second device through the screen projection connection; the first display frame is a display frame where a logo is displayed in the first device;

[0149] Step S112, determining an identifier corresponding to the opening control signal according to the coordinate information;

[0150] Step S113, determining an opening page in response to an opening control signal for the at least one identifier;

[0151] Step S114: Send the opened page to the first device through the screen projection connection.

[0152] In one embodiment, it further comprises:

[0153] Receiving, through the screen projection connection, a display control signal for a display page located in a second display frame of the first device;

[0154] Determine the response page corresponding to the display control signal;

[0155] The response page is displayed.

[0156] In an embodiment of the present disclosure, a device for displaying information in cross-screen collaboration is provided, which is applied to a first device that has established a screen projection connection with a second device.

[0157] Reference Fig.12 , Fig.12 FIG. 1 is a structural diagram of a display device based on cross-screen collaboration according to an exemplary embodiment. Fig.12 As shown, the device comprises:

[0158] The first display module 121 is configured to display an identifier in a first display frame, where the identifier is an identifier in a current display page or a non-current display page of the second device; the identifier is an application identifier or a file identifier;

[0159] The first receiving module 122 is configured to receive an opening control signal for at least one mark in the first display frame;

[0160] The first sending module 123 is configured to send the opening control signal and the coordinate information of the opening control signal in the first display frame to the second device through the screen projection connection;

[0161] The acquisition module 124 is configured to acquire, through the screen projection connection, an opening page of the second device in response to an opening control signal for the at least one identifier;

[0162] The second display module 125 is configured to call a setting display application to display the open page in a second display frame.

[0163] In one embodiment, the second display module is configured to use the following method to call a setting display application to display the open page in the second display frame:

[0164] When the number of the at least one identifier is greater than 1, determining more than one second display frame, the number of the more than one second display frame being the same as the number of the at least one identifier;

[0165] The setting display application is called to display the opening page in response to the opening control signal for the different identification in different second display frames.

[0166] In one embodiment, the device further comprises:

[0167] A second receiving module is configured to receive a display control signal for a display page located in the second display frame;

[0168] A first determining module is configured to determine an update page in response to the second control signal according to the type of the display control signal and / or the coordinate information of the display control signal in the second display frame;

[0169] The third display module is configured to display the update page in the second display frame.

[0170] In one embodiment, it further comprises:

[0171] The second sending module is configured to send the display control signal for the display page located in the second display frame to the second device through the screen projection connection, so that the second device displays a response page in response to the display control signal.

[0172] In one embodiment, the first display module is further configured to display the logo in the first display frame using the following method:

[0173] A screen display picture of the second device is displayed in the first display frame, wherein the screen display picture includes the logo.

[0174] In one embodiment, the device further comprises:

[0175] A setting module is configured to set the identifier as an application identifier and to perform the following settings for the application identifier: when the identifier is displayed in the control panel, the operation in response to the opening control signal is to call a setting display application to display the opening page in the second display frame, and to send the opening control signal for the application identifier to the second terminal;

[0176] The first display module is further configured to display the logo in the first display frame using the following method:

[0177] A control panel for the second device is displayed in the first display frame, wherein the control panel includes the logo.

[0178] In an embodiment of the present disclosure, a device for displaying information in cross-screen collaboration is provided, which is applied to a second device that has established a screen projection connection with a first device.

[0179] Reference Fig.13 , Fig.13 FIG. 1 is a structural diagram of a display device based on cross-screen collaboration and applied to a second device according to an exemplary embodiment. Fig.13 As shown, the device comprises:

[0180] A third receiving module is configured to receive an opening control signal and coordinate information of a first display frame where the opening control signal is located, and send the information to the second device through the screen projection connection; the first display frame is a display frame where a logo is displayed in the first device;

[0181] A second determination module is configured to determine an identifier corresponding to the opening control signal according to the coordinate information;

[0182] A third determination module is configured to determine an open page in response to an open control signal for the at least one identifier;

[0183] The second sending module is configured to send the open page to the first device through the screen projection connection.

[0184] In one embodiment, it further comprises:

[0185] a fourth receiving module, configured to receive, through the screen projection connection, a display control signal for a display page located in a second display frame of the first device;

[0186] A fourth determining module is configured to determine a response page corresponding to the display control signal;

[0187] The fourth display module is configured to display the response page.

[0188] An embodiment of the present disclosure provides a device for displaying information in cross-screen collaboration, including:

[0189] processor;

[0190] a memory for storing processor-executable instructions;

[0191] The processor is configured to execute the executable instructions in the memory to implement the steps of the method.

[0192] In an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, on which executable instructions are stored, and when the executable instructions are executed by a processor, the steps of the method are implemented.

[0193] Fig.14 1 is a block diagram of a device 1200 for displaying information in cross-screen collaboration according to an exemplary embodiment. For example, the device 1200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0194] Reference Fig.12 , the device 1200 may include one or more of the following components: a processing component 1202 , a memory 1204 , a power component 1206 , a multimedia component 1208 , an audio component 1210 , an input / output (I / O) interface 1212 , a sensor component 1214 , and a communication component 1216 .

[0195] The processing component 1202 generally controls the overall operation of the device 1200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 1202 may include one or more processors 1220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 1202 may include one or more modules to facilitate the interaction between the processing component 1202 and other components. For example, the processing component 1202 may include a multimedia module to facilitate the interaction between the multimedia component 1208 and the processing component 1202.

[0196] The memory 1204 is configured to store various types of data to support operations on the device 1200. Examples of such data include instructions for any application or method operating on the device 1200, contact data, phone book data, messages, pictures, videos, etc. The memory 1204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0197] The power component 1206 provides power to the various components of the device 1200. The power component 1206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 1200.

[0198] The multimedia component 1208 includes a screen that provides an output interface between the device 1200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1208 includes a front camera and / or a rear camera. When the device 1200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0199] The audio component 1210 is configured to output and / or input audio signals. For example, the audio component 1210 includes a microphone (MIC), and when the device 1200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 1204 or sent via the communication component 1216. In some embodiments, the audio component 1210 also includes a speaker for outputting audio signals.

[0200] I / O interface 1212 provides an interface between processing component 1202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0201] The sensor assembly 1214 includes one or more sensors for providing various aspects of the status assessment of the device 1200. For example, the sensor assembly 1214 can detect the open / closed state of the device 1200, the relative positioning of components, such as the display and keypad of the device 1200, the sensor assembly 1214 can also detect the position change of the device 1200 or a component of the device 1200, the presence or absence of user contact with the device 1200, the orientation or acceleration / deceleration of the device 1200, and the temperature change of the device 1200. The sensor assembly 1214 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1214 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1214 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0202] The communication component 1216 is configured to facilitate wired or wireless communication between the device 1200 and other devices. The device 1200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0203] In an exemplary embodiment, the device 1200 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned methods.

[0204] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1204 including instructions, and the instructions can be executed by the processor 1220 of the device 1200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0205] Those skilled in the art will readily appreciate other implementations of the embodiments in the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the embodiments in the present disclosure that follow the general principles of the embodiments in the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the embodiments. The specification and examples are to be regarded as exemplary only, and the true scope and spirit of the embodiments of the present disclosure are indicated by the following claims.

[0206] It should be understood that the embodiments of the present disclosure are not limited to the precise structures described above and shown in the drawings, and various combinations, substitutions, modifications and changes can be made to the method steps or device components disclosed in the present application without departing from the scope thereof, and these combinations, substitutions, modifications and changes are deemed to be included in the scope recorded in the present disclosure. The scope of protection claimed by the present disclosure is limited by the appended claims.

[0207] It should be noted that in the present disclosure, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0208] It is understood that the embodiments described in the present disclosure can be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSP Devices, DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present application or a combination thereof.

[0209] For software implementation, the technology described in this disclosure can be implemented by a unit that performs the functions described in this disclosure. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

[0210] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in this disclosure can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this disclosure.

[0211] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0212] In the embodiments provided in the present application, it should be understood that unless there is a clear sequence between the steps of the method embodiments, the execution order can be adjusted arbitrarily. The disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0213] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0214] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0215] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present disclosure is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard drives, ROM, RAM, magnetic disks or optical disks.

Claims

1. A method for displaying information in cross-screen collaboration, applied to a first device that has established a screen projection connection with a second device, characterized in that: include: Displaying a logo in the first display frame, where the logo is a logo in a currently displayed page or a non-currently displayed page of the second device; The identifier is an application identifier; receiving an opening control signal for at least one mark in the first display frame; The opening control signal and the coordinate information of the opening control signal in the first display frame are sent to the second device through the screen projection connection, and the coordinate information is used to determine the identifier corresponding to the opening control signal; Acquire, through the screen projection connection, an open page of the second device in response to an open control signal for the at least one identifier; the open page is a single-level page or a multi-level page; Calling a setting display application to display the open page in the second display frame; The calling and setting display application to display the open page in the second display frame includes: When the open page is a multi-level page, calling a setting display application to display the content of each level of the multi-level page in the second display frame; The calling and setting display application to display the open page in the second display frame includes: When the number of the at least one identifier is greater than 1, determining more than one second display frame, the number of the more than one second display frame being the same as the number of the at least one identifier; The setting display application is called to display the opening page in response to the opening control signal for the different identification in different second display frames.

2. The method according to claim 1, characterized in that The method further comprises: receiving a display control signal for a display page located in the second display frame; determining an update page in response to the second control signal according to the type of the display control signal and / or the coordinate information of the display control signal in the second display frame; The update page is displayed in the second display frame.

3. The method according to claim 2, characterized in that The method further comprises: Through the screen projection connection, the display control signal for the display page located in the second display frame is sent to the second device, so that the second device displays a response page in response to the display control signal.

4. The method according to claim 1, characterized in that The displaying of the logo in the first display frame includes: A screen display picture of the second device is displayed in the first display frame, wherein the screen display picture includes the logo.

5. The method according to claim 1, characterized in that The method further comprises: The identifier is an application identifier, and when the identifier is displayed in the control panel, the operation in response to the opening control signal is to call the setting display application to display the opening page in the second display frame, and to send the opening control signal of the application identifier to the second terminal; The displaying of the logo in the first display frame includes: A control panel for the second device is displayed in the first display frame, wherein the control panel includes the logo.

6. A method for displaying information in cross-screen collaboration, applied to a second device that has established a screen projection connection with a first device, characterized in that: include: Through the screen projection connection, receiving an opening control signal and the coordinate information of the opening control signal in the first display frame are sent to the second device; The first display frame is a display frame that displays a logo in the first device; Determine an identifier corresponding to the opening control signal according to the coordinate information; Determine an open page in response to an open control signal for at least one identifier; the open page is a single-level page or a multi-level page, and when the open page is a multi-level page, the open page includes the content of each level page in the multi-level page; Sending the open page to the first device via the screen projection connection; The determining an opening page in response to an opening control signal for the at least one identifier comprises: When the number of the at least one identifier is greater than 1, an open page in response to an open control signal for a different identifier is determined.

7. The method according to claim 6, characterized in that The method further comprises: Receiving, through the screen projection connection, a display control signal for a display page located in a second display frame of the first device; Determine the response page corresponding to the display control signal; The response page is displayed.

8. A device for displaying information in cross-screen collaboration, applied to a first device that has established a screen projection connection with a second device, characterized in that: include: A first display module is configured to display an identifier in a first display frame, where the identifier is an identifier in a current display page or a non-current display page of the second device; The identifier is an application identifier; A first receiving module is configured to receive an opening control signal for at least one mark in the first display frame; A first sending module is configured to send the opening control signal and the coordinate information of the opening control signal in the first display frame to the second device through the screen projection connection, wherein the coordinate information is used to determine the identifier corresponding to the opening control signal; an acquisition module configured to acquire, through the screen projection connection, an open page of the second device in response to an open control signal for the at least one identifier; the open page is a single-level page or a multi-level page; A second display module is configured to call a setting display application to display the open page in a second display frame; The second display module is configured as follows: When the open page is a multi-level page, calling a setting display application to display the content of each level of the multi-level page in the second display frame; The second display module is configured to use the following method to call the setting display application to display the open page in the second display frame: When the number of the at least one identifier is greater than 1, determining more than one second display frame, the number of the more than one second display frame being the same as the number of the at least one identifier; The setting display application is called to display the opening page in response to the opening control signal for the different identification in different second display frames.

9. The device according to claim 8, characterized in that The device also includes: A second receiving module is configured to receive a display control signal for a display page located in the second display frame; A first determining module is configured to determine an update page in response to a second control signal according to a type of the display control signal and / or coordinate information of the display control signal in the second display frame; The third display module is configured to display the update page in the second display frame.

10. The device according to claim 9, characterized in that The device also includes: The second sending module is configured to send the display control signal for the display page located in the second display frame to the second device through the screen projection connection, so that the second device displays a response page in response to the display control signal.

11. The device according to claim 8, characterized in that The first display module is further configured to display the logo in the first display frame using the following method: A screen display picture of the second device is displayed in the first display frame, wherein the screen display picture includes the logo.

12. The device according to claim 8, characterized in that The device also includes: A setting module is configured to set the identifier as an application identifier and to perform the following settings for the application identifier: when the identifier is displayed in the control panel, the operation in response to the opening control signal is to call a setting display application to display the opening page in the second display frame, and to send the opening control signal for the application identifier to the second terminal; The first display module is further configured to display the logo in the first display frame using the following method: A control panel for the second device is displayed in the first display frame, wherein the control panel includes the logo.

13. A device for displaying information in cross-screen collaboration, applied to a second device that has established a screen projection connection with a first device, characterized in that: include: A third receiving module is configured to receive, through the screen projection connection, an opening control signal and coordinate information of the opening control signal located in the first display frame and send the information to the second device; The first display frame is a display frame that displays a logo in the first device; A second determination module is configured to determine an identifier corresponding to the opening control signal according to the coordinate information; A third determination module is configured to determine an open page in response to an open control signal for at least one identifier; the open page is a single-level page or a multi-level page, and when the open page is a multi-level page, the open page includes the content of each level page in the multi-level page; A third sending module is configured to send the open page to the first device through the screen projection connection; The third determination module is configured to determine the opening page in response to the opening control signal for different identifiers when the number of the at least one identifier is greater than 1.

14. The device according to claim 13, characterized in that a fourth receiving module, configured to receive, through the screen projection connection, a display control signal for a display page located in a second display frame of the first device; A fourth determining module is configured to determine a response page corresponding to the display control signal; The fourth display module is configured to display the response page.

15. A device for displaying information in cross-screen collaboration, characterized in that: include: processor; memory for storing processor executable instructions; The processor is configured to execute executable instructions in the memory to implement the method described in any one of claims 1 to 5 or the steps of the method described in any one of claims 6 to 7.

16. A non-transitory computer-readable storage medium having executable instructions stored thereon, characterized in that: When the executable instruction is executed by a processor, the method described in any one of claims 1 to 5 or the steps of the method described in any one of claims 6 to 7 are implemented.

Images