Display method applied to folding screen equipment, related device and storage medium
By implementing multi-person sharing function on folding screen devices, using the advantages of dual screens to display different interfaces of cloud applications on two screens, solving the problem of mismatch between the screen ratio and the screen display ratio of the folding screen device, and improving screen utilization and display effect.
Patent Information
- Application Number
- CN202311268197.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-26
- Publication Date
- 2025-03-28
AI Technical Summary
The screen ratio of the folding screen device does not match the screen display ratio of most games and videos, resulting in low screen utilization and poor display effect.
By implementing multi-person sharing function on folding screen devices, taking advantage of the dual-screen advantages, different interfaces of cloud applications are displayed on two screens respectively, maintaining a common screen display ratio.
Improve the screen utilization and display effect of folding screen devices, and enhance the diversity and user experience of the device.
Smart Images

Figure CN119718233A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the fields of cloud technology and electronic technology, and in particular to a display method, related apparatus and storage medium applied to a folding screen device. Background Art
[0002] With the continuous advancement of science and technology, the form and function of electronic devices are constantly changing and upgrading, and more and more electronic devices with display screens are used in people's daily life and work. Among them, large-screen electronic devices are favored by consumers because of their better display effect, more convenient operation, and better reading experience.
[0003] At present, foldable screens have become a direction for device manufacturers to focus on, mainly because foldable screen technology represents a new form of screen that can bring a richer user experience. Foldable screen devices can provide larger screen space on smaller devices, thereby providing more innovative interaction methods.
[0004] The inventors have found that the current solution has at least the following problems: the screen ratio of the folding screen device is about 1:1, while the screen display ratio used by most games, videos, etc. is about 16:9. Therefore, the screen of the folding screen device cannot be fully utilized, resulting in low screen utilization of the folding screen device and poor display effect. No effective solution has been proposed for the above problems. Summary of the invention
[0005] The embodiments of the present application provide a display method, related device and storage medium applied to a folding screen device, which can realize the advantage of multi-person sharing of the folding screen and improve the diversity of use of the folding screen device. On the other hand, it can make better use of the screen and ensure the display effect.
[0006] In view of this, the present application provides, on one hand, a display method applied to a folding screen device, wherein the folding screen device includes a folding screen, and the folding screen can be folded to form at least two screens, wherein the at least two screens include a first screen and a second screen, and the method of the present application includes:
[0007] In response to a start-up operation on the cloud application, a first interface of the cloud application is displayed on the first screen, and a second interface of the cloud application is displayed on the second screen, wherein the first interface is used to present a screen corresponding to the first account, and the second interface is used to present a screen corresponding to the second account;
[0008] Based on the first video stream sent by the cloud application server, displaying a picture corresponding to the first video stream on the first interface, wherein the first video stream is generated by the cloud application server according to the first operation instruction stream, and the first operation instruction stream is an operation instruction stream triggered by the first account;
[0009] Based on the second video stream sent by the cloud application server, the picture corresponding to the second video stream is displayed on the second interface, wherein the second video stream is generated by the cloud application server according to the second operation instruction stream, and the second operation instruction stream is an operation instruction stream triggered by the second account.
[0010] On the other hand, the present application provides a display device applied to a folding screen device, the folding screen device includes a folding screen, the folding screen can be folded to form at least two screens, the at least two screens include a first screen and a second screen, and the display device applied to the folding screen device includes:
[0011] A display module, configured to display a first interface of the cloud application on the first screen and a second interface of the cloud application on the second screen in response to a startup operation on the cloud application, wherein the first interface is used to present a screen corresponding to the first account and the second interface is used to present a screen corresponding to the second account;
[0012] The display module is further used to display a picture corresponding to the first video stream on the first interface based on the first video stream sent by the cloud application server, wherein the first video stream is generated by the cloud application server according to the first operation instruction stream, and the first operation instruction stream is an operation instruction stream triggered by the first account;
[0013] The display module is also used to display the picture corresponding to the second video stream on the second interface based on the second video stream sent by the cloud application server, wherein the second video stream is generated by the cloud application server according to the second operation instruction stream, and the second operation instruction stream is an operation instruction stream triggered by the second account.
[0014] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0015] A display module, specifically configured to display a first login interface on a first screen and a second login interface on a second screen in response to a startup operation on a cloud application;
[0016] In response to a first login operation on the first login interface, displaying a first interface of the cloud application on the first screen, wherein the first login operation is used to log in using the first account;
[0017] In response to a second login operation on the second login interface, a second interface of the cloud application is displayed on the second screen, wherein the second login operation is used to log in using the second account.
[0018] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0019] A display module, specifically configured to display a login interface on an outer screen or an inner screen of the folding screen device in response to a startup operation for a cloud application when the folding screen is detected to be in a fully folded state, wherein the inner screen is the first screen or the second screen;
[0020] In response to a login operation on the login interface, when it is detected that the folding screen is in an unfolded state or a stand state, a first interface of the cloud application is displayed on the first screen, and a second interface of the cloud application is displayed on the second screen, wherein the login operation is used to log in using the first account and the second account respectively, and the unfolded state includes a fully unfolded state.
[0021] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0022] The display module is specifically configured to respond to a startup operation for the cloud application, and if it is detected that the folding screen device is successfully matched with at least two game controllers, display a first login interface on the first screen, and display a second login interface on the second screen;
[0023] In response to a first login operation for the first login interface, displaying a first interface of the cloud application on the first screen, wherein the first login operation is for logging in using a first account, the first account is paired with a first game controller, and the at least two game controllers include the first game controller;
[0024] In response to a second login operation for the second login interface, a second interface of the cloud application is displayed on the second screen, wherein the second login operation is used to log in using a second account, the second account has a pairing relationship with the second game controller, and the at least two game controllers include the second game controller.
[0025] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0026] A display module, specifically configured to display device identification information of the first game controller on the first login interface in response to a key operation triggered by the first game controller;
[0027] In response to a first login operation for the first login interface, matching the first account with the device identification information of the first game controller, and displaying the first interface of the cloud application on the first screen;
[0028] A display module, specifically configured to display device identification information of the second game controller on the second login interface in response to a key operation triggered by the second game controller;
[0029] In response to a second login operation for the second login interface, the second account is matched with the device identification information of the second game controller, and a second interface of the cloud application is displayed on the second screen.
[0030] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0031] The display module is specifically configured to display a login interface on an outer screen or an inner screen of the folding screen device in response to a startup operation for a cloud application when it is detected that the folding screen is in a fully folded state and the folding screen device is successfully matched with at least two game controllers, wherein the inner screen is the first screen or the second screen;
[0032] In response to a login operation on the login interface, when it is detected that the folding screen is in an unfolded state or a stand state, a first interface of the cloud application is displayed on the first screen, and a second interface of the cloud application is displayed on the second screen, wherein the login operation is used to log in using a first account and a second account respectively, the first account is paired with a first game controller, the second account is paired with a second game controller, at least two game controllers include a first game controller and a second game controller, and the unfolded state includes a fully unfolded state.
[0033] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0034] The display module is further configured to, in response to a startup operation for the cloud application, display a pairing control if it is detected that the folding screen device is not paired with a game controller when the cloud application supports a split-screen mode;
[0035] The display module is further configured to, in response to a selection operation on the pairing control, display a Bluetooth search list when the folding screen device turns on the Bluetooth function, wherein the Bluetooth search list includes device identification information searched by the folding screen device;
[0036] The display module is also used to display a pairing success message in response to a selection operation on the device identification information of the game controller when the Bluetooth search list includes the device identification information of the game controller, wherein the pairing success message is used to prompt that a communication connection relationship has been established between the game controller and the folding screen device.
[0037] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0038] The display module is further configured to, in response to a startup operation for the cloud application, display a pairing control if it is detected that the folding screen device is not paired with a game controller when the cloud application supports a split-screen mode;
[0039] The display module is also used to respond to a selection operation on the pairing control and display a pairing success message when the game controller and the folding screen device establish a communication connection via a data cable.
[0040] In one possible design, in another implementation of another aspect of the embodiment of the present application, the cloud application is a cloud gaming application, and the first account and the second account are different accounts belonging to the same game match in the cloud gaming application;
[0041] A display module, specifically configured to display a first virtual object in a first virtual scene on a first interface, wherein the first virtual object is a virtual object controlled by a first account;
[0042] In response to a first operation instruction for a first virtual object, sending the first operation instruction to a cloud application server so that the cloud application server renders the first virtual scene from the perspective of the first virtual object to obtain a first video frame, wherein the first operation instruction stream includes the first operation instruction, and the first video stream includes the first video frame;
[0043] Based on the first video frame sent by the cloud application server, displaying a picture corresponding to the first video frame on a first interface provided by a first screen;
[0044] A display module, specifically configured to display a second virtual object in a second virtual scene on a second interface, wherein the second virtual object is a virtual object controlled by a second account;
[0045] In response to a second operation instruction for the second virtual object, sending the second operation instruction to the cloud application server so that the cloud application server renders the second virtual scene from the perspective of the second virtual object to obtain a second video frame, wherein the second operation instruction stream includes the second operation instruction, and the second video stream includes the second video frame;
[0046] Based on the second video frame sent by the cloud application server, the picture corresponding to the second video frame is displayed on the second interface provided by the second screen.
[0047] In one possible design, in another implementation of another aspect of the embodiment of the present application, the cloud application is a cloud gaming application, and the first account and the second account are different accounts belonging to the same game match in the cloud gaming application;
[0048] The display module is further used to display a first interface of the cloud application on the first screen, and after displaying a second interface of the cloud application on the second screen, display a battle invitation message on the first interface, wherein the battle invitation message is used to prompt whether to initiate a battle invitation request to the second account;
[0049] The display module is further used to display a battle joining message on the second interface in response to a confirmation operation on the battle invitation message, wherein the battle joining message is used to prompt whether to accept the battle invitation request initiated by the first account;
[0050] The display module is further used to respond to a confirmation operation on the battle joining message and display a battle establishment message on the first interface and the second interface respectively, wherein the battle establishment message is used to prompt that the first account and the second account have established a battle relationship.
[0051] In one possible design, in another implementation of another aspect of the embodiment of the present application, the cloud application is a cloud gaming application, and the first account and the second account are different accounts belonging to the same game match in the cloud gaming application;
[0052] The display module is further used to display a first interface of the cloud application on the first screen, and after displaying a second interface of the cloud application on the second screen, when it is detected that the folding screen is in a stand state, display a first battle prompt message on the first interface, and display a second battle prompt message on the second interface, wherein the first battle prompt message is used to prompt the first account whether to join the battle, and the second battle prompt message is used to prompt the second account whether to join the battle;
[0053] The display module is also used to respond to a confirmation operation for the first battle prompt message and to respond to a confirmation operation for the second battle prompt message, and to display a battle establishment message on the first interface and the second interface respectively, wherein the battle establishment message is used to prompt that the first account and the second account have established a battle relationship.
[0054] In one possible design, in another implementation of another aspect of the embodiment of the present application, the cloud application is a cloud gaming application, and the first account and the second account are different accounts belonging to the same game match in the cloud gaming application;
[0055] The display module is further used to display a first interface of the cloud application on the first screen, and after displaying a second interface of the cloud application on the second screen, display a team invitation message on the first interface, wherein the team invitation message is used to prompt whether to initiate a team invitation request to the second account;
[0056] The display module is further used to display a team joining message on the second interface in response to a confirmation operation on the team invitation message, wherein the team joining message is used to prompt whether to accept the team invitation request initiated by the first account;
[0057] The display module is also used to respond to a confirmation operation on the team joining message, and display a team establishment message on the first interface and the second interface respectively, wherein the team establishment message is used to prompt that the first account and the second account have established a team relationship.
[0058] In one possible design, in another implementation of another aspect of the embodiment of the present application, the cloud application is a cloud gaming application, and the first account and the second account are different accounts belonging to the same game match in the cloud gaming application;
[0059] The display module is further used to display a first interface of the cloud application on the first screen, and after displaying a second interface of the cloud application on the second screen, when it is detected that the folding screen is in an unfolded state, display a first team formation prompt message on the first interface, and display a second team formation prompt message on the second interface, wherein the first team formation prompt message is used to prompt the first account whether to join the team, and the second team formation prompt message is used to prompt the second account whether to join the team, and the unfolded state includes a fully unfolded state;
[0060] The display module is also used to respond to the confirmation operation of the first team prompt message and the confirmation operation of the second team prompt message, and display the team establishment message on the first interface and the second interface respectively, wherein the team establishment message is used to prompt that the first account and the second account have established a team relationship.
[0061] In one possible design, in another implementation of another aspect of the embodiment of the present application, the display device applied to the folding screen device further includes a rotating module;
[0062] The display module is further used to display a first perspective switching control on the first interface;
[0063] A rotation module, configured to rotate the first interface 180 degrees clockwise, or 180 degrees counterclockwise, in response to an interactive operation on the first perspective switching control;
[0064] The display module is further used to display the second viewing angle switching control on the second interface;
[0065] The rotation module is also used to rotate the second interface 180 degrees clockwise, or 180 degrees counterclockwise, in response to an interactive operation on the second perspective switching control.
[0066] In one possible design, in another implementation of another aspect of the embodiment of the present application, the display device applied to the folding screen device further includes a setting module;
[0067] The display module is further used to display a login interface in response to a startup operation for the cloud application;
[0068] A setting module, configured to respond to a login operation on the login interface and set the first account or the second account as a primary account;
[0069] The display module is further configured to display a prompt message on the first interface if the first account is the primary account and the message prompt condition is met;
[0070] The display module is also used to display a prompt message on the second interface if the second account is the main account and the message prompt condition is met.
[0071] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0072] A display module, specifically configured to display an incoming call prompt message on the first interface when the folding screen device receives an incoming call if the first account is a primary account;
[0073] The display module is specifically used to display an incoming call prompt message on the second interface when the folding screen device receives an incoming call if the second account is the main account.
[0074] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0075] a display module, specifically configured to display the conversation message in a first window presented on the first interface when the folding screen device receives the conversation message if the first account is the primary account, wherein the first window supports replying to the conversation message;
[0076] The display module is specifically used to display the conversation message in a second window presented on the second interface when the folding screen device receives the conversation message if the second account is the main account, wherein the second window supports replying to the conversation message.
[0077] In one possible design, in another implementation of another aspect of the embodiment of the present application, the display device applied to the folding screen device further includes a sending module;
[0078] The display module is further used to display the first device switching control on the first interface;
[0079] a sending module, configured to send a first device switching request to a cloud application server in response to an interactive operation on a first device switching control, wherein the first device switching request is used to request the cloud application server to send a first video stream to a first terminal so that the first terminal displays a picture corresponding to the first video stream, and the first terminal has a binding relationship with the first account;
[0080] The display module is further used to display the second device switching control on the second interface;
[0081] The sending module is also used to send a second device switching request to the cloud application server in response to an interactive operation on the second device switching control, wherein the second device switching request is used to request the cloud application server to send a second video stream to the second terminal so that the second terminal displays the picture corresponding to the second video stream, and the second terminal has a binding relationship with the second account.
[0082] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0083] The display module is further used to display a first sub-interface and a second sub-interface of the cloud application on the first screen in response to an account joining operation for the cloud application, and to display a third sub-interface and a fourth sub-interface of the cloud application on the second screen, wherein different sub-interfaces are used to present screens corresponding to different accounts;
[0084] The display module is further used to display the screen corresponding to the first merged video stream on the first sub-interface and the second sub-interface based on the first merged video stream sent by the cloud application server, wherein the first merged video stream is generated by the cloud application server according to the operation instruction stream triggered by different accounts;
[0085] The display module is also used to display the pictures corresponding to the second merged video stream on the third sub-interface and the fourth sub-interface based on the second merged video stream sent by the cloud application server, wherein the second merged video stream is generated by the cloud application server according to the operation instruction stream triggered by different accounts.
[0086] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0087] The display module is also used to display the picture corresponding to the merged video stream on the outer screen or inner screen of the folding screen device when it is detected that the folding screen is in a fully folded state, wherein the merged video stream is obtained by the cloud application server after merging the first video stream and the second video stream, and the inner screen is the first screen or the second screen.
[0088] In one possible design, in another implementation of another aspect of the embodiment of the present application,
[0089] The display module is further used to display a status prompt pop-up window on the outer screen or inner screen of the folding screen device after displaying the picture corresponding to the merged video stream on the outer screen or inner screen of the folding screen device, wherein the status prompt pop-up window is used to prompt the folding screen device to be adjusted to the unfolded state or the bracket state;
[0090] The display module is also used to display the picture corresponding to the first video stream on the first interface and display the picture corresponding to the second video stream on the second interface when it is detected that the folding screen is in the unfolded state or the bracket state.
[0091] On the other hand, the present application provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the above-mentioned methods when executing the computer program.
[0092] Another aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the above-mentioned methods are implemented.
[0093] Another aspect of the present application provides a computer program product, including a computer program, which implements the above-mentioned methods when executed by a processor.
[0094] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:
[0095] In an embodiment of the present application, a display method applied to a folding screen device is provided. Specifically, first, the folding screen device displays the first interface of the cloud application on the first screen and displays the second interface of the cloud application on the second screen in response to the startup operation for the cloud application. Based on this, based on the first video stream sent by the cloud application server, the picture corresponding to the first video stream is displayed on the first interface, and based on the second video stream sent by the cloud application server, the picture corresponding to the second video stream is displayed on the second interface. Through the above-mentioned method, the dual-screen advantage of the folding screen device is fully utilized, and combined with the characteristics of the cloud application, the folding screen is used as a carrier of multi-person applications, so that different screens can distinguish and load different pictures of the cloud application. As a result, on the one hand, the multi-person sharing advantage of the folding screen can be realized, and the use diversity of the folding screen device can be improved. On the other hand, for each screen of the folding screen device, a common screen display ratio is still used, so the screen can be better utilized to ensure the display effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0096] Figure 1 This is a schematic diagram of a scenario in which a cloud gaming application is run based on a foldable screen device in an embodiment of the present application;
[0097] Figure 2 This is a schematic diagram of a scenario in which a cloud social application is run on a foldable screen device in an embodiment of the present application;
[0098] Figure 3 This is a schematic diagram of a scenario in which a cloud conference application is run based on a foldable screen device in an embodiment of the present application;
[0099] Figure 4 A schematic diagram of an implementation environment of a display method applied to a folding screen device in an embodiment of the present application;
[0100] Figure 5 This is a structural schematic diagram of a folding screen device in an embodiment of the present application;
[0101] Figure 6 A schematic diagram of a flow chart of a display method applied to a folding screen device in an embodiment of the present application;
[0102] Figure 7 This is a schematic diagram of an interface for account login based on the login interface in an embodiment of the present application;
[0103] Figure 8This is another interface schematic diagram for performing account login based on the login interface in an embodiment of the present application;
[0104] Fig. 9 This is another interface schematic diagram for performing account login based on the login interface in an embodiment of the present application;
[0105] Fig.10 A schematic diagram of matching a game controller and an account in an embodiment of the present application;
[0106] Fig.11 This is another interface schematic diagram for performing account login based on the login interface in an embodiment of the present application;
[0107] Fig.12 This is a schematic diagram of connecting a folding screen device and a game controller based on Bluetooth in an embodiment of the present application;
[0108] Fig.13 This is a schematic diagram of connecting a folding screen device and a game controller based on a data cable in an embodiment of the present application;
[0109] Fig.14 A schematic diagram of establishing a battle relationship between a first account and a second account in an embodiment of the present application;
[0110] Fig.15 Another schematic diagram of establishing a battle relationship between a first account and a second account in an embodiment of the present application;
[0111] Fig.16 A schematic diagram of establishing a team relationship between a first account and a second account in an embodiment of the present application;
[0112] Fig.17 Another schematic diagram of establishing a team relationship between a first account and a second account in an embodiment of the present application;
[0113] Fig.18 A schematic diagram of switching interface perspectives in an embodiment of the present application;
[0114] Fig.19 A schematic diagram of setting a primary account in an embodiment of the present application;
[0115] Fig. 20 A schematic diagram of displaying an incoming call reminder message based on a primary account in an embodiment of the present application;
[0116] Fig.21 A schematic diagram of displaying conversation messages based on a primary account in an embodiment of the present application;
[0117] Fig. 22 A schematic diagram of migrating a video stream in an embodiment of the present application;
[0118] Fig.23A schematic diagram of supporting split-screen display within the same screen in an embodiment of the present application;
[0119] Fig.24 A schematic diagram of supporting merged screen display in an embodiment of the present application;
[0120] Fig.25 A schematic diagram of performing split-screen prompts in an embodiment of the present application;
[0121] Fig.26 It is a schematic diagram of an overall process of a display method applied to a folding screen device in an embodiment of the present application;
[0122] Fig. 27 A schematic diagram of a display device applied to a folding screen device in an embodiment of the present application;
[0123] Fig.28 It is a structural schematic diagram of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION
[0124] The embodiments of the present application provide a display method, related device and storage medium applied to a folding screen device, which can realize the advantage of multi-person sharing of the folding screen and improve the diversity of use of the folding screen device. On the other hand, it can make better use of the screen and ensure the display effect.
[0125] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "corresponding to" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0126] With the continuous development of electronic devices and display screens, as well as the improvement of people's living needs, electronic devices with foldable screens have emerged, allowing users to fold or unfold the display screen to meet users' needs for different screen sizes. However, in many cases, the screen display ratio of the application does not match the screen display ratio supported by the foldable screen device, which results in black edges on the edges of the foldable screen device when displaying the application screen, and the large screen of the foldable screen cannot be fully utilized.
[0127] Based on this, in the embodiment of the present application, a display method applied to a folding screen device is provided, which can take advantage of the dual-screen advantage of the folding screen, use the folding screen as a carrier of cloud applications, load different screens of cloud applications on different screens, and still use a common screen display ratio for single-screen games without black edges. In this way, the advantages of the folding screen can be fully utilized, and the folding screen can be shared by multiple people, thereby enhancing the closeness of multi-person cooperation. The display method applied to a folding screen device provided in the present application includes at least one of the following scenarios when applied.
[0128] Applicable scenario 1: cloud gaming application;
[0129] For example, taking the cloud application as a cloud gaming application, for ease of understanding, please refer to Figure 1 , Figure 1 This is a schematic diagram of a scenario in which a cloud gaming application is run on a foldable screen device in an embodiment of the present application. Figure 1 The middle (A) figure shows the first screen of the foldable screen device. Figure 1 The figure (B) shows the second screen of the folding screen device. At this time, the folding screen is in the stand state. Player A and player B join the same game. Player A can control the first virtual object in the game by means of handle A or touch screen, and watch the picture rendered by the first video stream pushed by the cloud game server on the first screen. Player B can control the second virtual object in the game by means of handle B or touch screen, and watch the picture rendered by the second video stream pushed by the cloud game server on the second screen.
[0130] Cloud gaming, also known as gaming on demand, is an online gaming technology based on cloud computing technology. Cloud gaming technology enables thin clients with relatively limited graphics processing and data computing capabilities to run high-quality games. In a cloud gaming scenario, the game is not played on the player's game terminal, but on a cloud server, which renders the game scene into a video and audio stream and transmits it to the player's game terminal over the network. The player's game terminal does not need to have powerful graphics computing and data processing capabilities, but only needs to have basic streaming media playback capabilities and the ability to obtain player input commands and send them to the cloud server.
[0131] Applicable scenario 2: cloud communication application;
[0132] For example, the cloud application is a cloud communication application. For ease of understanding, please refer to Figure 2 , Figure 2 This is a schematic diagram of a scenario in which a cloud social application is run on a foldable screen device in an embodiment of the present application. Figure 2 The middle (A) figure shows the first screen of the foldable screen device. Figure 2 The figure (B) shows the second screen of the folding screen device, at this time, the folding screen is in the stand state. After user A logs in to his social account, he inputs the conversation content through keyboard A or touch screen. As a result, user A can view the conversation screen rendered by the first video stream pushed by the cloud communication server on the first screen. Similarly, after user B logs in to his social account, he inputs the conversation content through keyboard B or touch screen. As a result, user B can view the conversation screen rendered by the second video stream pushed by the cloud communication server on the second screen. Among them, the way to log in to a social account includes but is not limited to entering an account and password, or using another terminal to scan a code, etc.
[0133] The principle of cloud communication is to use light-end devices running in a web browser, or to install light-weight smart clients to replace traditional software, and to use remote background servers to transmit communication data. Cloud communication applications are not only completely comparable to traditional communication software in terms of functionality, but also have the following characteristics: First, cross-platform, that is, with the cross-platform characteristics of web technology, cloud communication applications based on this can naturally obtain this characteristic. Second, ease of use, popularization, that is, without the tedious downloading, installation and endless upgrading of traditional software, the upgrade of cloud communication applications is as simple as refreshing the web browser. Third, lightweight and green, that is, cloud communication provides a lightweight usage environment.
[0134] Applicable scenario three: cloud conference application;
[0135] For example, the cloud application is a cloud conference application. For ease of understanding, please refer to Figure 3 , Figure 3 This is a schematic diagram of a scenario in which a cloud conference application is run on a folding screen device in an embodiment of the present application. Figure 3 The middle (A) figure shows the first screen of the foldable screen device. Figure 3 The figure (B) shows the second screen of the folding screen device, at this time, the folding screen is in the stand state. After user A logs in to his conference account, he can enter the corresponding conference and watch the conference screen rendered by the first video stream pushed by the cloud conference server on the first screen. After user B logs in to his conference account, he can enter the corresponding conference and watch the conference screen rendered by the second video stream pushed by the cloud conference server on the second screen. In order to avoid mutual interference between users, user A can use earphone A to listen to the conference content and input voice content, while user B uses earphone B to listen to the conference content and input voice content.
[0136] Cloud conferencing is an efficient, convenient and low-cost conferencing format based on cloud computing technology. Users only need to use the Internet interface and perform simple and easy-to-use operations to quickly and efficiently share voice, data files and videos with teams and customers around the world. Cloud conferencing service providers help users operate complex technologies such as data transmission and processing in meetings. At present, domestic cloud conferencing mainly focuses on service content based on the software as a service (SaaS) model, including telephone, network, video and other service forms. Video conferencing based on cloud computing is called cloud conferencing.
[0137] In the era of cloud conferencing, data transmission, processing, and storage are all handled by the computer resources of video conferencing manufacturers. Users no longer need to purchase expensive hardware or install cumbersome software. They only need to open a browser and log in to the corresponding interface to conduct efficient remote meetings.
[0138] The cloud conference system supports dynamic cluster deployment of multiple servers and provides multiple high-performance servers, which greatly improves the stability, security and availability of conferences. In recent years, video conferencing has been welcomed by many users and widely used in various fields because it can greatly improve communication efficiency, continuously reduce communication costs, and upgrade internal management levels. There is no doubt that after using cloud computing, video conferencing has a stronger appeal in terms of convenience, speed and ease of use, which will surely stimulate the arrival of a new wave of video conferencing applications.
[0139] It should be noted that the above application scenarios are only examples. The display method for folding screen devices provided in this application can also be applied to various scenarios, including but not limited to cloud technology, artificial intelligence (AI), smart transportation, assisted driving, etc., which are not limited here.
[0140] The method provided in this application can be applied to Figure 4 The implementation environment shown in the figure includes a terminal 110 and a server 120, and the terminal 110 and the server 120 can communicate with each other through a communication network 130. The communication network 130 uses standard communication technology and / or protocols, usually the Internet, but can also be any network, including but not limited to Bluetooth, local area network (LAN), metropolitan area network (MAN), wide area network (WAN), mobile, dedicated network or any combination of virtual private networks. In some embodiments, customized or dedicated data communication technology can be used to replace or supplement the above data communication technology.
[0141] The terminal 110 involved in this application includes but is not limited to mobile phones, tablet computers, laptop computers, desktop computers, intelligent voice interaction devices, virtual reality devices, smart home appliances, vehicle terminals, aircraft, etc. Among them, the client is deployed on the terminal 110, and the client can be run on the terminal 110 in the form of a browser or in the form of an independent application (APP).
[0142] The server 120 involved in the present application can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), as well as big data and AI platforms.
[0143] In combination with the above implementation environment, in step A1, the user triggers the startup operation of the cloud application through the terminal 110, and the terminal 110 sends a startup instruction to the server 120 through the communication network 130, so that the server 120 starts to push the stream to the terminal 110. In step A2, user A triggers the first operation instruction stream through the first account. In step A3, user B triggers the second operation instruction stream through the second account. In step A4, the terminal 110 pushes the first operation instruction stream and the second operation instruction stream to the server 120, so that the server 120 generates the first video stream based on the first operation instruction stream and generates the second video stream based on the second operation instruction stream. In step A5, the server 120 pushes the first video stream and the second video stream to the terminal 110 through the communication network 130. In step A6, the terminal 110 displays the picture corresponding to the first video stream through the first screen. In step A7, the terminal 110 displays the picture corresponding to the second video stream through the second screen.
[0144] For example, the terminal 110 may be a folding screen device. Figure 5 , Figure 5 This is a structural diagram of a folding screen device in an embodiment of the present application. Figure 5Figure (A) shows the inner side schematic diagram of the folding screen device in the fully unfolded state of the inner screen, wherein the inner screen of the folding screen device includes a first screen 210 and a second screen 220. When the angle between the first screen 210 and the second screen 220 is 0 degrees, the folding screen is in a fully folded state of folding inward (that is, the first screen 210 and the second screen 220 are folded relative to each other). When the angle between the first screen 210 and the second screen 220 is 180 degrees, the folding screen is in a fully unfolded state. When the angle between the first screen 210 and the second screen 220 is 360 degrees, the folding screen is in a fully folded state of folding outward (that is, the first screen 210 and the second screen 220 are folded away from each other). When the angle between the first screen 210 and the second screen 220 is greater than 0 degrees and less than 180 degrees, the folding screen is in a semi-folded state, or it can also be called a semi-unfolded state. When the angle between the first screen 210 and the second screen 220 is greater than 180 degrees and less than 360 degrees, the folding screen is in a bracket state.
[0145] Figure 5 Figure (B) shows the outer side of the folding screen device when the inner screen is fully unfolded, wherein the folding screen device includes a housing 230 and an outer screen 240. It should be noted that, in actual situations, 230 can also be used to indicate the outer screen, or 240 can also be used to indicate the housing. The figure is only a schematic diagram and should not be understood as a limitation on the present application.
[0146] In combination with the above introduction, the display method applied to the folding screen device in this application will be introduced below. Figure 6 The display method for a folding screen device provided in the embodiment of the present application can be completed independently by a terminal (i.e., a folding screen device) or by a terminal and a server. The folding screen device includes a folding screen, which can be folded to form at least two screens, including a first screen and a second screen. The method of the present application includes:
[0147] 310. In response to a start-up operation for a cloud application, display a first interface of the cloud application on a first screen, and display a second interface of the cloud application on a second screen, wherein the first interface is used to present a screen corresponding to the first account, and the second interface is used to present a screen corresponding to the second account;
[0148] In one or more embodiments, a user triggers a startup operation for a cloud application through a folding screen device, whereupon a first interface of the cloud application is displayed on a first screen of the folding screen device, and the first interface is used to present a screen corresponding to a first account. At the same time, a second interface of the cloud application is displayed on a second screen of the folding screen device, and the second interface is used to present a screen corresponding to a second account. Cloud applications refer to hardware, software and other applications provided to users by cloud service providers through virtual technology in a network transmission and interaction mode. The working principle of cloud applications is to change the traditional software usage mode of "local installation, local computing" into a "ready-to-use" service.
[0149] It should be noted that the term "in response to" in this application is used to indicate the conditions or states on which the execution of an operation depends, and one or more operations can be executed when certain conditions or states are met. These operations can be real-time or have a certain delay.
[0150] 320. Based on the first video stream sent by the cloud application server, display a picture corresponding to the first video stream on the first interface, wherein the first video stream is generated by the cloud application server according to the first operation instruction stream, and the first operation instruction stream is an operation instruction stream triggered by the first account;
[0151] In one or more embodiments, the cloud application server pushes two groups of video streams to the folding screen device at the same time. At this time, a screen corresponding to a group of video streams is played on the first interface provided by the first screen. Among them, the group of video streams is a video stream pushed for the first account, based on which the user (for example, user A) can view the corresponding screen through the first interface and perform operations. That is, the user (for example, user A) triggers one or more continuous operation instructions through the logged-in first account, thereby generating a corresponding first operation instruction stream.
[0152] Specifically, the first interface is an interface for logging in with the first account. Based on this, the folding screen device can determine the carrier of the first interface logged in with the first account as the first screen. The user who logs in to the first account can operate (for example, click, swipe, long press, etc.) on the first interface provided on the first screen to trigger the corresponding first operation instruction. Thus, the first operation instruction stream is generated according to the triggering sequence of the first operation instruction. Then, the folding screen device sends the first operation instruction stream to the cloud application server, wherein the first operation instruction stream includes at least one first operation instruction, and each first operation instruction may carry the account identification of the first account. The cloud application server generates a first video stream corresponding to the first account according to the first operation instruction stream, and continuously pushes the first video stream to the folding screen device, wherein the first video stream carries the account identification of the first account. As a result, the folding screen device continuously plays the screen corresponding to the first video stream on the first interface provided by the first screen according to the account identification of the first account.
[0153] 330. Based on the second video stream sent by the cloud application server, the picture corresponding to the second video stream is displayed on the second interface, wherein the second video stream is generated by the cloud application server according to the second operation instruction stream, and the second operation instruction stream is an operation instruction stream triggered by the second account.
[0154] In one or more embodiments, the cloud application server pushes two sets of video streams to the folding screen device at the same time. At this time, the screen corresponding to the other set of video streams is played on the second interface provided by the second screen. Among them, this set of video streams is a video stream pushed for the second account. Based on this, the user (for example, user B) can view the corresponding screen through the second interface and perform operations. That is, the user (for example, user B) triggers one or more continuous operation instructions through the logged-in second account, thereby generating a corresponding second operation instruction stream.
[0155] Specifically, the first interface is an interface for logging in with the first account. Based on this, the folding screen device can determine the carrier of the first interface logged in with the first account as the first screen. The user who logs in to the first account can operate (for example, click, swipe, long press, etc.) on the first interface provided on the first screen to trigger the corresponding first operation instruction. Thus, the first operation instruction stream is generated according to the triggering sequence of the first operation instruction. Then, the folding screen device sends a second operation instruction stream to the cloud application server, wherein the second operation instruction stream includes at least one second operation instruction, and each second operation instruction may carry the account identification of the second account. The cloud application server generates a second video stream corresponding to the second account according to the second operation instruction stream, and continuously pushes the second video stream to the folding screen device, wherein the second video stream carries the account identification of the second account. As a result, the folding screen device continuously plays the screen corresponding to the second video stream on the second interface provided by the second screen according to the account identification of the second account.
[0156] In an embodiment of the present application, a display method for a folding screen device is provided. Through the above method, the dual-screen advantage of the folding screen device is fully utilized, and combined with the characteristics of the cloud application, the folding screen is used as a carrier of multi-person applications, so that different screens can distinguish and load different screens of the cloud application. As a result, on the one hand, the multi-person sharing advantage of the folding screen can be realized, and the diversity of use of the folding screen device can be improved. On the other hand, for each screen of the folding screen device, a common screen display ratio is still used, so the screen can be better utilized to ensure the display effect.
[0157] Optionally, in the above Figure 6On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, in response to a startup operation for a cloud application, displaying a first interface of the cloud application on a first screen and displaying a second interface of the cloud application on a second screen may specifically include:
[0158] In response to a start-up operation for the cloud application, displaying a first login interface on the first screen, and displaying a second login interface on the second screen;
[0159] In response to a first login operation on the first login interface, displaying a first interface of the cloud application on the first screen, wherein the first login operation is used to log in using the first account;
[0160] In response to a second login operation on the second login interface, a second interface of the cloud application is displayed on the second screen, wherein the second login operation is used to log in using the second account.
[0161] In one or more embodiments, a method for associating a user account is introduced. It can be seen from the above embodiments that the start-up operation of the cloud application can be triggered when the folding screen is in a fully folded state, an unfolded state (including a fully unfolded state and a semi-expanded state) or a stand state. The following will take the folding screen in a fully unfolded state as an example for introduction.
[0162] Specifically, for ease of understanding, see Figure 7 , Figure 7 This is a schematic diagram of an interface for performing account login based on the login interface in an embodiment of the present application. Figure 7 The diagram (A) shows the cloud application platform interface. B1 is used to indicate the first screen, B2 is used to indicate the second screen, and B11 is used to indicate a cloud application provided on the cloud application platform interface. When the user clicks on the cloud application indicated by B11, the start operation for the cloud application is triggered. Thus, the display is as follows Figure 7 The interface shown in Figure (B), where B3 is used to indicate the first login interface and B4 is used to indicate the second login interface.
[0163] The user (for example, user A) enters the first account (for example, "Tim123") in the account control indicated by B31, and enters the corresponding password in the password control indicated by B32. After completion, click the login control indicated by B33 to trigger the first login operation for the first login interface. Based on this, after the first account and password are successfully verified, the Figure 7 The interface shown in the middle (C) figure, that is, the first interface indicated by display B5.
[0164] The user (e.g., user B) enters the second account (e.g., "Jack999") in the account control indicated by B41, and enters the corresponding password in the password control indicated by B42. After completion, click the login control indicated by B43 to trigger the second login operation for the second login interface. Based on this, after the second account and password are successfully verified, the Figure 7 The interface shown in the middle (C) figure, that is, the second interface indicated by display B6.
[0165] Secondly, in the embodiment of the present application, a method for associating users' accounts is provided. In the above method, when the folding screen is in the unfolded state or the stand state, the user can perform account login operations on the login interfaces provided by different screens respectively. In this way, the content displayed on the interface is bound to the user's account, so that the operations of different users can be distinguished, and the effect of dual-screen multi-person application can be achieved.
[0166] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, in response to a startup operation for a cloud application, displaying a first interface of the cloud application on a first screen and displaying a second interface of the cloud application on a second screen may specifically include:
[0167] When it is detected that the folding screen is in a fully folded state, in response to a startup operation for a cloud application, a login interface is displayed on an outer screen or an inner screen of the folding screen device, wherein the inner screen is the first screen or the second screen;
[0168] In response to a login operation on the login interface, when it is detected that the folding screen is in an unfolded state or a stand state, a first interface of the cloud application is displayed on the first screen, and a second interface of the cloud application is displayed on the second screen, wherein the login operation is used to log in using the first account and the second account respectively, and the unfolded state includes a fully unfolded state.
[0169] In one or more embodiments, another way of associating users with accounts is introduced. It can be seen from the aforementioned embodiments that when the folding screen is in a fully folded state (for example, a fully folded state of folding inward or a fully folded state of folding outward), the startup operation of the cloud application can be triggered. If it is in a fully folded state of folding inward, the login interface is displayed on the outer screen. If it is in a fully folded state of folding outward, the login interface is displayed on the first screen or the second screen. The following will take the folding screen in the fully folded state of folding inward as an example for introduction.
[0170] Specifically, for ease of understanding, see Figure 8 , Figure 8 This is another interface diagram for performing account login based on the login interface in an embodiment of the present application. Figure 8The diagram (A) shows the cloud application platform interface. C1 is used to indicate the external screen, and C11 is used to indicate a cloud application provided on the cloud application platform interface. When the user clicks on the cloud application indicated by C11, the start operation for the cloud application is triggered. Thus, the display is as follows Figure 8 The interface shown in Figure (B), where C2 is used to indicate the login interface.
[0171] The user (e.g., user A) enters the first account (e.g., "Tim123") in the account control indicated by C21, and enters the corresponding password in the password control indicated by C22. The user (e.g., user B) enters the second account (e.g., "Jack999") in the account control indicated by C23, and enters the corresponding password in the password control indicated by C24. After completion, click the login control indicated by C25 to trigger the login operation for the login interface. Based on this, if the first account and password are successfully verified, and the second account and password are also successfully verified, the display Figure 8 The interface shown in the middle (C) figure shows the first interface indicated by C3 and the second interface indicated by C4.
[0172] Secondly, in the embodiment of the present application, another method of associating users' accounts is provided. In the above method, when the folding screen is in a fully folded state, different users can log in to their accounts on the login interface provided by the same screen. Thus, the content displayed on the interface is bound to the user's account, so that the operations of different users can be distinguished, and the effect of dual-screen multi-person application can be achieved.
[0173] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, in response to a startup operation for a cloud application, displaying a first interface of the cloud application on a first screen and displaying a second interface of the cloud application on a second screen may specifically include:
[0174] In response to a startup operation for a cloud application, if it is detected that the foldable screen device is successfully matched with at least two game controllers, a first login interface is displayed on the first screen, and a second login interface is displayed on the second screen;
[0175] In response to a first login operation for the first login interface, displaying a first interface of the cloud application on the first screen, wherein the first login operation is for logging in using a first account, the first account is paired with a first game controller, and the at least two game controllers include the first game controller;
[0176] In response to a second login operation for the second login interface, a second interface of the cloud application is displayed on the second screen, wherein the second login operation is used to log in using a second account, the second account has a pairing relationship with the second game controller, and the at least two game controllers include the second game controller.
[0177] In one or more embodiments, another way of associating users with accounts is introduced. It can be seen from the aforementioned embodiments that the startup operation of the cloud application can be triggered when the folding screen is in a fully folded state, an unfolded state (including a fully unfolded state and a semi-expanded state) or a stand state. At the same time, the folding screen device can also detect whether at least two game controllers have been pre-matched. If so, the account login operation can be performed directly. The following will be introduced as an example of the folding screen being in a fully unfolded state.
[0178] Specifically, for ease of understanding, see Fig. 9 , Fig. 9 This is another interface diagram for performing account login based on the login interface in an embodiment of the present application. Fig. 9 The figure (A) shows the cloud application platform interface. Among them, D1 is used to indicate the first screen, D2 is used to indicate the second screen, and D11 is used to indicate a cloud application provided on the cloud application platform interface. At this time, it is detected that the folding screen device has been matched with two game controllers, namely "Controller A" and "Controller B". When the user clicks on the cloud application indicated by D11, the startup operation for the cloud application is triggered. As a result, the display is as follows Fig. 9 The interface shown in Figure (B), wherein D3 is used to indicate the first login interface and D4 is used to indicate the second login interface.
[0179] For example, it is assumed that "handle A" is the device identification information of the first game handle, and "handle B" is the device identification information of the second game handle. Different device identification information is associated with different accounts.
[0180] The user (for example, user A) enters the first account (for example, "Tim123") in the account control indicated by D31, and enters the corresponding password in the password control indicated by D32. After completion, click the login control indicated by D33 to trigger the first login operation for the first login interface. Based on this, after the first account and password are successfully verified, the Fig. 9 The interface shown in the middle (C) figure is the first interface indicated by D5. At this time, the first account has been paired with the first game controller, and the corresponding operation instruction can be triggered by the first game controller.
[0181] The user (e.g., user B) enters the second account (e.g., "Jack999") in the account control indicated by D41, and enters the corresponding password in the password control indicated by D42. After completion, click the login control indicated by D43 to trigger the second login operation for the second login interface. Based on this, after the second account and password are successfully verified, the Fig. 9 The interface shown in the middle (C) figure is the second interface indicated by D6. At this time, the second account has been paired with the second game controller, and the corresponding operation instruction can be triggered by the second game controller.
[0182] Secondly, in the embodiment of the present application, another method of associating user accounts is provided. Through the above method, when the cloud application supports game controller operation, the account entered by the user can also be automatically associated with the game controller. In this way, the operations performed by different users using the game controller can be distinguished, thereby improving the flexibility and richness of the operation.
[0183] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, in response to a first login operation on a first login interface, displaying a first interface of a cloud application on a first screen may specifically include:
[0184] In response to a key operation triggered by the first game controller, displaying device identification information of the first game controller on the first login interface;
[0185] In response to a first login operation for the first login interface, matching the first account with the device identification information of the first game controller, and displaying the first interface of the cloud application on the first screen;
[0186] In response to the second login operation on the second login interface, displaying the second interface of the cloud application on the second screen may specifically include:
[0187] In response to a key operation triggered by the second game controller, displaying device identification information of the second game controller on the second login interface;
[0188] In response to a second login operation for the second login interface, the second account is matched with the device identification information of the second game controller, and a second interface of the cloud application is displayed on the second screen.
[0189] In one or more embodiments, a method for pairing an account with a game controller is introduced. As can be seen from the above embodiments, when it is detected that the folding screen device is successfully matched with at least two game controllers, the game controller needs to be matched with the user's account.
[0190] Specifically, for ease of understanding, see Fig.10 , Fig.10 A schematic diagram of matching a game controller with an account in an embodiment of the present application is shown in FIG. Fig.10 As shown in Figure (A), E1 is used to indicate the first screen, and E2 is used to indicate the second screen. The user is prompted to use the game controller to perform key operations through the first screen or the second screen. Based on this, user A and user B use different game controllers to perform key operations. Thus, the display is as follows Fig.10 The interface shown in Figure (B), where E3 is used to indicate the first login interface and E4 is used to indicate the second login interface.
[0191] For example, assume that user A uses the first game controller to trigger a key operation, thereby displaying the device identification information of the first game controller (i.e., "Controller A") on the first login interface. Assume that user B uses the second game controller to trigger a key operation, thereby displaying the device identification information of the second game controller (i.e., "Controller B") on the second login interface. Based on this, user A performs the first login operation through the first login interface, and user B performs the first login operation through the second login interface. After the account and password are successfully verified, the display Fig.10 The interface shown in the middle (C) figure shows the first interface indicated by E5 and the second interface indicated by E6.
[0192] Again, in an embodiment of the present application, a method for pairing an account with a game controller is provided. In the above method, after the user clicks a button on the game controller, it indicates that the user will use the game controller for subsequent operations. In this way, the game controller can be directly paired with the user's account, thereby improving the convenience of operation.
[0193] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, in response to a startup operation for a cloud application, displaying a first interface of the cloud application on a first screen and displaying a second interface of the cloud application on a second screen may specifically include:
[0194] When it is detected that the folding screen is in a fully folded state and the folding screen device is successfully matched with at least two game controllers, in response to a startup operation for a cloud application, a login interface is displayed on an outer screen or an inner screen of the folding screen device, wherein the inner screen is the first screen or the second screen;
[0195] In response to a login operation on the login interface, when it is detected that the folding screen is in an unfolded state or a stand state, a first interface of the cloud application is displayed on the first screen, and a second interface of the cloud application is displayed on the second screen, wherein the login operation is used to log in using a first account and a second account respectively, the first account is paired with a first game controller, the second account is paired with a second game controller, at least two game controllers include a first game controller and a second game controller, and the unfolded state includes a fully unfolded state.
[0196] In one or more embodiments, another way of associating users' accounts is introduced. It can be seen from the aforementioned embodiments that when the folding screen is in a fully folded state (for example, a fully folded state of folding inward or a fully folded state of folding outward), the startup operation of the cloud application can be triggered. If it is in a fully folded state of folding inward, the login interface is displayed on the outer screen. If it is in a fully folded state of folding outward, the login interface is displayed on the first screen or the second screen. At the same time, the folding screen device can also detect whether at least two game controllers have been pre-matched. If so, the account login operation can be performed directly. The following will be introduced using the folding screen in the fully folded state of folding inward as an example.
[0197] Specifically, for ease of understanding, see Fig.11 , Fig.11 This is another interface diagram for performing account login based on the login interface in an embodiment of the present application. Fig.11 The figure (A) shows the cloud application platform interface. F1 is used to indicate the external screen, and F11 is used to indicate a cloud application provided on the cloud application platform interface. When the user clicks the cloud application indicated by F11, the startup operation for the cloud application is triggered. As a result, the display is as follows: Fig.11 The interface shown in Figure (B), where F2 is used to indicate the login interface.
[0198] User A first clicks any button on a game controller, then enters the first account (for example, "Tim123") in the account control indicated by F21, and enters the corresponding password in the password control indicated by F22. User B first clicks any button on another game controller, then enters the second account (for example, "Jack999") in the account control indicated by F23, and enters the corresponding password in the password control indicated by F24. After completion, click the login control indicated by F25 to trigger the login operation for the login interface. Based on this, when the first account and password are successfully verified, and the second account and password are also successfully verified, the game controller used by user A (for example, the first game controller) is associated with the first account, and the game controller used by user B (for example, the second game controller) is associated with the second account. Thus, the display Fig.11The interface shown in the middle (C) figure shows the first interface indicated by F3 and the second interface indicated by F4.
[0199] Secondly, in the embodiment of the present application, another method of associating users' accounts is provided. In the above method, when the cloud application supports game controller operation, different users can perform account login operations on the login interface provided by the same screen. Thus, the account entered by the user is automatically associated with the game controller, so that the operations performed by different users using the game controller can be distinguished, thereby improving the flexibility and richness of the operation.
[0200] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, after responding to the start operation for the cloud application, the following may also be included:
[0201] If the cloud application supports split-screen mode, if it is detected that the foldable screen device is not paired with a game controller, the pairing control is displayed;
[0202] In response to a selection operation on the pairing control, when the foldable screen device turns on the Bluetooth function, a Bluetooth search list is displayed, wherein the Bluetooth search list includes device identification information searched by the foldable screen device;
[0203] When the Bluetooth search list includes the device identification information of the game controller, a pairing success message is displayed in response to a selection operation on the device identification information of the game controller, wherein the pairing success message is used to prompt that a communication connection relationship has been established between the game controller and the folding screen device.
[0204] In one or more embodiments, a method for pairing a foldable screen device with a game controller is introduced. It can be seen from the aforementioned embodiments that after the startup operation for the cloud application, it is first detected whether the cloud application supports split-screen mode. If the split-screen mode is not supported, the single-player business is directly performed. If the split-screen mode is supported, it is detected whether the foldable screen device has been paired with a game controller. If the game controller has been paired, the account is logged in directly. If the game controller is not paired, the pairing process of the game controller continues.
[0205] Specifically, for ease of understanding, see Fig.12 , Fig.12 Schematic diagram of connecting a folding screen device and a game controller based on Bluetooth in an embodiment of the present application. Fig.12 As shown in Figure (A), when the cloud application supports split-screen mode, a split-screen prompt message is displayed. After the user clicks the control indicated by G1, the following is displayed Fig.12The interface shown in Figure (B) is shown in the figure. Since the folding screen device is not paired with the game controller, a pairing prompt message is displayed. Among them, G2 is used to indicate the pairing control. When the user clicks the pairing control indicated by G2, that is, the selection operation for the pairing control is triggered, thereby displaying the following Fig.12 The Bluetooth settings interface shown in Figure (C).
[0206] When the foldable screen device turns on the Bluetooth function, it can search for surrounding Bluetooth devices and display the Bluetooth search list indicated by G3 based on the search results. The Bluetooth search list includes the identification information of each device searched by the foldable screen device, such as "handle A", "handle B", "person A's mobile phone" and "person B's mobile phone".
[0207] like Fig.12 As shown in the middle (D) figure, when the user clicks the device identification information "handle A" indicated by G31 and the device identification information "handle B" indicated by G32, the selection operation for the device identification information of the game controller is triggered. Fig.12 The interface shown in Figure (E) shows that G4 is used to indicate a successful pairing message. Based on the successful pairing message, it can be seen that the game controller and the folding screen device have been successfully paired and a communication connection has been established. After clicking the OK control, you can return to the cloud application interface.
[0208] Secondly, in the embodiment of the present application, a method for pairing a folding screen device with a game controller is provided. Through the above method, the connection between the folding screen device and the game controller is realized based on the Bluetooth function, which not only has the advantages of good connection stability and strong signal, but also the use of the Bluetooth function will not cause excessive pressure on the battery life of the folding screen device.
[0209] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, after responding to the start operation for the cloud application, the following may also be included:
[0210] If the cloud application supports split-screen mode, if it is detected that the foldable screen device is not paired with a game controller, the pairing control is displayed;
[0211] In response to a selection operation on the pairing control, when the game controller and the folding screen device establish a communication connection via a data cable, a pairing success message is displayed.
[0212] In one or more embodiments, another method of pairing a foldable screen device with a game controller is introduced. As can be seen from the above embodiments, after the cloud application is started, it is first detected whether the cloud application supports split-screen mode. If the split-screen mode is supported, it is detected whether the foldable screen device has been paired with a game controller. If the game controller is not paired, the pairing process of the game controller is continued.
[0213] Specifically, for ease of understanding, see Fig.13 , Fig.13 Schematic diagram of connecting a folding screen device and a game controller based on a data cable in an embodiment of the present application. Fig.13 As shown in Figure (A), when the cloud application supports split-screen mode, a split-screen prompt message is displayed. After the user clicks the control indicated by H1, the following is displayed Fig.13 The interface shown in Figure (B). Since the folding screen device is not paired with a game controller, a pairing prompt message is displayed. The user can use the data line (on the go, OTG) indicated by H3 to connect the first game controller indicated by H4 and the folding screen device, and use the data line indicated by H3 to connect the second game controller indicated by H5 and the folding screen device.
[0214] Thus, it is shown as Fig.13 The interface shown in Figure (C) shows that H6 is used to indicate a successful pairing message. Based on the successful pairing message, it can be seen that the game controller and the folding screen device have been successfully paired and a communication connection has been established. After clicking the OK control, you can return to the cloud application interface.
[0215] Secondly, in the embodiment of the present application, another method of pairing the folding screen device with the game controller is provided. Through the above method, the connection between the folding screen device and the game controller is realized based on the data cable, which not only has the advantages of good connection stability and strong convenience, but also has high security.
[0216] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, the cloud application is a cloud game application, and the first account and the second account are different accounts belonging to the same game match in the cloud game application;
[0217] Based on the first video stream sent by the cloud application server, displaying a picture corresponding to the first video stream on the first interface may specifically include:
[0218] Displaying a first virtual object in a first virtual scene on a first interface, wherein the first virtual object is a virtual object controlled by the first account;
[0219] In response to a first operation instruction for a first virtual object, sending the first operation instruction to a cloud application server so that the cloud application server renders the first virtual scene from the perspective of the first virtual object to obtain a first video frame, wherein the first operation instruction stream includes the first operation instruction, and the first video stream includes the first video frame;
[0220] Based on the first video frame sent by the cloud application server, displaying a picture corresponding to the first video frame on a first interface provided by a first screen;
[0221] Based on the second video stream sent by the cloud application server, displaying a picture corresponding to the second video stream on the second interface may specifically include:
[0222] Displaying a second virtual object in a second virtual scene on a second interface, wherein the second virtual object is a virtual object controlled by a second account;
[0223] In response to a second operation instruction for the second virtual object, sending the second operation instruction to the cloud application server so that the cloud application server renders the second virtual scene from the perspective of the second virtual object to obtain a second video frame, wherein the second operation instruction stream includes the second operation instruction, and the second video stream includes the second video frame;
[0224] Based on the second video frame sent by the cloud application server, the picture corresponding to the second video frame is displayed on the second interface provided by the second screen.
[0225] In one or more embodiments, a method for interactive operation based on cloud gaming applications is introduced. It can be seen from the aforementioned embodiments that when it is detected that the folding screen device is currently running a multi-person cloud gaming application, the cloud application server is supported to render video streams of multiple users at the same time, and use the user account as an identification mark, and push multiple video streams to the folding screen device at the same time. The folding screen device reads the corresponding video streams based on different accounts, and renders two sets of video streams on the two unfolded screens of the folding screen device at the same time. In addition, the two screens can receive operation instructions from multiple users respectively, and use the account as an identification mark to send the operation instructions to the cloud application server. The cloud application server distinguishes the operations of different users according to the instructions, and updates the video stream in real time, and pushes it to the folding screen device synchronously to realize dual-screen multiplayer games.
[0226] Exemplarily, taking a video frame displayed on the first interface as an example, the video frame shows the first virtual object in the first virtual scene, wherein the first virtual object is a virtual object controlled by user A using the first account. Based on this, user A triggers the first operation instruction for the first virtual object, and then the folding screen device sends the first operation instruction to the cloud application server. Based on this, the cloud application server renders the first virtual scene from the perspective of the first virtual object, obtains the first video frame, and sends the first video frame to the folding screen device, which renders the screen corresponding to the first video frame on the first interface.
[0227] For example, a video frame displayed on the second interface is used as an example. The video frame shows a second virtual object in a second virtual scene, wherein the second virtual object is a virtual object controlled by user B using a second account. Based on this, user B triggers a second operation instruction for the second virtual object, and the folding screen device sends the second operation instruction to the cloud application server. Based on this, the cloud application server renders the second virtual scene from the perspective of the second virtual object, obtains a second video frame, and sends the second video frame to the folding screen device, which renders the screen corresponding to the second video frame on the second interface.
[0228] It should be noted that multiple video frames are sent to the folding screen device in the form of a video stream, and the folding screen device will render the picture corresponding to the video stream.
[0229] Secondly, in the embodiment of the present application, a method for interactive operation based on cloud game application is provided. Through the above method, dual-screen multi-person cloud games can be realized, which can not only better utilize the multi-screen advantages of folding screen devices, but also restore the screen display ratio of cloud games, thereby ensuring the game display effect.
[0230] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, the cloud application is a cloud game application, and the first account and the second account are different accounts belonging to the same game match in the cloud game application;
[0231] After displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen, the method may further include:
[0232] Displaying a battle invitation message on the first interface, wherein the battle invitation message is used to prompt whether to initiate a battle invitation request to the second account;
[0233] In response to a confirmation operation on the battle invitation message, displaying a battle joining message on the second interface, wherein the battle joining message is used to prompt whether to accept the battle invitation request initiated by the first account;
[0234] In response to a confirmation operation on the battle joining message, a battle establishment message is displayed on the first interface and the second interface respectively, wherein the battle establishment message is used to prompt that the first account and the second account have established a battle relationship.
[0235] In one or more embodiments, a method for playing against each other based on a cloud gaming application is introduced. As can be seen from the aforementioned embodiments, the cloud application can be a cloud gaming application, based on which a user who logs into a first account and a user who logs into a second account can also establish a playing relationship. The following will take the example of the first account actively initiating a playing invitation to the second account as an example. In actual applications, the second account can also actively initiate a playing invitation to the first account, which will not be elaborated here.
[0236] Specifically, for ease of understanding, see Fig.14 , Fig.14 FIG. 1 is a schematic diagram of establishing a battle relationship between a first account and a second account in an embodiment of the present application. Fig.14 As shown in Figure (A), I1 is used to indicate the first screen, I2 is used to indicate the second screen, and I11 is used to indicate the battle invitation control. When the user clicks the battle invitation control indicated by I11, the following is displayed: Fig.14 The interface shown in Figure (B) is shown in Figure 1. I3 is used to indicate a battle invitation message, which is used to prompt the user using the first account (i.e., "Tim123") whether to initiate a battle invitation request to the second account (i.e., "Jack999"). When the user clicks the control indicated by I31, the confirmation operation for the battle invitation message is triggered. Thus, the following is displayed: Fig.14 The interface shown in Figure (C).
[0237] The battle joining message indicated by I4 is displayed on the second interface. The battle joining message is used to prompt the user of the second account whether to accept the battle invitation request initiated by the first account. If the battle invitation request is accepted, the control indicated by I41 is clicked, thereby triggering a confirmation operation for the battle joining message. Based on this, Fig.14 As shown in the middle (D) figure, the battle establishment message indicated by I5 is displayed on the first interface, and the battle establishment message indicated by I6 is displayed on the second interface. The battle establishment message is used to prompt that the first account and the second account have established a battle relationship.
[0238] It should be noted that the first account and the second account are accounts in the same game match. The first operation instruction stream triggered by the first account will also affect the generation of the second video stream, that is, the screen jointly affected by the first account and the second account can be seen through the second interface. Similarly, the second operation instruction stream triggered by the second account will also affect the generation of the first video stream, that is, the screen jointly affected by the first account and the second account can also be seen through the first interface. It can be seen that multi-person interaction can be supported in cloud game applications.
[0239] Secondly, in an embodiment of the present application, a method for fighting based on a cloud gaming application is provided. Through the above method, after one user logs in to the account, he can also actively trigger a battle invitation. When the other user accepts the battle, both users can fight on a folding screen device. As a result, users can also see each other's real-time battle situation, which can not only help change their own tactics, but also enhance the closeness of the two sides and the battle, greatly enhance the flexibility of cloud games, make full use of the advantages of folding screen devices, and also improve user satisfaction with the cloud gaming platform.
[0240] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, the cloud application is a cloud game application, and the first account and the second account are different accounts belonging to the same game match in the cloud game application;
[0241] After displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen, the method may further include:
[0242] When it is detected that the folding screen is in the stand state, a first battle prompt message is displayed on the first interface, and a second battle prompt message is displayed on the second interface, wherein the first battle prompt message is used to prompt the first account whether to join the battle, and the second battle prompt message is used to prompt the second account whether to join the battle;
[0243] In response to a confirmation operation for the first battle prompt message and in response to a confirmation operation for the second battle prompt message, a battle establishment message is displayed on the first interface and the second interface respectively, wherein the battle establishment message is used to prompt that the first account and the second account have established a battle relationship.
[0244] In one or more embodiments, another method of playing against each other based on a cloud gaming application is introduced. As can be seen from the aforementioned embodiments, when the folding screen is detected to be in the stand state, it can be considered that the user who has logged in to the account may have the intention to play against each other, based on which the corresponding game invitation process can be triggered.
[0245] Specifically, for ease of understanding, see Fig.15 , Fig.15 FIG. 1 is another schematic diagram of establishing a battle relationship between a first account and a second account in an embodiment of the present application. Fig.15 As shown in the middle (A) figure, J1 is used to indicate the first screen, and J2 is used to indicate the second screen. At this time, the folding screen is in a fully unfolded state.
[0246] When the folding screen is detected in the stand state, the following is displayed Fig.15 The first interface shown in Figure (B) and Fig.15 The second interface shown in Figure (C). J3 is used to indicate the first battle prompt message, which is used to prompt the first account (i.e., "Tim123") whether to join the battle. When the control indicated by J31 is clicked, the confirmation operation for the first battle prompt message is triggered. When the control indicated by J32 is clicked, the rejection operation for the first battle prompt message is triggered.
[0247] Among them, J4 is used to indicate the second battle prompt message, and the second battle prompt message is used to prompt the second account (i.e., "Jack999") whether to join the battle. When the control indicated by J41 is clicked, the confirmation operation for the second battle prompt message is triggered. When the control indicated by J42 is clicked, the rejection operation for the second battle prompt message is triggered.
[0248] It should be noted that if the rejection operation is triggered, the battle will not be carried out. Therefore, the battle relationship will only be established if both parties accept the battle. Fig.15 The first interface shown in Figure (D) and Fig.15 The second interface shown in Figure (E) is shown. The battle establishment message indicated by J5 is displayed on the first interface, and the battle establishment message indicated by J6 is displayed on the second interface. The battle establishment message is used to prompt that the first account and the second account have established a battle relationship.
[0249] Secondly, in the embodiment of the present application, another method of playing games based on cloud gaming applications is provided. In the above method, when the folding screen is in the stand state, it will be determined that the user may have the intention to play games, so the user can be actively asked whether to join the game. Thus, the operational flexibility of the solution is improved.
[0250] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, the cloud application is a cloud game application, and the first account and the second account are different accounts belonging to the same game match in the cloud game application;
[0251] After displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen, the method may further include:
[0252] Displaying a team invitation message on the first interface, wherein the team invitation message is used to prompt whether to initiate a team invitation request to the second account;
[0253] In response to a confirmation operation on the team invitation message, displaying a team joining message on the second interface, wherein the team joining message is used to prompt whether to accept the team invitation request initiated by the first account;
[0254] In response to a confirmation operation on the team joining message, a team establishment message is displayed on the first interface and the second interface respectively, wherein the team establishment message is used to prompt that the first account and the second account have established a team relationship.
[0255] In one or more embodiments, a method for forming a team based on a cloud gaming application is introduced. As can be seen from the aforementioned embodiments, the cloud application can be a cloud gaming application, based on which a user who logs in to a first account and a user who logs in to a second account can also establish a team relationship. The following will take the example of the first account actively initiating a team invitation to the second account as an example. In actual applications, the second account can also actively initiate a team invitation to the first account, which will not be described in detail here.
[0256] Specifically, for ease of understanding, see Fig.16 , Fig.16 FIG. 1 is a schematic diagram of establishing a team relationship between a first account and a second account in an embodiment of the present application. Fig.16 As shown in Figure (A), K1 is used to indicate the first screen, K2 is used to indicate the second screen, and K11 is used to indicate the team invitation control. When the user clicks the team invitation control indicated by K11, the following is displayed: Fig.16 The interface shown in Figure (B) is shown in Figure 1. K3 is used to indicate a team invitation message, which is used to prompt the user using the first account (i.e., "Tim123") whether to initiate a team invitation request to the second account (i.e., "Jack999"). When the user clicks the control indicated by K31, the confirmation operation for the team invitation message is triggered. Thus, the following is displayed: Fig.16 The interface shown in Figure (C).
[0257] The team joining message indicated by K4 is displayed on the second interface. The team joining message is used to prompt the user using the second account whether to accept the team invitation request initiated by the first account. If the team invitation request is accepted, the control indicated by K41 is clicked, thereby triggering a confirmation operation for the team joining message. Based on this, Fig.16 As shown in the middle (D) figure, a team establishment message indicated by K5 is displayed on the first interface, and a team establishment message indicated by K6 is displayed on the second interface. The team establishment message is used to prompt that the first account and the second account have established a team relationship.
[0258] Secondly, in an embodiment of the present application, a method for forming a team based on a cloud gaming application is provided. Through the above method, after one user logs in to the account, he can also actively trigger a team invitation. When the other user accepts the team formation, both users can play team games on a folding screen device. As a result, users can also see each other's real-time battle situation, which can not only help change their own tactics, but also enhance the closeness of the two sides and the battle, greatly enhance the flexibility of cloud games, make full use of the advantages of folding screen devices, and also improve user satisfaction with the cloud gaming platform.
[0259] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, the cloud application is a cloud game application, and the first account and the second account are different accounts belonging to the same game match in the cloud game application;
[0260] After displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen, the method may further include:
[0261] When it is detected that the folding screen is in the unfolded state, a first team formation prompt message is displayed on the first interface, and a second team formation prompt message is displayed on the second interface, wherein the first team formation prompt message is used to prompt the first account whether to join the team, and the second team formation prompt message is used to prompt the second account whether to join the team, and the unfolded state includes a fully unfolded state;
[0262] In response to a confirmation operation on the first team prompt message and in response to a confirmation operation on the second team prompt message, a team establishment message is displayed on the first interface and the second interface respectively, wherein the team establishment message is used to prompt that the first account and the second account have established a team relationship.
[0263] In one or more embodiments, another method of forming a team based on a cloud gaming application is provided. As can be seen from the aforementioned embodiments, when the folding screen is detected to be in an unfolded state, it can be considered that the user who has logged in to the account may have the intention to form a team, based on which the corresponding team invitation process can be triggered.
[0264] Specifically, for ease of understanding, see Fig.17 , Fig.17 This is another schematic diagram of establishing a team relationship between the first account and the second account in an embodiment of the present application. When the folding screen is in the support state, such as Fig.17 As shown in Figure (A), L1 is used to indicate the first screen. Fig.17 As shown in the middle (B) figure, L2 is used to indicate the second screen.
[0265] When the folding screen is detected to be in the unfolded state (including the fully unfolded state), Fig.17 As shown in the middle (C) figure, L3 is used to indicate the first team prompt message, and the first team prompt message is used to prompt the first account (i.e., "Tim123") whether to join the team. When the control indicated by L31 is clicked, the confirmation operation for the first team prompt message is triggered. When the control indicated by L32 is clicked, the rejection operation for the first team prompt message is triggered.
[0266] Among them, L4 is used to indicate the second team prompt message, and the second team prompt message is used to prompt the second account (i.e., "Jack999") whether to join the team. When the control indicated by L41 is clicked, the confirmation operation for the second team prompt message is triggered. When the control indicated by L42 is clicked, the rejection operation for the second team prompt message is triggered.
[0267] It should be noted that if the rejection operation is triggered, the team will not be formed. Therefore, the battle relationship will only be established if both parties accept the team formation. Fig.17 As shown in the middle (D) figure, the team establishment message indicated by L5 is displayed on the first interface, and the team establishment message indicated by L6 is displayed on the second interface. The team establishment message is used to prompt that the first account and the second account have established a team relationship.
[0268] Secondly, in the embodiment of the present application, another way of forming a team based on a cloud gaming application is provided. In the above manner, when the folding screen is in the unfolded state, it is determined that the user may have the intention to form a team, so the user can be actively asked whether to join the team. As a result, users can also see each other's real-time battle situation, which can not only help change their own tactics, but also enhance the closeness of the two sides and the battle, greatly improving the flexibility of cloud gaming.
[0269] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, another optional embodiment provided by the embodiment of the present application may further include:
[0270] Displaying a first-person perspective switching control on the first interface;
[0271] In response to an interactive operation on the first perspective switching control, the first interface is rotated 180 degrees clockwise, or the first interface is rotated 180 degrees counterclockwise;
[0272] It may also include:
[0273] Displaying a second perspective switching control on the second interface;
[0274] In response to an interactive operation on the second viewing angle switching control, the second interface is rotated 180 degrees clockwise, or the second interface is rotated 180 degrees counterclockwise.
[0275] In one or more embodiments, a method for supporting a user to switch an interface perspective is introduced. As can be seen from the above embodiments, a user can adjust the positional relationship with other users by switching the interface perspective. If the user needs to sit in the same direction, the interface perspective can be adjusted to the same direction. Conversely, if the user needs to sit in opposite directions, the user can adjust the interface perspective to the opposite direction.
[0276] Specifically, for ease of understanding, see Fig.18 , Fig.18 is a schematic diagram of switching interface perspectives in an embodiment of the present application, such as Fig.18 As shown in the middle (A) figure, M1 is used to indicate the first interface, M11 is used to indicate the first perspective switching control, M2 is used to indicate the second interface, and M22 is used to indicate the second perspective switching control.
[0277] based on Fig.18 (A) The interface effect shown in the figure, when the first perspective switching control indicated by M11 is clicked, that is, the interactive operation for the first perspective switching control is triggered, the first interface is rotated 180 degrees clockwise, or the first interface is rotated 180 degrees counterclockwise, thereby displaying the following Fig.18 The interface effect shown in Figure (B) is shown in Figure 1. At this time, the first interface and the second interface are in opposite directions.
[0278] based on Fig.18 (A) The interface effect shown in the figure, when the second perspective switching control indicated by M21 is clicked, that is, the interactive operation for the second perspective switching control is triggered, the second interface is rotated 180 degrees clockwise, or the second interface is rotated 180 degrees counterclockwise, thereby displaying the following Fig.18 The interface effect shown in Figure (C) is shown in Figure 1. At this time, the first interface and the second interface are in opposite directions.
[0279] Secondly, in the embodiment of the present application, a method for supporting the user to switch the interface perspective is provided. Through the above method, the user can choose whether to switch the interface perspective according to actual needs. Thus, the diversity and flexibility of the display mode are improved to meet the needs of users.
[0280] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, another optional embodiment provided by the embodiment of the present application may further include:
[0281] In response to a start-up operation on the cloud application, displaying a login interface;
[0282] In response to a login operation on the login interface, setting the first account or the second account as a primary account;
[0283] If the first account is the primary account, a prompt message is displayed on the first interface when the message prompt condition is met;
[0284] If the second account is the primary account, a prompt message is displayed on the second interface when the message prompt condition is met.
[0285] In one or more embodiments, a method for supporting users to set a primary account is introduced. It can be seen from the aforementioned embodiments that after triggering the startup operation for the cloud application, the corresponding login interface can be displayed. When the folding screen is in a fully folded state, a login interface can be displayed. When the folding screen is in an unfolded state or a stand state, two login interfaces can be displayed respectively. The following will take the folding screen in an inwardly folded state as an example for introduction.
[0286] Specifically, for ease of understanding, see Fig.19 , Fig.19 A schematic diagram of setting a primary account in an embodiment of the present application. Fig.19 The figure (A) shows the cloud application platform interface. N1 is used to indicate the external screen, and N11 is used to indicate a cloud application provided on the cloud application platform interface. When the user clicks the cloud application indicated by N11, the start operation for the cloud application is triggered. Thus, the display is as follows Fig.19 The interface shown in Figure (B), where N2 is used to indicate the login interface.
[0287] The user (e.g., user A) enters the first account (e.g., "Tim123") in the account control indicated by N21, and enters the corresponding password in the password control indicated by N22. The user (e.g., user B) enters the second account (e.g., "Jack999") in the account control indicated by N23, and enters the corresponding password in the password control indicated by N24. In addition, a primary account can also be selected. For example, it is assumed that the first account is set as the primary account, that is, the control indicated by N25 is clicked.
[0288] After completion, click the login control indicated by N26 to trigger the login operation for the login interface. Based on this, if the first account and password are successfully verified, and the second account and password are also successfully verified, it is displayed Fig.19 The interface shown in the middle (C) figure, that is, the first interface indicated by N3 and the second interface indicated by N4 are displayed. At this time, in the case where the first account is the main account, the main account information indicated by N31 is displayed.
[0289] It should be noted that if the first account is the primary account, a prompt message is displayed on the first interface if the message prompt condition is met. If the second account is the primary account, a prompt message is displayed on the second interface if the message prompt condition is met. The situations in which the message prompt condition is met include but are not limited to at least one of the following:
[0290] First, answer the call;
[0291] Second, receiving the session message;
[0292] Third, system update notification;
[0293] Fourth, application update notifications;
[0294] Fifth, low battery reminder message.
[0295] Secondly, in an embodiment of the present application, a method is provided to support users to set a main account. Through the above method, after being set as the main account, you can receive corresponding prompt messages (for example, incoming call prompts, system update prompts, conversation message prompts, etc.). As a result, it is convenient for the user corresponding to the main account to handle related matters during the cloud application process. On the one hand, it can prevent users from missing important messages. On the other hand, if the folding screen is in the stand state, only the main account user can view the message content, thereby better protecting user privacy.
[0296] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, if the first account is the primary account, a prompt message is displayed on the first interface when the message prompt condition is met, which may specifically include:
[0297] If the first account is the primary account, when the folding screen device receives an incoming call, a call reminder message is displayed on the first interface;
[0298] If the second account is the primary account, a prompt message is displayed on the second interface when the message prompt conditions are met, including:
[0299] If the second account is the primary account, when the folding screen device receives an incoming call, a call reminder message is displayed on the second interface.
[0300] In one or more embodiments, a method of displaying an incoming call prompt message is introduced. It can be seen from the aforementioned embodiments that when the main account is set, if the folding screen device receives an incoming call, the corresponding incoming call prompt message will be displayed on the interface corresponding to the main account. It should be noted that the following will be introduced with the folding screen in the fully unfolded state as an example. In actual applications, the corresponding operations can be performed when the folding screen is in the stand state, which is not limited here.
[0301] For example, it is assumed that the first account is the primary account. Based on this, please refer to Fig. 20 , Fig. 20 FIG. 1 is a schematic diagram of displaying an incoming call reminder message based on a primary account in an embodiment of the present application. Fig. 20 As shown in Figure (A), O1 is used to indicate the first interface, O11 is used to indicate that the primary account is the first account (ie, "Tim123"), and O2 is used to indicate the second interface. Fig. 20 The interface shown in Figure (B) in the figure. At this time, the incoming call reminder message indicated by O3 is displayed on the first interface. Based on this, if you click the control indicated by O31, you can merge the folding screens and answer the call. If you click the control indicated by O32, you will refuse to answer the call.
[0302] For example, it is assumed that the second account is the primary account. Based on this, please refer to Fig. 20 , Fig. 20 FIG. 1 is a schematic diagram of displaying an incoming call reminder message based on a primary account in an embodiment of the present application. Fig. 20 As shown in Figure (C), O4 is used to indicate the first interface, O5 is used to indicate the second interface, and O51 is used to indicate that the primary account is the second account (i.e., "Jack999"). When the folding screen device receives an incoming call, the following is displayed: Fig. 20 The interface shown in the middle (D) figure. At this time, the incoming call reminder message indicated by O6 is displayed on the second interface. Based on this, if you click the control indicated by O61, you can merge the folding screens and answer the call. If you click the control indicated by O62, you will refuse to answer the call.
[0303] Again, in the embodiment of the present application, a method for displaying an incoming call reminder message is provided. Through the above method, after setting the primary account, when an incoming call is received, the corresponding incoming call reminder message will be displayed on the interface corresponding to the primary account. This makes it easier for the user using the primary account to handle the incoming call in a timely manner.
[0304] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, if the first account is the primary account, a prompt message is displayed on the first interface when the message prompt condition is met, which may specifically include:
[0305] If the first account is the primary account, when the folding screen device receives a conversation message, the conversation message is displayed in a first window presented on the first interface, wherein the first window supports replying to the conversation message;
[0306] If the second account is the primary account, a prompt message is displayed on the second interface when the message prompt conditions are met, including:
[0307] If the second account is the primary account, when the folding screen device receives a conversation message, the conversation message is displayed in a second window presented on the second interface, wherein the second window supports replying to the conversation message.
[0308] In one or more embodiments, a method of displaying message reminders is introduced. It can be seen from the aforementioned embodiments that when a main account is set, if the folding screen device receives a conversation message, the corresponding conversation message will be displayed on the interface corresponding to the main account. It should be noted that the following will be introduced with the folding screen in the fully unfolded state as an example. In actual applications, the corresponding operations can be performed when the folding screen is in the stand state, which is not limited here.
[0309] For example, it is assumed that the first account is the primary account. Based on this, please refer to Fig.21 , Fig.21 FIG. 1 is a schematic diagram of displaying a conversation message based on a primary account in an embodiment of the present application. Fig.21 As shown in Figure (A), P1 is used to indicate the first interface, P11 is used to indicate that the primary account is the first account (ie, "Tim123"), and P2 is used to indicate the second interface. When the folding screen device receives a conversation message, it displays the following Fig.21 The interface shown in Figure (B) is shown in the figure. At this time, the first window indicated by P3 is displayed on the first interface, and the conversation message is displayed in the first window. Based on this, if the control indicated by P31 is clicked, the conversation message can be quickly replied in the first window.
[0310] For example, it is assumed that the second account is the primary account. Based on this, please refer to Fig.21 , Fig.21 FIG. 1 is a schematic diagram of displaying a conversation message based on a primary account in an embodiment of the present application. Fig.21 As shown in Figure (C), P4 is used to indicate the first interface, P5 is used to indicate the second interface, and P51 is used to indicate that the primary account is the second account (i.e., "Jack999"). When the folding screen device receives a conversation message, the following is displayed: Fig.21 The interface shown in Figure (D) is shown in the middle. At this time, the second window indicated by P6 is displayed on the second interface, and the conversation message is displayed in the second window. Based on this, if the control indicated by P61 is clicked, the conversation message can be quickly replied in the second window.
[0311] It should be noted that, in actual applications, the user may also set the content of the hidden conversation message, which is only an illustration and should not be construed as a limitation on the present application.
[0312] Again, in the embodiment of the present application, a method for displaying message reminders is provided. Through the above method, after setting the primary account, when a message reminder is received, the corresponding message reminder will be displayed on the interface corresponding to the primary account, and the user can make a quick reply. In this way, it is convenient for the user using the primary account to handle the conversation message in a timely manner, and the impact on the ongoing cloud business can be reduced.
[0313] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, another optional embodiment provided by the embodiment of the present application may further include:
[0314] Displaying a first device switching control on the first interface;
[0315] In response to the interactive operation on the first device switching control, sending a first device switching request to the cloud application server, wherein the first device switching request is used to request the cloud application server to send a first video stream to the first terminal so that the first terminal displays a picture corresponding to the first video stream, and the first terminal has a binding relationship with the first account;
[0316] It may also include:
[0317] Displaying a second device switching control on the second interface;
[0318] In response to the interactive operation on the second device switching control, a second device switching request is sent to the cloud application server, wherein the second device switching request is used to request the cloud application server to send a second video stream to the second terminal so that the second terminal displays the picture corresponding to the second video stream, and the second terminal has a binding relationship with the second account.
[0319] In one or more embodiments, a method for migrating video streams is introduced. It can be seen from the foregoing embodiments that the user may need to leave for a period of time while performing cloud services (for example, cloud games). In order to avoid interruption of cloud services, the cloud application server can be requested to continue streaming to other terminals bound to the user. The following will take the migration of the first video stream by the first account as an example. In actual applications, the way the second account migrates the second video stream is similar to the way the first account migrates the first video stream, that is, the corresponding switching operation needs to be completed through the second device switching control, so it will not be repeated here.
[0320] Specifically, for ease of understanding, see Fig. 22 , Fig. 22 A schematic diagram of migrating video streams in an embodiment of the present application is shown in FIG. Fig. 22 As shown in the figure (A), Q1 is used to indicate the first interface, Q11 is used to indicate the first device switching control. Q2 is used to indicate the second interface, and Q21 is used to indicate the second device switching control.
[0321] For example, when the first device switching control indicated by Q11 is clicked, the interactive operation for the first device switching control is triggered. As a result, the folding screen device sends a first device switching request to the cloud application server. The cloud application server queries whether the first account has been pre-bound to other terminals based on the first account carried in the first device switching request. If so, it displays the following information: Fig. 22 In the interface shown in Figure (B), Q3 applies a migration prompt message. If you agree to migrate the video stream, click the control indicated by Q31. Fig. 22 As shown in the middle (C) figure, at this time, the cloud application server no longer pushes the first video stream to the folding screen device, but continues to push the first video stream to the first terminal bound to the first account. As a result, the screen corresponding to the first video stream is displayed on the first terminal indicated by Q4.
[0322] Exemplarily, when the second device switching control indicated by Q21 is clicked, the interactive operation for the second device switching control is triggered. As a result, the folding screen device sends a second device switching request to the cloud application server. Based on the second account carried in the second device switching request, the cloud application server queries whether the second account has been pre-bound to other terminals. If so, a migration prompt message is displayed. If the video stream migration is agreed, the cloud application server will no longer push the second video stream to the folding screen device, but will continue to push the second video stream to the second terminal bound to the second account. As a result, the screen corresponding to the second video stream is displayed on the second terminal.
[0323] Secondly, in the embodiment of the present application, a method for migrating video streams is provided. Through the above method, it is considered that the user may need to leave for a period of time during the process of cloud business. Based on this, the video stream pushed by the cloud application server can be migrated to other terminals used by the user. In order to avoid the interruption of cloud business, the flexibility and convenience of the solution are improved, and the needs of users can be better met.
[0324] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, another optional embodiment provided by the embodiment of the present application may further include:
[0325] In response to an account joining operation for a cloud application, a first sub-interface and a second sub-interface of the cloud application are displayed on the first screen, and a third sub-interface and a fourth sub-interface of the cloud application are displayed on the second screen, wherein different sub-interfaces are used to present screens corresponding to different accounts;
[0326] Based on the first merged video stream sent by the cloud application server, displaying the screen corresponding to the first merged video stream on the first sub-interface and the second sub-interface, wherein the first merged video stream is generated by the cloud application server according to the operation instruction stream triggered by different accounts;
[0327] Based on the second merged video stream sent by the cloud application server, the screen corresponding to the second merged video stream is displayed on the third sub-interface and the fourth sub-interface, wherein the second merged video stream is generated by the cloud application server according to the operation instruction stream triggered by different accounts.
[0328] In one or more embodiments, a method for supporting split-screen display within a screen is introduced. As can be seen from the aforementioned embodiments, in actual applications, cloud applications can support more users to join the operation. Based on this, on the basis of the original screen of the folding screen device, more sub-interfaces can be further divided to support operations of different users.
[0329] Specifically, for ease of understanding, see Fig.23 , Fig.23 This is a schematic diagram of supporting split-screen display on the same screen in an embodiment of the present application. Fig.23 As shown in Figure (A), R1 is used to indicate the first interface, and R11 is used to indicate the add control. R2 is used to indicate the second interface, and R21 is used to indicate the add control. When you click the add control indicated by R11, the following is displayed: Fig.23 The interface shown in Figure (B) is shown in Figure 1. R3 is used to indicate the login interface. When the add control indicated by R21 is clicked, the login interface indicated by R4 is displayed.
[0330] The user (e.g., user C) enters a third account (e.g., "Mary") in the account control indicated by R31, and enters the corresponding password in the password control indicated by R32. After completion, click the login control indicated by R33 to trigger the login operation. Similarly, the user (e.g., user D) enters a fourth account (e.g., "Judy") in the account control indicated by R41, and enters the corresponding password in the password control indicated by R42. After completion, click the login control indicated by R43 to trigger the login operation.
[0331] If the third account and password are successfully verified, and the fourth account and password are successfully verified, the following will be displayed: Fig.23 The interface shown in Figure (C). R51 is used to indicate the first sub-interface corresponding to the first account, R52 is used to indicate the second sub-interface corresponding to the third account, R61 is used to indicate the third sub-interface corresponding to the second account, and R62 is used to indicate the fourth sub-interface corresponding to the fourth account.
[0332] It should be noted that the cloud application server merges the video frames corresponding to the same timestamp to obtain a synthesized video frame. Thus, the folding screen device renders the synthesized video frame and can display the picture under the dual perspective on the corresponding interface.
[0333] Exemplarily, the cloud application server generates a first merged video stream according to the operation instruction stream triggered by the first account and the third account, and pushes the first merged video stream to the folding screen device. Based on the first merged video stream, the folding screen device displays the screen corresponding to the first merged video stream on the first interface, that is, displays the screen content from different perspectives on the first sub-interface and the second sub-interface respectively.
[0334] Exemplarily, the cloud application server generates a second merged video stream according to the operation instruction stream triggered by the second account and the fourth account, and pushes the second merged video stream to the folding screen device. Based on the second merged video stream, the folding screen device displays the screen corresponding to the second merged video stream on the second interface, that is, displays the screen content from different perspectives on the third sub-interface and the fourth sub-interface respectively.
[0335] Secondly, in the embodiment of the present application, a method for supporting split-screen display within the screen is provided. Through the above method, split-screen display can also be performed within the same screen, thereby supporting more users to use cloud applications on the same folding screen device. This improves the diversity of display types, and can better meet the needs of users for split-screen display, increasing the flexibility of cloud application participation.
[0336] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, another optional embodiment provided by the embodiment of the present application may further include:
[0337] When it is detected that the folding screen is in a fully folded state, the picture corresponding to the merged video stream is displayed on the outer screen or inner screen of the folding screen device, wherein the merged video stream is obtained by merging the first video stream and the second video stream by the cloud application server, and the inner screen is the first screen or the second screen.
[0338] In one or more embodiments, a method for supporting merged display of folding screen devices is introduced. It can be seen from the aforementioned embodiments that when the folding screen is in a fully folded state (for example, a fully folded state of folding inward or a fully folded state of folding outward), the picture corresponding to the merged video stream can be displayed on a single screen. If it is in a fully folded state of folding inward, the picture corresponding to the merged video stream is displayed on the outer screen. If it is in a fully folded state of folding outward, the picture corresponding to the merged video stream is displayed on the first screen or the second screen.
[0339] Specifically, for ease of understanding, see Fig.24 , Fig.24 A schematic diagram of supporting merged screen display in an embodiment of the present application is shown as follows Fig.24 As shown in Figure (A), S1 is used to indicate the first interface, and S2 is used to indicate the second interface. When the folding screen is detected to be in a fully folded state, the following is displayed: Fig.24 The interface shown in Figure (B) at this time displays the screen corresponding to the merged video stream on the interface.
[0340] It should be noted that after the folding screens are combined (ie, the folding screens are in a fully folded state), the combined video stream can be displayed on the same screen, and the video stream has a two-person perspective. The combined video stream needs to synchronize video frames from different perspectives.
[0341] Secondly, in the embodiment of the present application, a method for supporting the combined display of folding screen devices is provided. Through the above method, when the folding screen devices are combined, video streams under multiple perspectives can still be displayed. In this way, the business interruption caused by the combination of folding screen devices can be avoided, thereby improving the feasibility and operability of the solution.
[0342] Optionally, in the above Figure 6 On the basis of one or more corresponding embodiments, in another optional embodiment provided by the embodiment of the present application, after displaying the picture corresponding to the merged video stream on the outer screen or the inner screen of the folding screen device, the method may further include:
[0343] Displaying a status prompt pop-up window on the outer screen or inner screen of the folding screen device, wherein the status prompt pop-up window is used to prompt the folding screen device to be adjusted to the unfolded state or the stand state;
[0344] When it is detected that the folding screen is in the unfolded state or the bracket state, the picture corresponding to the first video stream is displayed on the first interface, and the picture corresponding to the second video stream is displayed on the second interface.
[0345] In one or more embodiments, a method of prompting a user to change the state of a folding screen device is introduced. As can be seen from the aforementioned embodiments, when the folding screen is combined, the interface area visible to each user will become smaller, and the operation area will also become smaller, so it is easy to cause the user to make an error operation. Based on this, the user can also be prompted to unfold the screen.
[0346] Specifically, for ease of understanding, see Fig.25 , Fig.25 A schematic diagram of performing split screen prompts in an embodiment of the present application is shown in FIG. Fig.25 As shown in Figure (A), T1 is used to indicate a status prompt pop-up window, which reminds the user to adjust the folding screen device to the unfolded state or the stand state. Based on this, when the user unfolds the folding screen, the following is displayed Fig.25The interface shown in Figure (B) shows the picture corresponding to the first video stream on the first interface indicated by T2, and the picture corresponding to the second video stream on the second interface indicated by T3.
[0347] Again, in the embodiment of the present application, a method is provided to prompt the user to change the state of the folding screen device. In the above method, when the folding screen is in the fully folded state, it may be easy for the user to make an error operation because the screen is too small. Based on this, the user can be prompted to unfold the screen in time, thereby achieving a better use effect.
[0348] Based on the above embodiments, Fig.26 , which introduces the overall process of the display method applied to foldable screen devices, please refer to Fig.26 , specifically:
[0349] In step U1, the user clicks on the cloud game client to start a cloud game that supports two-player gaming.
[0350] In step U2, the cloud gaming client reads the system device information, such as the brand, screen resolution, whether it is a folding screen, and the type of folding screen (whether it supports horizontal and vertical expansion), thereby determining whether it is a folding screen device. If it is a folding screen device, execute step U3. If it is not a folding screen device, execute step U4.
[0351] In step U3, if it is a foldable screen device, the cloud game client displays a pop-up window to ask the user whether to continue the two-player cloud game. If the user chooses not to continue, the single-player game is directly started. If the user clicks to continue the two-player cloud game, step U5 is executed.
[0352] In step U4, if it is not a foldable screen device, the cloud game is directly started, and only single-player games can be played. After the user enters the game, he or she selects an opponent in the room provided by the game, or the cloud game server randomly selects an opponent.
[0353] In step U5, the cloud game client needs to detect whether there are at least two paired game controllers, and if so, execute step U8. If not, execute step U6.
[0354] In step U6, a pop-up window is displayed, requesting the user to turn on Bluetooth for device pairing.
[0355] In step U7, the user clicks pairing, and the cloud game client jumps to the Bluetooth pairing interface, displaying the game controllers that can currently be searched via Bluetooth. The user clicks the corresponding game controller to perform Bluetooth pairing.
[0356] In step U8, after the pairing is successful, the system of the folding screen device will send the pairing information to the cloud game client. After receiving the pairing information, the cloud game client will inform the cloud game server of the message that the pairing is successful and the game can be started. After receiving the message, the cloud game server notifies the cloud game client to request the user to enter the account. Thus, the user accounts corresponding to game controller A and game controller B can be identified through the account.
[0357] In step U9, if the folding screen of the folding screen device is in a fully folded state, the cloud game client prompts the user to unfold the screen, otherwise the two-player game may not be able to proceed normally.
[0358] In step U10, after the user unfolds the screen, the cloud gaming client displays account input interfaces on two screens respectively, and user A and user B enter their corresponding accounts on the account input interfaces.
[0359] In step U11, the cloud game client sends the two accounts to the cloud game server. After receiving the accounts, the cloud game server starts the cloud game, starts rendering the video, and pushes two sets of video streams to the cloud game client in real time, using the accounts of user A and user B as keys to match. Then, it starts pushing streams to the cloud game client.
[0360] In step U12, the cloud game client reads the coordinate system of the screen and the direction of the current screen, and draws two controls for carrying the cloud game video images on different screens (for example, left and right screens or upper and lower screens) at the same time, waiting to receive two sets of video streams from the cloud game server, and display them on two screens.
[0361] In step U13, the cloud gaming client receives the video streams corresponding to the two accounts, and displays the user accounts at designated locations on the two screens (e.g., upper left corner, upper right corner, etc.). Thus, user A and user B can distinguish the two groups of video streams by account.
[0362] In step U14, user A and user B use game controllers to operate the game respectively, and the cloud game client sends the operation instructions of the two users to the cloud game server. The cloud game server renders different game videos in real time according to the operation instructions of different users, and sends the rendered videos to the cloud game client. The cloud game client displays the video stream based on the account split screen.
[0363] In step U15, if the user merges the folding screens, the cloud gaming client receives the merge event feedback from the folding screen device system, and then the cloud gaming client notifies the cloud gaming server that the merge event has been triggered. As a result, the cloud gaming server immediately merges the two sets of video streams and sends the merged video stream to the cloud gaming client. The cloud gaming client displays the received video stream on a single screen.
[0364] In step U16, a pop-up window is used to remind the user that it is difficult to distinguish between two-player operations when the folding screens are combined, which may lead to misoperation, and the user is asked to unfold the folding screen. After the user unfolds the folding screen, the above game process continues.
[0365] In step U17, the user clicks the game exit button, and the cloud game client notifies the cloud game server to stop streaming, exit the remote game instance, and release cloud server resources.
[0366] In step U18, the user ends the cloud game.
[0367] The display device applied to the folding screen device in this application is described in detail below. Fig. 27 , Fig. 27 This is a schematic diagram of an embodiment of a display device applied to a folding screen device in an embodiment of the present application. The display device 40 applied to the folding screen device includes:
[0368] The display module 410 is used to display a first interface of the cloud application on the first screen and a second interface of the cloud application on the second screen in response to a startup operation on the cloud application, wherein the first interface is used to present a screen corresponding to the first account and the second interface is used to present a screen corresponding to the second account;
[0369] The display module 410 is further configured to display a screen corresponding to the first video stream on the first interface based on the first video stream sent by the cloud application server, wherein the first video stream is generated by the cloud application server according to the first operation instruction stream, and the first operation instruction stream is an operation instruction stream triggered by the first account;
[0370] The display module 410 is also used to display the picture corresponding to the second video stream on the second interface based on the second video stream sent by the cloud application server, wherein the second video stream is generated by the cloud application server according to the second operation instruction stream, and the second operation instruction stream is an operation instruction stream triggered by the second account.
[0371] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0372] The display module 410 is specifically configured to display a first login interface on the first screen and a second login interface on the second screen in response to a startup operation on the cloud application;
[0373] In response to a first login operation on the first login interface, displaying a first interface of the cloud application on the first screen, wherein the first login operation is used to log in using the first account;
[0374] In response to a second login operation on the second login interface, a second interface of the cloud application is displayed on the second screen, wherein the second login operation is used to log in using the second account.
[0375] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0376] The display module 410 is specifically configured to display a login interface on an outer screen or an inner screen of the folding screen device in response to a startup operation for a cloud application when the folding screen is detected to be in a fully folded state, wherein the inner screen is the first screen or the second screen;
[0377] In response to a login operation on the login interface, when it is detected that the folding screen is in an unfolded state or a stand state, a first interface of the cloud application is displayed on the first screen, and a second interface of the cloud application is displayed on the second screen, wherein the login operation is used to log in using the first account and the second account respectively, and the unfolded state includes a fully unfolded state.
[0378] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0379] The display module 410 is specifically configured to respond to a startup operation for a cloud application, and if it is detected that the folding screen device is successfully matched with at least two game controllers, display a first login interface on the first screen, and display a second login interface on the second screen;
[0380] In response to a first login operation for the first login interface, displaying a first interface of the cloud application on the first screen, wherein the first login operation is for logging in using a first account, the first account is paired with a first game controller, and the at least two game controllers include the first game controller;
[0381] In response to a second login operation for the second login interface, a second interface of the cloud application is displayed on the second screen, wherein the second login operation is used to log in using a second account, the second account has a pairing relationship with the second game controller, and the at least two game controllers include the second game controller.
[0382] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0383] The display module 410 is specifically configured to display device identification information of the first game controller on the first login interface in response to a key operation triggered by the first game controller;
[0384] In response to a first login operation for the first login interface, matching the first account with the device identification information of the first game controller, and displaying the first interface of the cloud application on the first screen;
[0385] The display module 410 is specifically configured to display device identification information of the second game controller on the second login interface in response to a key operation triggered by the second game controller;
[0386] In response to a second login operation for the second login interface, the second account is matched with the device identification information of the second game controller, and a second interface of the cloud application is displayed on the second screen.
[0387] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0388] The display module 410 is specifically configured to display a login interface on an outer screen or an inner screen of the folding screen device in response to a startup operation for a cloud application when it is detected that the folding screen is in a fully folded state and the folding screen device is successfully matched with at least two game controllers, wherein the inner screen is the first screen or the second screen;
[0389] In response to a login operation on the login interface, when it is detected that the folding screen is in an unfolded state or a stand state, a first interface of the cloud application is displayed on the first screen, and a second interface of the cloud application is displayed on the second screen, wherein the login operation is used to log in using a first account and a second account respectively, the first account is paired with a first game controller, the second account is paired with a second game controller, at least two game controllers include a first game controller and a second game controller, and the unfolded state includes a fully unfolded state.
[0390] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0391] The display module 410 is further configured to, in response to a startup operation for the cloud application, display a pairing control if it is detected that the folding screen device is not paired with a game controller when the cloud application supports a split-screen mode;
[0392] The display module 410 is further configured to, in response to a selection operation on a pairing control, display a Bluetooth search list when the folding screen device turns on the Bluetooth function, wherein the Bluetooth search list includes device identification information searched by the folding screen device;
[0393] The display module 410 is also used to display a pairing success message in response to a selection operation on the device identification information of the game controller when the Bluetooth search list includes the device identification information of the game controller, wherein the pairing success message is used to prompt that a communication connection relationship has been established between the game controller and the folding screen device.
[0394] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0395] The display module 410 is further configured to, in response to a startup operation for the cloud application, display a pairing control if it is detected that the folding screen device is not paired with a game controller when the cloud application supports a split-screen mode;
[0396] The display module 410 is also used to display a pairing success message in response to a selection operation on the pairing control when the game controller and the folding screen device establish a communication connection via a data cable.
[0397] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided by the embodiment of the present application, the cloud application is a cloud game application, and the first account and the second account are different accounts belonging to the same game in the cloud game application;
[0398] The display module 410 is specifically configured to display a first virtual object in a first virtual scene on a first interface, wherein the first virtual object is a virtual object controlled by a first account;
[0399] In response to a first operation instruction for a first virtual object, sending the first operation instruction to a cloud application server so that the cloud application server renders the first virtual scene from the perspective of the first virtual object to obtain a first video frame, wherein the first operation instruction stream includes the first operation instruction, and the first video stream includes the first video frame;
[0400] Based on the first video frame sent by the cloud application server, displaying a picture corresponding to the first video frame on a first interface provided by a first screen;
[0401] The display module 410 is specifically configured to display a second virtual object in a second virtual scene on a second interface, wherein the second virtual object is a virtual object controlled by a second account;
[0402] In response to a second operation instruction for the second virtual object, sending the second operation instruction to the cloud application server so that the cloud application server renders the second virtual scene from the perspective of the second virtual object to obtain a second video frame, wherein the second operation instruction stream includes the second operation instruction, and the second video stream includes the second video frame;
[0403] Based on the second video frame sent by the cloud application server, the picture corresponding to the second video frame is displayed on the second interface provided by the second screen.
[0404] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided by the embodiment of the present application, the cloud application is a cloud game application, and the first account and the second account are different accounts belonging to the same game in the cloud game application;
[0405] The display module 410 is further configured to display a first interface of the cloud application on the first screen, and after displaying a second interface of the cloud application on the second screen, display a battle invitation message on the first interface, wherein the battle invitation message is used to prompt whether to initiate a battle invitation request to the second account;
[0406] The display module 410 is further configured to display a battle joining message on the second interface in response to a confirmation operation on the battle invitation message, wherein the battle joining message is used to prompt whether to accept the battle invitation request initiated by the first account;
[0407] The display module 410 is further used to display a battle establishment message on the first interface and the second interface respectively in response to a confirmation operation on the battle joining message, wherein the battle establishment message is used to prompt that the first account and the second account have established a battle relationship.
[0408] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided by the embodiment of the present application, the cloud application is a cloud game application, and the first account and the second account are different accounts belonging to the same game in the cloud game application;
[0409] The display module 410 is further configured to display a first interface of the cloud application on the first screen, and after displaying a second interface of the cloud application on the second screen, display a first battle prompt message on the first interface and display a second battle prompt message on the second interface when it is detected that the folding screen is in a stand state, wherein the first battle prompt message is used to prompt the first account whether to join the battle, and the second battle prompt message is used to prompt the second account whether to join the battle;
[0410] The display module 410 is also used to respond to a confirmation operation for the first battle prompt message and a confirmation operation for the second battle prompt message, and to display a battle establishment message on the first interface and the second interface respectively, wherein the battle establishment message is used to prompt that the first account and the second account have established a battle relationship.
[0411] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided by the embodiment of the present application, the cloud application is a cloud game application, and the first account and the second account are different accounts belonging to the same game in the cloud game application;
[0412] The display module 410 is further configured to display a first interface of the cloud application on the first screen, and after displaying a second interface of the cloud application on the second screen, display a team invitation message on the first interface, wherein the team invitation message is used to prompt whether to initiate a team invitation request to the second account;
[0413] The display module 410 is further configured to display a team joining message on the second interface in response to a confirmation operation on the team invitation message, wherein the team joining message is used to prompt whether to accept the team invitation request initiated by the first account;
[0414] The display module 410 is also used to respond to the confirmation operation of the team joining message, and display the team establishment message on the first interface and the second interface respectively, wherein the team establishment message is used to prompt that the first account and the second account have established a team relationship.
[0415] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided by the embodiment of the present application, the cloud application is a cloud game application, and the first account and the second account are different accounts belonging to the same game in the cloud game application;
[0416] The display module 410 is further configured to display a first interface of the cloud application on the first screen, and after displaying a second interface of the cloud application on the second screen, display a first team formation prompt message on the first interface and display a second team formation prompt message on the second interface when it is detected that the folding screen is in an unfolded state, wherein the first team formation prompt message is used to prompt the first account whether to join the team, and the second team formation prompt message is used to prompt the second account whether to join the team, and the unfolded state includes a fully unfolded state;
[0417] The display module 410 is also used to respond to the confirmation operation of the first team prompt message and the confirmation operation of the second team prompt message, and to display the team establishment message on the first interface and the second interface respectively, wherein the team establishment message is used to prompt that the first account and the second account have established a team relationship.
[0418] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application, the display device 40 applied to the folding screen device further includes a rotating module 420;
[0419] The display module 410 is further used to display a first perspective switching control on the first interface;
[0420] The rotation module 420 is used to rotate the first interface 180 degrees clockwise or 180 degrees counterclockwise in response to an interactive operation on the first perspective switching control;
[0421] The display module 410 is further used to display the second viewing angle switching control on the second interface;
[0422] The rotation module 420 is further used to rotate the second interface 180 degrees clockwise, or rotate the second interface 180 degrees counterclockwise, in response to an interactive operation on the second perspective switching control.
[0423] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application, the display device 40 applied to the folding screen device further includes a setting module 430;
[0424] The display module 410 is further configured to display a login interface in response to a startup operation for the cloud application;
[0425] A setting module 430, for responding to a login operation on the login interface and setting the first account or the second account as a primary account;
[0426] The display module 410 is further configured to display a prompt message on the first interface if the first account is the primary account and the message prompt condition is met;
[0427] The display module 410 is further configured to display a prompt message on the second interface if the second account is the primary account and the message prompt condition is met.
[0428] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0429] The display module 410 is specifically configured to display an incoming call prompt message on the first interface when the folding screen device receives an incoming call if the first account is the primary account;
[0430] The display module 410 is specifically used to display an incoming call reminder message on the second interface when the folding screen device receives an incoming call if the second account is the main account.
[0431] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0432] The display module 410 is specifically configured to display the conversation message in a first window presented on the first interface when the folding screen device receives the conversation message if the first account is the primary account, wherein the first window supports replying to the conversation message;
[0433] The display module 410 is specifically used to display the conversation message in a second window presented on the second interface when the folding screen device receives the conversation message if the second account is the primary account, wherein the second window supports replying to the conversation message.
[0434] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application, the display device 40 applied to the folding screen device further includes a sending module 440;
[0435] The display module 410 is further configured to display a first device switching control on the first interface;
[0436] A sending module 440 is used to send a first device switching request to the cloud application server in response to an interactive operation on the first device switching control, wherein the first device switching request is used to request the cloud application server to send a first video stream to the first terminal so that the first terminal displays a picture corresponding to the first video stream, and the first terminal has a binding relationship with the first account;
[0437] The display module 410 is further used to display the second device switching control on the second interface;
[0438] The sending module 440 is also used to send a second device switching request to the cloud application server in response to an interactive operation on the second device switching control, wherein the second device switching request is used to request the cloud application server to send a second video stream to the second terminal so that the second terminal displays the picture corresponding to the second video stream, and the second terminal has a binding relationship with the second account.
[0439] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0440] The display module 410 is further used to display a first sub-interface and a second sub-interface of the cloud application on the first screen in response to an account adding operation for the cloud application, and to display a third sub-interface and a fourth sub-interface of the cloud application on the second screen, wherein different sub-interfaces are used to present screens corresponding to different accounts;
[0441] The display module 410 is further configured to display a screen corresponding to the first merged video stream on the first sub-interface and the second sub-interface based on the first merged video stream sent by the cloud application server, wherein the first merged video stream is generated by the cloud application server according to the operation instruction stream triggered by different accounts;
[0442] The display module 410 is also used to display the pictures corresponding to the second merged video stream on the third sub-interface and the fourth sub-interface based on the second merged video stream sent by the cloud application server, wherein the second merged video stream is generated by the cloud application server according to the operation instruction stream triggered by different accounts.
[0443] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0444] The display module 410 is also used to display the picture corresponding to the merged video stream on the outer screen or inner screen of the folding screen device when it is detected that the folding screen is in a fully folded state, wherein the merged video stream is obtained by the cloud application server after merging the first video stream and the second video stream, and the inner screen is the first screen or the second screen.
[0445] Optionally, in the above Fig. 27 On the basis of the corresponding embodiment, in another embodiment of the display device 40 applied to the folding screen device provided in the embodiment of the present application,
[0446] The display module 410 is further configured to display a status prompt pop-up window on the outer screen or inner screen of the folding screen device after displaying the picture corresponding to the merged video stream on the outer screen or inner screen of the folding screen device, wherein the status prompt pop-up window is used to prompt the folding screen device to be adjusted to the unfolded state or the stand state;
[0447] The display module 410 is also used to display the picture corresponding to the first video stream on the first interface and display the picture corresponding to the second video stream on the second interface when it is detected that the folding screen is in the unfolded state or the support state.
[0448] The present application also provides an electronic device, which may be a terminal. Fig.28 For the sake of convenience, only the parts related to the embodiments of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiments of the present application. In the embodiments of the present application, the electronic device is a mobile phone as an example for explanation:
[0449] Fig.28 FIG. 1 is a block diagram showing a partial structure of a mobile phone related to an electronic device provided in an embodiment of the present application. Fig.28 The mobile phone includes: a radio frequency (RF) circuit 510, a memory 520, an input unit 530, a display unit 540, a sensor 550, an audio circuit 560, a mobile hotspot (wireless fidelity, WiFi) module 570, a processor 580, and a power supply 590. Those skilled in the art can understand that Fig.28 The mobile phone structure shown in the figure does not constitute a limitation on the mobile phone, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0450] Combine the following Fig.28 A detailed introduction to the various components of the mobile phone:
[0451] The RF circuit 510 can be used for receiving and sending signals during information transmission or calls. In particular, after receiving the downlink information of the base station, it is sent to the processor 580 for processing; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit 510 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc. In addition, the RF circuit 510 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to the global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), email, short messaging service (SMS), etc.
[0452] The memory 520 can be used to store software programs and modules. The processor 580 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 520. The memory 520 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 520 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0453] The input unit 530 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile phone. Specifically, the input unit 530 may include a touch panel 531 and other input devices 532. The touch panel 531, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 531 or near the touch panel 531 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 531 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the processor 580, and can receive and execute commands sent by the processor 580. In addition, the touch panel 531 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 531, the input unit 530 may further include other input devices 532. Specifically, the other input devices 532 may include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a mouse, a joystick, etc.
[0454] The display unit 540 can be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 540 may include a display panel 541. Optionally, the display panel 541 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch panel 531 may cover the display panel 541. When the touch panel 531 detects a touch operation on or near it, it is transmitted to the processor 580 to determine the type of touch event. Subsequently, the processor 580 provides a corresponding visual output on the display panel 541 according to the type of touch event. Although in Fig.28 In the embodiment, the touch panel 531 and the display panel 541 are used as two independent components to realize the input and output functions of the mobile phone, but in some embodiments, the touch panel 531 and the display panel 541 can be integrated to realize the input and output functions of the mobile phone.
[0455] The mobile phone may also include at least one sensor 550, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 541 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 541 and / or the backlight when the mobile phone is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the mobile phone, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.
[0456] The audio circuit 560, the speaker 561, and the microphone 562 can provide an audio interface between the user and the mobile phone. The audio circuit 560 can transmit the received audio data to the speaker 561 after converting the received audio data into an electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 562 converts the collected sound signal into an electrical signal, which is received by the audio circuit 560 and converted into audio data, and then the audio data is output to the processor 580 for processing, and then sent to another mobile phone through the RF circuit 510, or the audio data is output to the memory 520 for further processing.
[0457] WiFi is a short-range wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages and access streaming media through the WiFi module 570. It provides users with wireless broadband Internet access. Fig.28 A WiFi module 570 is shown, but it is understandable that it is not an essential component of the mobile phone and can be omitted as needed without changing the essence of the invention.
[0458] The processor 580 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. It executes various functions of the mobile phone and processes data by running or executing software programs and / or modules stored in the memory 520, and calling data stored in the memory 520. Optionally, the processor 580 may include one or more processing units; optionally, the processor 580 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 580.
[0459] The mobile phone also includes a power source 590 (such as a battery) for supplying power to various components. Optionally, the power source can be logically connected to the processor 580 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.
[0460] Although not shown, the mobile phone may also include a camera, a Bluetooth module, etc., which will not be described in detail here.
[0461] The steps performed by the electronic device in the above embodiments can be based on the Fig.28 The electronic device structure shown.
[0462] A computer-readable storage medium is also provided in an embodiment of the present application, on which a computer program is stored. When the computer program is executed by a processor, the steps of the methods described in the above embodiments are implemented.
[0463] A computer program product is also provided in an embodiment of the present application, including a computer program, which, when executed by a processor, implements the steps of the methods described in the above embodiments.
[0464] It is understandable that in the specific implementation of this application, related data such as user information and operation information are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.
[0465] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0466] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
[0467] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0468] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0469] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a server or terminal device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store computer programs.
[0470] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A display method applied to a folding screen device, characterized in that: The folding screen device includes a folding screen, the folding screen can be folded to form at least two screens, the at least two screens include a first screen and a second screen, and the display method includes: In response to a start-up operation for a cloud application, a first interface of the cloud application is displayed on the first screen, and a second interface of the cloud application is displayed on the second screen, wherein the first interface is used to present a screen corresponding to the first account, and the second interface is used to present a screen corresponding to the second account; Based on the first video stream sent by the cloud application server, displaying a picture corresponding to the first video stream on the first interface, wherein the first video stream is generated by the cloud application server according to a first operation instruction stream, and the first operation instruction stream is an operation instruction stream triggered by the first account; Based on the second video stream sent by the cloud application server, the picture corresponding to the second video stream is displayed on the second interface, wherein the second video stream is generated by the cloud application server according to the second operation instruction stream, and the second operation instruction stream is an operation instruction stream triggered by the second account.
2. The display method according to claim 1, characterized in that: In response to the start-up operation for the cloud application, displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen includes: In response to a start-up operation for the cloud application, displaying a first login interface on the first screen, and displaying a second login interface on the second screen; In response to a first login operation on the first login interface, displaying the first interface of the cloud application on the first screen, wherein the first login operation is used to log in using the first account; In response to a second login operation on the second login interface, the second interface of the cloud application is displayed on the second screen, wherein the second login operation is used to log in using the second account.
3. The display method according to claim 1, characterized in that: In response to the start-up operation for the cloud application, displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen includes: When it is detected that the folding screen is in a fully folded state, in response to a startup operation for the cloud application, a login interface is displayed on an outer screen or an inner screen of the folding screen device, wherein the inner screen is the first screen or the second screen; In response to a login operation on the login interface, when it is detected that the folding screen is in an unfolded state or a stand state, the first interface of the cloud application is displayed on the first screen, and the second interface of the cloud application is displayed on the second screen, wherein the login operation is used to log in using the first account and the second account respectively, and the unfolded state includes a fully unfolded state.
4. The display method according to claim 1, characterized in that: In response to the start-up operation for the cloud application, displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen includes: In response to a startup operation for a cloud application, if it is detected that the folding screen device is successfully matched with at least two game controllers, a first login interface is displayed on the first screen, and a second login interface is displayed on the second screen; In response to a first login operation for the first login interface, displaying the first interface of the cloud application on the first screen, wherein the first login operation is for logging in using the first account, the first account is paired with a first game controller, and the at least two game controllers include the first game controller; In response to a second login operation for the second login interface, the second interface of the cloud application is displayed on the second screen, wherein the second login operation is used to log in using the second account, the second account has a pairing relationship with a second game controller, and the at least two game controllers include the second game controller.
5. The display method according to claim 4, characterized in that: The step of displaying the first interface of the cloud application on the first screen in response to a first login operation on the first login interface includes: In response to a key operation triggered by the first game controller, displaying device identification information of the first game controller on the first login interface; In response to the first login operation for the first login interface, matching the first account with the device identification information of the first game controller, and displaying the first interface of the cloud application on the first screen; The step of displaying the second interface of the cloud application on the second screen in response to the second login operation on the second login interface includes: In response to a key operation triggered by the second game controller, displaying device identification information of the second game controller on the second login interface; In response to a second login operation for the second login interface, the second account is matched with the device identification information of the second game controller, and the second interface of the cloud application is displayed on the second screen.
6. The display method according to claim 1, characterized in that: In response to the start-up operation for the cloud application, displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen includes: When it is detected that the folding screen is in a fully folded state and the folding screen device is successfully matched with at least two game controllers, in response to a startup operation for the cloud application, a login interface is displayed on an outer screen or an inner screen of the folding screen device, wherein the inner screen is the first screen or the second screen; In response to a login operation on the login interface, when it is detected that the folding screen is in an unfolded state or a stand state, the first interface of the cloud application is displayed on the first screen, and the second interface of the cloud application is displayed on the second screen, wherein the login operation is used to log in using the first account and the second account respectively, the first account is paired with a first game controller, the second account is paired with a second game controller, the at least two game controllers include the first game controller and the second game controller, and the unfolded state includes a fully unfolded state.
7. The display method according to claim 1, characterized in that: After the response to the startup operation for the cloud application, the method further includes: In the case where the cloud application supports split-screen mode, if it is detected that the foldable screen device is not paired with a game controller, displaying a pairing control; In response to a selection operation on the pairing control, when the folding screen device turns on the Bluetooth function, displaying a Bluetooth search list, wherein the Bluetooth search list includes device identification information searched by the folding screen device; In a case where the Bluetooth search list includes the device identification information of the game controller, a pairing success message is displayed in response to a selection operation on the device identification information of the game controller, wherein the pairing success message is used to prompt that a communication connection relationship has been established between the game controller and the folding screen device.
8. The display method according to claim 1, characterized in that: After the response to the startup operation for the cloud application, the method further includes: In the case where the cloud application supports split-screen mode, if it is detected that the foldable screen device is not paired with a game controller, displaying a pairing control; In response to a selection operation on the pairing control, when the game controller establishes a communication connection with the folding screen device via a data cable, a pairing success message is displayed.
9. The display method according to any one of claims 1 to 8, characterized in that: The cloud application is a cloud gaming application, and the first account and the second account are different accounts belonging to the same game in the cloud gaming application; The step of displaying a picture corresponding to the first video stream on the first interface based on the first video stream sent by the cloud application server includes: Displaying a first virtual object in a first virtual scene on the first interface, wherein the first virtual object is a virtual object controlled by the first account; In response to a first operation instruction for the first virtual object, sending the first operation instruction to the cloud application server, so that the cloud application server renders the first virtual scene from the perspective of the first virtual object to obtain a first video frame, wherein the first operation instruction stream includes the first operation instruction, and the first video stream includes the first video frame; Based on the first video frame sent by the cloud application server, displaying a picture corresponding to the first video frame on the first interface provided by the first screen; The displaying a picture corresponding to the second video stream on the second interface based on the second video stream sent by the cloud application server includes: Displaying a second virtual object in a second virtual scene on the second interface, wherein the second virtual object is a virtual object controlled by the second account; In response to a second operation instruction for the second virtual object, sending the second operation instruction to the cloud application server, so that the cloud application server renders the second virtual scene from the perspective of the second virtual object to obtain a second video frame, wherein the second operation instruction stream includes the second operation instruction, and the second video stream includes the second video frame; Based on the second video frame sent by the cloud application server, a picture corresponding to the second video frame is displayed on the second interface provided by the second screen.
10. The display method according to any one of claims 1 to 8, characterized in that: The cloud application is a cloud gaming application, and the first account and the second account are different accounts belonging to the same game in the cloud gaming application; After displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen, the method further includes: Displaying a battle invitation message on the first interface, wherein the battle invitation message is used to prompt whether to initiate a battle invitation request to the second account; In response to a confirmation operation on the battle invitation message, displaying a battle joining message on the second interface, wherein the battle joining message is used to prompt whether to accept the battle invitation request initiated by the first account; In response to a confirmation operation on the battle joining message, a battle establishment message is displayed on the first interface and the second interface respectively, wherein the battle establishment message is used to prompt that the first account and the second account have established a battle relationship.
11. The display method according to any one of claims 1 to 8, characterized in that: The cloud application is a cloud gaming application, and the first account and the second account are different accounts belonging to the same game in the cloud gaming application; After displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen, the method further includes: When it is detected that the folding screen is in the stand state, a first battle prompt message is displayed on the first interface, and a second battle prompt message is displayed on the second interface, wherein the first battle prompt message is used to prompt the first account whether to join the battle, and the second battle prompt message is used to prompt the second account whether to join the battle; In response to a confirmation operation for the first battle prompt message and in response to a confirmation operation for the second battle prompt message, a battle establishment message is displayed on the first interface and the second interface respectively, wherein the battle establishment message is used to prompt that the first account and the second account have established a battle relationship.
12. The display method according to any one of claims 1 to 8, characterized in that: The cloud application is a cloud gaming application, and the first account and the second account are different accounts belonging to the same game in the cloud gaming application; After displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen, the method further includes: Displaying a team invitation message on the first interface, wherein the team invitation message is used to prompt whether to initiate a team invitation request to the second account; In response to a confirmation operation on the team invitation message, displaying a team joining message on the second interface, wherein the team joining message is used to prompt whether to accept the team invitation request initiated by the first account; In response to a confirmation operation on the team joining message, a team establishment message is displayed on the first interface and the second interface respectively, wherein the team establishment message is used to prompt that the first account and the second account have established a team relationship.
13. The display method according to any one of claims 1 to 8, characterized in that: The cloud application is a cloud gaming application, and the first account and the second account are different accounts belonging to the same game in the cloud gaming application; After displaying the first interface of the cloud application on the first screen and displaying the second interface of the cloud application on the second screen, the method further includes: When it is detected that the folding screen is in the unfolded state, a first team formation prompt message is displayed on the first interface, and a second team formation prompt message is displayed on the second interface, wherein the first team formation prompt message is used to prompt the first account whether to join the team, and the second team formation prompt message is used to prompt the second account whether to join the team, and the unfolded state includes a fully unfolded state; In response to a confirmation operation for the first team prompt message, and in response to a confirmation operation for the second team prompt message, a team establishment message is displayed on the first interface and the second interface respectively, wherein the team establishment message is used to prompt that the first account and the second account have established a team relationship.
14. The display method according to claim 1, characterized in that: The method further comprises: Displaying a first perspective switching control on the first interface; In response to an interactive operation on the first perspective switching control, the first interface is rotated 180 degrees clockwise, or the first interface is rotated 180 degrees counterclockwise; The method further comprises: Displaying a second perspective switching control on the second interface; In response to an interactive operation on the second perspective switching control, the second interface is rotated 180 degrees clockwise, or the second interface is rotated 180 degrees counterclockwise.
15. The display method according to claim 1, characterized in that: The method further comprises: In response to a start-up operation on the cloud application, displaying a login interface; In response to a login operation on the login interface, setting the first account or the second account as a primary account; If the first account is the primary account, a prompt message is displayed on the first interface when a message prompt condition is met; If the second account is the primary account, a prompt message is displayed on the second interface when a message prompt condition is met.
16. The display method according to claim 15, characterized in that: If the first account is the primary account, displaying a prompt message on the first interface when a message prompt condition is met includes: If the first account is the primary account, when the folding screen device receives an incoming call, a call reminder message is displayed on the first interface; If the second account is the primary account, displaying a prompt message on the second interface when the message prompt condition is met includes: If the second account is the main account, when the folding screen device receives an incoming call, an incoming call prompt message is displayed on the second interface.
17. The display method according to claim 15, characterized in that: If the first account is the primary account, displaying a prompt message on the first interface when a message prompt condition is met includes: If the first account is the primary account, when the folding screen device receives a conversation message, the conversation message is displayed in a first window presented on the first interface, wherein the first window supports replying to the conversation message; If the second account is the primary account, displaying a prompt message on the second interface when the message prompt condition is met includes: If the second account is the main account, when the folding screen device receives a conversation message, the conversation message is displayed in a second window presented on the second interface, wherein the second window supports replying to the conversation message.
18. The display method according to claim 1, characterized in that: The method further comprises: Displaying a first device switching control on the first interface; In response to an interactive operation on the first device switching control, sending a first device switching request to the cloud application server, wherein the first device switching request is used to request the cloud application server to send a first video stream to a first terminal so that the first terminal displays a picture corresponding to the first video stream, and the first terminal has a binding relationship with the first account; The method further comprises: Displaying a second device switching control on the second interface; In response to the interactive operation on the second device switching control, a second device switching request is sent to the cloud application server, wherein the second device switching request is used to request the cloud application server to send a second video stream to the second terminal so that the second terminal displays the picture corresponding to the second video stream, and the second terminal has a binding relationship with the second account.
19. The display method according to claim 1, characterized in that: The method further comprises: In response to an account joining operation for the cloud application, a first sub-interface and a second sub-interface of the cloud application are displayed on the first screen, and a third sub-interface and a fourth sub-interface of the cloud application are displayed on the second screen, wherein different sub-interfaces are used to present screens corresponding to different accounts; Based on the first merged video stream sent by the cloud application server, displaying a picture corresponding to the first merged video stream on the first sub-interface and the second sub-interface, wherein the first merged video stream is generated by the cloud application server according to the operation instruction stream triggered by different accounts; Based on the second merged video stream sent by the cloud application server, the screen corresponding to the second merged video stream is displayed on the third sub-interface and the fourth sub-interface, wherein the second merged video stream is generated by the cloud application server according to the operation instruction stream triggered by different accounts.
20. The display method according to claim 1, characterized in that: The method further comprises: When it is detected that the folding screen is in a fully folded state, a picture corresponding to the merged video stream is displayed on the outer screen or the inner screen of the folding screen device, wherein the merged video stream is obtained by the cloud application server merging the first video stream and the second video stream, and the inner screen is the first screen or the second screen.
21. The display method according to claim 20, characterized in that: After displaying the picture corresponding to the merged video stream on the outer screen or the inner screen of the folding screen device, the method further includes: Displaying a status prompt pop-up window on the outer screen or the inner screen of the folding screen device, wherein the status prompt pop-up window is used to prompt the folding screen device to be adjusted to an unfolded state or a stand state; When it is detected that the folding screen is in the unfolded state or the support state, the picture corresponding to the first video stream is displayed on the first interface, and the picture corresponding to the second video stream is displayed on the second interface.
22. A display device applied to a folding screen device, characterized in that: The folding screen device includes a folding screen, and the folding screen can be folded to form at least two screens, and the at least two screens include a first screen and a second screen. The display device applied to the folding screen device includes: A display module, configured to display a first interface of the cloud application on the first screen and a second interface of the cloud application on the second screen in response to a startup operation on the cloud application, wherein the first interface is used to present a screen corresponding to the first account, and the second interface is used to present a screen corresponding to the second account; The display module is further used to display a screen corresponding to the first video stream on the first interface based on the first video stream sent by the cloud application server, wherein the first video stream is generated by the cloud application server according to the first operation instruction stream, and the first operation instruction stream is an operation instruction stream triggered by the first account; The display module is also used to display the screen corresponding to the second video stream on the second interface based on the second video stream sent by the cloud application server, wherein the second video stream is generated by the cloud application server according to the second operation instruction stream, and the second operation instruction stream is an operation instruction stream triggered by the second account.
23. An electronic device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the display method according to any one of claims 1 to 21 are implemented.
24. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the display method according to any one of claims 1 to 21 are implemented.
25. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the display method according to any one of claims 1 to 21 are implemented.