Cloud terminal control method and device, computer device and storage medium
By dynamically managing the peripheral capabilities of local terminals on the cloud terminal side and switching the source of peripheral data acquisition, the problem of poor multi-terminal interactivity in existing technologies is solved, and more efficient cloud terminal control is achieved.
Patent Information
- Application Number
- CN202211331773.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-10-28
- Publication Date
- 2025-11-21
- Estimated Expiration
- 2042-10-28
AI Technical Summary
In existing technologies, cloud terminal control methods are limited to acquiring peripheral data from the main control terminal, resulting in poor interactivity between multiple local terminals and affecting the control effect.
By establishing a peripheral management module on the cloud terminal side, the peripheral capabilities of the local terminal can be dynamically managed, allowing the source of peripheral data acquisition to be switched in peripheral control mode, thereby obtaining peripheral data from the control terminal for control.
It improves the interactivity and control effect of multi-terminal simultaneous screen interaction and reduces the limitations of data acquisition from peripheral devices of the main control terminal.
Smart Images

Figure CN115801752B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of cloud terminal technology, and in particular to a cloud terminal control method, device, computer equipment, and storage medium. Background Technology
[0002] With the development of 5G networks, technological advancements, and improved hardware configurations of smart mobile devices, more and more people enjoy sharing with others on their devices to enhance communication efficiency or increase the user experience. Cloud terminals, as an emerging form of terminal, offer screen sharing capabilities, becoming a primary method for remote communication and sharing, such as screen sharing for office work and gaming. In cloud terminal applications, it's typically necessary to utilize the peripheral capabilities of the local terminal to control the cloud terminal.
[0003] In related technologies, after multiple local terminals establish a cloud terminal sharing connection, the cloud terminal typically controls the cloud terminal by acquiring the peripheral capabilities of the main control terminal in the local terminals.
[0004] However, the above-mentioned method of controlling cloud terminals based on the peripheral capabilities of the main control terminal has strong limitations, which will affect the interaction between multiple local terminals, resulting in poor control of cloud terminals. Summary of the Invention
[0005] This application provides a cloud terminal control method, apparatus, device, and storage medium. During cloud terminal control, the source of peripheral data acquisition can be switched based on actual needs, reducing the limitation of only being able to collect peripheral data from the main control terminal for cloud terminal control. This improves the interactivity of multi-terminal simultaneous screen interaction and enhances the control effect of the cloud terminal. The technical solution is as follows:
[0006] On the one hand, a cloud terminal control method is provided, the method comprising:
[0007] When the cloud terminal is in peripheral control mode, it receives peripheral switching information.
[0008] The second terminal obtains the second peripheral data of the second terminal indicated by the peripheral switching information; the second terminal is a slave control terminal that accesses the cloud terminal based on the cloud terminal connection channel sent by the first terminal; the first terminal is the master control terminal of the cloud terminal.
[0009] The cloud terminal is controlled based on the data from the second peripheral device.
[0010] On the other hand, a cloud terminal control method is provided, the method comprising:
[0011] When the cloud terminal is in peripheral control mode, the first cloud terminal screen is displayed; the first cloud terminal screen is a screen displayed based on the control operation of the first terminal; the first terminal is the main control terminal of the cloud terminal.
[0012] Upon receiving peripheral switching information, a second cloud terminal screen is displayed; the second cloud terminal screen is a screen that has been modified based on the second peripheral data of the second terminal indicated by the peripheral switching information; the second terminal is a slave control terminal that accesses the cloud terminal based on the cloud terminal connection channel sent by the first terminal.
[0013] On the other hand, a cloud terminal control device is provided, the device comprising:
[0014] The information receiving module is used to receive peripheral switching information when the cloud terminal is in peripheral control mode;
[0015] The first data acquisition module is used to acquire the second peripheral data of the second terminal indicated by the peripheral switching information; the second terminal is a slave control terminal that accesses the cloud terminal based on the cloud terminal connection channel sent by the first terminal; the first terminal is the master control terminal of the cloud terminal.
[0016] The control module is used to control the cloud terminal based on the data from the second peripheral device.
[0017] In one possible implementation, the device further includes:
[0018] The second data acquisition module is used to acquire the first peripheral data of the first terminal before receiving the peripheral switching information;
[0019] The control module is used to control the cloud terminal based on the first peripheral data if the first peripheral data is obtained.
[0020] The information receiving module is used to receive the peripheral switching information sent by the first terminal based on the received peripheral switching operation.
[0021] In one possible implementation, the device further includes:
[0022] The indicator module is used to instruct the cloud terminal to display a peripheral switching control if the first peripheral data is not obtained.
[0023] The information receiving module is used to receive peripheral switching information generated based on the touch operation of the control received by the peripheral switching control.
[0024] In one possible implementation, the information receiving module is configured to receive peripheral switching information generated by the first terminal based on the received touch operation on the peripheral switching control.
[0025] And / or,
[0026] Receive peripheral switching information generated by the second terminal based on the received touch operation of the peripheral switching control.
[0027] In one possible implementation, the device further includes:
[0028] The information sending module is used to, when controlling the cloud terminal based on the first peripheral data, if it receives peripheral switching information sent by the second terminal based on the received peripheral switching operation, instruct the second terminal to display permission prompt information; the permission prompt information is used to indicate that the second terminal does not have permission to perform peripheral switching.
[0029] In one possible implementation, the device further includes:
[0030] The information acquisition module is used to acquire peripheral capability information of the local terminal after the local terminal accesses the cloud terminal; the peripheral capability information indicates the peripheral capabilities supported by the local terminal; the local terminal includes the first terminal and the second terminal.
[0031] On the other hand, a cloud terminal control device is provided, the device comprising:
[0032] The first display module is used to display the first cloud terminal screen when the cloud terminal is in peripheral control mode; the first cloud terminal screen is a screen displayed based on the control operation of the first terminal; the first terminal is the main control terminal of the cloud terminal.
[0033] The second display module is also used to display a second cloud terminal screen when receiving peripheral switching information; the second cloud terminal screen is a screen that is modified based on the second peripheral data of the second terminal indicated by the peripheral switching information; the second terminal is a slave control terminal that accesses the cloud terminal based on the cloud terminal connection channel sent by the first terminal.
[0034] On the other hand, a computer device is provided, the computer device including a processor and a memory, the memory storing at least one computer program, the at least one computer program being loaded and executed by the processor to implement the cloud terminal control method described above.
[0035] On the other hand, a computer-readable storage medium is provided, wherein at least one computer program is stored in the computer-readable storage medium, the computer program being loaded and executed by a processor to implement the cloud terminal control method described above.
[0036] On the other hand, a computer program product is provided, the computer program product comprising at least one computer program, the computer program being loaded and executed by a processor to implement the cloud terminal control method provided in the various optional implementations described above.
[0037] The technical solution provided in this application may include the following beneficial effects:
[0038] The cloud terminal control method provided in this application embodiment allows the cloud terminal management platform to change the peripheral acquisition terminal based on the received peripheral switching information when the cloud terminal is in peripheral control mode. That is, it switches from acquiring peripheral data from the main control terminal to acquiring peripheral data from the slave control terminal, and controls the cloud terminal based on the peripheral data of the switched slave control terminal. This enables the cloud terminal to switch the source of peripheral data acquisition based on actual needs during the control process, reducing the limitation of only being able to acquire peripheral data from the main control terminal to control the cloud terminal, improving the interactivity of multi-terminal screen interaction, and improving the control effect of the cloud terminal.
[0039] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description
[0040] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0041] Figure 1 A schematic diagram of a cloud terminal control system corresponding to a cloud terminal control method provided in an exemplary embodiment of this application is shown;
[0042] Figure 2 A flowchart of a cloud terminal control method provided in an exemplary embodiment of this application is shown;
[0043] Figure 3 A flowchart of a cloud terminal control method provided in an exemplary embodiment of this application is shown;
[0044] Figure 4 A flowchart illustrating a cloud terminal control method according to an exemplary embodiment of this application is shown;
[0045] Figure 5 A schematic diagram of a cloud terminal control system illustrated in an exemplary embodiment of this application is shown;
[0046] Figure 6 This illustration shows an interactive diagram of a cloud terminal control method provided in an exemplary embodiment of this application;
[0047] Figure 7A block diagram of a cloud terminal control device provided in an exemplary embodiment of this application is shown;
[0048] Figure 8 A block diagram of a cloud terminal control device provided in an exemplary embodiment of this application is shown;
[0049] Figure 9 This is a structural block diagram of a computer device according to an exemplary embodiment;
[0050] Figure 10 A block diagram of a cloud terminal control device provided in an exemplary embodiment of this application is shown. Detailed Implementation
[0051] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.
[0052] Figure 1 This illustration shows a schematic diagram of a cloud terminal control system corresponding to the cloud terminal control method provided in an exemplary embodiment of this application. The system may include a first terminal 110, a cloud terminal 120, a second terminal 130, and a cloud terminal management platform 140.
[0053] In this context, cloud terminal 120 refers to a virtual terminal built on a cloud server. Cloud terminal platform 140 allows users to operate a certain number of virtual cloud terminals on the cloud server through a local terminal. The cloud terminal runs a complete operating system, and its functions are similar to those of a local terminal. For illustrative purposes, the operating system running in the cloud terminal can be Android, iOS, or other operating systems; this application does not impose any limitations on this.
[0054] The cloud terminal management platform 140 is used to manage related services in the cloud terminal. In this embodiment, the cloud terminal management platform can be used to manage the connection and information interaction between the cloud terminal and the local terminal. Indicatively, the cloud terminal management platform 140 can be used for authentication management and cloud terminal management. Authentication management refers to authenticating the account information of the accessed local terminal to verify the legality of the account of the local terminal accessing the cloud terminal. Cloud terminal management refers to the allocation management service for the cloud terminal. The cloud terminal management platform 140 can be implemented as a terminal or a server. When the cloud terminal management platform 140 is implemented as a server, it can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.
[0055] In this embodiment, the first terminal 110 is a local terminal connected to the cloud terminal 120 and having control permissions for the cloud terminal. Alternatively, the first terminal can be a local terminal that initiates cloud terminal sharing among local terminals that have established a connection with the cloud terminal, and the first terminal is the main control terminal of the cloud terminal. The screen of the first terminal can serve as a carrier of the interface content of the cloud terminal, that is, the interface content of the cloud terminal is displayed on the screen of the first terminal. The first terminal 110 can be a smartphone, tablet computer, laptop computer, desktop computer, smartwatch, smart TV, etc.
[0056] The second terminal 130 is a terminal that establishes a connection with the cloud terminal based on the cloud terminal connection channel of the first terminal; that is, the second terminal is a local terminal that shares the interface content of the cloud terminal with the first terminal, and the first terminal is a slave control terminal of the cloud terminal; in this embodiment of the application, there may be one or more second terminals 130, and the application does not limit the number of second terminals; the second terminal can be a smartphone, tablet computer, laptop computer, desktop computer, smartwatch, smart TV, etc.
[0057] The first terminal 110 and the second terminal 130 are local terminals relative to the cloud terminal 120. The local terminal refers to a device with screen display function. Each local terminal can have a cloud terminal application installed. The cloud terminal application is the terminal display entry point of the cloud terminal screen and can be used to apply for and connect to the cloud terminal, obtain the cloud terminal login token and cloud terminal address, obtain the cloud terminal application list, send local command streams, and receive audio and video streams sent by the cloud terminal, etc.
[0058] In illustrative terms, the process of the first terminal accessing the cloud terminal can be implemented as follows: the first terminal opens the locally installed cloud terminal application based on the received user operation, completes account login, and sends a cloud terminal connection request to the cloud terminal management platform. After completing account authentication and cloud terminal management, the cloud terminal management platform completes the allocation and connection of the cloud terminal and transmits the audio and video data of the cloud terminal to the first terminal so that the first terminal can display the cloud terminal interface.
[0059] The process of the second terminal accessing the cloud terminal can be implemented as follows: The second terminal receives a cloud terminal connection channel sent by the first terminal. For example, the cloud terminal connection channel can be a cloud terminal link or QR code sent by the first terminal through a social application, etc. This application does not limit the implementation form of the cloud terminal connection channel or the method by which the first terminal sends the cloud terminal connection. The second terminal opens the locally installed cloud terminal application based on the cloud terminal connection channel, and sends a cloud terminal connection request to the cloud terminal management platform after completing account login. Based on the cloud terminal connection request, the cloud terminal platform connects the second terminal to the cloud terminal accessed by the first terminal, and transmits the audio and video data of the cloud terminal to the second terminal so that the second terminal displays the same cloud terminal interface as the first terminal, that is, the interface display content of the first terminal and the second terminal is consistent.
[0060] In the embodiments of this application, communication can be made between local terminals, between local terminals and cloud terminal management devices, and between cloud terminal management devices and cloud terminals through wired or wireless networks.
[0061] In one possible scenario, a local terminal can control a cloud terminal via peripheral capabilities. These peripheral capabilities can include cameras, microphones, GPS (Global Positioning System), Bluetooth, gravity sensors, gyroscopes, accelerometers, optical sensors, pressure sensors, etc. The local terminal collects peripheral data from its own peripheral capabilities and sends this data to the cloud terminal, enabling the cloud terminal to display images based on this data. However, in related technologies, the cloud terminal typically can only obtain peripheral data from one local terminal—that is, the peripheral data from the main control device—and cannot switch to other local devices. This limits screen-sharing interactions based on the peripheral capabilities of the local terminal in cloud terminal sharing scenarios. For example, when a user... When cloud terminals engage in screen mirroring, running game applications that require sensor parameter control can lead to poor screen mirroring and control of the cloud terminal, even if the control terminal has permission to operate the cloud terminal. This is because the cloud terminal can only collect sensor data from the main control terminal and cannot control the cloud terminal through peripheral data from the control terminal. Alternatively, even if the main control terminal lacks the peripheral capabilities currently required by the cloud terminal (i.e., the cloud terminal cannot obtain peripheral data from the main control terminal), the control terminal cannot control the cloud terminal through peripheral data from the control terminal. Consequently, the screen mirroring effect is poor, and the control effect of the cloud terminal is also poor.
[0062] To address the aforementioned issues, in this embodiment, a peripheral management module is established on the cloud terminal side. This module can register and manage the peripheral capabilities of local terminals connected to the cloud terminal. Simultaneously, during user operation of the cloud terminal, it can retrieve the current list of registered devices in the cloud terminal. This list includes the peripheral capabilities of registered local terminals and supports initiating switching commands for local terminals. After obtaining authorization from the corresponding local terminal, the peripheral capabilities of the cloud terminal and the local terminal are connected, thereby enabling the switching of the cloud terminal's peripheral data acquisition path and achieving dynamic management of the peripheral capabilities of multiple devices.
[0063] Figure 2 The flowchart shown is an exemplary embodiment of a cloud terminal control method provided in this application. This cloud terminal control method can be executed by a cloud terminal management platform, and the cloud terminal control device can be implemented as a server with cloud terminal management functions, such as... Figure 2 As shown, the cloud terminal control method may include the following steps:
[0064] Step 210: When the cloud terminal is in peripheral control mode, receive peripheral switching information.
[0065] This peripheral control mode refers to the mode of controlling the cloud terminal based on the collected peripheral data. This peripheral data can come from various peripheral devices of the local terminal. These peripheral devices can include image acquisition devices (such as cameras), audio acquisition devices (such as microphones), and various sensors, etc.
[0066] The cloud terminal can enter peripheral control mode based on control operations from the local terminal. For example, when a first application in the cloud terminal is opened based on control operations from the local terminal, the cloud terminal is determined to be in peripheral control mode. This first application is an application that runs based on peripheral data, such as an application that controls virtual objects based on volume data collected by the microphone of the local terminal; or an application that changes the position of virtual objects based on sensor data collected by the gyroscope sensor of the local terminal; or, when a control operation based on the local terminal triggers the target function of a second application, the cloud terminal is determined to be in peripheral control mode. For example, when a control operation based on the local terminal triggers the navigation function of a map application, and the local terminal's current location is determined and route planning is performed based on GPS data collected by the local terminal's GPS, the cloud terminal is determined to be in peripheral control mode. This application does not limit the way the cloud terminal enters peripheral control mode.
[0067] Step 220: Obtain the second peripheral data of the second terminal indicated by the peripheral switching information; the second terminal is a slave control terminal that accesses the cloud terminal through the cloud terminal connection channel sent by the first terminal; the first terminal is the master control terminal of the cloud terminal.
[0068] This peripheral switching information can instruct the cloud terminal to switch the way peripheral data is obtained from the first terminal to the second terminal.
[0069] In this embodiment of the application, the first terminal may correspond to multiple second terminals. The peripheral switching information can indicate that the peripheral data acquisition terminal is switched to one of the second terminals. For example, if the number of second terminals connected to the cloud terminal is 3, the peripheral switching information can indicate that the second peripheral data of one of the second terminals is acquired.
[0070] In one possible implementation, after receiving peripheral switching information, the cloud terminal management platform can communicate with the second terminal indicated by the peripheral switching information, send an authorization request to the second terminal, and after receiving the authorization information from the second terminal, invoke the peripheral capabilities of the second terminal, that is, obtain the second peripheral data of the second terminal; wherein, the authorization request may contain peripheral capability information currently required by the cloud terminal.
[0071] Step 230: Control the cloud terminal based on the second peripheral data.
[0072] In summary, the cloud terminal control method provided in this application allows the cloud terminal management platform to change the peripheral acquisition terminal based on the received peripheral switching information when the cloud terminal is in peripheral control mode. This means switching from acquiring peripheral data from the main control terminal to acquiring peripheral data from the slave control terminal, and then controlling the cloud terminal based on the switched peripheral data from the slave control terminal. This enables the cloud terminal to switch the source of peripheral data acquisition based on actual needs during the control process, reducing the limitation of only being able to acquire peripheral data from the main control terminal to control the cloud terminal, improving the interactivity of multi-terminal simultaneous screen interaction, and enhancing the control effect of the cloud terminal.
[0073] In this embodiment, when the main control terminal is connected to the cloud terminal and the cloud terminal is in peripheral control mode, the cloud terminal management platform defaults to prioritizing the use of peripheral data from the main control terminal to control the cloud terminal. However, there are two scenarios: the main control terminal has the peripheral functions required by the cloud terminal, and the main control terminal does not have the peripheral functions required by the cloud terminal. Therefore, under different circumstances, the peripheral switching information received by the cloud terminal management platform is triggered and sent by different operations. Figure 3 The flowchart shown is an exemplary embodiment of a cloud terminal control method provided in this application. This cloud terminal control method can be executed by a cloud terminal management platform, and the cloud terminal control device can be implemented as a server with cloud terminal management functions, such as... Figure 3 As shown, the cloud terminal control method may include the following steps:
[0074] Step 310: When the cloud terminal is in peripheral control mode, acquire the first peripheral data of the first terminal.
[0075] The first terminal is the main control terminal of the cloud terminal; optionally, after the first terminal connects to the cloud terminal, it registers its peripheral capabilities in the peripheral management module set in the cloud terminal management platform. In this embodiment, after the local terminal connects to the cloud terminal, the cloud terminal management platform obtains the peripheral capability information of the local terminal; the peripheral capability information indicates the peripheral capabilities supported by the local terminal, and the local terminal includes the first terminal and the second terminal; that is, any local terminal will register its peripheral capabilities in the peripheral management module after connecting to the cloud terminal, so that the terminal management platform can subsequently determine whether the local terminal has the peripheral capabilities required by the cloud terminal based on the stored peripheral capability information.
[0076] In this embodiment, the cloud terminal management platform prioritizes obtaining the first peripheral data of the first terminal; the first peripheral data is the peripheral data of the cloud terminal's current required peripheral capabilities collected by the first terminal.
[0077] When the cloud terminal management platform determines that the cloud terminal is in control mode, it prioritizes to obtain the first peripheral data of the first terminal. The acquisition results include whether the first peripheral data of the first terminal has been obtained or not. Based on the acquisition results, the cloud terminal is controlled in different ways.
[0078] When acquiring the first peripheral data, the method further includes: sending an authorization request to the first terminal; and acquiring the first peripheral data of the first terminal after receiving authorization consent information sent by the first terminal based on the authorization request. Correspondingly, after receiving the authorization request, the first terminal can display an authorization window. If it receives an authorization operation based on the authorization window (such as clicking a control indicating agreement to authorization), it generates and sends authorization consent information; if it receives a non-authorization operation based on the authorization window (such as clicking a control indicating disagreement to authorization, or closing the authorization window), it generates and sends disagreement to authorization information. In this case, the cloud terminal management device will not acquire the first peripheral data, i.e., it will not invoke the peripheral capabilities of the first terminal.
[0079] Step 320: If the first peripheral data is obtained, control the cloud terminal based on the first peripheral data.
[0080] When the first terminal has the peripheral capabilities required by the cloud terminal, the first terminal can collect the first peripheral data through the peripheral device and send the first peripheral data to the cloud terminal management platform. Correspondingly, the cloud terminal management platform obtains the first peripheral data. At this time, the cloud terminal management platform controls the cloud terminal based on the first peripheral data.
[0081] Step 330: When controlling the cloud terminal based on the first peripheral data, if peripheral switching information sent by the second terminal based on the received peripheral switching operation is received, the second terminal is instructed to display permission prompt information; the permission prompt information is used to indicate that the second terminal does not have permission to perform peripheral switching.
[0082] In this embodiment, the control terminal has control authority over the cloud terminal. However, the cloud terminal management platform can obtain the required peripheral data from the first terminal, and when the first terminal does not perform peripheral switching, the control authority of the first terminal is higher than that of the second terminal. Therefore, even if the second terminal sends peripheral switching information to the cloud terminal management platform based on the received peripheral switching operation, the cloud terminal management platform will not switch the peripheral data source based on the peripheral switching information. Furthermore, the cloud terminal management platform also instructs the second terminal to display permission prompt information to indicate that the second terminal does not have the permission to switch peripherals. Furthermore, the permission prompt information can also indicate the first terminal that has the permission to switch peripherals. Optionally, the permission prompt information can include the terminal identifier of the first terminal. Indicatively, the permission prompt information can be "Switching failed, please contact the main control device to switch".
[0083] Step 340: Receive peripheral switching information sent by the first terminal based on the received peripheral switching operation.
[0084] In this embodiment, the peripheral switching operation received by the local terminal can be based on the peripheral switching function provided in the local terminal. Illustratively, a list control can be displayed in the local terminal. When a touch operation based on the list control is received, a list of registered devices is displayed on the local terminal interface. This registration list can display the terminal identifiers of at least two local terminals. Furthermore, the registration list can also display the peripheral capability information corresponding to each local terminal, so that the user can select based on the peripheral capabilities of each local terminal when switching peripherals. When a selection switching operation based on the terminal identifiers in the registration list is received, it is determined that a peripheral switching operation has been received.
[0085] Step 350: If the first peripheral data is not obtained, instruct the cloud terminal to display the peripheral switching control.
[0086] If the cloud terminal management platform fails to obtain the data from the first peripheral device, it indicates that the first terminal does not possess the peripheral capabilities currently required by the cloud terminal. In this case, the cloud terminal management platform can instruct the cloud terminal to actively display a peripheral switching control. Correspondingly, the peripheral switching control is simultaneously displayed on each local terminal. This peripheral switching control can receive touch operations from any local terminal.
[0087] Step 360: Receive peripheral switching information generated based on the touch operation of the peripheral switching control.
[0088] Optionally, receive peripheral switching information generated based on the touch operation of the peripheral switching control, including:
[0089] Receive peripheral switching information generated by the first terminal based on the received touch operation of the peripheral switching control.
[0090] And / or,
[0091] Receive peripheral switching information generated by the second terminal based on the received touch operation of the peripheral switching control.
[0092] When the cloud terminal management platform receives peripheral switching information sent by multiple local terminals based on the peripheral switching control, the cloud terminal management platform performs peripheral switching based on the time sequence of receiving each peripheral switching information and the peripheral switching information received first.
[0093] In another possible approach, the cloud terminal management platform can analyze the peripheral capabilities of the second terminal indicated by each peripheral switching message based on the time sequence of the received peripheral switching information. The second terminal with the most prior received peripheral capabilities is then identified as the local terminal for this peripheral switching. For example, the cloud terminal management platform receives peripheral switching information sent by three local terminals using a peripheral switching control, ordered chronologically as peripheral switching information 1, peripheral switching information 2, and peripheral switching information 3. Peripheral switching information 1 indicates switching peripheral permissions to second terminal 1, peripheral switching information 2 indicates switching peripheral permissions to second terminal 2, and peripheral switching information 3 indicates switching peripheral permissions to second terminal 3. The cloud terminal management platform iterates through the peripheral switching information based on this chronological order, determining that second terminal 1 (corresponding to peripheral switching information 1) lacks the peripheral capabilities currently required by the cloud terminal, while second terminal 2 (corresponding to peripheral switching information 2) possesses the required peripheral capabilities. Therefore, second terminal 2 is identified as the local terminal for this peripheral switching.
[0094] In another possible approach, the cloud terminal management platform can also identify the second terminal with the largest number of received peripheral switching information indications as the local terminal for this peripheral switching. For example, if the cloud terminal management platform receives peripheral switching information sent by three local terminals based on the peripheral switching control, where peripheral switching information 1 indicates that peripheral permissions are switched to second terminal 1, peripheral switching information 2 indicates that peripheral permissions are switched to second terminal 2, and peripheral switching information 3 indicates that peripheral permissions are switched to second terminal 2, then second terminal 2 is identified as the local terminal for this peripheral switching.
[0095] In another possible implementation, the cloud terminal management platform can also identify the second terminal that received the last peripheral switching information indication as the local terminal for this peripheral switching.
[0096] It should be noted that the above-mentioned methods for determining the local terminal for this peripheral switch when the cloud terminal management platform receives peripheral switch information sent by multiple local terminals based on the peripheral switch control can be used separately or in combination, and this application does not impose any restrictions on this.
[0097] Step 370: Obtain the second peripheral data of the second terminal indicated by the peripheral switching information.
[0098] After receiving peripheral switching information, the cloud terminal management platform can communicate with the second terminal indicated by the peripheral switching information and send an authorization request to the second terminal. After receiving authorization information from the second terminal, the platform can access the second terminal's peripheral capabilities, i.e., obtain the second terminal's second peripheral data. This authorization request may contain information about the peripheral capabilities currently required by the cloud terminal. In other words, the authorization request sent by the cloud terminal management platform to the second terminal is a request for the currently required peripheral capabilities. For example, if the second terminal has multiple peripheral capabilities such as a microphone, camera, gyroscope sensor, and gravity sensor, and the cloud terminal currently requires a microphone, then the authorization request is used to request the second terminal to grant microphone permission. After receiving authorization, the cloud terminal management platform only accesses the microphone capability and not other capabilities to protect user security and privacy.
[0099] Step 380: Control the cloud terminal based on the second peripheral data.
[0100] In this embodiment of the application, controlling the cloud terminal based on peripheral data can be manifested as a change in the cloud terminal screen.
[0101] In summary, the cloud terminal control method provided in this application allows the cloud terminal management platform to change the peripheral acquisition terminal based on the received peripheral switching information when the cloud terminal is in peripheral control mode. This means switching from acquiring peripheral data from the main control terminal to acquiring peripheral data from the slave control terminal, and then controlling the cloud terminal based on the switched peripheral data from the slave control terminal. This enables the cloud terminal to switch the source of peripheral data acquisition based on actual needs during the control process, reducing the limitation of only being able to acquire peripheral data from the main control terminal to control the cloud terminal, improving the interactivity of multi-terminal simultaneous screen interaction, and enhancing the control effect of the cloud terminal.
[0102] Figure 4 A flowchart illustrating a cloud terminal control method according to an exemplary embodiment of this application is shown. This method can be executed by a cloud terminal. The cloud terminal control method includes:
[0103] Step 410: When the cloud terminal is in peripheral control mode, display the first cloud terminal screen; the first cloud terminal screen is a screen displayed based on the control operation of the first terminal; the first terminal is the main control terminal of the cloud terminal.
[0104] The screens displayed on each local terminal are all screens from the cloud terminal. The first cloud terminal screen can be a screen modified based on the touch operation received by the first terminal; or, the first cloud terminal screen can be a screen modified based on the first peripheral data of the first terminal when the first terminal has the peripheral capabilities currently required by the cloud terminal.
[0105] Step 420: After receiving the peripheral switching information, the second cloud terminal screen is displayed; the second cloud terminal screen is a screen that is modified based on the second peripheral data of the second terminal according to the peripheral switching operation instruction; the second terminal is a slave control terminal that accesses the cloud terminal based on the cloud terminal connection channel sent by the first terminal.
[0106] This peripheral switching operation can be performed based on the first terminal, or in some scenarios, it can be performed based on the second terminal. Different scenarios have different determination methods, and the determination process for each scenario can be referenced. Figure 3 The relevant details of the illustrated embodiments will not be repeated here.
[0107] When the display screen on the cloud terminal changes, the screen displayed on the local terminal will also change accordingly. Therefore, changes in the screen display on the local terminal can reflect changes in the display screen on the cloud terminal.
[0108] In summary, the cloud terminal control method provided in this application allows the cloud terminal to change the peripheral data acquisition terminal when it is in peripheral control mode, upon receiving peripheral switching information. Different screens are displayed based on peripheral information obtained from different peripheral acquisition terminals. This enables the switching of peripheral data acquisition sources based on actual needs during cloud terminal control, reducing the limitation of only being able to collect peripheral data from the main control terminal for cloud terminal control, improving the interactivity of multi-terminal simultaneous screen interaction, and enhancing the control effect of the cloud terminal.
[0109] In one possible scenario, after the peripheral data acquisition path of the cloud terminal is switched from the master control terminal to the slave control terminal based on peripheral switching information, the slave control terminal can also actively initiate peripheral switching. At this time, when the cloud terminal management platform receives the peripheral switching information sent based on the peripheral switching operation received by the slave control terminal, it can further perform peripheral switching based on the peripheral switching information. At this time, the peripheral switching information can instruct to switch the peripheral data acquisition path back to the master control terminal, or it can instruct to switch the peripheral data acquisition path to another slave control terminal.
[0110] Furthermore, after the peripheral data acquisition method is switched to the slave control terminal, the slave control terminal can actively initiate peripheral switching, and the master control terminal can also initiate peripheral switching. At this time, when the cloud terminal management platform receives the peripheral switching information sent by the peripheral switching operation received by the master control terminal, it can further perform peripheral switching based on the peripheral switching information. At this time, the peripheral switching information can instruct to switch the peripheral data acquisition method back to the master control terminal, or it can instruct to switch the peripheral data acquisition method to another slave control terminal.
[0111] Taking two local terminals as an example, Figure 5 A schematic diagram of a cloud terminal control system illustrated in an exemplary embodiment of this application is shown. The cloud terminal control system includes a cloud terminal management platform 510, an end-to-cloud transmission module 520, a cloud terminal 530, a first terminal 540, and a second terminal 550.
[0112] The cloud-end transmission module 520 may include a cloud-side transmission module and a terminal-side transmission module. The cloud-end transmission module 520 is used to establish communication between the local terminal and the cloud terminal. The cloud-side transmission module can run in the operating system of the cloud terminal 530 and is mainly responsible for receiving uplink command streams from the local terminals (including the first terminal 540 and the second terminal 550) and distributing downlink audio and video streams from the cloud terminals. The terminal-side transmission module can run in each local terminal. Furthermore, the terminal-side transmission module can run in the cloud terminal application installed in each local terminal and is mainly responsible for receiving downlink audio and video streams from the cloud terminals and sending uplink command streams from the local terminals. The cloud-side transmission module and the terminal-side transmission module transmit data through the network.
[0113] For information regarding the first terminal, cloud terminal, second terminal, and cloud terminal management platform, please refer to the following: Figure 1 The relevant content shown will not be repeated here.
[0114] In this embodiment of the application, the cloud terminal management platform 510 may further include a peripheral management module. The peripheral management module can register the peripheral capabilities of the local terminal and record the type of the terminal, that is, record whether the terminal is a master control device or a slave control device. When the cloud terminal needs to call the peripheral capabilities of the local terminal in the future, the peripheral management module can also filter and switch the peripheral data acquisition terminals.
[0115] Figure 6 This illustration shows an interactive diagram of a cloud terminal control method provided in an exemplary embodiment of this application. The method can be interactively executed by a first terminal, a second terminal, a cloud terminal, and a cloud terminal management platform. Figure 6 As shown, the cloud terminal control method includes:
[0116] S601, the first terminal connects to the cloud terminal.
[0117] S602, the cloud terminal returns audio and video streams to the first terminal.
[0118] S603: When the first terminal connects to the cloud terminal, it registers the peripheral capabilities of the first terminal at the cloud terminal management platform.
[0119] Furthermore, the first terminal registers its peripheral capabilities in the peripheral management module of the cloud terminal management platform.
[0120] S604, the first terminal shares the cloud terminal with the second terminal.
[0121] As an illustration, the first terminal can share the cloud terminal by sending a cloud terminal access channel.
[0122] S605, the second terminal connects to the cloud terminal.
[0123] That is, the second terminal connects to the cloud terminal based on the cloud terminal access channel sent by the first terminal.
[0124] S606, the cloud terminal returns audio and video streams to the second terminal.
[0125] The audio and video streams returned by the cloud terminal to the second terminal are the same as those returned to the first terminal.
[0126] S607: When the second terminal connects to the cloud terminal, the peripheral capabilities of the second terminal are registered at the cloud terminal management platform.
[0127] S608, the first terminal and / or the second terminal operate the cloud terminal application.
[0128] In this embodiment of the application, each local terminal may have operation permissions for the cloud terminal. However, when the cloud terminal has a need to call peripheral capabilities, it is necessary to call the peripheral capabilities of the first terminal first, that is, to obtain the peripheral data of the first terminal.
[0129] When an external device call is required, the cloud terminal management platform sends an authorization request to the first terminal, and the first terminal receives the authorization request accordingly.
[0130] As an illustration, the cloud terminal management platform can initiate an authorization request to the first terminal, causing the first terminal to display a pop-up window on its interface. Based on the operation received in the pop-up window, the platform can determine whether to authorize the cloud terminal management platform to call the peripheral capabilities of the first terminal.
[0131] S610: After the first terminal agrees to the authorization, the cloud terminal calls the peripheral capabilities of the first terminal.
[0132] The process of a cloud terminal calling the peripheral capabilities of a first terminal can be implemented as follows: the cloud terminal management platform obtains the first peripheral data of the first terminal, sends the first peripheral data to the cloud terminal, and the cloud terminal changes the screen based on the first peripheral data; or, the cloud terminal can directly obtain the first peripheral data to change the screen, and this application does not impose any restrictions on this.
[0133] By default, the cloud terminal calls the peripheral capabilities of the first terminal. However, there are scenarios where peripheral switching occurs. The interaction between the various devices differs under different peripheral switching scenarios. To illustrate, this application provides three possible interaction scenarios:
[0134] Scene 1:
[0135] S611, the first terminal sends peripheral switching information to the cloud terminal management platform.
[0136] S612, the cloud terminal management platform initiates an authorization request to the second terminal, and the second terminal receives the authorization request accordingly.
[0137] The second terminal is the slave control terminal indicated by the peripheral switching information.
[0138] S613: After the second terminal agrees to the authorization, the cloud terminal calls the peripheral capabilities of the second terminal.
[0139] Scene 2:
[0140] S614: When the cloud terminal calls the peripheral capabilities of the first terminal, the second terminal sends peripheral switching information to the cloud terminal management platform.
[0141] S615, the cloud terminal management platform sends permission prompt information to the second terminal.
[0142] This permission prompt message is used to indicate that the second terminal does not have the permission to switch peripherals and cannot switch peripherals. Furthermore, this permission prompt message can also remind the first terminal that has the permission to switch.
[0143] Scene 3:
[0144] S616 controls the cloud terminal to display the peripheral switching control when the cloud terminal management platform obtains abnormal data from the first peripheral device.
[0145] Among them, the abnormal acquisition of the first peripheral data can mean that the cloud terminal management platform is unable to obtain the peripheral data of the peripheral device that the cloud terminal needs to call from the first terminal.
[0146] S617, the first terminal performs a peripheral switching operation based on the peripheral switching control.
[0147] S618, the second terminal performs peripheral switching operations based on the peripheral switching control.
[0148] S619, the cloud terminal sends the peripheral switching information corresponding to the received peripheral switching operation to the cloud terminal management platform.
[0149] The cloud terminal management platform filters local terminals based on the received peripheral switching information to determine the peripheral data collection terminal.
[0150] In summary, this application provides a cloud terminal management system. By setting a peripheral management module in the cloud terminal management platform, the cloud terminal management method provided in this application can be implemented through the cloud terminal management system. When the cloud terminal is in peripheral control mode, the cloud terminal management platform can change the peripheral acquisition terminal based on the received peripheral switching information, that is, switch from acquiring peripheral data from the main control terminal to acquiring peripheral data from the slave control terminal. The cloud terminal is then controlled based on the peripheral data from the switched slave control terminal. This allows the source of peripheral data acquisition to be switched according to actual needs during the control of the cloud terminal, reducing the limitation of only being able to acquire peripheral data from the main control terminal to control the cloud terminal, improving the interactivity of multi-terminal simultaneous screen interaction, and improving the control effect of the cloud terminal.
[0151] Figure 7 This illustration shows a block diagram of a cloud terminal control device provided in an exemplary embodiment of this application. The cloud terminal control device can achieve the following: Figure 2 , Figure 3 or Figure 6 In any of the embodiments shown, the cloud terminal control device includes all or part of the following:
[0152] The information receiving module 710 is used to receive peripheral switching information when the cloud terminal is in peripheral control mode;
[0153] The first data acquisition module 720 is used to acquire the second peripheral data of the second terminal indicated by the peripheral switching information; the second terminal is a slave control terminal that accesses the cloud terminal based on the cloud terminal connection channel sent by the first terminal; the first terminal is the master control terminal of the cloud terminal.
[0154] The control module 730 is used to control the cloud terminal based on the data from the second peripheral device.
[0155] In one possible implementation, the device further includes:
[0156] The second data acquisition module is used to acquire the first peripheral data of the first terminal before receiving the peripheral switching information;
[0157] The control module 730 is used to control the cloud terminal based on the first peripheral data if the first peripheral data is obtained.
[0158] The information receiving module 710 is used to receive the peripheral switching information sent by the first terminal based on the received peripheral switching operation.
[0159] In one possible implementation, the device further includes:
[0160] The indicator module is used to instruct the cloud terminal to display a peripheral switching control if the first peripheral data is not obtained.
[0161] The information receiving module 710 is used to receive peripheral switching information generated based on the touch operation of the control received by the peripheral switching control.
[0162] In one possible implementation, the information receiving module 710 is configured to receive peripheral switching information generated by the first terminal based on the received touch operation on the peripheral switching control.
[0163] And / or,
[0164] Receive peripheral switching information generated by the second terminal based on the received touch operation of the peripheral switching control.
[0165] In one possible implementation, the device further includes:
[0166] The information sending module is used to, when controlling the cloud terminal based on the first peripheral data, if it receives peripheral switching information sent by the second terminal based on the received peripheral switching operation, instruct the second terminal to display permission prompt information; the permission prompt information is used to indicate that the second terminal does not have permission to perform peripheral switching.
[0167] In one possible implementation, the device further includes:
[0168] The information acquisition module is used to acquire peripheral capability information of the local terminal after the local terminal accesses the cloud terminal; the peripheral capability information indicates the peripheral capabilities supported by the local terminal; the local terminal includes the first terminal and the second terminal.
[0169] In summary, the cloud terminal control device provided in this application embodiment allows the cloud terminal management platform to change the peripheral acquisition terminal based on the received peripheral switching information when the cloud terminal is in peripheral control mode. That is, it switches from acquiring peripheral data from the main control terminal to acquiring peripheral data from the slave control terminal, and controls the cloud terminal based on the peripheral data of the switched slave control terminal. This enables the cloud terminal to switch the source of peripheral data acquisition based on actual needs during the control process, reducing the limitation of only being able to acquire peripheral data from the main control terminal to control the cloud terminal, improving the interactivity of multi-terminal simultaneous screen interaction, and improving the control effect of the cloud terminal.
[0170] Figure 8 This illustration shows a block diagram of a cloud terminal control device provided in an exemplary embodiment of this application. The cloud terminal control device can achieve the following: Figure 4 All or part of the steps in the illustrated embodiments, such as Figure 8 As shown, the cloud terminal control device includes:
[0171] The first display module 810 is used to display the first cloud terminal screen when the cloud terminal is in peripheral control mode; the first cloud terminal screen is a screen displayed based on the control operation of the first terminal; the first terminal is the main control terminal of the cloud terminal.
[0172] The second display module 820 is also used to display a second cloud terminal screen when receiving peripheral switching information; the second cloud terminal screen is a screen that is modified based on the second peripheral data of the second terminal indicated by the peripheral switching information; the second terminal is a slave control terminal that accesses the cloud terminal based on the cloud terminal connection channel sent by the first terminal.
[0173] In summary, the cloud terminal control device provided in this application embodiment allows the cloud terminal to change the peripheral data acquisition terminal when it is in peripheral control mode, upon receiving peripheral switching information. It can then display different screens based on peripheral information obtained from different peripheral acquisition terminals. This enables the switching of peripheral data acquisition sources based on actual needs during cloud terminal control, reducing the limitation of only being able to collect peripheral data from the main control terminal for cloud terminal control, improving the interactivity of multi-terminal simultaneous screen interaction, and enhancing the control effect of the cloud terminal.
[0174] Figure 9 A structural block diagram of a computer device 900 according to an exemplary embodiment of this application is shown. This computer device can be implemented as the cloud terminal control device described above in this application. The computer device 900 includes a Central Processing Unit (CPU) 901, a system memory 904 including Random Access Memory (RAM) 902 and Read-Only Memory (ROM) 903, and a system bus 905 connecting the system memory 904 and the CPU 901. The computer device 900 also includes a mass storage device 906 for storing an operating system 909, a client 910, and other program modules 911.
[0175] Without loss of generality, the computer-readable medium may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented using any method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data. Computer storage media include RAM, ROM, erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other solid-state memory technologies, CD-ROM, digital versatile disc (DVD) or other optical storage, magnetic tape cassettes, magnetic tape, disk storage, or other magnetic storage devices. Of course, those skilled in the art will recognize that the computer storage media are not limited to the above-mentioned types. The system memory 904 and mass storage device 906 described above can be collectively referred to as memory.
[0176] According to various embodiments of this application, the computer device 900 can also be connected to a remote computer on a network, such as the Internet. That is, the computer device 900 can be connected to a network 908 via a network interface unit 907 connected to the system bus 905, or it can use the network interface unit 907 to connect to other types of networks or remote computer systems (not shown).
[0177] The memory also includes at least one instruction, at least one program, code set, or instruction set, which are stored in the memory. The central processing unit 901 executes the at least one instruction, at least one program, code set, or instruction set to implement all or part of the steps in the cloud terminal control method shown in the above embodiments.
[0178] Figure 10 This illustration shows a structural block diagram of a computer device 1000 according to an exemplary embodiment of this application. The computer device 1000 can be implemented as the first terminal and the second terminal described above, such as a smartphone, tablet computer, laptop computer, desktop computer, smartwatch, and television. The computer device 1000 may also be referred to as user equipment, portable terminal, laptop terminal, desktop terminal, or other names.
[0179] Typically, computer device 1000 includes a processor 1001 and a memory 1002.
[0180] Processor 1001 may include one or more processing cores, such as a quad-core processor, a deca-core processor, etc. Processor 1001 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1001 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1001 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 1001 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.
[0181] The memory 1002 may include one or more computer-readable storage media, which may be non-transitory. The memory 1002 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1002 is used to store at least one instruction, which is executed by the processor 1001 to implement all or part of the steps in the cloud terminal control method shown in the method embodiments of this application.
[0182] In some embodiments, the computer device 1000 may optionally include a peripheral device interface 1003 and at least one peripheral device. The processor 1001, memory 1002, and peripheral device interface 1003 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1003 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 1004, a display screen 1005, a camera assembly 1006, an audio circuit 1007, and a power supply 1008.
[0183] In some embodiments, the computer device 1000 further includes one or more sensors 1009. The one or more sensors 1009 include, but are not limited to, an accelerometer 1010, a gyroscope 1011, a pressure sensor 1012, an optical sensor 1013, and a proximity sensor 1014.
[0184] Those skilled in the art will understand that Figure 10 The structure shown does not constitute a limitation on the computer device 1000, and may include more or fewer components than shown, or combine certain components, or use different component arrangements.
[0185] In one exemplary embodiment, a computer-readable storage medium is also provided, which stores at least one computer program that is loaded and executed by a processor to implement all or part of the steps in the cloud terminal control method described above. For example, the computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, or optical data storage device, etc.
[0186] In one exemplary embodiment, a computer program product is also provided, comprising at least one computer program that is loaded and executed by a processor. Figure 2 , Figure 3 , Figure 4 or Figure 6 All or part of the steps of the cloud terminal control method shown in any embodiment.
[0187] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the claims.
[0188] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.
Claims
1. A cloud terminal control method, characterized in that, The method is executed by a cloud terminal management platform, which registers the peripheral capabilities of each local terminal. The method includes: When the cloud terminal is in peripheral control mode, it receives peripheral switching information. The second terminal obtains the second peripheral data of the second terminal indicated by the peripheral switching information; the second terminal is a slave control terminal that accesses the cloud terminal based on the cloud terminal connection channel sent by the first terminal; the first terminal is the master control terminal of the cloud terminal. The cloud terminal is controlled based on the data from the second peripheral device. The method further includes the following steps before receiving peripheral switching information: If the first peripheral data of the first terminal is not obtained, the cloud terminal is instructed to display the peripheral switching control; the first peripheral data is the peripheral data of the cloud terminal’s current required peripheral capabilities collected by the first terminal; the peripheral switching control is synchronously displayed in each local terminal connected to the cloud terminal, and is used to receive control touch operation from any local terminal. The receiving of peripheral switching information includes: The peripheral switching information is received based on the touch operation of the control received by the peripheral switching control; wherein, when multiple local terminals receive the peripheral switching information sent by the peripheral switching control, the second terminal is determined based on the multiple peripheral switching information.
2. The method according to claim 1, characterized in that, Before receiving peripheral switching information, the method further includes: Obtain the first peripheral data of the first terminal; If the first peripheral data is obtained, the cloud terminal is controlled based on the first peripheral data; The receiving of peripheral switching information includes: Receive the peripheral switching information sent by the first terminal based on the received peripheral switching operation.
3. The method according to claim 1, characterized in that, The step of receiving peripheral switching information generated based on the touch operation of the peripheral switching control includes: The system receives peripheral switching information generated by the first terminal based on the received touch operation on the peripheral switching control. And / or, Receive peripheral switching information generated by the second terminal based on the received touch operation of the peripheral switching control.
4. The method according to claim 2, characterized in that, The method further includes: When controlling the cloud terminal based on the first peripheral data, if the peripheral switching information sent by the second terminal based on the received peripheral switching operation is received, the second terminal is instructed to display permission prompt information; the permission prompt information is used to indicate that the second terminal does not have permission to perform peripheral switching.
5. The method according to claim 1, characterized in that, The method further includes: After the local terminal accesses the cloud terminal, it obtains the peripheral capability information of the local terminal; the peripheral capability information indicates the peripheral capabilities supported by the local terminal; the local terminal includes the first terminal and the second terminal.
6. A cloud terminal control method, characterized in that, The method includes: When the cloud terminal is in peripheral control mode, the first cloud terminal screen is displayed; the first cloud terminal screen is a screen displayed based on the control operation of the first terminal; the first terminal is the main control terminal of the cloud terminal. Upon receiving peripheral switching information, a second cloud terminal screen is displayed; the second cloud terminal screen is a screen that has been modified based on the second peripheral data of the second terminal indicated by the peripheral switching information; the second terminal is a slave control terminal that accesses the cloud terminal based on the cloud terminal connection channel sent by the first terminal. The method further includes: Upon receiving an instruction from the cloud management platform, a peripheral switching control is displayed. The instruction is generated by the cloud terminal management platform when it has not acquired the first peripheral data of the first terminal. The peripheral switching information is generated by the touch operation of the control received by the peripheral switching control. The cloud terminal management platform has registered the peripheral capabilities of each local terminal. The first peripheral data is the peripheral data of the peripheral capabilities currently required by the cloud terminal collected by the first terminal. The peripheral switching control is synchronously displayed on each local terminal connected to the cloud terminal and is used to receive touch operations of the control from any local terminal. In the case of receiving peripheral switching information sent by multiple local terminals based on the peripheral switching control, the second terminal is determined based on the multiple peripheral switching information.
7. A cloud terminal control device, characterized in that, The device is used in a cloud terminal management platform, which has registered the peripheral capabilities of various local terminals in its settings. The device includes: The information receiving module is used to receive peripheral switching information when the cloud terminal is in peripheral control mode; The first data acquisition module is used to acquire the second peripheral data of the second terminal indicated by the peripheral switching information; the second terminal is a slave control terminal that accesses the cloud terminal based on the cloud terminal connection channel sent by the first terminal; the first terminal is the master control terminal of the cloud terminal. The control module is used to control the cloud terminal based on the data from the second peripheral device; The instruction module is used to instruct the cloud terminal to display a peripheral switching control if the first peripheral data of the first terminal is not obtained before receiving peripheral switching information; the first peripheral data is the peripheral data of the peripheral capabilities currently required by the cloud terminal collected by the first terminal; the peripheral switching control is synchronously displayed in each local terminal connected to the cloud terminal, and is used to receive control touch operation of any local terminal. The information receiving module is used to receive peripheral switching information generated by the control touch operation received by the peripheral switching control; wherein, when multiple local terminals send peripheral switching information based on the peripheral switching control, the second terminal is determined based on the multiple peripheral switching information.
8. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing at least one computer program, which is loaded and executed by the processor to implement the cloud terminal control method as described in any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one computer program, which is loaded and executed by a processor to implement the cloud terminal control method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Cloud game interaction method, system and device, storage medium and electronic equipment
CN112055227A
Network information interaction method and electronic equipment
CN113094128A