Input control method, device and electronic device applied to cloud application

By simultaneously displaying the character input areas of local input method and cloud input method in cloud applications, users can flexibly switch input methods and improve input efficiency and experience, solving the problem of single input method mode in cloud applications.

CN114816082BActive Publication Date: 2024-11-22TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110077732.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-20
Publication Date
2024-11-22
Estimated Expiration
2041-01-20

AI Technical Summary

Technical Problem

The single input method mode in cloud applications leads to inefficient user input and poor experience, especially in cloud games, users are accustomed to using specific input methods, but the default input method provided by the cloud cannot meet personalized needs.

Method used

The character input area of ​​the local input method and the cloud input method is displayed in the display interface of the cloud application. Users can edit characters through the local input method and display the edit results through the cloud input method to achieve flexible switching and instant response of the input method.

Benefits of technology

It improves the user's input efficiency and experience and solves the problem of single input method mode. Users can use the idiomatic local input method to edit characters and instantly see the key response of the local input method.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114816082B_ABST
    Figure CN114816082B_ABST
Patent Text Reader

Abstract

The embodiment of the present application discloses an input control method, device and electronic device applied to cloud applications, and relates to fields such as cloud technology and big data. The method includes: when the display interface of the cloud application obtains the first operation, the character input area of ​​the local input method of the terminal device and the input character display area of ​​the cloud input method corresponding to the cloud application are displayed, and the first operation is an operation initiated by the user to start the input method; when the character editing operation is received through the character input area of ​​the local input method, the text editing result corresponding to the character editing operation is displayed through the input character display area of ​​the cloud input method. With this method, in the cloud application, the user can switch to the character input area of ​​the local input method he likes to edit characters as needed, which can effectively improve the user's input efficiency and input experience, and make the mode of the input method in the cloud application no longer single, thereby improving the flexibility of the input method in the cloud application.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to fields such as cloud technology and big data, and in particular to an input control method, device and electronic device applied to cloud applications. Background Art

[0002] With the development of cloud technology, more and more people are starting to use cloud applications. The working principle of cloud applications is to change the traditional software usage mode of "local installation and local computing" into a "ready-to-use" service. It is a new type of application that connects and controls remote server clusters through the Internet or local area network to complete business logic or computing tasks. It can not only help users reduce Internet Technology (IT) costs, but also greatly improve work efficiency.

[0003] Take cloud gaming as an example. Cloud gaming is an online gaming technology based on cloud computing technology. Cloud gaming runs on cloud servers and generally provides a default cloud input method (that is, the pre-configured input method in cloud gaming). When players type in the game, the default input method will be pulled up. This way of providing a default input method makes the input method mode single, which may lead to low input efficiency due to users' unfamiliarity with the use, and poor typing experience for players.

[0004] Therefore, how to solve the problem of single input method mode in cloud applications has become an urgent problem to be solved. Summary of the invention

[0005] The embodiments of the present application provide an input control method, device, and electronic device for cloud applications, which can effectively improve the user's input efficiency and input experience, and increase the flexibility of the input method in the cloud application.

[0006] On the one hand, an embodiment of the present application provides an input control method applied to a cloud application, the method comprising:

[0007] When the display interface of the cloud application obtains a first operation, the character input area of ​​the local input method of the terminal device and the input character display area of ​​the cloud input method corresponding to the cloud application are displayed, wherein the first operation is an operation initiated by the user to start the input method;

[0008] When a character editing operation is received through the character input area of ​​the local input method, a text editing result corresponding to the character editing operation is displayed through the input character display area of ​​the cloud input method.

[0009] On the one hand, an embodiment of the present application provides an input control device applied to a cloud application, the device comprising:

[0010] An input method display module, configured to display a local character input area of ​​a terminal device and a cloud input display area of ​​the cloud application corresponding to a cloud server when a first operation is obtained on the display interface of the cloud application, wherein the first operation is an operation initiated by a user to start an input method;

[0011] The editing result display module is used to display the editing result corresponding to the character editing operation through the cloud input display area when a character editing operation is received through the local character input area.

[0012] In an optional embodiment, the input method display module is used to:

[0013] In response to the first operation, a first instruction is sent to the cloud server, so that the cloud server starts the cloud input method based on the first instruction, so that the input character display area of ​​the cloud input method is displayed on the terminal device, and an input method start message is sent to the terminal device;

[0014] In response to the input method start-up message, the local input method is started and the character input area of ​​the local input method is displayed.

[0015] In an optional embodiment, the input method display module is further used for:

[0016] In response to the first operation, the input character display area of ​​the local input method and the character input area of ​​the cloud input method are hidden.

[0017] In an optional embodiment, the input method display module is used to:

[0018] The character input area of ​​the local input method and the input character display area of ​​the cloud input method are displayed without overlapping.

[0019] In an optional embodiment, the input method display module is used to:

[0020] Displaying the input character display area of ​​the cloud input method above the character input area of ​​the local input method;

[0021] The input character display area of ​​the cloud input method is displayed in the input character display area of ​​the local input method corresponding to the character input area of ​​the local input method.

[0022] In an optional embodiment, the editing result display module is used to:

[0023] When the character editing operation is received through the character input area of ​​the local input method, an event message corresponding to the character editing operation is sent to the cloud service;

[0024] Receiving a rendering image of an input character display area corresponding to the cloud input method sent by the cloud server based on the event message;

[0025] The rendering picture is received, and a text editing result corresponding to the rendering picture is displayed in the input character display area of ​​the cloud input method.

[0026] In an optional embodiment, the above-mentioned character editing operation includes a character input operation, a character modification operation, or a character deletion operation;

[0027] If the character editing operation is the character input operation, the event message includes a corresponding input result, the rendering screen includes the input result screen corresponding to the input result, and the editing result display module is used to:

[0028] Displaying the text editing result corresponding to the above input result screen through the input character display area of ​​the above cloud input method;

[0029] If the character editing operation is the character modification operation, the event message includes character modification information corresponding to the character modification operation, the rendering screen includes a character modification instruction corresponding to the character modification information, and the editing result display module is used to:

[0030] Displaying the text editing result corresponding to the above character modification screen through the input character display area of ​​the above cloud input method;

[0031] If the character editing operation is the character deleting operation, the event message includes character deleting information corresponding to the character deleting operation, the rendering screen includes a character deleting screen corresponding to the character deleting information, and the editing result display module is used to:

[0032] The text editing result corresponding to the above-mentioned character deletion screen is displayed in the input character display area of ​​the above-mentioned cloud input method.

[0033] In an optional embodiment, the input method display module is further used for:

[0034] When the display interface of the cloud application obtains the second operation, the character input area of ​​the local input method and the input character display area of ​​the cloud input method are closed, wherein the second operation is an operation initiated by the user to close the input method.

[0035] In an optional embodiment, the input method display module is further used for:

[0036] In response to the second operation, a second instruction is sent to the cloud server, so that the cloud server closes the cloud input method based on the second instruction, so that the input character display area of ​​the cloud input method is closed on the terminal device, and an input method closing message is sent to the terminal device;

[0037] In response to the input method closing message, the local input method is closed, and the character input area of ​​the local input method is closed.

[0038] On the one hand, an embodiment of the present application provides an input control method applied to a cloud application, the method comprising:

[0039] Receiving a first instruction sent by a terminal device, wherein the first instruction is sent by the terminal device in response to a first operation of a user on a display interface of a cloud application, wherein the first operation is an operation initiated by the user to start an input method;

[0040] In response to the above-mentioned first instruction, the cloud input method is started so that the above-mentioned terminal device displays the input character display area of ​​the cloud input method corresponding to the above-mentioned cloud application, and an input method startup message is sent to the above-mentioned terminal device so that the above-mentioned terminal device starts the local input method according to the above-mentioned input method startup message and displays the character input area of ​​the above-mentioned local input method; and when a character editing operation of the user is received through the character input area of ​​the above-mentioned local input method of the above-mentioned terminal device, the text editing result corresponding to the above-mentioned character editing operation is displayed in the input character display area of ​​the above-mentioned cloud input method of the above-mentioned terminal device.

[0041] On the one hand, an embodiment of the present application provides an input control device applied to a cloud application, the device comprising:

[0042] An instruction receiving module, configured to receive a first instruction sent by a terminal device, wherein the first instruction is sent by the terminal device in response to a first operation of a user on a display interface of a cloud application, wherein the first operation is an operation initiated by the user to start an input method;

[0043] The editing result processing module is used to start the cloud input method in response to the above-mentioned first instruction, so that the above-mentioned terminal device displays the input character display area of ​​the cloud input method corresponding to the above-mentioned cloud application, send an input method startup message to the above-mentioned terminal device, so that the above-mentioned terminal device starts the local input method according to the above-mentioned input method startup message, displays the character input area of ​​the above-mentioned local input method, and when receiving the user's character editing operation through the character input area of ​​the above-mentioned local input method of the above-mentioned terminal device, control the input character display area of ​​the above-mentioned cloud input method of the above-mentioned terminal device to display the text editing result corresponding to the above-mentioned character editing operation.

[0044] In an optional embodiment, the editing result processing module is used to:

[0045] Receiving an event message corresponding to the character editing operation sent by the terminal device;

[0046] Determine a rendering screen corresponding to the input character display area of ​​the cloud input method according to the event message, and send the rendering screen to the terminal device so that the terminal device displays the text editing result corresponding to the rendering screen in the input character display area of ​​the cloud input method according to the rendering screen.

[0047] On the one hand, an embodiment of the present application provides an input control system applied to a cloud application, the system comprising a cloud server and a terminal device, wherein:

[0048] The terminal device is used to receive a first operation of a user on a display interface of a cloud application, and send a first instruction to the cloud server in response to the first operation, wherein the first operation is an operation initiated by the user to start an input method;

[0049] The cloud server is configured to receive the first instruction, and in response to the first instruction, start the cloud input method so that the terminal device displays the input character display area of ​​the cloud input method corresponding to the cloud application, and send an input method start message to the terminal device;

[0050] The terminal device is used to receive and respond to the input method startup message, start the local input method, and display the character input area of ​​the local input method;

[0051] The terminal device is further configured to send an event message corresponding to the character editing operation to the cloud server when receiving a character editing operation through the character input area of ​​the local input method;

[0052] The cloud server is further configured to receive the event message, determine a rendering image corresponding to the input character display area of ​​the cloud input method according to the event message, and send the rendering image to the terminal device;

[0053] The terminal device is further used to receive the rendering picture, and display the text editing result corresponding to the rendering picture through the input character display area of ​​the cloud input method.

[0054] In an optional embodiment, the system further includes a proxy server, and the terminal device exchanges information with the cloud server via the proxy server.

[0055] On the one hand, an embodiment of the present application provides an electronic device, which includes a processor and a memory, which are interconnected; the memory is used to store computer programs; the processor is configured to execute a method provided by any possible implementation of the input control method applied to cloud applications when calling the above-mentioned computer program.

[0056] On the one hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement a method provided by any possible implementation of an input control method applied to a cloud application.

[0057] On the one hand, an embodiment of the present application provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided by any possible implementation of the input control method applied to a cloud application.

[0058] The beneficial effects of the technical solution provided by this application are:

[0059] In the embodiment of the present application, the input control method, device and electronic device applied to cloud applications provided by the embodiment of the present application, when the user uses the cloud application, the input method can be started through the display interface of the cloud application. At this time, the terminal device displays the character input area of ​​the local input method and the input character display area of ​​the cloud input method corresponding to the cloud application. For the user, the character input area of ​​the displayed local input method can be used to edit the characters, and the text editing result corresponding to the character editing operation can be displayed through the input character display area of ​​the cloud input method. In this way, on the one hand, the user can switch the input method to the local input method he is accustomed to for character editing, which not only improves the user's character editing efficiency and the user's input experience, but also solves the technical problem of the single input method mode in the cloud application. On the other hand, since the user uses the local input method for character editing, the user can immediately see the key response of the local input method, which improves the user's input perception. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0061] Figure 1 It is a schematic diagram of an implementation flow of an input control system applied to a cloud application in an application scenario provided by an embodiment of the present application;

[0062] Figure 2a It is a flowchart of an input control method applied to a cloud application provided in an embodiment of the present application;

[0063] Figure 2b It is a schematic diagram of a display interface of a cloud application provided in an embodiment of the present application;

[0064] Figure 2c It is a schematic diagram of a character input area of ​​a local input method and an input character display area of ​​a cloud input method provided in an embodiment of the present application;

[0065] Figure 2d is a schematic diagram of a text editing process provided by an embodiment of the present application;

[0066] Figure 2e is a schematic diagram of a text editing result provided in an embodiment of the present application;

[0067] Figure 2f is a schematic diagram of sending text editing results provided by an embodiment of the present application;

[0068] Figure 3a is a flow chart of another input control method applied to cloud applications provided by an embodiment of the present application;

[0069] Figure 3b It is a schematic diagram of rewriting an input method in an Android system to obtain a cloud input method provided by an embodiment of the present application;

[0070] Figure 3c It is a flow chart of a communication process between a cloud input method and a cloud game backend provided in an embodiment of the present application;

[0071] Figure 3d It is a schematic diagram of an interface of a cloud input method and a cloud text box provided in an embodiment of the present application;

[0072] Figure 3e It is a schematic diagram of another method of rewriting an input method in an Android system to obtain a cloud input method provided by an embodiment of the present application;

[0073] Figure 3f It is a schematic diagram of a process of a cloud input method sending a message to a cloud game client provided by an embodiment of the present application;

[0074] Figure 3g It is a schematic diagram of the display height of a cloud text box and a software disk of a local input method provided in an embodiment of the present application;

[0075] Figure 3h It is a schematic diagram of an overload input, delete, and complete input interface provided in an embodiment of the present application;

[0076] Figure 3i It is a schematic diagram of a process of a cloud game client sending a message to a cloud input method provided by an embodiment of the present application;

[0077] Figure 4 It is an optional structural diagram of the distributed system 100 provided in the embodiment of the present application applied to the blockchain system;

[0078] Figure 5 It is an optional schematic diagram of the block structure (Block Structure) provided in the embodiment of the present application;

[0079] Figure 6 is a structural diagram of an input control device applied to a cloud application provided in an embodiment of the present application;

[0080] Figure 7 is a structural schematic diagram of another input control device applied to cloud applications provided in an embodiment of the present application;

[0081] Figure 8 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0082] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0083] The input control method for cloud applications provided in the embodiments of the present application involves various fields of cloud technology, such as cloud computing, cloud services, cloud games, cloud videos, etc. in cloud technology, as well as related data computing and processing fields in the big data field.

[0084] Cloud technology refers to a hosting technology that unifies hardware, software, network and other resources in a wide area network or a local area network to achieve data calculation, storage, processing and sharing. The input control method for cloud applications provided in the embodiment of the present application can be implemented based on cloud computing in cloud technology.

[0085] Cloud computing refers to obtaining required resources on demand and in an easily scalable manner through the network. It is the product of the integration of traditional computer and network technologies such as grid computing, distributed computing, parallel computing, utility computing, network storage technologies, virtualization, and load balancing.

[0086] Cloud gaming, also known as gaming on demand, is an online gaming technology based on cloud computing technology. Cloud gaming technology enables thin clients with relatively limited graphics processing and data computing capabilities to run high-quality games. In a cloud gaming scenario, the game is not played on the player's game terminal, but on a cloud server, which renders the game scene into a video and audio stream and transmits it to the player's game terminal over the network. The player's game terminal does not need to have powerful graphics computing and data processing capabilities, but only needs to have basic streaming media playback capabilities and the ability to obtain player input commands and send them to the cloud server.

[0087] Cloud video refers to a video network platform service based on the cloud computing business model. On the cloud platform, all video suppliers, agents, planning service providers, producers, industry associations, management agencies, industry media, legal structures, etc. are integrated into a resource pool. Each resource is displayed and interacted with each other, and communication is done on demand to reach an agreement, thereby reducing costs and improving efficiency. This concept is the concept of cloud video.

[0088] Artificial intelligence cloud service is generally referred to as AIaaS (AI as a Service). This is the current mainstream service mode of artificial intelligence platform. Specifically, AIaaS platform will split several common artificial intelligence services and provide independent or packaged services in the cloud, such as processing resource conversion requests.

[0089] Big data refers to a collection of data that cannot be captured, managed, and processed by conventional software tools within a certain time frame. It is a massive, high-growth, and diversified information asset that requires new processing models to have stronger decision-making power, insight discovery, and process optimization capabilities. With the advent of the cloud era, big data has also attracted more and more attention. Based on big data, special technologies are required to effectively implement the input control method for cloud applications provided in this embodiment, where technologies suitable for big data include large-scale parallel processing databases, data mining, distributed file systems, distributed databases, and the above-mentioned cloud computing.

[0090] As an example, Figure 1 FIG. 1 is a schematic diagram of an implementation flow of an input control system applied to a cloud application in an application scenario. It can be understood that the input control method applied to a cloud application provided in the embodiment of the present application can be applied to, but not limited to, Figure 1 In the application scenario shown.

[0091] In this example, taking the cloud application as a cloud game as an example, the input control system applied to the cloud application in this example may include but is not limited to a terminal device 101, a network 102, and a server 103. The terminal device 101 (such as a user's smart phone) can communicate with the server 103 through the network 102. The server 103 may include a database 1031 and a processing engine 1032. The processor 1032 is used to process various data generated during the operation of the cloud application. In the cloud game scenario, the processor 1032 can render the game scene as a video and audio stream and transmit it to the player's (ie, user's) terminal device through the network. The memory 1031 is used to store the application code of the cloud application and various data that need to be stored or cached during the operation of the cloud application. It may also include the login information of the user logging into the cloud application, the data records generated by the user when using the cloud application, etc.

[0092] The terminal device 101 may include a human-computer interaction screen 1011, a processor 1012 and a memory 1013. The display interface of the cloud application can be displayed on the human-computer interaction screen. The user can interact with the terminal device 101 through the human-computer interaction screen 1011 to implement the operation of the cloud application, such as receiving the user's first operation through the human-computer interaction screen 1011, wherein the first operation is an operation initiated by the user to start the input method. The processor 1012 can be used to play the video and audio stream (such as the game screen of the cloud application) corresponding to the cloud application (such as a cloud game) received from the server 103, and send a first instruction to the server 103 in response to the first operation. After the local input method is started, the human-computer interaction screen 1011 can also be used to display the character input area of ​​the local input method of the terminal device 101 and the input character display area of ​​the cloud input method corresponding to the cloud application, and receive the character editing operation through the character input area of ​​the local input method. The processor 1012 can also be used to obtain the text editing result according to the character editing operation. The memory 1013 is used to store various data of the terminal device 101, such as the text editing result.

[0093] like Figure 1 As shown, taking the cloud application as a cloud game as an example, the specific interaction process of the input control system applied to the cloud application in the present application may include steps S1-S8:

[0094] In step S1, the user triggers a cloud game start operation, and the terminal device 101 sends the cloud game start operation to the server 103 through the network 102. After receiving the cloud game start operation, the server 103 runs the cloud game in the server 103, and the processing engine 1032 renders the game scene of the cloud game into a video and audio stream, and sends the rendered video and audio stream to the terminal device 101 through the network 102.

[0095] Step S2, the terminal device 101 receives the video and audio stream of the cloud game, and displays the video and audio stream of the cloud game on the human-computer interaction screen 1011.

[0096] Step S3, in the terminal device 101, receiving the user's related operations through the human-computer interaction screen 1011. For example, when playing a game, the user can click / touch the chat box in the display interface to trigger the first operation, wherein the first operation is an operation initiated by the user to start the input method, and the processor 1012 sends a first instruction corresponding to the first operation to the cloud server through the network 102 in response to the first operation.

[0097] Step S4, the processing engine 1032 in the server 103 receives the first instruction, determines that the first instruction serves to pull up the input method, and then starts the cloud input method, pulls up the input character display area of ​​the cloud input method, and renders it, sends the rendering result of the input character display area of ​​the cloud input method (i.e., 01 shown in the figure) to the terminal device 101 through the network 102, and sends an input method startup message to the terminal device through the network 102.

[0098] Step S5, the terminal device 101 receives the input method startup message, pulls up the local input method, and displays the character input area of ​​the local input method (i.e., 02 shown in the figure) in the human-computer interaction screen 1011, and receives the rendering result of the input character display area of ​​the cloud input method, and displays the input character display area of ​​the cloud input method in the human-computer interaction screen 1011.

[0099] Step S6, for the user, the user can edit characters through the character input area of ​​the local input method displayed in the human-computer interaction screen 1011, and input the chat message that he wants to send during the chat process. When the user clicks / touches the corresponding button in the character input area of ​​the local input method, the processor 1012 can obtain the user's character editing operation, and obtain the event message corresponding to the character editing operation, and send the event message to the server 103 through the network 102.

[0100] Step S7, after receiving the event message, the processing engine 1032 in the server 103 can determine the rendering picture corresponding to the input character display area of ​​the cloud input method according to the event message, and send the rendering picture to the terminal device 101 through the network 102.

[0101] Step S8, the terminal device 101 receives the rendering picture sent by the server 103, and displays the text editing result corresponding to the rendering picture in the input character display area of ​​the cloud input method through the human-computer interaction screen 1011.

[0102] Among them, the database 1031 in the server 103 is used to store various data generated in steps S1, S4 and S7, such as the video and audio streams of the game scenes of the cloud game, and the memory 1013 in the terminal device 101 is used to store various data generated in steps S2-S3, S5-S6 and S8, such as event messages.

[0103] It is understandable that in the above example, taking the cloud application as a cloud game as an example, the application scenario in which the user can use the local input method to input chat information on the terminal device is described. In the actual application scenario, it is not limited to this application scenario. The cloud application can be an application in various application scenarios, such as online office software, cloud storage, email, map navigation, cloud music, cloud video, weight loss and fitness, financial management software, e-commerce and search engines, etc. Using the input control system of the above cloud application, the user can use the local input method to input the information he wants to input on the cloud application display interface of the terminal device. Specifically, the cloud application can also be a cloud video, such as the user can use the local input method to input the barrage information on the display interface of the cloud video while watching the video on the terminal device. The cloud application can also be cloud music, such as the user can enter comment information in the comment area through this input method, etc. The embodiment of the present application does not impose any restrictions on the specific usage scenarios.

[0104] Among them, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server or server cluster that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and basic cloud computing services such as big data and artificial intelligence platforms. The above-mentioned network may include but is not limited to: wired network, wireless network, wherein the wired network includes: local area network, metropolitan area network and wide area network, and the wireless network includes: Bluetooth, Wi-Fi and other networks that realize wireless communication. The terminal device can be a smart phone (such as Android mobile phone, iOS mobile phone, etc.), a tablet computer, a laptop computer, a digital broadcast receiver, MID (Mobile Internet Devices, mobile Internet device), PDA (personal digital assistant), desktop computer, vehicle terminal (such as vehicle navigation terminal), smart speaker, smart watch, etc. The terminal device and the server can be directly or indirectly connected by wired or wireless communication, but it is not limited to this. It can also be determined based on the actual application scenario requirements, and is not limited here.

[0105] See also Figure 2a , Figure 2a is a flow chart of an input control method for cloud applications provided by an embodiment of the present application. The method can be executed by any electronic device, such as a server, or by a terminal device and a server interacting with each other. Optionally, the method can be executed by a terminal device, such as Figure 2a As shown, the input control method applied to cloud applications provided in the embodiment of the present application includes the following steps:

[0106] Step S201, when the display interface of the cloud application obtains the first operation, the character input area of ​​the local input method of the terminal device and the input character display area of ​​the cloud input method corresponding to the above cloud application are displayed, wherein the above first operation is an operation initiated by the user to start the input method.

[0107] Step S202: When a character editing operation is received through the character input area of ​​the local input method, a text editing result corresponding to the character editing operation is displayed through the input character display area of ​​the cloud input method.

[0108] Optionally, the cloud application runs on the cloud server and does not know what input method the user's terminal device (such as a mobile phone) uses locally. The cloud application generally provides a default input method. When the user needs to type, the default input method of the cloud application will be pulled up. In this way, there will be the following two problems: Problem 1. Different users have different accustomed input methods. Some users are accustomed to input method A, and some users are accustomed to input method B. If all users are provided with the default input method of the cloud application, it will cause a poor typing experience for these users; 2. When the user types in the cloud application, the soft keyboard (SoftKeyBoard, also called virtual keyboard) runs in the cloud server. The local touch screen instructions of the terminal device (such as a mobile phone) must first be transmitted to the cloud server, and then the key response of the cloud soft keyboard will be triggered. There is a certain delay, which affects the user experience.

[0109] In order to solve the above problems, the present application provides an input control method applied to cloud applications, and the specific implementation steps of the method are as follows:

[0110] Step 1: Display a display interface of the cloud application in the terminal device, and receive a first operation of the user through the display interface, wherein the first operation is an operation initiated by the user to start the input method.

[0111] See also Figure 2b , Figure 2b is a schematic diagram of a display interface of a cloud application provided in an embodiment of the present application, such as Figure 2b As shown, the cloud application is a cloud game. The display interface of the cloud game shows a chat interface, a chat box corresponding to player 1 (i.e., the user corresponding to the terminal device, not shown in the figure), and relevant information of player 2, player 3, player 4, and player 5. Player 1 chats with other players 2, 3, 4, and 5. As shown in the figure, the chat message sent by player 2 is "Come here", the chat message sent by player 3 is "Come here with a microphone", the chat message sent by player 4 is "Come here with a microphone", and the chat message sent by player 5 is "Please take me with you". Player 1 can trigger the first operation by clicking / touching the chat box. Among them, Figure 2bThe display interface shown can also display other game elements of the cloud game, not limited to displaying Figure 2b The information shown.

[0112] Step 2: After acquiring the first operation, a character input area of ​​a local input method of the terminal device and an input character display area of ​​a cloud input method corresponding to a cloud application may be displayed in the terminal device.

[0113] Among them, the character input area of ​​the local input method can be understood as the soft keyboard of the local input method, which can also be called a virtual keyboard. Different from the physical keyboard, the soft keyboard is a software keyboard that pops up on the terminal device (such as a mobile phone) and will occupy the screen space of the terminal device (such as a mobile phone). The input character display area of ​​the cloud input method can be understood as the cloud text box corresponding to the cloud application.

[0114] In one example, the software disk of the local input method displayed in the terminal device can be directly clicked / touch controlled by the user. Alternatively, the software disk of the local input method displayed on the screen of the terminal device can also be controlled by a physical keyboard external to the terminal device, which is not limited here.

[0115] See also Figure 2c , Figure 2c is a schematic diagram of a character input area of ​​a local input method and an input character display area of ​​a cloud input method provided in an embodiment of the present application, such as Figure 2c As shown, when the user clicks / touches Figure 2b After opening the chat box in the chat box, the character input area of ​​the local input method and the input character display area of ​​the cloud input method are displayed. Users can edit the characters they want to input using their favorite local input method.

[0116] Step 3: The character input area of ​​the displayed local input method can receive the user's character editing operation, and the text editing result corresponding to the character editing operation can be displayed in the input character display area of ​​the cloud input method.

[0117] See also Figure 2d , Figure 2d is a schematic diagram of a text editing process provided by an embodiment of the present application, such as Figure 2b As shown, users can edit characters through the displayed local input method. Figure 2d In the example, when the user touches the buttons "C", "E" and "S" (i.e., character editing operation) respectively, the character input area of ​​the local input method displays "test", "toilet", "speed measurement", "calculation", "sideways", "side sleeping", "Book of Mountains" and "strategist" accordingly. Figure 2d When you press the "Test" key or the space bar, Figure 2d As shown in the figure, the space bar is pressed, and the following Figure 2eThe text editing result interface of the application shown in the figure shows "test" (i.e., text editing result) in the input character display area of ​​the cloud input method, and candidate texts related to the test are displayed in the character input area of ​​the local input method, i.e. Figure 2e The “volume”, “clothing”, “title”, “ceremony”, “edition”, and “next” shown in the text.

[0118] Step 4: When the user completes the input, the character input area of ​​the local input method and the input character display area of ​​the cloud input method will be closed accordingly, and the display will be switched to the text sending interface, such as Figure 2f As shown, at this time, the text to be sent in the chat box is "test", and the user can send the text "test" by clicking / touching the "Send" button.

[0119] It is understandable that the above is only an example and the embodiments of the present application are not limited thereto.

[0120] Through the embodiments of the present application, when a user uses a cloud application, he can start the input method through the display interface of the cloud application. At this time, the terminal device displays the character input area of ​​the local input method and the input character display area of ​​the cloud input method corresponding to the cloud application. For the user, the character input area of ​​the displayed local input method can be used to edit characters, and the text editing results corresponding to the character editing operation can be displayed through the input character display area of ​​the cloud input method. In this way, on the one hand, the user can switch the input method to the local input method he is accustomed to for character editing, which not only improves the user's character editing efficiency and the user's input experience, but also solves the technical problem of the single input method mode in the cloud application. On the other hand, since the user uses the local input method for character editing, the user can instantly see the key response of the local input method, which improves the user's input perception.

[0121] The specific process of how to start and display the character input area of ​​the local input method and the input character display area of ​​the cloud input method corresponding to the cloud application is described in detail below.

[0122] In an optional embodiment, when the first operation is obtained on the display interface of the cloud application, the character input area of ​​the local input method of the terminal device and the input character display area of ​​the cloud input method corresponding to the cloud application are displayed, including:

[0123] In response to the first operation, a first instruction is sent to the cloud server, so that the cloud server starts the cloud input method based on the first instruction, so that the input character display area of ​​the cloud input method is displayed on the terminal device, and an input method start message is sent to the terminal device;

[0124] In response to the input method start-up message, the local input method is started and the character input area of ​​the local input method is displayed.

[0125] Optionally, after receiving the first operation of the user, the terminal device may send a corresponding first instruction to the cloud server in response to the first operation. The first instruction is a click screen instruction or a touch screen instruction, which is not limited here.

[0126] After the cloud server receives the first instruction, it can respond to the first instruction. When it is determined that the first instruction corresponds to starting the input method, the cloud input method can be started, and the terminal device can display the input character display area of ​​the cloud input method. At the same time, an input method startup message is sent to the terminal device to inform the terminal device that the input method needs to be pulled up.

[0127] After receiving the input method start-up message, the terminal device starts the local input method and opens the character input area of ​​the local input method.

[0128] Specifically, the first operation indicates that the user wants to input text, and the specific form of the operation is not limited. For example, it can be a click / touch operation of the user in the "chat box" of the cloud application. The first instruction can include the position information (such as coordinate information) of the first operation in the display interface of the client of the cloud application. After the cloud server receives the first instruction, it can determine the user's operation position in the display interface according to the position information, and determine the user's specific operation based on the operation position. For example, when it is determined that the first operation is the position corresponding to the display area of ​​the "chat box", it can be determined that the first instruction is used to start the cloud input method, so that the cloud input method can be started in response to the first instruction. Accordingly, the input character display area of ​​the cloud input method pops up, and the display screen of the input character display area of ​​the cloud input method is rendered to obtain the rendering result, and the rendering result is sent to the terminal device. When the terminal device receives the rendering result, the input character display area of ​​the cloud input method can be displayed on the display interface of the terminal device. At the same time, the cloud server sends an input method startup message to the terminal device, informing the terminal device that the input method needs to be launched. After the terminal device receives the input method startup message, it starts the local input method and launches the character input area of ​​the local input method.

[0129] Through the embodiments of the present application, when the first operation is initiated on the terminal device, the cloud server can pull up the cloud input method and send an input method startup message to the terminal device, so that the terminal device starts the local input method. In this way, in the cloud application, the terminal device can instantly start the local input method, allowing the user to use the local input method they are accustomed to input text, thereby improving the input experience and input efficiency.

[0130] In an optional embodiment, the method may further include:

[0131] In response to the first operation, at least one of the input character display area of ​​the local input method and the character input area of ​​the cloud input method is hidden.

[0132] Optionally, when the local input method and the cloud input method are the same input method, the display effects of the character input area of ​​the local input method and the character input area of ​​the cloud input method are consistent, and the display effects of the input character display area of ​​the local input method and the input character display area of ​​the cloud input method are consistent, at least one item of the input character display area of ​​the local input method and the character input area of ​​the cloud input method can be hidden, which is not limited here.

[0133] In an optional embodiment, the method may further include:

[0134] In response to the first operation, the input character display area of ​​the local input method and the character input area of ​​the cloud input method are hidden.

[0135] Optionally, when the terminal device receives the user's first operation, the user only needs to see the character input area of ​​the local input method (i.e., the software disk of the local input method) and the input character display area (i.e., the text box) of the cloud input method that is ultimately used to display characters. At this time, the input character display area (i.e., the local text box) of the local input method started in response to the first operation and the character input area (i.e., the software disk of the cloud input method) of the cloud input method can be hidden to prevent the user from seeing two input methods and two text boxes.

[0136] When hiding the input character display area of ​​the local input method and the character input area of ​​the cloud input method, a variety of methods can be adopted. For example, the input character display area of ​​the local input method and the character input area of ​​the cloud input method can be set to be transparent (such as transparency is 0). Or, the input character display area of ​​the local input method and the character input area of ​​the cloud input method are not set to pop up. Or, the area where the character input area of ​​the local input method and the input character display area of ​​the cloud input method are located can be completely covered by the area where the input character display area of ​​the local input method and the character input area of ​​the cloud input method are located, and so on. This embodiment does not make any limitation to this.

[0137] Among them, when hiding the input character display area of ​​the local input method, the input character display area of ​​the local input method can be set to occupy an area of ​​the display interface of the size of one pixel and at the boundary position of the screen to prevent the user from accidentally touching the area. The specific setting of this area is not limited in this embodiment.

[0138] Through the embodiments of the present application, by hiding the input character display area of ​​the local input method and the character input area of ​​the cloud input method, the user can only see one input character display area (i.e., a text box) and one character input area (i.e., a software disk), thereby avoiding the display of multiple text boxes and multiple software disks and improving the rationality of the display effect setting.

[0139] In an optional embodiment, the character input area of ​​the local input method of the display terminal device and the input character display area of ​​the cloud input method corresponding to the cloud application include:

[0140] The character input area of ​​the local input method and the input character display area of ​​the cloud input method are displayed without overlapping.

[0141] Among them, the specific implementation method of the above-mentioned non-overlapping display of the character input area of ​​the local input method and the input character display area of ​​the cloud input method is not limited in the embodiment of the present application, and can be configured according to actual needs and different application scenarios. For example, the upper boundary of the local input character input area and the lower boundary of the input character display area of ​​the cloud input method can be made to coincide, or a certain gap can be left, or the cloud text box can be displayed below, to the left or to the right of the software disk of the local input method, and so on.

[0142] In an optional embodiment, the non-overlapping display of the character input area of ​​the local input method and the input character display area of ​​the cloud input method include:

[0143] Displaying the input character display area of ​​the cloud input method above the character input area of ​​the local input method;

[0144] The input character display area of ​​the cloud input method is displayed in the input character display area of ​​the local input method corresponding to the character input area of ​​the local input method.

[0145] Optionally, the character input area of ​​the local input method (i.e., the software disk of the local input method) and the input character display area of ​​the cloud input method (i.e., the cloud text box) may be displayed in the following multiple ways, as follows:

[0146] Method 1: The input character display area of ​​the cloud input method can be displayed above the character input area of ​​the local input method, and the character input area of ​​the local input method and the input character display area of ​​the cloud input method do not block each other.

[0147] Method 2: The input character display area (i.e., cloud text box) of the cloud input method can be displayed in the area where the input character display area (i.e., local text box) of the local input method originally resides, corresponding to the character input area of ​​the local input method. For example, the size of the cloud text box can be set to be the same as the size of the local text box, and then the cloud text box can be made to cover the local text box, or the cloud text box can be displayed and the local text box can be set to be transparent, or the cloud text box can be displayed without popping up the local text box, etc.

[0148] It is understandable that the above methods are only examples and can be combined with each other without any limitation.

[0149] Through the embodiments of the present application, the character input area of ​​the local input method and the input character display area of ​​the cloud input method can be displayed in a variety of ways, thereby improving the flexibility of the display method.

[0150] In an optional embodiment, when a character editing operation is received through the character input area of ​​the local input method, a text editing result corresponding to the character editing operation is displayed through the input character display area of ​​the cloud input method, including:

[0151] When the character editing operation is received through the character input area of ​​the local input method, an event message corresponding to the character editing operation is sent to the cloud service;

[0152] Receiving a rendering image of an input character display area corresponding to the cloud input method sent by the cloud server based on the event message;

[0153] The rendering picture is received, and a text editing result corresponding to the rendering picture is displayed in the input character display area of ​​the cloud input method.

[0154] Optionally, the character input area of ​​the local input method can receive the user's character editing operations, such as character input operations, character modification operations, or character deletion operations. At this time, an event message corresponding to the character editing operation will be triggered accordingly, and the event message can be sent to the cloud server.

[0155] When the cloud server receives the event message, it will process the cloud input accordingly according to the event message, obtain the processing result, render the processing result in the input character display area of ​​the cloud input method, obtain the rendering picture corresponding to the event message, and send the rendering picture to the terminal device.

[0156] When the terminal device receives the rendering picture sent by the cloud server, it plays the rendering picture, and displays the text editing result corresponding to the rendering picture in the input character display area of ​​the cloud input method. For example, if the rendering picture is an operation picture, then the terminal device can play the operation picture and the corresponding text result when the operation picture is finished playing, and the text result is the text editing result.

[0157] The above is only an example and the embodiments of the present application are not limited thereto.

[0158] Through the embodiments of the present application, users can flexibly perform character editing operations through the commonly used local input method, which greatly improves the user's typing experience and further improves the user's typing efficiency.

[0159] In an optional embodiment, the above-mentioned character editing operation includes a character input operation, a character modification operation, or a character deletion operation;

[0160] If the character editing operation is the character input operation, the event message includes a corresponding input result, the rendering screen includes an input result screen corresponding to the input result, and the input character display area through the cloud input method displays the text editing result corresponding to the rendering screen, including:

[0161] Displaying the text editing result corresponding to the above input result screen through the input character display area of ​​the above cloud input method;

[0162] If the character editing operation is the character modification operation, the event message includes character modification information corresponding to the character modification operation, the rendering screen includes a character modification screen corresponding to the character modification information, and the input character display area through the cloud input method displays a text editing result corresponding to the rendering screen, including:

[0163] Displaying the text editing result corresponding to the above character modification screen through the input character display area of ​​the above cloud input method;

[0164] If the character editing operation is the character deletion operation, the event message includes character deletion information corresponding to the character deletion operation, the rendering screen includes a character deletion screen corresponding to the character deletion information, and the input character display area through the cloud input method displays a text editing result corresponding to the rendering screen, including:

[0165] The text editing result corresponding to the above-mentioned character deletion screen is displayed in the input character display area of ​​the above-mentioned cloud input method.

[0166] The following describes the character editing operation as a character input operation, a character modification operation, or a character deletion operation:

[0167] 1. Character input operation: The user can input characters (i.e., character input operation) through the character input area of ​​the local input method, and intercept the characters input by the user through the input character display area of ​​the local input method that is not displayed, convert the intercepted characters into corresponding input results, and then send the input results to the cloud server. When the cloud service receives the input result, the cloud input method in the cloud server can extract the text in the input result, submit the extracted text to the cloud text box, and render the input process corresponding to the text to obtain the input result screen corresponding to the cloud text box, and send the input result screen to the terminal device. After the terminal device receives the input result screen, it plays the input result screen, and you can see the input result screen displayed in the input character display area of ​​the cloud input method (the input result screen includes the text).

[0168] 2. Character modification operation: The user can select the character to be modified through the character input area of ​​the local input method, and modify the character to be modified to the target character (i.e., character modification operation). At this time, the character modification information corresponding to the character modification operation will be triggered and sent to the cloud server. After the cloud service receives the character modification information, based on the character modification information, a character modification screen corresponding to the character modification information and to the cloud text box is obtained, and the character modification screen is sent to the terminal device. After the terminal device receives the character modification screen, the character modification screen can be played in the cloud text box. The character modification screen includes a character modification process and a character modification result. The character modification process can be a process of selecting the character to be modified and modifying the character to be modified to the target character. The character modification result can be the modified target character, which is the text editing result.

[0169] 3. Character deletion operation: The user can select characters to delete (i.e., character deletion operation) through the character input area of ​​the local input method. At this time, the character deletion information corresponding to the character deletion operation will be triggered and sent to the cloud server. After the cloud service receives the character deletion information, it obtains a character deletion screen corresponding to the character deletion information and to the cloud text box based on the character deletion information, and sends the character deletion screen to the terminal device. After the terminal device receives the character deletion screen, it can play the character deletion screen in the cloud text box. The character deletion screen includes a character deletion process and a character deletion result, wherein the character deletion process can be a process of deleting at least one character in front of the cursor, and the character deletion result can be the text information after deleting at least one character in the text information currently displayed in the cloud text box, and the text information after the deleted characters are the character editing result.

[0170] It is understandable that the above is only an example and the embodiments of the present application are not limited thereto.

[0171] It should be noted that, as an optional implementation, the user can process the character input operation, character modification operation or character deletion operation separately during the character editing process. That is, each time the user performs a character editing operation, the operation is processed once, such as when the user triggers a character input operation, the character input operation is processed, when the user triggers a character modification operation, the character modification operation is processed, and when the user triggers a character deletion operation, the character deletion operation is processed.

[0172] In actual applications, users may perform multiple edits during the character editing process. For example, in a relatively short period of time, the user may perform multiple operations including character input, character modification, or character deletion in sequence. As another optional implementation, a cache space may be configured on the client side of the cloud application, and character editing operations (which may be one or more of character input, character modification, or character deletion operations) occurring within a certain preset time (such as 0.1 seconds, 0.5 seconds, etc.) may be cached. When the preset time is reached, the event messages corresponding to all the character editing operations occurring within the preset time are uniformly sent to the cloud server for processing. For example, within a preset time (such as 0.5 seconds), if there are character input operations and character deletion operations in sequence, the character input operations and character deletion operations occurring within the preset time can be stored in a cache space. When the preset time ends, the input results corresponding to the character input operations occurring within the preset time and the character deletion information corresponding to the character deletion operations are sent to the cloud server. The cloud server processes the input results and character deletion information within the preset time in a unified manner to obtain an input result screen corresponding to the input results within the preset time and a character deletion screen corresponding to the character deletion information. The input result screen and character deletion screen are sent to the terminal device. When the terminal device receives the input result screen and the character deletion screen, the input result screen and the character deletion screen are played, thereby avoiding frequent processing by the cloud server.

[0173] Through the embodiments of the present application, character input, character modification or character deletion can be flexibly performed through character input operations, character modification operations, or character deletion operations, thereby improving the user's typing experience. Since the user uses the familiar local input method, the user's typing efficiency is also improved when editing characters.

[0174] In an optional embodiment, the method may further include:

[0175] When the display interface of the cloud application obtains the second operation, the character input area of ​​the local input method and the input character display area of ​​the cloud input method are closed, wherein the second operation is an operation initiated by the user to close the input method.

[0176] Optionally, when the user does not need to use the input method or completes character input, a second operation can be performed on the display interface of the cloud application, and in response to the second operation, the character input area of ​​the local input method and the input character display area of ​​the cloud input method are closed. The second operation is an operation initiated by the user to close the input method.

[0177] The character input area of ​​the local input method is referred to as the soft keyboard of the local input method, and the input character display area of ​​the cloud input method is referred to as the cloud text box to describe the specific process of closing the soft keyboard and cloud text box of the local input method.

[0178] The user can close the soft keyboard and cloud text box of the local input method by clicking / touching other blank areas except the soft keyboard and cloud text box of the local input method, or by clicking / touching other elements in the display interface except the soft keyboard and cloud text box of the local input method, or by clicking / touching the return key. In actual applications, it can be implemented according to the specific settings of the actual display interface and is not limited here.

[0179] Through the embodiments of the present application, users can close the input method and text box at any time as needed, which is convenient and flexible, and improves the user's input experience.

[0180] In an optional embodiment, when the display interface of the cloud application acquires the second operation, closing the character input area of ​​the local input method and the input character display area of ​​the cloud input method includes:

[0181] In response to the second operation, a second instruction is sent to the cloud server to enable the cloud server to close the cloud input method, so as to close the input character display area of ​​the cloud input method on the terminal device, and send an input method closing message to the terminal device;

[0182] In response to the input method closing message, the local input method is closed, and the character input area of ​​the local input method is closed.

[0183] Optionally, the specific implementation process of closing the character input area of ​​the local input method and the input character display area of ​​the cloud input method is as follows:

[0184] Receive a second operation of the user, respond to the second operation, and send a second instruction corresponding to the second operation to the cloud server. The second instruction can be a click screen instruction or a touch screen instruction, which is not limited here.

[0185] After the cloud server receives the second instruction, the cloud server will respond to the second instruction. When it is determined that the second instruction corresponds to closing the cloud input method, the cloud input method can be closed, and the terminal device can close the input character display area of ​​the cloud input method, and send an input method closing message to the terminal device.

[0186] After receiving the input method closing message, the terminal device will close the local input method according to the input method closing message.

[0187] Specifically, the second operation indicates that the user does not need to input text, and the specific form of the operation is not limited. For example, it can be a click / touch operation of the user in the area except the cloud text box and the local input method. The second instruction may include the location information (such as coordinate information) of the second operation in the display interface of the client of the cloud application. After the cloud server receives the second instruction, it can determine the user's operation position in the display interface according to the location information, and determine the user's specific operation based on the operation position. For example, when it is determined that the second operation corresponds to the location of the area except the cloud text box and the local input method, it can be determined that the second instruction is used to close the cloud input method, so that the second instruction can be responded to, the cloud input method can be started and closed, and accordingly, the cloud text box is closed, and the picture of closing the cloud text box is rendered at the same time to obtain the rendering result, and the rendering result is sent to the terminal device. When the terminal device receives the rendering result, the process of closing the cloud text box can be displayed on the display interface of the terminal device. At the same time, the cloud server sends an input method closing message to the terminal device, informing the terminal device that the input method needs to be closed. After the terminal device receives the input method closing message, the local input method is closed, and the character input area (i.e., the local text box) of the local input method is closed.

[0188] Through the embodiments of the present application, the terminal device and the cloud server can interact to close the local input method and at the same time close the cloud text box corresponding to the cloud input method, which is convenient and flexible.

[0189] See also Figure 3a , Figure 3a is a flow chart of another input control method for cloud applications provided by an embodiment of the present application. The method can be executed by any electronic device, such as a server, or by the interaction between a terminal device and a server. Optionally, the method can be executed by a server, such as Figure 3a As shown, the input control method applied to cloud applications provided in the embodiment of the present application includes the following steps:

[0190] Step S301, receiving a first instruction sent by a terminal device, wherein the first instruction is sent by the terminal device in response to a first operation of a user on a display interface of a cloud application, wherein the first operation is an operation initiated by the user to start an input method.

[0191] Step S302, in response to the above-mentioned first instruction, start the cloud input method so that the above-mentioned terminal device displays the input character display area of ​​the cloud input method corresponding to the above-mentioned cloud application, send an input method startup message to the above-mentioned terminal device, so that the above-mentioned terminal device starts the local input method according to the above-mentioned input method startup message, displays the character input area of ​​the above-mentioned local input method, and when the user's character editing operation is received through the character input area of ​​the above-mentioned local input method of the above-mentioned terminal device, the text editing result corresponding to the above-mentioned character editing operation is displayed in the input character display area of ​​the above-mentioned cloud input method of the above-mentioned terminal device.

[0192] Optionally, the following detailed description is given taking cloud gaming as an example of cloud application.

[0193] The following first introduces several concepts involved in the embodiments of the present application:

[0194] webrtc: An open source real-time audio and video communication solution.

[0195] View: The view in Android drawing.

[0196] ContentView: A view used to hold actual drawing content.

[0197] EditText: A text box used to enter text in Android.

[0198] Socket: Network communication interface.

[0199] Container: A virtualization solution where a server can run multiple containers, each of which can run Android or other operating systems.

[0200] Cloud Game Backend (CloudGame): A module in the cloud game project that collects game audio and video from the server-side Android system and is responsible for injecting touch screen coordinates, sensor data, etc. into the cloud game. In the GameMatrix cloud game project, this module is named CloudGame.

[0201] Cloud game transmission proxy (WebrtcProxy): responsible for receiving audio and video data sent from the cloud game backend, encoding it, and sending it to the mobile phone through the network. It is also responsible for sending the touch screen coordinates and sensor data sent from the mobile phone to the cloud game backend. In the GameMatrix cloud game project, this module is named WebrtcProxy. The cloud game transmission proxy is the proxy server described above.

[0202] The following is a detailed introduction to the cloud input method corresponding to cloud games:

[0203] In one example, the embodiment of the present application rewrites the input method (such as InputMethodService) in the Android container in the cloud server to obtain the cloud input method (named CgInputMethod) corresponding to the cloud game. Specifically, the cloud input method inherits from the InputMethodService input method in the Android system. The CgInputMethod input method is installed in the Android container of the cloud server, and the cloud input method is set as the default input method, and the onCreate of InputMethodService is rewritten, such as Figure 3b As shown, the arrows in the figure represent inheritance, that is, the onCreate function in the CgInputMethod input method inherits the onCreate function in the InputMethodService input method. The onCreate function can be a message response function.

[0204] like Figure 3c As shown, the Android system running in the container of the cloud server will start the cloud input method as a background service (Service), and will call the onCreate function of CgInputMethod. In the onCreate function, a thread create thread will be created, and a socket socket will be created in the thread. The socket is bound to a specified port and connected to the cloud game backend through the socket. After that, the cloud game backend will communicate with the cloud game client on the terminal device (such as a mobile phone).

[0205] The flow chart of the communication process between the CgInputMethod input method and the cloud game backend is as follows: Figure 3c Specifically, when the cloud game backend is started, a socket will be created and bound to the specified port through the bind function (the port number here is the same as the socket in CgInputMethod). Then, the connection between the socket of CgInputMethod and the socket of the cloud game backend is monitored through the listen function. When the connect function is called in CgInputMethod, CgInputMethod establishes a communication connection with the cloud game backend, and the cloud game backend returns this connection through the accept function. CgInputMethod and the cloud game backend can send read / write messages to each other through this connection (that is, write / read shown in the figure).

[0206] The following describes in detail how the terminal device knows that it needs to start / close the input method:

[0207] In one example, if Figure 2b As shown, when the user clicks / touches the chat box in the cloud game (i.e., the first operation) to start typing, the terminal device sends a first instruction corresponding to the first operation to the cloud server. When the cloud server receives the first instruction, Figure 3d As shown, the CgInputMethod input method (i.e., the character input area of ​​the cloud input method) and the corresponding cloud text box (i.e., the input character display area of ​​the cloud input method) running in the cloud game will be pulled up by the Android system.

[0208] When the Android system starts or closes the input method, it will call the onStartInput function / onFinishInput function of the input method respectively. Among them, the onStartInput function is used to start the input method, and the onFinishInput function is used to close the input method. In the embodiment of the present application, the onStartInput / onFinishInput function of InputMethodService is rewritten in the cloud input method CgInputMethod, such as Figure 3e As shown, the arrows shown in the figure represent inheritance, that is, the onCreate function, onStartInput function and onFinishInput function in the CgInputMethod input method inherit the onCreate function, onStartInput function and onFinishInput function in the InputMethodService input method.

[0209] Among them, the two functions onStartInput / onFinishInput are used to send the message of starting the input method and closing the input method to the cloud game backend, and send them to the cloud game client on the terminal device (such as a mobile phone) via the cloud game transmission agent. The cloud game client will correspondingly start or close the local input method of the terminal device (such as a mobile phone) according to whether it receives the message of starting the input method or the message of closing the input method. Among them, the message of starting the input method corresponds to the first instruction mentioned above, and the message of closing the input method corresponds to the second instruction mentioned above.

[0210] See also Figure 3f As shown, Figure 3f 1 is a flow chart of a cloud input method sending a message to a cloud game client provided by an embodiment of the present application. Figure 3fAs shown, the cloud input method can send the pull-up input method message / close input method message to the cloud game backend, and the cloud game backend then sends the pull-up input method message / close input method message to the cloud game transmission agent (i.e., the proxy server described above), and then the cloud game transmission agent sends the pull-up input method message / close input method message to the cloud game client on the terminal device (such as a mobile phone).

[0211] When the terminal device receives a message to launch the input method / close the input method, the terminal device will know that the local input method needs to be launched / closed, and will accordingly launch / close the local input method that the user is accustomed to, and display the software disk and cloud input box of the local input method on the terminal device, so that the user can use the local input method that he or she is accustomed to for character editing.

[0212] In one example, since the cloud server runs the CgInputMethod input method and the mobile phone runs the user's favorite input method locally, the cloud server and the terminal device display two different input methods. Since the soft keyboard layout and size of the two input methods are different, the local soft keyboard of the terminal device may cover the cloud text box in the cloud game. In order to ensure that the soft keyboard pulled up by the local input method of the terminal device does not cover the cloud text box in the cloud game, and that the cloud text box in the cloud game is located just above the software keyboard of the local input method of the terminal device, this can be achieved by adjusting the height of the soft keyboard of the local input method of the terminal device and the soft keyboard of the cloud input method to be consistent. The specific implementation process is as follows:

[0213] The EditText text box (i.e., cloud text box) of the cloud game client is laid out in the view of Android's ContentView (i.e., the view used to place actual drawing content). ContentView fills the entire screen of the phone by default. When the player clicks / touches the EditText text box, the soft keyboard of the local input method of the terminal device will pop up accordingly, and ContentView will be pushed up by the soft keyboard, that is, the cloud text box will be pushed up accordingly, such as Figure 3g As shown, Figure 3g The left side is a schematic diagram before the EditText text box is clicked / touched. It can be seen that the height of the ContentView at this time is the first height (that is, the display height of the EditText text box is the first height). After clicking / touching the EditText text box, the software disk of the local input method pops up, and the EditText text box is pushed up. At this time, the height of the ContentView is the second height (that is, the display height of the EditText text box is the second height).

[0214] In order to achieve Figure 3gThe display effect shown in the figure can be achieved by avoiding the local input method's software disk from blocking the cloud text box in the following ways:

[0215] By obtaining the height of the local ContentView of the terminal device, phoneContentViewHeight (which can also be understood as the height of the entire screen of the terminal device occupied by other display areas except the local software disk), and the height of the entire screen, phoneDisplayHeight (which can also be called the display height of the screen of the terminal device), the height of the soft keyboard of the local input method, phoneSoftKeyBoardHeight, is calculated:

[0216] phoneSoftKeyBoardHeight=phoneDisplayHeight-phoneContentViewHeight

[0217] Then calculate the ratio of the local input method's soft keyboard to the entire screen:

[0218] ratio=phoneSoftKeyBoardHeight / phoneDisplayHeight

[0219] Then, the cloud game client sends the ratio to the CgInputMethod input method in the cloud server through the cloud game transmission agent and the cloud game backend. After the CgInputMethod input method obtains the ratio, the CgInputMethod input method in the cloud server obtains the screen height in the Android container (recorded as containerDisplayHeight), and inversely infers the height of the soft keyboard in the Android container in the cloud server (recorded as expectedContainerSoftKeyBoardHeight):

[0220] expectedContainerSoftKeyBoardHeight=containerDisplayHeight*ratio

[0221] After obtaining the height of the soft keyboard in the Android container, the CgInputMethod input method in the cloud server will use this height to pull up the soft keyboard of the cloud input method and push the cloud text box of the cloud game to this height. At this time, the height of the soft keyboard of the local input method of the terminal device is consistent with the height of the soft keyboard of the cloud input method in the Android container, ensuring that the user can see the entire cloud text box, and the cloud text box and the software disk of the local input method do not block each other.

[0222] In addition, since the soft keyboard of the local input method of the terminal device pops up from the bottom, this process is very short, usually only a few hundred milliseconds. However, considering that the CgInputMethod input method soft keyboard in the Android container in the cloud server will also have a process of popping up from the bottom, in order to avoid players seeing two soft keyboards popping up at the same time, the CgInputMethod input method soft keyboard in the Android container in the cloud server can be set to transparent to ensure that players only see the local input method soft keyboard popping up.

[0223] Through the embodiments of the present application, the cloud input method is obtained by rewriting, so that the cloud input method can establish a communication connection with the cloud game client. When the cloud input method sends an input method launch message / input method close message to the terminal device, the terminal device will know that the local input method needs to be launched / closed. At this time, the cloud game client will also launch / close the local input method accordingly. On the one hand, the user uses the local input method he is accustomed to, which greatly improves the typing experience and improves the typing efficiency. On the other hand, by setting the cloud input method to be transparent, it can be ensured that the user only sees the process of the local input method's software disk popping up, thereby improving the display effect. On the other hand, the user can perform operations such as character editing through the local input method's software disk, which can achieve a key response close to that of the fast input method of the local game, thereby improving the cloud game experience.

[0224] The following describes in detail how the terminal device feeds back the local character editing operation to the cloud server.

[0225] In an optional embodiment, the method of displaying the text editing result corresponding to the character editing operation in the input character display area of ​​the cloud input method of the terminal device includes:

[0226] Receiving an event message corresponding to the character editing operation sent by the terminal device;

[0227] Determine a rendering screen corresponding to the input character display area of ​​the cloud input method according to the event message, and send the rendering screen to the terminal device so that the terminal device displays the text editing result corresponding to the rendering screen in the input character display area of ​​the cloud input method according to the rendering screen.

[0228] Optionally, the local input method can use a transparent local text box as a carrier to receive input (i.e. character input operation), and can obtain the text entered by the user from the local text box. However, the local text box alone is not enough to handle user deletion (i.e. character deletion operation), modification (i.e. character modification operation), and completion of input. You can overload the commitText, deleteSurroundingText, and performEditorAction interfaces of BaseInputConnection to implement the functions of obtaining the player's input text, deleting text, and completing input (such as closing the input method described above).

[0229] Among them, BaseInputConnection is the interface used in the Android system framework to handle the communication between the input method and the text box, such as Figure 3h As shown in the figure, by overloading the commitText, deleteSurroundingText and performEditorAction interfaces of BaseInputConnection, they will be called when the user enters text, deletes text and completes input. In these interfaces, the corresponding events will be sent to the cloud game transmission agent of the cloud server through the network, and finally sent to the CgInputMethod input method through the cloud game backend.

[0230] Specifically, see Figure 3i As shown, Figure 3i 1 is a flow chart of a cloud game client sending a message to a cloud input method provided by an embodiment of the present application. Figure 3i As shown, the cloud game client can send event messages such as inputting text, deleting text and completing input to the cloud game transmission agent through the cloud game client, and then send these event messages to the cloud game backend via the cloud game transmission agent. The cloud game backend then sends these event messages to the cloud input method, and the cloud input method will obtain the corresponding rendering screen based on these event messages.

[0231] The specific process of the CgInputMethod input method in the cloud server processing the cloud game client event message is as follows:

[0232] After receiving the event message corresponding to the character input operation, commitText() in the CgInputMethod input method will extract the text in the event message and submit the text to the cloud text box in the cloud game.

[0233] After receiving the event message corresponding to the character deletion operation, the deleteSurroundingText() in the CgInputMethod input method will delete the previous text of the cursor in the cloud text box.

[0234] After performEditorAction in the CgInputMethod input method receives the event message corresponding to the character input operation completion, the CgInputMethod input method will close the cloud input method and the cloud text box.

[0235] In an optional embodiment, the above system includes a cloud server and a terminal device, including:

[0236] The terminal device is used to receive a first operation of a user on a display interface of a cloud application, and send a first instruction to the cloud server in response to the first operation, wherein the first operation is an operation initiated by the user to start an input method;

[0237] The cloud server is configured to receive the first instruction, start the cloud input method in response to the first instruction, control the terminal device to display the input character display area of ​​the cloud input method corresponding to the cloud application, and send an input method start message to the terminal device;

[0238] The terminal device is used to receive and respond to the input method startup message, start the local input method, and display the character input area of ​​the local input method;

[0239] The terminal device is further configured to send an event message corresponding to the character editing operation to the cloud server when a character editing operation is received through the character input area of ​​the local input method;

[0240] The cloud server is further configured to receive the event message, determine a rendering image corresponding to the input character display area of ​​the cloud input method according to the event message, and send the rendering image to the terminal device;

[0241] The terminal device is further used to receive the rendering picture, and display the text editing result corresponding to the rendering picture through the input character display area of ​​the cloud input method.

[0242] In an optional embodiment, the system further includes a proxy server, and the terminal device exchanges information with the cloud server via the proxy server.

[0243] Optionally, for the interaction process between the cloud server, terminal device and proxy server (i.e., the cloud game transmission agent described above) in the input control system of the cloud application, reference may be made to the previous description and will not be repeated here.

[0244] The electronic devices involved in the embodiments of the present application (including but not limited to cloud servers, server 103 and terminal devices) can be nodes of the blockchain system, the servers involved (including but not limited to cloud servers, server 103) can be blockchain servers, and the data required to be stored in the embodiments of the present application can also be stored in blockchain nodes. The input control system applied to cloud applications involved in the embodiments of the present application can be a distributed system formed by connecting a client (such as a cloud game client) and multiple blockchain nodes (any form of computing devices in the access network, such as servers and user terminals) through network communication.

[0245] Take the distributed system as the blockchain system as an example, see Figure 4 , Figure 4 This is an optional structural diagram of the distributed system 100 provided in the embodiment of the present application applied to the blockchain system, which is formed by multiple nodes 200 (any form of computing devices in the access network, such as servers, user terminals) and clients 300, and the nodes form a peer-to-peer (P2P, Peer To Peer) network. The P2P protocol is an application layer protocol running on the Transmission Control Protocol (TCP, Transmission Control Protocol) protocol. In a distributed system, any machine such as a server or a terminal can join and become a node, and the node includes a hardware layer, an intermediate layer, an operating system layer, and an application layer.

[0246] See also Figure 4 The functions of each node in the blockchain system shown include:

[0247] 1) Routing: a basic function of a node, used to support communication between nodes.

[0248] In addition to the routing function, the node can also have the following functions:

[0249] 2) Applications are deployed in the blockchain to implement specific businesses based on actual business needs, record data related to the implementation of functions to form record data, carry digital signatures in the record data to indicate the source of the task data, and send the record data to other nodes in the blockchain system for other nodes to add the record data to a temporary block when they successfully verify the source and integrity of the record data.

[0250] For example, the services implemented by the application include:

[0251] 2.1) Wallet, used to provide the function of conducting electronic currency transactions, including initiating transactions (i.e., sending the transaction record of the current transaction to other nodes in the blockchain system. After the other nodes successfully verify the transaction, as a response to acknowledge the validity of the transaction, the transaction record data is stored in the temporary block of the blockchain; of course, the wallet also supports querying the remaining electronic currency in the electronic currency address;

[0252] 2.2) Shared ledger, which is used to provide functions such as storage, query and modification of account data. The record data of the operation on the account data is sent to other nodes in the blockchain system. After other nodes verify the validity, as a response to acknowledging the validity of the account data, the record data is stored in a temporary block, and a confirmation can also be sent to the node that initiated the operation.

[0253] 2.3) Smart contracts are computerized protocols that can execute the terms of a contract. They are implemented by deploying code on a shared ledger that is executed when certain conditions are met. The code is used to complete automated transactions based on actual business needs, such as querying the logistics status of the goods purchased by the buyer and transferring the buyer's electronic currency to the merchant's address after the buyer signs for the goods. Of course, smart contracts are not limited to executing contracts for transactions, but can also execute contracts for processing received information.

[0254] 3) Blockchain, including a series of blocks that are connected to each other in the order of their generation. Once a new block is added to the blockchain, it will not be removed. The block records the record data submitted by the nodes in the blockchain system.

[0255] See also Figure 5 , Figure 5 This is an optional schematic diagram of the block structure provided by the embodiment of the present application. Each block includes the hash value of the transaction record stored in this block (the hash value of this block) and the hash value of the previous block. Each block is connected by the hash value to form a blockchain. In addition, the block can also include information such as the timestamp when the block was generated. Blockchain is essentially a decentralized database, a string of data blocks generated by cryptographic methods. Each data block contains relevant information for verifying the validity of its information (anti-counterfeiting) and generating the next block.

[0256] See also Figure 6 , Figure 6 1 is a schematic diagram of a structure of an input control device for cloud applications provided in an embodiment of the present application. The input control device 1 for cloud applications provided in an embodiment of the present application includes:

[0257] The input method display module 11 is used to display the local character input area of ​​the terminal device and the cloud input display area of ​​the cloud application corresponding to the cloud server when a first operation is obtained on the display interface of the cloud application, wherein the first operation is an operation initiated by the user to start the input method;

[0258] The editing result display module 12 is used to display the editing result corresponding to the character editing operation through the cloud input display area when a character editing operation is received through the local character input area.

[0259] In an optional embodiment, the input method display module is used to:

[0260] In response to the first operation, a first instruction is sent to the cloud server, so that the cloud server starts the cloud input method based on the first instruction, so that the input character display area of ​​the cloud input method is displayed on the terminal device, and an input method start message is sent to the terminal device;

[0261] In response to the input method start-up message, the local input method is started and the character input area of ​​the local input method is displayed.

[0262] In an optional embodiment, the input method display module is further used for:

[0263] In response to the first operation, the input character display area of ​​the local input method and the character input area of ​​the cloud input method are hidden.

[0264] In an optional embodiment, the input method display module is used to:

[0265] The character input area of ​​the local input method and the input character display area of ​​the cloud input method are displayed without overlapping.

[0266] In an optional embodiment, the input method display module is used to:

[0267] Displaying the input character display area of ​​the cloud input method above the character input area of ​​the local input method;

[0268] The input character display area of ​​the cloud input method is displayed in the input character display area of ​​the local input method corresponding to the character input area of ​​the local input method.

[0269] In an optional embodiment, the editing result display module is used to:

[0270] When the character editing operation is received through the character input area of ​​the local input method, an event message corresponding to the character editing operation is sent to the cloud service;

[0271] Receiving a rendering image of an input character display area corresponding to the cloud input method sent by the cloud server based on the event message;

[0272] The rendering picture is received, and a text editing result corresponding to the rendering picture is displayed in the input character display area of ​​the cloud input method.

[0273] In an optional embodiment, the above-mentioned character editing operation includes a character input operation, a character modification operation, or a character deletion operation;

[0274] If the character editing operation is the character input operation, the event message includes a corresponding input result, the rendering screen includes an input result screen corresponding to the input result, and the editing result display module is used to:

[0275] Displaying the text editing result corresponding to the above input result screen through the input character display area of ​​the above cloud input method;

[0276] If the character editing operation is the character modification operation, the event message includes character modification information corresponding to the character modification operation, the rendering screen includes a character modification screen corresponding to the character modification information, and the editing result display module is used to:

[0277] Displaying the text editing result corresponding to the above character modification screen through the input character display area of ​​the above cloud input method;

[0278] If the character editing operation is the character deleting operation, the event message includes character deleting information corresponding to the character deleting operation, the rendering screen includes a character deleting screen corresponding to the character deleting information, and the editing result display module is used to:

[0279] The text editing result corresponding to the above-mentioned character deletion screen is displayed in the input character display area of ​​the above-mentioned cloud input method.

[0280] In an optional embodiment, the input method display module is further used for:

[0281] When the display interface of the cloud application obtains the second operation, the character input area of ​​the local input method and the input character display area of ​​the cloud input method are closed, wherein the second operation is an operation initiated by the user to close the input method.

[0282] In an optional embodiment, the input method display module is further used for:

[0283] In response to the second operation, a second instruction is sent to the cloud server, so that the cloud server closes the cloud input method based on the second instruction, so that the input character display area of ​​the cloud input method is closed on the terminal device, and an input method closing message is sent to the terminal device;

[0284] In response to the input method closing message, the local input method is closed, and the character input area of ​​the local input method is closed.

[0285] See also Figure 7 , Figure 7 2 is a schematic diagram of another input control device for cloud applications provided in an embodiment of the present application. The input control device 2 for cloud applications provided in an embodiment of the present application includes:

[0286] The instruction receiving module 21 is used to receive a first instruction sent by a terminal device, wherein the first instruction is sent by the terminal device in response to a first operation of a user on a display interface of a cloud application, wherein the first operation is an operation initiated by the user to start an input method;

[0287] The editing result processing module 22 is used to start the cloud input method in response to the above-mentioned first instruction, so that the above-mentioned terminal device displays the input character display area of ​​the cloud input method corresponding to the above-mentioned cloud application, send an input method startup message to the above-mentioned terminal device, so that the above-mentioned terminal device starts the local input method according to the above-mentioned input method startup message, displays the character input area of ​​the above-mentioned local input method, and when receiving the user's character editing operation through the character input area of ​​the above-mentioned local input method of the above-mentioned terminal device, the text editing result corresponding to the above-mentioned character editing operation is displayed in the input character display area of ​​the above-mentioned cloud input method of the above-mentioned terminal device.

[0288] In an optional embodiment, the editing result processing module is used to:

[0289] Receiving an event message corresponding to the character editing operation sent by the terminal device;

[0290] Determine a rendering screen corresponding to the input character display area of ​​the cloud input method according to the event message, and send the rendering screen to the terminal device so that the terminal device displays the text editing result corresponding to the rendering screen in the input character display area of ​​the cloud input method according to the rendering screen.

[0291] In the embodiment of the present application, the input control method, device, electronic device and storage medium applied to cloud applications provided by the embodiment of the present application, in the embodiment of the present application, the input control method, device and electronic device applied to cloud applications provided by the embodiment of the present application, when the user uses the cloud application, the input method can be started through the display interface of the cloud application. At this time, the terminal device displays the character input area of ​​the local input method and the input character display area of ​​the cloud input method corresponding to the cloud application. For the user, the character input area of ​​the displayed local input method can be used to edit the characters, and the text editing result corresponding to the character editing operation can be displayed through the input character display area of ​​the cloud input method. In this way, on the one hand, the user can switch the input method to the local input method he is accustomed to for character editing, which not only improves the user's character editing efficiency and the user's input experience, but also solves the technical problem of the single input method mode in the cloud application. On the other hand, since the user uses the local input method for character editing, the user can immediately see the key response of the local input method, which improves the user's input perception.

[0292] In a specific implementation, the input control device 1 applied to cloud applications can execute the above-mentioned functions through its built-in functional modules. Figure 2a The implementation method provided in each step, the input control device 2 applied to the cloud application can execute the above-mentioned various function modules built in it. Figure 3a For the implementation methods provided in each step, please refer to the implementation methods provided in the above steps for details, which will not be repeated here.

[0293] The above mainly introduces that the execution subject is hardware to implement the input control method applied to cloud applications in the present application, but the execution subject of the input control method applied to cloud applications in the present application is not limited to hardware. The execution subject of the input control method applied to cloud applications in the present application can also be software. The above-mentioned input control device applied to cloud applications can be a computer program (including program code) running in a computer device. For example, the input control device applied to cloud applications is an application software; the device can be used to execute the corresponding steps in the method provided in the embodiment of the present application.

[0294] In some embodiments, the input control device for cloud applications provided in the embodiments of the present application can be implemented in a combination of software and hardware. As an example, the input control device for cloud applications provided in the embodiments of the present application can be a processor in the form of a hardware decoding processor, which is programmed to execute the input control method for cloud applications provided in the embodiments of the present application. For example, the processor in the form of a hardware decoding processor can adopt one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.

[0295] In other embodiments, the input control device for cloud applications provided in the embodiments of the present application may be implemented in software. Figure 6 The input control device 1 for cloud applications shown can be software in the form of programs and plug-ins, and includes a series of modules, including an input method display module 11 and an editing result display module 12 for implementing the input control method for cloud applications provided in an embodiment of the present application. Figure 7 The input control device 2 shown for cloud applications may be software in the form of programs and plug-ins, and includes a series of modules, including an instruction receiving module 21 and an editing result processing module 22 for implementing the input control method for cloud applications provided in an embodiment of the present application.

[0296] See also Figure 8 , Figure 8 Schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 8As shown, the electronic device 1000 in this embodiment may include: a processor 1001, a network interface 1004 and a memory 1005. In addition, the above-mentioned electronic device 1000 may also include: a user interface 1003, and at least one communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. Among them, the user interface 1003 may include a display screen (Display), a keyboard (Keyboard), and the user interface 1003 may optionally include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1004 may be a high-speed RAM memory, or it may be a non-volatile memory (non-volatile memory), such as at least one disk storage. The memory 1005 may optionally also be at least one storage device located away from the aforementioned processor 1001. As Figure 8 As shown, the memory 1005 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a device control application program.

[0297] exist Figure 8 In the electronic device 1000 shown, the network interface 1004 can provide a network communication function; the user interface 1003 is mainly used to provide an input interface for the user; and the processor 1001 can be used to call a computer program stored in the memory 1005.

[0298] It should be understood that in some feasible implementations, the processor 1001 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The memory may include a read-only memory and a random access memory, and provide instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory. For example, the memory may also store information about the device type.

[0299] In a specific implementation, the electronic device 1000 can execute the above-mentioned functions through its built-in functional modules. Figure 2a , Figure 3aFor the implementation methods provided in each step, please refer to the implementation methods provided in the above steps for details, which will not be repeated here.

[0300] The present application also provides a computer-readable storage medium, which stores a computer program and is executed by a processor to implement Figure 2a , Figure 3a For the methods provided in each step, please refer to the implementation methods provided in the above steps for details, which will not be repeated here.

[0301] The computer-readable storage medium may be an internal storage unit of the task processing device provided in any of the aforementioned embodiments, such as a hard disk or memory of an electronic device. The computer-readable storage medium may also be an external storage device of the electronic device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc., equipped on the electronic device. The computer-readable storage medium may also include a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc. Further, the computer-readable storage medium may also include both an internal storage unit of the electronic device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the electronic device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

[0302] The embodiment of the present application provides a computer program product or a computer program, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. The processor of the electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the above Figure 2a , Figure 3a The method provided by any possible implementation manner.

[0303] The terms "first", "second", etc. in the claims, specification and drawings of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices. Mentioning "embodiment" in this article means that the specific features, structures or characteristics described in conjunction with the embodiment may be included in at least one embodiment of the present application. Displaying the phrase at various positions in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments. The term "and / or" used in the present application specification and the attached claims refers to any combination of one or more of the items listed in association and all possible combinations, and includes these combinations.

[0304] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Professional and technical personnel may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0305] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. An input control method for cloud applications, It is characterized in that include: When a first operation is acquired on the display interface of the cloud application, a character input area of ​​a local input method of the terminal device and an input character display area of ​​a cloud input method corresponding to the cloud application are displayed, wherein the first operation is an operation initiated by a user for starting the input method; When a character editing operation is received through the character input area of ​​the local input method, an event message corresponding to the character editing operation is sent to the cloud input method, so that the cloud input method determines a rendering screen corresponding to the input character display area of ​​the cloud input method according to the event message; wherein the character editing operation includes a character input operation, a character deletion operation, and a completion input operation; receiving the rendering screen sent by the cloud input method, and displaying a text editing result corresponding to the rendering screen in the input character display area of ​​the cloud input method according to the rendering screen; When the display interface of the cloud application obtains the second operation, the character input area of ​​the local input method and the input character display area of ​​the cloud input method are closed, and the display is switched to the text sending interface of the cloud application, and the text editing result is displayed in the text sending interface; wherein the second operation is an operation initiated by the user to close the input method; The receiving a character editing operation through the character input area of ​​the local input method includes: Receiving a character input operation by calling a first communication interface between a local input method and a local text box; Receiving a character deletion operation by calling a second communication interface between the local input method and the local text box; The input operation is received and completed by calling the third communication interface between the local input method and the local text box.

2. The method according to claim 1, It is characterized in that When the first operation is acquired on the display interface of the cloud application, the character input area of ​​the local input method of the terminal device and the input character display area of ​​the cloud input method corresponding to the cloud application are displayed, including: In response to the first operation, sending a first instruction to the cloud server, so that the cloud server starts the cloud input method based on the first instruction, so that the input character display area of ​​the cloud input method is displayed on the terminal device, and an input method start message is sent to the terminal device; In response to the input method start message, the local input method is started and a character input area of ​​the local input method is displayed.

3. The method according to claim 1, It is characterized in that Also includes: In response to the first operation, hiding the input character display area of ​​the local input method and the character input area of ​​the cloud input method.

4. The method according to claim 1, It is characterized in that The character input area of ​​the local input method of the display terminal device and the input character display area of ​​the cloud input method corresponding to the cloud application include: The character input area of ​​the local input method and the input character display area of ​​the cloud input method are displayed without overlapping.

5. The method according to claim 1, It is characterized in that The character editing operation also includes a character modification operation; If the character editing operation is the character input operation, the event message includes a corresponding input result, the rendering screen includes the input result screen corresponding to the input result, and the displaying of the text editing result corresponding to the rendering screen in the input character display area of ​​the cloud input method includes: Displaying the text editing result corresponding to the input result screen through the input character display area of ​​the cloud input method; If the character editing operation is the character modification operation, the event message includes character modification information corresponding to the character modification operation, the rendering screen includes a character modification screen corresponding to the character modification information, and the displaying of the text editing result corresponding to the rendering screen in the input character display area of ​​the cloud input method includes: Displaying the text editing result corresponding to the character modification screen through the input character display area of ​​the cloud input method; If the character editing operation is the character deletion operation, the event message includes character deletion information corresponding to the character deletion operation, the rendering screen includes a character deletion screen corresponding to the character deletion information, and the displaying of the text editing result corresponding to the rendering screen in the input character display area of ​​the cloud input method includes: The text editing result corresponding to the character deletion screen is displayed in the input character display area of ​​the cloud input method.

6. The method according to claim 1, It is characterized in that Also includes: When the display interface of the cloud application obtains a second operation, the character input area of ​​the local input method and the input character display area of ​​the cloud input method are closed, wherein the second operation is an operation initiated by the user for closing the input method.

7. An input control method for cloud applications, It is characterized in that include: Receiving a first instruction sent by a terminal device, wherein the first instruction is sent by the terminal device in response to a first operation of a user on a display interface of a cloud application, and the first operation is an operation initiated by the user to start an input method; In response to the first instruction, the cloud input method is started so that the terminal device displays the input character display area of ​​the cloud input method corresponding to the cloud application, an input method start message is sent to the terminal device so that the terminal device starts the local input method according to the input method start message and displays the character input area of ​​the local input method, and when a character editing operation of the user is received through the character input area of ​​the local input method of the terminal device, an event message corresponding to the character editing operation sent by the terminal device is received, a rendering screen corresponding to the input character display area of ​​the cloud input method is determined according to the event message, and the rendering screen is sent to the terminal device so that the terminal device displays the text editing result corresponding to the rendering screen in the input character display area of ​​the cloud input method according to the rendering screen; wherein the character editing operation includes a character input operation, a character deletion operation and an input completion operation; The terminal device is further configured to close the character input area of ​​the local input method and the input character display area of ​​the cloud input method when a second operation is obtained on the display interface of the cloud application, and switch the display to the text sending interface of the cloud application, and display the text editing result in the text sending interface; wherein the second operation is an operation initiated by the user to close the input method; The receiving a character editing operation through the character input area of ​​the local input method includes: Receiving a character input operation by calling a first communication interface between a local input method and a local text box; Receiving a character deletion operation by calling a second communication interface between the local input method and the local text box; The input operation is received and completed by calling the third communication interface between the local input method and the local text box.

8. An input control system for cloud applications, It is characterized in that The system includes a cloud server and a terminal device, including: The terminal device is used to receive a first operation of a user on a display interface of a cloud application, and send a first instruction to the cloud server in response to the first operation, wherein the first operation is an operation initiated by the user to start an input method; The cloud server is configured to receive the first instruction, and in response to the first instruction, start the cloud input method so that the terminal device displays an input character display area of ​​the cloud input method corresponding to the cloud application, and send an input method start message to the terminal device; The terminal device is used to receive and respond to the input method start message, start the local input method, and display the character input area of ​​the local input method; The terminal device is further configured to send an event message corresponding to a character editing operation to the cloud server when a character editing operation is received through the character input area of ​​the local input method; wherein the character editing operation includes a character input operation, a character deletion operation, and a completion input operation; The cloud server is further configured to receive the event message, determine a rendering image corresponding to the input character display area of ​​the cloud input method according to the event message, and send the rendering image to the terminal device; The terminal device is further used to receive the rendering picture, and display the text editing result corresponding to the rendering picture through the input character display area of ​​the cloud input method; The terminal device is further configured to close the character input area of ​​the local input method and the input character display area of ​​the cloud input method when a second operation is obtained on the display interface of the cloud application, and switch the display to the text sending interface of the cloud application, and display the text editing result in the text sending interface; wherein the second operation is an operation initiated by the user to close the input method; When the terminal device receives a character editing operation through the character input area of ​​the local input method, the terminal device is specifically configured to: Receiving a text input operation by calling a first communication interface between a local input method and a local text box; Receiving a text deletion operation by calling a second communication interface between the local input method and the local text box; The input confirmation operation is received by calling the third communication interface between the local input method and the local text box.

9. The system according to claim 8, It is characterized in that The system also includes a proxy server, and the terminal device interacts with the cloud server through the proxy server.

10. An input control device for cloud applications, It is characterized in that include: An input method display module, configured to display a character input area of ​​a local input method of a terminal device and an input character display area of ​​a cloud input method corresponding to the cloud application when a first operation is acquired on the display interface of the cloud application, wherein the first operation is an operation initiated by a user to start the input method; An editing result display module is used to send an event message corresponding to the character editing operation to the cloud input method when a character editing operation is received through the character input area of ​​the local input method, so that the cloud input method determines a rendering screen corresponding to the input character display area of ​​the cloud input method according to the event message; receive the rendering screen sent by the cloud input method, and display the text editing result corresponding to the rendering screen in the input character display area of ​​the cloud input method according to the rendering screen; wherein the character editing operation includes a character input operation, a character deletion operation and a completion input operation; when a second operation is obtained in the display interface of the cloud application, close the character input area of ​​the local input method and the input character display area of ​​the cloud input method, and switch the display to the text sending interface of the cloud application, and display the text editing result in the text sending interface; wherein the second operation is an operation initiated by the user to close the input method; When the editing result display module receives a character editing operation through the character input area of ​​the local input method, it is specifically used to: Receiving a text input operation by calling a first communication interface between a local input method and a local text box; Receiving a text deletion operation by calling a second communication interface between the local input method and the local text box; The input confirmation operation is received by calling the third communication interface between the local input method and the local text box.

11. An input control device for cloud applications, It is characterized in that include: An instruction receiving module, configured to receive a first instruction sent by a terminal device, wherein the first instruction is sent by the terminal device in response to a first operation of a user on a display interface of a cloud application, and the first operation is an operation initiated by the user to start an input method; an editing result processing module, for starting the cloud input method in response to the first instruction, so that the terminal device displays the input character display area of ​​the cloud input method corresponding to the cloud application, sending an input method startup message to the terminal device, so that the terminal device starts the local input method according to the input method startup message, displays the character input area of ​​the local input method, and when receiving a user's character editing operation through the character input area of ​​the local input method of the terminal device, receiving an event message corresponding to the character editing operation sent by the terminal device, and determining a rendering screen corresponding to the input character display area of ​​the cloud input method according to the event message , sending the rendering screen to the terminal device, so that the terminal device displays the text editing result corresponding to the rendering screen in the input character display area of ​​the cloud input method according to the rendering screen; wherein the character editing operation includes a character input operation, a character deletion operation and a character input operation; the terminal device is also used to close the character input area of ​​the local input method and the input character display area of ​​the cloud input method when a second operation is obtained in the display interface of the cloud application, and switch the display to the text sending interface of the cloud application, and display the text editing result in the text sending interface; wherein the second operation is an operation initiated by the user to close the input method; The receiving a character editing operation through the character input area of ​​the local input method includes: Receiving a character input operation by calling a first communication interface between a local input method and a local text box; Receiving a character deletion operation by calling a second communication interface between the local input method and the local text box; The input operation is received and completed by calling the third communication interface between the local input method and the local text box.

12. An electronic device, It is characterized in that comprising a processor and a memory, wherein the processor and the memory are connected to each other; The memory is used to store computer programs; The processor is configured to execute the method as claimed in any one of claims 1 to 6 or claim 7 when calling the computer program.

13. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the method described in any one of claims 1 to 6 or claim 7.