Cloud input method, system, device, electronic device and storage medium

Abstract

The present invention discloses a cloud input method, system, device, electronic device and storage medium. In the process of a cloud device running a cloud program, after monitoring an input start event in a first information input view, the method obtains configuration information including the information input type of the first information input view; sends the configuration information to a user device; receives input information collected by the user device and displays it in the first information input view. In the process of a user device displaying an image corresponding to a cloud program, the method sends the location information of a click event to the cloud device, so that when the location information corresponds to the first information input view of the cloud device, an input start event is generated in the first information input view; receives configuration information from the cloud device; collects input information that meets the information input type in the configuration information and sends it to the cloud device. Thus, the present invention achieves the purpose of using the input method on the user device side to input information.

Description

Technical Field

[0001] The present invention relates to the field of cloud communication technology, and in particular to a cloud input method, system, device, electronic device and storage medium. Background Art

[0002] Cloud application services deploy hardware resources in the cloud, use the cloud hardware resources to run the applications required by users, and display the display window image of the application on the user's device. Therefore, cloud application services have lower performance requirements for user devices.

[0003] In the process of using cloud application services, users can perform cloud operations. Common cloud operations include: inputting information into the cloud input box. Currently, in the process of running an application on a cloud device, the user device collects the click coordinates of the user on the display window image and sends them to the cloud device. On the cloud device side, the application object corresponding to the click coordinates performs the corresponding operation. Therefore, when inputting information into the cloud input box, users can only use the input method inherent in the cloud device, and cannot use the input method installed on the user device, which makes the input method single and cannot meet the user's personalized input needs. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide a cloud input method, system, device, electronic device and storage medium to solve the problem that when inputting information through cloud application services, only the input method of the cloud device can be used, and the input method installed on the user device cannot be adapted, and the personalized input requirements cannot be met. The specific technical solution is as follows:

[0005] In the first aspect of the implementation of the present invention, a cloud input method is first provided, and the steps executed on the cloud device include: in the process of running the cloud program, performing event monitoring on the first information input view; after monitoring the input start event of the first information input view, obtaining the configuration information of the first information input view; the configuration information includes the information input type; sending the configuration information to the user device so that the user device collects input information that conforms to the information input type; receiving the input information collected by the user device; and displaying the input information in the first information input view.

[0006] In the second aspect of the implementation of the present invention, a cloud input method is also provided, and the steps executed on the user device include: in the process of displaying the image corresponding to the cloud program, monitoring the event of the user display window; after monitoring the click event, sending the occurrence location information of the click event to the cloud device, so that when the occurrence location information corresponds to the first information input view of the cloud device, an input start event is generated in the first information input view; receiving configuration information from the cloud device; the configuration information includes the information input type; collecting input information that meets the information input type and sending it to the cloud device, so that the cloud device displays the input information in the first information input view.

[0007] In the third aspect of the implementation of the present invention, a cloud input system is also provided, which includes: a cloud device and a user device; wherein the cloud device is used to execute any of the above-mentioned method steps executed on the cloud device; the user device is connected to the cloud device and is used to execute any of the above-mentioned method steps executed on the user device.

[0008] In the fourth aspect of the implementation of the present invention, there is also provided a cloud input device, which is arranged on the cloud device side and includes: a first monitoring module, used to perform event monitoring on a first information input view during the running of a cloud program; an information acquisition module, used to obtain configuration information of the first information input view after monitoring the input start event of the first information input view; the configuration information includes an information input type; a first sending module, used to send the configuration information to a user device, so that the user device collects input information that conforms to the information input type; a first receiving module, used to receive the input information collected by the user device; and an information display module, used to display the input information in the first information input view.

[0009] In the fifth aspect of the implementation of the present invention, there is also provided a cloud input device, which is arranged on the user device side and includes: a second monitoring module, which is used to monitor events on the display window during the process of displaying the image corresponding to the cloud program; a second sending module, which is used to send the occurrence location information of the click event to the cloud device after the click event is monitored, so that when the occurrence location information corresponds to the first information input view of the cloud device, the first information input view generates an input start event; a second receiving module, which is used to receive configuration information from the cloud device; the configuration information includes an information input type; a third sending module, which is used to collect input information that meets the information input type and send it to the cloud device, so that the cloud device displays the input information in the first information input view.

[0010] In the sixth aspect of the implementation of the present invention, there is also provided an electronic device, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; the memory is used to store computer programs; the processor is used to implement any of the above-mentioned method steps executed on the cloud device, or implement any of the above-mentioned method steps executed on the user device when executing the program stored in the memory.

[0011] In the seventh aspect of the implementation of the present invention, a computer-readable storage medium is also provided, in which instructions are stored, and when the computer-readable storage medium is run on a computer, the computer executes any one of the above-mentioned method steps executed on a cloud device, or any one of the above-mentioned method steps executed on a user device.

[0012] In the eighth aspect of the implementation of the present invention, there is also provided a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute any one of the method steps executed on a cloud device, or any one of the method steps executed on a user device.

[0013] The cloud input method, system, device, electronic device and storage medium provided by the embodiments of the present invention have the following beneficial effects:

[0014] In an embodiment of the present invention, when an input demand occurs in the first information input view on the cloud device side, the configuration information of the first information input view is sent to the user device, and the configuration information includes the information input type. The user device collects input information that conforms to the information input type, thereby transferring the input operation on the cloud device side to the user device side. Input information that conforms to the information input type is collected on the user device side and sent to the cloud device. The input information that conforms to the information input type is displayed in the first information input view on the cloud device side, so that the user operation program on the user device side can be used to perform input operations, thereby meeting the input demand, so that the cloud input method can adapt to the personalized input method of the user end, and the input method is more flexible and diverse, convenient for users to select and use, and can meet the personalized needs of users. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art are briefly introduced below.

[0016] Figure 1 is a structural diagram of a cloud communication system according to an embodiment of the present invention;

[0017] Figure 2 is a flow chart of a cloud input method executed on a cloud device according to an embodiment of the present invention;

[0018] Figure 3 is a schematic diagram of an input method according to an embodiment of the present invention;

[0019] Figure 4 is a flow chart of a cloud input method executed on a user device according to an embodiment of the present invention.

[0020] Figure 5 is a flowchart of steps for adjusting the area position of a first information input view executed on a cloud device according to an embodiment of the present invention;

[0021] Figure 6 is a flowchart of steps for adjusting the area position of a first information input view executed on a cloud device according to an embodiment of the present invention;

[0022] Figure 7 is a schematic diagram of adjusting the position of the first input operation view according to an embodiment of the present invention;

[0023] Figure 8 is a flowchart of steps for adjusting the area position of a first information input view executed on a cloud device according to an embodiment of the present invention;

[0024] Fig. 9 is a flowchart of steps for adjusting attribute information of a second input operation view according to an embodiment of the present invention;

[0025] Fig.10 is a schematic diagram of adjusting the position of the second input operation view according to an embodiment of the present invention;

[0026] Fig.11 is a flowchart of steps for destroying a first input operation view according to an embodiment of the present invention;

[0027] Fig.12 is a schematic diagram of cloud input according to an embodiment of the present invention;

[0028] Fig.13 is a diagram showing the effect of cloud input according to an embodiment of the present invention;

[0029] Fig.14 is a schematic diagram of a cloud input method according to an embodiment of the present invention;

[0030] Fig.15 is a structural diagram of a cloud input device disposed in a cloud device according to an embodiment of the present invention;

[0031] Fig.16 is a structural diagram of a cloud input device provided in a user device according to an embodiment of the present invention;

[0032] Fig.17is a structural diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0033] The technical solutions in the embodiments of the present invention are described below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0034] The embodiment of the present invention provides a cloud communication system, based on which cloud application services can be provided. Figure 1 , which is a structural diagram of a cloud communication system according to an embodiment of the present invention.

[0035] The cloud communication system includes: a user device 110 and a cloud device 120. The user device 110 and the cloud device 120 are connected via a network.

[0036] The user device 110 is used to select a cloud program running on the cloud device 120 and display cloud video data from the cloud device 120; in the process of displaying the cloud video data, an operation instruction is generated and sent to the cloud device 120. The cloud video data is a video stream data formed by multiple frames of cloud video images.

[0037] The cloud device 120 is used to run the cloud program selected by the user device 110, generate cloud video data corresponding to the cloud program and send the cloud video data to the user device 110; the cloud video data includes a cloud video image generated in response to the operation instruction.

[0038] Specifically, after establishing a network connection with the cloud device 120, the user device 110 can obtain at least one cloud program information that can be run by the cloud device 120 from the cloud device 120, and display the at least one cloud program information in the display window. The user can click on a cloud program information that he wants to run in the at least one cloud program information to select the cloud program. The user device 110 system listens for the click event and sends the cloud program information at the location where the click event occurs to the cloud device 120.

[0039] The cloud device 120 receives the cloud program information and runs the cloud program corresponding to the cloud program information. In the process of running the cloud program, the cloud device 120 generates a cloud video image corresponding to the cloud program and sends the cloud video image to the user device 110.

[0040] During the process of displaying the cloud video image, the user device 110 monitors the operation event, and when an operation event is monitored, generates an operation instruction carrying the occurrence location information of the operation event, and sends the operation instruction to the cloud device 120 .

[0041] After receiving the operation instruction, the cloud device 120 generates a cloud click event according to the occurrence location information in the operation instruction, so that the object corresponding to the occurrence location information responds to the cloud click event, and the cloud device 120 generates a cloud video image for responding to the cloud click event.

[0042] Furthermore, the cloud video image displayed by the user device may include a first information input view. The first information input view is a view of a first input UI (User Interface) control object of the cloud program. For example, the first input UI control object is an input box (or text box).

[0043] When the user needs to input information, he can click on the first information input view in the cloud video image displayed by the user device; the user device monitors the user click event and sends the location information of the user click event to the cloud device; the system of the cloud device generates a cloud click event at the corresponding position in the cloud display window according to the location information; the first input UI control object of the cloud device monitors the cloud click event, obtains the focus and triggers the input start event; after the system of the cloud device monitors the input start event, it starts the cloud operation program so that the cloud operation program creates the first operation UI control object in the cloud display window. For example: the cloud operation program is a cloud input method, and the first operation UI control object is a keyboard. At this time, the cloud video image generated by the cloud device will include the first input operation image (the image of the first operation UI control object). The cloud device sends the cloud video data to the user device so that the user device displays the cloud video image. The user can click on the first input operation image as needed, and the user device sends the location information of the user click event to the cloud device. The cloud device generates a cloud click event at a corresponding position of the cloud display window based on the occurrence location information. The first operation UI control object listens for the cloud click event. The cloud operation program determines the input information based on the occurrence location of the cloud click event and sends it to the first input UI control object through the cloud device's system. The first input UI control object displays the input information, and then in the cloud video image generated by the cloud device, an image of the input information appears in the first information input view.

[0044] Generally speaking, users will install user operation programs on user devices according to their own usage habits. For example: the user operation program is a user input method. The user operation program runs on the user device side, and the cloud operation program runs on the cloud device. In the above-mentioned information input process, the user uses the cloud operation program to complete the information input, but cannot use the user operation program to complete the information input. This is because when the user operation program is different from the cloud operation program, when the user clicks the button corresponding to the user operation program, an operation event will be triggered. After the occurrence location information of the operation event is sent to the cloud device, the occurrence location information may not correspond to the same button of the cloud operation program, resulting in the cloud operation program being unable to perform the same operation as the user operation program.

[0045] Therefore, when inputting information into the cloud input box, users can only use the input method inherent in the cloud device and cannot use the input method installed on the user device, which makes the input method single and cannot meet the user's personalized input needs, making it inconvenient for users to input when using cloud programs.

[0046] In a cloud communication scenario, in order to facilitate user input, an embodiment of the present invention provides a cloud input method executed on a cloud device, which is intended to complete information input through a user operation program installed in the user device. Figure 2 , is a flow chart of a cloud input method executed on a cloud device according to an embodiment of the present invention.

[0047] Step S210: The cloud device performs event monitoring on the first information input view while running the cloud program.

[0048] Cloud programs refer to applications that run on cloud devices. Types of cloud programs include, but are not limited to: cloud gaming programs, cloud office programs.

[0049] The first information input view is a view of the first input UI control object of the cloud program. The first input UI control object is used to monitor cloud click events and display input information from the user device. The types of input information include but are not limited to: text information.

[0050] Performing event monitoring on the first information input view includes: monitoring an input start event occurring in the first information input view. The input start event is used to indicate that the first information input view is clicked. The input start event is generated by the first input UI control object after monitoring the cloud click event.

[0051] Specifically, after the cloud device and the user device are connected to the network, the cloud device runs the cloud program, renders the window display image, and sends the rendered window display image to the user device so that the user device displays the window display image in the user display window.

[0052] The window display image is an image in the cloud display window. The window display image includes a user interface image of a cloud program, and the user interface image of the cloud program may include a first information input view.

[0053] The cloud display window is a virtual display window, while the user display window is a real display window.

[0054] When the user needs to control the cloud program, a click operation can be performed in the window display image displayed by the user device. For example, click on the first information input view in the user interface image of the cloud program. The user device listens for user click events in the user display window, generates the occurrence location information corresponding to the user click event according to the coordinate position of the user click event, and sends it to the cloud device. The cloud device generates a cloud click event at the corresponding coordinate position of the cloud display window based on the received occurrence location information, and the object at the coordinate position in the cloud program performs the operation task corresponding to the cloud click event. Among them, the objects in the cloud program include: a first input UI control object.

[0055] The occurrence location information is the coordinates of the location where the user click event occurs. Furthermore, when the size of the cloud display window is the same as the size of the user display window, the cloud device generates a cloud click event at the same coordinate position of the cloud display window based on the coordinate position of the user click event. When the size of the cloud display window is different from the size of the user display window, the cloud device converts the coordinate position of the user click event into the coordinate position in the cloud display window based on the size ratio of the cloud display window to the user display window, and generates a cloud click event at the coordinate position in the cloud display window.

[0056] If the cloud click event occurs in the first information input view, the first input UI control object of the cloud program will listen to the cloud click event, obtain the focus, and trigger the input start event. At this time, the cloud device system will listen to the input start event.

[0057] Step S220: After monitoring the occurrence of an input start event in the first information input view, the cloud device obtains configuration information of the first information input view; the configuration information includes an information input type.

[0058] Furthermore, the configuration information of the first information input view at least includes: information input type. The information input type corresponding to the first information input view includes, but is not limited to: numbers, English, Chinese and / or characters. Of course, the configuration information may also include other information. For example, the configuration information may also include input restriction information. The input restriction information includes, but is not limited to: the upper limit of the number of bytes of the input information.

[0059] Furthermore, the information input type corresponding to the first information input view is the information input type of the first input UI control object. The information input type is pre-configured for the first input UI control object. The first input UI control object can display information of the corresponding information input type.

[0060] The information input type corresponding to the first information input view may be stored in a preset storage location of the cloud device. After an input start event of the first information input view is monitored, the information input type corresponding to the first information input view is obtained from the storage location.

[0061] In step S230, the cloud device sends the configuration information to the user device so that the user device collects input information that conforms to the information input type.

[0062] The cloud device sends the information input type to the user device so that the user device starts the user operation program after receiving the information input type.

[0063] The user operation program is an application program running on the user device. The user operation program is used to create a second input operation view on the user device side, or to monitor an external input device connected to the user device.

[0064] On the user device side, the external input device is a hardware input device. The types of external input devices include but are not limited to: an external keyboard and a stylus pen of the user device.

[0065] On the user device side, the second input operation view is a view of the second operation UI control object of the user operation program, wherein the information input type corresponding to the second input operation view is the same as the information input type corresponding to the first information input view.

[0066] On the user device side, the second operation UI control object is used to monitor the click event on the second input operation view. The user operation program is used to determine the input information according to the location where the click event occurs. The user device sends the input information to the cloud device.

[0067] For example: on the user device side, the user operation program is the user input method, the second operation UI control object is the keyboard, the view of the second operation UI control object is the keyboard view, the keyboard is used to monitor click events occurring on the keyboard view and report the location of the user click event to the user operation program, and the user input method determines the input information based on the location of the click event.

[0068] During the process of displaying the first information input view and the second input operation view by the user equipment, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0069] The input area of ​​the second input operation view corresponds to the input area of ​​the second operation UI control object. The second operation UI control object listens for click events in the input area of ​​the second input operation view.

[0070] Furthermore, after creating the second input operation view, the user device overlays and displays the second input operation view with the window display image from the cloud device, the second input operation view covers the window display image, and the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view in the window display image. The specific method of making the input area of ​​the second input operation view not overlap with the display area of ​​the first information input view will be introduced later.

[0071] For example: Figure 3 1 is a schematic diagram of an input method according to an embodiment of the present invention. In the cloud display window 11 of the cloud device 100, the window display image includes a cloud input box image 12 of the cloud program and a cloud keyboard image corresponding to the cloud input method. Fig.13 ; Among them, the information input type corresponding to the input box image is a digital type; the cloud keyboard view Fig.13 It is a transparent view. The window display image is sent to the user device by the cloud device as a frame of the cloud video data 300. In the user display window 21 of the user device 200, it includes: a window display image, a user input box view 22, and a numeric keyboard view 23 created according to the information input type; the user input box view 22 is a transparent view; the window display image and the numeric keyboard image are superimposed and displayed, and the cloud input box image 12 and the numeric keyboard image 23 in the window display image do not overlap.

[0072] Step S240: The cloud device receives input information collected by the user device.

[0073] The cloud device receives input information collected by the user device through the user operation program.

[0074] The input information is information to be displayed, wherein the input information conforms to the information input type corresponding to the first information input view.

[0075] The input information is collected by the user device through a second input operation view or an external input device; wherein the second input operation view is created by a user operation program; when the first information input view and the second input operation view are displayed by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view; the external input device is a hardware input device connected to the user device and monitored by the user operation program.

[0076] The input information is complete input information or unit input information. Complete input information means that the input information has been completely input. Unit input information is partial input information. Unit input information is selected candidate information. The candidate information includes but is not limited to: a phrase, a string, a number, an English letter, a Chinese character and / or a character.

[0077] Furthermore, on the user device side, the user operation program displays candidate information in the second operation UI control object according to the location where the user click event occurs, listens to the user click event, and reports the location where the user click event occurs to the user operation program. The user operation program determines the selected candidate information according to the location where the user click event occurs.

[0078] The cloud device and the user device may negotiate in advance whether the input information is complete input information or unit input information.

[0079] On the cloud device side, when information is input through the second input operation view collecting unit, input information collected by the user device through the second input operation view is received multiple times.

[0080] Step S250: The cloud device displays the input information in the first information input view.

[0081] The input information from the user device is sent to the first input UI control object of the application program, and the first input UI control object displays the input information in the display area, so that the input information is also displayed in the view of the first input UI control object.

[0082] In the embodiment of the present invention, the input information may be information encrypted by the user device; thus, before the input information is displayed in the first information input view, a preset information decryption algorithm may be used to perform decryption processing on the input information.

[0083] Furthermore, the user device and the cloud device may negotiate in advance the information encryption and decryption algorithm. The information encryption and decryption algorithm may be a symmetric encryption and decryption algorithm or an asymmetric encryption and decryption algorithm. Types of symmetric encryption and decryption algorithms include, but are not limited to: DES (Data Encryption Standard), 3DES algorithm, AES (Advanced Encryption Standard) algorithm. Types of asymmetric encryption and decryption algorithms include: RSA algorithm, ECC (Elliptic curve cryptography) algorithm.

[0084] In an embodiment of the present invention, when an input demand occurs in the first information input view on the cloud device side, the configuration information of the first information input view is sent to the user device, and the configuration information includes the information input type; after the user device side receives the configuration information, the user device collects input information that conforms to the information input type, thereby transferring the input operation on the cloud device side to the user device side. The input information that conforms to the information input type is collected on the user device side and sent to the cloud device, and the input information that conforms to the information input type is displayed in the first information input view on the cloud device side, so that the user operation program on the user device side can be used to perform input operations, thereby meeting the input demand, so that the cloud input method can adapt to the personalized input method of the user end, and the input method is more flexible and diverse, convenient for users to select and use, and can meet the personalized needs of users.

[0085] Furthermore, the user operation program is located on the user device side, so that the user operation program can create a second input operation view on the user device side, and can also monitor the hardware input device connected to the user device, so that the user can use the second input operation view for cloud input, and can also use the hardware input device for cloud input, further increasing the cloud input methods and facilitating user selection and use.

[0086] The cloud input method of the embodiment of the present invention is applied in cloud application services. Cloud application services include cloud computer services, cloud mobile phone services, etc. Application scenarios of cloud application services include cloud games, cloud office, etc.

[0087] Based on the above-mentioned cloud input method executed on the cloud device, the embodiment of the present invention also provides a cloud input method executed on the user device. Figure 4 , is a flow chart of a cloud input method executed on a user device according to an embodiment of the present invention.

[0088] Step S410 , when the user device is displaying the image corresponding to the cloud program, the user display window is monitored for events.

[0089] The image corresponding to the cloud program is the user interface image of the cloud program. Furthermore, the user device receives and displays a window display image from the cloud device, and the window display image includes the user interface image of the cloud program. For example: when the user interface of the cloud program is displayed in full screen, the window display image is the user interface image of the cloud program. When the user interface of the cloud program is not displayed in full screen, the window display image includes the user interface image of the cloud program and other images.

[0090] Monitor events on the user display window, including: monitor click events on the user display window.

[0091] In step S420, after monitoring the click event, the user device sends the occurrence location information of the click event to the cloud device, so that when the occurrence location information corresponds to the first information input view of the cloud device, the first information input view generates an input start event.

[0092] Occurrence location information, including: the location coordinates where the click event occurred.

[0093] Step S430, the user device receives configuration information from the cloud device; the configuration information includes information input type.

[0094] The information input type is the information input type corresponding to the first information input view of the cloud program.

[0095] The information input type includes, but is not limited to: information input type. The information input type includes: numbers, English, Chinese and / or characters.

[0096] Step S440: The user device collects input information that conforms to the information input type and sends it to the cloud device, so that the cloud device displays the input information in the first information input view.

[0097] After receiving the information input type, the user device starts the user operation program, collects the input information input through the user operation program, and sends the input information that meets the information input type to the cloud device, so that the cloud device displays the input information in the first information input view.

[0098] The input information is collected by the user operation program through the second input operation view or an external input device; wherein the second input operation view is created by the user operation program; the external input device is a hardware input device connected to the user device and monitored by the user operation program.

[0099] Furthermore, in the process of displaying the image of the first information input view and the second input operation view, the input area of ​​the second input operation view is made not to overlap with the display area of ​​the first information input view. The specific method of making the input area of ​​the second input operation view not to overlap with the display area of ​​the first information input view will be introduced later.

[0100] On the user device side, after receiving the configuration information sent by the cloud device, a second information input view can also be created. The second information input view is an image of the second input UI control object of the user input program. The information input type of the second input UI control object corresponds to the information input type corresponding to the first information input view. For example: When the system of the user device is an Android system, the Android system needs to use an input box at the same time when using a keyboard. At this time, it is necessary to create a user input box after creating a user keyboard according to the information input type sent by the cloud system.

[0101] In this embodiment, when the user device overlays and displays the second information input view, the second input operation view and the window display image, the second information input view may be set as a transparent view to avoid the second information input view obstructing the first information input view in the window display image.

[0102] A transparent view means that the transparency of the view itself and the information displayed in the view is 100%.

[0103] The display position of the transparent view may be the same as or different from the display position of the first information input view.

[0104] The input information input through the second input operation view can be sent to the second information input view through the user device system, but because the second information input view is a transparent view, the input information displayed in the second information input view is invisible to the user.

[0105] In this embodiment, the external input device connected to the user device can be monitored; input information is determined based on the monitored user input events; and when the input information meets the information input type, the input information is sent to the cloud device. Furthermore, the external input device connected to the user device can be monitored through the user operation program; wherein the user operation program determines input information based on the monitored user input events; through the control object corresponding to the second information input view, it is determined whether the input information determined by the user operation program meets the information input type, and when the input program meets the information input type, the input information that meets the information input type is sent to the cloud device. Among them, the control object corresponding to the second information input view is the second input UI control object. The second input UI control object sends the input information of the information input type to the cloud device, and does not process the input information of non-information input type.

[0106] In this embodiment, a second input operation view corresponding to the information input type can also be created; the second input operation view is monitored, and the input information is determined based on the monitored user click event; and the input information is sent to the cloud device. Furthermore, the second input operation view corresponding to the information input type can be created through the user operation program, the second input operation view is monitored, and the input information is determined based on the monitored user click event; wherein, in the process of displaying the first information input view and the second input operation view, the input area of ​​the second input operation view is made not to overlap with the display area of ​​the first information input view; and the input information is sent to the cloud device through the control object corresponding to the second information input view. Creating a second input operation view corresponding to the information input type is to create a second operation UI control object corresponding to the information input type. For example: if the information input type is a number, the second operation UI control object is a numeric keyboard.

[0107] In this embodiment, the input information is complete input information or unit input information. Complete input information means that the input information has been completely input. Unit input information is partial input information. Unit input information is selected candidate information. The candidate information includes but is not limited to: a phrase, a string, a number, an English letter, a Chinese character and / or a character.

[0108] Furthermore, when the input information is complete, in the process of collecting the input information input through the second input operation view, the input stop event occurring on the second input operation view is monitored; after the input stop event is monitored, the collected input information is sent to the cloud device. The input stop event is used to indicate that the input information has been completely input. For example: an input stop button is set in the second operation UI control object, and when the position corresponding to the input stop button in the second input operation view is triggered, an input stop event occurs.

[0109] Furthermore, in the case where the input information is unit input information, the user operation program displays candidate information in the second operation UI control object according to the location where the user click event occurs, monitors the user click event, reports the location where the user click event occurs to the user operation program, and the user operation program determines the selected candidate information according to the location where the user click event occurs. In the process of collecting input information input through the second input operation view, each time a unit input information is collected, the unit input information is sent to the cloud device.

[0110] Furthermore, in the case where the input information is unit input information, the user operation program monitors the user input event reported by the external input device, the user input event carries the key code of the triggered key, and the candidate information is generated according to the key code in the user input event, and the candidate information is selected according to the key code in the user input event. Among them, the external input device includes multiple keys, each key corresponds to a key code. The key type includes a first type of key and a second type of key. A first type of key is a character key, such as a letter key. A second type of key is a function key, such as a space bar. If the key code in the user input event is a first type of key, the candidate information is generated according to the key code; if the key code in the user input event is a second type of key code, the candidate information is selected according to the key code.

[0111] In this embodiment, before the input information is sent to the cloud device, the input information may be encrypted using a preset information encryption algorithm.

[0112] Furthermore, the user device and the cloud device may negotiate in advance the information encryption and decryption algorithm. The information encryption and decryption algorithm may be a symmetric encryption and decryption algorithm or an asymmetric encryption and decryption algorithm. Types of symmetric encryption and decryption algorithms include, but are not limited to: DES (Data Encryption Standard), 3DES algorithm, AES (Advanced Encryption Standard) algorithm. Types of asymmetric encryption and decryption algorithms include: RSA algorithm, ECC (Elliptic curve cryptography) algorithm.

[0113] In an embodiment of the present invention, when an input demand occurs in the first information input view on the cloud device side, the configuration information of the first information input view is sent to the user device, and the configuration information includes the information input type; after the user device side receives the configuration information, the user device collects input information that conforms to the information input type, thereby transferring the input operation on the cloud device side to the user device side. The input information that conforms to the information input type is collected on the user device side and sent to the cloud device, and the input information that conforms to the information input type is displayed in the first information input view on the cloud device side, so that the user operation program on the user device side can be used to perform input operations, thereby meeting the input demand, so that the cloud input method can adapt to the personalized input method of the user end, and the input method is more flexible and diverse, convenient for users to select and use, and can meet the personalized needs of users.

[0114] Furthermore, the user operation program is located on the user device side, so that the user operation program can create a second input operation view on the user device side, and can also listen to the external input device connected to the user device, so that the user can use the second input operation view for cloud input, and can also use the hardware input device for cloud input, further increasing the cloud input methods and facilitating user selection and use.

[0115] In an embodiment of the present invention, in the user display window of the user device, the second information input view is a transparent view and the display area of ​​the first information input view is visible to the user. Further, after the user device starts the user operation program, the display area of ​​the first information input view is visible to the user if the user device does not create the second input operation view. If the second input operation view created by the user device does not block the display area of ​​the first information input view, the display area of ​​the first information input view is visible to the user.

[0116] Specifically, types of device systems include but are not limited to: Windows system and Android system.

[0117] The Windows system supports collecting input information through a physical keyboard and displaying it in an input box object, and also supports collecting input information through a virtual keyboard and displaying it in an input box object. Therefore, the cloud device side may only include the first input UI control object and only display the first information input view; the cloud device side may also include the first input UI control object and the first operation UI control object, and display the first information input view and the first input operation view.

[0118] The Android system supports collecting input information through a virtual keyboard and displaying it in an input box object. Therefore, the cloud device side may include a first input UI control object and a first operation UI control object, and display a first information input view and a first input operation view.

[0119] In addition, the types of user device systems include but are not limited to: Windows system and Android system. Moreover, the types of cloud device systems include but are not limited to: Windows system and Android system.

[0120] When the user device system is a Windows system and the cloud device system is a Windows system, the user device can choose whether to create a second input operation view, and the cloud device can choose whether to create a first input operation view.

[0121] When the user device system is Windows system and the cloud device system is Android system, the user device can choose whether to create the second input operation view, and the cloud device needs to create the first input operation view.

[0122] When the user device system is an Android system and the cloud device system is a Windows system, the user device needs to create a second input operation view, and the cloud device can choose whether to create a first input operation view.

[0123] When the user device system is an Android system and the cloud device system is an Android system, the user device needs to create a second input operation view and the cloud device also needs to create a first input operation view.

[0124] Therefore, no matter what combination of user devices and cloud device systems are, there is a possibility that the input area of ​​the second input operation view overlaps with the display area of ​​the first information input view. This requires adjusting the position of the view so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view, so as to ensure that the first information input view is visible to the user.

[0125] The following further describes how to make the input area of ​​the second input operation view not overlap with the display area of ​​the first information input view.

[0126] In an embodiment of the present invention, the area position of the first information input view can be adjusted on the cloud device side so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view. The area position of the second input operation view can also be adjusted on the user device side so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0127] First, a method of adjusting the area position of the first information input view on the cloud device side so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view is described.

[0128] Specifically, on the user device side, after creating the second input operation view, the attribute information of the second input operation view is obtained; and the attribute information of the second input operation view is sent to the cloud device. On the cloud device side, according to the attribute information of the second input operation view, the area position of the first information input view is adjusted so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0129] On the cloud device side, based on the attribute information of the second input operation view, the first input operation view is created or the attribute information of the created first input operation view is adjusted; based on the attribute information of the first input operation view, the area position of the first information input view is adjusted so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0130] The first input operation view is the view of the first operation UI control object of the cloud operation program. The cloud operation program is, for example, a cloud input method of a cloud device, the first operation UI control object may be a cloud keyboard of the cloud input method, and the view of the first operation UI control object is a keyboard view of the cloud keyboard.

[0131] The embodiment of the present invention specifically provides four ways of adjusting the area position of the first information input view. Of course, those skilled in the art should know that the following four adjustment ways are only used to illustrate the embodiment of the present invention, but not to limit the embodiment of the present invention.

[0132] The following describes adjustment method 1. The execution subject of adjustment method 1 is the cloud device. Figure 5 , is a flowchart of the steps of adjusting the area position of the first information input view executed on a cloud device according to an embodiment of the present invention.

[0133] In step S510, after sending the information input type corresponding to the first information input view to the user device, the cloud device receives attribute information of the second input operation view from the user device.

[0134] The attribute information of the second input operation view is used to locate the area position of the second input operation view in the window display image. Further, the attribute information of the second input operation view is used to locate the area position of the input area of ​​the second input operation view in the window display image.

[0135] The attribute information of the second input operation view includes, but is not limited to, the position information of the second input operation view. Of course, the attribute information of the second input operation view may also include, style information of the second input operation view. The style information includes, but is not limited to, at least one of layout, color or shape.

[0136] The position information of the second input operation view includes: the coordinates of the diagonal vertices of the second input operation view. Alternatively, the position information of the second input operation view includes: the size information of the second input operation view and the coordinate information of two arbitrary preset points of the second input operation view. The size information includes: the view shape and line size of the second input operation view. When the view shape is fixed (for example, a preset shape), the size information can be represented by a specific size value. Exemplarily, the second input operation view Figure 1 It is generally a rectangle, and its size information may be the length and width of the second input operation view.

[0137] Further, the position information of the second input operation view includes: the coordinates of the diagonal vertices of the input area in the second input operation view. Alternatively, the position information of the second input operation view includes: the size information of the input area in the second input operation view and the coordinate information of two arbitrary preset points of the second input operation view. The size information includes: the view shape and line size of the input area in the second input operation view. The input area in the second input operation view is generally rectangular, and its size information may be: the length and width of the input area in the second input operation view.

[0138] In step S520, the cloud device adjusts the area position of the first information input view according to the attribute information of the second input operation view, so that when the image of the first information input view and the second input operation view are displayed by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0139] If the attribute information of the second input operation view can locate the area position of the second input operation view in the window display image, the area position of the first information input view is adjusted according to the area position of the second input operation view in the window display image, so that the area position of the second input operation view does not overlap with the area position of the first information input view, and thereby the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0140] If the attribute information of the second input operation view can locate the area position of the input area of ​​the second input operation view in the window display image, then the area position of the first information input view is adjusted according to the area position of the input area of ​​the second input operation view in the window display image, so that the input area of ​​the second input operation view does not overlap with the first information input view, and further the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0141] Since the window display image rendered by the cloud device needs to be displayed on the user device, in the process of superimposing and displaying the second input operation view and the window display image on the user device side, it is required that the input area of ​​the second input operation view does not block the display area of ​​the first information input view in the window display image. In this embodiment, the user device sends the attribute information of the second input operation view to the cloud device. When the cloud device knows the regional position of the second input operation view, or the regional position of the input area of ​​the second input operation view, it can be relatively easy to make the regional position of the first information input view, especially the display area of ​​the first information input view, avoid the regional position of the input area of ​​the second operation view, so as to achieve the effect that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0142] The following describes adjustment method 2. The execution subject of adjustment method 2 is the cloud device. Figure 6 , is a flowchart of the steps of adjusting the area position of the first information input view executed on a cloud device according to an embodiment of the present invention.

[0143] In step S610, after monitoring an input start event in the first information input view, the cloud device creates a first input operation view; wherein the relative position of the first input operation view and the first information input view is fixed.

[0144] The relative position of the first input operation view and the first information input view is fixed, which means that the input area of ​​the first input operation view and the display area of ​​the first information input view do not overlap each other, and the distance between the first edge of the first input operation view and the second edge of the first information input view remains unchanged. Among them, the edge is an edge of the view. The first edge is the edge of the first input operation view close to the first information input view. The second edge is the edge of the first information input view close to the first input operation view.

[0145] Specifically, in the Android system, if information needs to be input into the first input UI control object, the cloud device completes it with the help of the cloud operation program. In this case, it is necessary to create a first operation UI control object on the cloud device, so that the rendered window display image includes the image of the first operation UI control object (first input operation view).

[0146] In this embodiment, the user can collect input information through the user operation program on the user device side, and does not use the cloud operation program on the cloud device side to collect input information. Therefore, in order to prevent the first input operation view from being seen in the window display image displayed on the user device side and to improve the user viewing effect of the user display window, when creating the first input operation view, the first input operation view can be a transparent view.

[0147] In this embodiment, the first operation UI control object does not need to monitor the cloud click event, and the cloud operation program does not need to determine the input information according to the cloud click event. Of course, the first operation UI control object can also monitor the cloud click event, and the cloud operation program does not process or respond to the cloud click event.

[0148] Step S620: After sending the information input type to the user device, the cloud device receives attribute information of the second input operation view from the user device.

[0149] In step S630, the cloud device adjusts the attribute information of the first input operation view according to the attribute information of the second input operation view, so as to adjust the area position of the first information input view accordingly, so that when the first information input view and the second input operation view are displayed by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0150] The attribute information of the second input operation view is used to locate the area position of the second input operation view in the window display image. Further, the attribute information of the second input operation view is used to locate the area position of the input area of ​​the second input operation view in the window display image.

[0151] The attribute information of the second input operation view includes, but is not limited to, the position information of the second input operation view. Of course, the attribute information of the second input operation view may also include, style information of the second input operation view. The style information includes, but is not limited to, at least one of layout, color or shape.

[0152] According to the position information of the second input operation view, the regional position of the first input operation view in the window display image is adjusted so that the regional position of the second input operation view in the window display image completely covers or partially covers the regional position of the first input operation view in the window display image.

[0153] In the case where the area position of the second input operation view completely covers the area position of the first input operation view, the first input operation view will not be visible on the user device side. Further, in order for the second input operation view to completely cover the first input operation view in the window display image when the window display image and the second input operation view are superimposed on the user device side, the position information of the first input operation view can be adjusted to the first target position information; wherein the target position information is the same as the position information of the second input operation view.

[0154] In the case where the area position of the second input operation view partially covers the area position of the first input operation view, the relative positions of the first input operation view and the first information input view are fixed, and when the area position of the first input operation view in the window is adjusted, the edge of the second input operation view close to the first information input view is in the target area of ​​the third edge. The third edge is the area edge of the display area of ​​the first information input view close to the first input operation view. The target area of ​​the third edge is the area on one side of the third edge close to the first information input view. Figure 7 The figure shows a schematic diagram of the adjustment position of the first input operation view according to an embodiment of the present invention, so that when the display window image and the second input operation view are superimposed on the user device side, the input area of ​​the second input operation view does not block the display area of ​​the first information input view.

[0155] In the embodiment of the present invention, since the relative positions of the first input operation view and the first information input view are fixed, when the regional position of the first input operation view changes, the regional position of the first information input view changes accordingly. Conversely, when the regional position of the first information input view changes, the regional position of the first input operation view also changes accordingly. Based on the relative positional relationship between the first input operation view and the first information input view, the attribute information of the first input operation view is adjusted according to the attribute information of the second input operation view. When the attribute information of the first input operation view changes, the position of the first information input view changes accordingly. As long as the second input operation view is close to the edge of the first information input view and is in the target area of ​​the third edge, it can be ensured that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0156] The following describes adjustment method 3. The execution subject of adjustment method 3 is the cloud device. Figure 8 , is a flowchart of the steps of adjusting the area position of the first information input view executed on a cloud device according to an embodiment of the present invention.

[0157] In step S810, after sending the information input type corresponding to the first information input view to the user device, the cloud device receives attribute information of the second input operation view from the user device.

[0158] Step S820: The cloud device creates a first input operation view according to the attribute information of the second input operation view.

[0159] The attribute information of the second input operation view is used to locate the area position of the second input operation view in the window display image. Further, the attribute information of the second input operation view is used to locate the area position of the input area of ​​the second input operation view in the window display image.

[0160] The area position of the first input operation view is the same as the area position of the second input operation view, or the area position of the first input operation view partially overlaps with the area position of the second input operation view.

[0161] The attribute information of the second input operation view includes, but is not limited to, the position information of the second input operation view. Of course, the attribute information of the second input operation view may also include, style information of the second input operation view. The style information includes, but is not limited to, at least one of layout, color or shape.

[0162] Furthermore, a first input operation view having second target position information is created, wherein the second target position information is the same as the position information of the first input operation view, so that the area position of the first input operation view is the same as the area position of the second input operation view.

[0163] In this embodiment, in order to prevent the first input operation view from being seen in the window display image displayed on the user device side and improve the user viewing effect of the user display window, when creating the first input operation view, the first input operation view can be a transparent view.

[0164] In step S830, the cloud device adjusts the area position of the first information input view according to the attribute information of the first input operation view, so that when the first information input view and the second input operation view are displayed by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0165] When the area position of the first information input operation view is known, the area position of the first information input view is adjusted so that the second input operation view is close to the edge of the first information input view and is in the target area of ​​the third edge, so that when the user device superimposes the display window display image and the second input operation view, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view in the window display image.

[0166] In this embodiment, the user device sends the attribute information of the second input operation view to the cloud device. Since the attribute information of the second input operation view can locate the regional position of the second input operation view, the first input operation view is created according to the regional position of the second input operation view, and the regional position of the first information input view is adjusted according to the first input operation view, so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0167] In an embodiment of the present invention, in addition to adjusting the area of ​​the first information input view on the cloud device side so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view, the attribute information of the second input operation view can also be adjusted on the user device side so that the second input operation view is close to the edge of the first information input view and is in the target area of ​​the third edge, so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0168] After describing how to adjust the area position of the first information input view, a method for adjusting the area position of the second input operation view on the user device side is described so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view. Fig. 9 FIG. 1 is a flowchart of steps for adjusting the attribute information of the second input operation view according to an embodiment of the present invention.

[0169] In step S910, after monitoring an input start event of the first information input view, the cloud device creates a first input operation view; wherein the input area of ​​the first input operation view does not overlap with the display area of ​​the first information input view.

[0170] In this embodiment, in order to prevent the first input operation view from being seen in the window display image displayed on the user device side and improve the user viewing effect of the user display window, when creating the first input operation view, the first input operation view can be a transparent view.

[0171] Step S920: The cloud device obtains attribute information of the first input operation view.

[0172] The attribute information of the first input operation view is used to locate the area position of the first input operation view in the window display image. Further, the attribute information of the first input operation view is used to locate the area position of the input area of ​​the second input operation view in the window display image.

[0173] The attribute information of the first input operation view includes, but is not limited to, the position information of the first input operation view. Of course, the attribute information of the first input operation view may also include, style information of the first input operation view. The style information includes, but is not limited to, at least one of layout, color or shape.

[0174] The position information of the first input operation view includes: the coordinates of the diagonal vertices of the first input operation view. Alternatively, the position information of the first input operation view includes: the size information of the first input operation view and the coordinate information of two arbitrary preset points of the first input operation view. The size information includes: the view shape and line size of the first input operation view.

[0175] Further, the position information of the first input operation view includes: the coordinates of the diagonal vertices of the input area in the first input operation view. Alternatively, the position information of the first input operation view includes: the size information of the input area in the first input operation view and the coordinate information of two arbitrary preset points of the first input operation view. The size information includes: the view shape and line size of the input area in the first input operation view. The input area in the first input operation view is generally rectangular, and its size information may be: the length and width of the input area in the first input operation view.

[0176] Step S930: The cloud device sends the attribute information of the first input operation view to the user device.

[0177] By sending the attribute information of the first input operation view to the user device, the user device can adjust the attribute information of the second input operation view according to the attribute information of the first input operation view, so that when the first information input view and the second input operation view are displayed by the user device, the second input operation view covers the first input operation view, and the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0178] Step S940: After creating the second input operation view, the user device receives attribute information of the first input operation view from the cloud device.

[0179] Step S950: The user device adjusts the attribute information of the second input operation view according to the attribute information of the first input operation view, so that the second input operation view covers the first input operation view and the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0180] The attribute information of the second input operation view is adjusted so that the second input operation view completely or partially covers the first input operation view.

[0181] Furthermore, the attribute information of the second input operation view is adjusted to the target attribute information; the target attribute information is the same as the attribute information of the first input operation view. In this way, the second input operation view can completely cover the first input operation view, and the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0182] Furthermore, when adjusting the attribute information of the second input operation view, the edge of the second input operation view close to the first information input view is in the target area of ​​the fourth edge. The fourth edge is the edge of the first input operation view close to the first information input view. The target area of ​​the fourth edge is the side area of ​​the fourth edge close to the second input operation view. Fig.10The figure shows a schematic diagram of the adjustment position of the second input operation view according to an embodiment of the present invention, so that the second input operation view partially covers the first input operation view, and the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0183] In an embodiment of the present invention, when the area position of the first input operation view is known, the attribute information of the second input operation view is adjusted so that the second input operation view is close to the edge of the first information input view and is in the target area of ​​the fourth edge, so that the second input operation view covers the first input operation view, and the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0184] After adjusting the area position of the first information input view or the area position of the second input operation view, the user can see the first information input view and the second input operation view in the image superimposed and displayed by the user device. The user can input information through the second input operation view.

[0185] However, in the case where the cloud device has created a first input operation view, after completing the information input, the first input operation view needs to be destroyed. Further, the destruction of the first input operation view is achieved by destroying the first input UI control object, and destroying the first input UI control object means deleting the first input UI control object and releasing the memory space corresponding to the first input UI control object.

[0186] Fig.11 is a flowchart of the steps of destroying the first input operation view according to an embodiment of the present invention.

[0187] Step S1110: During the process of collecting input information input through the second input operation view, the user equipment monitors an input end event occurring in the second input operation view.

[0188] Step S1120: After monitoring the input end event occurring in the second input operation view, the user equipment generates input end information corresponding to the input end event.

[0189] A view retracting button may be set in the second input operation view, and the input end event may be listened to at the position of the view retracting button.

[0190] Step S1130: The user device sends the input end information to the cloud device so that the cloud device destroys the first input operation view.

[0191] Step S1140: After creating the first input operation view, the cloud device receives input end information from the user device.

[0192] Step S1150: The cloud device destroys the first input operation view according to the input end information.

[0193] The following takes the text input scenario of the Android system as an example to illustrate the cloud input method of the embodiment of the present invention. Fig.12 FIG. 4 is a schematic diagram of cloud input according to an embodiment of the present invention. Fig.13 This is a diagram showing the effect of cloud input according to an embodiment of the present invention.

[0194] In an embodiment of the present invention, the modules in the cloud device include a cloud program, a cloud device system, and a cloud input method. The modules in the user device include a client, a user device system, and a user input method. Among them, the cloud device and the user device are connected to the network. The cloud input method of the present invention is described below from the perspective of each module in the cloud device and the user device.

[0195] On the user device side, the user device system starts the client, through which the cloud device and the user device are connected to the network, and the cloud program in the cloud device is started.

[0196] On the cloud device side, the cloud device system runs a cloud program. During the running of the cloud program, the cloud device system renders the image in the cloud display window to obtain a window display image; the window display image includes a cloud input box view (corresponding to the above-mentioned first information input view), and the cloud input box view corresponds to a cloud input box UI control object, and the area of ​​the cloud input box view is the same as the area of ​​the cloud input box UI control object.

[0197] The cloud device system sends the rendered window display image to the user device, the user device system receives the window display image, sends the window display image to the client, and the client displays the window display image in the user display window.

[0198] When the user needs to input information, the user can click on the cloud input box view in the window display image displayed on the user device.

[0199] The user device system monitors the user click event, generates occurrence location information according to the occurrence location coordinates of the user click event, and sends the occurrence location information to the cloud device.

[0200] The cloud device system generates a cloud click event based on the occurrence location information; the cloud input box listens to the cloud click event, obtains the focus and generates an input start event; after listening to the input start event, the cloud device system obtains the information input type corresponding to the cloud input box, sends the information input type to the user device system, and starts the cloud input method, so that the cloud input method creates a cloud keyboard UI control object in the cloud display window. At this time, a cloud keyboard view (corresponding to the above-mentioned first input operation view) will appear in the cloud display window of the cloud device, and the area of ​​the cloud keyboard view coincides with the area of ​​the cloud keyboard UI control object; the cloud device system renders the window display image and sends the window display image to the user device. At this time, the window display image includes the cloud input box view and the cloud keyboard view, such as Fig.13 As shown in the image of the cloud display window, the cloud input box view is a transparent rectangular password input box view, and the cloud keyboard view is a rectangular frame keyboard view.

[0201] The user device system receives the window display image and the information input type respectively; sends the window display image to the client, and sends the information input type to the client and the user input method respectively. The client displays the window display image in the user display window, and creates a user input box UI control object in the user display window; the user input method creates a user keyboard UI control object in the user display window; at this time, there will be a user input box view (corresponding to the above-mentioned second information input view) and a user keyboard view (corresponding to the above-mentioned second input operation view) in the user display window, such as Fig.13 As shown in the image of the user display window in FIG. 1 , the user input box view is a transparent rounded box view, and the user keyboard view is a rounded box keyboard view. In an embodiment of the present invention, the user input box view is a transparent view.

[0202] The user input method of the user device sends the position information of the user keyboard view to the cloud input method of the cloud device.

[0203] After receiving the position information of the user's keyboard view, the cloud input method adjusts the position information of the cloud keyboard view to the position information of the user's keyboard view. Adjusting the position information of the cloud keyboard view is achieved by adjusting the position information of the cloud keyboard UI control object, so that the position information of the cloud keyboard UI control object is the same as the position information of the user's keyboard view, that is, adjusting the position information of the cloud keyboard view to the position information of the user's keyboard view. Since the area of ​​the cloud input box UI control object is adjacent to the area of ​​the cloud keyboard UI control object, after adjusting the position information of the cloud keyboard UI control object, the area of ​​the cloud keyboard UI control object changes, and the area of ​​the cloud input box UI control object also changes accordingly, so as to continue to be adjacent to the area of ​​the cloud keyboard UI control object, so that the position information of the cloud input box view also changes accordingly. Fig.13 As shown in the adjusted cloud keyboard view, the cloud keyboard view is stretched so that the position information of the cloud keyboard view is the same as the user keyboard view. At this time, the window display image rendered by the cloud device system includes the adjusted cloud keyboard view. Since the cloud input box view is adjacent to the cloud keyboard view and does not block each other, and the cloud keyboard view has the same position information as the user keyboard view.

[0204] The cloud device system sends the rendered window display image to the user device. The user device system sends the window display image to the client, and the client displays the window display image in the user display window, such as Fig.13 As shown in the image displayed by the user device, the image displayed by the user device is a superposition of the image of the cloud display window (the image after the cloud keyboard view is adjusted) and the image of the user display window. In the superimposed image, the user can see the user keyboard view and the cloud input box view. Since the user input box view is a transparent view, the user input box view is invisible to the user and will not block the cloud input box view.

[0205] The user can click on the user keyboard view, and the user keyboard UI control object listens for the click event and sends the click event to the user keyboard, which sends the input information selected by the user to the user device system. The user device system sends the input information to the user input box UI control object. The user input box UI control object sends the input information to the cloud input method. The cloud input method receives the input information and sends it to the cloud device system, which sends the input information to the cloud input box UI control object, which displays the input information. The window display image rendered by the cloud device system will include the image corresponding to the input information in the cloud input box view. For example: the image of the password number.

[0206] The following describes the cloud input method of an embodiment of the present invention for a cloud gaming scenario.

[0207] like Fig.14 , which is a schematic diagram of a cloud input method according to an embodiment of the present invention.

[0208] The cloud device (also called cloud device) installs the cloud game APP (Application) and the cloud input method APK (Android application package). The cloud input method can be called cloud input APK. The cloud input method is set as the system default input method. The cloud device system is Android System.

[0209] The user device installs the client APK and the user input method APK. The client includes a network interaction module. The network interaction module is used for the client to communicate with the cloud input method. The user device system is not limited.

[0210] The following describes the interaction process between the cloud device and the user device.

[0211] Step 1: After a cloud click event occurs, the APP text box (cloud text box) obtains the focus and generates an input start event.

[0212] Step 2: The cloud device system monitors the input start event and requests to launch the cloud input method. The cloud input method responds to the request of the cloud device system and starts working after being activated.

[0213] The cloud input method parses the system message of the cloud device system and determines the configuration information of the APP text box. The configuration information includes but is not limited to: information input type, such as pure numbers, pure letters, no restrictions, etc.

[0214] The cloud input method creates a blank transparent view and uses it as the keyboard view (keyboard interaction view) of the cloud input method, thereby triggering the cloud device system to adjust the position of the APP text box. The position of the APP text box is adjusted in real time based on the UI attribute information returned in step 6, so as to ensure that the overall UI display effect on the cloud device side is consistent with that on the user device side.

[0215] Step 3: The cloud input method sends the input notification event to the client in the user device through the network.

[0216] The cloud input method communicates with the network interaction module in the client to send input notification events to the client.

[0217] The input notification event is used to notify the client that it can start inputting information. The input notification event carries the configuration information of the APP text box.

[0218] Step 4: After receiving the input notification event, the client in the user device creates a transparent and invisible user input text box according to the configuration information. The user input text box acquires the focus, triggering the user device to enter the input scene.

[0219] The user input text box is a transparent view, which can ensure that the text box that the user sees on the user device side is only the APP text box on the cloud device side.

[0220] Step 5: After the user input method of the user device is pulled up, the user inputs text through the input method of the user device.

[0221] After the user input text box obtains the focus, an input start event is generated. The user device system monitors the input start event and requests to launch the user input method. The user input method responds to the request of the user device system and starts working after being activated.

[0222] Step 6: The client transmits the text content (input information) to the cloud input method in real time, and transmits the UI attribute information of the keyboard view of the user input method (such as the height and width of the screen, etc.) in real time.

[0223] Real-time feedback of the UI attribute information of the user input method keyboard view can ensure that the overall UI display effect on the cloud device side is consistent with that on the user device. For example, the APP text box on the cloud device is always displayed above the user input method keyboard.

[0224] When the text content is sent back, it can be encrypted.

[0225] Step 7: When the cloud input method receives the UI attribute information, it adjusts the position of the APP text box. When the cloud input method receives the text content, it submits the text content to the cloud device system through the system API (Application Programming Interface) and notifies the cloud device system to close the cloud input method keyboard.

[0226] Step 8: The cloud device system submits the text content to the APP text box. The APP text box receives the text content and displays it in real time, thus completing the entire input requirement.

[0227] When the user closes the keyboard of the user input method, the input ends. The client sends the closing event back to the cloud device. The cloud device closes the cloud input method and notifies the cloud APP that the input ends.

[0228] In view of the above-mentioned cloud input method, an embodiment of the present invention further provides a cloud input system. The cloud input system is based on Figure 1 The cloud communication system shown is carried out, so the structural diagram of the cloud input system is the same as the structural diagram of the cloud communication system.

[0229] The cloud input system includes: a cloud device 120 and a user device 110. The cloud device 120 and the user device 110 are connected via a network.

[0230] The cloud device 120 is used to perform event monitoring on the first information input view during the running of the cloud program; after monitoring the input start event of the first information input view, obtain the configuration information of the first information input view; the configuration information includes the information input type; the configuration information is sent to the user device 110 so that the user device 110 can collect input information that meets the information input type.

[0231] The user device 110 is connected to the cloud device 120 and is used to monitor events on the display window during the process of displaying the image corresponding to the cloud program; after a click event is monitored, the occurrence location information of the click event is sent to the cloud device 120, so that when the occurrence location information corresponds to the first information input view of the cloud device 120, the first information input view generates an input start event; receives configuration information sent by the cloud device 120; the configuration information includes an information input type; collects input information that meets the information input type and sends it to the cloud device 120.

[0232] The cloud device 120 is further used to receive input information collected by the user device 110; and display the input information in the first information input view.

[0233] The cloud device and user device described in the embodiment of the present invention have been described in the above method embodiment. Therefore, for details not provided in the description of this embodiment, please refer to the relevant description in the above embodiment and will not be repeated here.

[0234] The embodiment of the present invention also provides a cloud input device arranged in a cloud device. Fig.15 , is a structural diagram of a cloud input device disposed in a cloud device according to an embodiment of the present invention.

[0235] The cloud input device provided in the cloud device includes: a first monitoring module 1510 , an information acquisition module 1520 , a first sending module 1530 , a first receiving module 1540 and an information display module 1550 .

[0236] The first monitoring module 1510 is used to perform event monitoring on the first information input view during the running of the cloud program.

[0237] The information acquisition module 1520 is used to acquire configuration information of the first information input view after monitoring the occurrence of an input start event in the first information input view; the configuration information includes the information input type.

[0238] The first sending module 1530 is used to send the information input type to the user equipment so that the user equipment collects input information that meets the information input type.

[0239] The first receiving module 1540 is configured to receive input information collected by the user equipment.

[0240] The information display module 1550 is used to display the input information in the first information input view.

[0241] The functions of the device described in the embodiment of the present invention have been described in the above method embodiment, so for the details not fully described in this embodiment, please refer to the relevant description in the above embodiment, and no further description will be given here.

[0242] The embodiment of the present invention also provides a cloud input device arranged in a user device. Fig.16 , is a structural diagram of a cloud input device disposed in a user device according to an embodiment of the present invention.

[0243] The cloud input device arranged in the user equipment includes: a second monitoring module 1610 , a second sending module 1620 , a second receiving module 1630 and a third sending module 1640 .

[0244] The second monitoring module 1610 is used to monitor events of the display window during the process of displaying the image corresponding to the cloud program.

[0245] The second sending module 1620 is used to send the occurrence location information of the click event to the cloud device after the click event is monitored, so that when the occurrence location information corresponds to the first information input view of the cloud device, the first information input view generates an input start event.

[0246] The second receiving module 1630 is used to receive configuration information from the cloud device; the configuration information includes information input type.

[0247] The third sending module 1640 is used to collect the input information that meets the information input type and send it to the cloud device, so that the cloud device displays the input information in the first information input view.

[0248] The functions of the device described in the embodiment of the present invention have been described in the above method embodiment, so for the details not fully described in this embodiment, please refer to the relevant description in the above embodiment, and no further description will be given here.

[0249] The embodiment of the present invention further provides an electronic device, such as Fig.17 As shown, it includes a processor 1710 , a communication interface 1720 , a memory 1730 and a communication bus 1740 , wherein the processor 1710 , the communication interface 1740 , and the memory 1730 communicate with each other via the communication bus 1740 .

[0250] The memory 1730 is used to store computer programs.

[0251] Processor 1710, when used to execute the program stored in memory 1730, can implement the following steps executed on the cloud device: in the process of running the cloud program, perform event monitoring on the first information input view; after monitoring the input start event of the first information input view, obtain the configuration information of the first information input view; the configuration information includes the information input type; send the configuration information to the user device so that the user device collects input information that meets the information input type; receive the input information collected by the user device; and display the input information in the first information input view.

[0252] In which, the input information is collected through a second input operation view or an external input device; in the process of displaying the first information input view and the second input operation view by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0253] Among them, after sending the configuration information to the user device, it also includes: receiving attribute information of the second input operation view from the user device; adjusting the area position of the first information input view according to the attribute information of the second input operation view, so that when the first information input view and the second input operation view are displayed by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0254] Wherein, after monitoring the input start event of the first information input view, it also includes: creating a first input operation view; wherein the relative position of the first input operation view and the first information input view is fixed; after sending the information input type to the user device, it also includes: receiving attribute information of the second input operation view from the user device; according to the attribute information of the second input operation view, adjusting the attribute information of the first input operation view so as to adjust the area position of the first information input view accordingly, so that in the process of displaying the first information input view and the second input operation view by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0255] Among them, the attribute information of the second input operation view includes: the position information of the second input operation view; adjusting the attribute information of the first input operation view according to the attribute information of the second input operation view includes: adjusting the position information of the first input operation view to first target position information; wherein, the first target position information is the same as the position information of the second input operation view.

[0256] Wherein, after sending the configuration information to the user device, it also includes: receiving attribute information of a second input operation view from the user device; creating a first input operation view according to the attribute information of the second input operation view; adjusting the area position of the first information input view according to the attribute information of the first input operation view, so that when the first information input view and the second input operation view are displayed by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0257] Among them, the attribute information of the second input operation view includes: the location information of the second input operation view; creating the first input operation view according to the attribute information of the second input operation view includes: creating a first input operation view with second target location information; wherein the second target location information is the same as the location information of the first input operation view.

[0258] Wherein, after monitoring the input start event of the first information input view, it also includes: creating a first input operation view; wherein the input area of ​​the first input operation view does not overlap with the display area of ​​the first information input view; obtaining attribute information of the first input operation view; sending the attribute information of the first input operation view to the user device, so that the user device adjusts the attribute information of the second input operation view according to the attribute information of the first input operation view, so that in the process of displaying the first information input view and the second input operation view by the user device, the second input operation view covers the first input operation view, and the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0259] Wherein, the first input operation view is a transparent view.

[0260] After the first input operation view is created, the method further includes: receiving input end information from the user device; and destroying the first input operation view according to the input end information.

[0261] The input information is information encrypted by the user device; before displaying the input information in the first information input view, the method further includes: performing decryption processing on the input information using a preset information decryption algorithm.

[0262] The processor 1710, when used to execute the program stored in the memory 1730, can also implement the following steps executed on the user device: in the process of displaying the image corresponding to the cloud program, monitor the user display window for events; after monitoring the click event, send the occurrence location information of the click event to the cloud device, so that when the occurrence location information corresponds to the first information input view of the cloud device, an input start event is generated in the first information input view; receive configuration information from the cloud device; the configuration information includes the information input type; collect input information that meets the information input type and send it to the cloud device, so that the cloud device displays the input information in the first information input view.

[0263] After receiving the configuration information sent by the cloud device, the method further includes: creating a second information input view; wherein the second information input view is a transparent view.

[0264] Among them, the collecting of input information that meets the information input type and sending it to the cloud device includes: monitoring the external input device connected to the user device; determining the input information based on the monitored user input events; and sending the input information to the cloud device when the input information meets the information input type.

[0265] Wherein, the collected input information that meets the information input type is sent to the cloud device, including: creating a second input operation view corresponding to the information input type; wherein, in the process of displaying the first information input view and the second input operation view, the input area of ​​the second input operation view is made not overlapped with the display area of ​​the first information input view; monitoring the second input operation view, and determining the input information based on the monitored user click event; and sending the input information to the cloud device.

[0266] Among them, after creating the second input operation view corresponding to the information input type, it also includes: obtaining attribute information of the second input operation view; sending the attribute information of the second input operation view to the cloud device, so that the cloud device adjusts the area position of the first information input view according to the attribute information of the second input operation view, or, according to the attribute information of the second input operation view, creates the first input operation view or adjusts the attribute information of the created first input operation view, and adjusts the area position of the first information input view according to the attribute information of the first input operation view, so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0267] Wherein, after creating the second input operation view corresponding to the information input type, it also includes: receiving attribute information of the first input operation view from the cloud device; wherein the input area of ​​the first input operation view does not overlap with the display area of ​​the first information input view; according to the attribute information of the first input operation view, adjusting the attribute information of the second input operation view so that the second input operation view covers the first input operation view, and the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

[0268] Among them, adjusting the attribute information of the second input operation view according to the attribute information of the first input operation view includes: adjusting the attribute information of the second input operation view to target attribute information; wherein the target attribute information is the same as the attribute information of the first input operation view.

[0269] Among them, in the process of collecting input information that meets the information input type, it also includes: monitoring the input end event occurring in the second input operation view; generating input end information corresponding to the input end event, and sending the input end information to the cloud device so that the cloud device can destroy the first input operation view.

[0270] Before collecting the input information that meets the information input type and sending it to the cloud device, the method further includes: using a preset information encryption algorithm to perform encryption processing on the input information.

[0271] The communication bus mentioned in the above terminal can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0272] The communication interface is used for communication between the above terminal and other devices.

[0273] The memory may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0274] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.

[0275] In another embodiment provided by the present invention, a computer-readable storage medium is also provided, which stores instructions. When the computer-readable storage medium is executed on a computer, the computer executes any of the cloud input methods executed on a cloud device described in the above embodiments or any of the cloud input methods executed on a user device described in the above embodiments.

[0276] In another embodiment provided by the present invention, a computer program product comprising instructions is also provided. When the computer is run on a computer, the computer executes any of the cloud input methods executed on a cloud device described in the above embodiments or any of the cloud input methods executed on a user device described in the above embodiments.

[0277] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.

[0278] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0279] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0280] The above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims

1. A cloud input method, characterized in that: The steps performed on the cloud device include: During the running of the cloud program, event monitoring is performed on the first information input view; After monitoring the occurrence of an input start event of the first information input view, obtaining configuration information of the first information input view; the configuration information includes an information input type; Sending the configuration information to a user device so that the user device collects input information that conforms to the information input type; Receiving attribute information of a second input operation view from the user device; According to the attribute information of the second input operation view, adjust the area position of the first information input view so that when the first information input view and the second input operation view are displayed by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view; Receiving input information collected by the user equipment; The input information is displayed in the first information input view.

2. The method according to claim 1, characterized in that The input information is collected through a second input operation view or an external input device; During the process of displaying the first information input view and the second input operation view by the user equipment, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

3. The method according to claim 2, characterized in that After monitoring the occurrence of an input start event in the first information input view, the method further includes: Creating a first input operation view; wherein the relative position of the first input operation view and the first information input view is fixed; After sending the information input type to the user equipment, the method further includes: Receiving attribute information of the second input operation view from the user equipment; According to the attribute information of the second input operation view, the attribute information of the first input operation view is adjusted so as to accordingly adjust the area position of the first information input view, so that when the first information input view and the second input operation view are displayed by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

4. The method according to claim 3, characterized in that The attribute information of the second input operation view includes: position information of the second input operation view; The adjusting the attribute information of the first input operation view according to the attribute information of the second input operation view includes: The position information of the first input operation view is adjusted to first target position information; wherein the first target position information is the same as the position information of the second input operation view.

5. The method according to claim 2, characterized in that: After sending the configuration information to the user equipment, the method further includes: Receiving attribute information of a second input operation view from the user device; Creating a first input operation view according to the attribute information of the second input operation view; According to the attribute information of the first information input operation view, the area position of the first information input view is adjusted so that when the first information input view and the second input operation view are displayed by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

6. The method according to claim 5, characterized in that The attribute information of the second input operation view includes: position information of the second input operation view; The creating the first input operation view according to the attribute information of the second input operation view includes: A first input operation view having second target position information is created; wherein the second target position information is the same as the position information of the first input operation view.

7. The method according to claim 2, characterized in that After monitoring the occurrence of an input start event in the first information input view, the method further includes: Creating a first input operation view; wherein an input area of ​​the first input operation view does not overlap with a display area of ​​the first information input view; Acquire attribute information of the first input operation view; The attribute information of the first input operation view is sent to the user device so that the user device adjusts the attribute information of the second input operation view according to the attribute information of the first input operation view, so that when the first information input view and the second input operation view are displayed by the user device, the second input operation view covers the first input operation view, and the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

8. The method according to any one of claims 3 to 7, characterized in that: The first input operation view is a transparent view.

9. The method according to any one of claims 3 to 7, characterized in that: After creating the first input operation view, the method further includes: Receiving input completion information from the user device; Destroy the first input operation view according to the input end information.

10. The method according to any one of claims 1 to 7, characterized in that The input information is information encrypted by the user device; Before displaying the input information in the first information input view, the method further includes: The input information is decrypted using a preset information decryption algorithm.

11. A cloud input method, characterized in that: The steps performed on the user equipment include: In the process of displaying the image corresponding to the cloud program, the user display window is monitored for events; After the click event is monitored, the occurrence position information of the click event is sent to the cloud device, so that when the occurrence position information corresponds to the first information input view of the cloud device, an input start event is generated in the first information input view; Receiving configuration information from the cloud device; the configuration information includes information input type; collecting input information that conforms to the information input type and sending it to the cloud device, so that the cloud device displays the input information in the first information input view; The collecting input information that meets the information input type and sending it to the cloud device includes: Creating a second input operation view corresponding to the information input type; wherein, in the process of displaying the first information input view and the second input operation view, an input area of ​​the second input operation view is made not to overlap with a display area of ​​the first information input view; Monitoring the second input operation view, and determining input information according to the monitored user click event; Sending the input information to the cloud device; Acquire attribute information of the second input operation view; The attribute information of the second input operation view is sent to the cloud device so that the cloud device adjusts the area position of the first information input view according to the attribute information of the second input operation view, or, according to the attribute information of the second input operation view, creates the first input operation view or adjusts the attribute information of the created first input operation view, and adjusts the area position of the first information input view according to the attribute information of the first input operation view, so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

12. The method according to claim 11, characterized in that After receiving the configuration information from the cloud device, the method further includes: A second information input view is created; wherein the second information input view is a transparent view.

13. The method according to claim 12, characterized in that The collecting input information that meets the information input type and sending it to the cloud device includes: Monitoring an external input device connected to the user equipment; Determine input information based on monitored user input events; When the input information meets the information input type, the input information is sent to the cloud device.

14. The method according to claim 11, characterized in that After the second input operation view corresponding to the information input type is created, the method further includes: Receiving attribute information of a first input operation view from the cloud device; wherein an input area of ​​the first input operation view does not overlap with a display area of ​​the first information input view; According to the attribute information of the first input operation view, the attribute information of the second input operation view is adjusted so that the second input operation view covers the first input operation view and the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

15. The method according to claim 14, characterized in that The adjusting the attribute information of the second input operation view according to the attribute information of the first input operation view includes: The attribute information of the second input operation view is adjusted to target attribute information; wherein the target attribute information is the same as the attribute information of the first input operation view.

16. The method according to any one of claims 11 to 15, characterized in that The process of collecting input information that meets the information input type also includes: Listening for an input end event occurring in the second input operation view; Input end information corresponding to the input end event is generated, and the input end information is sent to the cloud device so that the cloud device destroys the first input operation view.

17. The method according to any one of claims 11 to 15, characterized in that Before collecting the input information that meets the information input type and sending it to the cloud device, the method further includes: The input information is encrypted using a preset information encryption algorithm.

18. A cloud input system, characterized in that: The system includes: a cloud device and a user device; wherein, The cloud device is used to perform the method steps described in any one of claims 1-10; The user device is connected to the cloud device and is used to execute the method steps of any one of claims 11-17.

19. A cloud input device, characterized in that: Set on the cloud device side, including: A first monitoring module, used to perform event monitoring on the first information input view during the running of the cloud program; An information acquisition module, configured to acquire configuration information of the first information input view after monitoring an input start event of the first information input view; the configuration information includes an information input type; a first sending module, configured to send the configuration information to a user device so that the user device collects input information that conforms to the information input type; receive attribute information of a second input operation view from the user device; and adjust the area position of the first information input view according to the attribute information of the second input operation view, so that during the process in which the first information input view and the second input operation view are displayed by the user device, the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view; A first receiving module, used to receive input information collected by the user equipment; An information display module is used to display the input information in the first information input view.

20. A cloud input device, characterized in that: Set on the user equipment side, including: The second monitoring module is used to monitor events of the display window during the process of displaying the image corresponding to the cloud program; A second sending module is used to send the occurrence position information of the click event to the cloud device after the click event is monitored, so that when the occurrence position information corresponds to the first information input view of the cloud device, the first information input view generates an input start event; A second receiving module, used to receive configuration information from the cloud device; the configuration information includes an information input type; A third sending module, used for collecting input information that meets the information input type and sending it to the cloud device, so that the cloud device displays the input information in the first information input view; The collecting input information that meets the information input type and sending it to the cloud device includes: Creating a second input operation view corresponding to the information input type; wherein, in the process of displaying the first information input view and the second input operation view, an input area of ​​the second input operation view is made not to overlap with a display area of ​​the first information input view; Monitoring the second input operation view, and determining input information according to the monitored user click event; Sending the input information to the cloud device; Acquire attribute information of the second input operation view; The attribute information of the second input operation view is sent to the cloud device so that the cloud device adjusts the area position of the first information input view according to the attribute information of the second input operation view, or, according to the attribute information of the second input operation view, creates the first input operation view or adjusts the attribute information of the created first input operation view, and adjusts the area position of the first information input view according to the attribute information of the first input operation view, so that the input area of ​​the second input operation view does not overlap with the display area of ​​the first information input view.

21. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor, for implementing the method steps described in any one of claims 1 to 10, or implementing the method steps described in any one of claims 11 to 17, when executing a program stored in a memory.

22. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the program implements the method steps described in any one of claims 1 to 10, or implements the method steps described in any one of claims 11 to 17.

Images