Input method and device of cloud real machine

Abstract

The invention discloses an input method and device of a cloud real machine, and relates to the technical field of computers. A specific embodiment of the method comprises the following steps: in response to a click operation of a user on a video at a browser end, sending a click instruction to a cloud real machine; the click instruction indicates a first position of the click operation on the video; obtaining element information returned by the cloud real machine in response to the click instruction; under the condition that the element information indicates that the first position is the character capable of being input, creating an input box at the first position on the video and waking up the target input method; receiving characters input by the user in the input box by using the target input method; and sending the characters to the cloud real machine. According to the embodiment, the input character can be directly sent to the cloud real machine by creating the input box at the browser end and waking up the input method, the input method does not need to be waken up at the cloud real machine end and the character is remotely input, then different waking-up methods do not need to be adapted to a cloud real machine platform, and the method is convenient, rapid and high in universality.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a cloud-based machine input method and device. Background Art

[0002] Cloud machine is a physical mobile phone based on the Internet. It projects the mobile phone screen to the browser through video streaming, allowing users to remotely control the physical machine on the browser. In the existing input process, it is necessary to wake up the input method on the cloud machine and send the key information on the browser to the cloud machine to complete the character input. However, the cloud machine itself cannot wake up the input method through the shortcut keys on the browser, so it is necessary to adapt the input method wake-up method for the cloud machine on the cloud machine platform. For different operating systems, different cloud machine brands and different operating versions, corresponding wake-up methods need to be adapted, which has high requirements for research and development and is not easy to maintain. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides an input method and device for a cloud real machine. By creating an input box on the browser side and waking up the input method, the input characters can be directly sent to the cloud real machine. There is no need to wake up the input method on the cloud real machine side and input characters remotely. There is no need to adapt different wake-up methods on the cloud real machine platform. It is convenient, fast and has strong versatility.

[0004] To achieve the above objective, according to one aspect of an embodiment of the present invention, a cloud-based machine input method is provided.

[0005] A cloud real machine input method according to an embodiment of the present invention is applied to a browser side, and includes: in response to a user's click operation on a video on the browser side, sending a click instruction to the cloud real machine; the click instruction indicates a first position of the click operation on the video; obtaining element information returned by the cloud real machine in response to the click instruction; when the element information indicates that the first position is an inputtable character, creating an input box at the first position on the video and waking up a target input method; receiving characters entered by the user in the input box using the target input method; and sending the characters to the cloud real machine.

[0006] Optionally, before responding to the user's click operation on the video on the browser side, it also includes: sending a connection request to the cloud real machine; establishing a network socket between the cloud real machine and the browser side according to the matching information returned by the cloud real machine in response to the connection request, so as to utilize the network socket to realize communication between the browser side and the cloud real machine.

[0007] Optionally, the network socket includes a video stream and a control stream; wherein the video stream is used to display the interface information of the cloud real machine on the browser side; and the control stream is used to send the user's click operation on the video to the cloud real machine.

[0008] Optionally, before creating an input box at the first position on the video and waking up the target input method, the method further includes: configuring the attributes, length, height and duration of the input box;

[0009] The creating an input box at the first position on the video and waking up the target input method includes: creating the input box according to preconfigured properties, length, and height, and displaying the input box according to the duration.

[0010] To achieve the above objective, according to another aspect of an embodiment of the present invention, another cloud-based machine input method is provided.

[0011] Another cloud real machine input method of an embodiment of the present invention is applied to the browser side, including: receiving a click instruction from the browser side; the click instruction indicates the first position of the click operation on the browser video; determining a second position corresponding to the first position on the current display interface, and determining element information of the first position based on whether characters can be input at the second position; returning the element information to the browser side; and receiving characters sent by the browser side when the element information indicates that characters can be input at the first position.

[0012] Optionally, before receiving the click instruction from the browser, it also includes: receiving a connection request sent by the browser; generating matching information in response to the connection request, and returning the matching information to the browser, so that a network socket is established between the cloud real machine and the browser, and the network socket is used to realize communication between the browser and the cloud real machine.

[0013] To achieve the above objective, according to another aspect of an embodiment of the present invention, an input device for a cloud real machine is provided.

[0014] An input device of a cloud real machine in an embodiment of the present invention is applied to a browser side, and includes: a first sending module, used to send a click instruction to the cloud real machine in response to a user's click operation on a video on the browser side; the click instruction indicates the first position of the click operation on the video; the character is sent to the cloud real machine; an acquisition module, used to obtain element information returned by the cloud real machine in response to the click instruction; a creation module, used to create an input box at the first position on the video and wake up a target input method when the element information indicates that the first position is an inputtable character; a first receiving module, used to receive characters entered by the user in the input box using the target input method.

[0015] To achieve the above objective, according to another aspect of an embodiment of the present invention, another input device for a cloud machine is provided.

[0016] Another input device of a cloud real machine according to an embodiment of the present invention is applied to the cloud real machine, including: a second receiving module, used to receive a click instruction from the browser; the click instruction indicates the first position of the click operation on the browser video; when the element information indicates that the first position is an input character, receiving the character sent by the browser; a determination module, used to determine the second position corresponding to the first position on the current display interface, and determine the element information of the first position according to whether the second position can input characters; a second sending module, used to return the element information to the browser.

[0017] To achieve the above objective, according to another aspect of an embodiment of the present invention, a cloud-to-real-machine system is provided.

[0018] A cloud real machine system of an embodiment of the present invention includes: the above-mentioned browser end and the cloud real machine, wherein the browser end sends a click instruction to the cloud real machine in response to a user's click operation on a video on the browser end; the click instruction indicates a first position of the click operation on the video; the cloud real machine receives the click instruction from the browser end; determines a second position corresponding to the first position on the current display interface, and determines element information of the first position according to whether characters can be input at the second position; the cloud real machine returns the element information to the browser end; the browser end obtains the element information returned by the cloud real machine in response to the click instruction; when the element information indicates that the first position is inputtable, creates an input box at the first position on the video and wakes up a target input method; the browser end receives characters input by the user in the input box using the target input method, and sends the characters to the cloud real machine.

[0019] Optionally, before the step in which the browser responds to a click operation by the user on the video on the browser, it also includes: displaying one or more cloud real machines to the user through the browser; the browser receives a selection instruction from the user; the selection instruction indicates a target cloud real machine selected by the user from the one or more cloud real machines; the browser sends a connection request to the target cloud real machine; the target cloud real machine sends a connection request to the browser, generates matching information in response to the connection request, and returns the matching information to the browser, so that a network socket is established between the cloud real machine and the browser, and the network socket is used to realize communication between the browser and the cloud real machine.

[0020] To achieve the above objective, according to another aspect of an embodiment of the present invention, an electronic device for cloud real machine input is provided.

[0021] A cloud real machine input electronic device according to an embodiment of the present invention includes: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement a cloud real machine input method according to an embodiment of the present invention.

[0022] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided.

[0023] A computer-readable storage medium according to an embodiment of the present invention stores a computer program, which, when executed by a processor, implements a cloud-to-real-machine input method according to an embodiment of the present invention.

[0024] One embodiment of the above invention has the following advantages or beneficial effects: by creating an input box on the browser side and waking up the input method, the input characters can be directly sent to the cloud real machine, without waking up the input method on the cloud real machine side and inputting characters remotely, and there is no need to adapt different wake-up methods on the cloud real machine platform, which is convenient, fast and versatile.

[0025] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0027] Figure 1 It is a schematic diagram of the main process of a cloud real machine input method according to an embodiment of the present invention;

[0028] Figure 2 This is a schematic diagram of the main process of connecting a browser end and a cloud real machine according to an embodiment of the present invention;

[0029] Figure 3 It is a main flow diagram of another cloud real machine input method according to an embodiment of the present invention;

[0030] Figure 4 This is a schematic diagram of the main process of connecting a cloud real machine with a browser according to an embodiment of the present invention;

[0031] Figure 5 is a schematic diagram of main modules of an input device of a cloud real machine according to an embodiment of the present invention;

[0032] Figure 6 is a schematic diagram of main modules of another input device of a cloud real machine according to an embodiment of the present invention;

[0033] Figure 7 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;

[0034] Figure 8 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION

[0035] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0036] It should be pointed out that the embodiments of the present invention and the technical features therein may be combined with each other without conflict.

[0037] It should be noted that the collection, collection, updating, analysis, processing, use, transmission, storage and other aspects of user personal information involved in the technical solution of this disclosure are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information, network security and national security.

[0038] Figure 1 It is a main flow chart of the input method of the cloud real machine according to an embodiment of the present invention.

[0039] like Figure 1 As shown, the cloud real machine input method of the embodiment of the present invention is applied to the browser side, and mainly includes the following steps:

[0040] Step S101: in response to a user clicking on a video on a browser, sending a click instruction to a cloud real machine; the click instruction indicates the first position of the click operation on the video;

[0041] Step S102: Obtaining element information returned by the cloud real machine in response to the click instruction;

[0042] Step S103: when the element information indicates that the first position is an inputtable character, create an input box at the first position on the video and wake up the target input method;

[0043] Step S104: receiving characters input by the user in the input box using the target input method;

[0044] Step S105: Send the characters to the cloud real machine.

[0045] Among them, Yunzhenji is a physical mobile phone real machine based on the Internet. It projects the mobile phone screen to the browser side through video streaming, allowing users to remotely control the physical real machine on the browser side. For users, only the browser side can perform operations, and the video displayed on the browser side is the mobile phone interface of Yunzhenji. The present invention realizes remote control of the mobile phone interface through user operations on the video.

[0046] It should be noted that before the browser and the cloud real machine perform data transmission (remote control), it is necessary to ensure the communication connection between the browser and the cloud real machine in advance. Only when the communication connection is stable can the data transmission be completed. Therefore, before step S101, in an optional embodiment, as Figure 2 As shown, including:

[0047] Step S201: Send a connection request to the cloud real machine;

[0048] Step S202: according to the matching information returned by the cloud real machine in response to the connection request, a network socket is established between the cloud real machine and the browser end, so as to realize the communication between the browser end and the cloud real machine by using the network socket.

[0049] There may be multiple cloud machines, and the user may select a cloud machine on the browser side, select a target cloud machine to be connected from the multiple cloud machines, and send a connection request to the target cloud machine. The matching information may be information indicating a successful match or a failed match. When the matching information indicates a successful match, a network socket is established between the cloud machine and the browser side.

[0050] For step S202, in a further optional embodiment, there may be two network sockets, including a video stream and a control stream, wherein different network sockets are used to implement different data transmission functions. Specifically, the video stream is used to display the interface information of the cloud real machine on the browser side, and the control stream is used to send the user's click operation on the video to the cloud real machine.

[0051] Through the above process, the communication connection between the cloud real machine and the browser is realized, and the remote display of the cloud real machine interface and the remote control of the browser operation are realized through two network sockets.

[0052] In step S101, the click instruction is generated according to the user's click operation. Specifically, the corresponding click instruction can be generated according to the coordinates or pixel position of the first position where the user clicks on the video, so that after the cloud real machine receives the click instruction, it can obtain the specific click position of the user on the mobile phone interface. The click operation of the present invention is not limited to the single-click operation of the mouse, but can also include a double-click operation, a sliding operation, etc., which is not limited in the present invention.

[0053] It should be noted that, for the mobile phone interface on the cloud real machine, each pixel point (position) will have a corresponding element type, element size, and control type, and each interface corresponds to an element tree, which contains all the element information in the interface. Therefore, the element information returned in step S102 can specifically include: element type, control type, and element size.

[0054] Furthermore, in step S103, the browser needs to judge the element information to determine whether the element information indicates that the first position is an input character, for example, judging whether the control type is an input box, or judging whether the element type is an input type, etc. The present invention does not limit this.

[0055] In an optional embodiment, before step S103, it also includes: configuring the attributes, length, height and duration of the input box. It is understandable that when the user clicks on the video, where the input box pops up, the size (height and length) of the input box, the color of the input box, whether the input box is transparently displayed, etc., can all be set according to user needs. It is preferred to display the input box at a position that does not affect the display of the mobile phone interface in the video, that is, step S103 can specifically include: creating the input box according to the pre-configured attributes, length, and height, and displaying the input box according to the duration. Among them, the duration can be understood as the display time of the input box, such as 10s, 20s, etc. If the user does not want to input characters, but just accidentally clicks on the video, the input box can be deleted after the duration exceeds.

[0056] In an optional embodiment, when the user performs click operations continuously, when the next click operation is triggered, even if the input box corresponding to the previous position does not exceed the duration, the created input box will be deleted and only the input box corresponding to the last click operation will be displayed.

[0057] For the target input method awakened in step S103, in an optional embodiment, it can be pre-set according to the specific type of operation. For example, when the mouse is clicked, the English input method is awakened, and when the mouse is double-clicked, the Chinese input method is awakened. Different input methods are awakened by different click operations, so that users can realize the synchronous input of Chinese and English. It should be noted that since the input method is awakened locally in the browser, the cloud real machine directly obtains the characters input locally in the browser, so it is generally not necessary to install multiple different types of Chinese input methods (such as Sogou input method, Wubi input method, etc., all for Chinese input), and only one commonly used one can be installed.

[0058] The input method of the cloud real machine according to an embodiment of the present invention can directly send the input characters to the cloud real machine by creating an input box and waking up the input method on the browser side. There is no need to wake up the input method on the cloud real machine side and input characters remotely, and there is no need to adapt different wake-up methods on the cloud real machine platform. It is convenient, fast and versatile.

[0059] Figure 3 It is a main flow chart of another cloud real machine input method according to an embodiment of the present invention.

[0060] like Figure 3 As shown, the input method of the cloud real machine in the embodiment of the present invention is applied to the cloud real machine, and mainly includes the following steps:

[0061] Step S301: receiving a click instruction from the browser; the click instruction indicates the first position of the click operation on the browser video;

[0062] Step S302: determining a second position corresponding to the first position on the current display interface, and determining element information of the first position according to whether characters can be input at the second position;

[0063] Step S303: Return the element information to the browser;

[0064] Step S304: When the element information indicates that the first position is an inputtable character, receive the character sent by the browser.

[0065] Among them, the browser side can only display the mobile phone interface of the cloud real machine. For the video, it is impossible to obtain the corresponding element information through the first position clicked by the user on the video. Therefore, the cloud real machine is needed to determine the element information. That is, step S302 can be understood as determining the specific second position corresponding to the mobile phone interface according to the first position of the click operation on the video, that is, determining the second position that the user wants to click on the mobile phone interface according to the first position, and then determining the element type, element size, and element control type corresponding to the second position. For example, the user clicks the first position on the video on the browser side. After the browser side sends the click instruction containing the first position to the cloud real machine, the cloud real machine determines the second position corresponding to the first position on the current display interface, and determines whether the second position is an input box. If so, the element information of the first position is determined to be an input box.

[0066] In an optional embodiment, before receiving the click instruction from the browser, Figure 4 As shown, it also includes:

[0067] Step S401: receiving a connection request sent by a browser;

[0068] Step S402: Generate matching information in response to the connection request, and return the matching information to the browser side, so that a network socket is established between the cloud real machine and the browser side, and the network socket is used to realize communication between the browser side and the cloud real machine.

[0069] According to the input method of the cloud real machine in an embodiment of the present invention, by creating an input box on the browser side and waking up the input method, the input characters can be directly sent to the cloud real machine. There is no need to wake up the input method on the cloud real machine side and input characters remotely, and there is no need to adapt different wake-up methods on the cloud real machine platform. It is convenient, fast and versatile.

[0070] Figure 5 It is a schematic diagram of main modules of the input device of the cloud real machine according to an embodiment of the present invention.

[0071] like Figure 5 As shown, the input device 500 for the browser side of the cloud real machine of the embodiment of the present invention includes:

[0072] The first sending module 501 is used to send a click instruction to the cloud real machine in response to a click operation of the user on the video on the browser side; the click instruction indicates the first position of the click operation on the video; and send the character to the cloud real machine;

[0073] An acquisition module 502 is used to acquire element information returned by the cloud real machine in response to the click instruction;

[0074] A creation module 503, configured to create an input box at the first position on the video and wake up a target input method if the element information indicates that the first position is an inputtable character;

[0075] The first receiving module 504 is configured to receive characters input by a user in the input box using the target input method.

[0076] In an optional embodiment of the present invention, the first sending module 501 is also used to send a connection request to the cloud real machine; based on the matching information returned by the cloud real machine in response to the connection request, a network socket is established between the cloud real machine and the browser end, so as to utilize the network socket to realize communication between the browser end and the cloud real machine.

[0077] In an optional embodiment of the present invention, the network socket includes a video stream and a control stream; wherein the video stream is used to display the interface information of the cloud real machine on the browser side; and the control stream is used to send the user's click operation on the video to the cloud real machine.

[0078] In an optional embodiment of the present invention, the device also includes a configuration module for configuring the attributes, length, height and duration of the input box before creating the input box at the first position on the video and waking up the target input method; the creation module 503 is also used to create the input box according to the preconfigured attributes, length, and height, and display the input box according to the duration.

[0079] According to the input device of the cloud real machine applied to the browser side according to the embodiment of the present invention, by creating an input box on the browser side and waking up the input method, the input characters can be directly sent to the cloud real machine. There is no need to wake up the input method on the cloud real machine side and input characters remotely, and there is no need to adapt different wake-up methods on the cloud real machine platform. It is convenient, fast and versatile.

[0080] Figure 6 4 is a schematic diagram of main modules of an input device of a cloud real machine applied to a cloud real machine according to an embodiment of the present invention.

[0081] like Figure 6 As shown, the input device 500 of the cloud real machine of the embodiment of the present invention includes:

[0082] The second receiving module 601 is used to receive a click instruction from the browser; the click instruction indicates the first position of the click operation on the browser video; if the element information indicates that the first position is an input character, receive the character sent by the browser;

[0083] A determination module 602 is used to determine a second position on the current display interface corresponding to the first position, and determine element information of the first position according to whether characters can be input at the second position;

[0084] The second sending module 603 is used to return the element information to the browser.

[0085] In an optional embodiment of the present invention, the second receiving module 601 is also used to, before receiving the click instruction from the browser, also include: receiving a connection request sent by the browser; generating matching information in response to the connection request, and returning the matching information to the browser, so as to establish a network socket between the cloud real machine and the browser, and use the network socket to realize communication between the browser and the cloud real machine.

[0086] According to the input device of the cloud real machine applied to the cloud real machine according to the embodiment of the present invention, by creating an input box on the browser side and waking up the input method, the input characters can be directly sent to the cloud real machine. There is no need to wake up the input method on the cloud real machine side and input characters remotely, and there is no need to adapt different wake-up methods on the cloud real machine platform. It is convenient, fast and versatile.

[0087] Figure 7 An exemplary system architecture 700 is shown to which the input method of a cloud real machine or the input device of a cloud real machine according to an embodiment of the present invention can be applied.

[0088] like Figure 7 As shown, the system architecture 700 may include browsers 701, 702, 703, a network 704, a server 705, and cloud machines 706, 707, 708. The network 704 is used to provide a medium for communication links between the browsers 701, 702, 703 and the server 705, and between the server 705 and the cloud machines 706, 707, 708. The network 704 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0089] The user can use the browser terminals 701, 702, 703 to interact with the server 705 through the network 704 to receive or send data, etc. Various communication client applications can be installed on the browser terminals 701, 702, 703, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc.

[0090] The browser terminals 701, 702, and 703 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers, etc.

[0091] The server 705 may be a server that provides various services, such as a background management server that provides support for click operations sent by users using the browser terminals 701, 702, and 703. The background management server may analyze and process the received click operations and input characters and other data, and send the processing results (such as the input characters) to the cloud real machines 706, 707, and 708.

[0092] It should be understood that Figure 7 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0093] Reference below Figure 8 , which shows a schematic diagram of the structure of a computer system 800 of a terminal device suitable for implementing an embodiment of the present invention. Figure 8 The terminal device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0094] like Figure 8 As shown, the computer system 800 includes a central processing unit (CPU) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage part 808 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the system 800 are also stored. The CPU 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) first interface 805 is also connected to the bus 804.

[0095] The following components are connected to the I / O first interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network first interface card such as a LAN card, a modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I / O first interface 805 as needed. A removable medium 811, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 810 as needed, so that a computer program read therefrom is installed into the storage section 808 as needed.

[0096] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 809, and / or installed from the removable medium 811. When the computer program is executed by the central processing unit (CPU) 801, the above-mentioned functions defined in the system of the present invention are executed.

[0097] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0098] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0099] The modules involved in the embodiments of the present invention may be implemented in software or hardware. The modules described may also be set in a processor. For example, they may be described as: a processor includes a first sending module, an acquisition module, a creation module, and a first receiving module. The names of these modules do not, in some cases, constitute a limitation on the modules themselves. For example, the first sending module may also be described as "a module that sends a click instruction to the cloud real machine in response to a user's click operation on the video on the browser side."

[0100] As another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs. When the above one or more programs are executed by a device, the device includes: in response to a user's click operation on the video on the browser side, sending a click instruction to the cloud real machine; the click instruction indicates the first position of the click operation on the video; obtaining the element information returned by the cloud real machine in response to the click instruction; when the element information indicates that the first position is an inputtable character, creating an input box at the first position on the video and waking up the target input method; receiving the characters entered by the user in the input box using the target input method; and sending the characters to the cloud real machine.

[0101] According to the technical solution of the embodiment of the present invention, by creating an input box and waking up the input method on the browser side, the input characters can be directly sent to the cloud real machine. There is no need to wake up the input method on the cloud real machine side and input characters remotely, and there is no need to adapt different wake-up methods on the cloud real machine platform. It is convenient, fast and versatile.

[0102] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A cloud real machine input method, characterized in that: Applied to the browser side, including: In response to a click operation of a user on the video on the browser side, sending a click instruction to the cloud real machine; the click instruction indicates a first position of the click operation on the video; Obtaining element information returned by the cloud real machine in response to the click instruction; When the element information indicates that the first position is an inputtable character, creating an input box at the first position on the video and waking up a target input method; Receiving characters input by a user in the input box using the target input method; The character is sent to the cloud real machine.

2. The method according to claim 1, characterized in that Before responding to the user's click operation on the video on the browser side, the method further includes: Sending a connection request to the cloud real machine; According to the matching information returned by the cloud real machine in response to the connection request, a network socket is established between the cloud real machine and the browser end, so as to realize the communication between the browser end and the cloud real machine by using the network socket.

3. The method according to claim 2, characterized in that The network socket includes a video stream and a control stream; wherein, The video stream is used to display the interface information of the cloud real machine on the browser side; The control flow is used to send the user's click operation on the video to the cloud real machine.

4. The method according to claim 1, characterized in that: Before creating an input box at the first position on the video and waking up the target input method, the method further includes: Configure the input box's properties, length, height, and duration; The step of creating an input box at the first position on the video and waking up a target input method includes: The input box is created according to the preconfigured properties, length, and height, and is displayed according to the duration.

5. A cloud real machine input method, characterized in that: Applied to cloud real machines, including: Receiving a click instruction from a browser; the click instruction indicates a first position of the click operation on the browser video; Determine a second position on the current display interface corresponding to the first position, and determine element information of the first position according to whether characters can be input at the second position; Returning the element information to the browser; When the element information indicates that the first position is an inputtable character, characters sent by the browser are received.

6. The method according to claim 5, characterized in that Before receiving the click instruction from the browser, the method further includes: Receiving a connection request sent by the browser; In response to the connection request, matching information is generated and returned to the browser end, so that a network socket is established between the cloud real machine and the browser end, and the network socket is used to realize communication between the browser end and the cloud real machine.

7. An input device for a cloud machine, characterized in that: Applied to the browser side, including: A first sending module is used to send a click instruction to the cloud real machine in response to a click operation of a user on the video on the browser side; the click instruction indicates a first position of the click operation on the video; and send the character to the cloud real machine; An acquisition module, used to acquire element information returned by the cloud real machine in response to the click instruction; A creation module, configured to create an input box at the first position on the video and wake up a target input method if the element information indicates that the first position is an inputtable character; The first receiving module is used to receive characters input by the user in the input box using the target input method.

8. An input device for a cloud machine, characterized in that: Applied to cloud real machines, including: A second receiving module is used to receive a click instruction from a browser; the click instruction indicates a first position of the click operation on the browser video; and when the element information indicates that the first position is an inputtable character, receive the character sent by the browser; A determination module, configured to determine a second position on the current display interface corresponding to the first position, and determine element information of the first position according to whether characters can be input at the second position; The second sending module is used to return the element information to the browser end.

9. A cloud-based real machine system, characterized in that: include: The browser terminal as described in claim 7 and the cloud real machine as described in claim 8; wherein, The browser sends a click instruction to the cloud real machine in response to a click operation of a user on the video on the browser; the click instruction indicates a first position of the click operation on the video; The cloud real machine receives a click instruction from the browser; determines a second position corresponding to the first position on the current display interface, and determines element information of the first position according to whether characters can be input at the second position; The cloud real machine returns the element information to the browser end; The browser side obtains the element information returned by the cloud real machine in response to the click instruction; When the element information indicates that the first position is an inputtable character, creating an input box at the first position on the video and waking up a target input method; The browser receives characters input by the user in the input box using the target input method, and sends the characters to the cloud real machine.

10. The system according to claim 9, characterized in that Before the step of the browser responding to the user's click operation on the video on the browser, the method further includes: Display one or more cloud real machines to the user through the browser; The browser receives a selection instruction from the user; the selection instruction indicates a target cloud real machine selected by the user from the one or more cloud real machines; The browser sends a connection request to the target cloud real machine; The target cloud real machine receives a connection request sent by the browser, generates matching information in response to the connection request, and returns the matching information to the browser, so that a network socket is established between the cloud real machine and the browser, and the network socket is used to realize communication between the browser and the cloud real machine.

11. An electronic device for cloud real machine input, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 6.

12. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images