Application system and its operating method and input device

Abstract

The application provides an application system, an operation method thereof and an input device. The application system comprises a remote server device, a local input device and a local computing device. The remote server device provides an application service. The local input device establishes a first connection with the remote server device through a communication network. The local input device generates input information to control the application service. The local input device transmits input data corresponding to the input information to the remote server device through the communication network. The local computing device establishes a second connection with the remote server device through the communication network. The remote server device transmits image frames of the application service to the local computing device through the communication network based on the input data. The local computing device displays the image frames.

Description

Technical Field

[0001] This invention relates to a communication network system, and more particularly to an application system, its operation method, and input device. Background Technology

[0002] Figure 1 This is a block diagram of an existing application system 100. Figure 1 In the illustrated embodiment, application system 100 includes a remote server device 110, a local computing device 120, and a local input device 130. The local input device 130 includes a keyboard and / or a mouse. The local input device 130 is connected to the local computing device 120 via a non-communication network interface 20. The non-communication network interface 20 includes a Universal Serial Bus (USB) interface or a Bluetooth interface. The local computing device 120 includes a personal computer or other computing device. The local computing device 120 can establish a connection with the remote server device 110 via a communication network 10. The communication network 10 includes the Internet and / or a Wi-Fi network (wireless network).

[0003] Remote server device 110 can provide application services (such as audio / video streaming services) to local computing device 120. Based on user operations, local input device 130 can generate input data to control the application services of remote server device 110. Local computing device 120 can receive the input data output by local input device 130 through non-communication network interface 20, and then forward the input data to remote server device 110 through communication network 10. Based on the input data, remote server device 110 can transmit image frames of application services to local computing device 120 through communication network 10. Therefore, local computing device 120 can display the image frames provided by remote server device 110.

[0004] anyway, Figure 1 The application system 100 shown has some problems. For example, the application system 100 has security issues. Users use local input devices 130 (keyboard, mouse, etc.) to input data into local computing devices 120 (computers, etc.). As is well known, computers are vulnerable to Trojan horse programs and / or virus infections. That is, hackers may steal the user's private data entered on the local computing device 120.

[0005] Application system 100 also suffers from transmission speed issues. The operation of application system 100 is as follows: the user uses a local input device 130 (keyboard, mouse, etc.) to input data to a local computing device 120 (computer, etc.). The local computing device 120 then transmits the input data to a remote server device 110 via a communication network 10 (Internet, etc.). Next, the remote server device 110 sends the result (image frame) back to the local computing device 120. The local computing device 120 must forward the input data from the local input device 130 to the remote server device 110, i.e., it forwards the data through the local computing device 120. Because the input data must pass through the local computing device 120, the transmission process is lengthened, reducing the transmission speed and increasing the time required to transmit the input data to the remote server device 110.

[0006] Application system 100 also has convenience issues. When the local input device 130 is a USB input device, the user needs to plug the local input device 130 into the local computing device 120 to transmit input data to the remote server device 110. When the local input device 130 is a Bluetooth input device, the user needs to plug a Bluetooth adapter (dongle) into the local computing device 120 to transmit input data to the remote server device 110.

[0007] These issues will cause users to have concerns about the local input device 130. Solving these problems in application system 100 will allow users to have a safer, faster, and more convenient input experience. It should be noted that the content of the "Background Art" paragraph is used to help understand the present invention. Some (or all) of the content disclosed in the "Background Art" paragraph may not be prior art known to those skilled in the art. The content disclosed in the "Background Art" paragraph does not mean that such content was known to those skilled in the art prior to this application. Summary of the Invention

[0008] This invention provides an application system, its operation method, and an input device to increase the security of user data input, reduce the time for input data to be transmitted to a remote server, and improve the convenience of using the input device.

[0009] In one embodiment of the present invention, the application system includes a remote server device, a first local input device, and a first local computing device. The remote server device provides application services. The first local input device includes an input interface circuit and a first communication network interface circuit. The first communication network interface circuit establishes a first connection with the remote server device via a communication network. The input interface circuit generates first input information to control the application service. The first communication network interface circuit is coupled to the input interface circuit to receive the first input information. The first communication network interface circuit transmits the first input data corresponding to the first input information to the remote server device via the communication network. The first local computing device includes a display module and a second communication network interface circuit. The second communication network interface circuit establishes a second connection with the remote server device via the communication network. Based on the first input data, the remote server device transmits image frames of the application service to the second communication network interface circuit via the communication network. The display module is coupled to the second communication network interface circuit to receive the image frames. The display module displays the image frames.

[0010] In one embodiment of the present invention, the above-described operation method includes: establishing a first connection between a first communication network interface circuit of a first local input device of the application system and a remote server device of the application system via a communication network; generating first input information by an input interface circuit of the first local input device to control the application service of the remote server device; transmitting the first input data corresponding to the first input information to the remote server device via a communication network by the first communication network interface circuit; establishing a second connection between a second communication network interface circuit of a first local computing device of the application system and the remote server device via a communication network; transmitting an image frame of the application service to the second communication network interface circuit based on the first input data via a communication network by the remote server device; and displaying the image frame by a display module of the first local computing device.

[0011] In one embodiment of the present invention, the input device includes an input interface circuit and a first communication network interface circuit. The input interface circuit generates first input information to control the application services provided by the remote server device. The first communication network interface circuit is coupled to the input interface circuit to receive the first input information. The first communication network interface circuit establishes a first connection with the remote server device through a communication network. The first communication network interface circuit transmits the first input data corresponding to the first input information to the remote server device through the communication network. The remote server device establishes a second connection with a first local computing device through the communication network.

[0012] Based on the above, the input device described in the embodiments of the present invention can establish a direct connection with a remote server device via a communication network. That is, input data from the local input device is not transmitted to the local computing device, thereby increasing security. Furthermore, since the input data from the local input device does not need to be forwarded by the local computing device, the transmission speed of input data can be further improved, and the time for transmitting input data to the remote server device can be reduced. In addition, since the local input device can establish a connection with the remote server device via a communication network, the user does not need to plug the local input device into the local computing device, thus improving convenience.

[0013] To make the above features and advantages of the present invention more apparent and understandable, specific embodiments are described below in conjunction with the accompanying drawings. Attached Figure Description

[0014] Figure 1 This is a block diagram of an existing application system.

[0015] Figure 2 This is a block diagram of an application system according to an embodiment of the present invention.

[0016] Figure 3 This is a flowchart of an operation method of an application system according to an embodiment of the present invention.

[0017] Figure 4 This is a flowchart of a pairing method between a local computing device and a local input device according to an embodiment of the present invention.

[0018] Figure 5 This is a block diagram of an application system according to another embodiment of the present invention.

[0019] Figure 6 This is a flowchart illustrating a method for switching between multiple local computing devices according to an embodiment of the present invention.

[0020] Figure 7 This is described according to an embodiment of the present invention. Figure 2 The circuit block diagram shown is for the local computing device and the local input device.

[0021] Figure 8 This is described according to another embodiment of the present invention. Figure 2 The circuit block diagram shown is for the local computing device and the local input device.

[0022] In the attached figures, the following labels are used:

[0023] 10, 30 communication networks

[0024] 20 Non-communication network interfaces

[0025] 100, 200, 500 application systems

[0026] 110, 210 remote servo devices

[0027] 120, 220, 240 local terminal computing devices

[0028] 130, 230, 250 local input devices

[0029] 221 and 232 communication network interface circuits

[0030] 222 display module

[0031] 231 input interface circuit

[0032] Steps S310~S330, S410~S440, S610~S650 Detailed Implementation

[0033] The term "coupled (or connected)" as used throughout this specification (including the claims) may refer to any direct or indirect means of connection. For example, if the text describes a first device coupled (or connected) to a second device, it should be interpreted as the first device being directly connected to the second device, or the first device being indirectly connected to the second device through other devices or some means of connection. The terms "first," "second," etc., used throughout this specification (including the claims) are used to name elements or distinguish different embodiments or scopes, and are not intended to limit the upper or lower limit of the number of elements, nor to limit the order of elements. Furthermore, wherever possible, elements / components / steps using the same reference numerals in the drawings and embodiments represent the same or similar parts. Elements / components / steps using the same reference numerals or the same terms in different embodiments may be referred to mutually in the relevant descriptions.

[0034] Figure 2 This is a block diagram of an application system 200 according to an embodiment of the present invention. Figure 2 In the illustrated embodiment, the application system 200 includes a remote server device 210, a local computing device 220, and a local input device 230. Depending on the actual design, the local input device 230 may include a keyboard, mouse, and / or other input devices, while the local computing device 220 may include a personal computer, laptop computer, tablet computer, and / or other computing devices.

[0035] Figure 3This is a flowchart illustrating the operation method of an application system according to an embodiment of the present invention. To clearly explain the operation of the above-mentioned components and the operation method of the application system according to this embodiment, the following will be used in conjunction with… Figure 3 The flowchart is described in detail below. However, those skilled in the art will understand that the operation method of this invention is not limited to... Figure 2 Application systems 200, and not limited to Figure 3 The flowchart shows the sequence of steps. Please refer to [the flowchart]. Figure 2 and Figure 3 In step S310, the local input device 230 can establish a first connection with the remote server device 210 through the communication network 30, and the local computing device 220 (the first local computing device) can establish a second connection with the remote server device 210 through the communication network 30. Depending on the actual design, the communication network 30 may include an Ethernet network, a Wi-Fi network (wireless network), the Internet, and / or other communication networks.

[0036] For example, a user can configure the correct network connection information on the local computing device 220 according to the actual network environment. In some applications, the network connection information may include, for example, the URL of the remote server device 210. In other applications, the network connection information may further include the Service Set Identifier (SSID) and password of the wireless network base station. Therefore, the local computing device 220 can connect to the communication network 30 and establish a second connection with the remote server device 210.

[0037] The local computing device 220 can provide the network connection information corresponding to the second connection to the local input device 230. For example, the local computing device 220 and the local input device 230 can enable an ad hoc network (or wireless ad hoc network, or wireless ad-hoc network). The local input device 230 (e.g., a keyboard and / or a mouse) can act as a server in the ad hoc network, while the local computing device 220 (e.g., a mobile phone) can act as a client in the ad hoc network. Therefore, the local computing device 220 can provide the correct network connection information corresponding to the remote server device 210 to the local input device 230. Based on the network connection information provided by the local computing device 220, the local input device 230 can establish a first connection with the remote server device 210 through the communication network 30.

[0038] The remote server device 210 can provide application services to the local computing device 220. Depending on the design, the application services may include search services, financial services, video streaming services, gaming services, and / or other application services. Based on user operations, the local input device 230 can generate input data to control the application services of the remote server device 210 (step S320). Depending on the design, in some embodiments, the input data may be encrypted ciphertext. In other embodiments, the input data may be unencrypted plaintext. In step S320, the local input device 230 can transmit the input data to the remote server device 210 via the communication network 30. The input data (private data) of the local input device 230 is not sent to the local computing device 220. Therefore, even if a Trojan program is implanted on the local computing device 220, a hacker cannot steal the input data of the local input device 230 through the local computing device 220.

[0039] Depending on design requirements, in some embodiments, the local input device 230 can transmit input data to the remote server device 210 in plaintext. In other embodiments, the local input device 230 can transmit input data to the remote server device 210 in encrypted form. That is, the local input device 230 can generate input data and transmit it to the remote server device 210 by performing an encryption algorithm. The encryption algorithm can be determined according to design requirements. For example, in some embodiments, the encryption algorithm may include RSA encryption algorithm, Data Encryption Standard (DES) algorithm, Triple DES (3DES) algorithm, Advanced Encryption Standard (AES) algorithm, or other encryption algorithms.

[0040] Based on the input data from the local input device 230, the remote server device 210 can transmit image frames of the application service (e.g., operation screens of the application service) to the local computing device 220 via the communication network 30 (step S330). Therefore, the local computing device 220 can display the image frames provided by the remote server device 210 in step S330. In some embodiments, the pairing relationship between the local computing device 220 and the local input device 230 can be predefined in the remote server device 210. That is, depending on the actual design, the pairing relationship between the local computing device 220 and the local input device 230 can be static (fixed). In other embodiments, the pairing relationship between the local computing device 220 and the local input device 230 can be dynamic.

[0041] Figure 4 This is a flowchart illustrating a pairing method between a local computing device and a local input device according to an embodiment of the present invention. Please refer to... Figure 2 and Figure 4 In step S410, the local computing device 220 (first local computing device) may issue a pairing request to the remote server device 210. The pairing period begins when the local computing device 220 issues the pairing request. Based on the pairing request from the local computing device 220, the remote server device 210 may provide a first identification code to the local computing device 220 via the communication network 30 (second connection) during the pairing period (step S420). Therefore, the local computing device 220 may display the first identification code provided by the remote server device 210 in step S420.

[0042] During pairing, based on the first identification code provided by the remote server device 210 and the user's operation, the local input device 230 can send the second identification code back to the remote server device 210 via the communication network 30 (first connection) (step S430). For example, suppose the first identification code displayed by the local computing device 220 in step S420 is "abc123". The user can input "abc123" into the keyboard (local input device 230), so that the keyboard can send "abc123" (the second identification code) back to the remote server device 210 via the communication network 30.

[0043] In some embodiments, the local input device 230 may include a mouse. Assume that the first identification code displayed by the local computing device 220 in step S420 is the mouse button sequence "left button, left button, right button, right button, right button, left button". The user can click the mouse (local input device 230) buttons sequentially according to "left button, left button, right button, right button, right button, left button", so that the mouse can transmit the button sequence "left button, left button, right button, right button, right button, left button" (second identification code) back to the remote server device 210 via the communication network 30.

[0044] The remote server device 210 can determine whether a local input device has returned a second identification code. If no local input device returns a second identification code during the pairing period, or if any local input device returns a second identification code that does not match the first identification code during the pairing period (the determination result of step S430 is "No"), then the remote server device 210 can proceed to step S460 after the pairing period ends. The pairing period can be set according to the actual design. For example, the pairing period can be 1 minute or other time lengths. In step S460, the remote server device 210 can provide a notification message (indicating "pairing timeout") to the local computing device 220.

[0045] If any local input device (e.g., local input device 230) returns a second identification code during the pairing process (the result of step S430 is "yes"), the remote server device 210 can proceed to step S440. During pairing, the remote server device 210 can check (compare) the second identification code returned by the local input device 230 with the first identification code provided by the remote server device 210 to the local computing device 220 (step S440) to determine whether to pair the local input device 230 with the local computing device 220 (step S450). For example, if the second identification code returned by the local input device 230 is different from the first identification code (the result of step S440 is "mismatch"), the remote server device 210 can return to step S430. When the second identification code returned by the local input device 230 is the same as the first identification code (the judgment result of step S440 is "matched"), the remote server device 210 can pair the local input device 230 with the local computing device 220 (step S450). After pairing is completed, the application system 200 can run. Figure 3 The operation method is shown.

[0046] If no local input device is successfully paired with local computing device 220 during the pairing period, remote server device 210 may provide a notification message (indicating "pairing timed out") to local computing device 220 via communication network 30 (second connection) after the pairing period ends. The end time of the pairing period can be determined according to the actual design. For example, in some embodiments, the length of the pairing period may be 60 seconds or other lengths.

[0047] In some application scenarios, application system 200 may have multiple local computing devices, and users can dynamically switch between these local computing devices during operation. For example, Figure 5 This is a block diagram of an application system 500 according to another embodiment of the present invention. Figure 5In the illustrated embodiment, the application system 500 includes a remote server device 210, a local computing device 220, a local input device 230, and a local computing device 240. Figure 5 The remote server device 210, local computing device 220, and local input device 230 shown can be referenced. Figures 2 to 4 The relevant explanations are omitted here. During operation, the user can dynamically switch between local computing devices 220 and 240.

[0048] Figure 6 This is a flowchart illustrating a switching method for multiple local computing devices 220 and 240 according to an embodiment of the present invention. Please refer to... Figure 5 and Figure 6 The local input device 230 can establish a first connection with the remote server device 210 through the communication network 30, the local computing device 220 (first local computing device) can establish a second connection with the remote server device 210 through the communication network 30, and the local computing device 240 (second local computing device) can establish a third connection with the remote server device 210 through the communication network 30 (step S610). Figure 5 The remote server device 210, local computing device 220, and local input device 230 shown can operate. Figure 4 The pairing method shown enables the local computing device 220 and the local input device 230 to be paired together for operation. Figure 3 The operation method is shown.

[0049] During operation, when a user wants to switch to the local computing device 240, the user can trigger the local computing device 240 (the second local computing device) to send a pairing request to the remote server device 210 (step S620). When the local computing device 240 sends the pairing request, the pairing period begins. Based on the pairing request from the local computing device 240, the remote server device 210 can provide a first identification code to the local computing device 240 via the communication network 30 (the third connection) during the pairing period (step S630). Therefore, the local computing device 240 can display the first identification code provided by the remote server device 210 in step S630.

[0050] During pairing, based on the first identification code provided by the remote server device 210 and the user's operation, the local input device 230 can send the second identification code back to the remote server device 210 via the communication network 30 (first connection) (step S640). For example, suppose the first identification code displayed by the local computing device 240 in step S630 is "xyz789". The user can input "xyz789" into the keyboard (local input device 230), so that the keyboard can send "xyz789" (the second identification code) back to the remote server device 210 via the communication network 30.

[0051] The remote server device 210 can determine whether a local input device has returned a second identification code. If no local input device returns a second identification code during the pairing period, or if any local input device returns a second identification code that does not match the first identification code during the pairing period (the determination result of step S640 is "No"), then the remote server device 210 can proceed to step S680 after the pairing period ends. The pairing period can be set according to the actual design. For example, the pairing period can be 1 minute or other time lengths. In step S680, the remote server device 210 can provide a notification message (indicating "pairing timeout") to the local computing device 220.

[0052] If any local input device (e.g., local input device 230) returns a second identification code during the pairing process (the result of step S640 is "yes"), the remote server device 210 can proceed to step S650. During the pairing process, the remote server device 210 can check (compare) the second identification code returned by the local input device 230 with the first identification code provided by the remote server device 210 to the local computing device 240 (second local computing device) (step S650) to determine whether to cancel the pairing relationship between the local input device 230 and the local computing device 220 (first local computing device) (first pairing) (step S660), and whether to establish a new pairing relationship between the local input device 230 and the local computing device 240 (second local computing device) (second pairing) (step S670).

[0053] For example, when the second identification code returned by the local input device 230 is different from the first identification code displayed by the local computing device 240 (the judgment result of step S650 is "disagreement"), the remote server device 210 can return to step S640. When the second identification code returned by the local input device 230 is the same as the first identification code displayed by the local computing device 240 (the judgment result of step S650 is "match"), the remote server device 210 can proceed to step S660.

[0054] In step S660, the remote servo device 210 can cancel the original pairing relationship (first pairing) between the local input device 230 and the local computing device 220 (first local computing device), and then the remote servo device 210 can proceed to step S670. In step S670, the remote servo device 210 can establish a new pairing relationship (second pairing) between the local input device 230 and the local computing device 240 (second local computing device). After the first pairing is canceled and the second pairing is established, the remote servo device 210 can retransmit the image frame corresponding to the input data of the local input device 230 from the local computing device 220 to the local computing device 240. That is, after completing... Figure 6 After the re-pairing method shown, Figure 5 The remote servo device 210, local input device 230, and local computing device 240 shown can operate. Figure 3 The operating method is shown.

[0055] Figure 7 This is described according to an embodiment of the present invention. Figure 2 The circuit block diagram of the local computing device 220 and the local input device 230 is shown. Figure 7 The remote server device 210, local computing device 220, and local input device 230 shown can be referenced. Figures 2 to 6 Related explanations.

[0056] exist Figure 7 In the illustrated embodiment, the local computing device 220 includes a communication network interface circuit 221 and a display module 222, while the local input device 230 includes an input interface circuit 231 and a communication network interface circuit 232. In some embodiments, the local input device 230 may include a keyboard, and the input interface circuit 231 may include a key array and related driving (scanning) circuitry. In other embodiments, the local input device 230 may include a mouse, and the input interface circuit 231 may include a positioning module and buttons.

[0057] Please refer to Figure 3 and Figure 7 In step S310, the communication network interface circuit 232 of the local input device 230 establishes a first connection with the remote server device 210 through the communication network 30, and the communication network interface circuit 221 of the local computing device 220 (first local computing device) establishes a second connection with the remote server device 210 through the communication network 30. Based on user operation, the input interface circuit 231 of the local input device 230 can generate input information (to control the application services provided by the remote server device 210) in step S320. The communication network interface circuit 232 is coupled to the input interface circuit 231 to receive the input information. In step S320, the communication network interface circuit 232 of the local input device 230 can transmit the input data corresponding to the input information to the remote server device 210 through the communication network 30. According to actual design, in some embodiments, the communication network interface circuit 232 can encrypt the input information to generate the input data (ciphertext). In other embodiments, the communication network interface circuit 232 may use the input information as input data (plaintext) without encryption.

[0058] According to design requirements, in some embodiments, the communication network interface circuit 232 of the local input device 230 can transmit the input information (as input data) provided by the input interface circuit 231 to the remote server device 210 in plaintext. In other embodiments, the communication network interface circuit 232 of the local input device 230 can convert the input information provided by the input interface circuit 231 into ciphertext (input data) and then transmit the ciphertext to the remote server device 210. That is, the communication network interface circuit 232 can perform an encryption algorithm on the input information provided by the input interface circuit 231 to generate input data for the remote server device 210. The encryption algorithm can be determined according to design requirements. For example, in some embodiments, the encryption algorithm may include RSA encryption algorithm, DES algorithm, 3DES algorithm, AES algorithm, or other encryption algorithms.

[0059] Based on the input data uploaded by the communication network interface circuit 232 of the local input device 230, the remote server device 210 can transmit the image frames of the application service to the communication network interface circuit 221 of the local computing device 220 via the communication network 30 (step S330). The display module 222 is coupled to the communication network interface circuit 221 to receive the image frames generated by the remote server device 210. Therefore, the display module 222 of the local computing device 220 can display the image frames provided by the remote server device 210 in step S330.

[0060] Figure 7The local computing device 220 and local input device 230 shown can also perform... Figure 4 The pairing method is shown below. Please refer to... Figure 4 and Figure 7 In step S410, the local computing device 220 (first local computing device) may issue a pairing request to the remote server device 210. The pairing period begins when the local computing device 220 issues the pairing request. Based on the pairing request from the local computing device 220, the remote server device 210 may provide a first identification code to the local computing device 220 via the communication network 30 (second connection) during the pairing period (step S420). Therefore, the display module 222 of the local computing device 220 may display the first identification code provided by the remote server device 210 in step S420.

[0061] During pairing, based on user operation, the input interface circuit 231 of the local input device 230 can send the second identification code back to the remote server device 210 via the communication network interface circuit 232 and the communication network 30 (first connection) (step S430). During pairing, the remote server device 210 can check (compare) the second identification code sent back by the local input device 230 with the first identification code displayed by the local computing device 220 (step S440) to decide whether to pair the local input device 230 with the local computing device 220 (step S450) or return to step S430. If no local input device sends back the second identification code during the pairing period, or if the second identification code sent back by any local input device during the pairing period does not match the first identification code, the remote server device 210 can enter step S460 after the pairing period ends and provide a notification message (indicating "pairing timed out") to the local computing device 220.

[0062] Figure 8 This is described according to another embodiment of the present invention. Figure 2 The circuit block diagram of the local computing device 220 and the local input device 230 is shown. Figure 8 The remote server device 210, local computing device 220, and local input device 230 shown can be referenced. Figures 2 to 7 The relevant explanations. In Figure 8 In the illustrated embodiment, the application system further includes a local input device 250. Depending on the actual design, the local input device 230 may be a keyboard or other input device, while the local input device 250 may be a mouse or other input device.

[0063] Local input device 250 and local input device 230 can establish a connection. For example, local input device 250 can connect to local input device 230 via a universal serial bus (USB) interface, a Bluetooth interface, or other interfaces. This embodiment does not limit the connection (pairing) method between local input devices 230 and 250. According to actual design, in some embodiments, local input devices 230 and 250 are already paired devices at the time of product shipment. When pairing (establishing a connection), only the Personal Identification Number (PIN code) or Universally Unique Identifier (UUID) of local input device 230 is needed to pair with local input device 250 for successful pairing.

[0064] In other embodiments, local input device 230 and / or local input device 250 have switches (or buttons) that can switch between a general input mode and a wired mode. When the switch (or button) is triggered, local input device 230 can pair (establish a connection) with local input device 250.

[0065] Local input device 250 can generate second input information (used to control application services provided by remote server device 210). After local input device 230 and local input device 250 are successfully paired, local input device 250 can transmit the second input information to communication network interface circuit 232 through the connection between local input devices 230 and 250. Communication network interface circuit 232 can transmit the second input data corresponding to the second input information of local input device 250 to remote server device 210 through communication network 30.

[0066] The implementation of the local input device 250 should not be limited to Figure 8 The illustrated embodiment. For example, in other embodiments, the local input device 250 also has a communication network interface circuitry that enables it to establish a connection with the remote server device 210 via the communication network 30. In this implementation, it is not necessary to establish a USB, Bluetooth, or other connection between the local input devices 230 and 250. In such an embodiment, the local input devices 250 and 230 can enable ad-hoc networking, so the local input device 230 can transmit the Service Configuration ID (SSID) and password of the local wireless network to the local input device 250, allowing the local input device 250 to directly connect to the communication network 30.

[0067] Depending on the design requirements, the above-mentioned communication network interface circuits 221 and / or 232 can be implemented in the form of hardware, firmware, software, or a combination of the above three.

[0068] In hardware terms, the aforementioned communication network interface circuits 221 and / or 232 can be implemented as logic circuits on an integrated circuit. The functions of the aforementioned communication network interface circuits 221 and / or 232 can be implemented as hardware using hardware description languages ​​(such as Verilog HDL or VHDL) or other suitable programming languages. For example, the functions of the aforementioned communication network interface circuits 221 and / or 232 can be implemented as various logic blocks, modules, and circuits in one or more controllers, microcontrollers, microprocessors, application-specific integrated circuits (ASICs), digital signal processors (DSPs), field-programmable gate arrays (FPGAs), and / or other processing units.

[0069] In software and / or firmware form, the functions of the aforementioned communication network interface circuits 221 and / or 232 can be implemented as programming codes. For example, the communication network interface circuits 221 and / or 232 can be implemented using general programming languages ​​(such as C, C++, or Assembly language) or other suitable programming languages. The programming code can be recorded / stored in non-transitory computer-readable medium. In some embodiments, the non-transitory computer-readable medium includes, for example, read-only memory (ROM), tape, disk, card, semiconductor memory, programmable logic circuits, and / or storage devices. The storage device includes a hard disk drive (HDD), a solid-state drive (SSD), or other storage devices. A computer, central processing unit (CPU), controller, microcontroller, or microprocessor can read and execute the programming code from the non-transitory computer-readable medium to implement the related functions of the communication network interface circuits 221 and / or 232. Furthermore, the programming code can also be provided to the computer (or CPU) via any transmission medium (communication network or broadcast waves, etc.). The communication network is, for example, the Internet, a wired communication network, a wireless communication network, or other communication media.

[0070] In summary, the input devices described in the above embodiments (e.g., local input device 230) can establish a connection with the remote server device 210 via the communication network 30, without needing to establish a connection with the local computing device. In some embodiments, the local input device 230 can be at least one of a keyboard and a mouse. Input data from the local input device 230 is not transmitted to the local computing device 220 to increase security. Furthermore, since the input data from the local input device 230 does not need to be forwarded from the local computing device to the remote server device 210 (the local input device 230 directly provides the input data to the remote server device 210), the transmission speed of input data can be further improved, and the transmission time can be reduced. In addition, since the local input device 230 can establish a connection with the remote server device 210 via the communication network 30, the user does not need to plug the local input device 230 into the local computing device 220, thereby improving convenience.

[0071] Although the present invention has been disclosed above with reference to embodiments, it is not intended to limit the present invention. Any person skilled in the art can make some modifications and refinements without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the appended claims.

Claims

1. An application system characterized by comprising: The application system comprises: a remote server device for providing an application service; a first local input device comprising an input interface circuit and a first communication network interface circuit, wherein the first communication network interface circuit establishes a first connection with the remote server device through a communication network, the input interface circuit is used to generate first input information for controlling the application service, the first communication network interface circuit is coupled to the input interface circuit to receive the first input information, and the first communication network interface circuit transmits first input data corresponding to the first input information to the remote server device through the communication network; and a first local computing device comprising a display module and a second communication network interface circuit, wherein the second communication network interface circuit establishes a second connection with the remote server device through the communication network, the remote server device transmits image frames of the application service to the second communication network interface circuit through the communication network based on the first input data, the display module is coupled to the second communication network interface circuit to receive the image frames, and the display module displays the image frames; wherein, during pairing, the display module of the first local computing device displays a first identification code provided by the remote server device through the second connection; based on user operation, the input interface circuit of the first local input device transmits a second identification code back to the remote server device through the first connection with the first communication network interface circuit; and the remote server device checks the second identification code and the first identification code to determine whether to pair the first local input device with the first local computing device.

2. The application system of claim 1, wherein, The first communication network interface circuit of the first local input device performs encryption algorithm on the first input information to generate the first input data.

3. The application system of claim 1, wherein, Further comprising: a second local input device, wherein the second local input device establishes a connection with the first local input device, the second local input device is used to generate second input information for controlling the application service, the second local input device transmits the second input information to the first communication network interface circuit through the connection, and the first communication network interface circuit transmits second input data corresponding to the second input information to the remote server device through the communication network.

4. The application system of claim 1, wherein, When the second identification code is the same as the first identification code, the remote server device pairs the first local input device with the first local computing device.

5. The application system of claim 1, wherein, When no local input device is paired with the first local computing device during the pairing, the remote server device provides a notification message to the first local computing device through the second connection after the pairing period ends.

6. The application system of claim 1, wherein, When the first local computing device sends a pairing request to the remote server device, the pairing period starts, and the remote server device provides the first identification code to the first local computing device based on the pairing request.

7. The application system of claim 1, wherein, Further comprising: a second local computing device configured to establish a third connection with the remote server device through the communication network, wherein, when the second local computing device sends a pairing request to the remote server device, a pairing period is started; during the pairing period, the second local computing device displays a first identification code provided by the remote server device through the third connection; during the pairing period, based on user operation, the input interface circuit of the first local input device transmits a second identification code back to the remote server device through the first communication network interface circuit and the first connection; and during the pairing period, the remote server device checks the second identification code and the first identification code to determine whether to cancel the first pairing between the first local input device and the first local computing device and to determine whether to establish a second pairing between the first local input device and the second local computing device.

8. The application system of claim 7, wherein, When the second identification code is the same as the first identification code, the remote server device cancels the first pairing and establishes the second pairing.

9. The application system of claim 7, wherein, After the first pairing is canceled and the second pairing is established, the remote server device transmits the image frame corresponding to the first input data of the first local input device from the first local computing device to the second local computing device.

10. The application system of claim 1, wherein, The first local computing device provides network connection information corresponding to the second connection to the first local input device, and the first local input device establishes the first connection with the remote server device through the communication network according to the network connection information.

11. An operation method of an application system, characterized by, The operation method comprises: establishing, by a first communication network interface circuit of a first local input device of an application system, a first connection with a remote server device of the application system through a communication network; generating, by an input interface circuit of the first local input device, first input information to control an application service of the remote server device; transmitting, by the first communication network interface circuit, first input data corresponding to the first input information to the remote server device through the communication network; establishing, by a second communication network interface circuit of a first local computing device of the application system, a second connection with the remote server device through the communication network; transmitting, by the remote server device, an image frame of the application service to the second communication network interface circuit through the communication network based on the first input data; and displaying, by a display module of the first local computing device, the image frame; wherein, during a pairing period, displaying, by the display module of the first local computing device, a first identification code provided by the remote server device through the second connection; wherein, during the pairing period, based on user operation, transmitting, by the input interface circuit of the first local input device, a second identification code back to the remote server device through the first communication network interface circuit and the first connection; and wherein, during the pairing period, the second identification code is checked by the remote server to determine whether to pair the first local input device with the first local computing device.

12. The operating method of claim 11, wherein, Further comprising: performing an encryption algorithm on the first input information by the first communication network interface circuit of the first local input device to generate the first input data.

13. The operating method of claim 11, wherein, Further comprising: establishing a connection by a second local input device of the application system with the first local input device; generating second input information by the second local input device to control the application service; transmitting the second input information by the second local input device to the first communication network interface circuit through the connection; and transmitting second input data corresponding to the second input information by the first communication network interface circuit to the remote server through the communication network.

14. The operating method of claim 11, wherein, Further comprising: when the second identification code is identical to the first identification code, pairing the first local input device with the first local computing device by the remote server.

15. The operating method of claim 11, wherein, Further comprising: when no local input device is paired with the first local computing device during the pairing period, providing a notification message to the first local computing device by the remote server through the second connection after the pairing period ends.

16. The operating method of claim 11, wherein, Further comprising: the pairing period starts when the first local computing device sends a pairing request to the remote server, and the first identification code is provided by the remote server to the first local computing device based on the pairing request.

17. The operating method of claim 11, wherein, Further comprising: establishing a third connection by a second local computing device of the application system with the remote server through the communication network; the pairing period starts when the second local computing device sends a pairing request to the remote server; during the pairing period, displaying the first identification code provided by the remote server through the third connection by the second local computing device; during the pairing period, based on user operation, returning a second identification code by the input interface circuit of the first local input device through the first communication network interface circuit and the first connection to the remote server; and during the pairing period, checking the second identification code and the first identification code by the remote server to determine whether to cancel the first pairing between the first local input device and the first local computing device and to determine whether to establish a second pairing between the first local input device and the second local computing device.

18. The operating method of claim 17, wherein, Further comprising: when the second identification code is identical to the first identification code, canceling the first pairing and establishing the second pairing by the remote server.

19. The operating method of claim 17, wherein, Further comprising: After the first pairing is cancelled and the second pairing is established, the first input data corresponding to the first input information of the first local input device is transmitted from the first local computing device to the second local computing device by the remote server.

20. The operating method of claim 11, wherein, Further comprising: providing, by the first local computing device, network connection information corresponding to the second connection to the first local input device; and establishing, by the first local input device, the first connection with the remote server through the communication network according to the network connection information. The input device comprises:

21. An input device, comprising: an input interface circuit for generating first input information to control an application service provided by a remote server; and a first communication network interface circuit coupled to the input interface circuit for receiving the first input information, wherein the first communication network interface circuit establishes a first connection with the remote server through a communication network, and the first communication network interface circuit transmits first input data corresponding to the first input information to the remote server through the communication network, wherein the remote server establishes a second connection with a first local computing device through the communication network; wherein, during pairing, based on a first identification code provided by the remote server and user operation, the input interface circuit transmits a second identification code back to the remote server through the first communication network interface circuit and the first connection. The first communication network interface circuit performs an encryption algorithm on the first input information to generate the first input data.

22. The input device of claim 21, wherein, The input device comprises:

23. The input device of claim 21, wherein, a keyboard comprising the input interface circuit and the first communication network interface circuit; and a mouse, wherein the mouse establishes a connection with the keyboard, the mouse is used to generate second input information to control the application service, the mouse transmits the second input information to the first communication network interface circuit through the connection, and the first communication network interface circuit transmits second input data corresponding to the second input information to the remote server through the communication network. The network connection information corresponding to the second connection is received by the first local computing device, and the first communication network interface circuit establishes the first connection with the remote server through the communication network according to the network connection information.

24. The input device of claim 21, wherein, ​

Images