Computer input system and input method equipped with functionality for surgical participation
Patent Information
- Application Number
- DE102018129614
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2018-03-22
- Filing Date
- 2018-11-23
- Publication Date
- 2025-02-06
- Estimated Expiration
- 2038-11-23
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
The invention relates to an input system, in particular a computer input system and input method provided with functionality for operation participation.As technology advances, the functionality of computer input systems such as mice or keyboards is becoming more and more versatile. However, the diversity of functions necessarily leads to massive computation of the input system of a mouse or keyboard and therefore, for example, when the input system causes the functions related to image processing, data analysis and statistics, macro command control, voice recognition, data access, or human machine interaction, pictorial palusation of the connected electron device, or intermittent sound. The object of the invention is therefore to provide a computer input system having functionality for operation participation.U.S. Pat. No. 6,256,014 B1 discloses a computer input system provided with functionality for operation participation, which comprises: a first electron device, a second electron device, and a mouse, which can be connected to the first electron device or to the second electron device.Further computer input systems or computer input methods are known from US 2005 / 0 190 148 A1, DE 10 2015 106 814 A1 and US 2012 / 0 154 279 A1.To achieve the object, there is provided a computer input system having functionality for operation participation according to independent claim 1. The computer input system consists essentially of a first electron device, a second electron device and a mouse. The mouse can be connected either to the first electron device or to the second electron device. If the mouse is connected to the first electron device, the mouse implements a first operation associated with the first electron device. In implementing a second operation, the mouse forwards the second operation to the second electron device and then receives a result regarding the second electron device having fully implemented the second operation. Between the second operation and the first operation, the relevant functional operations are distinguished from each other.To achieve the object, there is also provided a computer input method having functionality for operation participation according to independent claim 6. The computer input method is for the computer input system provided with functionality for operation participation, wherein the computer input system comprises a mouse, a first electron device and a second electron device. This computer input method comprises the following steps: I. connecting the mouse to the first electron device; II. implementing a first operation associated with the first electron device by the mouse; III. forwarding the second operation to the second electron device; IV. receiving the results by the mouse with respect to the second electron device having fully implemented the second operation. Between the second operation and the first operation, the relevant functional operations are distinguished from each other.The dependent claims show further advantageous embodiments of the computer input system or the computer input method.Further objectives, advantages, features and possible applications of the present invention will become apparent from the following description of the exemplary embodiments with reference to the drawings. FIG. 1 is a block diagram of an embodiment of the computer input system provided with functionality for operating involvement according to the invention; FIG. 2 is a block diagram of another embodiment of the computer input system provided with functionality for operating involvement according to the invention; FIG. 3 is a block diagram of yet another embodiment of the computer input system provided with functionality for operating involvement according to the invention; FIG. 4 shows a diagram of an embodiment of the computer input method according to the invention with a functionality for operation participation.Referring now to FIG. 1, there is shown a block diagram of an embodiment of the computer input system of the present invention having functionality for operating involvement.The computer input system 100 shown consists essentially of a first electron device 110, a second electron device 120 and a mouse 130. The first electron device 110 has a processor 111 and a transceiver 113. The second electron device 120 likewise has a processor 121 and a transceiver 123. The mouse 130 includes a processor 131 and a transceiver 133. The first electron device 110 and the second electron device 120 may each be a laptop computer, tablet computer, desktop computer, or all-in-one computer.In the present embodiment, the mouse 130 may be connected to either the first electronic device 110 or the second electronic device 120, with the connections being wired or wireless. For example, the mouse 130 may be connected to the transceiver 113 of the first electronic device 110 via the transceiver 133 with cable or wirelessly. The mouse 130 may also be connected to the transceiver 123 of the second electronic device 120 via the transceiver 133 with cable or wirelessly. The transceiver 133 of the mouse 130 may be a cable-related transceiver or a wireless transceiver, wherein the transceiver is, for example, a Bluetooth communication module or a wireless RF communication module. If the mouse 130 is actively connected to the first electron device 110, the serial number of the mouse 130 and the serial number of the first electron device 110 form a first identification number set. If the mouse 130 is actively connected to the second electron device 120, the serial number of the mouse 130 and the serial number of the second electron device 120 form a second identification number set. The serial number may be a product code of a device or an identity code for identification. The first identification number set and the second identification number set are each different from each other as a single identification number set for other device to recognize the connection status between the mouse 130 and the electronic device.The operation to be performed by the mouse 130 may be engaged by a device other than the mouse 130. The mouse 130 may receive the execution results of the other devices involved in the operation. For example, the operation to be performed by the processor 131 of the mouse 130 may include a first operation and a second operation. The first operation may include, for example, a most original cursor recognition from the mouse 130 or a control function on the input interface from the mouse. Here, control function on the input interface of the mouse 130 may be, for example, manipulation of a mouse button or a mouse wheel. The second operation may be, for example, an additional mouse functional operation associated with, for example, image processing, data analysis and statistics, macro control, speech recognition, data access, or human-computer interaction. However, the embodiment of the present invention is not limited therein. In the present embodiment, between the second operation and the first operation, the relevant functional operations are distinguished from each other.If the mouse 130 is actively connected to the first electron device 110, the mouse 130 may implement a first operation associated with the first electron device 110, for example, move or click the cursor on the first electron device 110. If the mouse 130 implements the second operation simultaneously, many resources of software and hardware of the mouse 130 or the first electron device 110 are used, so that the ease of the actual cursor movement or click is impaired. In an embodiment of the invention, the second operation is not implemented by the mouse 130 but is involved by the second electron device 120 or other device, where the mouse 130 drives the process for implementing the second operation and receives a result regarding that the second operation has been fully implemented. That is, sufficient ease of operation and convenience in implementing various functions by the mouse 130 is ensured by involvement of various devices in the operations.The processor 131 of the mouse 130 may calculate and arrange which operations are to be implemented by the mouse 130 itself and which operations are to be implemented by the processor 121 of the second electron device 120 or other electron device. For example, the mouse 130 may assign to its own processor 111 a first proportion of all operations to be implemented, and the processor 121 of the second electron device 120 the remaining second proportion. However, the embodiment of the present invention is not limited to the above-mentioned participation proportion. For example, the specification of the first proportion should not require any effect on the normal manipulation of the mouse 130. The first proportion can be understood as the first operation mentioned, which serves, for example, for controlling the cursor or for transferring data. However, the embodiment of the present invention is not limited therein. The second proportion may relate to said second operation, which is used for example for image processing, data analysis and statistics, macro-control, speech recognition, data access or human-computer interaction. However, the embodiment of the present invention is not limited therein.The mouse 130 may further be provided with one or more additional devices, such as internal memory, touch panel, voice input device, and image recognizer. The internal memory installed in the mouse 130 may store individually required data or commands, for example, a short-circuit or macro command related to the operation of the mouse 130 or to the implementation of an application program. With the touch panel installed in the mouse 130, handwriting input or touch input can be performed. The voice input device installed in the mouse 130 can be, for example, a microphone for voice input. The image detector installed in the mouse 130 serves to identify the images. However, the embodiment of the present invention is not limited to the above-mentioned additional devices of the mouse.In this way, the operations to be implemented by the mouse 130 of the present invention can be flexibly engaged by other electron devices to facilitate the own burden on the mouse.If the mouse 130 is actively connected to the first electron device 110 and performs input through the touch panel, the mouse 130 may recognize the input and forward it to the second electron device 120 for operation participation. The proxy application program pre-installed in the second electron device 120 may be actively connected to the mouse 130. After the mouse 130 outputs the operation related to the touch input, the touch inputs are identified from a hardware resource of the second electron device 120. The identification results are fed back to the mouse 130 to make the mouse 130 judge whether the first electron device 110 or the mouse 130 itself performs the touch input according to these results.If the mouse 130 is actively connected to the first electron device 110 and is executing input via the voice input device, the mouse 130 may recognize the input and forward it to the second electron device 120 for operation participation. The proxy application program pre-installed in the second electron device 120 may be actively connected to the mouse 130. After the mouse 130 outputs the operation regarding the voice input, the voice inputs are identified from a hardware resource of the second electronic device 120. The identification results are fed back to the mouse 130 so that the mouse 130 decides whether the first electron device 110 or the mouse 130 itself performs the voice input according to these results.If the mouse 130 is actively connected to the first electron device 110 and is executing input via the image recognizer, the mouse 130 may recognize the input and forward it to the second electron device 120 for operation participation. The proxy application program pre-installed in the second electron device 120 may be actively connected to the mouse 130. After the mouse 130 outputs the operation related to the image input, the image inputs are identified from a hardware resource of the second electron device 120. The identification results are fed back to the mouse 130 to make the mouse 130 judge whether the first electron device 110 or the mouse 130 itself performs the image input according to these results.The data transmission between the mouse 130 and the second electron device 120 is carried out wirelessly. The mouse 130 can wirelessly relay relevant data regarding the operation to be engaged to the second electron device 120 as well as receive the returned implementation results from the second electron device 120.If the mouse 130 is connected to the first electronic device 110 by cable, this connection is not affected by the mouse wirelessly transmitting the second operation to the second electronic device 120.If the mouse 130 is wirelessly connected to the first electron device 110 and transmits the second operation to the second electron device 120, the mouse 130 will temporarily interrupt the connection to the first electron device 110 and wirelessly connect to the second electron device 120. After the mouse 130 transmits the second operation to the second electron device 120 and then receives the returned implementation results from the second electron device 120, the mouse 130 may interrupt the wireless connection with the second electron device 120 and restore the wireless connection with the first electron device 110. In another embodiment, the mouse 130 interrupts the wireless link with the second electron device 120 and establishes the wireless link with the first electron device 110 again after the mouse 130 transmits the second operation to the second electron device 120. Thereafter, after a predetermined interval, the mouse 130 may interrupt the wireless connection with the first electron device 110, establish the wireless connection with the second electron device 120, and judge whether the second electron device 120 has fully implemented the second operation. If so, the mouse 130 immediately receives the implementation results. Otherwise, the mouse 130 will interrupt the wireless connection with the second electronic device 120 and restore the wireless connection with the first electronic device 110. These operations are repeated until the mouse 130 has finally received certain implementation results from the second electron device 120.Referring now to FIG. 2, there is shown a block diagram of another embodiment of the computer input system having functionality for operating involvement in accordance with the present invention. The displayed computer input system 200 is comprised of a first electron device 210, a second electron device 220, a mouse 230, and a cloud server 240. The first electronic device 210 includes a processor 111 and a wireless communication module 215. The second electronic device 120 includes a processor 121 and a wireless communication module 225. The mouse 130 includes a processor 131 and a wireless communication module 235. The basic mode of operation of the computer input system 200 is approximately the same as that of the computer input system 100. The differences will be explained below.The wireless communication modules 215, 225, 235 shown in FIG. 2 function like the receiver shown in FIG. 1. The wireless communication modules 215, 225, 235 appearing in the present embodiment may be, for example, WIFI communication modules or mobile communication modules that provide the WIFI communication functions with faster transmission speed and longer transmission distance. The cloud server 240 configured for a web environment may be linked to a first electron device 210 or a second electron device 220 to implement data processing such as cloud storage and cloud computing.If the mouse 130 transmits the second operation to the second electron device 220, the proxy application program pre-installed in the second electron device 220 may output this second operation to the cloud server 240 for the cloud server 240 to implement this second operation. As far as the cloud server 240 has implemented the second operation and sent back the implementation results to the second electron device 220, the second electron device 220 will receive these implementation results and then forward them to the mouse 230.While the second electron device 220 outputs the second operation to the cloud server 240, the identity information representing as a second identification number set in associating the mouse 230 with the second electron device 220 is also transmitted. The second identification number set includes the serial number of the mouse 230 and the serial number of the second electron device 210. Based on this second identification number set, the cloud server 240 notifies the second operation of the mouse 230 to be engaged. The second operation is output from the second electron device 220.In one embodiment, the second operation received from the cloud server 240 may be to provide a web storage location to the mouse 230 for accessing the data. For example, the shortcut or macro commands required to operate the mouse 230 may be stored in a storage space of the cloud server 240. In operation, if the mouse 230 is to use these shortcut or macro commands, the mouse 230 may issue the second operation to access the cloud server 240. Thereafter, the mouse 230 may incorporate relevant short or macro commands via the second electron device 220, with which the mouse 230 controls the late operation of the connected first electron device 210.Referring now to FIG. 3, there is shown a block diagram of still another embodiment of the computer input system having functionality for operating involvement in accordance with the present invention.The computer input system 300 includes a first electron device 310, a second electron device 320, a third electron device 330, a mouse 340, and a cloud server 350. The first electronic device 310 includes a processor 311, a transceiver 313, and a wireless communication module 315. The second electronic device 320 includes a processor 321, a transceiver 323, and a wireless communication module 325. The third electronic device 330 includes a processor 331, a transceiver 333, and a wireless communication module 335. The mouse 340 includes a processor 341, a transceiver 343, and a wireless communication module 345. The basic operation mode of the computer input system 300 is approximately the same as that of the computer input system 100 and the computer input system 200. The differences will be explained below.The operations to be implemented by the mouse 340 may be performed by a plurality of electron devices at a time or one at a time. In the present embodiment, there are three electron devices. However, the embodiment of the present invention is not limited therein. The transceiver 343 of the mouse 340 can be linked to the transceiver 313 of the first electron device 310, transceiver 323 of the second electron device 320 and transceiver 333 of the third electron device 330. The wireless communication module 345 of the mouse 340 may be associated with the wireless communication module 315 of the first electron device 310, wireless communication module 325 of the second electron device 320, wireless communication module 335 of the third electron device 330. The mouse 340 can be linked to the first electron device 310 via the transceiver 343 and to the second electron device 320 or the third electron device 330 via the wireless communication module 345. When the mouse 340 transfers the second operation to the second electron device 320 or the third electron device 330, the mouse 340 does not need to interrupt the association with the first electron device 310.The advantage of the present embodiment with a plurality of electron devices is that the second operations can be implemented in a participating manner by a plurality of electron devices if there is a possible multiplicity or diversity. For example, the mouse 340 may have the data evaluation implemented by the processor 321 of the second electron device 320, the image processing implemented by the processor 331 of the third electron device 330, the speech recognition implemented by the processor of a fourth electron device (not shown), the human-computer interaction implemented by the processor of a fifth electron device (not shown), and the data access implemented by the cloud server 350.Referring to Figures 1 and 4, Figure 4 is a diagram of one embodiment of the computer input method of the present invention having functionality for operating involvement. The computer input method is suitably intended for the computer input system according to the invention, wherein the computer input system is represented, for example, as a single or a combination of the above-mentioned embodiments. In the following, FIG. 4 will be explained with reference to the computer input system according to FIG. 1 as an example.The computer input method according to the invention is intended for the computer input system 100 provided with functionality for operation participation. In S 401, the mouse 130 is actively connected to the first electron device, so that input to the first electron device 110 may be performed via the mouse 130.In S 403, a first operation is implemented by the mouse 130. In this step, the mouse 130 implements a first operation associated with the first electron device 110, for example, input by means of the cursor on the first electron device 110 or clicking on the cursor. These operations are considered by the mouse 130 to directly implement the first operation of itself.In S 405, the mouse 130 outputs a second operation to the second electron device 120. In this step, the operation other than the above-mentioned first operation is regarded as the second operation. That is, the second operation is not implemented by the mouse 130 itself, but is implemented by the processor 121 of the second electron device 120 due to the assignment of the mouse 130.In S 407, the mouse 130 receives the implementation results from the second operation. In this step, as far as the second electron device 120 has performed the second operation and then sent a feedback to the mouse 130, the mouse 130 operates according to the feedback.As described above, the computer input system provided with operation participation functionality according to the present invention is constituted by a mouse, a first electron device and a second electron device. In order to lighten the processing load of the mouse in a plurality of the operations, the mouse may divide the operations into a first operation and a second operation, the first operation being implemented by the mouse itself, and the second operation being executed in a shared manner by a second electron device. The configuration according to the invention provides a possibility that the second operation actually to be carried out by the mouse is implemented in reverse by other electron devices or a cloud server. This effectively saves the operation of the mouse, accelerates the operation of the processor of the mouse, and at the same time ensures the ease of operation of the linked mouse with the first electron device.The invention is not limited in the exemplary embodiments, but rather is variable in many ways within the scope of the disclosure.List of reference characters100, 200, 300 The computer input system 110, 210, 310 first electron device 120, 220, 320 second electron device 330 third electron device 111, 121, 131, 311, 321, 331, 341 processor 113, 123, 133, 313, 323, 333, 343 transceiver 215, 225, 235, 315, 325, 335, 345 wireless communication module 130, 230, 340 mouse 240, 350 cloud server S 401 connecting the mouse to the first electron device S 403 implementing the first operation by the mouse S 405 outputting the second operation to the second electron device S 407 receiving the implementation results of the second operation
Claims
A computer input system provided with functionality for operation participation, comprising: a first electron device (110), a second electron device (120), and a mouse (130), which may be connected to the first electron device (110) or the second electron device (120), wherein a first operation or a second operation to be implemented by the mouse (130) is selectively divided from other devices different from the mouse (130) for implementation; if the mouse (130) is actively connected to the first electron device (110), is to implement the first operation connected to the first electron device (110) and at the same time implement the second operation, the mouse (130) will not implement the second operation and will output this second operation to the second electron device (120) and then receive a result with respect to the second electron device (120) having fully implemented the second operation, wherein the relevant functional operations are different from one another between the second operation and the first operation.The computer input system according to claim 1, characterized in that the mouse (130) wirelessly transmits the second operation to the second electronic device (120) if the mouse (130) is connected to the first electronic device (110) by cable.The computer input system according to claim 1 or 2, characterized in that the mouse (130) temporarily interrupts the connection to the first electron device (110) as far as the mouse (130) is wirelessly connected to the first electron device (110) and is to transmit the second operation to the second electron device (120), and connects wirelessly to the second electron device (120); after the mouse (130) transmits the second operation to the second electron device (120) and then receives the returned implementation results from the second electron device (120), the mouse (130) may interrupt the wireless connection to the second electron device (120) and restore the wireless connection to the first electron device (110).The computer input system according to any one of claims 1 to 3, characterized in that the mouse (130) temporarily interrupts the connection to the first electron device (110) as far as the mouse (130) is wirelessly connected to the first electron device (110) and is to transmit the second operation to the second electron device (120), and connects wirelessly to the second electron device (120); after the mouse (130) transmits the second operation to the second electron device (120), the mouse (130) will interrupt the wireless connection to the second electron device (120) and connects wirelessly to the first electron device (110); thereafter, after a predetermined interval, the mouse (130) may interrupt the wireless connection to the first electron device (110), establish the wireless connection to the second electron device (120), and judge whether the second electron device (120) has completely implemented the second operation; If yes, the mouse (130) receives the implementation results immediately.The computer input system according to any one of claims 1 to 4, characterized in that the second electron device (120) outputs the accepted second operation to a cloud server (240), so that the cloud server (240) implements this second operation and then sends an implementation result back to the second electron device (220).An operation-participating computer input method that determines the operation-participating computer input system (100), wherein the computer input system (100) is comprised of a mouse (130), a first electron device (110), and a second electron device (120), and the computer input method comprises the steps of: - connecting the mouse (130) to the first electron device (110), - implementing a first operation connected to the first electron device (110) by the mouse (130), - outputting the second operation by the mouse (130) to the second electron device (120), and - receiving the results by the mouse (130) with respect to the second electron device (120) fully implementing the second operation, the relevant functional operations are thereby differentiated from one another between the second operation and the first operation.The computer input method according to claim 6, characterized in that the mouse (130) wirelessly transmits the second operation to the second electronic device (120) if the mouse (130) is connected to the first electronic device (110) by cable.The computer input method according to claim 6 or 7, characterized in that the mouse (130) temporarily interrupts the connection to the first electron device (110) as far as the mouse (130) is wirelessly connected to the first electron device (110) and is to transmit the second operation to the second electron device (120), and connects wirelessly to the second electron device (120); after the mouse (130) transmits the second operation to the second electron device (120) and then receives the returned implementation results from the second electron device (120), the mouse (130) may interrupt the wireless connection to the second electron device (120) and restore the wireless connection to the first electron device (110).The computer input method according to any one of claims 6 to 8, characterized in that the mouse (130) temporarily interrupts the connection to the first electron device (110) as far as the mouse (130) is wirelessly connected to the first electron device (110) and is to transmit the second operation to the second electron device (120), and connects wirelessly to the second electron device (120); after the mouse (130) transmits the second operation to the second electron device (120), the mouse (130) will interrupt the wireless connection to the second electron device (120) and connects wirelessly to the first electron device (110); thereafter, after a predetermined interval, the mouse (130) may interrupt the wireless connection to the first electron device (110), establish the wireless connection to the second electron device (120), and judge whether the second electron device (120) has completely implemented the second operation; If yes, the mouse (130) receives the implementation results immediately.The computer input method according to any one of claims 6 to 9, characterized in that the second electron device (120) outputs the accepted second operation to a cloud server (240), so that the cloud server (240) implements this second operation and then sends an implementation result back to the second electron device (120).
Citation Information
Patent Citations
Data transmission based on identifying information from input devices
DE102015106814A1
Switching device and switching methods of the same
US20050190148A1
Wireless data transmitting system and method thereof
US20120154279A1
Mouse ranking system for multiple users
US6256014B1