A method and device for inputting text

Through the KVM device's one-way HDMI transmission and text recognition technology, the problem of sharing text content cannot be communicated between hosts, and efficient and accurate automatic text input is achieved, which improves work efficiency.

CN117215418BActive Publication Date: 2024-11-29GUANGDONG AVCIT TECH HLDG CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311320683.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-10-12
Publication Date
2024-11-29
Estimated Expiration
2043-10-12

AI Technical Summary

Technical Problem

In the prior art, communication between two hosts cannot be done, resulting in manual input via the keyboard when sharing text content between enterprises or departments, which is inefficient and error-prone.

Method used

Through the KVM device, the host's video stream is received using a one-way transmission HDMI line, the text on the display screen is recognized and converted into an external code or input code, the input position is determined on the display screen through the keyboard and mouse device, and the input command is generated. Implement automatic input of text to the target host.

Benefits of technology

It realizes efficiently transmitting the text content of one host to another host without allowing two hosts to communicate directly, avoiding inefficiency and errors in manual input and improving work efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117215418B_ABST
    Figure CN117215418B_ABST
Patent Text Reader

Abstract

The present invention mainly discloses a method for inputting text, which is applied to a KVM device. A screenshot of a designated area of ​​a display screen displaying a first video stream is taken by operating a keyboard and mouse device. An output unit recognizes the text in the screenshot and converts the text into an external code or an input code. When text recognition and input instructions are detected, the output unit sends the external code or the input code to a second input unit. The second input unit converts the external code or the input code into a keyboard and mouse signal and sends it to a second host via a first interface. The input instruction is generated when an input position is determined on a display screen displaying a second video stream by operating the keyboard and mouse device. The output unit sends the input instruction to the second input unit. The second input unit sends the input instruction to the second host via the first interface. The input instruction is used to instruct the second host to call the text corresponding to the external code or the input code to the designated position according to the keyboard and mouse signal. The first interface is a USB interface, a PS2 interface or a serial port.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of KVM technology, and in particular to a method and device for inputting text. Background Art

[0002] In some practical situations, two hosts cannot communicate with each other, for example, computers used by various enterprises or departments cannot communicate with each other. However, various enterprises or departments often need to share some text content of one host with the second host for input.

[0003] In the prior art, personnel often look at the text on the first host and manually input the text one by one using a keyboard connected to the second host, which is very time-consuming and inefficient, and it is often easy to make mistakes when manually inputting text. Summary of the invention

[0004] In order to solve at least one of the aforementioned technical problems, the present disclosure provides a method for inputting text in a first aspect, which is applied to a KVM device, comprising: the KVM device comprises: a first input unit, an output unit, and a second input unit, wherein the output unit is connected to a keyboard and mouse device and a display screen; the first input unit receives a first video stream of a first host through a unidirectional HDMI line, transmits the first video stream to the output unit, and displays it through the display screen; a designated area of ​​the display screen displaying the first video stream is screenshotted by operating the keyboard and mouse device, and the output unit recognizes the text in the screenshot and converts the text into an external code or an input code;

[0005] The second input unit receives the second video stream of the second host through a unidirectional HDMI cable, and then transmits the second video stream to the output unit and displays it through the display screen. When text recognition and input instructions are detected, the output unit sends the external code or input code to the second input unit, and the second input unit converts the external code or input code into a keyboard and mouse signal and sends it to the second host via the first interface. The input instruction is generated when the input position is determined on the display screen displaying the second video stream by operating the keyboard and mouse device; the output unit sends the input instruction to the second input unit, and the second input unit sends the input instruction to the second host through the first interface. The input instruction is used to instruct the second host to call the text corresponding to the external code or input code to the specified position according to the keyboard and mouse signal. The first interface is a USB interface, a PS2 interface, or a serial port.

[0006] Furthermore, when text recognition and input instructions are detected, it includes: when it is detected that text is selected from a display screen displaying a first video stream and dragged to an input position on a display screen displaying a second video stream, the mouse is released; or after it is detected that text is copied or selected from a display screen displaying a first video stream, the cursor moves from the display screen displaying the first video stream to the input position on the display screen displaying the second video stream to paste or fill in text.

[0007] Furthermore, the output unit includes a first output unit and a second output unit. The first output unit is connected to the keyboard and mouse device. The first output unit receives keyboard and mouse information from the keyboard and mouse device. The first output unit and the second output unit exchange the keyboard and mouse information through the exchange unit, and the keyboard and mouse information is passed between the first output unit and the second output unit.

[0008] Furthermore, the first output unit recognizes the text in the screenshot and converts the text into an external code or an input code. When text recognition and input instructions are detected, the first output unit sends the external code or input code to the second output unit, and the second output unit sends the external code or input code to the second input unit.

[0009] Furthermore, the display screen includes a first display screen and a second display screen, the first display screen is connected to the first output unit, the first display screen is used to display the first video stream, the second display screen is connected to the second output unit, the second display screen is used to display the second video stream, the keyboard and mouse cursors cross between the first display screen and the second display screen, and when the cursor is detected at the boundary of the first display screen, the first output unit sends the keyboard and mouse information to the second output unit or to the second input unit through the switching unit to control the second host.

[0010] Furthermore, the keyboard and mouse information generated when operating the keyboard and mouse connected to the second host to input text to the second host using the input code input method is the same as the keyboard and mouse signal converted by the second input unit from the external code or the input code.

[0011] Furthermore, the KVM device also includes a switching unit, which is connected between the first input unit and the output unit, and is also connected between the second input unit and the output unit.

[0012] In a second aspect, the present disclosure provides a device for inputting text, comprising:

[0013] The external code or input code obtaining unit is used for the first input unit to receive the first video stream of the first host through the unidirectional transmission HDMI line, and then transmit the first video stream to the output unit and display it through the display screen, and take a screenshot of the designated area of ​​the display screen displaying the first video stream by operating the keyboard and mouse device, and the output unit recognizes the text of the screenshot and converts the text into the external code or input code;

[0014] The position acquisition unit is used for the second input unit to receive the second video stream of the second host through the unidirectional transmission HDMI line, and then transmit the second video stream to the output unit and display it through the display screen. When a text recognition and input command are detected, the output unit sends the external code or input code to the second input unit, and the second input unit converts the external code or input code into a keyboard and mouse signal and sends it to the second host through the first interface; the input command is generated when the input position is determined on the display screen displaying the second video stream by operating the keyboard and mouse device;

[0015] The calling unit is used for the output unit to send the input instruction to the second input unit, and the second input unit sends the input instruction to the second host through the first interface. The input instruction is used to instruct the second host to call the text corresponding to the external code or input code to the specified position according to the keyboard and mouse signal. The first interface is a USB interface, a PS2 interface or a serial port.

[0016] The present disclosure proposes a device for inputting text in a third aspect, including a processing circuit for executing any of the methods described above.

[0017] In a fourth aspect, the present disclosure provides a device for inputting text, including a memory and a processor;

[0018] Memory, used to store computer programs.

[0019] Some technical effects of the present disclosure are as follows: the KVM device comprises: a first input unit, an output unit, and a second input unit, wherein the output unit is connected to a keyboard and mouse device and a display screen; the first input unit receives a first video stream of a first host through a unidirectional HDMI line, and then transmits the first video stream to the output unit and displays it through the display screen, a screenshot of a designated area of ​​the display screen displaying the first video stream is taken by operating the keyboard and mouse device, and the output unit recognizes text in the screenshot and converts the text into an external code or an input code;

[0020] The second input unit receives the second video stream of the second host through a unidirectional HDMI cable, and then transmits the second video stream to the output unit and displays it through the display screen. When text recognition and input instructions are detected, the output unit sends the external code or input code to the second input unit, and the second input unit converts the external code or input code into a keyboard and mouse signal and sends it to the second host through the first interface. The input instruction is generated when the input position is determined on the display screen displaying the second video stream by operating the keyboard and mouse device; the output unit sends the input instruction to the second input unit, and the second input unit sends the input instruction to the second host through the first interface. The input instruction is used to instruct the second host to call the text corresponding to the external code or input code to the specified position according to the keyboard and mouse signal. The first interface is a USB interface, a PS2 interface, or a serial port. The input instruction is generated when the input position is determined on the display screen displaying the second video stream by operating the keyboard and mouse device, and the output unit sends the input instruction to the second input unit, and the second input unit sends the input instruction to the second host through the first interface. The input instruction is used to instruct the second host to call the text corresponding to the external code or input code to the specified position according to the keyboard and mouse signal. The HDMI one-way transmission ensures that the first host and the second host do not communicate with each other. The second host and the second input unit are also connected by a USB interface, which ensures that the output unit can only transmit the keyboard and mouse signals to the second host through the second input unit, thereby controlling the second host. Further, the output unit can take a screenshot to identify the text, and the second input unit converts the area code or internal code into a keyboard and mouse signal and sends it to the second host, that is, the second input unit imitates the manual keyboard input method to type to the second host, so that the second host can call the text corresponding to the external code or input code, thereby realizing the transmission of the text of the first host to the second host, and at the same time ensuring that the first host and the second host are not connected to communicate. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] To better understand the technical solution of the present disclosure, you may refer to the following drawings for auxiliary explanation of the prior art or embodiments. These drawings will selectively display the products or methods involved in the prior art or some embodiments of the present disclosure. The basic information of these drawings is as follows:

[0022] Figure 1 is an exemplary device architecture diagram to which the first embodiment of the present application can be applied;

[0023] Figure 2 A flowchart of a method for inputting text in the present application;

[0024] Figure 3 is an exemplary device architecture diagram to which the second embodiment of the present application can be applied;

[0025] Figure 4This is a diagram of an exemplary device architecture to which the third embodiment of the present application can be applied. DETAILED DESCRIPTION

[0026] The technical means or technical effects involved in the present disclosure will be further described below. Obviously, the embodiments (or implementation methods) provided are only some of the implementation methods covered by the present disclosure, but not all of them. Based on the embodiments in the present disclosure and the explicit or implicit descriptions of the figures and texts, all other embodiments that can be obtained by those skilled in the art without making creative efforts will be within the scope of protection requested by the present disclosure.

[0027] like Figure 1 The application scenario of the present application is that the first host 1 is the first signal source. The second host 5 is the second signal source. The first host 1 and the second host 5 cannot communicate with each other. There is no direct or indirect connection or communication between the first host 1 and the second host 5, and they are not connected to each other. The purpose of the method of the embodiment of the present application is to ensure that the text of the first host is input into the second host under the premise that the first host and the second host are still not connected and communicated.

[0028] like Figure 1 and Figure 2 The method of the first embodiment provided in the present application is to connect a peripheral KVM device between a first host and a second host. The KVM device includes: a first input unit 2, an output unit, a second input unit 6, a switching unit 4, a keyboard and mouse device, and a display screen. In this embodiment, the output unit includes a first output unit 3 and a second output unit 7, and the display screen includes a first display screen and a second display screen. The first output unit is connected to the first display screen, and the second output unit is connected to the second display screen. The keyboard and mouse device is connected to the first output unit.

[0029] The display screen includes a first display screen and a second display screen. The first display screen is connected to a first output unit, and the first display screen is used to display a first video stream. The second display screen is connected to a second output unit, and the second display screen is used to display a second video stream. A keyboard and mouse device is connected to the first output unit, and the first output unit receives keyboard and mouse information of the keyboard and mouse device. The first output unit and the second output unit exchange keyboard and mouse information through a switching unit, and the keyboard and mouse information spans between the first output unit and the second output unit. Thus, the cursor of the keyboard and mouse spans between the first display screen and the second display screen. When the cursor is detected at the boundary of the first display screen, the first output unit sends the keyboard and mouse information to the second output unit or to the second input unit through the switching unit to control the second host. The second input unit sends the received keyboard and mouse information to the second host through the first interface, and the keyboard and mouse information is used to control the second host. The second host implements its own text pasting and moves the cursor on the display screen of the second host according to the received keyboard and mouse information.

[0030] The KVM device also includes a switching unit, such as Figure 1 The switching unit is connected between the first output unit and the second output unit, so that the first output unit can send the keyboard and mouse information to the second output unit through the switching unit. The switching unit is also connected between the first input unit and the output unit, and the switching unit is also connected between the second input unit and the output unit. In this embodiment, the switching unit is also connected between the first input unit and the first output unit, and the switching unit is also connected between the second input unit and the second output unit. The information is exchanged and transmitted through the switching unit.

[0031] HDMI cable is the abbreviation of high-definition multimedia interface cable, which can transmit uncompressed high-definition video and multi-channel audio data with high quality, and the maximum data transmission speed is 5Gbps. At the same time, there is no need to perform digital / analog or analog / digital conversion before signal transmission, which can ensure the highest quality audio and video signal transmission. The HDMI cable provided in the embodiment of the present invention is directional and unidirectional. The plug shell at one end of the HDMI cable is marked with a signal source end, and the plug shell at the other end is marked with a display end. The first input unit is provided with a power interface, an HDMI-in interface, an HDMI-out interface, and a LAN interface. The second input unit is provided with a power interface, an HDMI-in interface, an HDMI-out interface, a LAN interface, and a USB interface. The HDMI-in interface of the first input unit is plugged into the display end of the HDMI cable, and the signal source end of the HDMI cable is plugged into the HDMI interface of the first host, and the first host sends the first video stream to the first input unit unidirectionally. The HDMI cable cannot be connected in reverse, otherwise the video cannot be transmitted. The first host is the signal source. There is no other connection between the first input unit and the first host except the HDMI cable connection. The first host transmits the video stream to the first input unit via the HDMI cable in accordance with the HDMI transmission UDP protocol. That is, only the first host can output the first video stream, and the first input unit can receive the first video stream. However, the first host cannot transmit word files or folders and other types that require TCP protocol transmission to the first input unit, nor can the first input unit send the first video stream to the first host. The first output unit is provided with a power interface, an HDMI-out interface, a LAN interface, and a USB interface. The USB interface of the first output unit is connected to a mouse and keyboard device, and the HDMI-out interface of the first output unit is connected to an HDMI display, and the display screen of the HDMI display displays the image of the first video stream. A LAN interface of the first output unit is connected to the LAN interface of the first input unit. Another LAN interface of the first output unit is connected to a switch. The switch is also connected to the LAN interface of the second output unit.

[0032] The HDMI interface of the second input unit is also connected to the HDMI interface of the second host through an HDMI cable, and the second host sends the second video stream to the second input unit unidirectionally. The second host and the second input unit also transmit keyboard and mouse signals or keyboard and mouse information through the first interface, complying with the HID transmission protocol. In this way, it can be ensured that the second host can only send the second video stream to the second input unit unidirectionally through the HDMI cable. The first interface is a USB interface, and the first interface between the second host and the second input unit can also be replaced by a PS2 interface or a serial port. The data transmission between the keyboard and mouse interface end of the second host and the USB interface of the second input unit complies with the HID protocol, that is, the keyboard and mouse interface end of the second host and the second input unit can only transmit keyboard and mouse signals bidirectionally, and cannot transmit any other information. When the second input unit is connected to the second host through a USB data cable, the second host will request various descriptors from the second input unit to identify what device the second input unit belongs to. The USB interface of the second input unit complies with the HID specification, so its descriptor will be identified as an HID category. The communication between the second input unit and the second host connected by the USB data cable is realized in the form of a report. HID is a human-machine interface device. HID devices can be mouse and keyboard devices. The exchanged data is stored in a structure called a report. The device's firmware must support the format of the HID report. The host transmits and receives report data through control and interrupt transmission. The format of the report is very flexible. Control transmission: Receive and respond to USB control and class data requests from the host; transmit data when the HID class driver polls. Receive data from the host Interrupt transmission: Receive asynchronous (unrequested) data from the device; transmit low-latency data to the device. This ensures that only keyboard and mouse signals or keyboard and mouse information can be transmitted between the second host and the second input unit through the USB interface or the first interface, and no other signals or data can be transmitted. The LAN interface of the second input unit is connected to the second output unit. The USB interface of the second input unit is connected to the USB interface of the second host for sending or receiving keyboard and mouse commands. The second input unit is connected to the second output unit through a network cable or a switch.

[0033] The first input unit and the second input unit both include an encoding unit, which encodes the received video; the first output unit and the second output unit both include a decoding unit, which decodes the received video.

[0034] The first host is connected to the first input unit via a unidirectional HDMI cable, where unidirectional transmission refers to the unidirectional transmission of the first video stream from the first host to the first input unit. The second input unit is connected to the second host via a unidirectional HDMI cable, where unidirectional transmission refers to the unidirectional transmission of the second video stream from the second host to the second input unit. The second host and the second input unit are also connected via a first interface. The first interface is a USB interface, a PS2 interface, or a serial port.

[0035] The solution of this embodiment of the present application is to connect the first host and the second host as follows Figure 1 In the KVM device, since the first host is connected to the first input unit only through a unidirectional HDMI cable, and the second host is also connected to the second input unit only through a unidirectional HDMI cable and the first interface, there is no other connection between the first host and the first input unit. There is also no other connection between the second host and the second input unit. As a result, the first host and the second host cannot communicate directly or indirectly through the KVM device. The first host cannot send a connection request to the second host, that is, the first host and the second host cannot connect and communicate. Since the first host and the second host cannot communicate with each other, the content of the first host cannot be transmitted to the second host by copying or the like. Even after the KVM device of an embodiment of the present application is externally connected between the first host and the second host, it can still be ensured that the content of the first host cannot be transmitted to the second host by copying or the like. That is, it can still be ensured that the first host and the second host do not communicate.

[0036] The first input unit is connected to the first output unit through a network cable, and a switching unit may be connected between the first input unit and the first output unit, or the first input unit and the first output unit are directly connected through a network cable. The second input unit and the second output unit are connected through a network cable or through a switching unit, and a switching unit may be connected between the second input unit and the second output unit, and the first output unit and the second output unit are connected through a network cable, and a switching unit may be connected between the first output unit and the second output unit. The switching unit may be a switch. The first output unit is connected to the second output unit and the switching unit through a network cable. The first output unit is connected to a first display screen, and the first display screen is used to display a first video stream sent by the first output unit to the first display screen. The second output unit is connected to a second display screen, and the second display screen is used to display a second video stream sent by the second output unit to the second display screen. The first output unit is connected to a keyboard and mouse device. When the first output unit detects that the keyboard and mouse cursor slides out of the first display screen, the first output unit forwards the keyboard and mouse information received from the keyboard and mouse to the second output unit. The first output unit and the second output unit exchange keyboard and mouse information through the switching unit, and the keyboard and mouse information spans between the first output unit and the second output unit. Thus, the cursor of the keyboard and mouse spans between the first display screen and the second display screen.

[0037] When the first host transmits a video stream to the first input unit via an HDMI cable, the first host does not need to initiate a connection request to the first input unit. Similarly, the second host does not need to initiate a connection request to the second input unit. And the first interface can only transmit keyboard and mouse commands, and cannot transmit other information. The first host transmits video unidirectionally to the first input unit, and the second host transmits video unidirectionally to the second input unit, which ensures that the KVM device of the embodiment of the present application does not connect the first host and the second host for communication. That is to say, it is ensured that the content of the first host cannot be sent to the second host through communication methods such as copying.

[0038] For example, you need to enter the names of some folders on the first host into a table on the second host. Since the first host and the second host do not communicate, it is impossible to copy the names of the folders on the first host and send them to the second host for the second host to paste on the second host. Figure 2 The present invention provides a method for inputting text provided by an embodiment of the present application, which is used to input the name of a folder of a first host, that is, text, into a second host. The method is applied to a KVM device. The KVM device provided by an embodiment of the present application is also unable to directly copy the name of a folder of the first host and send it to the second host. It is even more impossible to directly copy the folder of the first host and send it to the second host. The steps of inputting text to the second host provided by the method provided by an embodiment of the present application are as follows.

[0039] refer to Figure 2 An embodiment of the present application provides a method for inputting text, which is applied to the above-mentioned KVM device, including:

[0040] The KVM device includes: a first input unit, an output unit, and a second input unit, wherein the output unit is connected to a keyboard and mouse device and a display screen; S10, the first input unit receives a first video stream of a first host through a unidirectional transmission HDMI line, transmits the first video stream to the output unit and displays it through the display screen, and takes a screenshot of a designated area of ​​the display screen displaying the first video stream by operating the keyboard and mouse device, and the output unit recognizes text in the screenshot and converts the text into an external code or an input code;

[0041] S20, the second input unit receives the second video stream of the second host through the unidirectional transmission HDMI line, and then transmits the second video stream to the output unit and displays it through the display screen. When a text recognition and input command are detected, the output unit sends an external code or an input code to the second input unit, and the second input unit converts the external code or the input code into a keyboard and mouse signal and sends it to the second host through the first interface. The input command is generated when the input position is determined on the display screen displaying the second video stream by operating the keyboard and mouse device;

[0042] S30, the output unit sends the input instruction to the second input unit, and the second input unit sends the input instruction to the second host through the first interface. The input instruction is used to instruct the second host to call the external code or the text corresponding to the input code to the specified position according to the keyboard and mouse signal. The first interface is a USB interface, a PS2 interface, or a serial port.

[0043] The first input unit and the second input unit both include an encoding unit, which encodes the received video; the first output unit and the second output unit both include a decoding unit, which decodes the received video. The switching unit may be a switch, which is used to exchange and transmit the signal or data received from the first output unit to the second output unit. The first input unit and the first output unit may be directly connected, or data exchange may be performed between the first input unit and the first output unit through a switch.

[0044] S10, the first input unit receives a first video stream of the first host through a unidirectional HDMI cable, transmits the first video stream to the output unit and displays it through the display screen, takes a screenshot of a designated area of ​​the display screen displaying the first video stream by operating a keyboard and mouse device, and the output unit recognizes text in the screenshot and converts the text into an external code or an input code;

[0045] The first input unit receives the first video stream of the first host through the unidirectional transmission HDMI line. After receiving the first video stream, the first input unit encodes the video and sends it to the first output unit. After receiving the first video stream, the first output unit sends it to the first display screen, and displays the content of the first video stream through the first display screen. At this time, the content displayed on the first display screen is the same as the content displayed by the first host through the display device connected to the first host. The content of the first video stream of the first host is displayed on the first display screen.

[0046] At this time, the display screen displaying the first video stream is the first display screen. The designated area of ​​the first display screen is screenshotted by operating the keyboard and mouse device. The designated area can be a fixed area or an area demarcated on the first display screen in real time by operating the keyboard and mouse. The first output unit receives a screenshot recognition instruction from the keyboard and mouse device. The screenshot recognition instruction is used to instruct the first output unit to take a screenshot of the designated area of ​​the first display screen and identify the text content of the captured image. The first output unit also includes an OCR unit and a conversion unit. The OCR unit is used to recognize the text of the screenshot. The conversion unit is used to convert the recognized text content into an external code or input code corresponding to the text content. Each text has a unique corresponding external code or input code.

[0047] The external code or input code includes a location code and an internal code. Take the location code as an example. For example, a display screen of a display device displays multiple folders, and the names are landscape pictures, character pictures, and street view pictures. The screenshot recognition command is obtained by operating the mouse or keyboard of the first output unit. The screenshot recognition command is used to instruct the first output unit to take a screenshot of the selected screen range of the first display screen, that is, the specified area, and send the captured picture including the folder name to the OCR unit. The OCR unit performs text recognition on the screenshot image and extracts the text content, for example, the text content extracted is the three characters "scenery picture". Then, the text conversion unit converts the text content into a location code corresponding to the text one by one, where the location code can also be an internal code or other input code. For example, the location code corresponding to the word "wind" is "2371", the location code corresponding to the word "scene" is "3016", and the location code corresponding to the word "color" is "4111". Each word corresponds to a unique location code. The location code is a four-digit decimal number, and each national standard code or location code corresponds to a unique Chinese character or symbol. The first output unit sends the area code or the inner code to the second output unit. Specifically, the first output unit sends the inner code or the area code to the switch, and the switch sends the inner code or the area code to the second output unit. The first output unit can also directly send the inner code or the area code to the second output unit.

[0048] The display screen includes a first display screen and a second display screen, and the keyboard and mouse device is connected to the first output unit, and the first display screen is connected to the first output unit. The second display screen is connected to the second output unit. When it is detected that the cursor of the keyboard and mouse slides out of the first display screen, the first output unit sends the keyboard and mouse information received from the keyboard and mouse to the second output unit. At this time, the keyboard and mouse device is used to control the second output unit or control the second host through the second output unit. When the second host is controlled by the second output unit, a second control instruction is generated by operating the keyboard and mouse device, and the keyboard and mouse device forwards the second control instruction to the second output unit via the first output unit, and the second output unit sends the second control instruction to the second input unit. The second input unit sends the second control instruction to the second host through the first interface, and the second control instruction is used to control the second host. The first interface is a USB interface or a PS2 interface or a serial port. Thus, the second host is controlled or operated by operating the keyboard and mouse device. The keyboard and mouse device can also send the second control instruction to the second input unit through the first output unit, and the second input unit sends the second control instruction to the second host through the first interface to control the second host.

[0049] S20, the second input unit receives the second video stream of the second host through the unidirectional transmission HDMI cable, and then transmits the second video stream to the output unit and displays it through the display screen. When text recognition and input instructions are detected, the output unit sends the external code or input code to the second input unit, and the second input unit converts the external code or input code into a keyboard and mouse signal and sends it to the second host through the first interface. The input instruction is generated when the input position is determined on the display screen displaying the second video stream by operating the keyboard and mouse device; the second input unit receives the second video stream of the second host through the unidirectional transmission HDMI cable, the second input unit encodes the received second video stream and transmits it to the second output unit, the second output unit decodes the received second video stream and transmits it to the second display screen connected to the second output unit, and displays the second video stream through the second display screen.

[0050] The first display screen is a display screen displaying the first video stream, and the second display screen is a display screen displaying the second video stream. When a text recognition and input instruction is detected, the output unit sends an external code or an input code to the second input unit, and the second input unit converts the external code or the input code into a keyboard and mouse signal and sends it to the second host via the first interface. The input instruction is generated when the input position is determined by operating the keyboard and mouse device on the display screen displaying the second video stream;

[0051] When text recognition and input instructions are detected, it includes: when it is detected that text is selected from the display screen displaying the first video stream and dragged to the input position on the display screen displaying the second video stream, the mouse is released, or after it is detected that text is copied or selected from the display screen displaying the first video stream, the cursor moves from the display screen displaying the first video stream to the input position of the display screen displaying the second video stream to paste or fill in text. When text recognition is detected, it means that text in the screenshot is detected to be recognized. The first method is to operate the keyboard and mouse to take a screenshot and recognize the text content on the first display screen, and then display a recognized text area on the first display screen, and the text area contains recognized text content. Then operate the keyboard and mouse to select the text in the text area, and you can select all or part of the text area in the text area. When clicking the mouse on the recognized text area to select the text, continue to press the mouse without releasing it, and drag the selected text area. During the dragging process, the cursor changes from the original arrow shape to a balloon shape, indicating that the text content is successfully dragged. After the balloon-shaped cursor slides out of the boundary of the first display screen, the balloon-shaped cursor appears on the second display screen. Continue to press and hold the mouse to drag until the balloon-shaped cursor reaches the specified position of the second display screen, and then release the mouse. The text will appear in the specified position of the second display screen in turn. Since the second display screen and the second host display the same content, at this time, in fact, the same position of the second host also displays the same text content. Or the second method, after copying or selecting text from the first display screen, the cursor moves from the display screen displaying the first video stream to the input position of the display screen displaying the second video stream to paste or fill in the text.

[0052] The output unit includes a first output unit and a second output unit. The first output unit recognizes the text of the screenshot and converts the text into an external code or an input code. Text recognition means that the text of the screenshot is recognized, and input instructions means that input instructions are generated. The input instruction can be generated when the mouse is released at the input position on the second display screen. When text recognition and input instructions are detected, the first output unit sends the external code or input code to the second input unit via the second output unit, or the first output unit sends the external code or input code to the second input unit, and the second input unit converts the external code or input code into a keyboard and mouse signal and sends it to the second host via the first interface. The input instruction is generated when the input position is determined on the display screen displaying the second video stream by operating the keyboard and mouse device. Specifically, after taking a screenshot of the designated area of ​​the first display screen to identify the text, the identified text on the first display screen is selected by operating the keyboard and mouse device, for example, the identified text area on the first display screen is clicked with a mouse, that is, all or part of the identified text is selected, and the selected text area is dragged without releasing the mouse when clicking until the cursor slides out of the boundary of the first display screen. At this time, the cursor appears on the second display screen, and the mouse is kept unreleased and continued to be dragged until the cursor reaches the input position of the second display screen and then the mouse is released. At this time, the text content is sequentially displayed at the input position of the second display screen, and at the same time, the text content appears at the designated position of the display screen of the second host. Here, when the cursor reaches the input position of the second display screen, an input instruction is generated by releasing the mouse operation. The mouse is released only when the cursor reaches the input position on the second display screen. The action of clicking the mouse is to press the mouse, and releasing the mouse means to release the action of clicking the mouse, that is, to release the action of pressing the mouse, so that the mouse is not in a pressed state or a clicked state. The input position is the position where the user wants to display the text on the display screen displaying the second video stream. In this embodiment, the input position is the position where the user wants to display the text on the second display screen. This process generates an input instruction by releasing the mouse at the input position. In other implementations, when text recognition and input instructions are detected, it may also include: after detecting that text is copied or selected from a display screen displaying a first video stream, the cursor moves from the display screen displaying the first video stream to the input position of the display screen displaying the second video stream to paste or fill in the text. After the text is recognized, the selected recognized text is copied, and then the mouse cursor is moved to the display screen displaying the second video stream until the mouse cursor moves to the input position, and the text is pasted. Selecting text is selecting from the recognized text, and all or part of the recognized text can be selected.

[0053] When the first output unit sends the external code or input code or keyboard and mouse signal to the second output unit, the external code or input code or keyboard and mouse signal may also be sent through a switch connected between the first output unit and the second output unit.

[0054] When inputting text on the second host using an input code input method with a keyboard and mouse device connected to the second host, the keyboard and mouse information generated is the same as the keyboard and mouse signals converted by the second input unit from external codes or input codes. For example, when operating a keyboard connected to the second host and using the area code input method to input text on the second host, the keyboard and mouse information generated is the same as the keyboard and mouse signals generated by the second input unit according to the area code. Here, the area code input method can also be an input code input method such as a pinyin input method, as long as it is the same as the input method used by the second input unit to generate the keyboard and mouse signals corresponding to the text called by the second host using the keyboard and mouse signals converted from external codes or input codes. The keyboard and mouse signals generated by the second input unit according to external codes or input codes correspond to the external codes or input codes, that is, the external codes or input codes can be converted into keyboard and mouse signals, and the keyboard and mouse signals can also be converted back into the same external codes or input codes. For example, the area code corresponding to the character "景" is "3016". The second input unit generates a first keyboard and mouse signal according to the area code "3016", and the second input unit sends the first keyboard and mouse signal to the second host through the first interface. Then the second host can call the character "景" according to the received first keyboard and mouse signal. The second host sending the keyboard and mouse signal to the second host through the first interface is similar to the second input unit inputting text to the second host like simulating manual typing, rather than the second input unit directly sending the text content to the second host, ensuring security.

[0055] Only when the first interface also complies with the HID transmission protocol can the second host only receive the keyboard and mouse signals sent by the second input unit. The second host and the second input unit are connected by a one-way transmission HDMI cable, ensuring that the second transmission unit cannot send information to the second host through the HDMI interface. The second input unit sequentially generates the above-mentioned keyboard and mouse signals according to the received external code or input code. The second input unit only needs to send the above-mentioned keyboard and mouse signals to the second host through the USB interface of the HID protocol, without directly sending the text content to the second host, achieving the purpose that the first host and the second host do not communicate. After receiving the above-mentioned keyboard and mouse signals, the second host can, like imitating manual operation of the keyboard typing, call out the required text according to the above-mentioned keyboard and mouse signals. Specifically, the second host processes the received above-mentioned keyboard and mouse signals and converts them into internal machine codes. The internal machine codes are converted into Chinese character address codes through a corresponding relationship. At this time, the Chinese character library can be accessed through the address codes, and the glyph codes of Chinese characters can be extracted from the Chinese character library. Finally, the second host can display the corresponding text on the display device according to the glyph data.

[0056] S30, the output unit sends an input instruction to the second input unit. The second input unit sends the input instruction to the second host through the first interface. The input instruction is used to instruct the second host to call the text corresponding to the external code or input code to a specified position according to the keyboard and mouse signals. The first interface is a USB interface or a PS2 interface or a serial port.

[0057] The first output unit is connected to the keyboard and mouse device, and the first output unit and the second output unit exchange keyboard and mouse information through the exchange unit, and the keyboard and mouse information crosses between the first output unit and the second output unit. The first output unit sends the input instruction to the second output unit, and the second output unit sends the input instruction to the second input unit. The first output unit can also send the input instruction to the second input unit. The first output unit receives the input instruction of the keyboard and mouse device and forwards it to the second output unit. The second output unit sends the input instruction to the second input unit, and the second input unit sends the input instruction to the second host through the first interface. The input instruction is used to instruct the second host to call the text corresponding to the external code or input code to the specified position according to the keyboard and mouse signal. After the second host receives the input instruction, the second host calls the corresponding input method according to the keyboard and mouse signal, and displays the text corresponding to the external code or input code at the specified position of the display screen of the second host.

[0058] For example, paste the text into a specified list in the Excel sheet of the second host. Because the content displayed by the second host is the same as the content displayed on the second display screen of the second output unit, it can be seen that the text to be transmitted is displayed one by one in the display device of the second output unit. When the text is displayed, it can be seen that the text appears on the display screen in order, just like when typing manually.

[0059] like Figure 3 In the second embodiment provided by the present application, the difference from the first embodiment is that only one output unit is provided, that is, the second output unit in the first embodiment is cancelled. The first output unit takes a screenshot of the designated area of ​​the first display screen and directly sends the screenshot to the second input unit after identifying the text content of the screenshot. When text recognition and input instructions are detected, the first output unit directly sends the external code or input code to the second input unit. The first output unit also directly sends the input instruction to the second input unit. The first output unit is connected to both the first display screen and the second display screen. When the mouse cursor is on the first display screen, the first output unit is used to receive the first video stream sent by the first input unit and send it to the first display screen, and the first display screen displays the first video stream. When the mouse cursor slides out of the boundary of the first display screen, the mouse cursor slides to the second display screen. At this time, the first output unit receives the second video stream sent by the second input unit and sends it to the second display screen, and the second display screen displays the second video stream.

[0060] After receiving the second video stream sent by the second host, the second input unit encodes the second video stream and sends it to the first output unit. The first output unit decodes the second video stream and sends it to the second display screen for display. The second display screen is connected to the first output unit. The encoding and decoding process may also be omitted, which is not limited here.

[0061] After receiving the first video stream, the first output unit sends it to the first display screen for display.

[0062] like Figure 4 In the third embodiment provided by the present application, in the first embodiment and the second embodiment, the first display screen and the second display screen are two separate display devices connected to the output unit. In the third embodiment, what is different from the first embodiment is that the first display screen and the second display screen are the same display device. The display device can be divided into left and right, with the first display screen on the left and the second display screen on the right. The display device can also be divided into two virtual display screens. That is, the entire display device can be used as the first display screen, and can also be used as the second display screen after switching.

[0063] The same display device display screen includes a first display screen and a second display screen, the first display screen is used to display a first video stream, and the second display screen is used to display a second video stream; when it is detected that the cursor slides out of the boundary of the first display screen, the first output unit sends the keyboard and mouse information to the second output unit or to the second input unit through the switching unit to control the second host.

[0064] The embodiment of the present application provides a device for inputting text, including: an external code or input code obtaining unit, which is used for a first input unit to receive a first video stream of a first host through a unidirectional transmission HDMI line, and then transmit the first video stream to an output unit and display it through a display screen, and take a screenshot of a designated area of ​​the display screen displaying the first video stream by operating a keyboard and mouse device, and the output unit recognizes the text of the screenshot and converts the text into an external code or input code; a position obtaining unit, which is used for a second input unit to receive a second video stream of a second host through a unidirectional transmission HDMI line, and then transmit the second video stream to the output unit and display it through the display screen, when a text recognition and input instruction is detected, the output unit sends the external code or input code to the second input unit, and the second input unit converts the external code or input code into a keyboard and mouse signal and sends it to the second host through a first interface, and the input instruction is generated when the input position is determined on the display screen displaying the second video stream by operating the keyboard and mouse device;

[0065] The calling unit is used for the output unit to send the input instruction to the second input unit, and the second input unit sends the input instruction to the second host through the first interface. The input instruction is used to instruct the second host to call the external code or the text corresponding to the input code to the specified position according to the keyboard and mouse signal. The first interface is a USB interface, a PS2 interface or a serial port.

[0066] The present disclosure also includes a device for inputting text, including a memory and a processor; the memory is used to store a computer program; the processor is used to implement any of the methods described above when executing the computer program.

[0067] The input unit includes an encoder, which is a device or program that compresses image data, etc. The output unit includes a decoder, which is a device or program that decompresses image data, etc. The codec is composed of a codec pair. The codec has its own fixed codec format, and the code stream compressed by the encoder can be decoded by the corresponding decoder.

[0068] The embodiment of the present application provides a computer-readable medium, in which a computer program is stored, and the computer program is loaded and executed by the processing module to implement the steps of the acquisition method. It can be understood by those skilled in the art that all or part of the steps in the embodiment can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable medium, which can include various media that can store program codes, such as a flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.

[0069] Within the scope of the knowledge and ability level of those skilled in the art, the various embodiments or technical features mentioned herein may be combined with each other as other optional embodiments without conflict. These limited number of optional embodiments, which are not listed one by one and are formed by combining a limited number of technical features, still fall within the technical scope disclosed in the present disclosure and can be understood or inferred by those skilled in the art in combination with the drawings and the above text.

[0070] In addition, the description of most embodiments is based on different focuses. If you need to further understand what is not described in detail, you can refer to the relevant content of the prior art, other relevant descriptions in this article or the purpose of the invention for reasonable reasoning.

[0071] It is emphasized again that the embodiments listed above are typical and preferred embodiments of the present disclosure, which are only used to explain and interpret the technical solutions of the present disclosure in detail to facilitate the understanding of the readers, and are not used to limit the scope or application of the present disclosure. Any technical solutions obtained by modification, equivalent substitution, improvement, etc. made within the spirit and principle of the present disclosure shall be included in the scope of the present disclosure.

Claims

1. A method for inputting text, applied to a KVM device, characterized in that: include: The KVM device comprises: a first input unit, an output unit, and a second input unit, wherein the output unit is connected to a keyboard and mouse device and a display screen; The first input unit receives the first video stream of the first host through the unidirectional transmission HDMI line, transmits the first video stream to the output unit and displays it through the display screen, takes a screenshot of a designated area of ​​the display screen displaying the first video stream by operating the keyboard and mouse device, and the output unit recognizes the text of the screenshot and converts the text into an external code or an input code; The second input unit receives the second video stream of the second host through the unidirectional transmission HDMI line, and then transmits the second video stream to the output unit and displays it through the display screen. When text recognition and input instructions are detected, the output unit sends the external code or input code to the second input unit, and the second input unit converts the external code or input code into a keyboard and mouse signal and sends it to the second host through the first interface. The input instruction is generated when the input position is determined on the display screen displaying the second video stream by operating the keyboard and mouse device; The output unit sends the input instruction to the second input unit, and the second input unit sends the input instruction to the second host through the first interface. The input instruction is used to instruct the second host to call the text corresponding to the external code or input code to the specified position according to the keyboard and mouse signals. The first interface is a USB interface, a PS2 interface, or a serial port.

2. The method according to claim 1, characterized in that When text recognition and input instructions are detected, it includes: detecting that the mouse is released when text is selected from the display screen displaying the first video stream and dragged to the input position on the display screen displaying the second video stream; or detecting that after text is copied or selected from the display screen displaying the first video stream, the cursor moves from the display screen displaying the first video stream to the input position of the display screen displaying the second video stream to paste or fill in text.

3. The method according to claim 1, characterized in that The output unit includes a first output unit and a second output unit. The first output unit is connected to the keyboard and mouse device. The first output unit receives keyboard and mouse information from the keyboard and mouse device. The first output unit and the second output unit exchange the keyboard and mouse information through the exchange unit, and the keyboard and mouse information is passed between the first output unit and the second output unit.

4. The method according to claim 3, characterized in that The first output unit recognizes the text of the screenshot and converts the text into an external code or an input code. When text recognition and input instructions are detected, the first output unit sends the external code or input code to the second output unit, and the second output unit then sends the external code or input code to the second input unit.

5. The method according to claim 3, characterized in that: The display screen includes a first display screen and a second display screen. The first display screen is connected to a first output unit and is used to display a first video stream. The second display screen is connected to a second output unit and is used to display a second video stream. The cursor of a keyboard and mouse crosses between the first display screen and the second display screen. When the cursor is detected at the boundary of the first display screen, the first output unit sends the keyboard and mouse information to the second output unit or to the second input unit through a switching unit to control a second host.

6. The method according to claim 1, characterized in that The keyboard and mouse information generated when operating the keyboard and mouse connected to the second host to input text to the second host using the input code input method is the same as the keyboard and mouse signal converted by the second input unit from the external code or the input code.

7. The method according to claim 1, characterized in that The KVM device further includes a switching unit connected between the first input unit and the output unit, and the switching unit is also connected between the second input unit and the output unit.

8. A text input device, applied to a KVM device, characterized in that: include: The KVM device comprises: a first input unit, an output unit, and a second input unit, wherein the output unit is connected to a keyboard and mouse device and a display screen; The external code or input code obtaining unit is used for the first input unit to receive the first video stream of the first host through the unidirectional transmission HDMI line, and then transmit the first video stream to the output unit and display it through the display screen, and take a screenshot of the designated area of ​​the display screen displaying the first video stream by operating the keyboard and mouse device, and the output unit recognizes the text of the screenshot and converts the text into the external code or input code; A position acquisition unit, used for the second input unit to receive the second video stream of the second host through the unidirectional transmission HDMI line, and then transmit the second video stream to the output unit and display it through the display screen. When text recognition and input instructions are detected, the output unit sends the external code or input code to the second input unit, and the second input unit converts the external code or input code into a keyboard and mouse signal and sends it to the second host through the first interface. The input instruction is generated when the input position is determined by operating the keyboard and mouse device on the display screen displaying the second video stream; The calling unit is used for the output unit to send the input instruction to the second input unit, and the second input unit sends the input instruction to the second host through the first interface. The input instruction is used to instruct the second host to call the text corresponding to the external code or input code to the specified position according to the keyboard and mouse signal. The first interface is a USB interface, a PS2 interface or a serial port.

9. A device for inputting text, characterized in that: Comprising a processing circuit for performing a method as claimed in any one of claims 1 to 7.

10. A device for inputting text, characterized in that: including memory and processor; Memory for storing computer programs; A processor, configured to implement the method according to any one of claims 1 to 7 when executing the computer program.

Citation Information

Patent Citations

  • Login method and device for user identified by radio frequency

    CN102609657A

  • Cross-network-segment data transmission method and device and readable medium

    CN114202756A