Mouse crossing control method and system applied to picture segmentation

Abstract

The invention discloses a mouse crossing control method and system applied to picture segmentation, and the method comprises the steps: enumerating the type of accessed keyboard and mouse equipment and keyboard and mouse information based on a USB (Universal Serial Bus) keyboard and mouse control system when a KVM (Keyboard Video Mouse) forms multi-path input sources input by a plurality of different source equipment into split-screen display pictures by adopting a picture segmentation technology; acquiring a USB standard descriptor corresponding to an operating system on a picture channel based on the keyboard and mouse information; converting the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor; and the operating system on the picture channel responds to the key event. According to the invention, the mouse crossing control among different system pictures is realized, so that the mouse crossing control of different system pictures achieves a more ideal effect.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method and system for controlling mouse crossing in screen segmentation. Background Art

[0002] With the rapid development of the Internet era, computer devices have been widely used in people's daily lives. However, at present, a single display screen can no longer meet the needs of users, and users usually switch back and forth between multiple display screens. The current screen splitter supports the source device of the WINDOWS / MACOS system to access the video through the HDMI cable and control the mouse crossing through the USB cable. However, the current mouse crossing control cannot realize the mouse crossing control between multiple mobile phone screens and between mobile phones and computers, nor can it realize the mouse crossing control between different operating systems. At the same time, the existing mouse crossing control has not formed a complete and reliable event reporting strategy, resulting in the failure to accurately report pointer events of different systems, so that the mouse crossing control of different system screens cannot achieve the expected effect. Summary of the invention

[0003] The purpose of the present invention is to overcome the shortcomings of the prior art. The present invention provides a method and system for mouse crossing control in screen segmentation, which realizes mouse crossing control between different system screens and achieves a more ideal effect of mouse crossing control between different system screens.

[0004] In order to solve the above technical problems, the present invention provides a method for mouse crossing control in screen splitting, wherein the method is based on a screen splitter KVM connected to multiple different source devices, and the KVM uses screen splitting technology to display multiple input sources input by multiple different source devices on the connected display device, and the method comprises:

[0005] When the KVM uses the screen segmentation technology to form a split-screen display screen using multiple input sources input by multiple different source devices, the type of connected keyboard and mouse devices and keyboard and mouse information are enumerated based on the USB keyboard and mouse control system;

[0006] Acquire the USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information;

[0007] Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0008] The operating system on the screen channel responds to the key event.

[0009] Optionally, the acquiring of a USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information includes:

[0010] Determine whether the mouse has moved across the screen based on the keyboard and mouse information;

[0011] When it is determined that the mouse has moved across screens, a USB standard descriptor corresponding to the operating system on the cross-screen channel is extracted based on the keyboard and mouse device type;

[0012] When it is determined that the mouse is not moved across screens, a USB standard descriptor corresponding to the operating system on the current screen channel is obtained.

[0013] Optionally, judging whether the mouse has moved across screens based on the keyboard and mouse information includes:

[0014] The relative displacement of the mouse is extracted based on the keyboard and mouse information, the screen channel value where the mouse is located is calculated based on the relative displacement, and whether the mouse has moved across the screen is determined based on the screen channel value where the mouse is located.

[0015] Optionally, the calculation process of the screen channel value where the mouse is located is:

[0016] Calculate the current position of the mouse:

[0017] XHost ′ =XHost+DeltaX,

[0018] YHost ′ =YHost+DelaY,

[0019] Among them, XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, XHost is the initial horizontal coordinate position of the mouse, YHost is the initial vertical coordinate position of the mouse, DeltaX is the relative displacement of the mouse on the horizontal axis, and DeltaY is the relative displacement of the mouse on the vertical axis;

[0020] The screen channel where the mouse is located is calculated based on the current position of the mouse. The calculation expression of the screen channel where the mouse is located is:

[0021]

[0022] Among them, CHx is the screen channel where the mouse is located, XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, Xmax is the maximum horizontal coordinate of the split screen, Ymax is the maximum vertical coordinate of the split screen, and Ny is the number of rows of the split screen;

[0023] Based on the channel coordinate value of the screen channel where the mouse is located, the calculation expression of the channel coordinate value is:

[0024] XDevice=XHost ′ %Xmax,

[0025] YDevice=YHost ′ %Ymax,

[0026] Among them, XDevice is the horizontal coordinate position of the screen channel where the mouse is located, YDevice is the vertical coordinate position of the screen channel where the mouse is located, and XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, Xmax is the maximum horizontal coordinate value of the screen, and Ymax is the maximum vertical coordinate value of the screen.

[0027] Optionally, the method further comprises:

[0028] In the screen splitter, the USB standard descriptor corresponding to the operating system is configured in combination with the keyboard and mouse device type.

[0029] Optionally, configuring the USB standard descriptor corresponding to the operating system in the screen splitter in combination with the keyboard and mouse device type includes:

[0030] When the keyboard and mouse device type is an absolute position mouse, a corresponding first interface descriptor is configured for the operating system, the first interface descriptor includes a first HID class descriptor and an endpoint descriptor, and the data format reported to the operating system by the first HID class descriptor is eight bytes, and the eight bytes are Report ID, a mouse button flag, an arbitrary value, a wheel value, high 8 bits of the absolute value of the horizontal coordinate, low 8 bits of the absolute value of the horizontal coordinate, low 8 bits of the absolute value of the vertical coordinate, and high 8 bits of the absolute value of the vertical coordinate;

[0031] When the keyboard and mouse device type is a relative position mouse, a corresponding second interface descriptor is configured for the operating system, the second interface descriptor includes a second HID class descriptor and an endpoint descriptor, and the data format reported to the operating system by the second HID class descriptor is six bytes, and the six bytes are a mouse button flag, an arbitrary value, the upper 8 bits of the relative displacement of the horizontal coordinate, the lower 8 bits of the relative displacement of the horizontal coordinate, the lower 8 bits of the relative displacement of the vertical coordinate, and the upper 8 bits of the relative displacement of the vertical coordinate;

[0032] When the keyboard and mouse device type is a touch screen or a button, a corresponding third interface descriptor is configured for the operating system, the third interface descriptor includes a third HID class descriptor and an endpoint descriptor, and the data format reported to the operating system by the third HID class descriptor is six bytes, and the six bytes are Report ID, a touch button status flag, the upper 8 bits of the absolute value of the horizontal coordinate, the lower 8 bits of the absolute value of the horizontal coordinate, the lower 8 bits of the absolute value of the vertical coordinate, and the upper 8 bits of the absolute value of the vertical coordinate.

[0033] Optionally, the acquiring of a USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information includes:

[0034] An operating system tag is obtained, and a system type of the operating system on the picture channel is determined based on the operating system tag, wherein the system type is one of Windows / MACOS system, IOS system, Andorid / HarmonyOS system and a non-mainstream operating system.

[0035] Optionally, the acquiring of a USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information includes:

[0036] If the operating system on the screen channel is a Windows / MACOS system, and the keyboard and mouse device types supported by the Windows / MACOS system include an absolute position mouse, extract the first interface descriptor in the USB standard descriptor;

[0037] If the operating system on the screen channel is an IOS system, and the keyboard and mouse device types supported by the IOS system include absolute position mouse and relative position mouse, extract the first interface descriptor and the second interface descriptor in the USB standard descriptor;

[0038] If the operating system on the screen channel is an Andorid / HarmonyOS system, and the keyboard and mouse device types supported by the Andorid / HarmonyOS system include relative position mouse and touch screen devices, extract the second interface descriptor and the third interface descriptor in the USB standard descriptor;

[0039] If the operating system on the screen channel is a non-mainstream operating system, and the keyboard and mouse device types supported by the non-mainstream operating system include absolute position mouse and relative position mouse, the first interface descriptor and the second interface descriptor in the USB standard descriptor are extracted.

[0040] Optionally, converting the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor includes:

[0041] If the operating system on the screen channel is Windows / MACOS system, the keyboard and mouse device type and keyboard and mouse information are converted into key events based on the first interface descriptor for reporting;

[0042] If the operating system on the screen channel is an IOS system, the channel coordinate value in the keyboard and mouse information is reported based on the first interface descriptor, the position offset of the relative position mouse is set to 0, the key event of the absolute position mouse is filled into the key position of the relative position mouse, and the relative position mouse reports the scroll wheel event and the mouse key event based on the second interface descriptor;

[0043] If the operating system on the screen channel is the Andorid / HarmonyOS system, the left button press event of the absolute position mouse is converted into a touch screen press event. After being converted into the touch screen press event, the channel coordinate value is filled into the absolute position of the touch screen based on the absolute position mouse, and the channel coordinate value and the touch press event are reported based on the touch screen device using the third interface descriptor, and the scroll wheel event and the mouse button event are reported based on the second interface descriptor;

[0044] If the operating system on the screen channel is a non-mainstream operating system, the channel coordinate value is reported based on the first interface descriptor, and the scroll wheel event and the mouse button event are reported based on the second interface descriptor.

[0045] In addition, the present invention also provides a system for mouse crossing control in screen segmentation, wherein the system is based on a screen segmentation device KVM to access multiple different source devices, and the KVM uses a screen segmentation technology to display multiple input sources input by multiple different source devices on the connected display device, and the system includes:

[0046] Keyboard and mouse data enumeration module: used for enumerating the connected keyboard and mouse device types and keyboard and mouse information based on the USB keyboard and mouse control system when the KVM uses the screen segmentation technology to form a split-screen display screen with multiple input sources input by multiple different source devices;

[0047] A standard descriptor acquisition module: used for acquiring a USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information;

[0048] Event conversion module: used for converting the keyboard and mouse device type and keyboard and mouse information into key events based on the corresponding USB standard descriptor;

[0049] Event response module: used for the operating system on the screen channel to respond to the key event.

[0050] In an embodiment of the present invention, when the KVM uses screen segmentation technology to form a split-screen display screen with multiple input sources input by multiple different source devices, the connected keyboard and mouse device types and keyboard and mouse information are enumerated based on the USB keyboard and mouse control system to achieve access to different systems. Based on the keyboard and mouse information, it is determined whether the mouse has moved across screens. When it is determined that the mouse has moved across screens, the USB standard descriptor corresponding to the operating system on the screen channel is extracted based on the keyboard and mouse device type, and the keyboard and mouse device type and keyboard and mouse information are converted into key events based on the corresponding USB standard descriptor. The operating system on the screen channel responds to the key events. Different reporting strategies are used for different systems to achieve mouse crossing control between multiple mobile phone screens and mouse crossing control between mobile phones and computers. This makes it compatible with different systems and enables mouse crossing control of different system screens to achieve a more ideal effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0052] Figure 1 is a hardware structure diagram of the screen segmentation system in the first embodiment of the present invention;

[0053] Figure 2 is a flow chart of a method for controlling mouse traversal in screen segmentation in a second embodiment of the present invention;

[0054] Figure 3 is a flow chart of a method for controlling mouse crossing in screen segmentation in a third embodiment of the present invention;

[0055] Figure 4 is a flowchart of a method for controlling mouse traversal in screen segmentation in a fourth embodiment of the present invention;

[0056] Figure 5 is a flowchart of a method for controlling mouse traversal in screen segmentation in a fifth embodiment of the present invention;

[0057] Figure 6 is a flowchart of a method for controlling mouse traversal in screen segmentation in a sixth embodiment of the present invention;

[0058] Figure 7 is a flowchart of a method for controlling mouse traversal in screen segmentation in a seventh embodiment of the present invention;

[0059] Figure 8 Schematic diagram of the structure of a system for controlling mouse traversal in screen segmentation according to an embodiment of the present invention;

[0060] Fig. 9 This is a diagram showing the effect of implementing mouse crossing control in screen segmentation in an embodiment of the present invention. DETAILED DESCRIPTION

[0061] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0062] Embodiment 1

[0063] The hardware structure diagram of the screen segmentation system provided by the embodiment of the present invention is as follows: Figure 1 As shown, the screen splitting system includes: a microprocessor, a TYPE-C input port, an HDMI input port, a USB interface, a conversion chip, an HDMI screen splitting chip, a USB Host chip and a USB HID Device. The microprocessor is connected to the HDMI screen splitting chip and the USB HID Device respectively, the USB HID Device is connected to the USB Host chip and the USB interface respectively, the HDMI screen splitting chip is connected to the conversion chip, the HDMI output port and the HDMI input port respectively, the conversion chip is connected to the TYPE-C input port, the HDMI input port is connected to a source device implemented by a non-touch screen driving principle, the TYPE-C input port is connected to a source device implemented by a touch screen driving principle, the HDMI output port is connected to a display, and the mouse / keyboard is connected to the USB Host chip.

[0064] It should be noted that the HDMI screen splitting chip can be connected to the TYPE-C input port through the conversion chip, that is, the source device implemented by the touch screen driving principle can be connected to the HDMI screen splitting chip through the TYPE-C input port, and the HDMI screen splitting chip here can be partially connected to the source device implemented by the touch screen driving principle through the TYPE-C input port, and some source devices can be other types of source devices, that is, connected to the source device implemented by the non-touch screen driving principle through the HDMI input port, which can support the source device implemented by the non-touch screen driving principle to access the HDMI screen splitting chip. That is, the HDMI screen splitting chip in the embodiment of the present invention can simultaneously support the access of the source device implemented by the touch screen driving principle and the source device implemented by the non-touch screen driving principle.

[0065] The microprocessor can be a high-performance and low-power 32-bit microcontroller with ultra-high computing power and large-capacity memory, which can meet the efficient processing of multiple systems. The USB Host chip can include two USBHost ports, which can connect to two USB HID keyboard and mouse devices. The USB Host chip can embed a USB controller and dual USB transceivers, support USB-Host host mode and USB-Device device mode, and provide rich interface resources. The chip has the ability to enumerate and control USB keyboards and mice, and the USB Host reads raw data. The USB HID Device can use an enhanced E8051 core microcontroller compatible with the MCS51 instruction set. This chip supports multiple USB input endpoints. The HDMI screen segmentation chip is used for screen segmentation, the conversion chip is used for display signal conversion, and the fast charging interface is used to charge the source device connected to the system.

[0066] DP display signals of different operating systems are received through different TYPE-C input ports. The operating system here is the operating system of the source device implemented by the touch screen driving principle. The source device connected is a mobile terminal of Android / HarmonyOS system or IOS system. After the display signal of the mobile terminal is connected, the display signal needs to be converted through the conversion chip, and then the display signal is input to the HDMI screen splitting chip for processing. The DP display signals of different operating systems are also connected through the HDMI input port. The operating system connected here is Windows / MACOS or a non-mainstream operating system. The display signal connected here can be directly input to the HDMI screen splitting chip for processing without the signal conversion of the conversion chip, so as to realize multi-screen display. Therefore, the display signals of different operating systems are connected in different ways, which can be adjusted according to the actual situation, such as connecting four source devices that are all implemented by the touch screen driving principle, or connecting one source device that is implemented by the touch screen driving principle, and three source devices that are implemented by the non-touch screen driving principle, etc. The specific situation is determined by the actual situation of the user. The USB Host chip reads the keyboard and mouse data transmitted by the USB HID Device, and the USB Host chip parses the acquired keyboard and mouse data and converts them into corresponding keyboard and mouse events and reports them to the operating system of the screen. The microprocessor of the operating system of the screen responds to and processes events to realize screen segmentation and mouse crossing in the segmented screen.

[0067] In the embodiment of the present invention, the access of different systems can be received through the TYPE-C input port, and the mouse crossing between different operating systems can be realized through the cooperation of the microprocessor, the HDMI screen segmentation chip, the USB Host chip and the USB HID Device.

[0068] Embodiment 2

[0069] See also Figure 2 , Figure 2 It is a flowchart of a method for controlling mouse crossing in screen segmentation in the second embodiment of the present invention.

[0070] The method is based on a screen splitter KVM connected to multiple different source devices, and the KVM uses a screen splitting technology to display multiple input sources input by the multiple different source devices on the connected display device, and the method includes:

[0071] S011: when the KVM uses the screen segmentation technology to form a split-screen display screen for multiple input sources input by multiple different source devices, enumerate the types of connected keyboard and mouse devices and keyboard and mouse information based on the USB keyboard and mouse control system;

[0072] Specifically, a split-screen display screen is formed by using screen splitting technology through multiple input sources, and source devices of different operating systems can be connected. The type of connected keyboard and mouse devices and keyboard and mouse information are enumerated through the USB keyboard and mouse control system to obtain specific operation information for subsequent judgment operations.

[0073] S012: Acquire a USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information;

[0074] Specifically, different keyboard and mouse device types can be enumerated through USB standard descriptors corresponding to different operating systems to support different systems.

[0075] S013: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0076] Specifically, an event reporting strategy corresponding to each operating system can be formed through the corresponding USB standard descriptor, which can be compatible with different operating systems to achieve mouse crossing control between multiple mobile phone screens and mouse crossing control between a mobile phone and a computer.

[0077] S014: The operating system on the screen channel responds to the key event.

[0078] In an embodiment of the present invention, when the KVM uses screen segmentation technology to form a split-screen display screen with multiple input sources input by multiple different source devices, the connected keyboard and mouse device types and keyboard and mouse information are enumerated based on the USB keyboard and mouse control system to achieve access to different systems. Based on the keyboard and mouse information, it is determined whether the mouse has moved across screens. When it is determined that the mouse has moved across screens, the USB standard descriptor corresponding to the operating system on the screen channel is extracted based on the keyboard and mouse device type, and the keyboard and mouse device type and keyboard and mouse information are converted into key events based on the corresponding USB standard descriptor. The operating system on the screen channel responds to the key events. Different reporting strategies are used for different systems to achieve mouse crossing control between multiple mobile phone screens and mouse crossing control between mobile phones and computers. This makes it compatible with different systems and enables mouse crossing control of different system screens to achieve a more ideal effect.

[0079] Embodiment 3

[0080] See also Figure 3 , Figure 3 : is a flow chart of a method for controlling mouse crossing in screen segmentation in a third embodiment of the present invention, the method comprising:

[0081] S110: configuring a USB standard descriptor corresponding to the operating system in the screen splitter in combination with the keyboard and mouse device type;

[0082] When the keyboard and mouse device type is an absolute position mouse, a corresponding first interface descriptor is configured for the operating system, the first interface descriptor includes a first HID class descriptor and an endpoint descriptor, and the data format reported to the operating system by the first HID class descriptor is eight bytes, and the eight bytes are Report ID, a mouse button flag, an arbitrary value, a wheel value, the upper 8 bits of the absolute value of the horizontal coordinate, the lower 8 bits of the absolute value of the horizontal coordinate, the lower 8 bits of the absolute value of the vertical coordinate, and the upper 8 bits of the absolute value of the vertical coordinate, as shown in the following table:

[0083]

[0084] When the keyboard and mouse device type is a relative position mouse, a corresponding second interface descriptor is configured for the operating system, the second interface descriptor includes a second HID class descriptor and an endpoint descriptor, and the data format reported by the second HID class descriptor to the operating system is six bytes, and the six bytes are a mouse button flag, an arbitrary value, the upper 8 bits of the horizontal coordinate relative displacement, the lower 8 bits of the horizontal coordinate relative displacement, the lower 8 bits of the vertical coordinate relative displacement, and the upper 8 bits of the vertical coordinate relative displacement, as shown in the following table:

[0085]

[0086] When the keyboard and mouse device type is a touch screen or a button, a corresponding third interface descriptor is configured for the operating system, the third interface descriptor includes a third HID class descriptor and an endpoint descriptor, and the data format reported by the third HID class descriptor to the operating system is six bytes, and the six bytes are Report ID, a touch button state flag, the upper 8 bits of the absolute value of the horizontal coordinate, the lower 8 bits of the absolute value of the horizontal coordinate, the lower 8 bits of the absolute value of the vertical coordinate, and the upper 8 bits of the absolute value of the vertical coordinate, as shown in the following table:

[0087]

[0088] S111: accessing multiple different source devices based on the screen splitter KVM;

[0089] In the specific implementation process of the present invention, a plurality of different source devices are connected based on a plurality of input ports in the screen splitter KVM, and the source devices include computers, mobile phones or tablets.

[0090] S112: The KVM uses a screen splitting technology to form a split-screen display screen using multiple input sources input from multiple different source devices;

[0091] In the specific implementation process of the present invention, the KVM receives multiple input sources input by different source devices, and performs screen segmentation of different systems through a screen segmentation chip to realize split-screen display.

[0092] S113: when the KVM uses the screen segmentation technology to form a split-screen display screen for multiple input sources input by multiple different source devices, enumerate the types of connected keyboard and mouse devices and keyboard and mouse information based on the USB keyboard and mouse control system;

[0093] In the specific implementation process of the present invention, when the KVM uses the screen segmentation technology to form a split-screen display screen for the multi-channel input sources input by multiple different source devices, the USB keyboard and mouse control system enumerates the connected keyboard and mouse device types and keyboard and mouse information. The USB keyboard and mouse control system includes a USB Host and multiple USB HID Device devices. The enumerated connected keyboard and mouse device types include a touch screen, a relative position mouse, an absolute position mouse, and a keyboard, as shown in the following table:

[0094]

[0095] Keyboard and mouse information includes the current mouse position, system and relative displacement, etc.

[0096] S114: determining whether the mouse has moved across the screen based on the keyboard and mouse information;

[0097] In the specific implementation process of the present invention, the method of judging whether the mouse has moved across the screen based on the keyboard and mouse information includes: extracting the relative displacement of the mouse based on the keyboard and mouse information, calculating the screen channel value where the mouse is located based on the relative displacement, and judging whether the mouse has moved across the screen based on the screen channel value where the mouse is located.

[0098] Furthermore, the calculation process of the channel value of the screen where the mouse is located is:

[0099] Calculate the current position of the mouse:

[0100] XHost ′ =XHost+DeltaX,

[0101] YHost ′ =YHost+DelaY,

[0102] Among them, XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, XHost is the initial horizontal coordinate position of the mouse, YHost is the initial vertical coordinate position of the mouse, DeltaX is the relative displacement of the mouse on the horizontal axis, and DeltaY is the relative displacement of the mouse on the vertical axis;

[0103] The screen channel where the mouse is located is calculated based on the current position of the mouse. The calculation expression of the screen channel where the mouse is located is:

[0104]

[0105] Among them, CHx is the screen channel where the mouse is located, XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, Xmax is the maximum horizontal coordinate of the split screen, Ymax is the maximum vertical coordinate of the split screen, and Ny is the number of rows of the split screen;

[0106] Based on the channel coordinate value of the screen channel where the mouse is located, the calculation expression of the channel coordinate value is:

[0107] XDevice=XHost ′ %Xmax,

[0108] YDevice=YHost ′ %Ymax,

[0109] Among them, XDevice is the horizontal coordinate position of the screen channel where the mouse is located, YDevice is the vertical coordinate position of the screen channel where the mouse is located, and XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, Xmax is the maximum horizontal coordinate value of the screen, and Ymax is the maximum vertical coordinate value of the screen.

[0110] Specifically, the coordinate space of the USB Host is composed of the coordinates of the sub-screens. The coordinate range of the sub-screens is fixed to [0,0]-[Xmax,Ymax]. The conversion relationship of different multi-screens is similar. The maximum value of the horizontal coordinate of each sub-screen is Xmax, the maximum value of the vertical coordinate is Ymax, and the coordinate range of the sub-screen is [0,0]-[Xmax,Ymax]. The maximum value of the horizontal coordinate of the USB Host is Xmax*Nx, and the maximum value of the vertical coordinate is Ymax*Ny. The coordinate range of the USB Host is [0,0]-[Xmax*Nx,Ymax*Ny]. Nx is the number of columns of the split screen, indicating that there are Nx split screens in one row, and Ny is the number of rows of the split screen, indicating that there are Ny split screens in one column. For example, for the four-screen split in Tianzi grid, Nx=2, Ny=2, for the four-column style screen, Nx=4, Ny=1. Assume that the initial position of the USB Host is XHost = 0, YHost = 0. The USB Host continuously reads the relative displacement DeltaX and DeltaY of the mouse when it crosses the split screen to obtain the current mouse position. The calculation expression of the current mouse position when it crosses the split screen is:

[0111] XHost ′=XHost+DeltaX,

[0112] YHost ′ =YHost+DelaY,

[0113] Among them, XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, XHost is the initial horizontal coordinate position of the mouse, YHost is the initial vertical coordinate position of the mouse, DeltaX is the relative displacement of the mouse on the horizontal axis, and DeltaY is the relative displacement of the mouse on the vertical axis.

[0114] By current mouse position XHost ′ and YHost ′ Value, calculate which input channel CHx the mouse is on, the calculation expression of the input channel where the mouse is located is:

[0115]

[0116] Among them, CHx is the screen channel where the mouse is located, XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, Xmax is the maximum horizontal coordinate of the split screen, Ymax is the maximum vertical coordinate of the split screen, Ny is the number of rows of the split screen, XHost ′ The maximum value is Nx*Xmax, where Nx is the number of columns in the split screen, indicating that there are Nx split screens in one row. ′ The maximum value is Ny*Ymax, where Ny is the number of rows of the split screen, indicating that there are Ny split screens in one column. For example, for the four-screen split in Tianzi grid, Nx=2, Ny=2, and for the four-column style screen, Nx=4, Ny=1.

[0117] USB Host XHost ′ and YHost ′ The coordinate value converted to CHx is:

[0118] XDevice=XHost ′ %Xmax,

[0119] YDevice=YHost ′ %Ymax,

[0120] Among them, XDevice is the horizontal coordinate position of the channel where the mouse is located, YDevice is the vertical coordinate position of the channel where the mouse is located, and XHost ′ is the current horizontal coordinate position of the mouse, YHost ′is the current vertical coordinate position of the mouse, Xmax is the maximum horizontal coordinate of the split screen, and Ymax is the maximum vertical coordinate of the split screen. Then it is determined whether the mouse moves across the screen.

[0121] S115: when it is determined that the mouse has moved the screen, the system type of the system for which the mouse has moved the screen is determined;

[0122] During the specific implementation of the present invention, the device system will provide a button for the user to mark, that is, the system mark can be obtained according to the button, and the system type to which the current Type-C source is connected can be memorized according to the mark. Different systems correspond to different marks, including Windows / MACOS system, IOS system, Andorid / HarmonyOS system and non-mainstream operating system. Non-mainstream operating systems are other non-mainstream operating systems except Android, HarmonyOS, iOS, Windows and MacOS, such as various Linux distributions.

[0123] S116: if it is determined that the mouse crosses from the screen where the Windows / MACOS system is located to the screen where the Windows / MACOS system is located, and the keyboard and mouse device types supported by the Windows / MACOS system include absolute position mice, extracting a first interface descriptor;

[0124] In the specific implementation process of the present invention, if it is determined that the mouse is crossing from the screen where the Windows / MACOS system is located to the screen where another Windows / MACOS system is located, the crossing of the same system screen, the keyboard and mouse device type supported by the Windows / MACOS system includes an absolute position mouse, and when the keyboard and mouse device type is an absolute position mouse, the corresponding first interface descriptor is configured for the operating system, so the first interface descriptor is extracted, the USB standard descriptor includes three interface descriptors, each interface descriptor follows a HID class descriptor and an endpoint descriptor, the descriptor format follows the USB HID protocol specification, different keyboard and mouse device types correspond to different interface descriptors, the first interface descriptor includes a first HID class descriptor and an endpoint descriptor, the data format reported by the first HID class descriptor to the operating system is eight bytes, and the eight bytes are Report ID, mouse button flag, arbitrary value, wheel value, high 8 bits of the absolute value of the horizontal coordinate, low 8 bits of the absolute value of the horizontal coordinate, low 8 bits of the absolute value of the vertical coordinate, and high 8 bits of the absolute value of the vertical coordinate, wherein for any value, the system will ignore this field.

[0125] S1161: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the first interface descriptor;

[0126] In the specific implementation of the present invention, different systems have different event reporting strategies, as shown in the following table:

[0127]

[0128]

[0129] The operating system here is Windows / MACOS system. Based on the first interface descriptor, the keyboard and mouse device type and keyboard and mouse information are converted into key events. According to the first interface descriptor, the channel coordinate value is reported by the absolute position mouse, the wheel event is reported by the absolute position wheel, the left mouse button is reported by the absolute position mouse left button, and other mouse buttons are reported by the absolute position mouse buttons. According to the first interface descriptor, the relevant information is converted into corresponding events and reported to the operating system, which also includes keyboard events. For the reporting of keyboard events, the USB HID protocol is also followed. The reporting format of the keyboard is eight bytes, as shown in the following table:

[0130]

[0131] The byte definition format is Report ID, Control Key, Key Value 1, Key Value 2, Key Value 3, Key Value 4, Key Value 5, and Key Value 6.

[0132] S1162: The Windows / MACOS system on the screen channel where the mouse is traversing responds to the key event;

[0133] In the specific implementation process of the present invention, the Windows / MACOS system on the screen channel where the mouse passes through responds to the key event, that is, the Windows / MACOS system calculates the position of the mouse on the current screen to display the pointer icon according to the acquired key event, and responds to the mouse button and scroll wheel at the same time. The specific mouse passing effect diagram is as follows Fig. 9 shown.

[0134] S117: If it is determined that the mouse crosses from the screen where the Windows / MACOS system is located to the screen where the IOS system is located, and the keyboard and mouse device types supported by the IOS system include absolute position mouse and relative position mouse, extract the first interface descriptor and the second interface descriptor in the USB standard descriptor;

[0135] In the specific implementation process of the present invention, if it is determined that the mouse crosses from the screen where the Windows / MACOS system is located to the screen where the IOS system is located, the IOS system can support the pointer display of the absolute position mouse, but does not respond to the key events of the absolute position mouse. Therefore, the relative position mouse is used to report events to achieve better compatibility. Therefore, the keyboard and mouse device types supported by the IOS system include absolute position mouse and relative position mouse. When the keyboard and mouse device type is an absolute position mouse, the corresponding first interface descriptor is configured for the operating system. When the keyboard and mouse device type is a relative position mouse, the corresponding second interface descriptor is configured for the operating system. Therefore, the first interface descriptor and the second interface descriptor in the USB standard descriptor are extracted, and the relative position mouse is a pointer relative position control. , event data reporting between different operating systems can be realized through the conversion of USB standard descriptors, and the conversion of descriptor information can be realized through GET_DESCRIPTOR request to achieve mouse control between different systems. When it is recognized that the screen traversed by the mouse is a different system, the corresponding USB standard descriptor can be converted according to the recognized system type. The second interface descriptor includes a second HID class descriptor and an endpoint descriptor. The data format reported by the second HID class descriptor to the operating system is six bytes, and the six bytes are the mouse button flag, an arbitrary value, the high 8 bits of the horizontal coordinate relative displacement, the low 8 bits of the horizontal coordinate relative displacement, the low 8 bits of the vertical coordinate relative displacement, and the high 8 bits of the vertical coordinate relative displacement. For any value, the system will ignore this field. The IOS system can support the pointer display of the absolute position mouse, but does not respond to the button event of the absolute position mouse. Therefore, the relative position mouse wheel and button are used for reporting to achieve better compatibility.

[0136] S1171: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0137] During the specific implementation of the present invention, the keyboard and mouse device type and keyboard and mouse information are reported as events through the corresponding interface descriptors. When reporting to the operating system, the channel coordinate value is first reported through the absolute position mouse device, and no mouse button is pressed at this time; then, the position offset of the relative position mouse is set to 0, and the key event of the absolute position mouse is filled into the relative position mouse button position, so as to achieve the effect of no displacement control of the relative position mouse device and only reporting of mouse key events.

[0138] S1172: The iOS system on the screen channel where the mouse passes through responds to the key event;

[0139] In the specific implementation process of the present invention, the IOS system on the screen channel where the mouse is traversed establishes a socket communication interface with the Windows / MACOS system, and obtains the data contained in the key event from the diplay_window function on the Windows / MACOS system side. The diplay_window function, as a data extraction function, can extract data by creating a window, encode the data contained in the key event according to the encoding protocol, generate first keyboard and mouse data, send the first keyboard and mouse data to the IOS system side, decode the first keyboard and mouse data on the IOS system side, obtain second keyboard and mouse data, and send the second keyboard and mouse data to the hardware abstraction layer of the IOS operating system. The hardware abstraction layer calls the framework event of the IOS operating system to enable the IOS system to respond to the key event, thereby realizing mouse operation in the IOS system, bringing a more convenient operation experience to the user. The specific mouse traversal effect diagram is shown in the figure. Fig. 9 shown.

[0140] S118: If it is determined that the mouse crosses from the screen where the Windows / MACOS system is located to the screen where the Andorid / HarmonyOS system is located, and the keyboard and mouse device types supported by the Andorid / HarmonyOS system include relative position mouse and touch screen device, extract the second interface descriptor and the third interface descriptor in the USB standard descriptor;

[0141] In the specific implementation process of the present invention, if it is determined that the mouse crosses from the screen where the Windows / MACOS system is located to the screen where the Andorid / HarmonyOS system is located, and the system does not support the absolute position mouse, the keyboard and mouse device type is changed to a touch screen device to achieve the mouse pointer display, that is, the mouse pointer position movement is achieved by converting to the state of the simulated touch screen device, and the event data reporting between different operating systems can be achieved by converting the USB standard descriptor. Similarly, the descriptor conversion can be achieved according to the corresponding request function to achieve mouse control between different systems. When it is recognized that the screen crossed by the mouse is of a different system, it can be realized according to the recognized The USB standard descriptor corresponding to the system type conversion is shown in FIG. 1 . The keyboard and mouse device types supported by the Andorid / HarmonyOS system include relative position mouse and touch screen devices. When the keyboard and mouse device type is a touch screen or a button, the corresponding third interface descriptor is configured for the operating system. When the keyboard and mouse device type is a relative position mouse, the corresponding second interface descriptor is configured for the operating system. Therefore, the second interface descriptor and the third interface descriptor are extracted. The third interface descriptor includes a third HID class descriptor and an endpoint descriptor. The data format reported by the third HID class descriptor to the operating system is six bytes. The six bytes are Report ID, touch button status flag, high 8 bits of the absolute value of the horizontal coordinate, low 8 bits of the absolute value of the horizontal coordinate, low 8 bits of the absolute value of the vertical coordinate, and high 8 bits of the absolute value of the vertical coordinate. Because mobile phone systems such as Android and HarmonyOS do not support absolute position mouse, it is necessary to use a touch screen to achieve mouse control.

[0142] S1181: Convert the keyboard and mouse device type and keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0143] In the specific implementation process of the present invention, the keyboard and mouse device type and keyboard and mouse information are reported as events based on the corresponding USB standard descriptor. When reporting to the operating system, the left button press event of the absolute position mouse is first converted into a touch screen press event, that is, when the left button of the mouse is detected to be pressed, the button mark position of the touch screen device is converted into a pressed state, and then the channel coordinate value of the absolute position mouse is filled into the absolute position position of the touch screen, and the channel coordinate value and the touch press event are reported to the operating system through the touch screen device. If there are wheel and other mouse button events, the displacement of the relative position mouse will be set to 0, and then the wheel and other mouse button events will be filled into the relative position mouse device button position and sent to the operating system. By filling the information into the corresponding mark position, data conversion can be realized between different systems to realize event information reporting between different systems.

[0144] S1182: The Android / HarmonyOS system on the screen channel where the mouse passes through responds to the key event;

[0145] In the specific implementation process of the present invention, the Andorid / HarmonyOS system on the screen channel where the mouse is traversed responds to the key event, establishes a socket communication interface with the Windows / MACOS system, obtains the data contained in the key event from the diplay_window on the Windows / MACOS system side, encodes the data contained in the key event according to the encoding protocol, generates first keyboard and mouse data, sends the first keyboard and mouse data to the Andorid / HarmonyOS system side, decodes the first keyboard and mouse data on the Andorid / HarmonyOS system side, obtains second keyboard and mouse data, sends the second keyboard and mouse data to the hardware abstraction layer of the IOS operating system, and the hardware abstraction layer uses the framework event of the Andorid / HarmonyOS operating system to make the Andorid / HarmonyOS system respond to the key event. The specific mouse traversal effect diagram is shown in FIG. Fig. 9 shown.

[0146] S119: if it is determined that the mouse has crossed from the screen where the Windows / MACOS system is located to the screen where the non-mainstream operating system is located, and the keyboard and mouse device types supported by the non-mainstream operating system include absolute position mouse and relative position mouse, extract the first interface descriptor and the second interface descriptor in the USB standard descriptor;

[0147] During the specific implementation of the present invention, if it is determined that the mouse has crossed from the screen where the Windows / MACOS system is located to the screen where the non-mainstream operating system is located, the keyboard and mouse device types supported by the non-mainstream operating system include absolute position mouse and relative position mouse, so the first interface descriptor and the second interface descriptor are extracted, wherein the absolute position mouse uses the first interface descriptor to report the channel coordinate value, and the relative position mouse uses the second interface descriptor to report scroll wheel events and mouse button events.

[0148] S1191: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0149] In the specific implementation process of the present invention, the keyboard and mouse device type and keyboard and mouse information are reported as events based on the corresponding USB standard descriptor, the keyboard and mouse device type and keyboard and mouse information are reported as enumerated data based on the corresponding USB standard descriptor, and the relevant data is converted into corresponding pointer events for reporting. For the reporting of the channel coordinate value of the keyboard and mouse information in the non-mainstream system, the channel coordinate value can also be reported based on the absolute position mouse and the touch screen device at the same time. The reporting strategy of the system can also use the absolute position mouse to report the channel coordinate value once, and then use the touch screen device to report the channel coordinate value.

[0150] S1192: The non-mainstream operating system on the screen channel where the mouse passes through responds to the key event.

[0151] In the specific implementation process of the present invention, the non-mainstream operating system decodes the received related key events to obtain the coded instructions, parses the coded instructions, serializes the objects operated in the coded instructions, obtains the related serialized data, and performs the corresponding operations through the related serialized data. The non-mainstream operating system makes corresponding response operations according to the pointer data in the obtained key events. The specific mouse crossing effect diagram is shown in FIG. Fig. 9 shown.

[0152] In an embodiment of the present invention, when the KVM uses screen segmentation technology to form a split-screen display screen with multiple input sources input by multiple different source devices, the connected keyboard and mouse device types and keyboard and mouse information are enumerated based on the USB keyboard and mouse control system to achieve access to different systems. Based on the keyboard and mouse information, it is determined whether the mouse has moved across the screen. When it is determined that the mouse has moved across the screen, the USB standard descriptor corresponding to the operating system on the screen channel is extracted based on the keyboard and mouse device type, and the keyboard and mouse device type and keyboard and mouse information are converted into key events based on the corresponding USB standard descriptor. The operating system on the screen channel responds to the key events. Different reporting strategies are used for different systems to achieve mouse crossing control between mobile phones and computers, thereby being compatible with different systems and achieving a more ideal effect of mouse crossing control of different system screens.

[0153] Embodiment 4

[0154] See also Figure 4 , Figure 4 4 is a flow chart of a method for controlling mouse traversal in screen segmentation in a fourth embodiment of the present invention, the method comprising:

[0155] S210: configuring a USB standard descriptor corresponding to the operating system in the screen splitter in combination with the keyboard and mouse device type;

[0156] S211: accessing multiple different source devices based on the screen splitter KVM;

[0157] S212: The KVM uses a screen splitting technology to form a split-screen display screen using multiple input sources input from multiple different source devices;

[0158] S213: when the KVM uses the screen segmentation technology to form a split-screen display screen for multiple input sources input by multiple different source devices, enumerate the types of connected keyboard and mouse devices and keyboard and mouse information based on the USB keyboard and mouse control system;

[0159] S214: determining whether the mouse has moved across the screen based on the keyboard and mouse information;

[0160] S215: when it is determined that the mouse has moved the screen, the system type of the system for which the mouse has moved the screen is determined;

[0161] S216: If it is determined that the mouse crosses from the screen where the IOS system is located to the screen where the Windows / MACOS system is located, and the keyboard and mouse device types supported by the Windows / MACOS system include absolute position mice, extracting a first interface descriptor;

[0162] During the specific implementation of the present invention, if it is determined that the mouse has crossed from the screen where the IOS system is located to the screen where the Windows / MACOS system is located, since the keyboard and mouse device types supported by the Windows / MACOS system include absolute position mouse, when the keyboard and mouse device type is an absolute position mouse, the corresponding first interface descriptor is configured for the operating system. Therefore, the first interface descriptor is extracted, and event data reporting between different operating systems can be achieved through conversion of USB standard descriptors. When it is identified that the screen crossed by the mouse is of a different system, the corresponding USB standard descriptor can be converted according to the identified system type through the GET_DESCRIPTOR request.

[0163] S2161: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the first interface descriptor;

[0164] In the specific implementation process of the present invention, the mouse channel coordinate value, the scroll wheel event and the mouse button event are reported to the operating system according to the format configured by the first interface descriptor.

[0165] S2162: The Windows / MACOS system on the screen channel where the mouse is traversing responds to a key event;

[0166] During the specific implementation of the present invention, the IOS system on the screen channel where the mouse traverses establishes a socket communication interface with the Windows / MACOS system, obtains the keyboard and mouse data contained in the event from the diplay_ios function, decodes the contained keyboard and mouse data according to the encoding protocol, generates decoded keyboard and mouse data, and sends the decoded keyboard and mouse data to the processor of the Windows / MACOS system. The processor of the system calls the corresponding framework to respond accordingly to the decoded keyboard and mouse event.

[0167] S217: if it is determined that the mouse crosses from the screen where the IOS system is located to the screen where the IOS system is located, and the keyboard and mouse device types supported by the IOS system include absolute position mouse and relative position mouse, extract the first interface descriptor and the second interface descriptor in the USB standard descriptor;

[0168] S2171: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0169] S2172: The iOS system on the screen channel where the mouse passes through responds to the key event;

[0170] S218: if it is determined that the mouse crosses from the screen where the IOS system is located to the screen where the Andorid / HarmonyOS system is located, and the keyboard and mouse device types supported by the Andorid / HarmonyOS system include relative position mouse and touch screen device, extract the second interface descriptor and the third interface descriptor in the USB standard descriptor;

[0171] During the specific implementation of the present invention, when the mouse passes from the screen where the IOS system is located to the screen where the Andorid / HarmonyOS system is located, since the Andorid / HarmonyOS system does not support the absolute position mouse, the keyboard and mouse device type is changed to a touch screen device to achieve the mouse pointer display, that is, the mouse pointer position movement is achieved by converting to the state of a simulated touch screen device, and the corresponding standard descriptor is converted by calling a request function. The keyboard and mouse device types supported by the Andorid / HarmonyOS system include relative position mouse and touch screen device. When the keyboard and mouse device type is a touch screen or a button, the corresponding third interface descriptor is configured for the operating system. When the keyboard and mouse device type is a relative position mouse, the corresponding second interface descriptor is configured for the operating system, and thus the second interface descriptor and the third interface descriptor are extracted.

[0172] S2181: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0173] S2182: The Android / HarmonyOS system on the screen channel where the mouse passes through responds to a key event;

[0174] During the specific implementation of the present invention, a data transmission protocol is defined, a port for signaling interaction is declared, and an event transmission channel is established based on the defined data transmission protocol and the port for signaling interaction. The Andorid / HarmonyOS system on the screen channel where the mouse is crossing obtains key events based on the event transmission channel, and makes corresponding response processing based on the key events, thereby realizing mouse crossing control between source devices of different operating systems.

[0175] S219: if it is determined that the mouse has crossed from the screen where the IOS system is located to the screen where the non-mainstream operating system is located, and the keyboard and mouse device types supported by the non-mainstream operating system include absolute position mouse and relative position mouse, extract the first interface descriptor and the second interface descriptor in the USB standard descriptor;

[0176] In the specific implementation process of the present invention, the keyboard and mouse device types supported by the non-mainstream operating system include absolute position mouse and relative position mouse. Therefore, the first interface descriptor and the second interface descriptor are extracted, also through the corresponding conversion function. When it is identified that the non-mainstream operating system has been crossed over, it is converted into the configured USB standard descriptor corresponding to the non-mainstream operating system through the conversion function.

[0177] S2191: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0178] S2192: The non-mainstream operating system on the screen channel where the mouse passes through responds to the key event.

[0179] During the specific implementation of the present invention, the non-mainstream operating system on the screen channel where the mouse is located performs regularized preprocessing on the keyboard and mouse information contained in the acquired key events, creates a compilation thread, divides the keyboard and mouse information contained in the key events into concurrent components, and uses the compilation thread to convert the information contained in the key events into a compiled language recognizable by the non-mainstream operating system, so that the non-mainstream system can make corresponding response processing.

[0180] In an embodiment of the present invention, when the KVM uses the screen segmentation technology to form a split-screen display screen with multiple input sources input by multiple different source devices, the connected keyboard and mouse device types and keyboard and mouse information are enumerated based on the USB keyboard and mouse control system to achieve access to different systems. Based on the keyboard and mouse information, it is determined whether the mouse has moved across the screen. When it is determined that the mouse has moved across the screen, the USB standard descriptor corresponding to the operating system on the screen channel is extracted based on the keyboard and mouse device type, and the keyboard and mouse device type and keyboard and mouse information are converted into key events based on the corresponding USB standard descriptor. The operating system on the screen channel responds to the key events. Different reporting strategies are used for different systems to achieve mouse crossing control between source devices of different operating systems, thereby being compatible with different systems and achieving a more ideal effect of mouse crossing control of different system screens.

[0181] Embodiment 5

[0182] See also Figure 5 , Figure 5 4 is a flow chart of a method for controlling mouse crossing in screen segmentation in a fifth embodiment of the present invention, the method comprising:

[0183] S310: configuring a USB standard descriptor corresponding to the operating system in the screen splitter in combination with the keyboard and mouse device type;

[0184] S311: accessing multiple different source devices based on the screen splitter KVM;

[0185] S312: The KVM uses a screen splitting technology to form a split-screen display screen using multiple input sources input from multiple different source devices;

[0186] S313: when the KVM uses the screen segmentation technology to form a split-screen display screen for multiple input sources input by multiple different source devices, enumerate the types of connected keyboard and mouse devices and keyboard and mouse information based on the USB keyboard and mouse control system;

[0187] S314: determining whether the mouse has moved across the screen based on the keyboard and mouse information;

[0188] S315: when it is determined that the mouse has moved the screen, the system type of the system for which the mouse has moved the screen is determined;

[0189] S316: if it is determined that the mouse crosses from the screen where the Andorid / HarmonyOS system is located to the screen where the Windows / MACOS system is located, and the keyboard and mouse device types supported by the Windows / MACOS system include absolute position mice, extracting a first interface descriptor;

[0190] During the specific implementation of the present invention, if it is determined that the mouse has crossed from the screen where the Andorid / HarmonyOS system is located to the screen where the Windows / MACOS system is located, since the keyboard and mouse device types supported by the Windows / MACOS system include absolute position mouse, when the keyboard and mouse device type is an absolute position mouse, the corresponding first interface descriptor is configured for the operating system. Therefore, the first interface descriptor is extracted, and event data reporting between different operating systems can be achieved through the conversion of USB standard descriptors. When it is identified that the screen crossed by the mouse is of a different system, the corresponding USB standard descriptor can be converted according to the identified system type through the GET_DESCRIPTOR request.

[0191] S3161: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the first interface descriptor;

[0192] S3162: The Windows / MACOS system on the screen channel where the mouse passes through responds to the key event;

[0193] During the specific implementation of the present invention, the Andorid / HarmonyOS system on the screen channel where the mouse traverses establishes a socket communication interface with the Windows / MACOS system, obtains the keyboard and mouse data contained in the event from the diplay_ios function, decodes the contained keyboard and mouse data according to the encoding protocol, generates decoded keyboard and mouse data, and sends the decoded keyboard and mouse data to the processor of the Windows / MACOS system. The processor of the system calls the corresponding framework to respond accordingly to the decoded keyboard and mouse event.

[0194] S317: if it is determined that the mouse crosses from the screen where the Andorid / HarmonyOS system is located to the screen where the IOS system is located, and the keyboard and mouse device types supported by the IOS system include absolute position mouse and relative position mouse, extract the first interface descriptor and the second interface descriptor in the USB standard descriptor;

[0195] During the specific implementation of the present invention, when it is determined that the mouse has crossed from the screen where the Andorid / HarmonyOS system is located to the screen where the IOS system is located, the conversion function and the request function are called to convert the corresponding USB standard descriptor through the keyboard and mouse device types supported by the IOS system. The keyboard and mouse device types supported by the IOS system include absolute position mouse and relative position mouse, and the first interface descriptor and the second interface descriptor in the USB standard descriptor can be extracted.

[0196] S3171: Convert the keyboard and mouse device type and keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0197] S3172: The iOS system on the screen channel where the mouse passes through responds to the key event;

[0198] In the specific implementation process of the present invention, a data transmission protocol is defined, a port for signaling interaction is declared, and an event transmission channel is established based on the defined data transmission protocol and the port for signaling interaction. The IOS system on the screen channel where the mouse is crossing obtains key events based on the event transmission channel, and makes corresponding response processing based on the key events, thereby realizing mouse crossing control between source devices of different operating systems.

[0199] S318: if it is determined that the mouse crosses from the screen where the Android / HarmonyOS system is located to the screen where the Android / HarmonyOS system is located, and the keyboard and mouse device types supported by the Android / HarmonyOS system include relative position mouse and touch screen device, extract the second interface descriptor and the third interface descriptor in the USB standard descriptor;

[0200] S3181: Convert the keyboard and mouse device type and keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0201] S3182: The Android / HarmonyOS system on the screen channel where the mouse passes through responds to the key event;

[0202] S319: if it is determined that the mouse has crossed from the screen where the Andorid / HarmonyOS system is located to the screen where the non-mainstream operating system is located, and the keyboard and mouse device types supported by the non-mainstream operating system include absolute position mouse and relative position mouse, extract the first interface descriptor and the second interface descriptor in the USB standard descriptor;

[0203] In the specific implementation process of the present invention, the keyboard and mouse device types supported by the non-mainstream operating system include absolute position mouse and relative position mouse. Therefore, the first interface descriptor and the second interface descriptor are extracted, also through the corresponding conversion function. When it is identified that the non-mainstream operating system has been crossed over, it is converted into the configured USB standard descriptor corresponding to the non-mainstream operating system through the conversion function.

[0204] S3191: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0205] S3192: The non-mainstream operating system on the screen channel that the mouse passes through responds to a key event.

[0206] During the specific implementation of the present invention, the non-mainstream operating system on the screen channel where the mouse is located performs regularized preprocessing on the keyboard and mouse information contained in the acquired key events, creates a compilation thread, divides the keyboard and mouse information contained in the key events into concurrent components, and uses the compilation thread to convert the information contained in the key events into a compiled language recognizable by the non-mainstream operating system, so that the non-mainstream system can make corresponding response processing.

[0207] In an embodiment of the present invention, when the KVM uses the screen segmentation technology to form a split-screen display screen with multiple input sources input by multiple different source devices, the connected keyboard and mouse device types and keyboard and mouse information are enumerated based on the USB keyboard and mouse control system to achieve access to different systems. Based on the keyboard and mouse information, it is determined whether the mouse has moved across the screen. When it is determined that the mouse has moved across the screen, the USB standard descriptor corresponding to the operating system on the screen channel is extracted based on the keyboard and mouse device type, and the keyboard and mouse device type and keyboard and mouse information are converted into key events based on the corresponding USB standard descriptor. The operating system on the screen channel responds to the key events. Different reporting strategies are used for different systems to achieve mouse crossing control between source devices of different operating systems, thereby being compatible with different systems and achieving a more ideal effect of mouse crossing control of different system screens.

[0208] Embodiment 6

[0209] See also Figure 6 , Figure 6 : is a flowchart of a method for controlling mouse crossing in screen segmentation in a sixth embodiment of the present invention, the method comprising:

[0210] S410: configuring a USB standard descriptor corresponding to the operating system in the screen splitter in combination with the keyboard and mouse device type;

[0211] S411: accessing multiple different source devices based on the screen splitter KVM;

[0212] S412: The KVM uses a screen splitting technology to form a split-screen display screen using multiple input sources input from multiple different source devices;

[0213] S413: when the KVM uses the screen segmentation technology to form a split-screen display screen for multiple input sources input by multiple different source devices, enumerate the types of connected keyboard and mouse devices and keyboard and mouse information based on the USB keyboard and mouse control system;

[0214] S414: determining whether the mouse has moved across the screen based on the keyboard and mouse information;

[0215] S415: when it is determined that the mouse has moved the screen, the system type of the system for which the mouse has moved the screen is determined;

[0216] S416: if it is determined that the mouse crosses from the screen where the non-mainstream operating system is located to the screen where the Windows / MACOS system is located, and the keyboard and mouse device types supported by the Windows / MACOS system include absolute position mice, extracting a first interface descriptor;

[0217] During the specific implementation of the present invention, if it is determined that the mouse has crossed from a screen where a non-mainstream operating system is located to a screen where a Windows / MACOS system is located, since the keyboard and mouse device types supported by the Windows / MACOS system include absolute position mice, when the keyboard and mouse device type is an absolute position mouse, the corresponding first interface descriptor is configured for the operating system. Therefore, the first interface descriptor is extracted, and event data reporting between different operating systems can be achieved through conversion of USB standard descriptors. When it is identified that the screen crossed by the mouse is of a different system, the corresponding USB standard descriptor can be converted according to the identified system type through the GET_DESCRIPTOR request.

[0218] S4161: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the first interface descriptor;

[0219] S4162: The Windows / MACOS system on the screen channel where the mouse is traversing responds to a key event;

[0220] During the specific implementation of the present invention, the non-mainstream operating system on the screen channel where the mouse is located performs regularized preprocessing on the keyboard and mouse information contained in the acquired key event, creates a compilation thread, divides the keyboard and mouse information contained in the key event into concurrent components, and uses the compilation thread to convert the information contained in the key event into a compilation language that can be recognized by the Windows / MACOS system, so that the non-mainstream system can make corresponding response processing. Similarly, the IOS system and the Andorid / HarmonyOS system also use the compilation thread to convert the information into a compilation language that can be recognized by their own operating systems. The compilation thread is set according to different operating systems so that it can respond to the response event.

[0221] S417: if it is determined that the mouse has crossed from the screen where the non-mainstream operating system is located to the screen where the IOS system is located, and the keyboard and mouse device types supported by the IOS system include absolute position mouse and relative position mouse, extract the first interface descriptor and the second interface descriptor in the USB standard descriptor;

[0222] During the specific implementation of the present invention, the IOS system can support the pointer display of the absolute position mouse, but does not respond to the button events of the absolute position mouse. Therefore, the relative position mouse is used to report events to achieve better compatibility. Therefore, the keyboard and mouse device types supported by the IOS system include absolute position mouse and relative position mouse. When the keyboard and mouse device type is the absolute position mouse, the corresponding first interface descriptor is configured for the operating system. When the keyboard and mouse device type is the relative position mouse, the corresponding second interface descriptor is configured for the operating system. Therefore, the first interface descriptor and the second interface descriptor in the USB standard descriptor are extracted. The relative position mouse is the relative position control of the pointer. Event data reporting between different operating systems can be realized by converting the USB standard descriptor, and the conversion of descriptor information is realized by the GET_DESCRIPTOR request to achieve mouse control between different systems. When it is identified that the screen traversed by the mouse is of a different system, the corresponding USB standard descriptor can be converted according to the identified system type.

[0223] S4171: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0224] During the specific implementation of the present invention, the keyboard and mouse device type and keyboard and mouse information are reported as events through the corresponding interface descriptors. When reporting to the operating system, the channel coordinate value is first reported through the absolute position mouse device, and no mouse button is pressed at this time; then, the position offset of the relative position mouse is set to 0, and the key event of the absolute position mouse is filled into the relative position mouse button position, so as to achieve the effect of no displacement control of the relative position mouse device and only reporting of mouse key events.

[0225] S4172: The IOS system on the screen channel where the mouse passes through responds to the key event;

[0226] In the specific implementation process of the present invention, a data transmission protocol is defined, a port for signaling interaction is declared, and an event transmission channel is established based on the defined data transmission protocol and the port for signaling interaction. The IOS system on the screen channel where the mouse is crossing obtains key events based on the event transmission channel, and makes corresponding response processing based on the key events, thereby realizing mouse crossing control between source devices of different operating systems.

[0227] S418: if it is determined that the mouse crosses from the screen where the non-mainstream operating system is located to the screen where the Andorid / HarmonyOS system is located, and the keyboard and mouse device types supported by the Andorid / HarmonyOS system include relative position mouse and touch screen device, extract the second interface descriptor and the third interface descriptor in the USB standard descriptor;

[0228] S4181: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0229] S4182: The Android / HarmonyOS system on the screen channel where the mouse passes through responds to a key event;

[0230] During the specific implementation of the present invention, a data transmission protocol is defined, a port for signaling interaction is declared, and an event transmission channel is established based on the defined data transmission protocol and the port for signaling interaction. The Andorid / HarmonyOS system on the screen channel where the mouse is crossing obtains key events based on the event transmission channel, and makes corresponding response processing based on the key events, thereby realizing mouse crossing control between source devices of different operating systems.

[0231] S419: if it is determined that the mouse crosses from the screen where the non-mainstream operating system is located to the screen where the non-mainstream operating system is located, and the keyboard and mouse device types supported by the non-mainstream operating system include absolute position mouse and relative position mouse, extract the first interface descriptor and the second interface descriptor in the USB standard descriptor;

[0232] S4191: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0233] S4192: The non-mainstream operating system on the screen channel where the mouse passes through responds to a key event.

[0234] During the specific implementation of the present invention, the non-mainstream operating system on the screen channel where the mouse is located performs regularized preprocessing on the keyboard and mouse information contained in the acquired key events, creates a compilation thread, divides the keyboard and mouse information contained in the key events into concurrent components, and uses the compilation thread to convert the information contained in the key events into a compiled language recognizable by the non-mainstream operating system, so that the non-mainstream system can make corresponding response processing.

[0235] In an embodiment of the present invention, when the KVM uses the screen segmentation technology to form a split-screen display screen with multiple input sources input by multiple different source devices, the connected keyboard and mouse device types and keyboard and mouse information are enumerated based on the USB keyboard and mouse control system to achieve access to different systems. Based on the keyboard and mouse information, it is determined whether the mouse has moved across the screen. When it is determined that the mouse has moved across the screen, the USB standard descriptor corresponding to the operating system on the screen channel is extracted based on the keyboard and mouse device type, and the keyboard and mouse device type and keyboard and mouse information are converted into key events based on the corresponding USB standard descriptor. The operating system on the screen channel responds to the key events. Different reporting strategies are used for different systems to achieve mouse crossing control between source devices of different operating systems, thereby being compatible with different systems and achieving a more ideal effect of mouse crossing control of different system screens.

[0236] Embodiment 7

[0237] See also Figure 7 , Figure 7 : is a flow chart of a method for controlling mouse crossing in screen segmentation in a seventh embodiment of the present invention, the method comprising:

[0238] S510: configuring a USB standard descriptor corresponding to the operating system in the screen splitter in combination with the keyboard and mouse device type;

[0239] S511: accessing multiple different source devices based on the screen splitter KVM;

[0240] S512: The KVM uses a screen splitting technology to form a split-screen display screen using multiple input sources input from multiple different source devices;

[0241] S513: when the KVM uses the screen segmentation technology to form a split-screen display screen for multiple input sources input by multiple different source devices, enumerate the types of connected keyboard and mouse devices and keyboard and mouse information based on the USB keyboard and mouse control system;

[0242] S514: determining whether the mouse has moved across the screen based on the keyboard and mouse information;

[0243] S515: If it is determined that the mouse is not moving across screens, obtain a USB standard descriptor corresponding to the operating system on the current screen channel;

[0244] Specifically, different operating systems correspond to different USB standard descriptors. The Windows / MACOS system corresponds to the first interface descriptor of the absolute position mouse. The screen where the IOS system is located, the keyboard and mouse device types supported by the IOS system include absolute position mouse and relative position mouse, and the first interface descriptor and the second interface descriptor in the USB standard descriptor are extracted; the screen where the Andorid / HarmonyOS system is located, the keyboard and mouse device types supported by the Andorid / HarmonyOS system include relative position mouse and touch screen device, and the second interface descriptor and the third interface descriptor in the USB standard descriptor are extracted; the screen where the non-mainstream operating system is located, the keyboard and mouse device types supported by the non-mainstream operating system include absolute position mouse and relative position mouse, and the first interface descriptor and the second interface descriptor in the USB standard descriptor are extracted.

[0245] S516: Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor;

[0246] S517: The operating system on the screen channel responds to the key event.

[0247] In an embodiment of the present invention, the keyboard and mouse device type and keyboard and mouse information are converted into key events through the corresponding USB standard descriptors, and the operating system on the screen channel responds to the key events, thereby enabling different systems to respond to mouse operations, solving the problem in the prior art that the mouse cannot be operated in a touch screen device, and providing better convenience for mouse crossing control.

[0248] Embodiment 8

[0249] See also Figure 8 , Figure 8 : is a schematic diagram of the structure of a system for mouse crossing control in screen splitting in an embodiment of the present invention. The system is based on a screen splitter KVM to access multiple different source devices. The KVM uses a screen splitting technology to display multiple input sources input by multiple different source devices on the connected display device. The system includes:

[0250] Keyboard and mouse data enumeration module 71: used for enumerating the connected keyboard and mouse device types and keyboard and mouse information based on the USB keyboard and mouse control system when the KVM uses the screen segmentation technology to form a split-screen display screen with multiple input sources input by multiple different source devices;

[0251] The standard descriptor acquisition module 72 is used to acquire the USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information;

[0252] Event conversion module 73: used for converting the keyboard and mouse device type and keyboard and mouse information into key events based on the corresponding USB standard descriptor;

[0253] Event response module 74: used for the operating system on the screen channel to respond to the key event.

[0254] In the specific implementation process of the present invention, the specific implementation method of the system item can refer to the implementation method of the above-mentioned method item, which will not be repeated here.

[0255] In an embodiment of the present invention, when the KVM uses the screen segmentation technology to form a split-screen display screen with multiple input sources input by multiple different source devices, the connected keyboard and mouse device types and keyboard and mouse information are enumerated based on the USB keyboard and mouse control system to achieve access to different systems. Based on the keyboard and mouse information, it is determined whether the mouse has moved across the screen. When it is determined that the mouse has moved across the screen, the USB standard descriptor corresponding to the operating system on the screen channel is extracted based on the keyboard and mouse device type, and the keyboard and mouse device type and keyboard and mouse information are converted into key events based on the corresponding USB standard descriptor. The operating system on the screen channel responds to the key events. Different reporting strategies are used for different systems to achieve mouse crossing control between source devices of different operating systems, thereby being compatible with different systems and achieving a more ideal effect of mouse crossing control of different system screens.

[0256] A person skilled in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the storage medium may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.

[0257] In addition, the above is a detailed introduction to a method and system for mouse crossing control in screen segmentation provided by an embodiment of the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for a person skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A method for controlling mouse crossing in screen segmentation, characterized in that: The method is based on a screen splitter KVM connected to multiple different source devices, and the KVM uses a screen splitting technology to display multiple input sources input by the multiple different source devices on the connected display device, and the method includes: When the KVM uses the screen segmentation technology to form a split-screen display screen using multiple input sources input by multiple different source devices, the type of connected keyboard and mouse devices and keyboard and mouse information are enumerated based on the USB keyboard and mouse control system; Based on the keyboard and mouse information, a USB standard descriptor corresponding to the operating system on the screen channel is obtained; Convert the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor; The operating system on the screen channel responds to the key event.

2. The method for controlling mouse crossing in screen segmentation according to claim 1, characterized in that: The method of acquiring the USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information includes: Determine whether the mouse has moved across the screen based on the keyboard and mouse information; When it is determined that the mouse has moved across screens, a USB standard descriptor corresponding to the operating system on the cross-screen channel is extracted based on the keyboard and mouse device type; When it is determined that the mouse is not moving across screens, a USB standard descriptor corresponding to the operating system on the current screen channel is obtained.

3. The method for controlling mouse crossing in screen segmentation according to claim 2, characterized in that: The determining whether the mouse has moved across screens based on the keyboard and mouse information includes: The relative displacement of the mouse is extracted based on the keyboard and mouse information, the screen channel value where the mouse is located is calculated based on the relative displacement, and whether the mouse has moved across the screen is determined based on the screen channel value where the mouse is located.

4. The method for controlling mouse crossing in screen segmentation according to claim 3, characterized in that: The calculation process of the screen channel value where the mouse is located is: Calculate the current position of the mouse: XHost ′ =XHost+DeltaX, YHost ′ =YHost+DelaY, Among them, XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, XHost is the initial horizontal coordinate position of the mouse, YHost is the initial vertical coordinate position of the mouse, DeltaX is the relative displacement of the mouse on the horizontal axis, and DeltaY is the relative displacement of the mouse on the vertical axis; The screen channel where the mouse is located is calculated based on the current position of the mouse. The calculation expression of the screen channel where the mouse is located is: Among them, CHx is the screen channel where the mouse is located, XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, Xmax is the maximum horizontal coordinate of the split screen, Ymax is the maximum vertical coordinate of the split screen, and Ny is the number of rows of the split screen; Based on the channel coordinate value of the screen channel where the mouse is located, the calculation expression of the channel coordinate value is: XDevice=XHost ′ %Xmax, YDevice=YHost ′ %Ymax, Among them, XDevice is the horizontal coordinate position of the screen channel where the mouse is located, YDevice is the vertical coordinate position of the screen channel where the mouse is located, and XHost ′ is the current horizontal coordinate position of the mouse, YHost ′ is the current vertical coordinate position of the mouse, Xmax is the maximum horizontal coordinate value of the screen, and Ymax is the maximum vertical coordinate value of the screen.

5. The method for controlling mouse crossing in screen segmentation according to claim 1, characterized in that: The method also includes: In the screen splitter, the USB standard descriptor corresponding to the operating system is configured in combination with the keyboard and mouse device type.

6. The method for controlling mouse crossing in screen segmentation according to claim 5, characterized in that: The USB standard descriptor corresponding to the operating system is configured in the screen splitter in combination with the keyboard and mouse device type, including: When the keyboard and mouse device type is an absolute position mouse, a corresponding first interface descriptor is configured for the operating system, the first interface descriptor includes a first HID class descriptor and an endpoint descriptor, and the data format reported to the operating system by the first HID class descriptor is eight bytes, and the eight bytes are Report ID, a mouse button flag, an arbitrary value, a wheel value, high 8 bits of the absolute value of the horizontal coordinate, low 8 bits of the absolute value of the horizontal coordinate, low 8 bits of the absolute value of the vertical coordinate, and high 8 bits of the absolute value of the vertical coordinate; When the keyboard and mouse device type is a relative position mouse, a corresponding second interface descriptor is configured for the operating system, the second interface descriptor includes a second HID class descriptor and an endpoint descriptor, and the data format reported to the operating system by the second HID class descriptor is six bytes, and the six bytes are a mouse button flag, an arbitrary value, the upper 8 bits of the relative displacement of the horizontal coordinate, the lower 8 bits of the relative displacement of the horizontal coordinate, the lower 8 bits of the relative displacement of the vertical coordinate, and the upper 8 bits of the relative displacement of the vertical coordinate; When the keyboard and mouse device type is a touch screen or a button, a corresponding third interface descriptor is configured for the operating system, the third interface descriptor includes a third HID class descriptor and an endpoint descriptor, and the data format reported to the operating system by the third HID class descriptor is six bytes, and the six bytes are Report ID, a touch button status flag, the upper 8 bits of the absolute value of the horizontal coordinate, the lower 8 bits of the absolute value of the horizontal coordinate, the lower 8 bits of the absolute value of the vertical coordinate, and the upper 8 bits of the absolute value of the vertical coordinate.

7. The method for controlling mouse crossing in screen segmentation according to claim 6, characterized in that: The method of acquiring the USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information includes: An operating system tag is obtained, and a system type of the operating system on the picture channel is determined based on the operating system tag, wherein the system type is one of Windows / MACOS system, IOS system, Andorid / HarmonyOS system and a non-mainstream operating system.

8. The method for controlling mouse crossing in screen segmentation according to claim 7, characterized in that: The method of acquiring the USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information includes: If the operating system on the screen channel is a Windows / MACOS system, and the keyboard and mouse device types supported by the Windows / MACOS system include an absolute position mouse, extract the first interface descriptor in the USB standard descriptor; If the operating system on the screen channel is an IOS system, and the keyboard and mouse device types supported by the IOS system include absolute position mouse and relative position mouse, extract the first interface descriptor and the second interface descriptor in the USB standard descriptor; If the operating system on the screen channel is an Andorid / HarmonyOS system, and the keyboard and mouse device types supported by the Andorid / HarmonyOS system include relative position mouse and touch screen devices, extract the second interface descriptor and the third interface descriptor in the USB standard descriptor; If the operating system on the screen channel is a non-mainstream operating system, and the keyboard and mouse device types supported by the non-mainstream operating system include absolute position mouse and relative position mouse, the first interface descriptor and the second interface descriptor in the USB standard descriptor are extracted.

9. The method for controlling mouse crossing in screen segmentation according to claim 1, characterized in that: The converting the keyboard and mouse device type and the keyboard and mouse information into a key event based on the corresponding USB standard descriptor includes: If the operating system on the screen channel is Windows / MACOS system, the keyboard and mouse device type and keyboard and mouse information are converted into key events based on the first interface descriptor for reporting; If the operating system on the screen channel is an IOS system, the channel coordinate value in the keyboard and mouse information is reported based on the first interface descriptor, the position offset of the relative position mouse is set to 0, the key event of the absolute position mouse is filled into the key position of the relative position mouse, and the relative position mouse reports the scroll wheel event and the mouse key event based on the second interface descriptor; If the operating system on the screen channel is the Andorid / HarmonyOS system, the left button press event of the absolute position mouse is converted into a touch screen press event. After being converted into the touch screen press event, the channel coordinate value is filled into the absolute position of the touch screen based on the absolute position mouse, and the channel coordinate value and the touch press event are reported based on the touch screen device using the third interface descriptor, and the scroll wheel event and the mouse button event are reported based on the second interface descriptor; If the operating system on the screen channel is a non-mainstream operating system, the channel coordinate value is reported based on the first interface descriptor, and the scroll wheel event and the mouse button event are reported based on the second interface descriptor.

10. A system for controlling mouse crossing in screen segmentation, characterized in that: The system is based on a screen splitter KVM to access multiple different source devices, and the KVM uses a screen splitting technology to display multiple input sources input by multiple different source devices on the connected display device. The system includes: Keyboard and mouse data enumeration module: used for enumerating the connected keyboard and mouse device types and keyboard and mouse information based on the USB keyboard and mouse control system when the KVM uses the screen segmentation technology to form a split-screen display screen with multiple input sources input by multiple different source devices; A standard descriptor acquisition module: used for acquiring a USB standard descriptor corresponding to the operating system on the screen channel based on the keyboard and mouse information; Event conversion module: used for converting the keyboard and mouse device type and keyboard and mouse information into key events based on the corresponding USB standard descriptor; Event response module: used for the operating system on the screen channel to respond to the key event.

Images