A method and system for optimizing the use of multi-layered interface mirror image nesting

Abstract

The application provides a method and system for optimizing multi-layer interface mirror image nesting use, the method comprising: constructing a multi-layer interface control model based on a signal source for generating a picture and a control end for viewing and controlling the signal source picture; collecting and processing touch data generated when the screen of the touch control end is touched to obtain an event type of the touch data; wherein the event type comprises a single-click event and a double-click event; controlling the signal source based on the event type of the touch data and the multi-layer interface control model to complete optimization of the multi-layer interface mirror image nesting use. The technical scheme of the application can accurately distinguish whether a double-click operation or a single-click operation is to be performed by a sending end under an Android device with different screen densities, and can send corresponding event data to a controlled end, so as to ensure that the controlled end responds according to the corresponding event data, thereby optimizing the experience of multi-layer interface mirror image nesting use.

Description

Technical Field

[0001] This invention belongs to the field of computer technology, specifically relating to a method and system for optimizing the nested use of multi-layer interface mirroring. Background Technology

[0002] When controlling a signal source on an Android device that supports a driverless protocol (such as the common Windows system), this protocol can receive and respond to touch data, mouse data, and keyboard data. When responding to click events, it needs to receive touch data or mouse data. Since Android devices are all operated by touch, the corresponding data received is touch data. If you want to send mouse data to the controlled device, you need to convert the touch data according to the mouse data format of the driverless protocol before sending it to the controlled device. When the controlled device taps twice in quick succession within the signal source area of ​​the Android device's own screen (because Android is a touch operation, when you quickly tap the same area twice with your finger, the two taps are unlikely to be at the same coordinates, there will always be an error), it represents a double tap, and the event data of these two taps is sent to the controlled device for response. If the distance between the two taps exceeds a certain range, the controlled device will not respond as a double tap event, but will respond as two independent tap events; for example, double-tapping the "My Computer" icon, the intention is to double-tap to open "My Computer", but it will instead select "My Computer" with the cursor.

[0003] In existing technologies, Android devices do not intervene when sending data; they simply convert it to mouse data format and then send it. If the distance between the two clicks falls within the range that Windows systems can respond to double-click events, it will be responded to as a double-click event. However, if the distance between the two clicks exceeds the range that Windows systems can respond to double-click events, it will be responded to as two independent click events. This will result in a phenomenon that is inconsistent with our expected purpose and reduce the user experience of multi-layered interface mirroring. Summary of the Invention

[0004] To address the problems existing in the prior art, this invention provides a method and system for optimizing the nested use of multi-layer interface mirroring, thereby avoiding or reducing the phenomenon that double-click event data is responded to as two independent click events by the controlled end.

[0005] To achieve the above objectives, the present invention provides the following solution:

[0006] A method for optimizing the use of nested multi-level interface mirroring, the method comprising:

[0007] A multi-layer interface control model is constructed based on the signal source that generates the image and the control terminal used to view and control the image of the signal source.

[0008] The system collects and processes touch data generated when the touch control terminal screen is touched, and obtains the event types of the touch data; wherein, the event types include single-click events and double-click events;

[0009] Based on the event types of touch data and the multi-layer interface control model, the signal source is controlled to optimize the nested use of multi-layer interface mirroring.

[0010] Preferably, the multi-layer interface control model further includes a dual-link interface device, an HDMI cable, and an office box; the method for constructing the multi-layer interface control model includes:

[0011] The signal sources are distributed across different local area networks (LANs), and an office box is configured for each LAN.

[0012] Based on the aforementioned office box, image data generated by multiple signal sources are aggregated;

[0013] The converged image data is transmitted to the dual-link interface device via an HDMI cable;

[0014] The dual-link interface device configures the received screen data to the control terminal;

[0015] The control terminal generates control commands based on the screen data; wherein, the control commands are the touch data;

[0016] Based on the dual-link interface device and the office box, the control commands are transmitted to the signal source to control the signal source and complete the construction of a multi-layer interface control model.

[0017] Preferred methods for obtaining event types of touch data include:

[0018] The system collects touch data generated when the touch control terminal screen is touched; wherein, the touch data includes the coordinates of the current touch point and the event time of the current touch;

[0019] Analyze the touch data to determine the initial event type of the touch data; the initial event type includes pressing, moving, and releasing.

[0020] When the initial event type is "press", the coordinates of the current press event and the previous press event are compared and the time difference between the two press events is calculated.

[0021] If the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range, then the current press event is a double-click event; if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range, then the current press event is a single-click event.

[0022] Preferably, the method for comparing the coordinates of the current press event and the previous press event includes:

[0023] Calculate the diagonal of the control screen based on the height, xdpi, and ydpi of the control screen.

[0024] Based on the diagonal, width, and height of the control terminal screen, obtain the number of dots per inch of the control terminal screen;

[0025] The screen density coefficient is obtained based on the number of dots per inch of the control screen.

[0026] Based on the screen density coefficient and the preset basic fault tolerance value, the final fault tolerance value is obtained;

[0027] Based on the final fault tolerance value and the coordinates of the last pressed event, a square area is selected on the control screen, and it is determined whether the coordinates of the current pressed event are within the selected square area to obtain the coordinate comparison result.

[0028] Preferably, the method for selecting a square region includes: using the coordinates of the last press event as the center point of the square region, and using the final tolerance value as the distance from the center point to the four right-angle vertices of the square region to select the square region.

[0029] The present invention also provides a system for optimizing the use of nested multi-layer interface mirroring, for implementing the method, comprising:

[0030] The multi-layer interface control model construction module is used to construct a multi-layer interface control model based on the signal source that generates the image and the control terminal used to view and control the image of the signal source.

[0031] The touch data processing module is used to collect and process touch data generated when the touch control terminal screen is touched, and to obtain the event types of the touch data; wherein, the event types include single-click events and double-click events;

[0032] The signal source control module is used to control the signal source based on the event type of touch data and the multi-layer interface control model, thereby optimizing the use of nested multi-layer interface mirroring.

[0033] Preferably, the multi-layer interface control model further includes a dual-link interface device, an HDMI cable, and an office box; the multi-layer interface control model construction module includes:

[0034] An office box configuration unit is used to distribute the signal source in different local area networks and configure one office box for each local area network;

[0035] The image aggregation unit is used to aggregate image data generated by multiple signal sources based on the office box;

[0036] The image transmission unit is used to transmit the aggregated image data to the dual-link interface machine via an HDMI cable;

[0037] A control instruction generation unit is used for the dual-link interface device to configure the received screen data to the control terminal; the control terminal generates control instructions based on the screen data; wherein, the control instructions are the touch data;

[0038] The signal source control unit is used to transmit the control commands to the signal source based on the dual-link interface machine and the office box, thereby controlling the signal source and completing the construction of a multi-layer interface control model.

[0039] Preferably, the touch data processing module includes:

[0040] A touch data generation unit is used to collect touch data generated when the touch control terminal screen is touched; wherein, the touch data includes the coordinates of the current touch point and the event time of the current touch;

[0041] An initial event type determination unit is used to analyze the touch data and determine the initial event type of the touch data; the initial event type includes pressing, moving, and releasing;

[0042] The calculation unit is used to compare the coordinates of the current press event and the previous press event and calculate the time difference between the two press events when the initial event type is press.

[0043] The final event type determination unit is used to determine the current press event as a double-click event if the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range; and to determine the current press event as a single-click event if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range.

[0044] Compared with existing technologies, the beneficial effects of this invention are as follows: This invention can accurately distinguish whether the sending end is performing a double-click or a single-click operation on Android devices with different screen densities, and send the corresponding event data to the controlled end, ensuring that the controlled end responds according to the corresponding event data, thus optimizing the use of nested multi-layer interface mirroring. By controlling the office box, the signal source displayed on the office box can be switched, allowing the control end to view and use the signal source without connecting to the network where the signal source is located. Attached Figure Description

[0045] To more clearly illustrate the technical solution of the present invention, the drawings used in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0046] Figure 1 A flowchart illustrating the method for optimizing the nested use of multi-layer interface mirroring in an embodiment of the present invention;

[0047] Figure 2 This is a schematic diagram of the multi-layer interface control model structure according to an embodiment of the present invention;

[0048] Figure 3 This is a flowchart illustrating the process of determining the type of touch data event according to an embodiment of the present invention;

[0049] Figure 4 This is a schematic diagram of a square area selected in an embodiment of the present invention. Detailed Implementation

[0050] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0051] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0052] The terms used in the embodiments of this invention are explained as follows:

[0053] Multi-level interface mirroring refers to a single interface containing multiple other interfaces, where each nested interface can also act as a container for further nesting of other interfaces. This structure creates a multi-layered, multi-dimensional interface system, allowing users to access and manipulate multiple different functions or datasets within a unified interface.

[0054] To optimize the user experience of nested multi-level interface mirroring, the following strategies can typically be adopted:

[0055] Provide clear hierarchical navigation and interface element labels so that users can quickly locate and operate.

[0056] It supports multi-finger touch and gesture operation to improve operating efficiency and convenience.

[0057] Optimize touch response speed and interface update speed to reduce user waiting time.

[0058] It offers customizable interface layouts and themes to meet the personalized needs of different users.

[0059] HDMI cable, short for High Definition Multimedia Interface, is a digital transmission interface cable used to connect high-definition display devices and high-definition signal source devices. The working principle of HDMI cables is mainly based on TMDS (Time Minimized Differential Signal) technology. This technology transmits information through the voltage difference between two pins; the data value ("0" or "1") is determined by the sign and magnitude of the voltage between these two pins. At the transmitting end, the data is processed by the TMDS encoder, converted into a TMDS signal, and serialized for output. At the receiving end, the received serial HDMI signal is processed by signal restoration and the TMDS decoder to restore the original data. This process ensures accurate data transmission.

[0060] Example 1

[0061] Since Android devices use touch operation, when you quickly tap the same area twice with your finger, the two taps will not actually be at the same coordinates, and there will always be an error. This invention aims to process touch data and, based on a preset coordinate range and time range, ensure that as long as two taps occur within a certain time and in a set area, they are treated as a double-tap event and sent.

[0062] like Figure 1 As shown, a method for optimizing the use of nested multi-level interface mirroring is provided, the method including:

[0063] S1: Based on the signal source that generates the image and the control terminal for viewing and controlling the image of the signal source, a multi-layer interface control model is constructed; a further implementation method is that the multi-layer interface control model also includes a dual-link interface device, an HDMI cable, and an office box.

[0064] like Figure 2 As shown, the methods for constructing a multi-layer interface control model include:

[0065] The signal sources are distributed across different local area networks (LANs), and an office box is configured for each LAN.

[0066] Based on the office box, it aggregates image data from multiple signal sources;

[0067] The converged image data is transmitted to the dual-link interface device via an HDMI cable;

[0068] The dual-link interface device configures the received screen data to the control terminal;

[0069] The control unit generates control commands based on the screen data; these control commands are touch data.

[0070] Based on a dual-link interface device and an office box, control commands are transmitted to the signal source to control the signal source and complete the construction of a multi-layer interface control model.

[0071] Specifically, the signal sources are distributed across two (or more) networks, with one interface unit / office box placed in each network to aggregate multiple signal sources from the network and output them to the dual-link interface unit via HDMI. The signal sources specifically include several signal sources and their corresponding acquisition boxes.

[0072] The dual-link interface device reports screen data to the backend system, configures the corresponding screen data to a certain account on the pad, and the pad (control terminal) plays the screen transmitted by the dual-link interface device, enabling users to view the screen of the interface device / office box and the screen of signal sources in various networks.

[0073] During control, control command data is sent to the dual-link interface device. Upon receiving the data, the dual-link interface device transmits it to the interface device / office box via an HDMI control cable to control the interface device / office box. The interface device / office box then converts and forwards the control information to the target signal source, thereby controlling the signal source.

[0074] By controlling the interface device / office box, the signal source displayed on the interface device / office box can be switched, allowing the tablet to view and use the signal source without being connected to the network where the signal source is located.

[0075] The dual-link interface machine includes two layers of links and a display and parsing module. The first layer of links includes a first unidirectional link, and the second layer of links includes a second unidirectional link and a third unidirectional link.

[0076] A virtual interface is pre-stored and set as the virtual interface to be operated, and in response to an input, the data corresponding to the virtual interface to be operated is output to the display parsing module through a first unidirectional link. The display parsing module parses the screen data collected by the office box and outputs the parsing result to the control terminal. The system receives and analyzes user input, and determines the control command for controlling the virtual interface and the control instruction for controlling the signal source corresponding to the input based on the pre-stored correspondence between input and control command. According to the control instruction for controlling the virtual interface, the system controls the virtual interface to respond, and outputs the data as the virtual interface response result through the first unidirectional link. According to the control instruction for controlling the signal source, the system controls the signal source to respond through a second unidirectional link. The signal source response result is output through a third unidirectional link. The system parses the data output through the first unidirectional link, merges the parsing result with the signal source response result output through the third unidirectional link, and outputs the merged result to the control terminal.

[0077] S2: Collects and processes touch data generated when the touch control screen is touched, obtaining the event types of the touch data; among which, event types include single-click events and double-click events. For example... Figure 3 As shown.

[0078] A further implementation method includes a method for obtaining the event type of touch data, comprising:

[0079] S21: Collect touch data generated when touching the control screen; the touch data includes the coordinates of the current touch point and the event time of the current touch; specifically, when touching the control screen, touch data is generated, and this touch data is given to the developer through the system's onTouchEvent(MotionEvent event) function.

[0080] S22: Analyze the touch data and determine the initial event type of the touch data; the initial event type includes press, move, and release; specifically, the MotionEvent object contains touch data information, which will use the getX,Y coordinates of the current touch point (getX(), getY()), the current touch event type (press, move, release; getAction()), and the current touch event time (getEventTime()).

[0081] When a finger touches the screen, multiple touch data are generated, including three event types: press, move (the system may not respond to move event data when a finger is quickly touched and then immediately lifted), and lift. A complete touch data record must include both press and lift events.

[0082] S23: When the initial event type is "press", compare the coordinates of the current press event and the previous press event and calculate the time difference between the two press events.

[0083] When determining the coordinate range, the fault tolerance value and the screen density coefficient are required.

[0084] The final error tolerance value is determined by the screen density of the device. Determining the screen density requires calculating the device's dpi (dots per inch) range. Calculating dpi requires the screen width, screen height, screen xdpi, and screen ydpi, all of which can be obtained through APIs provided by the Android system.

[0085] Specifically, a further implementation method for comparing the coordinates of the current press event and the previous press event includes:

[0086] The diagonal of the control screen is calculated based on the screen's height, xdpi, and ydpi. Specifically, the diagonal of the screen is calculated in inches (in). The formula divides the width by xdpi and the height by ydpi to convert the pixel units (px) to inches (in).

[0087]

[0088] Based on the diagonal, width, and height of the control screen, obtain the dots per inch of the control screen; specifically, calculate the device's dpi range:

[0089] Dots per inch

[0090] The screen density coefficient is obtained based on the number of dots per inch of the control screen. Specifically, the screen density coefficient can be obtained according to the dpi range reference table provided by Android. (The range is backward compatible; for example, if the calculation result of the above formula is 200 dpi, it is less than 240 dpi and greater than 160 dpi, and the final value range is 160 dpi, that is, the screen density coefficient is 1.0). See Table 1.

[0091] Table 1

[0092] Dots per inch (dpi) Screen Category Directory Screen density coefficient 120dpi ldpi 0.75 160dpi mdpi 1.0 240dpi hdpi 1.5 320dpi xhdpi 2.0 480dpi xxhdpi 3.0 640dpi xxxhdpi 4.0

[0093] Based on the screen density coefficient and a preset baseline fault tolerance value, the final fault tolerance value is obtained; specifically, the final fault tolerance value is calculated in pixels (px):

[0094] Fault tolerance value = Screen density coefficient × Base fault tolerance value

[0095] For example:

[0096] When the screen density coefficient is 1.5

[0097] Error tolerance value = 1.5 (screen density coefficient) x 30 (base error tolerance value) = 45 pixels

[0098] When the screen density index is 3.0

[0099] Error tolerance value = 3.0 (screen density coefficient) x 30 (base error tolerance value) = 90 pixels

[0100] After obtaining the final fault tolerance value, it is possible to determine whether it is a double-click event. At the same time, the time difference between the current press event data and the previous press event data also needs to be considered.

[0101] Based on the final fault tolerance value and the coordinates of the last pressed event, a square area is selected on the control screen. It is then determined whether the coordinates of the current pressed event are within the selected square area to obtain a coordinate comparison result. A further implementation method involves selecting the square area by using the coordinates of the last pressed event as the center point of the square area and the final fault tolerance value as the distance from the center point to the four right-angle vertices of the square area.

[0102] In this embodiment, the fault tolerance value is set to 30, which is a basic fault tolerance value (note: screen density coefficient is not involved here; the actual screen density coefficient will vary, and the fault tolerance value will change accordingly). The unit is pixels (px). This value is used to select a square area, with the center point of the area being the x, y coordinates of the last press event data. The distance from the center coordinate point to the right angle of the four sides of the square is the fault tolerance value of 30px. This value is the result of verification that sending a double-tap event to the controlled end can be correctly triggered and responded to 100% of the time on Android devices with various screen densities (this is an empirical value, and its feasibility has been verified through multiple tests).

[0103] For example: Figure 4 As shown, the x,y coordinates of the last press event data are (60,60), in pixels. Using these coordinates as the center point of the square, the coordinates of the left vertex, right vertex, left bottom point, and right bottom point of the selected square in the coordinate system are (30,30), (90,30), (30,90), and (90,90), respectively. The final tolerance value is 30 pixels, so the corresponding coordinate range is (60-30=30 to 60+30=90) on the x-axis and (60-30=30 to 60+30=90) on the y-axis. The x,y coordinates of the current press event are (75,75). The x-coordinate 75 is within the x-axis range of 30-90, and the y-coordinate 75 is within the y-axis range of 30-90. Therefore, the coordinate range meets the requirements.

[0104] S24: If the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range, then the current press event is a double-click event; if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range, then the current press event is a single-click event.

[0105] Specifically, each touch event contains the corresponding event time, which can be obtained through the getEventTime() function in the MotionEvent object. The event time of the current press event minus the event time of the previous press event will have a time difference value. Determine whether the time difference value is within the set interval range. If it is within the set interval range (and combined with the coordinate range mentioned above), it represents a double-click action; if it is outside the set interval range, it represents a single-click action.

[0106] 1. The time difference is set to 300 milliseconds (ms). This means that if the time difference between the current press event and the previous press event is greater than 300ms, it represents a tap action; if it is less than or equal to 300ms, it represents a double tap action. This value (300ms) is the system-defined value for a double tap response on Android, obtained through the `getDoubleTapTimeout()` function in the `ViewConfiguration` object. Some Android devices allow modification of the double tap response interval (short, medium, standard, long) through system settings. Different Android device manufacturers define different interval values, but the standard is 300ms. Therefore, the time difference set in this embodiment is also 300ms. We tested this standard time difference on various Android device models, and within this time difference range, the controlled device accurately responded to the double tap operation (this value was obtained from the system and verified through multiple tests). For example, if the last press event time was 3415013770ms and the current press event time is 3415013900ms, the current press event time minus the last press event time (3415013900-3415013770=130) results in 130. 130<300, which is within the set time difference range, and the time difference has now met the condition.

[0107] In summary, the system controls a driverless signal source via an Android device. During control, the Android device displays the image of the controlled signal source; in other words, the Android device plays the image of the controlled signal source. Based on this displayed image, the Android device then controls the controlled signal source. When a user initiates control and touches the Android device's screen, the system sends data generated by the touch back to the program. Therefore, the source of the touch data is the user's touch on the Android device's screen. After receiving the touch data, the program analyzes it. If the event type is a press event, the data is passed to the data processing module for analysis and processing. The final data to be sent is determined, and after sending, the data is recorded and stored. Specifically, if the x,y coordinates of the current press event data fall within a square area centered on the x,y coordinates of the previous press event data, and the time difference is within a set time interval, it is considered a double-click event. In this case, the recorded data of the previous press event is also sent to the controlled signal source. If the coordinates are outside the designated area or the time difference exceeds the set range, it is considered a click event. In this case, the data of this click event will be sent to the controlled signal source. All data sent to the controlled signal source will be stored for future condition comparisons.

[0108] S3: Based on event types and multi-layer interface control models using touch data, control signal sources to optimize the nested use of multi-layer interface mirroring.

[0109] In summary, this invention optimizes the use of nested multi-layer interface mirroring by optimizing touch response.

[0110] Example 2

[0111] This invention also provides a system for optimizing the use of nested multi-layer interface mirroring, and a method for implementing this system, including:

[0112] The multi-layer interface control model construction module is used to construct a multi-layer interface control model based on the signal source that generates the image and the control terminal used to view and control the image of the signal source.

[0113] The touch data processing module is used to collect and process touch data generated when the touch control terminal screen is touched, and to obtain the event types of the touch data; among which, the event types include single-click events and double-click events;

[0114] The signal source control module is used to control the signal source based on the event type of touch data and the multi-layer interface control model, and to optimize the use of nested multi-layer interface mirroring.

[0115] A further implementation method includes a multi-layer interface control model that also includes a dual-link interface device, an HDMI cable, and an office box; the multi-layer interface control model construction module includes:

[0116] The office box configuration unit is used to distribute signal sources in different local area networks and configure one office box for each local area network;

[0117] The image aggregation unit is used to aggregate image data from multiple signal sources based on the office box;

[0118] The image transmission unit is used to transmit the aggregated image data to the dual-link interface unit via an HDMI cable;

[0119] The control command generation unit is used by the dual-link interface device to configure the received screen data to the control terminal; the control terminal generates control commands based on the screen data; wherein, the control commands are touch data;

[0120] The signal source control unit is used to transmit control commands to the signal source based on the dual-link interface machine and the office box, thereby controlling the signal source and completing the construction of a multi-layer interface control model.

[0121] A further embodiment of the invention includes a touch data processing module comprising:

[0122] The touch data generation unit is used to collect touch data generated when the touch control terminal screen is touched; wherein, the touch data includes the coordinates of the current touch point and the event time of the current touch;

[0123] The initial event type determination unit is used to analyze touch data and determine the initial event type of the touch data; the initial event type includes press, move, and release.

[0124] The calculation unit is used to compare the coordinates of the current press event and the previous press event and calculate the time difference between the two press events when the initial event type is press.

[0125] The final event type determination unit is used to determine the current press event as a double-click event if the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range; and to determine the current press event as a single-click event if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range.

[0126] The system also includes a data recording and storage module, which stores all control commands sent to the signal source.

[0127] In summary, this embodiment of the invention predicts the behavior of the control terminal when controlling the signal source of the controlled terminal via the Android device. If the corresponding conditions for double-clicking are met, it means that the Android device wants to double-click the signal source of the controlled terminal. In this case, the data sent by the Android device should be processed accordingly so that the signal source of the controlled terminal can accurately respond to the operation behavior of our control terminal.

[0128] The embodiments described above are merely preferred embodiments of the present invention and are not intended to limit the scope of the present invention. Various modifications and improvements made to the technical solutions of the present invention by those skilled in the art without departing from the spirit of the present invention should fall within the protection scope defined by the claims of the present invention.

Claims

1. A method for optimizing the nested use of multi-layer interface mirroring, characterized in that, The method includes: A multi-layer interface control model is constructed based on the signal source that generates the image and the control terminal used to view and control the image of the signal source. The system collects and processes touch data generated when the touch control terminal screen is touched, and obtains the event types of the touch data; wherein, the event types include single-click events and double-click events; Based on the event types of touch data and the multi-layer interface control model, the signal source is controlled to optimize the nested use of multi-layer interface mirroring. The multi-layer interface control model also includes a dual-link interface device, an HDMI cable, and an office box; the method for constructing the multi-layer interface control model includes: The signal sources are distributed across different local area networks (LANs), and an office box is configured for each LAN. Based on the aforementioned office box, image data generated by multiple signal sources are aggregated; The converged image data is transmitted to the dual-link interface device via an HDMI cable; The dual-link interface device configures the received screen data to the control terminal; The control terminal generates control commands based on the screen data; wherein, the control commands are the touch data; Based on the dual-link interface machine and the office box, the control commands are transmitted to the signal source to control the signal source and complete the construction of a multi-layer interface control model. Methods for obtaining touch data event types include: The system collects touch data generated when the touch control terminal screen is touched; wherein, the touch data includes the coordinates of the current touch point and the event time of the current touch; Analyze the touch data to determine the initial event type of the touch data; the initial event type includes pressing, moving, and releasing. When the initial event type is "press", the coordinates of the current press event and the previous press event are compared and the time difference between the two press events is calculated. If the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range, then the current press event is a double-click event; if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range, then the current press event is a single-click event.

2. The method according to claim 1, characterized in that, Methods for comparing the coordinates of the current press event and the previous press event include: Calculate the diagonal of the control screen based on the height, xdpi, and ydpi of the control screen. Based on the diagonal, width, and height of the control terminal screen, obtain the number of dots per inch of the control terminal screen; The screen density coefficient is obtained based on the number of dots per inch of the control screen. Based on the screen density coefficient and the preset basic fault tolerance value, the final fault tolerance value is obtained; Based on the final fault tolerance value and the coordinates of the last pressed event, a square area is selected on the control screen, and it is determined whether the coordinates of the current pressed event are within the selected square area to obtain the coordinate comparison result.

3. The method according to claim 1, characterized in that, The method for selecting a square area includes: using the coordinates of the last press event as the center point of the square area, and using the final tolerance value as the distance from the center point to the four right-angle vertices of the square area to select the square area.

4. A system for optimizing the use of nested multi-layer interface mirroring, used to implement the method described in any one of claims 1-3, characterized in that, include: The multi-layer interface control model construction module is used to construct a multi-layer interface control model based on the signal source that generates the image and the control terminal used to view and control the image of the signal source. The touch data processing module is used to collect and process touch data generated when the touch control terminal screen is touched, and to obtain the event type of the touch data; wherein, the event type includes single-click event and double-click event; The signal source control module is used to control the signal source based on the event type of touch data and the multi-layer interface control model, thereby optimizing the use of nested multi-layer interface mirroring.

5. The system according to claim 4, characterized in that, The multi-layer interface control model also includes a dual-link interface device, an HDMI cable, and an office box; the multi-layer interface control model construction module includes: An office box configuration unit is used to distribute the signal source in different local area networks and configure one office box for each local area network; The image aggregation unit is used to aggregate image data generated by multiple signal sources based on the office box; The image transmission unit is used to transmit the aggregated image data to the dual-link interface machine via an HDMI cable; A control instruction generation unit is used for the dual-link interface device to configure the received screen data to the control terminal; the control terminal generates control instructions based on the screen data; wherein the control instructions are the touch data; The signal source control unit is used to transmit the control commands to the signal source based on the dual-link interface machine and the office box, thereby controlling the signal source and completing the construction of a multi-layer interface control model.

6. The system according to claim 4, characterized in that, The touch data processing module includes: A touch data generation unit is used to collect touch data generated when the touch control terminal screen is touched; wherein, the touch data includes the coordinates of the current touch point and the event time of the current touch; An initial event type determination unit is used to analyze the touch data and determine the initial event type of the touch data; the initial event type includes pressing, moving, and releasing; The calculation unit is used to compare the coordinates of the current press event and the previous press event and calculate the time difference between the two press events when the initial event type is press. The final event type determination unit is used to determine the current press event as a double-click event if the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range; and to determine the current press event as a single-click event if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range.

Images