Method and system for optimizing multi-layer interface mirror image nesting use

Abstract

The invention provides a method and system for optimizing multi-layer interface mirror image nesting usage, and the method comprises the steps: building a multi-layer interface control model based on a signal source which generates a picture and a control end which is used for checking and controlling the picture of the signal source; collecting and processing touch data generated when the screen of the control end is touched, and obtaining an event type of the touch data; wherein the event type comprises a single-click event and a double-click event; and based on the event type of the touch data and the multi-layer interface control model, controlling a signal source, and completing optimization of mirror image nesting use of the multi-layer interface. According to the technical scheme, whether the sending end executes the double-click operation or the single-click operation can be accurately distinguished under the Android devices with different screen densities, the corresponding event data are sent to the controlled end, it is ensured that the controlled end responds according to the corresponding event data, and therefore the experience of multi-layer interface mirror image nesting use is optimized.

Description

Technical Field

[0001] The present invention belongs to the field of computer technology, and in particular relates to a method and system for optimizing the nested use of multi-layer interface mirroring. Background Art

[0002] When the Android end controls the controlled end signal source that supports the driver-free protocol (for example, the common Windows system supports the driver-free protocol), the protocol can receive and respond to touch data, mouse data and keyboard data. When responding to a click event, what needs to be received is touch data or mouse data; because Android devices are all touch-operated, what is obtained is touch data. If the mouse data is to be sent to the controlled end at this time, the touch data needs to be converted according to the mouse data format of the driver-free protocol and then sent to the controlled end after conversion. When the controlled end signal source area on the Android end's screen is clicked twice in a short period of time (because the Android end is a touch operation, when you quickly click the same position area twice with your finger, the positions of the two clicks are basically impossible to be on the same point coordinates, and there will be an error), it represents a double-click, and the event data of the two clicks are sent to the controlled end for response. If the distance between the two clicks exceeds a certain range, the controlled end will not respond as a double-click event, but will respond as two independent click events; for example, double-clicking on the "My Computer" icon is intended to open "My Computer" by double-clicking, but the result is that the cursor selects "My Computer".

[0003] In the prior art, the Android end does not intervene when sending, and executes the sending after converting into the mouse data format. If the distance between the pressing points of the two clicks falls within the range where the Windows system can respond to double-click events, it will respond as a double-click event. However, if the distance between the pressing points of the two clicks exceeds the range where the Windows system can respond to double-click events, it will be responded to as two independent click events. At this time, there will be a phenomenon that is inconsistent with our expected purpose, which reduces the user experience of multi-layer interface mirroring and nesting. Summary of the invention

[0004] In order to solve the problems existing in the prior art, the present invention provides a method and system for optimizing the nested use of multi-layer interface mirroring, thereby avoiding or reducing the phenomenon that when sending double-click event data, the controlled end responds to two independent click events.

[0005] To achieve the above object, the present invention provides the following solutions:

[0006] A method for optimizing nested use of multi-layer interface mirroring, the method comprising:

[0007] Based on the signal source that generates the image and the control terminal for viewing and controlling the signal source image, a multi-layer interface control model is constructed;

[0008] Collecting and processing touch data generated when touching the control terminal screen, and obtaining event types of the touch data; wherein the event types include single-click events and double-click events;

[0009] Based on the event type of the touch data and the multi-layer interface control model, the signal source is controlled to optimize the nested use of multi-layer interface mirroring.

[0010] Preferably, the multi-layer interface control model further includes a dual-link interface machine, an HDMI cable, and an office box; and the method for constructing the multi-layer interface control model includes:

[0011] Distribute the signal sources in different local area networks, and configure an office box for each local area network;

[0012] Based on the office box, the image data generated by multiple signal sources are gathered;

[0013] Transmitting the aggregated image data to the dual-link interface machine via an HDMI cable;

[0014] The dual-link interface machine configures the received picture data to the control terminal;

[0015] The control terminal generates a control instruction based on the screen data; wherein the control instruction is the touch data;

[0016] Based on the dual-link interface machine and the office box, the control instruction is transmitted to the signal source to realize the control of the signal source and complete the construction of the multi-layer interface control model.

[0017] Preferably, the method for obtaining the event type of touch data includes:

[0018] Collecting touch data generated when touching the control terminal screen; wherein the touch data includes the coordinates of the current touch point and the event time of the current touch;

[0019] Analyze the touch data to determine the initial event type of the touch data; the initial event type includes pressing, moving, and lifting;

[0020] When the initial event type is press, coordinate comparison is performed between the current press event and the last press event, and the time difference between the two press events is calculated;

[0021] If the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range, the current press event is a double-click event; if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range, the current press event is a single-machine event.

[0022] Preferably, the method for comparing the coordinates of the current press event and the last press event includes:

[0023] Calculate the diagonal of the control terminal screen based on the height of the control terminal screen, the screen xdpi and the screen ydpi;

[0024] Based on the diagonal, width and height of the control terminal screen, obtain the dots per inch of the control terminal screen;

[0025] Based on the dots per inch of the control terminal screen, the screen density coefficient is obtained;

[0026] Based on the screen density coefficient and the preset basic tolerance value, a final tolerance value is obtained;

[0027] Based on the final fault tolerance value and the coordinate point of the last press event, a square area is selected on the control end screen, and it is determined whether the coordinate point of the current press event is within the selected square area to obtain a coordinate comparison result.

[0028] Preferably, the method for selecting a square area includes: taking the coordinate point of the last press event as the center point of the square area, taking the final tolerance value as the distance from the center point to the four right-angle vertices of the square area, and selecting the square area.

[0029] The present invention also provides a system for optimizing the nested use of multi-layer interface mirrors, which is used to implement the method, and includes:

[0030] A multi-layer interface control model building module, used to build a multi-layer interface control model based on a signal source that generates a picture and a control terminal that is used to view and control the signal source picture;

[0031] A touch data processing module, used to collect and process touch data generated when touching the control terminal screen, and obtain the event type of the touch data; wherein the event type includes a single-click event and a double-click event;

[0032] The signal source control module is used to control the signal source based on the event type of the touch data and the multi-layer interface control model to optimize the nested use of multi-layer interface mirroring.

[0033] Preferably, the multi-layer interface control model further includes a dual-link interface machine, an HDMI cable and an office box; the multi-layer interface control model construction module includes:

[0034] An office box configuration unit, used to distribute the signal sources in different local area networks and configure an office box for each local area network;

[0035] A picture aggregation unit, used for aggregating picture data generated by multiple signal sources based on the office box;

[0036] A picture transmission unit, used to transmit the aggregated picture data to the dual-link interface machine via an HDMI cable;

[0037] A control instruction generating unit, used for the dual-link interface machine to configure the received screen data to the control end; the control end generates a control instruction based on the screen data; wherein the control instruction is the touch data;

[0038] The signal source control unit is used to transmit the control instruction to the signal source based on the dual-link interface machine and the office box, realize the control of the signal source, and complete the construction of the multi-layer interface control model.

[0039] Preferably, the touch data processing module includes:

[0040] A touch data generating unit, used to collect touch data generated when the control terminal screen is touched; wherein the touch data includes the coordinates of the current touch point and the event time of the current touch;

[0041] An initial event type determination unit, used for analyzing the touch data to determine the initial event type of the touch data; the initial event type includes press, move and lift;

[0042] A calculation unit, for, when the initial event type is a press, performing a coordinate comparison between a current press event and a previous press event and calculating a time difference between the two press events;

[0043] The final event type determination unit is used to determine that if the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range, the current press event is a double-click event; if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range, the current press event is a single-machine event.

[0044] Compared with the prior art, the beneficial effects of the present invention are as follows: the present invention can accurately distinguish whether the sending end is to perform a double-click operation or a single-click operation under Android devices with different screen densities, and send the corresponding event data to the controlled end, ensuring that the controlled end responds according to the corresponding event data, and optimizing the nested use of multi-layer interface mirrors. By controlling the office box to switch the signal source displayed on the office box, the control end can view and use the signal source without accessing the network where the signal source is located. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solution of the present invention, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0046] Figure 1 A flow chart of a method for optimizing the nested use of multi-layer interface mirroring according to an embodiment of the present invention;

[0047] Figure 2 A schematic diagram of the structure of a multi-layer interface control model according to an embodiment of the present invention;

[0048] Figure 3 A flow chart of determining the type of a touch data event according to an embodiment of the present invention;

[0049] Figure 4 A schematic diagram of selecting a square area according to an embodiment of the present invention. DETAILED DESCRIPTION

[0050] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0051] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0052] The nouns appearing in the embodiments of the present invention are explained as follows:

[0053] Multi-layer interface mirroring means that multiple interfaces are nested in one interface, and these nested interfaces can also be used as containers to further nest other interfaces. This structure forms a multi-level, multi-dimensional interface system, allowing users to access and operate multiple different functions or data sets in a unified interface.

[0054] To optimize the experience of using nested multi-layer interface images, the following strategies can usually be adopted:

[0055] Provide clear hierarchical navigation and interface element identification so that users can quickly locate and operate.

[0056] Supports multi-finger touch and gesture operations to improve operational efficiency and convenience.

[0057] Optimize touch response speed and interface update speed to reduce user waiting time.

[0058] Provide customized interface layout and theme functions to meet the personalized needs of different users.

[0059] HDMI cable, the full name of which is High Definition Multimedia Interface, is a digital transmission interface cable used to connect high-definition display devices and high-definition signal source devices. The working principle of HDMI cable is mainly based on TMDS (Time Minimized Differential Signal) technology, which is the minimized transmission differential signal technology. This technology transmits information through the voltage difference between two pins, and the data value ("0" or "1") is determined by the positive and negative voltage and the size between the two pins. At the transmitting end, the data is processed by the TMDS encoder, converted into a TMDS signal, and serialized for output. At the receiving end, the received serial HDMI signal is restored to the original data after signal recovery and TMDS decoder processing. This process ensures the accurate transmission of data.

[0060] Embodiment 1

[0061] Since the Android terminal is a touch operation, when you quickly click twice on the same position area with your finger, in fact, the positions of the two clicks basically cannot be on the same point coordinates, and there will be an error. The present invention processes the touch data and is based on the preset coordinate range and time range, so that as long as two clicks are generated within a certain time and in the set area, they will be sent as double-click events.

[0062] like Figure 1 As shown, a method for optimizing the nested use of multi-layer interface mirroring includes:

[0063] S1: constructing a multi-layer interface control model based on a signal source for generating a picture and a control terminal for viewing and controlling the signal source picture; a further implementation method is that the multi-layer interface control model also includes a dual-link interface machine, an HDMI cable and an office box;

[0064] like Figure 2 As shown, the method for constructing a multi-layer interface control model includes:

[0065] Distribute the signal sources in different LANs and configure an office box for each LAN;

[0066] Based on the office box, it gathers the image data generated by multiple signal sources;

[0067] The aggregated image data is transmitted to the dual-link interface machine via the HDMI cable;

[0068] The dual-link interface machine configures the received picture data to the control terminal;

[0069] The control terminal generates a control instruction based on the screen data; wherein the control instruction is touch data;

[0070] Based on the dual-link interface machine and the office box, the control instructions are transmitted to the signal source to realize the control of the signal source and complete the construction of the multi-layer interface control model.

[0071] Specifically, the signal sources are distributed in two (or more) networks, and an interface machine / office box is placed in each network to aggregate multiple signal sources in the network and output them to the dual-link interface machine through HDMI. The signal source specifically includes several signal sources and corresponding acquisition boxes.

[0072] The dual-link interface machine reports the screen data to the background system, and configures the corresponding screen data to a pad account. The pad (control end) plays the screen transmitted by the dual-link interface machine, so as to view the screen of the interface machine / office box and the screen of the signal source in each network;

[0073] When controlling, control command data is sent to the dual-link interface machine, and after receiving it, the dual-link interface machine sends it to the interface machine / office box through the HDMI control line to control the interface machine / office box. The interface machine / office box converts and forwards the control information to the target signal source to control the signal source.

[0074] By controlling the interface machine / office box, the signal source displayed on the interface machine / office box can be switched, so that the signal source can be viewed and used without the pad being connected to the network where the signal source is located.

[0075] The dual-link interface machine includes two layers of links and a display analysis module, the first layer of links includes a first unidirectional link, and the second layer of links includes a second unidirectional link and a third unidirectional link.

[0076] A virtual interface is stored and set in advance as the virtual interface to be operated, and in response to an input, the data corresponding to the virtual interface to be operated is output to the display analysis module through the first unidirectional link, and the display analysis module analyzes the screen data gathered by the office box and outputs the analysis result to the control end; receiving and analyzing user input, and determining the control command for controlling the virtual interface and the control instruction for controlling the signal source corresponding to the input according to the pre-stored correspondence between the input and the control command; according to the control instruction for controlling the virtual interface, the virtual interface is controlled to respond, and the data as the virtual interface response result is output through the first unidirectional link; according to the control instruction for controlling the signal source, the signal source is controlled to respond through the second unidirectional link; the signal source response result is output through the third unidirectional link; the data output through the first unidirectional link is analyzed, and the analysis result and the signal source response result output through the third unidirectional link are merged, and the fusion result is output to the control end.

[0077] S2: Collect and process the touch data generated when touching the control terminal screen, and obtain the event type of the touch data; wherein the event type includes a single-click event and a double-click event. Figure 3 shown.

[0078] A further implementation method is that the method for obtaining the event type of touch data includes:

[0079] S21: Collecting touch data generated when touching the control end screen; wherein the touch data includes the coordinates of the current touch point and the event time of the current touch; specifically, when the control end screen is touched, touch data will be generated, and these touch data will be given to the developer through the system's onTouchEvent (MotionEvent event) function.

[0080] S22: Analyze the touch data and determine the initial event type of the touch data; the initial event types include press, move, and lift; specifically, the MotionEvent object contains touch data information, which is used to obtain the x, y coordinates of the current touch point (getX(), getY()), the current touch event type (press, move, lift; getAction()), and the current touch event time (getEventTime()).

[0081] When a finger touches the screen, multiple touch data will be generated, including press, move (the system may not feedback move event data when you touch the screen quickly and lift it immediately), and lift. A complete touch data must include press and lift events.

[0082] S23: When the initial event type is press, coordinate comparison is performed between the current press event and the last press event, and the time difference between the two press events is calculated.

[0083] When determining the coordinate range, the tolerance value and the screen density factor are used.

[0084] Devices with different screen densities determine the final result of the tolerance value. To determine the screen density, you need to first calculate the device's dpi (dots per inch) range. Calculating dpi requires using values ​​such as screen width, screen height, screen xdpi, and screen ydpi. All of the above values ​​can be obtained through the API provided by the Android system.

[0085] Specifically, a further implementation method is that the method for comparing the coordinates of the current press event and the last press event includes:

[0086] Based on the height of the control terminal screen, the screen xdpi and the screen ydpi, the control terminal screen diagonal is calculated; specifically, the screen diagonal is calculated in inches (in). The width is divided by xdpi and the height is divided by ydpi in the formula to convert pixel units (px) to inch units (in).

[0087]

[0088] Based on the diagonal, width, and height of the control terminal screen, obtain the dots per inch of the control terminal screen; specifically, calculate the dpi range of the device:

[0089] Unit: Dots per inch

[0090] Based on the dots per inch of the control end screen, the screen density coefficient is obtained; specifically, according to the dpi interval reference table provided by Android, the screen density coefficient can be obtained. (The interval is backward compatible, such as the result of the above formula is 200dpi, less than 240dpi and greater than 160dpi, the final value interval is 160dpi, that is, the screen density coefficient is 1.0). See Table 1.

[0091] Table 1

[0092] Unit: Dots in inches (dpi) Screen Category Catalog Screen density factor 120dpi ldpi 0.75 160dpi mdpi 1.0 240dpi hdpi 1.5 320dpi xhdpi 2.0 480dpi xxhdpi 3.0 640dpi xxxhdpi 4.0

[0093] Based on the screen density coefficient and the preset basic tolerance value, the final tolerance value is obtained; specifically, the final tolerance value is calculated in pixels (px):

[0094] Tolerance value = screen density factor × basic tolerance value

[0095] For example:

[0096] When the screen density factor is 1.5

[0097] Tolerance value = 1.5 (screen density factor) x 30 (basic tolerance value) = 45 pixels

[0098] When the screen density factor is 3.0

[0099] Tolerance value = 3.0 (screen density factor) x 30 (basic tolerance value) = 90 pixels

[0100] After obtaining the final fault tolerance value, it is possible to determine whether it is a double-click event. At the same time, the event time difference between the current press event data and the last press event data must also be considered.

[0101] Based on the final tolerance value and the coordinate point of the last press event, a square area is selected on the control end screen, and it is determined whether the coordinate point of the current press event is within the selected square area to obtain a coordinate comparison result. A further implementation method is that the method for selecting the square area includes: using the coordinate point of the last press event as the center point of the square area, using the final tolerance value as the distance from the center point to the four right-angle vertices of the square area, and selecting the square area.

[0102] In this embodiment, the tolerance value is set to 30, which is a basic tolerance value (note: the screen density coefficient is not involved here, and the actual screen density coefficient is different, and the tolerance value will change accordingly), unit pixel (px), this value is used to select a square area, the center point of the area is the x, y coordinate point of the last press event data, and the distance from the center coordinate point to the right angle of the four sides of the square is the tolerance value of 30px. This value is the verification result that sending a double-click event to the controlled end can be 100% correctly triggered and responded to under various Android devices with different screen densities (it is an empirical value, and it has been tested and verified to be feasible many times).

[0103] For example: Figure 4 As shown, the x,y coordinates of the last press event data are (60,60), in pixels. At this time, based on this coordinate as the center point of the square, the coordinates of the left vertex, right vertex, left bottom point, and right bottom point of the selected square in the coordinate system are (30,30), (90,30), (30,90), and (90,90), respectively. The final tolerance value is 30px, so the corresponding coordinate range is (60-30=30 to 60+30=90) on the x-axis and (60-30=30 to 60+30=90) on the y-axis. The x,y coordinates of this press event are (75,75), with the x coordinate 75 within the x-axis range of 30-90 and the y coordinate 75 within the y-axis range of 30-90. So far, the coordinate range has met the conditions.

[0104] S24: If the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range, the current press event is a double-click event; if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range, the current press event is a single-machine event.

[0105] Specifically, the data of each touch event contains the event time of the corresponding event, which can be obtained through the getEventTime() function in the MotionEvent object. The event time of this press event minus the event time of the last press event will have a time difference. It is judged whether the time difference is within the set interval range. If it is within the set interval range (and combined with the above-mentioned coordinate range), it represents a double-click action; if it is outside the set interval range, it represents a single-click action.

[0106] 1. The time difference is set to 300, in milliseconds (ms), that is, the event time of this press event minus the event time of the last press event is greater than 300ms, which represents a click action; less than or equal to 300ms, represents a double-click action. This value (300ms) is the value defined by the Android system to represent the double-click response, which is obtained through the getDoubleTapTimeout() function in the ViewConfiguration object; some Android devices can modify the double-click response interval (short, medium, standard, long) through system settings. The specific interval values ​​defined by different Android device manufacturers are different, but the standard is 300ms, so the time difference set in this embodiment is also 300ms. We use this standard time difference to test on a variety of Android device models, and send double-click events to the controlled end within this time difference range. The controlled end can accurately respond to the double-click operation (highlighting that it is obtained by the system and tested and verified multiple times, so this value is set). For example, if the last press event time is 3415013770ms, and the current press event time is 3415013900ms, the current press event time minus the last press event time (3415013900-3415013770=130) is 130, 130<300, which is within the set time difference range. So far, the time difference has met the condition.

[0107] In general, the controlled signal source that supports the driver-free protocol is controlled by an Android device. During control, the screen of the controlled signal source can be seen on the Android device, that is, the screen of the controlled signal source is played through the Android device. Based on the screen of the controlled signal source, the Android device is used to control the controlled signal source. When the user enables control, the screen of the Android device is touched, and the system will feed back the data generated by the user's touch to the program, so the source of the touch data is because the user touches the screen of the Android device. After obtaining the touch data generated during touch, the program analyzes the touch data. If the event type of the touch data is a press event, the touch data is handed over to the data processing module for analysis and processing; the final data to be sent is determined, and the data is recorded and stored after sending. Specifically, when the x,y coordinate point of the current press event data is within the square area with the x,y coordinate point of the last press event data as the center point, and the time difference is within the set time interval, it is a double-click event. At this time, the recorded and stored data of the last press event is also sent to the controlled signal source. If the coordinates are outside the area or the time difference exceeds the set range, it is a single click event, and the data of this click event will be sent to the controlled end signal source. The data sent to the controlled end signal source will be stored and provided for the next condition comparison.

[0108] S3: Based on the event type of touch data and the multi-layer interface control model, the signal source is controlled to optimize the nested use of multi-layer interface mirroring.

[0109] In summary, the present invention optimizes the nested use of multi-layer interface mirroring by optimizing touch response.

[0110] Embodiment 2

[0111] The present invention also provides a system for optimizing the nested use of multi-layer interface images, which is used to implement the method, including:

[0112] A multi-layer interface control model building module, used to build a multi-layer interface control model based on a signal source that generates a picture and a control terminal that is used to view and control the signal source picture;

[0113] A touch data processing module is used to collect and process the touch data generated when the control terminal screen is touched, and obtain the event type of the touch data; wherein the event type includes a single-click event and a double-click event;

[0114] The signal source control module is used to control the signal source based on the event type of touch data and the multi-layer interface control model, and optimize the nested use of multi-layer interface mirroring.

[0115] A further implementation method is that the multi-layer interface control model also includes a dual-link interface machine, an HDMI cable, and an office box; and the multi-layer interface control model construction module includes:

[0116] An office box configuration unit is used to distribute signal sources in different local area networks and configure an office box for each local area network;

[0117] The image aggregation unit is used to aggregate image data generated by multiple signal sources based on the office box;

[0118] A picture transmission unit, used for transmitting the aggregated picture data to a dual-link interface machine via an HDMI line;

[0119] A control instruction generating unit is used for the dual-link interface machine to configure the received screen data to the control end; the control end generates a control instruction based on the screen data; wherein the control instruction is touch data;

[0120] The signal source control unit is used to transmit control instructions to the signal source based on the dual-link interface machine and the office box, realize the control of the signal source, and complete the construction of the multi-layer interface control model.

[0121] In a further embodiment, the touch data processing module includes:

[0122] A touch data generating unit, used to collect touch data generated when the control terminal screen is touched; wherein the touch data includes the coordinates of the current touch point and the event time of the current touch;

[0123] An initial event type determination unit, used to analyze touch data and determine the initial event type of the touch data; the initial event types include press, move and lift;

[0124] A calculation unit, for comparing the coordinates of the current press event and the last press event and calculating the time difference between the two press events when the initial event type is press;

[0125] The final event type determination unit is used to determine that if the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range, the current press event is a double-click event; if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range, the current press event is a single-machine event.

[0126] The system also includes a data recording storage module for storing all control instructions sent to the signal source.

[0127] In summary, the embodiment of the present invention predicts the behavior of the controlling end when controlling the controlled end signal source through the Android device end. If the corresponding condition of double-clicking is met, it means that the Android device end wants to double-click the controlled end signal source, then the data sent by the Android device end must be processed accordingly to allow the controlled end signal source to accurately respond to the operating behavior of our controlling end.

[0128] The embodiments described above are only descriptions of the preferred embodiments of the present invention and are not intended to limit the scope of the present invention. Without departing from the design spirit of the present invention, various modifications and improvements made to the technical solutions of the present invention by ordinary technicians in this field should all fall within the protection scope determined by the claims of the present invention.

Claims

1. A method for optimizing the nested use of multi-layer interface images, characterized in that: The method comprises: Based on the signal source that generates the image and the control terminal for viewing and controlling the signal source image, a multi-layer interface control model is constructed; Collecting and processing touch data generated when touching the control terminal screen, and obtaining event types of the touch data; wherein the event types include single-click events and double-click events; Based on the event type of the touch data and the multi-layer interface control model, the signal source is controlled to optimize the nested use of multi-layer interface mirroring.

2. The method according to claim 1, characterized in that The multi-layer interface control model also includes a dual-link interface machine, an HDMI cable, and an office box; the method for constructing the multi-layer interface control model includes: Distribute the signal sources in different local area networks, and configure an office box for each local area network; Based on the office box, the image data generated by multiple signal sources are gathered; Transmitting the aggregated image data to the dual-link interface machine via an HDMI cable; The dual-link interface machine configures the received picture data to the control terminal; The control terminal generates a control instruction based on the screen data; wherein the control instruction is the touch data; Based on the dual-link interface machine and the office box, the control instruction is transmitted to the signal source to realize the control of the signal source and complete the construction of the multi-layer interface control model.

3. The method according to claim 1, characterized in that Methods for obtaining touch data event types include: Collecting touch data generated when touching the control terminal screen; wherein the touch data includes the coordinates of the current touch point and the event time of the current touch; Analyze the touch data to determine the initial event type of the touch data; the initial event type includes pressing, moving, and lifting; When the initial event type is press, coordinate comparison is performed between the current press event and the last press event, and the time difference between the two press events is calculated; If the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range, the current press event is a double-click event; if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range, the current press event is a single-machine event.

4. The method according to claim 1, characterized in that: The methods for comparing the coordinates of the current press event and the last press event include: Calculate the diagonal of the control terminal screen based on the height of the control terminal screen, the screen xdpi and the screen ydpi; Based on the diagonal, width and height of the control terminal screen, obtain the dots per inch of the control terminal screen; Based on the dots per inch of the control terminal screen, the screen density coefficient is obtained; Based on the screen density coefficient and the preset basic tolerance value, a final tolerance value is obtained; Based on the final fault tolerance value and the coordinate point of the last press event, a square area is selected on the control end screen, and it is determined whether the coordinate point of the current press event is within the selected square area to obtain a coordinate comparison result.

5. The method according to claim 2, characterized in that: The method for selecting a square area includes: taking the coordinate point of the last press event as the center point of the square area, taking the final tolerance value as the distance from the center point to the four right-angle vertices of the square area, and selecting the square area.

6. A system for optimizing the nested use of multi-layer interface images, used to implement the method described in any one of claims 1 to 5, characterized in that: include: A multi-layer interface control model building module, used to build a multi-layer interface control model based on a signal source that generates a picture and a control terminal that is used to view and control the signal source picture; A touch data processing module, used to collect and process touch data generated when touching the control terminal screen, and obtain the event type of the touch data; wherein the event type includes a single-click event and a double-click event; The signal source control module is used to control the signal source based on the event type of the touch data and the multi-layer interface control model to optimize the nested use of multi-layer interface mirroring.

7. The system according to claim 6, characterized in that The multi-layer interface control model also includes a dual-link interface machine, an HDMI cable and an office box; the multi-layer interface control model construction module includes: An office box configuration unit, used to distribute the signal sources in different local area networks and configure an office box for each local area network; A picture aggregation unit, used to aggregate picture data generated by multiple signal sources based on the office box; A picture transmission unit, used to transmit the aggregated picture data to the dual-link interface machine via an HDMI cable; A control instruction generating unit, used for the dual-link interface machine to configure the received screen data to the control end; the control end generates a control instruction based on the screen data; wherein the control instruction is the touch data; The signal source control unit is used to transmit the control instruction to the signal source based on the dual-link interface machine and the office box, realize the control of the signal source, and complete the construction of the multi-layer interface control model.

8. The system according to claim 6, characterized in that The touch data processing module includes: A touch data generating unit, used to collect touch data generated when the control terminal screen is touched; wherein the touch data includes the coordinates of the current touch point and the event time of the current touch; An initial event type determination unit, used for analyzing the touch data to determine the initial event type of the touch data; the initial event type includes press, move and lift; A calculation unit, for, when the initial event type is a press, performing coordinate comparison between a current press event and a previous press event and calculating a time difference between the two press events; The final event type determination unit is used to determine that if the coordinate comparison result meets the preset requirements and the time difference meets the preset time interval range, the current press event is a double-click event; if the coordinate comparison result does not meet the preset requirements or the time difference does not meet the preset time interval range, the current press event is a single-machine event.

Images