Intelligent tablet control method, device and equipment and storage medium

Abstract

The embodiment of the invention discloses an intelligent tablet control method and device, equipment and a storage medium. The intelligent tablet control method provided by the embodiment of the invention is applied to the mobile terminal, and specifically comprises the following steps: identifying a control two-dimensional code displayed on an intelligent tablet to obtain first connection information of the intelligent tablet; generating second connection information according to the first connection information and self identity information; the second connection information is sent to the server, so that the server verifies the second connection information, and if the verification is passed, communication connection between the mobile terminal and the intelligent tablet computer is established; based on the communication connection, responding to the virtual control trigger instruction, and performing interaction control of a virtual mouse and / or a virtual keyboard on the intelligent tablet; performing interaction control on the intelligent tablet based on the communication connection; the problem of poor user experience of intelligent tablet interaction can be solved, remote interaction control is realized, the flexibility of intelligent tablet interaction control is improved, and the user experience is improved.

Description

Technical Field

[0001] This application relates to the field of intelligent interactive technology, and in particular to an intelligent flat panel control method, device, equipment and storage medium. Background Technology

[0002] With the rapid advancement of technology, electronic devices are becoming increasingly ubiquitous and have become an important part of people's daily lives. Among them, smart tablets, as versatile electronic devices, are widely used in various scenarios such as learning, working, and entertainment.

[0003] When interacting with existing smart tablets, users need to walk in front of the tablet and use their fingers to control it. When the smart tablet is far away or hung in a high position, it is difficult for users to interact with it, which affects the user experience. Summary of the Invention

[0004] This application provides a smart tablet control method, device, equipment, and storage medium, which can solve the problem of poor user experience in smart tablet interaction, realize remote interactive control, improve the flexibility of smart tablet interactive control, and enhance the user experience.

[0005] In a first aspect, embodiments of this application provide a smart tablet control method for a mobile terminal, the smart tablet control method comprising:

[0006] Identify the control QR code displayed on the smart tablet to obtain the first connection information of the smart tablet;

[0007] Generate second connection information based on the first connection information and your own identity information;

[0008] The second connection information is sent to the server so that the server can verify the second connection information. If the verification is successful, a communication connection is established between the mobile terminal and the smart tablet.

[0009] Based on the communication connection, and in response to virtual control trigger commands, the smart tablet can perform interactive control using a virtual mouse and / or virtual keyboard.

[0010] In one embodiment, based on a communication connection, in response to a virtual control trigger command, interactive control of the smart tablet using a virtual mouse and / or virtual keyboard includes:

[0011] Based on the communication connection, in response to the virtual control trigger command, a first virtual cursor is displayed in the interactive interface, and the first virtual cursor corresponds to the second virtual cursor displayed on the smart tablet.

[0012] Monitor touch events, and when a touch event is detected, obtain the relative displacement information of the touch movement;

[0013] The first virtual cursor is moved based on the relative displacement information, and the relative displacement information is sent to the smart tablet so that the smart tablet can move the second virtual cursor based on the relative displacement information.

[0014] As described above, the smart tablet is controlled via a mobile terminal's interface using a first virtual cursor, enabling virtual mouse interaction. This eliminates the need for close contact with the smart tablet or a wired mouse connection, allowing users to control the tablet virtually from their mobile devices. This improves the flexibility of smart tablet interaction and enhances the user experience. Furthermore, by controlling the movement of the first and second virtual cursors using relative displacement information, this embodiment significantly reduces the data transmission volume compared to existing real-time control methods based on movement trajectories. This reduction in data transmission volume improves the response speed of the second virtual cursor, further enhancing the user experience.

[0015] In one embodiment, after controlling the movement of the first virtual cursor based on relative displacement information, the process includes:

[0016] Get the current position of the first virtual cursor in the interactive interface, which includes a first target area and a second target area;

[0017] When the current position is within the first target area, continue to control the movement of the first virtual cursor based on the relative displacement information;

[0018] A virtual keyboard pops up when the current location is within the second target area.

[0019] As described above, through the mobile terminal's interactive interface, virtual mouse interaction control is achieved on the smart tablet based on the first target area and the first virtual cursor. This eliminates the need for close contact with the smart tablet or a wired mouse connection to interact with it, allowing users to control the smart tablet virtually with their mobile devices. This improves the flexibility of smart tablet interaction control and enhances the user experience. Similarly, through the mobile terminal's interactive interface, virtual keyboard interaction control is achieved on the smart tablet based on the second target area and the virtual keyboard. This eliminates the need for close contact with the smart tablet or a wired keyboard connection to input text information. Users can control the smart tablet virtually with their mobile devices, improving the flexibility of smart tablet interaction control and enhancing the user experience.

[0020] In one embodiment, after continuing to control the movement of the first virtual cursor based on relative displacement information when the current position is within the first target area, the process includes:

[0021] Monitor the first click event, and when the first click event is detected, perform left and right mouse button interaction control based on the first click event.

[0022] As described above, the smart tablet is controlled by a virtual mouse through the mobile terminal's interface, based on the first target area and the first virtual cursor. This achieves the virtual mouse interaction function, avoiding the need for close contact with the smart tablet or a wired mouse connection to interact with it. Users can control the smart tablet with a virtual mouse using their mobile terminal, improving the flexibility of smart tablet interaction and thus enhancing the user experience.

[0023] In one embodiment, after the virtual keyboard pops up when the current location is within the second target area, the process includes:

[0024] Monitor the second click event. When the second click event is detected, determine the keyboard input information based on the second click event and the virtual keyboard. The second click event is a click event on the virtual keyboard.

[0025] Send keyboard input information to the smart tablet.

[0026] As described above, the smart tablet can be controlled via a virtual keyboard through the mobile terminal's interface, based on the second target area and the virtual keyboard. This eliminates the need for close contact with the smart tablet or a wired keyboard connection to input text information, allowing users to control the smart tablet via their mobile devices. This improves the flexibility of smart tablet control and enhances the user experience.

[0027] In a second aspect, embodiments of this application provide a smart tablet control method for a smart tablet, comprising:

[0028] Display control QR code, which includes the first connection information of the smart tablet;

[0029] A communication connection is established between the server and the mobile terminal. The communication connection is established after the server verifies the second connection information. The second connection information is generated by the first connection information and the identity information of the mobile terminal. The second connection information is sent from the mobile terminal to the server.

[0030] Based on the communication connection, it receives interactive control instructions from the corresponding mobile terminal's virtual mouse and / or virtual keyboard.

[0031] In a third aspect, embodiments of this application provide a smart tablet control method for a server, the smart tablet control method comprising:

[0032] Receive second connection information sent by the mobile terminal. The second connection information is generated from the first connection information and the identity information of the mobile terminal. The first connection information is generated by the corresponding smart tablet.

[0033] The second connection information is verified. If the verification is successful, a communication connection is established between the mobile terminal and the smart tablet. The mobile terminal is used to perform interactive control of the smart tablet using a virtual mouse and / or virtual keyboard based on the communication connection and in response to virtual control trigger commands.

[0034] In a fourth aspect, embodiments of this application provide a smart tablet control device for a mobile terminal, the smart tablet control device comprising:

[0035] The QR code scanning module is used to identify the control QR code displayed on the smart tablet and obtain the first connection information of the smart tablet.

[0036] The information integration module is used to generate second connection information based on the first connection information and its own identity information;

[0037] The communication connection module is used to send the second connection information to the server so that the server can verify the second connection information. If the verification is successful, a communication connection is established between the mobile terminal and the smart tablet.

[0038] The interactive control module is used to perform interactive control of the smart tablet using a virtual mouse and / or virtual keyboard in response to virtual control trigger commands based on the communication connection.

[0039] In a fifth aspect, embodiments of this application provide a smart flat panel control device, comprising:

[0040] Memory and one or more processors;

[0041] Memory, used to store one or more programs;

[0042] When one or more programs are executed by one or more processors, the one or more processors implement the smart panel control method as described in the first, second, or third aspect.

[0043] In a sixth aspect, embodiments of this application provide a storage medium for storing computer-executable instructions, which, when executed by a computer processor, are used to perform a smart tablet control method as described in the first, second, or third aspect.

[0044] This application embodiment obtains the first connection information of the smart tablet by recognizing the control QR code displayed on the smart tablet through a mobile terminal, and generates second connection information based on the first connection information and its own identity information. The second connection information is then sent to a server for verification. If the verification is successful, a communication connection is established between the mobile terminal and the smart tablet. Based on this communication connection, in response to a virtual trigger command, the smart tablet is interactively controlled using a virtual mouse and / or virtual keyboard. Using this technical means, interactive control of the smart tablet can be achieved simply by scanning the QR code with a mobile terminal. This avoids the poor user experience caused by the need for close-range or wired communication for interaction with the smart tablet, enabling remote interactive control of the smart tablet, improving the flexibility of interactive control, and enhancing the user experience. Furthermore, establishing a communication connection between the mobile terminal and the smart tablet only after successful verification determines the permissions of the mobile terminal acting as a virtual mouse and / or virtual keyboard, preventing unauthorized mobile terminals from connecting and affecting the normal operation of the smart tablet. This ensures the normal operation of the smart tablet under the interactive control of the virtual mouse and / or virtual keyboard, thereby improving the user experience. Attached Figure Description

[0045] Figure 1 This is a schematic diagram of an interactive scenario for a smart flat panel provided in an embodiment of this application;

[0046] Figure 2 This is a flowchart of a smart flat panel control method provided in an embodiment of this application;

[0047] Figure 3 This is a first schematic diagram of a virtual mouse and keyboard interaction interface provided in an embodiment of this application;

[0048] Figure 4 This is a schematic diagram of a first display of a smart flat panel provided in an embodiment of this application;

[0049] Figure 5 This is a second schematic diagram of a virtual mouse and keyboard interaction interface provided in an embodiment of this application;

[0050] Figure 6 This is a flowchart of another smart flat panel control method provided in the embodiments of this application;

[0051] Figure 7 This is a schematic diagram of a second display for a smart flat panel provided in an embodiment of this application;

[0052] Figure 8 This is a flowchart of another smart flat panel control method provided in the embodiments of this application;

[0053] Figure 9 This is a schematic diagram of the structure of an intelligent flat panel control device provided in an embodiment of this application;

[0054] Figure 10 This is a schematic diagram of another intelligent flat panel control device provided in the embodiments of this application;

[0055] Figure 11 This is a schematic diagram of another intelligent flat panel control device provided in the embodiments of this application;

[0056] Figure 12 This is a schematic diagram of the structure of an intelligent flat panel control device provided in an embodiment of this application. Detailed Implementation

[0057] To make the objectives, technical solutions, and advantages of this application clearer, specific embodiments of this application will be described in further detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely for explaining this application and not for limiting it. It should also be noted that, for ease of description, only the parts relevant to this application are shown in the drawings, not all of them. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe operations (or steps) as sequential processes, many of these operations can be performed in parallel, concurrently, or simultaneously. Furthermore, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but may also have additional steps not included in the drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0058] When interacting with existing smart tablets, users need to walk in front of the tablet and use their fingers to control it. When the smart tablet is far away or hung in a high position, it is difficult for users to interact with it, which affects the user experience.

[0059] Existing smart tablet interactions also allow for control via an external keyboard and mouse. However, due to the limited length of the connection cable between the keyboard / mouse and the smart tablet, users cannot use the keyboard and mouse for control when they are far from the tablet. Furthermore, users generally do not carry a keyboard and mouse with them, resulting in limited operational flexibility.

[0060] Existing smart tablets can also be controlled remotely via a laptop, but this remote control involves video streaming, which is costly. In general, users don't carry laptops with them, resulting in limited operational flexibility.

[0061] Existing mice and keyboards typically connect wirelessly via Bluetooth or Wi-Fi. However, Bluetooth and Wi-Fi have range limitations; connections will disconnect when outside the designated range, impacting the user experience. Furthermore, existing mice and keyboards using Bluetooth or Wi-Fi do not require authentication; they can directly connect and control the smart tablet. If unauthorized users connect in this way, it can disrupt the normal operation of the smart tablet, resulting in a poor user experience.

[0062] Based on this, the smart tablet control method, apparatus, device, and storage medium provided in this application embodiment enable interactive control of the smart tablet by scanning a code with a mobile terminal. This avoids the problem of poor user experience in smart tablet interaction. Even if the user is far away from the smart tablet, corresponding interactive control can still be achieved. Moreover, mobile terminals are generally portable. When interactive control of the smart tablet is needed, remote interactive control of the smart tablet can be achieved by scanning a code with the user's portable mobile terminal. Compared with existing methods that require physical contact with the smart tablet for interactive control, control based on wired mouse and keyboard connections, or remote control based on laptops that are inconvenient to carry, this embodiment enables interactive control of the smart tablet by scanning a code with a portable mobile terminal, which greatly improves the operational flexibility of smart tablet interactive control and thus enhances the user experience. Furthermore, unlike existing Bluetooth or WiFi connections that do not require authentication, this embodiment uses a server for permission management and verifies the second connection information. Only after successful verification is a communication connection established between the mobile terminal and the smart tablet. This can determine the permissions of the mobile terminal acting as a virtual mouse and / or virtual keyboard, preventing unauthorized mobile terminals from connecting and affecting the normal operation of the smart tablet. This ensures the normal operation of the smart tablet under the interactive control of the virtual mouse and / or virtual keyboard, thereby improving the user experience.

[0063] Figure 1 This is a schematic diagram of an interactive scenario for a smart flat panel provided in an embodiment of this application, with reference to... Figure 1The smart tablet interaction scenario provided in this application embodiment includes a mobile terminal 10, a smart tablet 20, and a server 30. The mobile terminal 10 can be understood as a mobile communication terminal, such as a smartphone or tablet computer. The smart tablet 20 can control the content displayed on the tablet (LCD, LED, or PDP) using touch technology, realizing an integrated electronic device for human-computer interaction. The smart tablet 20 integrates multiple functions such as a projector, electronic whiteboard, screen, audio system, television, and video conferencing terminal, and is widely used in various scenarios such as learning, office work, and entertainment. The server 30 can be understood as the cloud, a server service based on cloud computing technology, providing simple, efficient, secure, reliable, and elastically scalable computing services. The mobile terminal 10 can communicate with the server 30 and can also perform image recognition on the smart tablet 20. The server 30 can establish a control communication channel between the mobile terminal 10 and the corresponding smart tablet 20 based on corresponding connection information. Subsequently, the mobile terminal 10 can establish a corresponding communication connection with the smart tablet 20 based on the control communication channel established by the server 30 to achieve interactive control of the smart tablet 20. Server 30 is also used to verify the identity information of mobile terminal 10. Only after successful identity verification is the control communication channel established. As described above, the interaction and control of smart tablet 20 are achieved through the cooperation of mobile terminal 10, smart tablet 20, and server 30. Server 30 coordinates the communication between mobile terminal 10 and smart tablet 20 and is responsible for monitoring control permissions, playing a centralized control role. Compared to related technologies where no identity verification is required and any mobile terminal 10 can directly communicate and control smart tablet 20, the server 30's monitoring of the mobile terminal 10's permissions in this embodiment ensures that a control communication channel with smart tablet 20 is established only after successful identity verification. This guarantees the legitimate rights and interests of authorized users of smart tablet 20 and prevents unauthorized users from arbitrarily controlling smart tablet 20, thereby improving the user experience.

[0064] Figure 2 A flowchart of a smart tablet control method provided in this application embodiment is given. The smart tablet control method provided in this embodiment can be executed by a smart tablet control device, which can be implemented by software and / or hardware. The smart tablet control device can consist of two or more physical entities, or it can consist of a single physical entity. Generally, the smart tablet control device can be an electronic device, such as an interactive whiteboard, tablet computer, smart TV, learning machine, or mobile phone.

[0065] The following description uses an electronic device as the main body for implementing the smart tablet control method. (Refer to...) Figure 2This smart tablet control method is used for mobile terminals, and specifically includes:

[0066] S101. Identify the control QR code displayed on the smart tablet to obtain the first connection information of the smart tablet.

[0067] Mobile terminals can be understood as portable communication terminals, such as smartphones and tablets. Mobile terminals can scan and identify QR codes using corresponding apps or "mini-programs" within applications. A corresponding control QR code will be displayed on the smart tablet. This control QR code includes the smart tablet's initial connection information, which can be used for subsequent communication connections. The smart tablet can display the corresponding control QR code continuously, or it can be displayed only when there is an interactive control need, or it can display the corresponding control QR code at preset time intervals. Mobile terminals can identify the control QR code displayed on the smart tablet using the corresponding app or "mini-program" function to obtain the smart tablet's initial connection information.

[0068] As described above, when users need to interact with and control the smart tablet, they can scan the control QR code displayed on the smart tablet using their mobile terminal. Subsequent steps then establish the corresponding communication connection and enable interactive control. This provides a way to interactively control the smart tablet based on a mobile terminal, avoiding the lack of flexibility caused by requiring close proximity or a wired communication connection for interaction, thus greatly improving the flexibility of smart tablet interactive control. When the smart tablet is located at a high or distant position, users can simply scan the QR code with their nearby mobile terminal to interact and control it, overcoming the limitations of height and distance, thereby enhancing the user experience.

[0069] S102. Generate second connection information based on the first connection information and its own identity information.

[0070] To ensure that only mobile terminals of users with corresponding management permissions can interact with and control the smart tablet in this embodiment, second connection information needs to be generated based on the first connection information obtained by recognizing the control QR code and the user's own identity information. When a communication connection is requested to be established based on the second connection information, the user's permissions can be verified based on the identity information in the second connection information. This can prevent unauthorized users from scanning the code and interacting with and controlling the smart tablet, thus affecting the normal operation of the smart tablet and improving the reliability of interactive control.

[0071] S103. Send the second connection information to the server so that the server can verify the second connection information. If the verification is successful, a communication connection is established between the mobile terminal and the smart tablet.

[0072] After generating second connection information based on the first connection information from the smart tablet and its own identity information, the mobile terminal sends the second connection information to the server for verification. If the verification is successful, a communication connection is established between the mobile terminal and the smart tablet. During the establishment of the communication connection, the server can establish a control communication channel between the mobile terminal and the smart tablet based on the second connection information and feed back the channel information of the control communication channel to both the mobile terminal and the smart tablet. This allows the mobile terminal and the smart tablet to subsequently establish a communication connection through the control communication channel based on the channel information. For example, this control communication channel can be a P2P, PMP, or MQ communication channel.

[0073] After receiving the second connection information, the server verifies the identity information within it. If verification is successful, a control communication channel is established between the mobile terminal and the smart tablet based on the second connection information. Channel information for this control communication channel is generated and then fed back to both the mobile terminal and the smart tablet. For example, the server pre-stores the legitimate identity information of mobile terminals with management permissions. The server compares the identity information in the received second connection information with the pre-stored legitimate identity information. If the identity information in the second connection information matches the pre-stored legitimate identity information, it means the corresponding mobile terminal belongs to a user with management permissions, allowing interactive control of the smart tablet, and thus the control communication channel can be established. If the identity information in the second connection information does not match the pre-stored legitimate identity information, it means the corresponding mobile terminal does not belong to a user with management permissions, and interactive control of the smart tablet is not allowed. Therefore, the control communication channel is not established, preventing unauthorized users from scanning the code to control the smart tablet, improving the reliability and security of smart tablet control, preventing malicious damage to the smart tablet, and thus enhancing the user experience for users with management permissions.

[0074] In one embodiment, the identity information of the mobile terminal can be key information, which can be input by the user. The server verifies the identity information (i.e., key information) in the received second connection information. If the key verification passes, it means that the corresponding mobile terminal belongs to a user with management authority, allowing interactive control of the smart tablet, and thus a control communication channel can be established. If the key verification fails, it means that the corresponding mobile terminal does not belong to a user with management authority, and interactive control of the smart tablet is not allowed. Therefore, no control communication channel is established, preventing other users without management authority from scanning the code to control the smart tablet, improving the reliability and security of smart tablet control, preventing malicious damage to the smart tablet, and thus improving the user experience for users with management authority.

[0075] In one embodiment, the identity information of the mobile terminal can be an account password. The server pre-stores a mapping relationship between the account passwords and phone information of mobile terminals with management permissions. The server determines the corresponding phone information based on the account password information in the second connection information and sends a corresponding verification code based on the phone information. If the verification code is received from the mobile terminal, the verification is successful, indicating that the current user of the corresponding mobile terminal is a user with management permissions and is allowed to interact with and control the smart tablet. Therefore, a control communication channel can be established. If no verification code is received, or the received verification code is inconsistent with the sent verification code, the verification fails, indicating that the current user of the corresponding mobile terminal is not a user with management permissions and is not allowed to interact with and control the smart tablet. Therefore, a control communication channel is not established, preventing other users without management permissions from scanning the code to control the smart tablet, improving the reliability and security of smart tablet control, preventing malicious damage to the smart tablet, and thus improving the user experience for users with management permissions. It should be noted that the account password information can be pre-stored in the mobile terminal or obtained by the mobile terminal after scanning the code based on the account password input page. That is, the account password can be entered by the user.

[0076] When establishing a communication connection, the mobile terminal can receive channel information sent by the server and establish a communication connection with the smart tablet through the corresponding control communication channel. This allows for subsequent interactive control of the smart tablet based on the communication connection established by the server. The control communication channel established by the server enables point-to-point communication between the mobile terminal and the smart tablet, facilitating mutual communication between them. Furthermore, the communication connection can be established simply by the mobile terminal recognizing the control QR code, avoiding the cumbersome connection steps of entering corresponding account and password information. For users, scanning the code is all it takes to connect and interact, a simple process that greatly improves the user experience. The fast communication connection also significantly improves the efficiency of interactive control, further enhancing the user experience. Moreover, establishing a communication connection between the mobile terminal and the smart tablet only after successful verification confirms the permissions of the mobile terminal acting as a virtual mouse and / or virtual keyboard, preventing unauthorized mobile terminals from connecting and affecting the normal operation of the smart tablet. This ensures the normal operation of the smart tablet under the interactive control of the virtual mouse and / or virtual keyboard, thereby improving the user experience.

[0077] S104. Based on the communication connection, in response to the virtual control trigger command, perform interactive control of the smart tablet using a virtual mouse and / or virtual keyboard.

[0078] After a mobile terminal and a smart tablet establish a communication connection based on channel information fed back from the server through a corresponding control communication channel, the mobile terminal can interactively control the smart tablet through this communication connection. This includes functions such as acting as a virtual mouse to control the smart tablet, acting as a virtual keyboard to input text information, or engaging in game interaction. Furthermore, when interactive control of the smart tablet is needed, even if the smart tablet is located at a high or distant geographical location, the user can use their mobile terminal to scan the control QR code displayed on the smart tablet to establish a communication connection through the control communication channel. This connection allows for interactive control of the smart tablet, making it as simple as scanning a code, thus greatly improving the user experience. Moreover, users can control the smart tablet by scanning the code based on their own location, overcoming geographical limitations and increasing the flexibility of smart tablet interactive control, further enhancing the user experience.

[0079] This embodiment provides a method for virtual mouse and keyboard interactive control of a smart tablet. After the mobile terminal and the smart tablet establish a communication connection based on the channel information fed back by the server through the corresponding control communication channel, the mobile terminal receives a virtual control trigger command and enters the interactive interface in response to the virtual control trigger command. This virtual control trigger command can be automatically triggered after the mobile terminal establishes a communication connection with the smart tablet based on recognizing a control QR code, or it can be triggered based on a user input command after the mobile terminal establishes a communication connection with the smart tablet based on recognizing a control QR code. After entering the interactive interface based on the virtual control trigger command, the user can perform virtual mouse and keyboard interactive control of the smart tablet. As described above, by establishing a communication connection between the mobile terminal and the smart tablet and entering the interactive interface based on the virtual control trigger command, the user can immediately perform interactive control of the smart tablet after connecting by scanning a code, greatly shortening the startup time for interactive control of the smart tablet, thereby improving the user experience. Existing virtual mouse and keyboard wireless connections with smart tablets are usually direct connections without verification; any user (mobile terminal) can connect and perform virtual mouse and keyboard interactive control. In smart tablet interaction scenarios, if any user can connect and interact with the tablet, unauthorized connections can disrupt its normal operation, impacting the user experience. This embodiment provides a virtual mouse and keyboard interaction control method for smart tablets. The method verifies the second connection information sent by the mobile terminal via the cloud, and only establishes a communication connection between the mobile terminal and the smart tablet after successful verification. This method determines the permissions of the mobile terminal acting as a virtual mouse and / or virtual keyboard, preventing unauthorized connections from interfering with the tablet's normal operation. This ensures the smart tablet functions correctly under virtual mouse and / or virtual keyboard interaction control, thereby improving the user experience.

[0080] It should be noted that when the virtual control trigger command is triggered by user input, the mobile terminal sends the virtual control trigger command to the smart tablet, so that the smart tablet displays a second virtual mouse based on the virtual control trigger command.

[0081] In one embodiment, when a mobile terminal connected to a smart tablet does not perform interactive control operations for an extended period, such as when the smart tablet does not receive an interactive signal / command from the mobile terminal for a preset time, a disconnection reminder is sent to the server, and the server then controls the corresponding control communication channel to disconnect. When the same mobile terminal scans the code for the second time, based on the previous connection and the corresponding connection information (i.e., the second connection information) recorded in the server, the server recreates the corresponding control communication channel according to the previously recorded second connection information to establish a communication connection between the mobile terminal and the smart tablet. For example, after scanning the code, the mobile terminal can send a connection request to the server. The connection request includes identification information. The server determines the previously recorded second connection information based on the identification information. Since it has already been verified, the server can directly recreate the corresponding control communication channel based on the previously recorded second connection information.

[0082] Figure 3 This is a first schematic diagram of a virtual mouse and keyboard interaction interface provided in an embodiment of this application. Figure 4 This is a schematic diagram of a first display of a smart flat panel provided in an embodiment of this application, referring to... Figure 3 and Figure 4 After entering the interactive interface, the mobile terminal 10 displays a first virtual cursor 1010 on the interface. The first virtual cursor 1010 corresponds to the second virtual cursor 120 displayed on the smart tablet 20. That is, when the first virtual cursor 1010 moves on the interactive interface of the mobile terminal 10, the second virtual cursor 120 on the smart tablet 20 will also move accordingly to achieve interactive control. It should be noted that when the interactive interface is first entered, the first virtual cursor 1010 is displayed at a preset position on the interactive interface. This preset position can be the center point of the interactive interface or any position within the first target area 101, to ensure that the initial position of the first virtual cursor 1010 is within the first target area 101. After the first virtual cursor 1010 is first displayed at the preset position, touch events are monitored. When a touch event is detected, the relative displacement information of the touch movement is obtained. The obtained relative displacement information is used to control the movement of the first virtual cursor 1010, and the obtained relative displacement information is also sent to the smart tablet 20 so that the smart tablet 20 can control the movement of the second virtual cursor 120 based on the relative displacement information. From the user's perspective, the first virtual cursor 1010 and the second virtual cursor 120 are moved synchronously based on touch, thus achieving interactive control.

[0083] For example, a preset touch response sensitivity can be used. The acquired relative displacement information of touch movement is scaled according to the preset touch response sensitivity and then sent to the smart tablet 20. The smart tablet 20 obtains the target relative displacement information by scaling the received (scaled) relative displacement information according to the preset touch response sensitivity, and then controls the movement of the second virtual mouse based on the target relative displacement information. It should be noted that the preset touch response sensitivity of the mobile terminal 10 and the preset touch response sensitivity of the smart tablet 20 can be set according to the actual situation; they can be set to be the same or different.

[0084] The interactive interface includes a first target area 101 and a second target area 102. The first target area 101 is used to display a first virtual cursor 1010 and to control the movement of the first virtual cursor 1010 based on touch movement. The second target area 102 is used to trigger virtual keyboard interaction. Therefore, in the aforementioned virtual mouse interaction control process, it is necessary to monitor the current position of the first virtual cursor 1010. When the first virtual cursor is within the first target area 101, it indicates that virtual mouse interaction control is being performed, and the movement control of the first virtual cursor 1010 continues based on relative displacement information. (Refer to...) Figure 3 The first target area 101 includes a first virtual control 1011 and a second virtual control 1012. The first virtual control 1011 is used to implement the "left-click" function of the virtual mouse, and the second virtual control is used to implement the "right-click" function of the virtual mouse. When the current position of the first virtual cursor 1010 is detected within the first target area 101, a first click event is detected. The first click event is a click event on the first virtual control 1011 and the second virtual control 1012. When the first click event is detected, the left and right mouse button interaction control is performed according to the first click event. For example, when the first click event is detected as a click on the first virtual control 1011, a left-click function command is generated and sent to the smart tablet 20. The smart tablet 20 performs the left-click function based on the left-click function command. For example, refer to... Figure 4 When an error pop-up appears on the smart tablet 20, and the mobile terminal 10 moves the second virtual cursor 120 on the smart tablet 20 to the position of the close trigger control 121 based on the movement of the first virtual cursor 1010, a left-click function command is generated by clicking the first virtual control 1011 on the mobile terminal 10 and sent to the smart tablet 20. The smart tablet 20 controls the second virtual cursor 120 to touch the close trigger control 121 based on the left-click function command, so as to realize the left-click function of the mouse and close the error pop-up.

[0085] As described above, through the interaction interface of the mobile terminal, virtual mouse interaction control is performed on the smart tablet based on the first target area and the first virtual cursor, realizing the virtual mouse interaction function, avoiding the need to be in close contact with the smart tablet or connect a wired mouse to realize the interaction with the smart tablet, enabling the user to perform virtual mouse interaction control on the smart tablet based on the mobile terminal carried with them, improving the flexibility of the smart tablet interaction control, and thus enhancing the user experience. In addition, by using the first target area as the moving area of the first virtual cursor, compared with the existing method of using the entire mobile terminal as a mouse for moving control, in this embodiment, the moving area of the first virtual cursor is restricted, reducing the control dimension, enabling the user to move the virtual cursor based on the movement of the finger, and thus enhancing the user experience.

[0086] Figure 5 It is the second schematic diagram of a virtual mouse and keyboard interaction interface provided by an embodiment of the present application. Refer to Figure 5 , in the above virtual mouse interaction control process, it is necessary to monitor the current position of the first virtual cursor 1010. When the first virtual cursor 1010 is located within the second target area 102, it represents that virtual keyboard interaction control is being performed at this time, and the virtual keyboard 1013 is popped up. After the virtual keyboard 1013 is popped up, the second click event is monitored. The second click event is a click event on the virtual keyboard 1013. Based on the second click event, the keyboard input information can be determined. The virtual keyboard 1013 provided in this embodiment has a complete input method function. When the second click event is detected, the character information on the clicked virtual keyboard 1013 is determined according to the second click event, and the corresponding keyboard input information is generated according to the character information and the input method function. For example, the second click event is a click on the characters "z", "h", "o", "n", and "g" in the virtual keyboard 1013. According to the input method function, "中", "仲", "种", and "钟" are generated. According to the second click event being a click on the generated character "中", the keyboard input information is determined to be "中". The mobile terminal 10 sends the keyboard input information generated based on the second click event to the smart tablet for the smart tablet to display the keyboard input information in the corresponding text display box. For example, the mobile terminal 10 sends "中" to the smart tablet for the smart tablet to display "中" in the corresponding text input box, as Figure 7 shown. Compared with the existing method that must be displayed simultaneously to perform the keyboard function, in this embodiment, the mobile terminal is used as a virtual keyboard. In the original working state of the smart tablet, the mobile terminal participates in the interaction control of the smart tablet with an external keyboard device, greatly improving the flexibility of the smart tablet interaction, and thus enhancing the user experience.

[0087] The instruction manual requires that the second virtual cursor be moved to the corresponding text input trigger position based on the movement of the first virtual cursor, and the text input is triggered and the corresponding text input box is displayed based on the first click event. At this time, the first virtual cursor is moved to the second target area, and the corresponding keyboard input information is generated based on the second click event and sent to the smart tablet so that the smart tablet can display the keyboard input information in the text input box.

[0088] The above describes a method that uses a mobile terminal's interface to control a smart tablet via a virtual keyboard, based on a second target area and a virtual keyboard. This eliminates the need for close contact with the smart tablet or a wired keyboard connection to input text, allowing users to control the tablet remotely from their mobile devices. This increases the flexibility of smart tablet control and enhances the user experience. Furthermore, existing wireless keyboard connections typically rely on Bluetooth or Wi-Fi, requiring no authentication. Any user (mobile terminal) can connect and interact with the tablet. However, in smart tablet interaction scenarios, if any user can connect and interact, unauthorized connections can disrupt the tablet's normal operation, negatively impacting the user experience. The virtual mouse and keyboard interaction control method for smart tablets provided in this embodiment verifies the second connection information sent by the mobile terminal through the cloud, and only creates a communication connection between the mobile terminal and the smart tablet after the verification is successful. This can determine the permissions of the mobile terminal acting as a virtual mouse and / or virtual keyboard, preventing unauthorized mobile terminals from connecting at will and affecting the normal operation of the smart tablet. This ensures the normal operation of the smart tablet under the interaction control of the virtual mouse and / or virtual keyboard, thereby improving the user experience.

[0089] As mentioned above, mobile terminals do not need to install any additional interactive apps; they can directly use the "mini-program" function in regular applications to achieve the aforementioned smart tablet control method, further improving the convenience of use and thus enhancing the user experience.

[0090] on the other hand, Figure 6 This is a flowchart of a smart flat panel control method provided in an embodiment of this application, referred to as follows. Figure 6 This application provides another smart tablet control method according to embodiments thereof, for use with smart tablets, such as conference tablets, smart TVs, and video conferencing systems. The process of this smart tablet control method includes:

[0091] S201. Display control QR code, the control QR code includes the first connection information of the smart tablet.

[0092] Before interactive control of a smart tablet, a communication connection needs to be established. In related technologies, this is typically achieved through Bluetooth or Wi-Fi searching. This method requires no authentication, allowing any user (mobile terminal) to connect and interact with the tablet using a virtual mouse and keyboard. However, in smart tablet interaction scenarios, if any user can connect and interact, unauthorized connections can disrupt the tablet's normal operation, impacting the user experience. Therefore, this embodiment displays a control QR code containing the smart tablet's initial connection information on the tablet. When interactive control is needed, a communication connection can be established by recognizing this QR code. The control QR code can be displayed continuously on the smart tablet, triggered by an interactive control request, or displayed at preset time intervals.

[0093] As described above, by displaying a control QR code on the smart tablet, users can interact with and control the smart tablet by scanning the code with their mobile devices, regardless of whether the smart tablet is at a high or distant location. This overcomes the limitations of height and distance, thereby improving the user experience.

[0094] S202. A communication connection is established between the server and the mobile terminal. The communication connection is established after the server verifies the second connection information. The second connection information is generated by the first connection information and the identity information of the mobile terminal. The second connection information is sent from the mobile terminal to the server.

[0095] When interactive control of the smart tablet is required, a mobile terminal can scan the control QR code displayed on the smart tablet to obtain the tablet's initial connection information. The mobile terminal generates second connection information based on the first connection information and its own identity information, and sends this second connection information to the server. Upon receiving the second connection information, the server verifies the identity information within it. If verification is successful, a control communication channel is established between the mobile terminal and the smart tablet based on the second connection information, and channel information for this control communication channel is generated and fed back to both the mobile terminal and the smart tablet. The smart tablet receives this channel information and establishes a communication connection with the mobile terminal through the corresponding control communication channel, enabling it to subsequently receive interactive control commands / data from the mobile terminal via a virtual mouse and / or virtual keyboard.

[0096] S203. Based on the communication connection, receive interactive control instructions from the corresponding mobile terminal's virtual mouse and / or virtual keyboard.

[0097] The smart tablet receives interactive control commands / data sent by the mobile terminal through a communication connection via a control channel, and then performs corresponding operations based on these commands / data. Examples include receiving relative displacement information, left-click function commands, right-click function commands, and keyboard input information from the mobile terminal.

[0098] As described above, displaying a control QR code on the smart tablet provides an entry point for mobile terminals to scan and connect. Combined with server-side permission monitoring of mobile terminals, this allows mobile terminals with corresponding management permissions to scan the code, connect, and access the interactive interface. Even if the smart tablet is located at a high or distant position, users can remotely control it using their mobile terminals, thus improving the operational flexibility of the smart tablet's interactive control and enhancing the user experience. Furthermore, establishing a communication connection between the mobile terminal and the smart tablet only after successful verification ensures the permissions of the mobile terminal acting as a virtual mouse and / or virtual keyboard. This prevents unauthorized mobile terminals from connecting and interfering with the normal operation of the smart tablet, ensuring its proper functioning under virtual mouse and / or virtual keyboard interaction control and further improving the user experience.

[0099] This embodiment provides a method for virtual mouse and keyboard interaction control on a smart tablet. After a communication connection is established between a mobile terminal and a smart tablet based on channel information fed back by a server through a corresponding control communication channel, the mobile terminal receives a virtual control trigger command and displays a second virtual mouse in response to the command. This virtual control trigger command can be automatically triggered after the mobile terminal establishes a communication connection with the smart tablet based on a recognized control QR code, or it can be triggered based on a user input command after the mobile terminal establishes a communication connection with the smart tablet based on a recognized control QR code. If it is automatically triggered, a second virtual cursor is displayed after establishing a communication connection with the mobile terminal. If it is triggered by a user input command, the smart tablet displays the second virtual cursor upon receiving the virtual control trigger command.

[0100] After the smart tablet displays the second virtual cursor, when it receives relative displacement information from the mobile terminal, it scales the relative displacement information according to a preset touch response sensitivity to obtain the target relative displacement information, and then controls the movement of the second virtual mouse based on this target relative displacement information. When a left-click function command is received, the mouse left-click function is performed, such as a click operation. For example, refer to... Figure 4, an error pop-up window appears on the smart tablet 20. When the second virtual cursor 120 on the smart tablet 20 is moved to the position of the close trigger control 121 by moving the first virtual cursor 1010 based on the movement of the mobile terminal 10, a left-button function instruction is generated by clicking on the first virtual control 1011 of the mobile terminal 10, and the left-button function instruction is sent to the smart tablet 20. The smart tablet 20 controls the second virtual cursor 120 to touch the close trigger control 121 based on the left-button function instruction to implement the left mouse click function, thereby closing the error pop-up window.

[0101] As described above, through the interaction interface of the mobile terminal, virtual mouse interaction control of the smart tablet is performed based on the first target area and the first virtual cursor, realizing the virtual mouse interaction function, avoiding the need to be in close contact with the smart tablet or connect a wired mouse to achieve interaction with the smart tablet, enabling the user to perform virtual mouse interaction control of the smart tablet based on the mobile terminal carried with them, improving the flexibility of the smart tablet interaction control, and thus enhancing the user experience. When the existing virtual mouse and keyboard are wirelessly connected to the smart tablet, it is usually a direct connection without verification, and any user (mobile terminal) can connect and perform virtual mouse and keyboard interaction control. In the scenario of smart tablet interaction, if any user can connect and interactively control, the connection of illegal users will affect the normal operation scenario of the smart tablet, thus affecting the user experience. The method for virtual mouse and keyboard interaction control of the smart tablet provided in this embodiment verifies the second connection information sent by the mobile terminal through the cloud, and only creates a communication connection between the mobile terminal and the smart tablet after the verification is passed, which can determine the permission of the mobile terminal as a virtual mouse and / or virtual keyboard, avoiding the random connection of unauthorized mobile terminals from affecting the normal operation of the smart tablet, thereby ensuring the normal operation of the smart tablet under the virtual mouse and / or virtual keyboard interaction control, and thus enhancing the user experience.

[0102] After the smart tablet displays the second virtual cursor, when the second virtual cursor moves according to the relative displacement information, when the second virtual cursor moves to the text input trigger position and receives the left-button function instruction, a corresponding text input box is displayed according to the left-button function instruction. Figure 7 It is a second display schematic diagram of the smart tablet provided by an embodiment of the present application. Refer to Figure 7 , after the smart tablet 12 displays the text input box 122 and receives the keyboard input information, the corresponding keyboard input information is displayed in the text input box 122, for example, "中" is displayed.

[0103] As described above, by using the mobile terminal's interactive interface, the smart tablet is controlled via a virtual keyboard based on the second target area and the virtual keyboard. This achieves virtual keyboard interaction functionality, avoiding the need for close contact with the smart tablet or a wired keyboard connection to input text information. Users can control the smart tablet using their portable mobile terminal, improving the flexibility of smart tablet interaction and enhancing the user experience. Compared to existing methods that require a physical display for keyboard functionality, this embodiment uses the mobile terminal as a virtual keyboard. While the smart tablet is in its original working state, the mobile terminal, acting as an external keyboard device, participates in the interactive control of the smart tablet, significantly improving the flexibility of smart tablet interaction and thus enhancing the user experience.

[0104] In one embodiment, multiple mobile terminals can simultaneously control the same smart tablet. It should be noted that all mobile terminals are verified with verified identity information. The specific smart tablet control method is the same as in the aforementioned implementation method and will not be repeated here. Simultaneous interaction control via multiple mobile terminals allows multiple users to interact with the same smart tablet. For example, in a game scenario, each mobile terminal corresponds to a game character, and each mobile terminal can interact with and control that game character.

[0105] on the other hand, Figure 8 This is a flowchart of a smart flat panel control method provided in an embodiment of this application, referred to as follows. Figure 8 This application provides another smart tablet control method for a server, the process of which includes:

[0106] S301. Receive second connection information sent by the mobile terminal. The second connection information is generated by the first connection information and the identity information of the mobile terminal. The first connection information is generated by the corresponding smart tablet.

[0107] When a mobile terminal needs to interact with and control a smart tablet, the mobile terminal combines the first connection information and identity information obtained from scanning the QR code on the smart tablet to generate second connection information, and sends the second connection information to the server. After receiving the second connection information from the mobile terminal, the server verifies the identity information within it. For example, the server pre-stores the legitimate identity information of mobile terminals with management privileges. The server compares the identity information in the received second connection information with the pre-stored legitimate identity information. If the identity information in the second connection information matches the pre-stored legitimate identity information, it means the corresponding mobile terminal belongs to a user with management privileges, and interactive control of the smart tablet is allowed. Therefore, the subsequent control communication channel establishment process can proceed. If the identity information in the second connection information does not match the pre-stored legitimate identity information, it means the corresponding mobile terminal does not belong to a user with management privileges, and interactive control of the smart tablet is not allowed. Therefore, the control communication channel establishment process is not initiated, preventing unauthorized users from scanning the QR code to control the smart tablet, improving the reliability of smart tablet control, preventing malicious damage to the smart tablet, and thus improving the user experience for users with management privileges.

[0108] It should be noted that if the verification fails, an error message will be sent to the corresponding mobile terminal to indicate that the user does not have management privileges and therefore cannot establish a communication connection.

[0109] S302. Verify the second connection information. If the verification is successful, establish a communication connection between the mobile terminal and the smart tablet. The mobile terminal is used to perform interactive control of the smart tablet using a virtual mouse and / or virtual keyboard based on the communication connection and in response to the virtual control trigger command.

[0110] The server verifies the identity information in the second connection information. If verification is successful, indicating that the corresponding mobile terminal belongs to a user with administrative privileges, a control communication channel is established between the mobile terminal and the smart tablet based on the second connection information. Communication information for this control communication channel is generated, such as the channel ID. For example, this control communication channel can be a P2P, PMP, or MQ communication channel. The control communication channel is used for point-to-point communication between the mobile terminal and the smart tablet. The server feeds back the channel information of the corresponding control communication channel to the corresponding mobile terminal and smart tablet, enabling the mobile terminal and smart tablet to establish a communication connection through the control communication channel based on the channel information and to perform interactive control based on this communication connection.

[0111] As described above, the server verifies the identity information corresponding to the mobile terminal based on the received second connection information, preventing unauthorized users from scanning the code to control the smart tablet. This improves the reliability and security of smart tablet control, prevents malicious damage to the smart tablet, and enhances the user experience for users with administrative privileges. Furthermore, if verification is successful, a corresponding control communication channel is established, allowing the mobile terminal and smart tablet to establish a communication connection and perform interactive control. Compared to related technologies that require user account and password login for communication connections, this embodiment avoids the cumbersome connection steps caused by users entering corresponding account and password information. For users, connecting and interactive control is as simple as scanning a code, greatly improving the user experience. Moreover, the fast communication connection significantly improves the communication efficiency of interactive control, further enhancing the user experience.

[0112] The above describes a process where a mobile terminal obtains first connection information for the smart tablet by scanning a control QR code displayed on the tablet. Based on this first connection information and the mobile terminal's own identity information, second connection information is generated and sent to a server for verification. If verification is successful, a communication connection is established between the mobile terminal and the smart tablet. Based on this connection, the server responds to virtual trigger commands to perform interactive control of the smart tablet using a virtual mouse and / or virtual keyboard. This technique allows for interactive control of the smart tablet simply by scanning a QR code with a mobile terminal. This avoids the poor user experience caused by the need for close proximity or wired communication for interaction, enabling remote interactive control of the smart tablet, improving its flexibility, and enhancing the user experience. Furthermore, establishing a communication connection only after successful verification ensures the permissions of the mobile terminal acting as a virtual mouse and / or virtual keyboard, preventing unauthorized connections from interfering with the normal operation of the smart tablet. This guarantees the normal operation of the smart tablet under virtual mouse and / or virtual keyboard interactive control, thereby improving the user experience.

[0113] Based on the above embodiments, Figure 9 This is a schematic diagram of a smart flat panel control device provided in an embodiment of this application. (Reference) Figure 9 The intelligent tablet control device provided in this embodiment is used for mobile terminals and specifically includes: a QR code recognition module 21, an information integration module 22, a communication connection module 23, and an interactive control module 24.

[0114] Among them, the QR code recognition module 21 is used to recognize the control QR code displayed on the smart tablet and obtain the first connection information of the smart tablet;

[0115] Information integration module 22 is used to generate second connection information based on the first connection information and its own identity information;

[0116] The communication connection module 23 is used to send the second connection information to the server so that the server can verify the second connection information. If the verification is successful, a communication connection is established between the mobile terminal and the smart tablet.

[0117] The interactive control module 24 is used to perform interactive control of the smart tablet using a virtual mouse and / or virtual keyboard in response to virtual control trigger commands based on the communication connection.

[0118] As described above, after establishing a communication connection between the mobile terminal and the smart tablet, the user enters the interactive interface based on the virtual control trigger command. This allows the user to immediately control the smart tablet after connecting by scanning the code, greatly shortening the startup time for interactive control of the smart tablet and thus improving the user experience.

[0119] In one embodiment, the interactive control module 24 includes a cursor display submodule, a touch detection submodule, and a motion control submodule;

[0120] The cursor display submodule is used to display a first virtual cursor in the interactive interface in response to a virtual control trigger command based on a communication connection. The first virtual cursor corresponds to the second virtual cursor displayed on the smart tablet.

[0121] The touch monitoring submodule is used to monitor touch events. When a touch event is detected, it obtains the relative displacement information of the touch movement.

[0122] The motion control submodule is used to control the movement of the first virtual cursor based on the relative displacement information, and to send the relative displacement information to the smart tablet so that the smart tablet can control the movement of the second virtual cursor based on the relative displacement information.

[0123] As described above, the smart tablet is controlled via a mobile terminal's interface using a first virtual cursor, enabling virtual mouse interaction. This eliminates the need for close contact with the smart tablet or a wired mouse connection, allowing users to control the tablet virtually from their mobile devices. This improves the flexibility of smart tablet interaction and enhances the user experience. Furthermore, by controlling the movement of the first and second virtual cursors using relative displacement information, this embodiment significantly reduces the data transmission volume compared to existing real-time control methods based on movement trajectories. This reduction in data transmission volume improves the response speed of the second virtual cursor, further enhancing the user experience.

[0124] In one embodiment, the interactive control module 24 further includes a location recognition submodule and a keyboard interaction submodule;

[0125] The position recognition submodule is used to obtain the current position of the first virtual cursor in the interactive interface, which includes a first target area and a second target area.

[0126] The movement control submodule is also used to continue to move the first virtual cursor based on the relative displacement information when the current position is within the first target area;

[0127] The keyboard interaction submodule is used to pop up a virtual keyboard when the current location is within the second target area.

[0128] As described above, through the mobile terminal's interactive interface, virtual mouse interaction control is achieved on the smart tablet based on the first target area and the first virtual cursor. This eliminates the need for close contact with the smart tablet or a wired mouse connection to interact with it, allowing users to control the smart tablet virtually with their mobile devices. This improves the flexibility of smart tablet interaction control and enhances the user experience. Similarly, through the mobile terminal's interactive interface, virtual keyboard interaction control is achieved on the smart tablet based on the second target area and the virtual keyboard. This eliminates the need for close contact with the smart tablet or a wired keyboard connection to input text information. Users can control the smart tablet virtually with their mobile devices, improving the flexibility of smart tablet interaction control and enhancing the user experience.

[0129] In one embodiment, the interactive control module 24 further includes a first monitoring submodule;

[0130] The first monitoring submodule is used to monitor the first click event. When the first click event is detected, the left and right mouse buttons of the virtual mouse are used for interactive control based on the first click event.

[0131] As described above, the smart tablet is controlled by a virtual mouse through the mobile terminal's interface, based on the first target area and the first virtual cursor. This achieves the virtual mouse interaction function, avoiding the need for close contact with the smart tablet or a wired mouse connection to interact with it. Users can control the smart tablet with a virtual mouse using their mobile terminal, improving the flexibility of smart tablet interaction and thus enhancing the user experience.

[0132] In one embodiment, the interactive control module 24 further includes a second monitoring submodule;

[0133] The second monitoring submodule is used to monitor the second click event. When the second click event is detected, the keyboard input information is determined based on the second click event and the virtual keyboard. The second click event is a click event on the virtual keyboard.

[0134] The keyboard interaction submodule is used to send keyboard input information to the smart tablet.

[0135] As described above, the smart tablet can be controlled via a virtual keyboard through the mobile terminal's interface, based on the second target area and the virtual keyboard. This eliminates the need for close contact with the smart tablet or a wired keyboard connection to input text information, allowing users to control the smart tablet via their mobile devices. This improves the flexibility of smart tablet control and enhances the user experience.

[0136] The intelligent flat panel control device provided in this application embodiment can be used to execute the intelligent flat panel control method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0137] Based on the above embodiments, Figure 10 This is a schematic diagram of another intelligent flat panel control device provided in an embodiment of this application. (Reference) Figure 10 The smart tablet control device provided in this embodiment is used for smart tablets and specifically includes: a display module 31, a communication establishment module 32, and an instruction receiving module 33.

[0138] The display module 31 is used to display a control QR code, which includes the first connection information of the smart tablet.

[0139] The communication establishment module 32 is used to establish a communication connection with the mobile terminal through the server. The communication connection is established after the server verifies the second connection information. The second connection information is generated by the first connection information and the identity information of the mobile terminal. The second connection information is sent to the server by the mobile terminal.

[0140] The instruction receiving module 33 is used to receive interactive control instructions from the virtual mouse and / or virtual keyboard of the corresponding mobile terminal based on the communication connection.

[0141] The intelligent flat panel control device provided in this application embodiment can be used to execute the intelligent flat panel control method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0142] Based on the above embodiments, Figure 11 This is a schematic diagram of another intelligent flat panel control device provided in an embodiment of this application. (Reference) Figure 11The intelligent tablet control device provided in this embodiment is used for a server and specifically includes: a connection information receiving module 41 and a communication establishment module 42.

[0143] Among them, the connection information receiving module 41 is used to receive the second connection information sent by the mobile terminal. The second connection information is generated by the first connection information and the identity information of the mobile terminal. The first connection information is generated by the corresponding smart tablet.

[0144] The communication establishment module 42 is used to verify the second connection information. If the verification is successful, a communication connection is established between the mobile terminal and the smart tablet. The mobile terminal is used to perform interactive control of the smart tablet using a virtual mouse and / or virtual keyboard based on the communication connection and in response to the virtual control trigger command.

[0145] The intelligent flat panel control device provided in this application embodiment can be used to execute the intelligent flat panel control method provided in the above embodiment, and has corresponding functions and beneficial effects.

[0146] This application provides an intelligent flat panel control device, referring to... Figure 12 The intelligent flat panel control device includes: a processor 51, a memory 52, a communication module 53, an input device 54, and an output device 55. The intelligent flat panel control device may have one or more processors, and the intelligent flat panel control device may have one or more memories. The processor, memory, communication module, input device, and output device of the intelligent flat panel control device can be connected via a bus or other means.

[0147] The memory 52, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as program instructions / modules corresponding to the smart tablet control method described in any embodiment of this application (e.g., the barcode recognition module, information integration module, communication connection module, and interactive control module in the smart tablet control device). The memory may primarily include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a function; the data storage area may store data created based on the use of the device. Furthermore, the memory may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, the memory may further include memory remotely located relative to the processor, and these remote memories can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0148] The communication module 53 is used for data transmission.

[0149] The processor 51 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, thereby realizing the above-mentioned smart tablet control method.

[0150] Input device 54 can be used to receive input digital or character information, and to generate key signal inputs related to user settings and function control of the device. Output device 55 may include display devices such as a display screen.

[0151] The intelligent flat panel control device provided above can be used to execute the intelligent flat panel control method provided in the above embodiments, and has corresponding functions and beneficial effects.

[0152] This application also provides a storage medium for storing computer-executable instructions. When executed by a computer processor, the computer-executable instructions are used to execute a smart tablet control method. The smart tablet control method includes: recognizing a control QR code displayed on the smart tablet to obtain first connection information of the smart tablet; generating second connection information based on the first connection information and its own identity information; sending the second connection information to a server so that the server can verify the second connection information, and if the verification is successful, establishing a communication connection between the mobile terminal and the smart tablet; and based on the communication connection, responding to a virtual control trigger command to perform interactive control of the smart tablet using a virtual mouse and / or a virtual keyboard.

[0153] Storage medium – any type of memory device or storage device. The term “storage medium” is intended to include: mounting media, such as CD-ROM, floppy disk, or magnetic tape devices; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. Storage medium may also include other types of memory or combinations thereof. Furthermore, storage medium may reside in a first computer system in which the program is executed, or it may reside in a different second computer system connected to the first computer system via a network (such as the Internet). The second computer system can provide program instructions to the first computer for execution. The term “storage medium” can include two or more storage media residing in different locations (e.g., in different computer systems connected via a network). Storage medium may store program instructions (e.g., specifically implemented as a computer program) executable by one or more processors.

[0154] Of course, the storage medium for storing computer-executable instructions provided in the embodiments of this application is not limited to the smart tablet control method described above, but can also execute related operations in the smart tablet control method provided in any embodiment of this application.

[0155] The smart tablet control device, storage medium, and smart tablet control equipment provided in the above embodiments can execute the smart tablet control method provided in any embodiment of this application. For technical details not described in detail in the above embodiments, please refer to the smart tablet control method provided in any embodiment of this application.

[0156] The above description is merely a preferred embodiment and the technical principles employed in this application. This application is not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions that can be made by those skilled in the art will not depart from the scope of protection of this application. Therefore, although this application has been described in detail through the above embodiments, this application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of this application, the scope of which is determined by the scope of the claims.

Claims

1. A smart panel control method, characterized by, A mobile terminal, comprising: identifying a control two-dimensional code displayed on a smart tablet to obtain first connection information of the smart tablet; generating second connection information according to the first connection information and identity information of the mobile terminal; sending the second connection information to a server to enable the server to verify the second connection information, and establishing a communication connection between the mobile terminal and the smart tablet if the verification is passed; based on the communication connection, responding to a virtual control trigger instruction to perform interactive control of a virtual mouse and / or a virtual keyboard on the smart tablet.

2. The method of claim 1, wherein, The interactive control of the virtual mouse and / or the virtual keyboard on the smart tablet based on the communication connection in response to the virtual control trigger instruction comprises: based on the communication connection, responding to a virtual control trigger instruction to display a first virtual cursor in an interactive interface, the first virtual cursor corresponding to a second virtual cursor displayed on the smart tablet; monitoring a touch event, and acquiring relative displacement information of touch movement when the touch event is monitored; controlling movement of the first virtual cursor according to the relative displacement information, and sending the relative displacement information to the smart tablet to enable the smart tablet to control movement of the second virtual cursor based on the relative displacement information.

3. The method of claim 2, wherein, After the movement control of the first virtual cursor according to the relative displacement information, the method comprises: acquiring a current position of the first virtual cursor in the interactive interface, the interactive interface including a first target area and a second target area; when the current position is located in the first target area, continuing to control movement of the first virtual cursor according to the relative displacement information; when the current position is located in the second target area, popping up a virtual keyboard.

4. The method of claim 3, wherein, After the movement control of the first virtual cursor according to the relative displacement information when the current position is located in the first target area, the method comprises: monitoring a first click event, and performing left and right key interactive control of a virtual mouse according to the first click event when the first click event is monitored.

5. The method of claim 3, wherein, After the virtual keyboard is popped up when the current position is located in the second target area, the method comprises: monitoring a second click event, and determining keyboard input information according to the second click event and the virtual keyboard when the second click event is monitored, the second click event being a click event on the virtual keyboard; sending the keyboard input information to the smart tablet.

6. A smart panel control method, characterized by, A smart tablet, comprising: displaying a control two-dimensional code, the control two-dimensional code including first connection information of the smart tablet; establishing a communication connection with a mobile terminal through a server, the communication connection being established after verification of second connection information by the server, the second connection information being generated by the first connection information and identity information of the mobile terminal, and the second connection information being sent to the server by the mobile terminal; based on the communication connection, receiving an instruction of interactive control of a virtual mouse and / or a virtual keyboard of a corresponding mobile terminal. 7.A smart panel control method, characterized by, A server, comprising: Receiving second connection information sent by the mobile terminal, the second connection information being generated by the first connection information and identity information of the mobile terminal, the first connection information being generated by the corresponding smart pad; Verifying the second connection information, and establishing a communication connection between the mobile terminal and the smart pad if the verification is passed, the mobile terminal being configured to perform interactive control of the smart pad by a virtual mouse and / or a virtual keyboard based on the communication connection and in response to a virtual control trigger instruction.

8. A smart pad control device, characterized by, For a mobile terminal, comprising: A code scanning and recognizing module configured to recognize a control two-dimensional code displayed on a smart pad to obtain first connection information of the smart pad; An information integrating module configured to generate second connection information according to the first connection information and identity information of the mobile terminal; A communication connection module configured to send the second connection information to a server to enable the server to verify the second connection information, and to establish a communication connection between the mobile terminal and the smart pad if the verification is passed; An interactive control module configured to perform interactive control of the smart pad by a virtual mouse and / or a virtual keyboard based on the communication connection and in response to a virtual control trigger instruction.

9. A smart panel control device, characterized by, Comprising: A memory and one or more processors; The memory is configured to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the method according to any one of claims 1-7.

10. A storage medium storing computer-executable instructions, wherein: The computer executable instructions, when executed by a processor, are configured to perform the method according to any one of claims 1-7.

Images