Teaching screen operating system based on artificial intelligence

Abstract

The invention relates to the technical field of computer vision, in particular to a teaching screen operating system based on artificial intelligence, which comprises a contact information acquisition module, an analysis module, a response module and a correction module. By accurately collecting and analyzing real-time information of the contacts, accurate recognition of single-point and multi-point touch control gestures is achieved, gesture types can be flexibly determined according to the number of the contacts, coordinates and pressure changes, misoperation is avoided, the operation accuracy is improved, and the correction module calculates the standard deviation of the distance change rate, so that the accuracy of gesture recognition is improved. The unit coordinate distance is dynamically adjusted, so that high response sensitivity and precision can be kept in different use scenes, the adaptability of the system is remarkably enhanced, the intelligent level of a teaching screen is improved, the user experience is optimized, and the user experience is improved. The problems of inaccurate gesture recognition and slow response speed caused by insufficient touch point information processing precision and operation mode switching lag are effectively solved.

Description

Technical Field

[0001] The present invention relates to the field of computer vision technology, and in particular to an artificial intelligence-based teaching screen operating system. Background Art

[0002] With the rapid development of intelligent education and the continuous advancement of science and technology, teaching tools are undergoing profound changes. Artificial intelligence technology, especially the application of deep learning and machine learning, has brought unprecedented intelligent capabilities to educational equipment, greatly improving interactivity and operating accuracy. This trend has promoted the demand for efficient and accurate interactive technologies in the education field, aiming to improve teaching effectiveness and enrich the learning experience.

[0003] The patent document with publication number CN111552432A discloses an electronic device screen operating system and method. The system includes: a data acquisition module, a touch point judgment module and a mode switching module; the data acquisition module collects touch point information on the touch screen, and transmits the touch point information to the touch point judgment module and the mode switching module; the touch point judgment module performs mode judgment according to the touch point information and the preset mode judgment time, and transmits the judgment result to the mode switching module; the mode switching module switches the current operation mode according to the judgment result, generates a motion trajectory according to the touch point information, and executes the current operation mode according to the motion trajectory. The system mainly relies on the preset mode judgment time and fixed operation mode, resulting in the flexibility and accuracy of the system being limited in complex gesture operations or rapidly changing touch environments, and the correction process may not be flexible enough, making it difficult to cope with various abnormal situations in touch screen operations. Summary of the invention

[0004] To this end, the present invention provides a teaching screen operating system based on artificial intelligence to overcome the problems of inaccurate gesture recognition and slow response speed caused by insufficient touch point information processing accuracy and delayed operation mode switching in the prior art.

[0005] To achieve the above object, the present invention provides a teaching screen operating system based on artificial intelligence, comprising:

[0006] A touch point information acquisition module, used to acquire real-time touch point information of each touch point on the teaching screen, wherein the real-time touch point information includes real-time touch point coordinates and real-time pressure at the real-time touch point coordinates in a two-dimensional coordinate system established with the upper left corner of the teaching screen as the origin and a preset unit coordinate distance;

[0007] an analysis module, connected to the touch information acquisition module, comprising a touch number determination unit and an action determination unit, wherein the touch number determination unit is used to determine whether the touch mode is single-point touch or multi-point touch according to all real-time pressures within a preset determination time and a preset standard pressure, and the action determination unit is used to determine the single-point gesture type according to the touch mode, real-time touch coordinates and real-time pressure of the single-point touch;

[0008] The action determination unit is further used to determine a contact pairing combination according to a contact mode of the multi-touch control, a plurality of real-time contact coordinates, and a plurality of real-time pressures, calculate a distance change rate and a direction change rate of each pair of contacts in the contact pairing combination, and determine a multi-point gesture type of each contact according to the distance change rate, the direction change rate, and a preset gesture model standard value;

[0009] A response module, connected to the analysis module, for performing corresponding response actions according to the single-point gesture type and the multi-point gesture type;

[0010] The correction module is connected to the analysis module and the touch information acquisition module respectively, and is used to correct the unit coordinate distance according to all real-time touch coordinates of the multi-touch touch mode within a preset correction time and a preset correction standard deviation.

[0011] Furthermore, the touch point number determination unit is used to determine whether the touch point mode is single-point touch or multi-point touch according to all real-time pressures within a preset determination time and a preset standard pressure, including:

[0012] The touch point number determination unit is used to obtain the number of touch points whose real-time pressure is greater than the standard pressure. When the number of touch points is equal to one, the touch point number determination unit determines that the touch point mode is single-point touch;

[0013] When the number of touch points is greater than one, the touch point number determination unit determines that the touch point mode is multi-touch.

[0014] Further, when the contact point number determination unit determines that the contact point mode is a single-point touch, the action determination unit calculates the change rate of all real-time contact point coordinates and real-time pressure within the determined time length to obtain the coordinate change rate and the pressure change rate. When the coordinate change rate is greater than a preset standard coordinate change rate, and the pressure change rate is less than or equal to a preset standard pressure change rate, the action determination unit determines that the single-point gesture type is a sliding gesture;

[0015] When the coordinate change rate is greater than a preset standard coordinate change rate, and the pressure change rate is greater than a preset standard pressure change rate, the action determination unit determines that the single-point gesture type is a drag gesture.

[0016] Further, when the coordinate change rate is less than or equal to a preset standard coordinate change rate, the action determination unit records the duration of time when the real-time pressure is greater than a preset standard pressure to obtain a duration, and when the duration is less than a preset standard duration, the action determination unit determines that the single-point gesture type is a click gesture;

[0017] When the duration is greater than or equal to a preset standard duration, the action determination unit determines that the single-point gesture type is a long press gesture.

[0018] Furthermore, the action determination unit is further configured to determine the contact pairing combination according to the multi-touch contact mode, a plurality of real-time contact coordinates and a plurality of real-time pressures, including:

[0019] The action determination unit calculates the number of contact point pairing combinations according to the number of the contacts when the contact point number determination unit determines that the contact point mode is multi-touch.

[0020] Furthermore, the action determination unit is used to calculate the distance and direction angle of each pair of contacts in the contact pairing combination, and calculate the distance change rate and direction change rate between the contact pairings according to the distance and direction angle of each pair of contacts.

[0021] Further, the action determination unit is used to determine that the multi-point gesture type is a zoom gesture when the distance change rate is greater than a preset standard distance change rate and the direction change rate is less than a preset standard direction change rate.

[0022] Further, the action determination unit is used to determine that the multi-point gesture type is a rotation gesture when the distance change rate is less than or equal to a preset standard distance change rate, and the direction change rate is greater than or equal to a preset standard direction change rate.

[0023] Furthermore, the action determination unit is used to determine that the multi-point gesture type is a sliding gesture when the distance change rate is less than or equal to a preset standard distance change rate, and the direction change rate is less than a preset standard direction change rate.

[0024] Furthermore, the correction module is used to correct the unit coordinate distance according to all real-time touch point coordinates of the multi-touch touch point mode within a preset correction time and a preset correction standard deviation, including:

[0025] Calculate the distance change between each pair of contacts within a preset correction time to obtain the corrected distance change; calculate the mean of the distance change between all contact pairing combinations at each time point based on the corrected distance change; calculate the rate of change of the corrected distance based on all corrected distances within the preset correction time to obtain the corrected distance change rate; calculate the standard deviation of the corrected distance change rate to obtain the corrected distance change rate standard deviation; when the corrected distance change rate standard deviation is greater than the corrected standard deviation, reduce the unit coordinate distance according to the corrected standard deviation, the corrected distance change rate standard deviation and a preset correction coefficient.

[0026] Compared with the prior art, the beneficial effect of the present invention is that, by accurately collecting and analyzing the real-time information of the contacts, accurate recognition of single-point and multi-point touch gestures is achieved, and the gesture type can be flexibly determined according to the changes in the number of contacts, coordinates and pressure, thereby avoiding misoperation and improving the accuracy of the operation. The correction module dynamically adjusts the unit coordinate distance by calculating the standard deviation of the distance change rate, thereby maintaining a high response sensitivity and accuracy in different usage scenarios, significantly enhancing the adaptability of the system. The system not only improves the intelligence level of the teaching screen, but also optimizes the user experience, especially in the complex operations of multi-touch, and effectively solves the problems of inaccurate gesture recognition and slow response speed caused by insufficient accuracy in touch point information processing and delayed operation mode switching.

[0027] Furthermore, by comparing the contact pressure with the standard pressure in real time, it is possible to effectively filter out slight or unintentional touches and accurately determine whether the current operation is single-point touch or multi-point touch. This pressure-based determination method improves the accuracy of touch mode recognition and reduces the possibility of misjudgment.

[0028] Furthermore, accurate recognition of sliding gestures and dragging gestures is achieved through comprehensive analysis of the coordinates and pressure change rate under single-point touch.

[0029] Furthermore, by performing dual analysis on the coordinate change rate of the touch point and the duration of pressure, accurate recognition of click gestures and long-press gestures is achieved. The system can distinguish short-term clicks from long-term presses based on the duration of pressure, providing more accurate gesture recognition.

[0030] Furthermore, by using this formula to calculate the number of contact pairing combinations, the system can systematically process and analyze the relationship between all touch points, ensuring comprehensive coverage and accurate processing of multi-touch operations.

[0031] Furthermore, by accurately analyzing the changes in the distance and direction angle of each pair of touch points, we can understand the dynamic interaction between the touch points in detail, which can help the system accurately identify the changing pattern of touch gestures, including the movement and rotation of the touch points. Accurately calculating the distance and direction change rate improves the accuracy and reliability of multi-touch operations.

[0032] Furthermore, using a deep learning model to determine the type of multi-point gestures can significantly improve recognition accuracy and response speed. The deep learning model can handle complex gesture changes and automatically adapt to different operating environments, making the system faster and more accurate in processing zoom gestures.

[0033] Furthermore, through the deep learning model's detailed analysis of the distance and direction changes between touch points, the system can accurately identify rotation gestures and effectively distinguish rotation gestures from other gesture types, thereby improving the accuracy of gesture recognition.

[0034] Furthermore, when both the distance change rate and the direction change rate are lower than the preset threshold, it usually indicates that the relative position between the touch points does not change much and the direction changes slowly, which is consistent with the characteristics of a sliding gesture. The deep learning model can effectively distinguish sliding gestures from other types of gestures, such as zoom or rotation gestures.

[0035] Furthermore, by real-time monitoring of the distance changes between the touch points and calculating their standard deviations, irregular changes between the touch points can be effectively identified. When the standard deviation of the corrected distance change rate is too large, the system automatically reduces the unit coordinate distance, thereby improving touch accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 Schematic diagram of the teaching screen operating system based on artificial intelligence in this embodiment;

[0037] Figure 2 A decision logic diagram for determining a contact mode by a contact number determination unit in this embodiment;

[0038] Figure 3 A decision logic diagram for determining a sliding gesture by the action determination unit of this embodiment;

[0039] Figure 4 This is a decision logic diagram for the action determination unit of this embodiment to determine a long press gesture. DETAILED DESCRIPTION

[0040] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0041] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0042] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside" and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings. This is merely for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0043] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0044] See also Figure 1 As shown, it is a schematic diagram of the teaching screen operating system based on artificial intelligence in this embodiment;

[0045] This embodiment provides a teaching screen operating system based on artificial intelligence, including:

[0046] A touch point information acquisition module, used to acquire real-time touch point information of each touch point on the teaching screen, wherein the real-time touch point information includes real-time touch point coordinates and real-time pressure at the real-time touch point coordinates in a two-dimensional coordinate system established with the upper left corner of the teaching screen as the origin and a preset unit coordinate distance;

[0047] an analysis module, connected to the touch information acquisition module, comprising a touch number determination unit and an action determination unit, wherein the touch number determination unit is used to determine whether the touch mode is single-point touch or multi-point touch according to all real-time pressures within a preset determination time and a preset standard pressure, and the action determination unit is used to determine the single-point gesture type according to the touch mode, real-time touch coordinates and real-time pressure of the single-point touch;

[0048] The action determination unit is further used to determine a contact pairing combination according to a contact mode of the multi-touch control, a plurality of real-time contact coordinates, and a plurality of real-time pressures, calculate a distance change rate and a direction change rate of each pair of contacts in the contact pairing combination, and determine a multi-point gesture type of each contact according to the distance change rate, the direction change rate, and a preset gesture model standard value;

[0049] A response module, connected to the analysis module, for performing corresponding response actions according to the single-point gesture type and the multi-point gesture type;

[0050] The correction module is connected to the analysis module and the touch information acquisition module respectively, and is used to correct the unit coordinate distance according to all real-time touch coordinates of the multi-touch touch mode within a preset correction time and a preset correction standard deviation.

[0051] The preset unit coordinate distance refers to the basic measurement unit used to establish a two-dimensional coordinate system in the system, which determines the accuracy of the touch point position. It depends on the screen resolution, touch accuracy requirements, and the size of common gestures operated by users. It can usually be set to one pixel of the screen resolution or to several millimeters according to the accuracy of the touch device. In this embodiment, the unit coordinate distance is set to 1 mm. This setting can improve the system's responsiveness to small gesture changes while ensuring touch accuracy, making user operations smoother.

[0052] The preset determination duration is the time window used by the system to determine the touch mode (single point or multi-point). This parameter depends on the typical gesture duration in the operating scenario and the system response speed requirements. It is usually set to 50 to 200 milliseconds, which is enough to capture fast gesture changes without excessively delaying the response. In this embodiment, the determination duration is set to 100 milliseconds. This setting can accurately distinguish between fast clicks and multi-touch gestures while ensuring a sufficiently fast system response.

[0053] The preset standard pressure is the pressure threshold used by the system to distinguish between light touch and intentional touch. It depends on the sensitivity of the touch screen and the pressure range applied by a typical user. It is usually set to the middle value of the pressure range that the screen can detect, such as 100 to 200g of pressure. In this embodiment, the standard pressure is set to 150g. This setting can effectively filter unintentional light touches or slides, ensuring that only intentional operations by the user will be recognized and processed by the system.

[0054] The preset gesture model standard value is a reference value combination of the distance and direction change rate for identifying different gestures, which depends on the shape and speed of common gestures, such as the characteristics of zooming, rotating, and sliding actions. It is usually set to the common gesture feature value obtained by analyzing user behavior data. In this embodiment, the standard value is set to the average change rate of the zoom gesture in the user data.

[0055] The corresponding response action is the operation performed by the system based on the recognized gesture, including but not limited to zooming, rotating, and sliding. It depends on the needs of the application scenario and the user's common operation mode. It is usually set to the operation directly associated with the gesture type, such as pinch-to-zoom corresponding to zoom in or out.

[0056] The preset correction time is the time window used by the system to analyze the touch data and correct the unit coordinate distance. It depends on the system's demand for dynamic adjustment and the frequency of changes in the touch scene. It is usually set to a few seconds to tens of seconds to balance the real-time and stability of the system. In this embodiment, the correction time is set to 10 seconds. It can avoid too frequent adjustments while ensuring the sensitivity of the system, and maintain the continuity and smoothness of the operation.

[0057] The preset correction standard deviation is a reference value used to determine whether the unit coordinate distance needs to be adjusted. It depends on the stability of the touch operation and the response accuracy that the system hopes to achieve. It is usually set to an empirical value or a standard deviation range obtained through testing. In this embodiment, the standard deviation threshold is set to 2%. This setting ensures that the system does not make frequent adjustments when the touch operation is stable, and performs appropriate sensitivity adjustments when the operation is complex, thereby optimizing the user experience.

[0058] First, the real-time coordinates and pressure information of the touch points on the screen are collected through the touch information acquisition module. In the analysis module, the touch number determination unit determines whether the current operation is single-point touch or multi-point touch based on the number and pressure of the touch points. For single-point touch, the action determination unit determines the corresponding gesture type based on the coordinates and pressure of the touch points; for multi-point touch, the system generates a contact pairing combination, and determines the multi-point gesture type by calculating the distance change rate and direction change rate between the contact pairs, combined with the preset gesture model standard value. The response module performs the corresponding operation according to the identified gesture type. The correction module analyzes the touch coordinate data within the correction time, calculates the standard deviation of the distance change rate, and dynamically corrects the unit coordinate distance according to the preset standard deviation threshold to ensure the accuracy and sensitivity of the system operation.

[0059] By accurately collecting and analyzing the real-time information of the touch points, accurate recognition of single-point and multi-point touch gestures is achieved. The gesture type can be flexibly determined according to the changes in the number of touch points, coordinates and pressure, avoiding misoperation and improving the accuracy of the operation. The correction module dynamically adjusts the unit coordinate distance by calculating the standard deviation of the distance change rate, thereby maintaining a high response sensitivity and accuracy in different usage scenarios, significantly enhancing the adaptability of the system. The system not only improves the intelligence level of the teaching screen, but also optimizes the user experience, especially in complex multi-touch operations, and effectively solves the problems of inaccurate gesture recognition and slow response speed caused by insufficient touch point information processing accuracy and delayed operation mode switching.

[0060] Please continue reading Figure 2 As shown, it is a decision logic diagram of the contact number determination unit in this embodiment for determining the contact mode;

[0061] Specifically, the touch point number determination unit is used to determine whether the touch point mode is single-point touch or multi-point touch according to all real-time pressures within a preset determination time and a preset standard pressure, including:

[0062] The touch point number determination unit is used to obtain the number of touch points whose real-time pressure is greater than the standard pressure. When the number of touch points is equal to one, the touch point number determination unit determines that the touch point mode is single-point touch;

[0063] When the number of touch points is greater than one, the touch point number determination unit determines that the touch point mode is multi-touch.

[0064] The touch point number determination unit continuously monitors the touch points on the screen within a preset determination time and obtains the real-time pressure information of each touch point. The system compares these real-time pressures with the preset standard pressures and selects the touch points with pressures greater than the standard pressures. When the number of selected touch points is equal to one, the system determines that the current touch mode is single-point touch; when the number of selected touch points is greater than one, the system determines that it is multi-point touch. In this way, the system can accurately distinguish different touch modes according to the number and pressure of the touch points, providing a basis for subsequent gesture recognition.

[0065] By comparing the contact pressure with the standard pressure in real time, it can effectively filter out slight or unintentional touches and accurately determine whether the current operation is single-point touch or multi-point touch. This pressure-based determination method improves the accuracy of touch pattern recognition and reduces the possibility of misjudgment.

[0066] Please continue reading Figure 3 As shown, it is a decision logic diagram of the action determination unit determining the sliding gesture in this embodiment;

[0067] Specifically, when the contact point determination unit determines that the contact point mode is a single-point touch, the action determination unit calculates the change rate of all real-time contact point coordinates and real-time pressure within the determined time length to obtain the coordinate change rate and the pressure change rate. When the coordinate change rate is greater than a preset standard coordinate change rate, and the pressure change rate is less than or equal to a preset standard pressure change rate, the action determination unit determines that the single-point gesture type is a sliding gesture.

[0068] When the coordinate change rate is greater than a preset standard coordinate change rate, and the pressure change rate is greater than a preset standard pressure change rate, the action determination unit determines that the single-point gesture type is a drag gesture.

[0069] The preset standard pressure change rate refers to the reference value used by the system to identify pressure changes in single-point touch, which indicates the rate of pressure change within a certain period of time. This value depends on the pressure sensing capability of the touch device and the common pressure change pattern of the user's operation. It is usually set to 0.1 to 0.5 units / second, depending on the pressure sensing range of the actual device and the pressure change speed of the user's gesture. In this embodiment, the standard pressure change rate is set to 0.3 units / second. It can effectively distinguish between sliding and dragging gestures, allowing the system to more accurately identify the user's intentions while avoiding over-response to unintentional pressure fluctuations.

[0070] The preset standard coordinate change rate refers to the reference value used by the system to identify coordinate changes in single-point touch, which indicates the rate of change of the touch point coordinates within a certain period of time. This value depends on the common gesture speed of the user's operation and the resolution and response speed of the touch device. It is usually set to 1 to 5 pixels / second, depending on the resolution of the touch screen and the speed range of the user's operation. In this embodiment, the standard coordinate change rate is set to 2 pixels / second. This setting can accurately distinguish between sliding and dragging gestures, improve the system's ability to recognize gesture operations, and ensure that the system's response is stable and accurate in the case of fast movement or long dragging.

[0071] When the contact mode is determined to be a single-point touch, the action determination unit first calculates the change rate of all real-time contact coordinates and pressure within a determined time period. These change rates include coordinate change rate and pressure change rate. The system compares the coordinate change rate with the preset standard coordinate change rate to check whether it is greater than the standard value. At the same time, the pressure change rate is compared with the preset standard pressure change rate to check whether it is less than or equal to the standard value. If the coordinate change rate is greater than the standard value and the pressure change rate is less than or equal to the standard value, it is determined to be a sliding gesture; if the coordinate change rate is greater than the standard value and the pressure change rate is also greater than the standard value, it is determined to be a drag gesture. In this way, through accurate judgment of the change rate, the system can accurately identify the user's single-point gesture type.

[0072] Through comprehensive analysis of the coordinates and pressure change rate under single-point touch, accurate recognition of sliding gestures and dragging gestures is achieved.

[0073] Please continue reading Figure 4 As shown, it is a decision logic diagram of the action determination unit in this embodiment for determining a long press gesture;

[0074] Specifically, when the coordinate change rate is less than or equal to the preset standard coordinate change rate, the action determination unit records the duration of time when the real-time pressure is greater than the preset standard pressure to obtain the duration, and when the duration is less than the preset standard duration, the action determination unit determines that the single-point gesture type is a click gesture;

[0075] When the duration is greater than or equal to a preset standard duration, the action determination unit determines that the single-point gesture type is a long press gesture.

[0076] When the contact mode is determined to be a single-point touch, the action determination unit first calculates the coordinate change rate and compares it with the preset standard coordinate change rate. If the coordinate change rate is less than or equal to the standard value, the system will record the duration of the real-time pressure greater than the preset standard pressure. Subsequently, this duration is compared with the preset standard duration. If the duration is less than the standard duration, it is determined to be a click gesture; if the duration is greater than or equal to the standard duration, it is determined to be a long press gesture. In this way, by comprehensively analyzing the duration of the contact pressure and the rate of coordinate change, the system can accurately distinguish between click and long press gestures.

[0077] By performing dual analysis on the coordinate change rate of the touch point and the duration of pressure, accurate recognition of click gestures and long-press gestures is achieved. The system can distinguish short-term clicks from long-term presses based on the duration of pressure, providing more accurate gesture recognition.

[0078] Specifically, the action determination unit is further configured to determine the contact pairing combination according to the multi-touch contact mode, a number of real-time contact coordinates, and a number of real-time pressures, including:

[0079] When the contact number determination unit determines that the contact mode is multi-touch, the action determination unit calculates the number of contact pairing combinations according to the number of contacts, where A=n×(n-1) / 2, A is the number of contact pairing combinations, and n is the number of contacts.

[0080] When the touch mode is determined to be multi-touch, the action determination unit first obtains the number of current touch points n. Then, the system calculates the number A of all possible touch pairing combinations, using the formula A = n × (n-1) / 2. This formula represents the number of all possible combinations of selecting two touch points for pairing from n touch points. For example, if there are 4 touch points, the number of pairing combinations is 4 × (4-1) / 2 = 6. This calculation provides the basis for the subsequent analysis of the distance change rate and direction change rate between touch points.

[0081] By using this formula to calculate the number of contact pairing combinations, the system is able to systematically process and analyze the relationships between all contact points, ensuring comprehensive coverage and precise processing of multi-touch operations.

[0082] Specifically, the action determination unit is used to calculate the distance and direction angle of each pair of contacts in the contact pairing combination, and calculate the distance change rate and direction change rate between the contact pairings according to the distance and direction angle of each pair of contacts, wherein: dij is the distance between each pair of contacts within the determined time length, θij is the direction angle of each pair of contacts within the determined time length, xi is the horizontal coordinate of the real-time contact coordinates of the ith contact within the determined time length, xj is the horizontal coordinate of the real-time contact coordinates of the jth contact within the determined time length, yi is the vertical coordinate of the real-time contact coordinates of the ith contact within the determined time length, yj is the vertical coordinate of the real-time contact coordinates of the jth contact within the determined time length, dij(t) is the contact distance at moment t within the determined time length, dij(t-1) is the contact distance at the previous moment t-1 within the determined time length, and Δt is the time interval.

[0083] In the multi-touch mode, the main task of the action determination unit is to calculate the distance and direction angle between each pair of touch points, and then further determine the changes between the touch points based on these calculated values.

[0084] By accurately analyzing the changes in the distance and direction angle of each pair of touch points, we can understand the dynamic interaction between the touch points in detail, which can help the system accurately identify the changing pattern of touch gestures, including the movement and rotation of the touch points. Accurately calculating the distance and direction change rate improves the accuracy and reliability of multi-touch operations.

[0085] Specifically, a deep learning model is also provided in the action determination unit. The action determination unit uses the deep learning model to quickly determine that the multi-point gesture type is a zoom gesture when the distance change rate is greater than a preset standard distance change rate and the direction change rate is less than a preset standard direction change rate.

[0086] The preset standard distance change rate is a threshold set by the system to determine whether the distance change between the touch points is significant enough to identify a specific gesture type. In multi-touch, it is used to distinguish between zoom gestures (zoom in or out) and other gesture types. It depends on the user's operating requirements and the sensitivity of the screen. In general, the setting of the standard distance change rate should be able to capture the obvious changes when the user performs a zoom operation, while avoiding misjudgment of misidentification caused by small movements. The standard distance change rate is usually set at a moderate value, such as the distance change per second is greater than or equal to a certain threshold (for example, 0.5 to 2 pixels per second), and the specific value needs to be adjusted according to the screen resolution and application scenario. This embodiment is set to 0.5 pixels per second, which can effectively distinguish the changes in the distance between the touch points when the user performs a zoom gesture, while avoiding misidentification caused by small movements.

[0087] The preset standard direction change rate is a threshold set by the system, which is used to determine whether the direction angle change between the touch points is significant in order to identify the gesture type. In multi-touch, it is used to determine whether to perform a rotation gesture or other changes. It depends on the user's operating requirements and touch accuracy. The standard direction change rate should be able to accurately reflect the user's rotation gesture while avoiding misjudgment due to slight changes in direction. The standard direction change rate is usually set to the direction angle change per second, such as less than or equal to a certain threshold (for example, 1 to 5 degrees per second), and the specific value is adjusted according to the actual application situation. In this embodiment, it is set to 2 degrees per second, which can ensure that the system accurately distinguishes rotation gestures, reduces misrecognition caused by small changes in direction, and improves the accuracy of gesture recognition.

[0088] In the action determination unit, the deep learning model is used to identify and classify multi-point gestures. When the distance change rate of the contact pair combination is greater than the preset standard distance change rate, and the direction change rate is less than the preset standard direction change rate, the deep learning model will quickly determine that the current gesture is a zoom gesture by analyzing the real-time contact data and historical gesture samples. The deep learning model uses its training ability on large-scale gesture data to efficiently identify complex gesture patterns and thus accurately classify them.

[0089] Using deep learning models to determine the type of multi-point gestures can significantly improve recognition accuracy and response speed. Deep learning models can handle complex gesture changes and automatically adapt to different operating environments, making the system faster and more accurate when processing zoom gestures.

[0090] Specifically, the action determination unit is used to determine that the multi-point gesture type is a rotation gesture when the distance change rate is less than or equal to a preset standard distance change rate, and the direction change rate is greater than or equal to a preset standard direction change rate.

[0091] In the multi-touch mode, the action determination unit is used to analyze the changes of each pair of contact points to determine the gesture type.

[0092] By analyzing the distance and direction changes between the touch points in detail, the system can accurately identify the rotation gesture. This method can effectively distinguish the rotation gesture from other gesture types, thereby improving the accuracy of gesture recognition.

[0093] Specifically, the action determination unit is used to determine that the multi-point gesture type is a sliding gesture when the distance change rate is less than or equal to a preset standard distance change rate, and the direction change rate is less than a preset standard direction change rate.

[0094] In the multi-touch mode, the action determination unit identifies the gesture type according to the change rate between the touch points.

[0095] When both the distance change rate and the direction change rate are lower than the preset threshold, it usually indicates that the relative position between the touch points does not change much and the direction changes slowly, which is consistent with the characteristics of a sliding gesture. It can effectively distinguish sliding gestures from other types of gestures, such as zoom or rotation gestures.

[0096] Specifically, the correction module is used to correct the unit coordinate distance according to all real-time touch point coordinates of the multi-touch touch point mode within a preset correction time and a preset correction standard deviation, including:

[0097] Calculate the distance change between each pair of contacts within a preset correction time to obtain the corrected distance change; calculate the mean of the distance change between all contact pairing combinations at each time point according to the corrected distance change; calculate the rate of change of the corrected distance according to all the corrected distances within the preset correction time to obtain the corrected distance change rate; calculate the standard deviation of the corrected distance change rate to obtain the corrected distance change rate standard deviation; when the corrected distance change rate standard deviation is greater than the corrected standard deviation, reduce the unit coordinate distance according to the corrected standard deviation, the corrected distance change rate standard deviation and the preset correction coefficient, wherein D'=Dk×(σΔdrate-σ), D' is the corrected unit coordinate distance, D is the unit coordinate distance, k is the correction coefficient, σΔdrate is the corrected distance change rate standard deviation, and σ is the corrected standard deviation.

[0098] The correction coefficient is a parameter used to control the adjustment range of the unit coordinate distance. It plays a balancing role in the correction calculation process to ensure that the corrected unit coordinate distance will not be over- or under-adjusted. If the system needs to be very sensitive to contact changes, the correction coefficient will be set larger, so that once the standard deviation exceeds the threshold, the adjustment range of the unit coordinate distance will also be larger. If the system requires higher stability to avoid frequent adjustments, the correction coefficient will be set smaller, so that the corrected changes are smoother. In this embodiment, it is set to 0.5 to ensure that when the standard deviation deviates from the threshold, the unit coordinate distance is adjusted appropriately, which can respond to contact changes without causing excessive fluctuations in the system.

[0099] Within the preset correction time, the system first calculates the distance change between each pair of contacts to obtain the corrected distance change. Next, the system calculates the mean distance change between all contact pairings at each time point, and then calculates the rate of change of the corrected distance through all the corrected distance changes within the preset time, and calculates its standard deviation. If the standard deviation exceeds the preset correction standard deviation, the system will reduce the unit coordinate distance according to the correction coefficient and the standard deviation difference.

[0100] By real-time monitoring of the distance changes between the touch points and calculating their standard deviation, irregular changes between the touch points can be effectively identified. When the standard deviation of the corrected distance change rate is too large, the system automatically reduces the unit coordinate distance to improve touch accuracy.

[0101] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

[0102] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A teaching screen operating system based on artificial intelligence, characterized in that: include: A touch point information acquisition module, used to acquire real-time touch point information of each touch point on the teaching screen, wherein the real-time touch point information includes real-time touch point coordinates and real-time pressure at the real-time touch point coordinates in a two-dimensional coordinate system established with the upper left corner of the teaching screen as the origin and a preset unit coordinate distance; an analysis module, connected to the touch information acquisition module, comprising a touch number determination unit and an action determination unit, wherein the touch number determination unit is used to determine whether the touch mode is single-point touch or multi-point touch according to all real-time pressures within a preset determination time and a preset standard pressure, and the action determination unit is used to determine the single-point gesture type according to the touch mode, real-time touch coordinates and real-time pressure of the single-point touch; The action determination unit is further used to determine a contact pairing combination according to a contact mode of the multi-touch control, a plurality of real-time contact coordinates, and a plurality of real-time pressures, calculate a distance change rate and a direction change rate of each pair of contacts in the contact pairing combination, and determine a multi-point gesture type of each contact according to the distance change rate, the direction change rate, and a preset gesture model standard value; A response module, connected to the analysis module, for performing corresponding response actions according to the single-point gesture type and the multi-point gesture type; The correction module is connected to the analysis module and the touch information acquisition module respectively, and is used to correct the unit coordinate distance according to all real-time touch coordinates of the multi-touch touch mode within a preset correction time and a preset correction standard deviation.

2. The teaching screen operating system based on artificial intelligence according to claim 1 is characterized in that: The touch point number determination unit is used to determine whether the touch point mode is single-point touch or multi-point touch according to all real-time pressures within a preset determination time and a preset standard pressure, and includes: The touch point number determination unit is used to obtain the number of touch points whose real-time pressure is greater than the standard pressure. When the number of touch points is equal to one, the touch point number determination unit determines that the touch point mode is single-point touch; When the number of touch points is greater than one, the touch point number determination unit determines that the touch point mode is multi-touch.

3. The teaching screen operating system based on artificial intelligence according to claim 2 is characterized in that: When the contact point number determination unit determines that the contact point mode is a single-point touch, the action determination unit calculates the change rate of all real-time contact point coordinates and real-time pressure within the determined time length to obtain the coordinate change rate and the pressure change rate. When the coordinate change rate is greater than a preset standard coordinate change rate, and the pressure change rate is less than or equal to a preset standard pressure change rate, the action determination unit determines that the single-point gesture type is a sliding gesture; When the coordinate change rate is greater than a preset standard coordinate change rate, and the pressure change rate is greater than a preset standard pressure change rate, the action determination unit determines that the single-point gesture type is a drag gesture.

4. The teaching screen operating system based on artificial intelligence according to claim 3 is characterized in that: When the coordinate change rate is less than or equal to the preset standard coordinate change rate, the action determination unit records the duration of time when the real-time pressure is greater than the preset standard pressure to obtain the duration, and when the duration is less than the preset standard duration, the action determination unit determines that the single-point gesture type is a click gesture; When the duration is greater than or equal to a preset standard duration, the action determination unit determines that the single-point gesture type is a long press gesture.

5. The teaching screen operating system based on artificial intelligence according to claim 4 is characterized in that: The action determination unit is also used to determine the contact point pairing combination according to the contact point mode of the multi-touch, a number of real-time contact point coordinates and a number of real-time pressures, including: The action determination unit calculates the number of contact point pairing combinations according to the number of the contacts when the contact point number determination unit determines that the contact point mode is multi-touch.

6. The teaching screen operating system based on artificial intelligence according to claim 5 is characterized in that: The action determination unit is used to calculate the distance and direction angle of each pair of touch points in the touch point pairing combination, and calculate the distance change rate and direction change rate between the touch point pairs according to the distance and direction angle of each pair of touch points.

7. The teaching screen operating system based on artificial intelligence according to claim 6 is characterized in that: The action determination unit is used for determining that the multi-point gesture type is a zoom gesture when the distance change rate is greater than a preset standard distance change rate and the direction change rate is less than a preset standard direction change rate.

8. The teaching screen operating system based on artificial intelligence according to claim 7 is characterized in that: The action determination unit is used to determine that the multi-point gesture type is a rotation gesture when the distance change rate is less than or equal to a preset standard distance change rate and the direction change rate is greater than or equal to a preset standard direction change rate.

9. The teaching screen operating system based on artificial intelligence according to claim 8 is characterized in that: The action determination unit is used to determine that the multi-point gesture type is a sliding gesture when the distance change rate is less than or equal to a preset standard distance change rate, and the direction change rate is less than a preset standard direction change rate.

10. The teaching screen operating system based on artificial intelligence according to claim 9 is characterized in that: The correction module is used to correct the unit coordinate distance according to all real-time touch point coordinates of the multi-touch touch point mode within a preset correction time and a preset correction standard deviation, including: Calculate the distance change between each pair of contacts within a preset correction time to obtain the corrected distance change; calculate the mean of the distance change between all contact pairing combinations at each time point based on the corrected distance change; calculate the rate of change of the corrected distance based on all corrected distances within the preset correction time to obtain the corrected distance change rate; calculate the standard deviation of the corrected distance change rate to obtain the corrected distance change rate standard deviation; when the corrected distance change rate standard deviation is greater than the corrected standard deviation, reduce the unit coordinate distance according to the corrected standard deviation, the corrected distance change rate standard deviation and a preset correction coefficient.

Images