Intelligent blackboard interaction management method and system based on touch identification
By analyzing historical interaction data of the smart blackboard, identifying worn areas, and introducing a pen-starting delay mode index, and selecting reference users for adaptive correction, the pen-starting response problem caused by wear on the smart blackboard was solved, and the interactive performance of worn areas was optimized.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- DONGFANG ZHONGYUAN (SHENZHEN) OPTICAL DISPLAY TECH CO LTD
- Filing Date
- 2026-01-09
- Publication Date
- 2026-04-28
AI Technical Summary
Existing smart blackboards suffer from delayed pen response and missed response due to uneven wear in different areas during long-term use. Current technology fails to effectively distinguish between regional differences and user habits, resulting in a degraded interactive experience.
By analyzing historical interaction data of the smart blackboard, worn areas are identified and a pen start delay mode index is introduced. Reference users are selected for adaptive correction, and touch sensitivity is adjusted to improve the pen start response in worn areas.
Without changing the operator's habits, improve the interaction consistency and stability of the wear area, enhance the pen start response effect of the wear area, and extend the service life of the equipment.
Smart Images

Figure CN121934731A_ABST
Abstract
Description
Technical Field
[0001] This invention belongs to the field of smart education touch interaction data management technology, and in particular relates to a smart blackboard interaction management method and system based on touch recognition. Background Technology
[0002] With the development of educational informatization and intelligentization, smart blackboards, as teaching devices integrating display, touch interaction, and teaching management, have been widely used in teaching scenarios. Existing smart blackboards typically possess the ability to recognize and process touch input, supporting various interactive operations such as writing, annotation, erasing, and function control. To enhance the interactive experience, related technical solutions often process and optimize touch input by setting unified touch sensitivity parameters, touch thresholds, or calibration mechanisms based on preset rules. These methods can meet basic teaching interaction needs in the initial stages of device use and represent relatively mature interactive management methods among existing technologies.
[0003] However, in actual long-term use, different areas of the smart blackboard often exhibit inconsistent surface wear due to differences in usage frequency and methods, especially the functional display areas that host frequently used functions, where wear is more pronounced. Existing technologies typically address this wear issue by adjusting overall parameters or using calibration based on fixed thresholds. These methods fail to differentiate response differences between areas in non-functionally triggered interaction scenarios, and do not fully consider the differences in pen-starting behavior characteristics exhibited by operators during natural interactions such as writing and annotation. Consequently, when the functional display areas are used for interactive teaching content, issues such as delayed pen-starting responses and missed responses can easily occur, leading to a degraded user experience.
[0004] Furthermore, existing technologies generally lack sophisticated analytical methods for the relationship between operator interaction habits and the wear and tear of different areas. On the one hand, the degree of wear itself is difficult to quantify accurately, and adjusting parameters directly based on wear status lacks reliable basis. On the other hand, different operators exhibit significant individual differences in their pen-starting rhythm and delay, making it difficult to simultaneously adapt to the interaction needs of different users with uniform sensitivity or threshold adjustments. Therefore, existing smart blackboard interaction management solutions struggle to effectively alleviate the degradation of pen-starting response caused by localized wear while maintaining natural writing habits. There is an urgent need for a technical solution that can adaptively compensate for the interaction performance of worn areas by combining historical interaction data, operator differences, and regional characteristics. Summary of the Invention
[0005] The purpose of this invention is to provide a smart blackboard interactive management method and system based on touch recognition, which aims to solve the problems mentioned in the background art.
[0006] This invention is implemented as follows: a smart blackboard interactive management method based on touch recognition, the method comprising:
[0007] Before the target personnel use the smart blackboard, retrieve the historical usage database of the smart blackboard and obtain the first sample that matches the target personnel's current usage context.
[0008] The first sample was analyzed to obtain non-functional trigger-type interaction trajectory data of the target personnel in different areas of the smart blackboard, and the effective response rate of the pen stroke in each area was calculated accordingly.
[0009] Compare the effective response rate of the pen stroke in different areas to determine whether there is a designated area. The designated area is an area that is simultaneously a functional hot zone display area and whose effective response rate of the pen stroke is lower than a preset ratio of the effective response rate of the pen stroke in the non-functional hot zone area.
[0010] If it is determined that it exists, extract several second samples from the database that are consistent with the current usage background but correspond to different operators, and calculate the starting delay pattern index of each second sample and its effective starting response rate in the specified area. Select the reference personnel based on the highest effective starting response rate.
[0011] Obtain the starting delay pattern index of the target personnel, perform a difference analysis between it and the starting delay pattern index of the reference personnel, generate a correction factor, and adaptively correct the touch sensitivity of the specified area accordingly.
[0012] As a further limitation of the technical solution of the present invention, the phrase "matching the target user's current usage context" means that at least one of the following aspects of the first sample or the second sample is consistent with or falls within the preset allowable error range of the target user's current usage: teaching content type, interactive operation type, and usage time period.
[0013] As a further limitation of the technical solution of the present invention, the non-functional trigger type refers to the interactive operation corresponding to the interactive trajectory data that does not trigger the function control instruction of the smart blackboard, and is used for content writing, annotation or trajectory drawing.
[0014] As a further limitation of the technical solution of this embodiment of the invention, the calculation process of the effective response rate of the initial stroke includes:
[0015] The interaction trajectory data is analyzed to obtain the touch press event, trajectory point generation event, and their corresponding time and position information corresponding to the pen stroke operation; the trajectory point generation event is an event that generates handwriting trajectory points based on touch input.
[0016] For each pen stroke, based on the time difference between the touch press event and the trajectory point generation event, it is determined whether the trajectory point is generated within a preset time threshold, and based on the distance between the position corresponding to the touch press event and the trajectory point generation position, it is determined whether the trajectory point falls within a preset spatial threshold range.
[0017] If the trajectory point is generated within a preset time threshold and falls within a preset spatial threshold range, the starting operation is determined as a valid response starting operation, and the number of valid response starting operations is counted; if the trajectory point is not generated or the preset time threshold or the preset spatial threshold is not met, the starting operation is determined as an invalid response starting operation.
[0018] The effective response rate is obtained by calculating the ratio of the number of effective response strokes to the total number of strokes in the corresponding area.
[0019] As a further limitation of the technical solution of this embodiment of the invention, the calculation process of the starting delay mode index includes:
[0020] The interaction trajectory data is parsed to obtain the touch press event and touch terminal movement event corresponding to the pen start operation, and the corresponding time information is obtained; the touch terminal movement event is the event in which the touch input terminal detects the displacement of the touch position and generates position change information after the touch is pressed.
[0021] The starting delay time corresponding to each starting operation is determined based on the time difference between the touch press event and the touch terminal movement event.
[0022] Statistical analysis of the pen-starting delay time yields a pen-starting delay pattern index that characterizes the pen-starting behavior of the current operator.
[0023] As a further limitation of the technical solution of this invention, the steps of obtaining the starting delay pattern index of the target person, performing difference analysis between it and the starting delay pattern index of the reference person, generating a correction factor, and adaptively correcting the touch sensitivity of the specified area accordingly include:
[0024] Calculate the starting delay pattern index of the target personnel based on the historical usage database, and obtain the corresponding starting delay pattern index of the reference personnel.
[0025] A quantitative difference analysis was conducted between the starting delay pattern index of the target personnel and the starting delay pattern index of the reference personnel to generate correction factors.
[0026] The touch sensitivity of the specified area is adaptively adjusted based on the correction factor, so that the initial stroke triggering effect of the target person when performing non-functional triggering interaction in the specified area is close to the initial stroke triggering effect of the reference person.
[0027] As a further limitation of the technical solution of this embodiment of the invention, when adaptively correcting the touch sensitivity of a specified area, a preset correction function is used, wherein the correction function is:
[0028] ;
[0029] in, This refers to the corrected touch sensitivity of a specified area. This refers to the touch sensitivity of the specified area before correction. This refers to the writing delay pattern indicator of the target personnel. This refers to the writing delay pattern indicator of the reference personnel. This refers to the correction factor. This refers to the preset correction strength coefficient, and satisfies... , and These are the maximum and minimum allowable values for touch sensitivity, respectively.
[0030] As a further limitation of the technical solution of this embodiment of the invention, when the target person performs interactive operation in the designated area and the designated area is in the functional hot zone display state, the touch sensitivity of the designated area is not corrected.
[0031] A smart blackboard interactive management system based on touch recognition, the system comprising:
[0032] The sample acquisition module is used to retrieve the historical usage database of the smart blackboard before the target person uses it, and obtain the first sample that matches the target person's current usage background.
[0033] The response rate calculation module is used to analyze the first sample, obtain the non-functional trigger-type interaction trajectory data of the target person in different areas of the smart blackboard, and calculate the effective response rate of the pen stroke in each area accordingly.
[0034] The designated area determination module is used to compare the effective response rate of the pen stroke in different areas and determine whether a designated area exists. The designated area is an area that is simultaneously a functional hot zone display area and whose effective response rate of the pen stroke is lower than a preset ratio of the effective response rate of the pen stroke in the non-functional hot zone area.
[0035] The reference personnel determination module is used to extract several second samples from the database that are consistent with the current usage background but correspond to different operators if the determination exists, and to calculate the starting delay pattern index of each second sample and its starting effective response rate in the specified area, and select the reference personnel based on the highest starting effective response rate.
[0036] The sensitivity adaptive correction module is used to obtain the starting delay pattern index of the target person, analyze the difference between it and the starting delay pattern index of the reference person, generate a correction factor, and adaptively correct the touch sensitivity of the specified area accordingly.
[0037] As a further limitation of the technical solution of the present invention, the phrase "matching the target user's current usage context" means that at least one of the following aspects of the first sample or the second sample is consistent with or falls within the preset allowable error range of the target user's current usage: teaching content type, interactive operation type, and usage time period.
[0038] Compared with the prior art, the present invention has the following beneficial effects:
[0039] This invention, through analysis of historical interaction data of smart blackboards, proposes a targeted and adaptive interaction management scheme to address the degradation of pen-starting response caused by wear and tear on functional hot zones during long-term use in non-functionally triggered interaction scenarios. Unlike existing technologies that rely solely on absolute thresholds or uniform parameter adjustments, this invention first objectively identifies designated wear areas for specific users based on a relative comparison of effective pen-starting response rates across regions. Then, through comparison of multiple user samples, it introduces a pen-starting delay pattern index to select the reference user most suited to the wear state, thereby avoiding the uncertainty caused by directly modeling the degree of wear.
[0040] Building upon this foundation, the present invention transforms the operator's unchangeable pen-starting habits into adjustable system parameters. Through limited adaptive correction of touch sensitivity, it achieves compensation and optimization of the pen-starting response effect in worn areas. This solution requires no additional hardware support and can improve the interaction consistency and stability of worn areas while maintaining natural writing habits, demonstrating good practicality, scalability, and application value. Attached Figure Description
[0041] Figure 1 A flowchart of the method provided in the embodiments of the present invention;
[0042] Figure 2 This is a flowchart illustrating the dynamic correction of touch sensitivity in the method provided in this embodiment of the invention;
[0043] Figure 3 The application architecture diagram of the system provided in the embodiments of the present invention. Detailed Implementation
[0044] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.
[0045] Figure 1 A flowchart of the method provided by an embodiment of the present invention is shown.
[0046] Specifically, a smart blackboard interactive management method based on touch recognition includes the following steps:
[0047] Step S100: Before the target person uses the smart blackboard, retrieve the historical usage database of the smart blackboard and obtain the first sample that matches the target person's current usage background.
[0048] The phrase "matching the target user's current usage context" means that the first sample is consistent with or falls within a preset allowable error range in at least one of the following: teaching content type, interactive operation type, and usage time period.
[0049] Step S200: Analyze the first sample to obtain non-functionally triggered interaction trajectory data of the target person in different areas of the smart blackboard, and calculate the effective response rate of the pen stroke in each area accordingly. The non-functionally triggered type refers to the interaction operation corresponding to the interaction trajectory data that does not trigger the smart blackboard's function control instructions and is used for content writing, annotation, or trajectory drawing.
[0050] Step S300: Compare the effective response rates of the starting strokes in different areas to determine whether a specified area exists. The specified area is an area that simultaneously belongs to the functional hot zone display area and whose effective response rate of the starting strokes is lower than a preset proportion of the effective response rate of the starting strokes in the non-functional hot zone area.
[0051] In this embodiment of the invention, the target smart blackboard is a display interaction device with touch recognition capability, which may include a display panel, a touch recognition component, a processor, and a memory. The touch recognition component is used to detect the contact state and contact position change information between a stylus (mainly) or a finger and the blackboard surface. The processor is used to parse the touch input output by the touch recognition component and generate corresponding interactive trajectory data. Taking a stylus as an example, when an operator uses a stylus to perform actions such as pressing, moving, and lifting on the smart blackboard surface, the touch recognition component can output basic events such as touch press events and touch end movement events. The processor can generate handwriting trajectory points based on the touch input to present handwriting, thereby forming a trajectory point generation event, and further obtaining interactive trajectory data that can be used for subsequent calculations. The collection and recording of the above-mentioned touch events, time information, and position information belong to the mature interactive input processing flow in the prior art, and can be directly obtained through the driver layer, input event distribution layer, or application layer log interface of the smart blackboard system.
[0052] The core research focus of this invention is that existing smart blackboards often exhibit regional differences in surface wear during long-term use, with the functional hotspot display area being a typical example. This area is typically used in classroom settings to house frequently used function entry points or control buttons. Due to its high usage frequency, operators often exhibit more purposeful actions to ensure the certainty of function triggering, such as more concentrated repeated clicking, more forceful pressing, and more precise targeting. This makes the touch surface and recognition link in this area more prone to cumulative wear, resulting in a relative decrease in the responsiveness of this area in subsequent touch input processing. At the same time, the functional hotspot display area is not always in a functional display state. In scenarios such as full-screen display, courseware presentation, and blackboard extension, this area is also used for interactive teaching content such as writing, annotation, or trajectory drawing. At this point, there is a significant difference between the operator's interaction method and the function-triggered operation: In the content interaction scenario, the operator usually follows the same natural writing and annotation habits as other areas, especially in the initial writing stage, showing an unintentional, continuous rhythm of movement, such as a light touch and pause at the beginning of the stroke, and a natural transition from stillness to movement; even if the operator can subjectively feel that the worn area "requires more force and precision" when clicking the function, they may not actively adjust to the same intensity or the same level of focus when interacting with content, thus making it easier for insufficient response at the beginning of the stroke to occur in the worn area, manifested as missing response at the beginning of the stroke, delay at the beginning of the stroke, and deviation of the starting point.
[0053] Based on this, the present invention recognizes that different operators have different pen-starting delay mode indicators, that is, statistical characteristics of the time difference between pressing the touch and the movement of the touch end. Some operators start writing faster, while others start writing slower. In non-wear areas, the above differences usually do not significantly affect the pen-starting experience because the touch recognition capability in this area is sufficient, and the system can generate pen trajectory points in a timely manner and present a natural pen-starting experience. However, in designated areas with higher wear levels, due to the decrease in touch recognition capability, the system is more likely to fail to generate pen trajectory points in a timely manner or generate them at positions deviating from the starting point. As a result, operators with different pen-starting delay mode indicators exhibit significantly different effective pen-starting response rates in the designated area.
[0054] In step S100, the retrieved historical usage database can be automatically generated by the smart blackboard during daily use. Its data sources may include touch input event logs output by the touch recognition component, rendering / handwriting engine logs of handwriting trajectory points generated by the system, application layer interaction logs, and contextual information related to the classroom or usage scenario. The methods for acquiring this data are all mature log recording and event collection methods in the existing technology. The historical usage database may contain at least the following types of data: time information for each interaction (such as timestamp, date, time period), interaction operation type information (such as categories or inferable features of touch, swipe, writing, annotation, trajectory drawing, etc.), interaction trajectory data (at least including touch position sequence and its time sequence information), function control command trigger records (used to determine whether a function control command of the smart blackboard has been triggered), function hotspot display status records (used to determine whether a certain area is in function hotspot display status), and associated information used to characterize the type of teaching content (such as courseware type labels, blackboard mode / annotation mode markers, current application or page type, etc.). In this embodiment of the invention, the historical usage database can be implemented using local storage or cloud storage. The data can be indexed and retrieved by class, user, application session, or time period, all of which are mature implementations in the field.
[0055] To improve the representativeness of the first sample to the target user's current usage scenario, this invention performs a rigorous screening process for "matching the target user's current usage background" in step S100. The reason for this rigorous screening is that both the effective response rate and the starting delay pattern index are affected by the usage context. For example, different types of teaching content correspond to different writing densities, annotation frequencies, and pause rhythms; different types of interactive operations correspond to significant differences in trajectory patterns and starting actions; and different usage periods may correspond to different usage intensities and operator states. If the sample backgrounds differ too much, the statistical results of the effective response rate are easily disturbed by non-wear factors, thus affecting the accuracy of the determination of the designated area. Therefore, based on meeting the background matching conditions, this invention preferably selects sample data whose time is closest to the target user's current usage time as the first sample to reduce the bias caused by time-related factors such as changes in equipment status, wear processes, and system versions. The purpose and significance of determining the first sample is as follows: The first sample is used to characterize the recent interactive performance of the target personnel on the smart blackboard, and to determine whether there is a designated area for the target personnel. Since different operators have different pen-starting delay pattern indicators, the wear and tear of the same smart blackboard will have different effects on different operators. Therefore, using the first sample that matches the background of the target personnel and is close in time as the basis for evaluation helps to more objectively identify the designated area "for the target personnel", rather than just identifying the area differences that "may exist for everyone".
[0056] In step S200, the basis for using non-functionally triggered interaction trajectory data as the calculation basis is that functionally triggered operations usually have stronger purposefulness and compensatory characteristics. Operators may actively combat the uncertainty caused by wear by applying more force, clicking repeatedly, or reducing the touch range. Moreover, the system often has a different judgment strategy for triggering functional control commands than for handwriting generation, making it difficult for functionally triggered operations to truly reflect the pen-starting response capability of the worn area under natural content interaction. In contrast, non-functionally triggered interactions better reflect the difference between the operator's natural pen-starting rhythm and the system response in content interaction scenarios. Therefore, using it as the basis for calculating the effective pen-starting response rate can more accurately characterize the pen-starting response problem of the worn area in content interaction scenarios. This is one of the creative improvements of this invention compared to judging wear solely based on click success rate or functional trigger success rate.
[0057] In this embodiment of the invention, the calculation process of the effective response rate of the initial stroke includes: parsing the interaction trajectory data to obtain the touch press event, trajectory point generation event, and their corresponding time and position information corresponding to the initial stroke operation; the trajectory point generation event is an event that generates handwriting trajectory points based on touch input. For each initial stroke operation, based on the time difference between the touch press event and the trajectory point generation event, it is determined whether the trajectory point is generated within a preset time threshold, and based on the distance between the position corresponding to the touch press event and the trajectory point generation position, it is determined whether the trajectory point falls within a preset spatial threshold range. If the trajectory point is generated within the preset time threshold and falls within the preset spatial threshold range, the initial stroke operation is determined as a valid response initial stroke, and the number of valid response initial strokes is counted; if the trajectory point is not generated or the preset time threshold or the preset spatial threshold is not met, the initial stroke operation is determined as an invalid response initial stroke.
[0058] The effective response rate is obtained by calculating the ratio of the number of effective response strokes to the total number of strokes in the corresponding area. The preset time threshold and preset spatial threshold range can be determined comprehensively using mature parameters in existing technologies, such as touch event sampling period, input debouncing strategy, handwriting engine generation delay, display refresh period, and touch positioning error range. For example, the preset time threshold can be set to cover a reasonable time window required for normal stroke recognition and handwriting point generation to exclude obvious delayed responses; the preset spatial threshold range can be determined based on touch positioning error, handwriting rendering start point alignment error, etc., to exclude obvious start point offsets. By introducing a joint judgment of time and space dimensions, this invention can simultaneously cover various wear-related stroke anomalies such as missed responses, delayed responses, and start point offsets, thereby enabling the effective response rate to more comprehensively and objectively reflect the stroke response quality of different areas in content interaction scenarios.
[0059] Touch press events and trajectory point generation events are both basic events that can be reliably obtained in the existing smart blackboard touch input processing flow. Touch press events are generated when the touch input terminal detects a contact, and trajectory point generation events are generated when the system generates handwriting trajectory points based on touch input. Both can be directly obtained through existing touch controllers or interactive system log interfaces.
[0060] In step S300, the reason for determining whether a specified area exists is that: the functional hot zone display area is more prone to high wear and tear during long-term use, and is often used as a normal interaction area (such as in full-screen mode). However, it cannot be directly inferred that it will necessarily have a pen response problem in the content interaction scenario simply because it belongs to the functional hot zone display area. At the same time, the effective pen response rate is affected by individual device differences, environmental conditions and operator habits. If an absolute threshold is used for judgment, it is easy to cause incomparability or misjudgment between different devices.
[0061] By comparing the functional hot zone display area with the non-functional hot zone area and using a preset ratio as the relative judgment standard, the non-functional hot zone area of the smart blackboard itself can be used as a reference baseline to reduce the impact of device differences and environmental differences. This makes the judgment of the designated area more adaptive and objective, and ensures that the identified designated area does indeed show a significantly lower effective response rate for pen strokes than the conventional area. This provides a reliable basis for generating correction factors based on the differences in pen stroke delay mode indicators and correcting the touch sensitivity of the designated area.
[0062] The above-mentioned determination method corresponds to the technical idea in the core research point of this invention regarding the identification of the impact of functional hot zone wear on pen response in non-functional trigger-type interaction scenarios through relative comparison.
[0063] Furthermore, the smart blackboard interaction management method based on touch recognition also includes the following steps:
[0064] Step S400: If it is determined that a second sample exists, extract several second samples from the database that are consistent with the current usage background but correspond to different operators, and calculate the starting delay pattern index of each second sample and its effective starting response rate in the specified area. Select the reference personnel based on the highest effective starting response rate. Consistent with step 100, the second sample must be consistent with the target personnel's current usage in at least one of the following aspects: teaching content type, interactive operation type, and usage time period, or fall within the preset allowable error range.
[0065] The calculation process of the pen start delay pattern index includes: parsing the interaction trajectory data, obtaining the touch press event and touch terminal movement event corresponding to the pen start operation, and obtaining the corresponding time information. The touch terminal movement event is the event in which the touch input terminal detects a displacement of the touch position and generates position change information after the touch is pressed. Based on the time difference between the touch press event and the touch terminal movement event, the pen start delay time corresponding to each pen start operation is determined. The pen start delay time is statistically analyzed to obtain the pen start delay pattern index used to characterize the pen start behavior of the current operator.
[0066] In this embodiment of the invention, step S400 is used to provide a reference basis for subsequent adaptive correction of touch sensitivity, given that a designated area has already been determined to exist. Since it has been confirmed in step S300 that, for the target user, the effective response rate of the designated area when performing non-functional triggered interactions is significantly lower than that of the non-functional hotspot area, it can be reasonably inferred that the target user does indeed experience poor pen response when performing non-functional triggered interactions such as writing, annotation, or trajectory drawing in the designated area. This situation mainly stems from the decreased touch recognition capability caused by the wear and tear of the designated area. However, in practical applications, the degree of wear itself is difficult to quantify precisely, and different operators exhibit significant differences in their pen adaptation ability and interaction performance when facing the same worn area. Therefore, it is difficult to directly determine the optimal parameter correction method for the designated area based solely on the degree of wear.
[0067] Based on the above understanding, this invention introduces a second sample screening and analysis mechanism in step S400. Several second samples, consistent with the target user's current usage context but corresponding to different operators, are extracted from the historical usage database. These samples are then compared and analyzed to assess the initial writing performance of different operators in the same designated area. Similar to step S100, the second samples must match or fall within a preset allowable error range in at least one of the following: teaching content type, interactive operation type, and usage time. This ensures comparability between different samples in terms of usage context and avoids introducing additional interference factors due to differences in content type, interaction mode, or time.
[0068] In this embodiment of the invention, by calculating the starting delay pattern index and the effective starting response rate in a specified area for each second sample, it can be observed that different operators exhibit significantly different effective starting response rates in the specified area due to differences in their own starting habits. Among these differences, there is often an operator whose starting delay pattern index is more easily and accurately identified by the system under the current wear conditions in the specified area, thus resulting in a relatively higher effective starting response rate in the specified area. The starting delay pattern index of this operator can be understood as a starting behavior characteristic that is more suitable for the wear level in the specified area. Therefore, this invention selects a reference operator based on the highest effective starting response rate, and uses the starting delay pattern index of the reference operator as a reference standard in the subsequent correction process, thereby avoiding the uncertainty caused by directly modeling the wear level or relying on absolute threshold adjustment.
[0069] The process of obtaining the pen-starting delay pattern index is based on mature touch event acquisition and time analysis methods in existing technologies. Specifically, by parsing the interaction trajectory data, the touch press event and touch terminal movement event corresponding to the pen-starting operation are obtained, along with their corresponding time information. The touch terminal movement event is the event where the touch input terminal detects a displacement of the touch position and generates position change information after the touch is pressed. This type of event is usually directly provided by the touch controller or operating system input event mechanism and belongs to the basic input events that can be stably acquired in existing smart blackboard systems and touch devices. Based on the time difference between the touch press event and the touch terminal movement event, the pen-starting delay time corresponding to each pen-starting operation can be determined, and the pen-starting delay time can be statistically analyzed, such as calculating its mean, distribution characteristics, or stable interval, thereby obtaining a pen-starting delay pattern index to characterize the pen-starting behavior of the current operator. Through the above method, this invention can objectively characterize the pen-starting delay characteristics of different operators using existing touch event data without relying on complex sensors or additional hardware, providing a reliable data foundation for subsequent adaptive correction of touch sensitivity for specified areas.
[0070] Furthermore, the smart blackboard interaction management method based on touch recognition also includes the following steps:
[0071] Step S500: Obtain the starting delay pattern index of the target person, and perform a difference analysis between it and the starting delay pattern index of the reference person to generate a correction factor, and adaptively correct the touch sensitivity of the specified area accordingly.
[0072] Specifically, Figure 2 A flowchart illustrating the dynamic adjustment of touch sensitivity is shown.
[0073] The process of acquiring the target user's pen-starting delay pattern index, performing a difference analysis between it and the reference user's pen-starting delay pattern index, generating a correction factor, and adaptively correcting the touch sensitivity of a specified area based on this factor specifically includes the following steps:
[0074] Step S501: Calculate the starting delay pattern index of the target personnel based on the historical usage database, and obtain the starting delay pattern index of the reference personnel.
[0075] Step S502: Quantitatively analyze the differences between the starting delay pattern index of the target personnel and the starting delay pattern index of the reference personnel to generate correction factors.
[0076] Step S503: Adaptively adjust the touch sensitivity of the specified area based on the correction factor, so that the starting touch effect of the target person when performing non-functional triggering interaction in the specified area is close to the starting touch effect of the reference person.
[0077] When adaptively correcting the touch sensitivity of a specified area, a preset correction function is used, which is:
[0078] ;
[0079] in, This refers to the corrected touch sensitivity of a specified area. This refers to the touch sensitivity of the specified area before correction. This refers to the writing delay pattern indicator of the target personnel. This refers to the writing delay pattern indicator of the reference personnel. This refers to the correction factor. This refers to the preset correction strength coefficient, and satisfies... , and These are the maximum and minimum allowable values for touch sensitivity, respectively.
[0080] In this embodiment of the invention, step S500 is a key step performed after the identification of the designated area and the selection of the reference person. Its purpose is to transform the aforementioned analysis results into adjustment measures that can directly affect the interactive performance of the smart blackboard, thereby substantially improving the writing experience of the target person when performing non-functional triggering interaction in the designated area.
[0081] After selecting a reference person, the starting delay mode index corresponding to that reference person in the specified area can be clearly defined. This index essentially reflects the time length characteristic between the operator pressing the touch button and the touch end starting to move.
[0082] Furthermore, this invention recognizes that while the pen start delay pattern index can accurately characterize an operator's pen start habits, these habits are long-term behavioral characteristics that are difficult to actively change in a short period. Therefore, attempting to guide operators to adjust their pen start rhythm to adapt to the worn area is not only difficult to achieve but also significantly affects the natural writing experience. In contrast, touch sensitivity, as an objectively existing and directly adjustable parameter in the smart blackboard system, can affect the system's response threshold and timing to touch input. Its adjustment direction has an intuitive correspondence with the pen start delay pattern index: when the target user's pen start delay pattern index is relatively large (compared to the reference user), meaning the pen start action is relatively slow, appropriately increasing the touch sensitivity of the designated area can enable the system to recognize the pen start intention earlier and more easily, thereby shortening the actual pen start delay. Conversely, when the target user's pen start delay pattern index is relatively small, meaning the pen start action is relatively rapid, appropriately reducing the touch sensitivity can avoid accidental touches or abnormal responses caused by excessive sensitivity. Therefore, considering that the degree of wear cannot be precisely quantified, the operator's writing habits are difficult to change, and the system parameters are controllable, applying the aforementioned analysis results to the adaptive correction of the touch sensitivity of a specified area is a technical approach that achieves low cost, strong adaptability, and a natural user experience.
[0083] In this invention, touch sensitivity is used to characterize the sensitivity of a specified area to the effective start of a stroke in response to a touch press event. The higher the touch sensitivity, the easier it is for the system to determine a touch press as an effective start of a stroke and trigger the generation of the stroke trajectory point.
[0084] In this embodiment of the invention, a calculation method for generating a correction factor based on the difference in the starting delay pattern index is introduced for the above-mentioned adaptive correction process. This correction factor is generated based on the relative difference in the starting delay pattern index between the target person and the reference person, and is adjusted through a preset correction intensity coefficient, thereby achieving controllability of the sensitivity adjustment range.
[0085] The corrected touch sensitivity is constrained by both maximum and minimum allowable values during calculation to avoid adverse effects on normal interaction caused by excessively high or low sensitivity. This calculation method is intuitive and easy to understand. Its core idea is: when the target user's pen-starting delay pattern index is greater than the reference user's, the correction factor is positive, proportionally increasing the touch sensitivity; when the target user's pen-starting delay pattern index is less than the reference user's, the correction factor is negative, proportionally decreasing the touch sensitivity. This linear correction method based on relative differences maintains stable adjustment logic under different operators and different wear conditions. Furthermore, without departing from the technical concept of this invention, other calculation methods can be used to generate the correction factor, such as piecewise linear functions, exponential functions, or mapping functions based on statistical distributions, to meet the needs of different sensitivity change curves. However, their common point is to constrain the adjustment of touch sensitivity based on differences in pen-starting delay pattern indices.
[0086] Understandably, when the target user's pen start delay pattern index is greater than that of the reference user, it indicates that there is a longer static phase between the target user pressing the touch button and the displacement occurring. During this phase, the wear-specific area is more likely to have insufficient effective pen start determination. Therefore, the difficulty of triggering effective pen start is reduced by increasing the touch sensitivity. When the target user's pen start delay pattern index is less than that of the reference user, the touch sensitivity is appropriately reduced to avoid oversensitivity causing erroneous pen start.
[0087] The preset correction intensity coefficient can be determined based on the comparative test results of the relationship between different pen start delay mode indicators and touch sensitivity changes in a laboratory environment, or it can be obtained by statistical analysis and fitting of a large number of interaction samples in a historical usage database. Its value is used to ensure the improvement effect of pen start response while avoiding excessive adjustment that may have an adverse effect on interaction stability.
[0088] The following specific example illustrates the overall implementation process of this invention. In a certain implementation scenario, assume the target user's pen-starting delay pattern index in a designated area is 0.30 seconds, and the reference user's pen-starting delay pattern index in the same area is 0.20 seconds, with a difference of 0.10 seconds. The ratio of this difference to the reference user's index is 0.5. Assuming the original touch sensitivity is 1.0 and the preset correction intensity coefficient is 0.4, the adjustment ratio corresponding to the correction factor is 1 plus 0.4 multiplied by 0.5, i.e., 1.2. Without exceeding the maximum allowable value or falling below the minimum allowable value, the corrected touch sensitivity is 1.2. Through this adjustment, the system's response to touch input in the designated area will be more sensitive, allowing the target user's pen-starting action to be recognized and trajectory points generated earlier when performing non-functional trigger-type interactions, thus making the actual pen-starting response effect closer to the reference user's. If, in another scenario, the target user's pen-starting delay pattern index is less than the reference user's, the correction process will appropriately reduce the touch sensitivity using the same logic to avoid over-response.
[0089] In this embodiment of the invention, when a user interacts with the designated area and the designated area is in a functional hotspot display state, the touch sensitivity of the designated area is not corrected. This is because interactive operations in a functional hotspot display state are typically used to trigger function control commands, requiring higher precision in click positioning, stability of trigger thresholds, and consistency of function triggering. If touch sensitivity is still adaptively corrected, the trigger threshold of the function button may drift, leading to problems such as accidental touches, repeated touches, or trigger failures, thus reducing the reliability of function control. Furthermore, users typically have a stronger sense of purpose when operating in a functional hotspot, actively compensating for wear and tear by applying more force or clicking repeatedly, making further correction of touch sensitivity relatively less necessary. Therefore, this invention limits adaptive correction of touch sensitivity to non-functional trigger-based interactive scenarios to ensure that while improving the initial response of content interaction in the designated area, the triggering stability and interactive security of function control commands are not affected.
[0090] Through the above steps, the present invention effectively addresses the core research point proposed in step S100: that is, regarding the problem that wear and tear occurs in local areas of the smart blackboard due to long-term use, and that this wear and tear adversely affects the pen-starting response in non-functional content interaction scenarios, the present invention does not attempt to directly quantify the degree of wear or forcibly change the operator's habits. Instead, it identifies designated areas through historical data analysis, selects reference personnel through comparison between operators, generates correction factors through differences in pen-starting delay mode indicators, and finally achieves experience compensation through adaptive correction of touch sensitivity, thereby improving the pen-starting response effect in worn areas while maintaining a natural interaction method.
[0091] From an application perspective, the interactive management method proposed in this invention can be widely applied to smart blackboards, electronic whiteboards, and other large-size touch display devices in teaching scenarios, especially suitable for environments with multiple users rotating and long-term high-frequency use. This method can extend the device's lifespan, reduce the risk of experience degradation due to wear and tear, and improve the consistency and comfort of interaction between different operators on the same device without increasing additional hardware costs through adaptive adjustments at the software level. It has good engineering practical value and promising prospects for widespread application.
[0092] Understandably, in some embodiments, the adaptive correction of touch sensitivity may take effect at the session level, user level, or device level, and may be restored to its initial state after use.
[0093] Furthermore, Figure 3 An application architecture diagram of the system provided in an embodiment of the present invention is shown.
[0094] In another preferred embodiment of the present invention, a smart blackboard interactive management system based on touch recognition includes:
[0095] The sample acquisition module 100 is used to retrieve the historical usage database of the smart blackboard before the target person uses it, and obtain the first sample that matches the target person's current usage background.
[0096] Furthermore, the touch-recognition-based smart blackboard interactive management system also includes:
[0097] The response rate calculation module 200 is used to analyze the first sample, obtain the non-functional trigger-type interaction trajectory data of the target person in different areas of the smart blackboard, and calculate the effective response rate of the pen stroke in each area accordingly.
[0098] Furthermore, the touch-recognition-based smart blackboard interactive management system also includes:
[0099] The designated area determination module 300 is used to compare the effective response rate of the starting stroke in different areas and determine whether a designated area exists. The designated area is an area that is simultaneously a functional hot zone display area and whose effective response rate of the starting stroke is lower than a preset ratio of the effective response rate of the starting stroke in the non-functional hot zone area.
[0100] Furthermore, the touch-recognition-based smart blackboard interactive management system also includes:
[0101] The reference personnel determination module 400 is used to extract several second samples from the database that are consistent with the current usage background but correspond to different operators if the determination exists, and to calculate the starting delay mode index of each second sample and its starting effective response rate in the specified area, and select the reference personnel based on the highest starting effective response rate.
[0102] The phrase "matching the target user's current usage context" means that at least one of the following aspects—teaching content type, interactive operation type, and usage time period—is consistent with or falls within the preset allowable error range of the target user's current usage.
[0103] Furthermore, the touch-recognition-based smart blackboard interactive management system also includes:
[0104] The sensitivity adaptive correction module 500 is used to acquire the starting delay pattern index of the target person, analyze the difference between it and the starting delay pattern index of the reference person, generate a correction factor, and adaptively correct the touch sensitivity of the specified area accordingly.
[0105] It should be understood that although the steps in the flowcharts of the various embodiments of the present invention are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the various embodiments may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the sub-steps or stages of other steps.
[0106] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
[0107] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0108] The embodiments described above are merely illustrative of several implementations of the present invention, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these modifications and improvements all fall within the scope of protection of the present invention. Therefore, the scope of protection of this patent should be determined by the appended claims.
[0109] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the protection scope of the present invention.
Claims
1. A smart blackboard interactive management method based on touch recognition, characterized in that, The method includes: Before the target personnel use the smart blackboard, retrieve the historical usage database of the smart blackboard and obtain the first sample that matches the target personnel's current usage context. The first sample was analyzed to obtain non-functional trigger-type interaction trajectory data of the target personnel in different areas of the smart blackboard, and the effective response rate of the pen stroke in each area was calculated accordingly. Compare the effective response rate of the pen stroke in different areas to determine whether there is a designated area. The designated area is an area that is simultaneously a functional hot zone display area and whose effective response rate of the pen stroke is lower than a preset ratio of the effective response rate of the pen stroke in the non-functional hot zone area. If it is determined that it exists, extract several second samples from the database that are consistent with the current usage background but correspond to different operators, and calculate the starting delay pattern index of each second sample and its effective starting response rate in the specified area. Select the reference personnel based on the highest effective starting response rate. Obtain the starting delay pattern index of the target personnel, perform a difference analysis between it and the starting delay pattern index of the reference personnel, generate a correction factor, and adaptively correct the touch sensitivity of the specified area accordingly.
2. The smart blackboard interactive management method based on touch recognition according to claim 1, characterized in that, The phrase "matching the target user's current usage context" means that at least one of the following aspects—teaching content type, interactive operation type, and usage time period—is consistent with or falls within the preset allowable error range of the target user's current usage.
3. The smart blackboard interactive management method based on touch recognition according to claim 1, characterized in that, The term "non-functional trigger type" refers to interactive operations corresponding to the interactive trajectory data that do not trigger the function control instructions of the smart blackboard and are used for content writing, annotation, or trajectory drawing.
4. The smart blackboard interactive management method based on touch recognition according to claim 1, characterized in that, The calculation process for the effective response rate at the start of the stroke includes: The interaction trajectory data is analyzed to obtain the touch press event, trajectory point generation event, and their corresponding time and position information corresponding to the pen stroke operation; the trajectory point generation event is an event that generates handwriting trajectory points based on touch input. For each pen stroke, based on the time difference between the touch press event and the trajectory point generation event, it is determined whether the trajectory point is generated within a preset time threshold, and based on the distance between the position corresponding to the touch press event and the trajectory point generation position, it is determined whether the trajectory point falls within a preset spatial threshold range. If the trajectory point is generated within a preset time threshold and falls within a preset spatial threshold range, the starting operation is determined as a valid response starting operation, and the number of valid response starting operations is counted; if the trajectory point is not generated or the preset time threshold or the preset spatial threshold is not met, the starting operation is determined as an invalid response starting operation. The effective response rate is obtained by calculating the ratio of the number of effective response strokes to the total number of strokes in the corresponding area.
5. The smart blackboard interactive management method based on touch recognition according to claim 4, characterized in that, The calculation process for the starting delay pattern index includes: The interaction trajectory data is parsed to obtain the touch press event and touch terminal movement event corresponding to the pen start operation, and the corresponding time information is obtained; the touch terminal movement event is the event in which the touch input terminal detects the displacement of the touch position and generates position change information after the touch is pressed. The starting delay time corresponding to each starting operation is determined based on the time difference between the touch press event and the touch terminal movement event. Statistical analysis of the pen-starting delay time yields a pen-starting delay pattern index that characterizes the pen-starting behavior of the current operator.
6. The smart blackboard interactive management method based on touch recognition according to claim 5, characterized in that, The steps of obtaining the target user's pen-starting delay pattern index, performing a difference analysis between it and the reference user's pen-starting delay pattern index, generating a correction factor, and adaptively correcting the touch sensitivity of a specified area accordingly include: Calculate the starting delay pattern index of the target personnel based on the historical usage database, and obtain the corresponding starting delay pattern index of the reference personnel. A quantitative difference analysis was conducted between the starting delay pattern index of the target personnel and the starting delay pattern index of the reference personnel to generate correction factors. The touch sensitivity of the specified area is adaptively adjusted based on the correction factor, so that the initial stroke triggering effect of the target person when performing non-functional triggering interaction in the specified area is close to the initial stroke triggering effect of the reference person.
7. The smart blackboard interactive management method based on touch recognition according to claim 6, characterized in that, When adaptively correcting the touch sensitivity of a specified area, a preset correction function is used, which is: ; in, This refers to the corrected touch sensitivity of a specified area. This refers to the touch sensitivity of the specified area before correction. This refers to the writing delay pattern indicator of the target personnel. This refers to the writing delay pattern indicator of the reference personnel. This refers to the correction factor. This refers to the preset correction strength coefficient, and satisfies... , and These are the maximum and minimum allowable values for touch sensitivity, respectively.
8. The smart blackboard interactive management method based on touch recognition according to claim 6, characterized in that, When a user interacts with the designated area and the designated area is in a functional hotspot display state, the touch sensitivity of the designated area is not corrected.
9. A smart blackboard interactive management system based on touch recognition, characterized in that, The system includes: The sample acquisition module is used to retrieve the historical usage database of the smart blackboard before the target person uses it, and obtain the first sample that matches the target person's current usage background. The response rate calculation module is used to analyze the first sample, obtain the non-functional trigger-type interaction trajectory data of the target person in different areas of the smart blackboard, and calculate the effective response rate of the pen stroke in each area accordingly. The designated area determination module is used to compare the effective response rate of the pen stroke in different areas and determine whether a designated area exists. The designated area is an area that is simultaneously a functional hot zone display area and whose effective response rate of the pen stroke is lower than a preset ratio of the effective response rate of the pen stroke in the non-functional hot zone area. The reference personnel determination module is used to extract several second samples from the database that are consistent with the current usage background but correspond to different operators if the determination exists, and to calculate the starting delay pattern index of each second sample and its starting effective response rate in the specified area, and select the reference personnel based on the highest starting effective response rate. The sensitivity adaptive correction module is used to obtain the starting delay pattern index of the target person, analyze the difference between it and the starting delay pattern index of the reference person, generate a correction factor, and adaptively correct the touch sensitivity of the specified area accordingly.
10. The smart blackboard interactive management system based on touch recognition according to claim 9, characterized in that, The phrase "matching the target user's current usage context" means that at least one of the following aspects—teaching content type, interactive operation type, and usage time period—is consistent with or falls within the preset allowable error range of the target user's current usage.