Interaction control method and system for multifunctional large-screen display device

Abstract

The invention relates to the technical field of large-screen display interaction control, solves the technical problems of single interaction mode and poor real-time interaction experience of a user in the existing multifunctional large-screen interaction control technology, and provides an interaction control method and system for a multifunctional large-screen display device. Obtaining an interaction signal sent by an interaction terminal in a preset distance range; obtaining an interaction signal type and a current control mode of the interaction terminal according to the interaction signal; according to the interactive signal type and the current control mode, determining an interactive operation strategy for real-time display content in the large-screen display device; according to the interactive operation strategy, interactive operation is carried out on the real-time display content, and interactive control over the large-screen display device is completed. According to the invention, the real-time interaction experience between the user and the large screen is obviously improved.

Description

Technical Field

[0001] This invention relates to the field of interactive control technology for large-screen displays, and in particular to an interactive control method and system for a multifunctional large-screen display device. Background Technology

[0002] Existing multifunctional large-screen display devices are typically used in scenarios such as conference presentations, classrooms, remote collaboration, and public information interaction. These devices feature large display areas, high resolution, and rich interactive functions, meeting the needs of multiple users viewing and interacting simultaneously. With the development of technologies such as touch control, motion sensing, and wireless connectivity, large-screen devices are no longer limited to traditional display functions; they are gradually expanding into diverse application modes such as writing and annotation, remote presentation control, and multi-terminal collaboration, thus playing a vital role in education, office work, and entertainment.

[0003] Existing large-screen interactive control technologies mainly fall into three categories: First, direct contact operation based on touchscreens, where users control the displayed content by clicking, swiping, and writing on the screen surface with their fingers or styluses; second, motion-sensing interaction based on light spot recognition, where users emit light spot signals using laser pointers or infrared light sources, and the large screen captures and analyzes the light spot positions through a camera to achieve remote cursor movement and command triggering; and third, input methods based on external buttons or remote controls, where users perform direction selection, menu operations, or simple writing input through button signals. These existing technologies are widely used in scenarios such as conference presentations and interactive teaching. However, certain shortcomings still exist in practical applications. Traditional touch methods require close-range operation by users, which is easily limited by position and unsuitable for long-distance interaction; light spot recognition-based control methods are easily affected by jitter interference during light spot trajectory tracking, leading to unstable cursor positioning; while button control methods can expand the interaction modes, they often lack dynamic compensation and smoothing processing for directional and writing controls, resulting in inaccurate cursor movement and discontinuous writing trajectories. These technical issues require users to repeatedly adjust their posture or even make large body movements when performing fine operations or writing at a distance, making it impossible to guarantee the naturalness of the interaction process and the smoothness of the writing process.

[0004] Chinese patent CN106843602A discloses a large-screen remote control interactive system and its interaction method. The method includes: S1: the remote control emits an infrared signal to the large screen; S2: the camera captures a light spot image of the infrared signal and sends it to the host; S3: the host calculates the coordinates of the light spot based on the light spot image; S4: the host receives window layout information from the splicing controller, and retrieves corresponding display information based on the coordinates of the light spot and the window layout information, and sends the display information to the splicing controller; S5: the splicing controller sends the display information to the large screen, and the large screen displays the window selected by the remote control. Although the above patent solution achieves window selection based on infrared light spot coordinates and simple remote control button operation, it lacks precise coordinate mapping, anti-shake and trajectory optimization processing, and does not support continuous trajectory and multi-mode fusion control. This results in limited cursor control accuracy, insufficient anti-shake capability, and easy jumps and discontinuities in the operation process in long-distance interaction scenarios, leading to a poor overall real-time user interaction experience.

[0005] Therefore, how to improve the real-time interactive experience of users on multifunctional large screens under different interactive control modes is an urgent technical problem to be solved. Summary of the Invention

[0006] In view of this, embodiments of the present invention provide an interactive control method and system for a multifunctional large-screen display device, in order to solve the problems of single interaction mode and poor real-time interactive experience of users in existing multifunctional large-screen interactive control technologies.

[0007] In a first aspect, embodiments of the present invention provide an interactive control method for a multifunctional large-screen display device, the method comprising: In response to an interactive request command, acquire interactive signals emitted by interactive terminals within a preset distance range; Based on the interaction signal, obtain the interaction signal type and the current control mode of the interaction terminal; Based on the interaction signal type and the current control mode, determine the interaction operation strategy for the real-time displayed content on the large screen display device; According to the interactive operation strategy, interactive operations are performed on the real-time displayed content to complete the interactive control of the large screen display device.

[0008] In an optional embodiment, obtaining the interaction signal type and the current control mode of the interaction terminal based on the interaction signal includes: The interaction signals are classified, and the interaction signal type is obtained based on the classification result. The interaction signal type includes light spot signals and button signals. If the type of the interaction signal is the light spot signal, then the current control mode is determined to be the light spot indication mode; If the interaction signal type is the key signal, then in response to the key command issued by the user, the current control mode corresponding to the key command is obtained, wherein the current control mode includes directional control mode and writing mode.

[0009] In an optional embodiment, if the interaction signal type is the light spot signal and the current control mode is the light spot indication mode, then determining the interaction operation strategy for the real-time displayed content in the large-screen display device according to the interaction signal type and the current control mode includes: Based on the light spot signal, obtain the position information of the light spot emitted by the interactive terminal on the large screen display device; Based on the light spot position information and the preset calibration parameters corresponding to the large screen display device, the light spot is mapped to obtain the mapped position information of the light spot in the screen coordinate system. Based on the mapped position information, the movement trajectory of the light spot is smoothed and dynamically compensated to obtain the target position information. Based on the target location information and the original position information of the cursor in the large screen display device, a cursor update control command is determined as the interactive operation strategy.

[0010] In an optional embodiment, the step of performing smoothing filtering and dynamic compensation processing on the movement trajectory of the light point based on the mapped position information to obtain the target position information includes: Based on the mapped position information, the continuous position data of the light spot within a preset time window are sampled and aggregated to obtain the trajectory change vector of the light spot. Based on the trajectory change vector, the fluctuation amplitude of the position of the light spot in the time domain is statistically analyzed, and combined with a preset time domain stability threshold, the time domain stability determination result of the light spot is obtained. Based on the trajectory change vector, the displacement trend of the light spot in the spatial domain is predicted, and combined with the spatial constraints of the preset target area, the spatial stability determination result of the light spot is obtained. Based on the temporal stability determination result and the spatial stability determination result, the motion state of the light spot is determined twice to obtain the target position information that meets the anti-shake requirements.

[0011] In an optional embodiment, the step of performing a dual determination of the motion state of the light spot based on the temporal stability determination result and the spatial stability determination result to obtain the target position information that meets the image stabilization requirements includes: Based on the time-domain stability determination results and the spatial-domain stability determination results, the stability index is quantified to obtain the time-domain stability score and the spatial-domain stability score. According to the preset weight allocation parameters, the time domain stability score and the spatial domain stability score are weighted and fused to obtain a comprehensive stability score. The comprehensive stability score is compared with a preset anti-shake threshold to obtain the anti-shake determination result of the light spot motion state, wherein the anti-shake determination result includes stable and unstable. If the anti-shake determination result is stable, then based on the trajectory change vector, the mapped position information is interpolated, fitted and dynamically compensated to obtain the first candidate target position information; If the anti-shake determination result is unstable, then according to the preset time decay parameter, the preset historical position information corresponding to the mapped position information is smoothed to obtain the second candidate target position information. Based on the comprehensive stability score, the first candidate target location information and the second candidate target location information are subjected to confidence weighting to obtain the target location information.

[0012] In an optional embodiment, if the interaction signal type is the button signal and the current control mode is the direction control mode, then determining the interaction operation strategy for the real-time displayed content on the large screen display device based on the interaction signal type and the current control mode includes: In response to the key instruction, the direction control instruction triggered by the user is parsed according to the key signal to obtain the direction control parameters; Based on the direction control parameters, the control type corresponding to the direction control command is determined, wherein the control type includes cursor movement control and function operation control; If the control type is cursor movement control, then based on the direction control parameters and the preset displacement compensation, the current position of the cursor is incrementally calculated to obtain the candidate target position information of the cursor. Obtain the display boundary position information of the large screen display device; Based on the displayed boundary position information and the candidate target position information, the cursor position is constrained and corrected to obtain the corrected cursor position information. Based on the corrected cursor position information and the current cursor position, determine the cursor movement control command; If the control type is function operation control, then the function operation control command is determined according to the preset function mapping relationship and the direction control parameters; The interactive operation strategy is determined based on the cursor movement control instructions and the function operation control instructions.

[0013] In an optional embodiment, if the control type is function operation control, then determining the function operation control instruction based on a preset function mapping relationship and the direction control parameters includes: Based on the function mapping relationship, a preset function operation type and its corresponding function control parameters are obtained, wherein the preset function operation type includes page turning function and playback switching; Feature extraction is performed on the direction control parameters and the function control parameters to obtain direction control features and function control features; The directional control features and function control features are matched, and the target function operation type corresponding to the directional control parameters is obtained based on the matching result. The function operation control instruction is determined based on the target function operation type.

[0014] In an optional embodiment, if the interaction signal type is the key signal and the current control mode is writing mode, then if the control type is function operation control, determining the interaction operation strategy for the real-time displayed content on the large screen display device based on the interaction signal type and the current control mode includes: Based on the key signal, writing-related data is obtained, wherein the writing-related data includes key code, key state, and key trigger time; Based on the writing-related data, the user's writing operation is analyzed to obtain writing input parameters, which include stroke start point, stroke direction, stroke amplitude, and continuous writing status information. Based on the preset coordinate mapping relationship between the writing input parameters and the large screen display device, and the preset operation range constraints, coordinate transformation is performed on the starting and ending points of the strokes to obtain the mapped writing data corresponding to the screen coordinate system. Based on the mapped writing data, trajectory interpolation and smoothing filtering are performed on continuous writing points to obtain a target writing trajectory that conforms to writing continuity. Based on the target writing trajectory, the sensitivity of the stroke trajectory is adjusted and the trajectory is corrected to obtain the corrected writing trajectory; Based on the corrected writing trajectory, writing operation control instructions are generated, and these writing operation control instructions are used as the interactive operation strategy.

[0015] In an optional embodiment, the step of performing trajectory interpolation and smoothing filtering on consecutive writing points based on the mapped writing data to obtain a target writing trajectory that conforms to writing continuity includes: Based on the mapped writing data, coordinates are extracted and temporal sequence is processed for continuous writing points to obtain a temporal writing point set. Trajectory interpolation is performed on adjacent points in the time-series writing point set to obtain the interpolated intermediate point; Based on the interpolated midpoint, the writing trajectory is processed to construct curves and preserve turning features, resulting in the writing trajectory curve; Based on the writing trajectory curve, the trajectory points are smoothed and filtered to obtain the processed trajectory data. Based on the trajectory data, the trajectory is organized and synthesized to obtain the target writing trajectory.

[0016] In a second aspect, embodiments of the present invention provide an interactive control system for a multifunctional large-screen display device, comprising: at least one processor, at least one memory, and computer program instructions stored in the memory, wherein when the computer program instructions are executed by the processor, the method of the first aspect described above is implemented.

[0017] In summary, the beneficial effects of the present invention are as follows: This invention provides a multifunctional large-screen display device interactive control method and system. The method includes: responding to an interactive request command, acquiring interactive signals emitted by interactive terminals within a preset distance range; acquiring the interactive signal type and the current control mode of the interactive terminals based on the interactive signals; determining an interactive operation strategy for real-time displayed content on the large-screen display device based on the interactive signal type and the current control mode; and performing interactive operations on the real-time displayed content according to the interactive operation strategy to complete the interactive control of the large-screen display device. This invention establishes an integrated link from interactive signal acquisition, signal type identification, control mode judgment to interactive strategy generation, enabling the large screen to no longer rely on a single touch or fixed interaction method, but to automatically match the corresponding control mode based on light spot signals or button signals emitted by different terminals, achieving dynamic switching of multiple interaction methods such as indication, direction control, and writing. After the interactive signals enter the system, they are first classified and parsed in conjunction with the current control mode, and then the system generates an interactive operation strategy that matches the real-time displayed content, ensuring that cursor movement, content response, or trajectory writing can all be executed in the correct mode. Through this adaptive strategy generation and pattern matching mechanism, users can freely use different interaction methods in different scenarios. The system can identify and respond accurately in real time, thereby significantly improving the problems of single interaction methods and poor scenario adaptability of traditional large screens, making the overall interaction process more coherent and natural, and significantly improving the user's real-time interaction experience. Attached Figure Description

[0018] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments of the present invention will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort, and these are all within the protection scope of the present invention.

[0019] Figure 1 This is a schematic diagram of the overall process of the interactive control method for the multifunctional large-screen display device in Embodiment 1 of the present invention; Figure 2 This refers to obtaining the interaction signal type and the current control mode of the interaction terminal in Embodiment 1 of the present invention; Figure 3 This is a schematic diagram of a scenario in Embodiment 2 of the present invention where a multifunctional large screen interacts with a human. Figure 4 This is a schematic diagram of the interactive control system of the multifunctional large-screen display device in Embodiment 3 of the present invention. Detailed Implementation

[0020] The features and exemplary embodiments of various aspects of the present invention will now be described in detail. To make the objectives, technical solutions, and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only configured to explain the present invention and are not configured to limit the present invention. For those skilled in the art, the present invention can be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present invention by illustrating examples of the invention.

[0021] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes said element.

[0022] It should be noted that all actions involving the acquisition of signals, information, or data in this invention are carried out in compliance with the relevant data protection laws and regulations of the locality and with authorization from the owner of the relevant device.

[0023] Example 1 Please see Figure 1 This invention provides an interactive control method for a multifunctional large-screen display device, the method comprising: In response to an interactive request command, acquire interactive signals emitted by interactive terminals within a preset distance range; Specifically, the interaction request command is used to trigger the initiation of the interaction process, the preset distance range is used to limit the range of interactive terminals, and the interaction signal is the data emitted by the terminal to realize the interaction. By acquiring the interaction signal within the preset distance range, the reliability and effectiveness of the signal source for subsequent processing can be ensured. This process establishes the basis for interaction by having the system respond to the interaction request and receive and filter the signals emitted by the terminal, ensuring that the interaction process is based solely on the target terminal input, avoiding external interference, and improving the accuracy and stability of the interaction.

[0024] Based on the interaction signal, obtain the interaction signal type and the current control mode of the interaction terminal; Specifically, the interaction signal type is used to distinguish different input forms (such as light spot signal input or button signal input), while the current control mode of the interactive terminal is used to indicate the current working mode of the interactive terminal. By parsing and classifying the original interaction signals, the subsequent processing path is determined. The interaction signals are identified and their patterns are judged to obtain the corresponding signal attributes and working states, ensuring that the system can correctly understand the user's intent under various interaction methods, avoiding misoperation, and improving the adaptability and accuracy of the interaction.

[0025] Based on the interaction signal type and the current control mode, determine the interaction operation strategy for the real-time displayed content on the large screen display device; Specifically, the interactive operation strategy refers to the processing methods and interaction rules set for different signals and modes, used to guide specific operations on the large screen. Under various input types and control modes, a unified corresponding interaction strategy is generated to ensure consistency in the interaction process. This process, through combined analysis of signal types and control modes, determines the corresponding interaction rules and processing methods, enabling interactive behavior to flexibly adapt to different scenarios and achieve diversified, standardized, and coherent control of real-time displayed content.

[0026] According to the interactive operation strategy, interactive operations are performed on the real-time displayed content to complete the interactive control of the large screen display device.

[0027] Specifically, according to the aforementioned interactive operation strategy, interactive operations are performed on the real-time displayed content. By specifically executing the aforementioned interactive operation strategy, that is, applying the determined interactive rules to the real-time displayed content, the display state is changed, interactive control is achieved, and user input receives timely and accurate feedback on the large screen, thereby completing the interactive process. By executing the corresponding strategy, the desired content can be presented on the large screen. Figure 1 To achieve consistent operational results, enhance the intuitiveness and coherence of the interaction, and ensure the smoothness and stability of the overall control process.

[0028] In an alternative embodiment, please refer to Figure 2 The step of obtaining the interaction signal type and the current control mode of the interaction terminal based on the interaction signal includes: The interaction signals are classified, and the interaction signal type is obtained based on the classification result. The interaction signal type includes light spot signals and button signals. Specifically, the interactive signals are classified. This classification involves categorizing the signals acquired and preprocessed by the front end into different classes based on predefined signal characteristics. The classification result serves as the signal label for subsequent selection of the processing chain. The aim is to map raw signals from different physical channels or input methods into distinguishable types, enabling the adoption of matching parsing and processing strategies. In implementation, the classification process includes: extracting temporal and morphological features of the interactive signals; determining the extracted features based on a pre-trained lightweight classification model; and outputting a structured classification result, i.e., the interactive signal type. Using classification as a hub, the input is routed to the corresponding pattern determination and strategy module, thereby reducing the risk of misprocessing and improving the efficiency and accuracy of subsequent processing.

[0029] If the type of the interaction signal is the light spot signal, then the current control mode is determined to be the light spot indication mode; Specifically, if the interaction signal type is the light spot signal, which represents a point target input detected by a vision or optical device, and the current control mode is determined to be the light spot indication mode, it means that the system will enter an interaction state mainly based on position mapping and trajectory processing. The optical input is directly used for spatial indication or cursor control, which is accomplished by mapping the classification output to the mode state machine. While recognizing it as a light spot signal, the system sets or maintains the operating state of the light spot indication mode, and can decide whether to continue or exit the mode based on the mode holding time window or saliency criterion. By explicitly coupling optical input with indication control strategy, a clear mode context is provided for subsequent mapping / filtering / compensation processes, thereby ensuring that the light spot input is processed according to indication semantics rather than being mistakenly entered into other control flows.

[0030] If the interaction signal type is the key signal, then in response to the key command issued by the user, the current control mode corresponding to the key command is obtained, wherein the current control mode includes directional control mode and writing mode.

[0031] Specifically, if the interaction signal type is the key signal, the key signal refers to the discrete control input from the terminal key event. The purpose is to parse the user's key command into a specific control mode to determine the subsequent control semantics, such as interpreting the subsequent input as incremental cursor movement or continuous writing trajectory. In implementation, in response to the key command issued by the user, the key command is converted into a corresponding control mode identifier through a key mapping table, key duration criteria (short press / long press), or key combination rules, and the mode identifier is passed to the strategy selection module. Through a clear key and mode mapping mechanism, controllable switching and maintenance between modes are achieved, thereby supporting the correct triggering of two different processing chains: directional control mode and writing mode, improving the controllability of the interaction and the reliability of user intent recognition.

[0032] In an optional embodiment, if the interaction signal type is the light spot signal and the current control mode is the light spot indication mode, then determining the interaction operation strategy for the real-time displayed content in the large-screen display device according to the interaction signal type and the current control mode includes: Based on the light spot signal, obtain the position information of the light spot emitted by the interactive terminal on the large screen display device; Specifically, based on the light spot signal, the position information of the light spot emitted by the interactive terminal on the large-screen display device is obtained. The light spot position information refers to the representational data of the position and timestamp of the light spot in the observation coordinate system obtained after the front end acquires single or multiple frames of signals. Its purpose is to convert the raw optical input into spatiotemporal position data that can be used for positioning and tracking, serving as input for subsequent mapping and control. To achieve this, bright spot detection, connected component analysis, and centroid or sub-pixel estimation can be performed on the frame sequence acquired by the camera. The detection results are then packaged into a time-stamped position sequence, while simultaneously recording the confidence level or quality index. By performing structured and positional processing on the optical observation data, standardized input is provided for subsequent coordinate mapping and trajectory processing, which helps improve the availability and consistency of the basic positioning data.

[0033] Based on the light spot position information and the preset calibration parameters corresponding to the large screen display device, the light spot is mapped to obtain the mapped position information of the light spot in the screen coordinate system. Specifically, the preset calibration parameters refer to the set of parameters used to transform the observation coordinate system to the large-screen display coordinate system. These include geometric transformation matrices, projection / distortion parameters, or calibration lookup tables. The purpose is to eliminate geometric and projection differences between the observation geometry and the display plane, ensuring that the position of the light spot directly corresponds to the target position on the screen. To achieve this, the transformation relationship obtained through pre-calibration can be used to perform geometric transformation and distortion correction on the light spot position information. For example, this can be done by applying intrinsic and extrinsic parameters and lens distortion correction from monocular / multi-view camera calibration, or by applying homography / mapping tables for projection mapping. The mapping results are then scaled and boundary-checked to generate the mapped position information of the light spot in the screen coordinate system. The calibration-driven coordinate transformation ensures a one-to-one correspondence between the observation point and the display point, thus providing an accurate spatial reference for cursor control or instruction operations.

[0034] Based on the mapped position information, the movement trajectory of the light spot is smoothed and dynamically compensated to obtain the target position information. Specifically, based on the mapped position information, the movement trajectory of the light point undergoes smoothing filtering and dynamic compensation processing. Smoothing filtering and dynamic compensation processing refer to noise suppression and compensation for system delay / motion trends in the time series of the mapped position information, respectively. The aim is to maintain timely interactive response while suppressing jitter and abnormal jumps. To achieve this, temporal filtering, such as exponential smoothing, Kalman filtering, or adaptive low-pass filtering, can be applied to the mapped position information, combined with velocity / acceleration estimation for dynamic compensation. This includes using velocity extrapolation to offset perception and rendering delays, adjusting filter strength based on confidence levels, and employing anomaly detection and short-time frame interpolation strategies to handle sampling discontinuities. By balancing the mapped position information in the time domain, stable and timely target position information is output as reliable input for cursor updates.

[0035] Based on the target location information and the original position information of the cursor in the large screen display device, a cursor update control command is determined as the interactive operation strategy.

[0036] Specifically, based on the target position information and the original position information of the cursor in the large-screen display device, a cursor update control instruction is determined. This instruction converts the target position information into a control format for driving the display unit, such as an absolute position instruction or an incremental movement instruction, and includes necessary constraints and time information. Its purpose is to update the cursor position on the screen and facilitate interaction with interface elements using a standardized command delivery method. A displacement vector is calculated based on the target position information and the current cursor position, and boundary constraints, rate limits, or smooth transition processing are applied to it. This generates a control instruction containing position, velocity, or interpolation parameters, which is then delivered through the display control interface or application layer events. A timestamp is recorded for subsequent closed-loop verification and feedback. By converting the processed positioning data into executable control semantics, the controllability and consistency of cursor updates are ensured, facilitating interactive behaviors on the large screen that conform to user intent.

[0037] In an optional embodiment, the step of performing smoothing filtering and dynamic compensation processing on the movement trajectory of the light point based on the mapped position information to obtain the target position information includes: Based on the mapped position information, the continuous position data of the light spot within a preset time window are sampled and aggregated to obtain the trajectory change vector of the light spot. Specifically, within a preset time window, based on the mapped position information, the positions of the light points mapped to the screen coordinate system are sampled in chronological order, and the sampled points are aligned according to a uniform time sequence. The displacement difference between adjacent sampled points is calculated to form a set of displacement vectors, and this set of displacement vectors is statistically summarized according to a preset aggregation strategy, such as summation, averaging, or median, and combined into a trajectory change vector representing recent motion characteristics. Missing points are interpolated and the confidence information of each sampled point is recorded. The trajectory change vector is used to characterize the spatiotemporal characteristics of the light point's movement direction, amplitude, and rate within the time window, thereby providing basic data for subsequent stability determination.

[0038] Based on the trajectory change vector, the fluctuation amplitude of the position of the light spot in the time domain is statistically analyzed, and combined with a preset time domain stability threshold, the time domain stability determination result of the light spot is obtained. Specifically, a metric for characterizing volatility is calculated on the trajectory change vector in the time dimension, such as the standard deviation of the positional deviation, the maximum offset, or the root mean square value. The metric is then compared with a preset time-domain stability threshold to determine time-domain stability. In practice, sliding window statistics, weighted samples, or robust statistical methods can be used to reduce the influence of abnormal samples. Hysteresis or threshold delay can be introduced to avoid judgment jitter, thereby outputting a time-domain stability determination result indicating whether the light spot is stable or unstable in the time domain.

[0039] Based on the trajectory change vector, the displacement trend of the light spot in the spatial domain is predicted, and combined with the spatial constraints of the preset target area, the spatial stability determination result of the light spot is obtained. Specifically, spatial prediction of the short-term displacement trend of the light spot is performed based on the trajectory change vector. For example, linear extrapolation, low-order curve fitting, or recursive filters are used to obtain the expected position at the next moment or within a short period of time. The predicted position is then compared with the preset target area boundary, maximum allowable displacement, or interaction zone constraint to assess whether it exceeds the spatial stability range. In practice, the prediction results can be judged by combining the boundary buffer and the relative velocity threshold. Finally, the spatial stability judgment result representing whether the light spot meets the stability requirements in the spatial domain is output.

[0040] Based on the temporal stability determination result and the spatial stability determination result, the motion state of the light spot is determined twice to obtain the target position information that meets the anti-shake requirements.

[0041] Specifically, the temporal stability determination results and the spatial stability determination results are fused and judged, for example through rule logic, weighted scoring or confidence fusion. Based on the fusion results, different processing strategies are adopted in the two cases of stability and instability, and the final target position information is output. This target position information satisfies the anti-shake constraint and is used as the input for subsequent cursor update or interactive commands.

[0042] In an optional embodiment, the step of performing a dual determination of the motion state of the light spot based on the temporal stability determination result and the spatial stability determination result to obtain the target position information that meets the image stabilization requirements includes: Based on the time-domain stability determination results and the spatial-domain stability determination results, the stability index is quantified to obtain the time-domain stability score and the spatial-domain stability score. Specifically, based on the temporal stability determination results and the spatial stability determination results, the statistics representing the temporal fluctuation amplitude and spatial displacement consistency are normalized and scaled to obtain numerical temporal stability scores and spatial stability scores. The normalization mapping can be based on a pre-defined mapping function (e.g., linear normalization, logarithmic or sigmoid mapping) to transform the original measure (e.g., standard deviation, root mean square displacement or prediction error) into a score with uniform dimensions, and a confidence value is attached to each score to reflect the credibility of the input data, thereby providing comparable stability indicators for subsequent fusion calculations.

[0043] According to the preset weight allocation parameters, the time domain stability score and the spatial domain stability score are weighted and fused to obtain a comprehensive stability score. Specifically, based on the preset weight allocation parameters, the temporal stability score and the spatial stability score are weighted and normalized to obtain a single comprehensive stability score. The weight allocation parameters can be static preset values ​​or adaptively adjusted based on historical judgment accuracy. During fusion, the confidence level of each score can be considered for weighted correction to ensure that the influence of a score with low confidence level is reduced, thereby outputting a comprehensive score that reflects the overall stability.

[0044] The comprehensive stability score is compared with a preset anti-shake threshold to obtain the anti-shake determination result of the light spot motion state, wherein the anti-shake determination result includes stable and unstable. Specifically, based on the comprehensive stability score, it is compared with a pre-set anti-shake threshold to determine whether the current light spot motion state is stable or unstable. To reduce frequent switching, upper and lower thresholds or hysteresis mechanisms and the shortest hold window can also be used to balance sensitivity and stability. The determination result is accompanied by time window confirmation logic and confidence output, so that downstream modules can select different subsequent processing paths based on the determination.

[0045] If the anti-shake determination result is stable, then based on the trajectory change vector, the mapped position information is interpolated, fitted and dynamically compensated to obtain the first candidate target position information; Specifically, when the image stabilization is determined to be stable, curve fitting or piecewise interpolation (e.g., cubic spline or Bezier interpolation) is performed on the most recent mapping position information based on the trajectory change vector to generate a smooth and continuous trajectory. Dynamic compensation (e.g., based on velocity extrapolation or model correction) is then implemented in combination with velocity / acceleration information or delay estimation to offset the perception and rendering delay, thereby generating the first candidate target position information with confidence label.

[0046] If the anti-shake determination result is unstable, then according to the preset time decay parameter, the preset historical position information corresponding to the mapped position information is smoothed to obtain the second candidate target position information. Specifically, when the image stabilization is determined to be unstable, time-weighted smoothing (such as exponential decay weighted average or weighted median within a time window) is applied to the historical mapped position information according to the preset time decay parameter, and outliers can be removed by combining the confidence threshold to obtain the second candidate target position information representing a more conservative position estimate, so as to avoid drastic position jumps caused by instantaneous noise.

[0047] Based on the comprehensive stability score, the first candidate target location information and the second candidate target location information are subjected to confidence weighting to obtain the target location information.

[0048] Specifically, based on the comprehensive stability score, the first candidate target location information and the second candidate target location information are weighted and synthesized according to the mapped confidence level or the weight determined by the comprehensive score. Boundary constraints and necessary endpoint protection strategies are applied to the synthesis result to output the final target location information and its confidence level for use in cursor updates or subsequent control command generation.

[0049] In an optional embodiment, if the interaction signal type is the button signal and the current control mode is the direction control mode, then determining the interaction operation strategy for the real-time displayed content on the large screen display device based on the interaction signal type and the current control mode includes: In response to the key instruction, the direction control instruction triggered by the user is parsed according to the key signal to obtain the direction control parameters; Specifically, in response to the key command, upon receiving a key event, the key signal from the interactive terminal is decoded and standardized into a set of parameters for subsequent control. Specifically, firstly, basic information such as key encoding, press / release state, trigger timestamp, and duration is extracted from the key signal. Then, based on a preset key-semantic mapping table, the key encoding is converted into directional semantics (e.g., up / down / left / right or angle vector). Next, the quantized attributes of the directional control parameters are calculated based on the key state and duration, including movement direction, displacement amplitude or step size, continuous movement rate / acceleration configuration, repetition trigger frequency (long press acceleration strategy), and stopping conditions. Simultaneously, sudden jitter or jittering is handled with debouncing / anti-jitter processing, and fault-tolerant judgment is performed on abnormal or conflicting key combinations. Finally, the normalized directional control parameters (including confidence level or priority label) are output for use by the control type determination module. This processing enables discrete key inputs to be converted into quantifiable, configurable, and consistent control command inputs, facilitating precise cursor movement or function calls downstream.

[0050] Based on the direction control parameters, the control type corresponding to the direction control command is determined, wherein the control type includes cursor movement control and function operation control; Specifically, the quantized directional control parameters are mapped to subsequent executable control semantics, thereby determining the direction of the subsequent processing chain. To this end, the received directional control parameters (e.g., direction vector, displacement amplitude, duration, trigger frequency, and quantized attributes such as velocity / acceleration) are compared with preset control mapping rules or lookup table mappings. These mapping rules may include threshold judgment (e.g., amplitude threshold, duration threshold), angle range matching, key combination / sequence pattern recognition, and pattern matching of specific gestures or rate features. Simultaneously, the current interaction context (e.g., focus object type, interface state, mode lock flag) and historical input information are used for judgment. To avoid frequent switching, a hysteresis or confirmation window mechanism is introduced in the judgment process, and a confidence index is output. When mapping results conflict, priority is given to the one with the higher confidence, or a secondary confirmation strategy is triggered. Finally, the output identifier is the control type identifier for cursor movement control or function operation control, along with the corresponding control parameters and confidence information, for use by downstream candidate position calculation or function instruction generation modules.

[0051] If the control type is cursor movement control, then based on the direction control parameters and the preset displacement compensation, the current position of the cursor is incrementally calculated to obtain the candidate target position information of the cursor. Specifically, based on the direction control parameters (e.g., direction vector, displacement amplitude, key press duration, etc.), the direction information is first normalized into a unit direction vector and a reference step size is determined. Then, based on a preset displacement compensation strategy (e.g., scaling factor according to screen resolution / size, user distance / viewpoint compensation, long press acceleration curve, speed-related acceleration / deceleration model, and preset dead zone), the displacement increment is calculated, that is, the reference step size is multiplied by the displacement compensation coefficient and combined with the time increment to obtain the increment values ​​Δx and Δy in the screen coordinate system. Next, the Δx and Δy are vector-superimposed with the current position of the cursor to obtain the candidate target position information of the cursor. At the same time, metadata of the candidate position (e.g., timestamp, confidence level, trigger parameters) can be generated for subsequent boundary constraints and corrections. Minimum quantization, rate capping, or debouncing processing is applied to the calculated increment to avoid abnormal jumps.

[0052] Obtain the display boundary position information of the large screen display device; Specifically, the display boundary position information refers to boundary data used to define the interactive display area, including the physical pixel range of the screen, the active interactive area, the non-interactive / occluded area, and geometric parameters related to display direction, scaling, or rotation. The purpose of this step is to obtain a spatial reference for subsequent position constraints and corrections to prevent the cursor or interactive target from exceeding the visible or controllable range. In implementation, this information can be read from the large screen's system configuration, runtime layout management module, or calibration module. If necessary, it can be combined with the current application interface layout or multi-window hierarchy calculation to obtain the effective interactive boundary, and output in standardized coordinates for use in subsequent steps.

[0053] Based on the displayed boundary position information and the candidate target position information, the cursor position is constrained and corrected to obtain the corrected cursor position information. Specifically, based on the display boundary position information and the candidate target position information, and using the candidate target position information and the display boundary position information as input, the purpose is to adjust the candidate position to a legal screen position that conforms to the interaction rules. The implementation ideas include constraining the candidate coordinates to the boundary range, applying soft constraints (such as elastic boundaries or progressive reduction) to the displacements close to the boundary, projecting or avoiding points located in the occluded area or non-interactive area, and combining interface elements (such as control hotspots) to execute snapping or alignment rules. In addition, hysteresis, minimum movement threshold, or micro-smoothing can be introduced to avoid jitter at the boundary. The output is the corrected cursor position information with a correction type and confidence level indicator.

[0054] Based on the corrected cursor position information and the current cursor position, determine the cursor movement control command; Specifically, based on the corrected cursor position information and the current cursor position, the position difference is converted into executable control instructions to drive cursor movement on the large screen. The implementation includes calculating the displacement vector between the current position and the corrected position, selecting the instruction type (e.g., absolute positioning instruction or incremental movement instruction) according to the system strategy, applying rate limits, interpolation / transition parameters or animation configurations to ensure smooth motion, and encapsulating information such as displacement, rate, timestamp, and confidence into standardized cursor movement control instructions. The generated instructions can directly drive the display engine or serve as an action unit for upper-level event interaction, and downstream processes can execute rendering or further compositing according to the instructions.

[0055] If the control type is function operation control, then the function operation control command is determined according to the preset function mapping relationship and the direction control parameters; Specifically, based on a preset function mapping table and directional control parameters, the aim is to map directional inputs into higher-level functional commands (such as page turning, playback switching, etc.). In practice, the function items corresponding to the directional parameters are identified by looking up tables or matching rules, and functional operation control instructions are generated by combining trigger conditions (short press / long press, angle range, continuous sequence, etc.). The instructions should include function identifiers, necessary parameters, and trigger time information, and can be supplemented with debouncing or confirmation logic to avoid false triggering. The output of this step is a functional instruction that can be executed by application logic or system services.

[0056] The interactive operation strategy is determined based on the cursor movement control instructions and the function operation control instructions.

[0057] Specifically, instructions from both cursor movement and function operation are uniformly scheduled and synthesized to form the final interactive operation strategy for use by the execution module. The implementation methods include arbitrating the two types of instructions according to preset priorities, context rules, or user preferences (e.g., movement priority or function priority, concurrent execution or queued execution), merging mergeable instructions (e.g., triggering a function after movement is completed), and generating scheduling parameters (execution sequence, rollback strategy, command batching rules, and feedback requirements). Finally, a structured interactive operation strategy is output, which includes the sequence of control commands to be executed, execution constraints, and monitoring indicators to ensure consistent, predictable, and conflict-free interactive behavior during the execution phase.

[0058] In an optional embodiment, if the control type is function operation control, then determining the function operation control instruction based on a preset function mapping relationship and the direction control parameters includes: Based on the function mapping relationship, a preset function operation type and its corresponding function control parameters are obtained, wherein the preset function operation type includes page turning function and playback switching; Specifically, available function operation types and their corresponding function control parameters are read from a preset function mapping relationship storage unit. The preset function operation types include at least page turning and playback switching. Each function operation type corresponds to a set of function control parameters to characterize its triggering conditions and execution constraints. The function control parameters may include information such as direction range, amplitude threshold, duration threshold, key combination rules, execution priority, and cooldown / hold time window. The above reading can be completed based on a lookup table, configuration file, or remotely distributed strategy set, and the preset function operation types and their function control parameters are output in a structured format for subsequent feature matching.

[0059] Feature extraction is performed on the direction control parameters and the function control parameters to obtain direction control features and function control features; Specifically, the parsed directional control parameters are standardized and characterized to extract representative values ​​such as normalized direction vectors, displacement amplitude levels, duration categories, repetitive triggering frequencies, and directional change rates to form directional control features. Simultaneously, the functional control parameters are vectorized or interval-based, converting direction intervals, amplitude thresholds, duration windows, and key combinations into comparable functional control features (e.g., direction interval labels, threshold interval vectors, trigger mode encodings). Feature extraction may include normalization, quantization binning, and additional confidence level labeling, and outputs directional control features and functional control features for matching and comparison.

[0060] The directional control features and function control features are matched, and the target function operation type corresponding to the directional control parameters is obtained based on the matching result. Specifically, the directional control features are compared and scored with each functional control feature. The matching can be done using rule-based judgment (threshold, interval inclusion), similarity measurement, or a lightweight classification model to calculate the matching score for each functional operation type. The matching scores are sorted and filtered and conflict-resolved according to a preset confidence threshold, priority rules, and contextual constraints (such as the current interface state or mode lock) to identify the target functional operation type that best matches the directional control parameters, and the target functional operation type and its matching confidence are output.

[0061] The function operation control instruction is determined based on the target function operation type.

[0062] Specifically, the target function operation type is mapped to a specific function operation control instruction format, and instruction parameters are set according to the matching confidence and function control parameters (e.g., page turning direction is "previous page / next page", number of page turning steps or continuous page turning rate; playback switching is "previous track / next track / play / pause", etc.). At the same time, execution priority, timestamp, initiating terminal identifier and necessary anti-shake or confirmation flags are added. The function operation control instructions are formatted and sent to the interaction strategy synthesis module or execution unit so as to jointly determine the final interaction operation strategy with the cursor movement control instructions.

[0063] In an optional embodiment, if the interaction signal type is the key signal and the current control mode is writing mode, then if the control type is function operation control, determining the interaction operation strategy for the real-time displayed content on the large screen display device based on the interaction signal type and the current control mode includes: Based on the key signal, writing-related data is obtained, wherein the writing-related data includes key code, key state, and key trigger time; Specifically, the raw key signals from the interactive terminal are received and structured. The key encoding is used to identify specific keys or key combinations, the key state is used to indicate the action category such as press / hold / release, and the key trigger time is used to record the time of event occurrence and duration. The purpose is to transform discrete key events into standardized trigger data that can be parsed by the upper layer to support the recognition of writing semantics. Implementation may include key message parsing, timestamp recording, debouncing processing, and event queuing, and the output data structure includes necessary device identifiers and confidence labels. The writing-related data serves as the input to the subsequent writing parsing module.

[0064] Based on the writing-related data, the user's writing operation is analyzed to obtain writing input parameters, which include stroke start point, stroke direction, stroke amplitude, and continuous writing status information. Specifically, a set of parameters representing the writing intention is inferred from the aforementioned writing-related data in order to reconstruct the stroke path in the large-screen coordinate system. The implementation idea includes using key codes and trigger times to determine the start and end of strokes (e.g., short press corresponds to a single point, long press or continuous key sequence corresponds to continuous strokes), determining the stroke direction vector based on key semantics and historical position, estimating the stroke amplitude or step size based on duration or repetition frequency, and identifying the continuous writing state (e.g., entering / exiting continuous writing mode) through pattern detection. The output is a structured writing input parameter that can carry time series information and confidence level for subsequent mapping.

[0065] Based on the preset coordinate mapping relationship between the writing input parameters and the large screen display device, and the preset operation range constraints, coordinate transformation is performed on the starting and ending points of the strokes to obtain the mapped writing data corresponding to the screen coordinate system. Specifically, the user's writing input parameters are converted into actual display coordinates on the large screen, and operation range restrictions are applied to ensure that writing is performed within the legal display area. In practice, affine or projective transformations are performed on the start and end points based on preset calibration transformations or mapping tables. The coordinates are scaled and offset corrected in conjunction with the user's minimum body movement range and the interaction safety zone. Points exceeding the boundaries are clamped or projected for correction. The output is mapped writing data that satisfies the screen coordinate system and operation constraints, serving as the basis for trajectory reconstruction and rendering.

[0066] Based on the mapped writing data, trajectory interpolation and smoothing filtering are performed on continuous writing points to obtain a target writing trajectory that conforms to writing continuity. Specifically, a continuous and coherent writing trajectory is reconstructed from discrete or sparse mapping points to ensure smooth strokes and conformity to writing habits. In practice, the mapping points can be sorted by time and interpolated (e.g., piecewise curve interpolation or interpolation point completion) to fill sampling gaps. Then, temporal smoothing filtering is applied to suppress instantaneous jitter and smooth the curve while retaining key turning points. The output is preliminary target writing trajectory data that meets the coherence requirements and is labeled with the confidence level or feature point information of the trajectory segments.

[0067] Based on the target writing trajectory, the sensitivity of the stroke trajectory is adjusted and the trajectory is corrected to obtain the corrected writing trajectory; Specifically, the sensitivity of the trajectory response is adjusted based on the real-time interactive context, and the trajectory is modified as necessary to adapt to user expectations and display characteristics. In terms of implementation, the smoothing intensity can be adaptively adjusted based on the velocity / acceleration characteristics of the trajectory (e.g., reducing smoothing for fast writing and enhancing smoothing for slow writing), and a dynamic compensation model can be used to correct for system latency or hand micro-movements. Protection or preservation strategies can also be applied to endpoints and turning points to avoid loss of details due to excessive smoothing. The output is the final writing trajectory after sensitivity adjustment and geometric / temporal correction, carrying execution parameters for use in command generation.

[0068] Based on the corrected writing trajectory, writing operation control instructions are generated, and these writing operation control instructions are used as the interactive operation strategy.

[0069] Specifically, the corrected trajectory is converted into specific control commands to drive the large-screen display unit to execute writing display. The purpose is to describe the stroke drawing process in a standardized command format and ensure executability and traceability. The implementation includes discretizing the trajectory into a sequence of rendering points or a path description, setting the stroke style and drawing rate, encapsulating timestamps and priority information, and issuing commands through the display control interface and monitoring execution feedback. These writing operation control commands constitute the final interactive operation strategy, thereby triggering corresponding real-time writing display on the large screen and recording the execution status for necessary backtracking or retries.

[0070] In an optional embodiment, the step of performing trajectory interpolation and smoothing filtering on consecutive writing points based on the mapped writing data to obtain a target writing trajectory that conforms to writing continuity includes: Based on the mapped writing data, coordinates are extracted and temporal sequence is processed for continuous writing points to obtain a temporal writing point set. Specifically, the screen coordinates and timestamps of each sampling point are extracted based on the previously obtained mapping writing data. The extracted points are then sorted by time sequence, deduplicated, and aligned temporally. If necessary, time synchronization or missing point marking is performed on points from different sources or irregular sampling. This results in a temporal writing point set arranged in time sequence and containing coordinate and time information. The purpose of this step is to provide a consistent and indexable input sequence for subsequent interpolation and curve construction. The output typically includes a (x,y,t) triplet for each point and optional confidence / quality labels.

[0071] Trajectory interpolation is performed on adjacent points in the time-series writing point set to obtain the interpolated intermediate point; Specifically, based on the preset interpolation strategy and sampling rate, interpolation calculations are performed between adjacent sampling points of the time-series writing point set to fill in spatial or temporal gaps. The interpolation method can be linear interpolation, piecewise cubic spline, Bessel, or other piecewise polynomial interpolation, and the interpolation density can be adaptively determined according to the speed to obtain a set of intermediate points inserted between the original sampling points. The purpose of this step is to improve the spatiotemporal resolution of the trajectory in order to generate a continuous curve, and the output is a dense point sequence containing the original points and interpolation points.

[0072] Based on the interpolated midpoint, the writing trajectory is processed to construct curves and preserve turning features, resulting in the writing trajectory curve; Specifically, taking the interpolated dense point sequence as input, a continuous parametric curve or path representation is constructed using curve fitting or path construction methods. At the same time, important turning points or corner features of the strokes are identified and preserved (e.g., through curvature or angle threshold detection). Feature preservation strategies are applied to the detected turning points (e.g., reducing the smoothing intensity or inserting control vertices at these points), thereby generating a writing trajectory curve that is both smooth and does not lose value at key turning points. The purpose of this step is to convert the discrete point sequence into a continuous curve output that conforms to the semantics of handwriting.

[0073] Based on the writing trajectory curve, the trajectory points are smoothed and filtered to obtain the processed trajectory data. Specifically, the constructed writing trajectory curve is smoothed in the time or parameter domain to suppress noise and minor jitter. The smoothing method can be adaptive low-pass filtering, Kalman filtering, etc. The filtering intensity can be adjusted according to the local velocity or curvature of the trajectory to avoid weakening the turning features. At the same time, the endpoints are protected to prevent excessive smoothing from causing breakage. The output is the processed trajectory data that is denoised and retains the key structure, which is used for subsequent rendering and control command generation.

[0074] Based on the trajectory data, the trajectory is organized and synthesized to obtain the target writing trajectory.

[0075] Specifically, the processed trajectory data is segmented according to stroke segments, neighboring segments are merged, short noise segments are removed, and the trajectory is finally resampled or quantized to match the display resolution and rendering requirements. If necessary, stroke style, speed information and timestamps are added to the trajectory. Multiple strokes or sub-paths are sequentially synthesized into a complete target writing trajectory representation (such as a path sequence or parameterized path). The final output can be directly used to generate writing control instructions or drive the target writing trajectory and its metadata for large-screen rendering.

[0076] Example 2 like Figure 3 As shown, in the actual use of multifunctional large screens, users often need to freely switch between different interaction distances and scenarios, making the switching between touch screen mode and off-screen mode necessary. For example, when demonstrating at close range, making detailed annotations, or writing content, users are more accustomed to directly touching the screen; however, when giving presentations, lecturing in class, or needing to maintain a certain distance to operate the large screen, users must switch to off-screen indicator mode for convenient remote control. If there is no natural and continuous transition between the two modes, the cursor may jump or lose its position after switching, resulting in an interruption of the interactive experience. Therefore, based on Embodiment 1, if the real-time control mode of the multifunctional large screen is touch screen display mode and responds to the user's button command, and the current control mode is obtained as off-screen display mode, then the step of determining the interactive operation strategy for the real-time displayed content on the large screen display device according to the interaction signal type and the current control mode further includes: In response to the large screen control mode switching from touch screen display mode to off-screen display mode, the touch screen position information recorded in the touch screen display mode is collected according to a preset time range to obtain the target touch screen position information sequence; Specifically, the system retains the user's most recent valid touch behavior trajectory at the moment of mode switching. Specifically, when the large-screen system detects that the user has switched from near-field touch operation to far-field off-screen operation (such as a laser pointer or air mouse) via buttons or menus, it traces back the touch coordinate records within a preset time period, organizing all touch points within that time period into a trajectory sequence in chronological order. For example, in a conference presentation or classroom lecture, the speaker typically first circles key points on the screen, clicks on a section of text, and then moves back to the podium or the center of the classroom to continue the lecture using off-screen mode. This sequence completely preserves this touch behavior near the mode switch, providing a data foundation for subsequently extracting stable reference positions and initializing the off-screen cursor, preventing the system from forgetting the area the user just focused on after the mode switch.

[0077] Based on the target touch screen position information sequence, the touch screen trajectory is processed in time sequence and anomalies are removed. Combined with a preset touch screen stability threshold, the continuity and spatial stability of the touch screen trajectory are judged to obtain touch screen reference position information that meets the stability requirements. Specifically, stable points representing the user's true focus location are extracted from the original touch trajectory. In practice, this involves two steps: first, sorting touch points by time and connecting their trajectories to eliminate isolated points that are significantly deviated from the main trajectory or short-term accidental touches; second, statistically analyzing the displacement amplitude and speed changes at the end of the trajectory within a preset time window. When both displacement and speed are below a preset touch screen stability threshold, the area is determined to be the user's dwell or indication area, from which a representative touch screen reference point is selected. In meeting or classroom scenarios, this reference position information typically corresponds to the speaker's last indication or the position where they finished writing. By extracting this stable point, it is possible to effectively prevent the off-screen cursor from jumping from an abnormal position due to finger tremors, accidental touches, or rapid screen swipes, ensuring that subsequent off-screen operations start from the position the user is truly focused on.

[0078] Based on the mapping relationship between the touch screen reference position information and the screen coordinates of the large screen display device, the touch screen reference position information is converted into screen coordinates in off-screen mode to obtain the off-screen initial cursor position information; Specifically, a connection between the two interaction modes is established under a unified coordinate system. For application scenarios using multi-screen splicing, scaling display, or external projection, the system can combine calibration parameters such as the large screen's resolution, coordinate origin, and scaling ratio to perform coordinate conversion and transformation on the touch screen reference point, obtaining the accurate screen coordinates under the current display layout. When using a single-screen display with a unified resolution, the touch screen reference point can be directly used as the initial cursor position in off-screen mode. Through the above mapping process, whether the user is drawing charts with their finger at the podium or writing formulas near the blackboard in the classroom, the system can accurately map that position to the starting coordinates of the subsequent off-screen cursor, ensuring that the cursor remains in the same content area after switching interaction modes, avoiding cursor jumping that could affect the audience's continuous understanding of the content.

[0079] Based on the off-screen initial cursor position information, the cursor state in off-screen mode is initialized and configured to obtain the off-screen initial cursor control parameters. Specifically, the initial cursor control parameters for off-screen presentations include not only the cursor's initial coordinates but also its display style, initial movement sensitivity, movable area range, and status information related to the current presentation content, such as the current PPT page number and annotation layer on / off status. After completing coordinate mapping, the system repositions the cursor to its initial off-screen position and loads control parameters suitable for long-distance indication or operation according to a preset strategy. This allows the presenter to simply pick up the off-screen terminal when moving to the center of the room or the back of the classroom and continue lecturing around the previously marked or indicated location without needing to search for or correct the cursor position again. This initial configuration significantly reduces preparation time after mode switching, maintaining the continuity of the presentation rhythm.

[0080] Based on the off-screen initial cursor control parameters, the initial cursor position and initial control state in off-screen mode are determined as the interaction operation strategy.

[0081] Specifically, this enables seamless integration of touchscreen and off-screen modes in terms of interaction logic. After calculating the aforementioned parameters, the system writes the initial cursor position and corresponding control state into the control strategy of the current interactive session. Subsequent received light dot indicators and directional button signals are then processed based on this initial state. Thus, during conference presentations or lectures, when the speaker switches from near-field touch to far-field pointing, the cursor on the large screen will not reappear in its default position or a corner of the screen, but will naturally remain near the key area it just interacted with. Off-screen control commands are also incrementally updated based on this. By uniformly managing off-screen initialization as part of the interaction operation strategy, this solution maintains consistency and predictability of cursor behavior across multiple scenarios and modes, effectively improving the overall experience and professional presentation of the multi-functional large screen in human-computer interaction.

[0082] Example 3 In addition, combined Figure 1 The interactive control method for the multifunctional large-screen display device described in this embodiment of the invention can be implemented by the interactive control system for the multifunctional large-screen display device. Figure 4 A schematic diagram of the hardware structure of the interactive control system for the multifunctional large-screen display device provided in an embodiment of the present invention is shown.

[0083] The interactive control system for a multi-functional large-screen display device may include a processor and a memory storing computer program instructions.

[0084] Specifically, the processor may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement embodiments of the present invention.

[0085] Memory may include non-persistent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0086] Computer-readable media include both permanent and non-permanent, removable and non-removable media, which can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient media, such as modulated communication signals and carrier waves.

[0087] The processor reads and executes computer program instructions stored in the memory to implement any of the interactive control methods for the multifunctional large-screen display device in the above embodiments.

[0088] In one example, the interactive control system for the multi-functional large-screen display device may also include a communication interface and a bus. For example, Figure 4 As shown, the processor 401, memory 402, and communication interface 403 are connected through bus 410 and complete communication with each other.

[0089] The communication interface is mainly used to enable communication between various modules, devices, units and / or equipment in the embodiments of the present invention.

[0090] A bus, including hardware, software, or both, couples together components of a multi-functional large-screen display device's interactive control system. For example, and not limitingly, a bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, a bus may include one or more buses. While specific buses are described and illustrated in embodiments of the invention, the invention contemplates any suitable bus or interconnect.

[0091] In summary, the embodiments of the present invention provide an interactive control method and system for a multifunctional large-screen display device.

[0092] It should be clarified that the present invention is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown. Those skilled in the art can make various changes, modifications, and additions, or change the order of steps, after understanding the spirit of the present invention.

[0093] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0094] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0095] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0096] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0097] It should also be noted that the exemplary embodiments mentioned in this invention describe methods or systems based on a series of steps or apparatus. However, this invention is not limited to the order of the steps described above; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0098] The above description is merely a specific embodiment of the present invention. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the protection scope of the present invention.

Claims

1. An interactive control method for a multifunctional large-screen display device, characterized in that, The method includes: In response to an interactive request command, acquire interactive signals emitted by interactive terminals within a preset distance range; Based on the interaction signal, obtain the interaction signal type and the current control mode of the interaction terminal; Based on the interaction signal type and the current control mode, determine the interaction operation strategy for the real-time displayed content on the large screen display device; According to the interactive operation strategy, interactive operations are performed on the real-time displayed content to complete the interactive control of the large screen display device.

2. The interactive control method for the multifunctional large-screen display device according to claim 1, characterized in that, The step of obtaining the interaction signal type and the current control mode of the interaction terminal based on the interaction signal includes: The interaction signals are classified, and the interaction signal type is obtained based on the classification result. The interaction signal type includes light spot signals and button signals. If the type of the interaction signal is the light spot signal, then the current control mode is determined to be the light spot indication mode; If the interaction signal type is the key signal, then in response to the key command issued by the user, the current control mode corresponding to the key command is obtained, wherein the current control mode includes directional control mode and writing mode.

3. The interactive control method for the multifunctional large-screen display device according to claim 2, characterized in that, If the interaction signal type is the light spot signal and the current control mode is the light spot indication mode, then the interaction operation strategy for the real-time displayed content in the large screen display device is determined according to the interaction signal type and the current control mode, including: Based on the light spot signal, obtain the position information of the light spot emitted by the interactive terminal on the large screen display device; Based on the light spot position information and the preset calibration parameters corresponding to the large screen display device, the light spot is mapped to obtain the mapped position information of the light spot in the screen coordinate system. Based on the mapped position information, the movement trajectory of the light spot is smoothed and dynamically compensated to obtain the target position information. Based on the target location information and the original position information of the cursor in the large screen display device, a cursor update control command is determined as the interactive operation strategy.

4. The interactive control method for the multifunctional large-screen display device according to claim 3, characterized in that, The step of performing smoothing filtering and dynamic compensation processing on the movement trajectory of the light spot based on the mapped position information to obtain the target position information includes: Based on the mapped position information, the continuous position data of the light spot within a preset time window are sampled and aggregated to obtain the trajectory change vector of the light spot. Based on the trajectory change vector, the fluctuation amplitude of the position of the light spot in the time domain is statistically analyzed, and combined with a preset time domain stability threshold, the time domain stability determination result of the light spot is obtained. Based on the trajectory change vector, the displacement trend of the light spot in the spatial domain is predicted, and combined with the spatial constraints of the preset target area, the spatial stability determination result of the light spot is obtained. Based on the temporal stability determination result and the spatial stability determination result, the motion state of the light spot is determined twice to obtain the target position information that meets the anti-shake requirements.

5. The interactive control method for the multifunctional large-screen display device according to claim 4, characterized in that, The step of performing a dual determination of the motion state of the light spot based on the temporal stability determination result and the spatial stability determination result to obtain the target position information that meets the image stabilization requirements includes: Based on the time-domain stability determination results and the spatial-domain stability determination results, the stability index is quantified to obtain the time-domain stability score and the spatial-domain stability score. According to the preset weight allocation parameters, the time domain stability score and the spatial domain stability score are weighted and fused to obtain a comprehensive stability score. The comprehensive stability score is compared with a preset anti-shake threshold to obtain the anti-shake determination result of the light spot motion state, wherein the anti-shake determination result includes stable and unstable. If the anti-shake determination result is stable, then based on the trajectory change vector, the mapped position information is interpolated, fitted and dynamically compensated to obtain the first candidate target position information; If the anti-shake determination result is unstable, then according to the preset time decay parameter, the preset historical position information corresponding to the mapped position information is smoothed to obtain the second candidate target position information. Based on the comprehensive stability score, the first candidate target location information and the second candidate target location information are subjected to confidence weighting to obtain the target location information.

6. The interactive control method for the multifunctional large-screen display device according to claim 2, characterized in that, If the interaction signal type is the button signal and the current control mode is the direction control mode, then the interaction operation strategy for the real-time displayed content on the large screen display device is determined according to the interaction signal type and the current control mode, including: In response to the key instruction, the direction control instruction triggered by the user is parsed according to the key signal to obtain the direction control parameters; Based on the direction control parameters, the control type corresponding to the direction control command is determined, wherein the control type includes cursor movement control and function operation control; If the control type is cursor movement control, then based on the direction control parameters and the preset displacement compensation, the current position of the cursor is incrementally calculated to obtain the candidate target position information of the cursor. Obtain the display boundary position information of the large screen display device; Based on the displayed boundary position information and the candidate target position information, the cursor position is constrained and corrected to obtain the corrected cursor position information. Based on the corrected cursor position information and the current cursor position, determine the cursor movement control command; If the control type is function operation control, then the function operation control command is determined according to the preset function mapping relationship and the direction control parameters; The interactive operation strategy is determined based on the cursor movement control instructions and the function operation control instructions.

7. The interactive control method for a multifunctional large-screen display device according to claim 6, characterized in that, If the control type is function operation control, then according to the preset function mapping relationship and in combination with the direction control parameters, the function operation control command is determined to include: Based on the function mapping relationship, a preset function operation type and its corresponding function control parameters are obtained, wherein the preset function operation type includes page turning function and playback switching; Feature extraction is performed on the direction control parameters and the function control parameters to obtain direction control features and function control features; The directional control features and function control features are matched, and the target function operation type corresponding to the directional control parameters is obtained based on the matching result. The function operation control instruction is determined based on the target function operation type.

8. The interactive control method for a multifunctional large-screen display device according to claim 6, characterized in that, If the interaction signal type is the key signal and the current control mode is writing mode, then if the control type is function operation control, then the interaction operation strategy for the real-time displayed content on the large screen display device is determined according to the interaction signal type and the current control mode, including: Based on the key signal, writing-related data is obtained, wherein the writing-related data includes key code, key state, and key trigger time; Based on the writing-related data, the user's writing operation is analyzed to obtain writing input parameters, which include stroke start point, stroke direction, stroke amplitude and continuous writing status information. Based on the preset coordinate mapping relationship between the writing input parameters and the large screen display device, and the preset operation range constraints, coordinate transformation is performed on the starting and ending points of the strokes to obtain the mapped writing data corresponding to the screen coordinate system. Based on the mapped writing data, trajectory interpolation and smoothing filtering are performed on continuous writing points to obtain a target writing trajectory that conforms to writing continuity. Based on the target writing trajectory, the sensitivity of the stroke trajectory is adjusted and the trajectory is corrected to obtain the corrected writing trajectory; Based on the corrected writing trajectory, writing operation control instructions are generated, and these writing operation control instructions are used as the interactive operation strategy.

9. The interactive control method for a multifunctional large-screen display device according to claim 8, characterized in that, The step of performing trajectory interpolation and smoothing filtering on consecutive writing points based on the mapped writing data to obtain a target writing trajectory that conforms to writing continuity includes: Based on the mapped writing data, coordinates are extracted and temporal sequence is processed for continuous writing points to obtain a temporal writing point set. Trajectory interpolation is performed on adjacent points in the time-series writing point set to obtain the interpolated intermediate point; Based on the interpolated midpoint, the writing trajectory is processed to construct curves and preserve turning features, resulting in the writing trajectory curve; Based on the writing trajectory curve, the trajectory points are smoothed and filtered to obtain the processed trajectory data. Based on the trajectory data, the trajectory is organized and synthesized to obtain the target writing trajectory.

10. A multifunctional large-screen display device interactive control system, characterized in that, include: At least one processor, at least one memory, and computer program instructions stored in the memory, which, when executed by the processor, implement the method as described in any one of claims 1-9.

Images