An LED transparent display intelligent control system for motion teaching
By analyzing motion data through an intelligent control system, generating dynamic masking layers, and adjusting display parameters, the problem of visual interference with motion teaching content on transparent display devices is solved, enabling precise, collaborative display, and interactive control of motion teaching content.
Patent Information
- Application Number
- CN202511756408.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-11-27
- Publication Date
- 2026-03-06
- Estimated Expiration
- 2045-11-27
AI Technical Summary
The existing movement instruction content appears chaotic on transparent display devices, making it difficult to adjust flexibly according to training needs, resulting in visual interference and poor teaching synergy.
The system receives demonstration motion data through a data interface array, the structure analysis processor identifies the main motion and auxiliary description areas, the mask generation unit generates a dynamic mask layer, the area mapping controller implements area mapping, the interactive response unit adjusts display parameters, and the drive signal generator generates drive signals to achieve intelligent control of the motion content.
It effectively solves the problem of visual interference in action teaching content in a transparent display environment, realizes dynamic response and collaborative display of action demonstration and key point explanation, and improves information transmission efficiency and training interaction experience.
Smart Images

Figure CN121214733B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of motion instruction technology, and more specifically to an intelligent control system for LED transparent display used in motion instruction. Background Technology
[0002] With the deep integration of information technology and professional movement training, intelligent teaching environments have become an important development direction for improving the effectiveness of sports training and dance instruction. Transparent display technology, with its unique perspective characteristics, can seamlessly connect digitized standard movement libraries with real-world training scenarios, providing an innovative visualization solution for high-precision movement demonstrations and technical point analysis. LED transparent display devices, as a typical example of this technology, enable coaches or dance teachers to present slow-motion replays and keyframe analyses of standard movements while maintaining face-to-face guidance with students, potentially creating a more precise and efficient professional training model.
[0003] In existing technologies, some solutions have attempted to apply motion instruction resources to transparent display environments. These solutions typically use direct projection to display complete instructional videos or motion breakdown diagrams on a transparent screen. To optimize the display effect, some methods employ fixed content partitioning strategies, such as arranging video footage and text narration in separate areas using preset templates, or achieving simple separation of static and dynamic content based on image difference detection. Furthermore, some interactive solutions achieve basic control over the teaching process by recognizing the instructor's basic hand gestures, such as waving to switch instructional content or clenching a fist to pause playback. These constitute early applications of transparent display technology in the field of motion instruction.
[0004] However, currently widely used standard motion videos, technical breakdown diagrams, and other teaching resources are primarily designed around the unidirectional demonstration needs of traditional two-dimensional display devices. When these teaching materials are directly projected onto a transparent LED display screen with a perspective effect, the dynamic demonstration content and the training environment create visual competition, making it difficult to effectively distinguish between core motion trajectories and auxiliary technical explanations. Existing fixed-partitioning models are ill-suited to the specific structural requirements of different training movements, while content separation methods based on surface visual features lack a deep understanding of the logic of motion techniques, resulting in a lack of pedagogical synergy between key technical demonstrations and related instructional prompts in a transparent environment. Instructors struggle to flexibly and precisely control the display of different types of teaching information according to real-time training needs. Summary of the Invention
[0005] The purpose of this invention is to provide an intelligent control system for LED transparent display used in motion teaching, solving the following technical problems:
[0006] The existing motion instruction content is not designed for transparent display and deep interaction. When projected directly onto an LED transparent display screen, the display effect is chaotic.
[0007] The objective of this invention can be achieved through the following technical solutions:
[0008] An intelligent control system for LED transparent display used in motion instruction includes:
[0009] The data interface array is used to receive demonstration action data input by the instructor. The demonstration action data includes standard action videos, breakdown action diagrams, and key point explanations.
[0010] A structural analysis processor is used to analyze the compositional structure of demonstration motion data and identify the main motion areas and auxiliary description areas in the demonstration motion data.
[0011] The mask generation unit is used to generate a dynamic mask layer based on the teacher's limb command trajectory. The dynamic mask layer defines the opaque and transparent areas of the LED transparent display device.
[0012] The area mapping controller is used to map the main action area to an opaque area for display and to map the auxiliary description area to a transparent area for display.
[0013] The interactive response unit is used to detect the instructor's pointing operation on the main action area and adjust the display parameters of the corresponding auxiliary explanation area according to the pointing operation;
[0014] A drive signal generator is used to generate drive signals for LED transparent display devices based on the dynamic masking layer and display parameter adjustment results.
[0015] As a further aspect of the present invention: the specific process of analyzing the compositional structure of the demonstration action data in the structure analysis processor is as follows:
[0016] The system analyzes standard motion video data using a video decoder, processes decomposed motion illustration data using a graphics processor, and processes instructional data using a text parser. Based on the spatial relationships and size proportions of the motion elements, the demonstration motion data is divided into multiple initial content regions. Adjacent initial content regions with similar motion features are merged based on motion feature similarity. The number of motion elements per unit area in each content region is calculated using a computing unit as the spatial distribution density. A comparator identifies content regions with spatial distribution density values greater than a set threshold as primary motion regions and content regions with spatial distribution density values less than a set threshold as auxiliary instruction regions.
[0017] The feature recognizer identifies standard action demonstration elements and key posture elements in the main action area; the content analyzer identifies action key points and precaution elements in the auxiliary instruction area; the coordinate acquisition device records the boundary coordinates of the main action area and the auxiliary instruction area; and the storage unit establishes a correspondence table between the main action area and the auxiliary instruction area.
[0018] As a further aspect of the present invention: the specific process of generating a dynamic mask layer based on the teacher's limb command trajectory in the mask generation unit is as follows:
[0019] The spatial position data of the teacher's limbs are continuously collected by a depth sensor array at a fixed sampling frequency. The spatial position data is projected onto an LED transparent display plane by a coordinate converter to generate a trajectory projection graphic. The contour extractor performs a boundary tracking algorithm on the trajectory projection graphic to obtain a closed limb command trajectory contour.
[0020] The calculation unit calculates the centroid coordinates of the outline of the limb command trajectory. Based on the centroid coordinates, it extends to both sides by a set distance to form an opaque area. The area outside the opaque area is defined as the transparent area. The curve generator uses a smooth curve to connect the boundaries of the transparent and opaque areas. The shapes of the opaque and transparent areas are updated according to the real-time changes of the teacher's limb command trajectory.
[0021] As a further aspect of the present invention: the specific process of expanding to both sides by a predetermined distance to form an opaque area is as follows:
[0022] The minimum bounding rectangle of the limb command trajectory is calculated by the geometric calculation unit. The expansion distance is dynamically adjusted according to the speed of the teacher's limb movement. The expansion distance is translated outward along the four sides of the minimum bounding rectangle to generate the boundary of the opaque area. The Bezier curve fitting algorithm is performed on the boundary of the opaque area by the curve fitter. The pixel processing unit sets the transparency value of the pixels inside the opaque area to zero. The transparency value of the pixels outside the opaque area is set according to the distance of the pixels from the boundary of the opaque area.
[0023] As a further aspect of the present invention: the specific process of mapping the main action area and the auxiliary description area to the corresponding display area in the area mapping controller is as follows:
[0024] The system reads the boundary coordinates of the main action area using a coordinate reader and converts them into display coordinates for the opaque area. It also reads the boundary coordinates of the auxiliary description area and converts them into display coordinates for the transparent area. The system uses an intersection calculator to detect the overlapping parts between the main action area and the auxiliary description area. The system uses a position adjuster to perform a translation transformation on the overlapping auxiliary description areas to eliminate the overlap. If the translation transformation cannot eliminate the overlap, the system performs a rotation transformation on the auxiliary description areas. Finally, the system uses a mapping table generator to establish a mapping relationship table between the content area and the display area.
[0025] As a further aspect of the present invention: the specific process of detecting the instructor's pointing operation on the main action area and adjusting the display parameters according to the pointing operation in the interactive response unit is as follows:
[0026] The relative position of the teacher's limbs and the LED transparent display device is detected at a fixed frequency using an infrared sensor array. When the vertical distance between the limb and the main action area is less than a set threshold, a pointing operation is determined to have occurred. The duration of the pointing operation is recorded by a timer. The main action area where the limb projection is located is identified as the target main action area by a position recognizer. The auxiliary description area associated with the target main action area is found by querying the corresponding relationship table through a query processor. The transparency and font size of the auxiliary description area are adjusted according to the duration of the pointing operation.
[0027] As a further aspect of the present invention: the specific process of adjusting the display parameters of the auxiliary description area according to the duration of the pointing operation is as follows:
[0028] The first and second duration ranges are set using the parameter setter. When the duration of the pointing operation is within the first duration range, the transparency and font size values are adjusted using the first rate of change. When the duration of the pointing operation is within the second duration range, the transparency and font size values are adjusted using the second rate of change. When the pointing operation ends, the transparency and font size values of the auxiliary description area are linearly restored to their initial values within the set time using the parameter restorer.
[0029] As a further aspect of the present invention: the specific process of generating the driving signal for the LED transparent display device in the driving signal generator is as follows:
[0030] The dynamic mask layer generates a region control signal, which specifies the transparency value of each pixel. The content rendering signal is generated according to the mapping relationship between the content area and the display area. When the display parameters are adjusted, the transparency value and content rendering parameters of the corresponding area are updated. The driving signal is transmitted to the controller of the LED transparent display device through the display interface. The controller parses the driving signal and controls the transparency state and content display state of the LED pixel array through the display driving circuit.
[0031] The beneficial effects of this invention are:
[0032] This invention automatically distinguishes between the main action area and the auxiliary instruction area by analyzing the composition structure of the demonstration action data. It combines this with a dynamic masking layer generated from the instructor's body command trajectory to intelligently divide opaque and transparent areas. The main action content is mapped to the opaque area for display, while the auxiliary instruction content is mapped to the transparent area, effectively solving the visual interference problem of action teaching content in a transparent display environment. By detecting the instructor's pointing operations on the main action area and adjusting the transparency and font size of the associated auxiliary instruction area accordingly, a dynamic response mechanism between action demonstration and instruction is established, allowing the instructor to intuitively control the information display hierarchy through natural body movements. Based on the dynamic masking layer and real-time updated display parameters, a driving signal is generated, enabling intelligent layout and collaborative display of action teaching content according to training progress, improving the information transmission efficiency and training interaction experience of action teaching in a transparent display environment. Attached Figure Description
[0033] The invention will now be further described with reference to the accompanying drawings.
[0034] Figure 1 This is a schematic diagram of the structure of the present invention. Detailed Implementation
[0035] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0036] Please see Figure 1 As shown, this invention is an intelligent control system for LED transparent display used in motion teaching, comprising:
[0037] The data interface array is used to receive demonstration action data input by the instructor. The demonstration action data includes standard action videos, breakdown action diagrams, and key point explanations.
[0038] A structural analysis processor is used to analyze the compositional structure of demonstration motion data and identify the main motion areas and auxiliary description areas in the demonstration motion data.
[0039] The mask generation unit is used to generate a dynamic mask layer based on the teacher's limb command trajectory. The dynamic mask layer defines the opaque and transparent areas of the LED transparent display device.
[0040] The area mapping controller is used to map the main action area to an opaque area for display and to map the auxiliary description area to a transparent area for display.
[0041] The interactive response unit is used to detect the instructor's pointing operation on the main action area and adjust the display parameters of the corresponding auxiliary explanation area according to the pointing operation;
[0042] A drive signal generator is used to generate drive signals for LED transparent display devices based on the dynamic masking layer and display parameter adjustment results.
[0043] In a preferred embodiment of the present invention, the specific process of analyzing the compositional structure of the demonstration action data in the structural analysis processor is as follows:
[0044] First, an initial segmentation operation is performed through a region segmentation circuit, using motion elements as the core analysis unit. Motion elements include human joint coordinates, limb contour features, motion trajectory vectors, and textual descriptions. The system uses an integrated feature extraction processor to traverse the complete demonstration motion data, and based on the differences in position coordinates and pixel size ratios of each motion element in 3D space, the overall data is segmented into multiple independent initial content regions. During the segmentation process, a spatial distance threshold between adjacent motion elements is used as the segmentation criterion. When the distance between two elements exceeds the threshold, the region boundary is established, ensuring that the motion elements within each initial region have basic spatial correlation.
[0045] After the initial partitioning is completed, the region merging process is initiated. A judgment model is constructed based on motion feature similarity using the motion feature analysis unit. This unit extracts motion parameters from each initial region, including motion rate, attitude change amplitude, and motion direction vector. The similarity calculation unit then uses a cosine similarity algorithm to calculate the feature matching degree between adjacent regions. When the matching degree exceeds a set fusion threshold, the two regions are determined to belong to the same action logic unit, and a merging operation is performed using a region merger. This eliminates the fragmentation problem caused by local feature differences in the initial partitioning, forming a set of content regions with complete action semantics.
[0046] Subsequently, the density calculation unit determines the regional attributes, introducing spatial distribution density as the core quantitative indicator. The system first calculates the pixel area of each content region using an area calculation circuit, then uses an element counter to count the total number of motion elements contained within the region, and finally uses an arithmetic logic unit to calculate the ratio of the total number to the area to obtain the number of motion elements per unit area, i.e., the spatial distribution density. The preset density threshold is determined using training data stored in the teaching scenario database, taking into account differences in motion types and display requirements. The calculated spatial distribution density is compared with the threshold; regions with higher values are marked as primary motion regions, which mainly contain core teaching information such as standard motion demonstrations; regions with lower values are designated as auxiliary explanation regions, mainly containing supplementary information such as motion explanations.
[0047] To establish precise associations, the system further performs element segmentation and recognition through an element recognizer. For the main action area, a skeletal keypoint tracking processor locates standard action demonstration elements, while a posture stability analysis unit extracts key posture elements, which refer to static postures with significant symbolic meaning in the action sequence. For the auxiliary instruction area, a text recognition processor and a semantic analyzer distinguish between action instruction elements and precaution elements. The former focuses on action execution standards, while the latter focuses on safety tips and common error corrections. Finally, the system records the boundary coordinate information of the two types of areas through a coordinate positioning device. The coordinates are represented by a two-dimensional coordinate system with the upper left corner of the display screen as the origin. At the same time, an association mapper constructs a correspondence table between the main action area and the auxiliary instruction area based on the content logic, clarifying the supplementary instruction content matched to each core action area, providing data support for subsequent area mapping.
[0048] In another preferred embodiment of the present invention, the specific process of generating a dynamic mask layer based on the teacher's limb command trajectory in the mask generation unit is as follows:
[0049] The acquisition of limb spatial position data is performed continuously at a fixed sampling frequency by a data acquisition device. The configuration of the sampling frequency needs to comprehensively consider the refresh rate of the LED transparent display device and the responsiveness of the teacher's limb movements. It is usually synchronized with the refresh cycle of the display device to avoid delays caused by time differences between data acquisition and display updates. The data acquisition device adopts a multi-dimensional sensor combination scheme, including depth camera units and infrared positioning sensor arrays deployed around the display area. The depth camera units are responsible for acquiring the coordinate information of the teacher's limbs in three-dimensional space, while the infrared positioning sensor array assists in calibrating the spatial position data through multi-point positioning to improve data accuracy. The acquired spatial position data includes the three-dimensional coordinates of key limb nodes, and each coordinate value is accompanied by timestamp information for temporal sequencing during subsequent trajectory generation.
[0050] The process of projecting spatial location data onto the LED transparent display plane establishes a unified coordinate transformation model through a coordinate converter. The physical center point of the LED transparent display screen is used as the origin, and the plane where the display screen is located is the two-dimensional projection plane. The horizontal direction is defined as the X-axis, and the vertical direction as the Y-axis. The coordinate converter directly maps the X and Y components of the three-dimensional spatial coordinates to the projection plane, while the Z-axis component serves as a reference for position calibration. When the Z-axis component exceeds the preset effective interaction distance range, the system automatically filters the set of position data to avoid misidentification caused by the teacher's limbs being too far away. After projection, a trajectory projection graphic composed of continuous coordinate points is generated. This graphic, arranged in chronological order, completely records the movement path of the teacher's limbs on the display plane. For discrete coordinate points appearing during projection, the system uses an interpolation processor to execute a linear interpolation algorithm to supplement the missing data between adjacent points, ensuring the continuity of the trajectory projection graphic.
[0051] A boundary tracking algorithm is applied to the trajectory projection image to obtain the closed limb command trajectory contour. The algorithm is based on contour extraction and connected component analysis. First, the trajectory projection image is binarized to separate the trajectory region from the background region, setting the pixel value of the trajectory region to 1 and the background region to 0. Then, scanning begins line by line from the top-left pixel of the binarized image. When a boundary point is detected where the pixel value changes from 0 to 1, boundary tracking begins from that point. Adjacent pixels are traversed clockwise, determining whether each pixel belongs to the trajectory boundary, until the system returns to the starting point to form a closed contour. During tracking, any jagged or interfering contours are smoothed using a morphological filter to remove isolated interfering pixels, ensuring that the final limb command trajectory contour accurately reflects the instructor's limb movement intention.
[0052] After the closed trajectory outline is determined, its centroid coordinates are calculated using the centroid calculation unit as the reference point for subsequent region generation. The centroid coordinates are calculated based on the average coordinates of all pixels within the outline area. By traversing all pixels contained in the outline, the X and Y coordinates of all pixels are accumulated, and then divided by the total number of pixels to obtain the X and Y coordinate values of the centroid. During the process of expanding to both sides by a set distance to form an opaque area based on the centroid coordinates, the expansion direction needs to be dynamically adjusted according to the direction of the trajectory outline. When the trajectory is horizontal, the expansion direction is mainly perpendicular to the vertical direction of the trajectory; when the trajectory is vertical, the expansion direction is mainly horizontal; for inclined trajectories, the expansion direction remains perpendicular to the tangent direction of the trajectory to ensure that the expanded area can completely cover the display area that the teacher intends to highlight.
[0053] In the dynamic adjustment of the extended distance, the minimum bounding rectangle of the limb command trajectory outline is first calculated by the geometric calculation unit. This rectangle is obtained by traversing all boundary points of the trajectory outline to determine the maximum and minimum values of the X-coordinate and Y-coordinate, thus forming the four vertices of the rectangle. Then, the speed calculator calculates the movement speed of the instructor's limbs based on the time difference and distance between adjacent sampling points. Specifically, the movement distance is calculated using the coordinate difference between two adjacent sampling points, and combined with the timestamp difference, the movement distance per unit time is obtained, which is the limb movement speed. The system has a built-in mapping table between speed and extended distance. When the limb movement speed is fast, a larger extended distance is used to ensure that the opaque area can cover the target display content in time during rapid movement; when the limb movement speed is slow, a smaller extended distance is used to avoid the opaque area from obscuring too much of the real-world scene.
[0054] After generating an initial opaque region boundary by translating outwards along the four sides of the minimum bounding rectangle, a Bézier curve fitting algorithm is applied to this boundary to avoid visual abruptness caused by sharp corners. During the fitting process, the four vertices of the rectangle and the midpoints of each side are used as control points for the Bézier curve. By adjusting the curvature parameters of the curve, a smooth transition effect is achieved in the boundary lines, ensuring that the fitted boundary maintains consistency with the overall trajectory outline. The pixel transparency settings for the opaque region employ a zoned control strategy. All pixels within the region have their transparency values set to zero through the transparency configuration unit, ensuring that the teaching content within this region is clearly displayed and unaffected by background perspective. The pixel transparency values outside the opaque region are gradient-set according to their distance from the boundary. Pixels closer to the boundary have smaller transparency values and are displayed more clearly, while pixels farther from the boundary have larger transparency values, gradually merging with the transparent display area to achieve a smooth visual transition.
[0055] The real-time update mechanism of the dynamic mask layer is synchronized with the frequency of limb movement acquisition. Each time new limb spatial position data is acquired, the system repeatedly executes processes such as trajectory projection, contour extraction, region generation, and boundary optimization through the trajectory processing unit to update the shapes of opaque and transparent areas. During the update process, to avoid display flickering caused by abrupt changes in region shape, the system employs double buffering technology. The newly generated mask layer content is rendered in the background buffer before seamlessly switching with the currently displayed mask layer, ensuring a smooth and consistent update process and providing educators with a coherent interactive experience.
[0056] In another preferred embodiment of the present invention, the specific process of mapping the main action area and the auxiliary description area to the corresponding display area in the area mapping controller is as follows:
[0057] The coordinate reading and conversion process uses the output of the structure analysis processor as its data foundation. The system first reads the boundary coordinates of the identified main action areas using a coordinate reader; these coordinates are the relative coordinate system of the demonstration action data itself. During conversion, a coordinate converter establishes the physical coordinate system of the LED transparent display screen. With the top left corner of the screen as the origin, the positive X-axis is horizontal to the right, and the positive Y-axis is vertically downward. A coordinate mapping model is constructed based on the screen resolution and pixel density, converting the relative coordinates of the main action areas into the absolute display coordinates of the opaque areas through proportional scaling. The coordinate conversion of the auxiliary explanation areas uses the same logic, only the target mapping area is replaced with a transparent area. During the conversion process, a parameter recorder synchronously records the coordinate conversion parameters for subsequent mapping relationship tracing.
[0058] After coordinate transformation, the overlap detection process is initiated through the overlap detection unit, which uses coordinate interval intersection calculation. The system extracts the X-axis and Y-axis coordinate intervals of the main action area and the auxiliary description area respectively. An interval comparator compares the numerical ranges of the two sets of intervals. When both the X-axis and Y-axis intervals of the two areas overlap, it is determined that there is regional overlap. To avoid false positives caused by minor coordinate errors, a reasonable overlap tolerance range is set. Subsequent overlap elimination processing is triggered only when the area of the overlapping region exceeds the pixel threshold corresponding to the tolerance.
[0059] Overlap elimination is prioritized through translation transformation performed by the translation controller. The system analyzes the distribution of blank space within the display area using a spatial analyzer to determine the optimal translation direction. Typically, directions along the edges of the display area, such as to the right or downwards, are preferred to minimize interference with other content areas. During translation, the auxiliary explanatory area is moved incrementally in fixed steps, with overlap detection re-performing after each movement until the overlap is completely eliminated. If the blank space within the display area is limited, and overlap still exists after translation to the boundary, a rotation transformation is initiated using the rotation controller. Using the geometric center of the auxiliary explanatory area as the rotation center, the area angle is adjusted incrementally in a clockwise direction. The rotation step size is dynamically set according to the area size, and the overlap status is re-detected after each rotation until the overlap is eliminated or the preset maximum rotation angle is reached.
[0060] After all regions have undergone coordinate mapping and overlap processing, a mapping table is created between the content regions and the display regions using a mapping table generator. The table records information such as the unique identifier of the content region, region type (main action or auxiliary description), original boundary coordinates, transformed display coordinates, and the transformation parameters used (translation distance or rotation angle). This mapping table uses a dynamically updatable structure; when the display region or content region changes, the corresponding mapping entries can be quickly retrieved and modified by the retrieval processor, providing stable data support for subsequent display control and interactive responses.
[0061] In another preferred embodiment of the present invention, the specific process of detecting the teacher's pointing operation on the main action area and adjusting the display parameters according to the pointing operation in the interactive response unit is as follows:
[0062] The deployment and data acquisition of the infrared sensor array are fundamental to operational detection. The sensor array is installed uniformly along the four bezels of the LED transparent display screen. The spacing between adjacent sensors is determined based on the screen size and detection accuracy requirements, ensuring a detection area without blind spots. The sampling frequency is set to a fixed value matching the display screen's refresh rate, avoiding excessive system resource consumption due to high-frequency sampling while preventing missed detections caused by low-frequency sampling. The sensors emit infrared beams to form a detection network covering the area in front of the display. When a student's limb enters this area, the beam is blocked, generating a reflected signal. The sensor receives the reflected signal, converts it into an electrical signal, processes it into a digital signal via an analog-to-digital converter, and finally outputs raw position data containing the limb's three-dimensional spatial coordinates.
[0063] The raw position data needs to be preprocessed by a signal processor to improve accuracy. The system first uses a Kalman filter algorithm to reduce noise, filtering out outliers caused by ambient light interference and sensor errors. Then, a coordinate calibrator converts the sensor's physical coordinates into a unified coordinate system consistent with the display screen, ensuring accurate correspondence between limb position and display area coordinates. The relative position detection stage focuses on calculating the vertical distance between the limb and the main movement area through a distance calculation unit. This distance is defined as the vertical distance from the limb's coordinate point in three-dimensional space to the display plane. The perpendicular coordinates of the limb on the display plane are obtained through coordinate projection calculation, and then combined with the boundary coordinates of the main movement area to complete the quantitative calculation of the vertical distance.
[0064] The system determines pointing actions based on vertical distance. A preset distance threshold is established, determined by combining typical interactive distances in a teaching scenario with sensor detection accuracy. When the calculated vertical distance is less than this threshold, the system determines that the teacher has initiated a pointing action and simultaneously triggers a timer to record the duration of the action. The timer uses a high-precision timing circuit synchronized with the sensor's sampling frequency. The first time stamp is taken as the moment the distance is detected to be less than the threshold. Subsequent frames of sampled data will check the distance status; if the distance remains less than the threshold, timing continues; if the distance is greater than the threshold, timing stops and the duration is locked. If a limb briefly leaves the detection area and then quickly returns, the system determines whether to continue the previous timing data by checking if the departure time is within a preset tolerance range, avoiding interruptions to parameter adjustments due to misjudgment.
[0065] The identification of the target's primary action area is based on matching the limb's projected coordinates with the region coordinates. The system compares the preprocessed perpendicular coordinates of the limb with the boundary coordinates of each primary action area. A region matcher determines whether the perpendicular coordinates fall within the X-axis and Y-axis coordinate range of a particular region, thus identifying that region as the target area the limb is pointing towards. When the perpendicular coordinates fall within the coordinate ranges of multiple adjacent regions, the system further calculates the straight-line distance between the perpendicular coordinates and the geometric centers of each region using a distance comparator. The region with the closest distance is identified as the target's primary action area, ensuring that the identification results match the instructor's actual pointing intention.
[0066] Once the target area is determined, the system queries the corresponding relationship table generated by the region mapping controller, using the unique identifier of the target's main action area as the search keyword, to quickly retrieve the identification information and current display parameters of the associated auxiliary description areas. The parameter adjustment process uses the duration of the pointing operation as the core control basis. The system pre-divides a first duration interval and a second duration interval using an interval divider. The boundaries between the two intervals are combined with the usual duration settings for brief prompts and key explanations in teaching; the first duration interval corresponds to a shorter operation duration, and the second duration interval corresponds to a longer operation duration.
[0067] When the duration is within the first duration range, the system adjusts parameters using a first rate of change via a parameter controller. This rate is set to a gradual change mode, with the transparency value gradually decreasing at the rate to improve the clarity of the auxiliary explanation area, and the font size value gradually increasing at the rate to enhance readability. During the change, parameters are only fine-tuned each frame refresh to avoid abrupt changes in display effects. When the duration enters the second duration range, the system switches to a second rate of change, a rapid change mode. The parameter adjustment range is increased, allowing the auxiliary explanation area to achieve a clear and prominent display state within a short time, meeting the needs of instructors for focused explanations.
[0068] The system determines the end of the operation based on a vertical distance exceeding a set threshold and a duration exceeding the tolerance range. At this point, the system initiates a parameter recovery process via a parameter restorer. Based on a preset recovery time, it calculates the linear change step size for the parameters to return to their initial values. Each frame refresh adjusts the transparency and font size according to this step size until the initial values are restored. The recovery process uses a linear change curve to ensure a smooth transition in the display effect. Simultaneously, the system records the parameter adjustment log for this operation, including information such as the target area, duration, and parameter change range, providing data support for subsequent interaction optimization. Throughout the entire process, all parameter adjustment commands are transmitted to the driver signal generator via a real-time communication interface to ensure real-time response in the display effect.
[0069] In another preferred embodiment of the present invention, the specific process of generating the driving signal for the LED transparent display device in the driving signal generator is as follows:
[0070] Based on the dynamic mask layer data output by the mask generation unit, the signal generation unit generates region control signals. The system uses a pixel scanner to traverse the mask layer information sequentially according to the pixel matrix, matching the transparency parameters of opaque, transparent, and transition regions to their corresponding pixels one by one, converting them into independent transparency control instructions for each pixel. Simultaneously, the content parser extracts the content data of the main action and auxiliary description areas according to the mapping relationship table of the region mapping controller, parses it into pixel arrangement information according to the display coordinate rules, generates content rendering signals, and clarifies the display content and grayscale level of each pixel.
[0071] When the interactive response unit triggers a display parameter adjustment, the system quickly locates the coordinate range of the target auxiliary description area using a coordinate locator, and synchronously updates the pixel transparency value and content rendering parameters of that area using a parameter updater, ensuring that the adjustment command is immediately integrated into the signal stream. The drive signal is transmitted through a high-speed display interface, the interface type of which is compatible with the controller specifications of the LED transparent display device. A data verification unit ensures signal integrity during transmission.
[0072] After receiving the signal, the controller of the LED transparent display device uses an instruction parser to break down the area control and content rendering instructions. The driving circuit then adjusts the transparency and illumination states of the pixel array to achieve accurate presentation of the teaching content. The entire driving signal generation process employs a parallel processing architecture to ensure synchronous output of area control and content rendering signals, maintaining the stability of the display effect and real-time responsiveness.
[0073] The foregoing has provided a detailed description of one embodiment of the present invention, but this description is merely a preferred embodiment and should not be construed as limiting the scope of the invention. All equivalent variations and modifications made within the scope of the claims of this invention should still fall within the patent coverage of this invention.
Claims
1. An LED transparent display intelligent control system for action teaching, characterized in that, The application relates to a teaching system, comprising: a data interface array for receiving demonstration action data input by a teacher, wherein the demonstration action data comprises standard action video, decomposed action graphics and key point explanation content; a structure analysis processor for analyzing the composition structure of the demonstration action data, identifying main action areas and auxiliary explanation areas in the demonstration action data; a mask generation unit for generating a dynamic mask layer according to the body instruction trajectory of the teacher, wherein the dynamic mask layer defines the opaque area and the transparent area of the LED transparent display device; a region mapping controller for mapping the main action areas to the opaque area display and mapping the auxiliary explanation areas to the transparent area display; an interactive response unit for detecting the pointing operation of the teacher on the main action areas and adjusting the display parameters of the corresponding auxiliary explanation areas according to the pointing operation; a driving signal generator for generating the driving signal of the LED transparent display device according to the dynamic mask layer and the adjustment result of the display parameters; in the interactive response unit, the specific process of detecting the pointing operation of the teacher on the main action areas and adjusting the display parameters according to the pointing operation is as follows: the relative position between the body of the teacher and the LED transparent display device is detected by an infrared sensor array at a fixed frequency, the pointing operation is determined when the vertical distance between the body and the main action areas is less than a set threshold, the duration of the pointing operation is recorded by a timer, the main action area where the body projection is located is identified as a target main action area by a position identifier, the auxiliary explanation area associated with the target main action area is found by a query processor by querying a corresponding relationship table, and the transparency value and the font size value of the auxiliary explanation area are adjusted according to the duration of the pointing operation; the specific process of adjusting the display parameters of the auxiliary explanation area according to the duration of the pointing operation is as follows: a first duration interval and a second duration interval are set by a parameter setter, the transparency value and the font size value are adjusted at a first change rate when the duration of the pointing operation is in the first duration interval, the transparency value and the font size value are adjusted at a second change rate when the duration of the pointing operation is in the second duration interval, and the transparency value and the font size value of the auxiliary explanation area are linearly restored to the initial values within a set time by a parameter restorer when the pointing operation is over.
2. The LED transparent display intelligent control system for action teaching according to claim 1, characterized in that, in the structure analysis processor, the specific process of analyzing the composition structure of the demonstration action data is as follows: standard action video data is analyzed by a video decoder, decomposed action graphics data is processed by a graphics processor, and key point explanation content data is processed by a text parser; the demonstration action data is divided into multiple initial content areas according to the spatial position relationship and size proportion of action elements; adjacent initial content areas with similar features are combined based on motion feature similarity; the number of action elements in each content area per unit area is calculated as a spatial distribution density by a calculation unit; the content area with a spatial distribution density value greater than a set threshold is determined as a main action area by a comparator; and the content area with a spatial distribution density value less than a set threshold is determined as an auxiliary explanation area. The standard action demonstration element and the key posture element in the main action area are identified by the feature recognizer; the action tip description element and the matter needing attention element in the auxiliary description area are identified by the content analyzer; the boundary coordinates of the main action area and the boundary coordinates of the auxiliary description area are recorded by the coordinate acquisition device; and the corresponding relationship table of the main action area and the auxiliary description area is established by the storage unit.
3. The LED transparent display intelligent control system for action teaching according to claim 1, characterized in that, In the mask generation unit, the specific process of generating a dynamic mask layer according to the body instruction trajectory of the teacher is as follows: The spatial position data of the teacher's body is continuously collected at a fixed sampling frequency through a depth sensor array, the spatial position data is projected to an LED transparent display plane through a coordinate converter to generate a trajectory projection graph, and a closed body instruction trajectory contour is obtained by performing a boundary tracking algorithm on the trajectory projection graph through a contour extractor; The centroid coordinates of the body instruction trajectory contour are calculated through a calculation unit, the centroid coordinates are taken as a reference to expand a set distance to both sides to form an opaque region, the region outside the opaque region is determined as a transparent region, a smooth curve is used to connect the boundary of the transparent region and the opaque region through a curve generator, and the shapes of the opaque region and the transparent region are updated according to the real-time changes of the body instruction trajectory of the teacher.
4. The LED transparent display intelligent control system for action teaching according to claim 3, characterized in that, The specific process of expanding the set distance to both sides to form the opaque region is as follows: The minimum circumscribed rectangle of the body instruction trajectory contour is calculated through a geometric calculation unit, the expansion distance is dynamically adjusted according to the moving speed of the teacher's body, the opaque region boundary is generated by translating the expansion distance outward along the four sides of the minimum circumscribed rectangle, a Bezier curve fitting algorithm is performed on the opaque region boundary through a curve fitter, the pixels inside the opaque region are set to have a transparency value of zero through a pixel processing unit, and the transparency values of the pixels outside the opaque region are set according to the distance of the pixels to the opaque region boundary.
5. The LED transparent display intelligent control system for action teaching according to claim 1, characterized in that, In the region mapping controller, the specific process of mapping the main action region and the auxiliary description region to the corresponding display region is as follows: The boundary coordinates of the main action region are read and converted into display coordinates of the opaque region through a coordinate reader, the boundary coordinates of the auxiliary description region are read and converted into display coordinates of the transparent region, the overlapping part of the main action region and the auxiliary description region is detected through an intersection calculator, a translational transformation is performed on the auxiliary description region that has an overlap to eliminate the overlap through a position adjuster, a rotational transformation is performed on the auxiliary description region when the translational transformation cannot eliminate the overlap, and a mapping relationship table of the content region and the display region is established through a mapping table generator.
6. The LED transparent display intelligent control system for action teaching according to claim 1, characterized in that, In the driving signal generator, the specific process of generating the driving signal of the LED transparent display device is as follows: A region control signal is generated according to the dynamic mask layer, the transparency value of each pixel point is specified, a content rendering signal is generated according to the mapping relationship between the content region and the display region, the transparency value and the content rendering parameter of the corresponding region are updated when the display parameter is adjusted, the driving signal is transmitted to the controller of the LED transparent display device through a display interface, the controller analyzes the driving signal and controls the transparency state and the content display state of the LED pixel array through a display driving circuit.
Citation Information
Patent Citations
Physical education method and system based on multimedia and holographic AR fusion
CN120335618A
Real-time interactive image generation system based on multi-point touch canvas
CN120743141A
Large-screen display for teaching
CN213183134U