A multimedia classroom equipment integrated supervision control method, device and medium

Abstract

The application discloses a multimedia classroom equipment integrated supervision control method, equipment and medium, relates to the classroom intelligent control technical field, and comprises the following steps: a host registers and arranges control fragments by responding to a bus, branch power supply state, port connection state, sound output state and execution mechanism motion state of an execution equipment, and generates a control fragment base table; the control fragment base table is called to issue curtain control, projection power supply, video switching and sound amplification connection, and state responses corresponding to various control actions are collected to generate a running event chain; the running event chain and each control fragment in the control fragment base table are subjected to segmented interlocking release of action confirmation and scene confirmation, established fragments and blocked fragments are distinguished and blocked paths are marked, and a scene execution record is generated; and the application enables the release, blocking, takeover and exit processes in the teaching process to form a complete supervision closed loop.

Description

Technical Field

[0001] This invention relates to the field of intelligent classroom control technology, and in particular to a method, equipment and medium for integrated monitoring and control of multimedia classroom equipment. Background Technology

[0002] With the development of smart campus and IoT control technologies, multimedia classrooms have gradually evolved from stand-alone equipment management to a collaborative operation mode that integrates bus interconnection, status awareness, and centralized control. Related technologies typically revolve around projection, sound reinforcement, screens, video switching, and environmental equipment, collecting power supply status, port connection status, and actuator status, and combining this with the host computer to complete sequential control, linkage control, and operational monitoring.

[0003] Existing solutions mainly rely on single device start / stop or single-point alarm, lacking control segment arrangement and segmented interlocking release mechanisms oriented towards the teaching process. This makes it difficult to uniformly verify whether control actions are implemented and whether the teaching scenario is formed. When video, audio, screen, or projection optical path is blocked, the entire chain is often retried or the whole system is reset. It is difficult to locate the blocked path, resume partial takeover, and reverse the sequence collection during the clearing phase. It is also difficult to select the takeover sequence with lower cost among multiple takeover paths. Summary of the Invention

[0004] In view of the aforementioned existing problems, the present invention is proposed.

[0005] Therefore, this invention provides an integrated monitoring and control method for multimedia classroom equipment to solve the problem of difficulty in coordinating and unifying the implementation of control actions, the formation of teaching scenarios, and the takeover of blocked pathways in multimedia classrooms.

[0006] To solve the above-mentioned technical problems, the present invention provides the following technical solution: In a first aspect, the present invention provides a multimedia classroom equipment integrated monitoring and control method, which includes, The host performs device registration and control segment arrangement for bus response, branch power supply status, port connection status, sound output status and actuator movement status, and generates a control segment base table; The control segment base table is invoked to issue screen control, projector power supply, video switching and sound amplification connection according to the control segment, and the status response corresponding to each control action is collected to generate a running event chain; Perform segmented interlocking and release of action confirmation and scenario confirmation for each control segment in the running event chain and control segment base table, distinguish between established segments and blocked segments and mark the blocking path, and generate scenario execution records; Based on the scenario execution record, determine the target takeover fragment set and minimum takeover sequence for the blocked path, execute the takeover control of the blocked path according to the minimum takeover sequence, confirm the status response continuation fragment after takeover, and generate a takeover control record. The system compiles scenario execution records and takeover control records to form a control operation archive. It then combines the control operation archive with the clearing segments in the control segment base table to perform reverse sequence control and control aggregation, generating regulatory control results.

[0007] As a preferred embodiment of the multimedia classroom equipment integrated monitoring and control method of the present invention, the generation of the control segment base table specifically includes: The host reads the addresses and online status of each node through the dedicated bus and the extended bus to obtain the device address set; Register the device address set with the power supply status of each controlled branch, the connection status of each video channel port, the sound output status of each amplification channel, and the motion status of each actuator to obtain the device relationship table; Configure the class start segment, signal takeover segment, screen setup segment, sound reinforcement setup segment, switching segment, and clearing segment according to the equipment relationship table, and label the equipment group, action sequence, and confirmation items of each control segment to obtain the control segment base table.

[0008] As a preferred embodiment of the multimedia classroom equipment integrated monitoring and control method of the present invention, the generation of the running event chain specifically includes: The host retrieves the class start segment and signal takeover segment from the control segment base table, and sequentially issues screen control, projector power supply, video switching and sound amplification connection to obtain the control action sequence; The control action sequence is collected in correspondence with changes in branch power supply, port connection status, screen display status, and sound output status to obtain a status response set. The state response set is sequentially associated according to the control action sequence, and the state responses corresponding to each control segment are arranged into segment event segments to obtain the running event chain.

[0009] As a preferred embodiment of the multimedia classroom equipment integrated monitoring and control method of the present invention, the segmented interlocking release of the execution action confirmation and scene confirmation includes: Extract the fragment event segments and control fragment base table from the runtime event chain to form fragment confirmation items; Based on the segment confirmation item, verify whether the control action has been implemented to the corresponding equipment group of the control segment, and obtain the action confirmation result; The action confirmation result is compared with the screen display status, classroom sound status, port connection status, and the stop status in the actuator movement status to obtain the scene confirmation result. The action confirmation results and scene confirmation results are mapped to each control segment to obtain the segment release results.

[0010] As a preferred embodiment of the multimedia classroom equipment integrated monitoring and control method of the present invention, the generation of scene execution records specifically includes: According to the control segment order, control segments in the segment release results where both action confirmation and scene confirmation results are true are marked as established segments, thus obtaining the established segment set; Maintain the device state corresponding to the established fragment set, and mark the current control fragment that only obtains action confirmation results but not scene confirmation results as a blocked fragment, stop releasing subsequent control fragments, and obtain a blocked fragment set; The path mapping results are obtained by mapping the screen movement in the blocked segment to the screen stop state, the video switching to the port connection state, the projection power supply to the screen image state, and the sound reinforcement connection to the classroom sound output state. Based on the path correspondence results and in conjunction with the corresponding device group's path, the blocked segments are marked as the corresponding paths in the screen execution path, video switching path, audio output path, and projection light path path, thus obtaining the scene execution record. The scene execution record registers the segment correlation degree, path switching cost, and scene recovery priority corresponding to each blocked path.

[0011] As a preferred embodiment of the multimedia classroom equipment integrated monitoring and control method of the present invention, the execution of the blocking path takeover control specifically includes: Read the blocked paths, corresponding device groups, and backup paths from the scenario execution records, and extract the fragment correlation, path switching cost, and scenario recovery priority corresponding to the blocked paths to construct a takeover candidate set; Maintain the device status corresponding to the established segment, define the target takeover segment set according to the influence range of each candidate segment in the takeover candidate set on the subsequent control segment, and generate the candidate takeover sequence from high to low according to the scenario recovery priority; Perform sequence cost calculation on the candidate takeover sequences, and filter out the smallest takeover sequence with the minimum total cost that satisfies the segment continuous release constraint to obtain the takeover object set; Perform blocking path takeover control on the takeover object set, switch to the video channel in the backup path in the video switching path, switch to the audio channel in the backup path in the audio output path, resend the screen action command in the screen execution path, and issue the projection detection command in the projection light path path to obtain the takeover status response set. By associating the takeover status response set with the subsequent control segments in the blocked path and the target takeover segment set, the takeover result of the blocked path is obtained.

[0012] As a preferred embodiment of the multimedia classroom equipment integrated monitoring and control method of the present invention, the generation of takeover control records specifically includes: Extract the takeover status response set from the takeover results of the blocked path, and add the takeover status response set into the running event chain to obtain the continuation event chain; For the blocked segments in the continuation event chain and the subsequent control segments in the target takeover segment set, the action confirmation and scene confirmation are re-executed to obtain the continuation segment result; The results of the continued segment are registered in correspondence with the results of the blocked path takeover and the minimum takeover sequence to obtain the takeover control record.

[0013] As a preferred embodiment of the multimedia classroom equipment integrated monitoring and control method of the present invention, the generation of monitoring and control results specifically includes: Collect scene execution records and takeover control records, register established segments, blocked paths and blocked pathways takeover results, and minimum takeover sequence according to the control segment order, and obtain the control operation file; Retrieve the clearing segment from the control segment base table and combine it with the established segments in the control operation file to issue signals in reverse order: release, exit the sound amplification, exit the projection, reset the screen, and exit the environmental equipment to obtain the clearing state chain. The clearing status chain and control operation files are controlled and aggregated to obtain the regulatory control results.

[0014] In a second aspect, the present invention provides a computer device including a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, implements any step of the multimedia classroom equipment integrated monitoring and control method as described in the first aspect of the present invention.

[0015] Thirdly, the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein: when the computer program is executed by a processor, it implements any step of the multimedia classroom equipment integrated monitoring and control method as described in the first aspect of the present invention.

[0016] The beneficial effects of this invention are as follows: By generating a control segment base table through device registration and control segment arrangement, bus response, branch power supply status, port connection status, sound output status, and actuator movement status can be uniformly mapped to the class start segment, signal takeover segment, screen establishment segment, sound reinforcement establishment segment, switching segment, and clearing segment, thereby improving the organization and sequence of control relationships for various devices in the multimedia classroom; by calling the control segment base table to issue screen control, projector power supply, video switching, and sound reinforcement connection, and forming a running event chain, a temporal correspondence is established between control actions and status responses, thereby providing a basis for subsequent action confirmation and scene... The system confirms the provision of continuous event evidence; by performing segmented interlocking and release on the running event chain, it distinguishes between established segments and blocked segments and marks the blocked paths, so that the implementation of control actions and the formation of teaching scenarios can be uniformly verified, thereby improving the accuracy of blockage location; by using the minimum takeover sequence optimization algorithm of blocked segment-path coupling to perform takeover control on the blocked path and confirm the continued segments, the takeover scope is limited to the target takeover segment set that is effective for scene recovery, and the execution sequence with the smaller total cost is selected from multiple candidate takeover sequences, thereby avoiding repeated start-stop of the entire chain and improving local recovery capability and takeover efficiency. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 A flowchart for integrating monitoring and control methods for multimedia classroom equipment.

[0019] Figure 2 Flowchart for controlling the generation of the fragment base table.

[0020] Figure 3 Flowchart for event chain generation and segmented interlocking release.

[0021] Figure 4 This is a flowchart illustrating the reverse control process for blocking access, taking over, and clearing the area. Detailed Implementation

[0022] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0023] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the invention. Therefore, the invention is not limited to the specific embodiments disclosed below.

[0024] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in different places in this specification does not necessarily refer to the same embodiment, nor is it a single or selective embodiment that is mutually exclusive with other embodiments.

[0025] Reference Figures 1-4 As an embodiment of the present invention, this embodiment provides a multimedia classroom equipment integrated monitoring and control method, including the following steps: S1. Reference Figure 2 The host performs device registration and control segment arrangement for bus response, branch power supply status, port connection status, sound output status and actuator movement status, and generates a control segment base table.

[0026] S1.1. After receiving the scheduling information or class instruction, the host sequentially reads the address and online status of each node through the dedicated bus and the extended bus, and records the node address that returns a valid address response and has a valid online status in the device address set. The node address is used to distinguish different controlled objects, and the online status is used to characterize whether the corresponding node of the dedicated bus and the extended bus is in a communicable state.

[0027] Preferably, the dedicated bus and the extended bus use a node-by-node polling method to read the data, ensuring a one-to-one correspondence between the node addresses in the device address set and their online status. For example, the nodes corresponding to the screen actuator, projection power supply, video switching, and sound reinforcement are all read into the device address set in the same order.

[0028] S1.2. The host continues to read the power supply status of each controlled branch, the connection status of each video channel port, the sound output status of each amplification channel, and the motion status of each actuator according to the device address set. It then registers each node address in the device address set with the corresponding power supply status of the controlled branch, the corresponding video channel port connection status, the corresponding amplification channel sound output status, and the corresponding actuator motion status to obtain a device relationship table. Among them, the port connection status is used to characterize the connectivity between the input and output ports of the video channel, the sound output status is used to characterize whether there is effective sound output from the amplification channel, and the actuator motion status is used to characterize the rising, falling, and stopping states of the screen actuator.

[0029] Furthermore, after obtaining the device relationship table, the host performs a consistency scan of the idle input ports, idle output ports, and target display terminals for the video switching corresponding nodes, and performs a consistency scan of the idle audio channels, target power amplifier channels, and target speaker circuits for the sound reinforcement connection corresponding nodes, thus obtaining a candidate set of backup paths. The host then issues short-term test switching commands to the candidate video channels in the backup path candidate set and reads the port connection status changes, and issues test audio commands to the candidate audio channels and reads the output level status changes, thus obtaining the backup path verification results. The host registers the candidate video channels or candidate audio channels that pass the verification and are not occupied by other control segments as backup paths, and registers the backup paths with the corresponding device groups, corresponding primary paths, takeover priorities, and activation conditions, thus obtaining backup path registration items.

[0030] Preferably, the backup path registration item is incorporated into the device relationship table or an indexed correspondence is established with the device relationship table, so that the backup path in the subsequent scenario execution record has a prior source.

[0031] S1.3. The host computer configures the opening segment, signal takeover segment, screen establishment segment, sound reinforcement establishment segment, switching segment, and clearing segment according to the teaching sequence of the multimedia classroom based on the device relationship table. It also labels each control segment with device group, action sequence, and confirmation items to obtain the control segment base table. Among them, device group is used to merge the node addresses that participate in the control within the same control segment, action sequence is used to represent the execution order of each control segment, and confirmation items are used to represent the status items that need to be checked in the subsequent action confirmation and scene confirmation of each control segment.

[0032] Preferably, the class start segment corresponds to screen control and projector power supply, the signal takeover segment corresponds to video switching, the sound reinforcement establishment segment corresponds to sound reinforcement activation, and the clearing segment corresponds to signal release, sound reinforcement deactivation, projector deactivation, screen reset, and environmental equipment deactivation. For example, the screen establishment segment indicates the screen display status as a confirmation item, the sound reinforcement establishment segment indicates the classroom sound output status as a confirmation item, and the screen control corresponding to the control segment indicates the stop status of the actuator movement as a confirmation item.

[0033] Furthermore, the host adds annotations to the control segment base table for the video synchronization lock status and screen sampling image status of the screen establishment segment, and adds annotations to the sound reinforcement establishment segment for the mute status, output level status and classroom sound pickup status. It also adds annotations to the equipment group with backup paths for the primary path, backup path and takeover priority, so as to perform multi-source consistency scenario judgment and blocked path takeover in the future.

[0034] S2. Reference Figure 3 It calls the control segment base table to issue screen control, projector power supply, video switching and sound amplification connection according to the control segment, and collects the status response corresponding to each control action to generate a running event chain.

[0035] S2.1. The host retrieves the class start segment and signal takeover segment from the control segment base table, and sequentially sends screen control, projector power supply, video switching, and sound reinforcement activation to the corresponding nodes of the screen actuator, projector power supply, video switching, and sound reinforcement activation according to the action sequence marked in the control segment base table, thus obtaining the control action sequence. The control action sequence characterizes the sequential execution relationship of screen control, projector power supply, video switching, and sound reinforcement activation, and each control action in the control action sequence corresponds to the device group and action sequence in the control segment base table.

[0036] S2.2. The host computer reads the changes in the motion state of the actuator corresponding to screen control, the changes in the branch power supply corresponding to the projection power supply, the changes in the port connection state and the screen image state corresponding to video switching, and the changes in the sound output state corresponding to the sound reinforcement connection according to the control action sequence. Each state change is then matched with its corresponding control action to obtain a state response set. Specifically, the branch power supply change represents the change from a disconnected state to an on state in the controlled branch where the projection power supply is located; the port connection state change represents the switching connection change between the video channel input and output ports; the screen image state change represents the change from a screen without an image to one with an image; and the sound output state change represents the change from no effective sound output to effective sound output in the sound reinforcement route.

[0037] Furthermore, when the host collects changes in the screen image state, it first reads the projector's video synchronization lock signal or the synchronization valid flag of the display decoding unit, and then reads the brightness distribution state, edge change state, and continuous frame stability state returned by the image sampling module set on the screen side or projection output side to obtain the basic state for image judgment; among them, the HDMI HPD hot-plug pin is only used to indicate the existence of physical plugging and is not used as a separate basis for judging whether there is an image.

[0038] Furthermore, when the host collects changes in the sound output state, it first reads the mute status pin level of the audio device or the mute register status of the DSP, then reads the power amplifier output level detection value or the DSP level bar data, and reads the synchronous sound pressure change collected by the classroom MIC to obtain the basic state for sound output determination. Among them, the mute status is only used to characterize whether the audio link is under mute control, and the MIC acquisition result is only used to characterize whether there is an actual sound field response on the classroom side. Neither of them is used as the sole criterion for determining whether there is effective sound output.

[0039] S2.3. The host performs time-series association on the state response set according to the control action sequence, and arranges the state responses corresponding to screen control and projector power supply as segment event segments corresponding to the class start segment, the state responses corresponding to video switching as segment event segments corresponding to the signal takeover segment, the state responses corresponding to changes in screen image state as segment event segments corresponding to the image establishment segment, and the state responses corresponding to changes in sound output state as segment event segments corresponding to the sound reinforcement establishment segment. Then, the segment event segments are connected according to the order of the control action sequence to obtain the running event chain. The running event chain is used to represent the continuous process from the issuance of the control action to the appearance of the state response. The running event chain and the control segment base table are used together for subsequent action confirmation and scene confirmation.

[0040] Preferably, the event segment corresponding to the scene establishment segment includes at least the port connection status change, the video synchronization lock status change, and the screen sampling image status change; the event segment corresponding to the sound reinforcement establishment segment includes at least the mute status change, the output level status change, and the classroom sound pickup status change, so as to ensure consistency verification of the subsequent execution scene establishment.

[0041] S3. Perform segmented interlocking and release of action confirmation and scenario confirmation for each control segment in the running event chain and control segment base table, distinguish between established segments and blocked segments and mark the blocking path, and generate scenario execution records.

[0042] S3.1. The host extracts the corresponding event segments for the class start segment, signal takeover segment, screen establishment segment, and sound reinforcement segment from the running event chain, and extracts the corresponding confirmation items for the class start segment, signal takeover segment, screen establishment segment, and sound reinforcement segment from the control segment base table. The event segments and confirmation items are matched according to the control segment order to obtain the segment confirmation item set.

[0043] Preferably, the confirmation items for the class start segment include the stop status and branch power supply status in the movement state of the actuator; the confirmation items for the signal takeover segment include the port connection status; the confirmation items for the screen establishment segment include the screen display status; and the confirmation items for the sound reinforcement establishment segment include the classroom sound output status.

[0044] Furthermore, the confirmation items for the established video segment also include video synchronization lock status and screen sampling image status, while the confirmation items for the established sound segment also include mute status and output level status.

[0045] S3.2. The host verifies each control action in the segment confirmation item set to ensure it is implemented in the corresponding device group of the control segment, and obtains the action confirmation result set. The screen control action confirmation result in the action confirmation result set is obtained by verifying whether the corresponding node of the screen actuator receives screen control and whether the actuator's motion state changes. The projection power supply action confirmation result is obtained by verifying whether the corresponding node of the projection power supply receives projection power and whether the branch power supply state changes. The video switching action confirmation result is obtained by verifying whether the corresponding node of the video switching receives video switching and whether the port connection state changes. The sound reinforcement connection action confirmation result is obtained by verifying whether the corresponding node of the sound reinforcement connection receives sound reinforcement connection and whether the sound output state changes.

[0046] Furthermore, the confirmation result of the action corresponding to the established screen segment is also used to indicate that the power supply to the projection and video switching have been implemented to the corresponding equipment group, and the confirmation result of the action corresponding to the established sound reinforcement segment is also used to indicate that the sound reinforcement connection has been implemented to the corresponding equipment group.

[0047] S3.3. The host computer checks the action confirmation result set against the screen display status, classroom sound output status, port connection status, and the stop status in the actuator movement status to obtain the scene confirmation result set. The stop status in the actuator movement status is used to represent the stop result after the screen control is completed. The port connection status is used to represent the channel connection result after the video switching is completed. The screen display status is used to represent the image presentation result after the projection power supply and video switching are completed. The classroom sound output status is used to represent the sound output result after the sound reinforcement is connected.

[0048] Furthermore, the host computer performs a multi-source consistency scene determination algorithm on the screen display status and classroom sound output status to obtain enhanced scene confirmation results. Specifically, for the screen display status, the host computer constructs a screen determination vector based on the port connection status, video synchronization lock status, and screen sampling image status, and performs consistency comparisons over multiple consecutive sampling periods. When the port connection is established, the video synchronization lock is effective, and the screen sampling image status is continuously displayed as a non-black screen, a non-blue screen, and has stable content edges, the host computer determines that "there is a screen". For the classroom sound output status, the host computer constructs a sound output determination vector based on the mute status, output level status, and classroom sound pickup status, and performs consistency comparisons over multiple consecutive sampling periods. When the amplification path is in a non-mute state, the output level is continuously higher than a preset level threshold, and the classroom microphone has a synchronous sound pressure response, the host computer determines that "the amplification path has effective sound output".

[0049] Preferably, the multi-source consistency scenario determination algorithm is used to filter out misjudgments caused by single-port plug-in signals, instantaneous level spikes, or occasional environmental noise, so that the scenario confirmation results can be directly used for subsequent segmented interlock release and blocked path labeling.

[0050] The host calculates the result by logically multiplying the action confirmation result and the scene confirmation result, as shown in the expression: ; in, Indicates the first Each control segment corresponds to a segment release result. Indicates the first The action confirmation result corresponds to each control segment. Indicates the first The control segment corresponds to the scenario confirmation result.

[0051] This indicates that the control action has been implemented in the corresponding device group of the control segment. This indicates that the control action was not implemented in the corresponding equipment group of the control segment; This indicates that the scene corresponding to the control segment has appeared. This indicates that the scene corresponding to the control segment has not appeared; Indicates the first Each control segment meets the release conditions. Indicates the first One control segment does not meet the release conditions.

[0052] S3.4. The host reads the release results of the control segments in sequence. The control segments for which both the action confirmation result and the scene confirmation result are true and the release result is "released" are marked as established segments, thus obtaining a set of established segments. The host keeps the device state corresponding to the established segment set unchanged, and then marks the current control segment that has only obtained the action confirmation result but not the scene confirmation result and whose release result is "not released" as a blocked segment, and stops releasing the subsequent control segments, thus obtaining a set of blocked segments. The segmented interlocked release is used to indicate that the next control segment is allowed to continue execution only when the previous control segment meets the release condition, and the next control segment stops execution when the current control segment does not meet the release condition.

[0053] S3.5. The host matches the screen actions in the blocked segment set with the screen stop status, the video switching with the port connection status, the projection power supply with the screen image status, and the sound reinforcement connection with the classroom sound output status to obtain the path mapping result. Based on the path mapping result and combined with the corresponding device group in the control segment base table, the host marks the blocked segment as the corresponding path in the screen execution path, video switching path, audio output path, and projection optical path. For each blocked path, the host calculates the segment correlation, path switching cost, and scene recovery priority. Then, the host registers the established segments, blocked segments, blocked paths, corresponding device groups, backup paths, segment correlation, path switching cost, scene recovery priority, and subsequent takeover order to obtain the scene execution record.

[0054] Preferably, when the screen action has been completed but the screen is not in a stopped state, the blocked segment is marked as the screen execution path; when the video switching has been completed but the port connection has not been established, the blocked segment is marked as the video switching path; when the sound reinforcement has been completed but the classroom sound output has not appeared, the blocked segment is marked as the audio output path; when the projector power supply has been completed but the screen image has not appeared, the blocked segment is marked as the projection optical path.

[0055] Furthermore, the backup paths in the scenario execution record are derived from the backup path registration entries obtained in S1.2, and correspond one-to-one with the device groups corresponding to the blocked paths, so that the backup path calls in S4 have a prior registration basis.

[0056] It should be noted that the host first obtains the fragment confirmation item set, action confirmation result set, scene confirmation result set, and fragment release result, and then obtains the established fragment set, blocked fragment set, and path correspondence result, so that the control fragment release judgment and the blocked path labeling maintain the same sequential link; the host then supplements the blocked path with the fragment correlation degree, path switching cost, and scene recovery priority registration, so that the subsequent minimum takeover sequence optimization algorithm has a unified input basis, and the subsequent blocked path takeover control can be directly executed on the blocked path and the corresponding device group, avoiding the repeated execution of all control fragments, and the sequential control relationship is clear, which can improve the feasibility and positioning accuracy at the control fragment level.

[0057] Reference Figure 4 S4. Execute the minimum takeover sequence optimization algorithm for the blocked path according to the scenario execution record, determine the target takeover segment set and the minimum takeover sequence, execute the blocked path takeover control according to the minimum takeover sequence, confirm the state response continuation segment after takeover, and generate the takeover control record.

[0058] S4.1. The host reads the blocked path, corresponding device group, backup path, and subsequent takeover sequence from the scenario execution record, and extracts the segment correlation, path switching cost, and scenario recovery priority corresponding to the blocked path to construct a takeover candidate set. The host arranges the control segment where the blocked path is located and the subsequent control segments sharing the corresponding device group to obtain a candidate takeover segment set. The host constructs a sequence cost value based on the number of segments, the number of path switching times, and the expected recovery sampling period of each candidate segment in the candidate takeover segment set, and selects the candidate takeover sequence with the minimum total cost that satisfies the segment continuous release constraint to obtain a takeover arrangement table. The takeover arrangement table is used to characterize the scope and takeover sequence of the control segment corresponding to the blocked path that needs to be taken over. The takeover scope in the takeover arrangement table is limited to the control segment where the blocked path is located and the subsequent control segments sharing the corresponding device group.

[0059] Preferably, the video switching path corresponding to the takeover arrangement table includes at least the control segment where the video switching path is located and the image establishment segment; the audio output path corresponding to the takeover arrangement table includes at least the control segment where the audio output path is located and the sound reinforcement establishment segment; the screen execution path corresponding to the takeover arrangement table includes at least the control segment where the screen execution path is located; and the projection optical path corresponding to the takeover arrangement table includes at least the control segment where the projection optical path is located and the image establishment segment. When multiple candidate takeover sequences simultaneously meet the segment continuous release constraint, the host prioritizes the candidate takeover sequence with fewer segments, fewer path switching times, and a shorter expected recovery sampling period.

[0060] The sequence cost of the candidate takeover sequence and the minimum takeover sequence selection expression are as follows: ; ; in, Indicates the first The sequence value of a candidate takeover sequence. Indicates the first The number of takeover segments contained in each candidate takeover sequence. Indicates the first The number of path switching times corresponding to each candidate takeover sequence. Indicates the first The candidate takeover sequence is expected to recover to the number of sampling periods required for the scenario to be established. This represents the priority weight of the number of control segments, indicating the number of segments in the candidate takeover sequence. More segments mean a larger takeover scope and higher execution cost. This represents the weight of the number of path switching events, indicating the priority weight of the number of path switching events in the candidate sequence. More path switching events may increase operational risk and latency. The weighted number of sampling periods expected to be restored represents the priority weight of the candidate sequence to the number of sampling periods required for the scenario to be established. A longer restoration period may affect the continuity of the teaching process. This represents the smallest takeover sequence number that satisfies the segment continuous release constraint.

[0061] In this embodiment, =0.4, because controlling the number of fragments is more important, so we prioritize reducing the number of fragments. =0.35, because the number of path switching operations is the second highest, ensuring stable switching. =0.25, because the recovery period has the smallest weight, but it still needs to be considered.

[0062] S4.2. The host maintains the status of the corresponding device of the established segment, and defines the control segment where the blocking path is located and the control segment that shares the corresponding device group with it as the takeover release segment according to the takeover arrangement table. At the same time, it locks the original control status of the control segments other than the takeover release segment to obtain the takeover object set.

[0063] The set of targets to be taken over is determined by the set of target takeover segments corresponding to the minimum takeover sequence.

[0064] Preferably, when the device status corresponding to the established segment remains unchanged, the screen actuator's stopped position, the projection power supply connected, the port connection status formed by video switching, and the sound output status formed by sound reinforcement connection all continue to maintain their original status.

[0065] It should be noted that the host first defines the takeover release segment, and then locks the original control state of the control segments outside the takeover release segment. This can limit the takeover control of the blocked path to the path associated with the blocked path, and avoid all control segments being re-executed. By applying convergence constraints to the takeover range through the minimum takeover sequence optimization algorithm, the number of takeover segments and the number of path switching can be reduced while ensuring scene recovery. This is beneficial for reducing redundant control and maintaining the stable state of established segments.

[0066] The host performs blocking path takeover control on the set of objects to be taken over. When the blocking path is a video switching path, the host switches the corresponding node of the video switching path to the video channel in the backup path. Before the switch is performed, the host first checks the idleness and connectivity of the input and output ports of the backup video channel according to the backup path registration item formed in S1.2 to ensure that the corresponding port of the backup path is not occupied and the physical connection is valid. During the switch, the port mapping relationship is updated synchronously to bypass the abnormal connection path corresponding to the original blocking port, so as to replace the original abnormal port connection state with the new port connection relationship, and read the changes in port connection state and screen image state after the video switch.

[0067] S4.3. The host performs blocking path takeover control on the takeover object set. When the blocking path is a video switching path, the host switches the corresponding node of the video switching path to the video channel in the backup path. Before the switch is performed, the host first checks the idleness and connectivity of the input and output ports of the backup video channel according to the backup path registration item formed in S1.2 to ensure that the corresponding port of the backup path is not occupied and the physical connection is valid. During the switch, the port mapping relationship is updated synchronously to bypass the abnormal connection path corresponding to the original blocking port, so as to replace the original abnormal port connection state with the new port connection relationship, and read the port connection state change and screen image state change after the video switch.

[0068] When the blocked path is the audio output path, the host switches the corresponding node of the audio output path to the audio channel in the backup path. Before the switch is performed, the host performs connectivity and output capability checks on the input terminal, power amplifier channel and speaker circuit corresponding to the backup audio channel. During the switch, the binding relationship of the original abnormal audio path is released, and the audio signal is routed and redirected to the independent audio link corresponding to the backup path to avoid the channel path corresponding to the original sound abnormality. The host also reads the change in the sound output status after the audio switch.

[0069] When the blocked path is the screen execution path, the host resends the screen action command to the corresponding node of the screen execution path and reads the changes in the motion state and the stop state of the actuator after resending; when the blocked path is the projection optical path, the host sends a projection detection command to the corresponding node of the projection optical path and reads the changes in the screen image state after projection detection to obtain the takeover state response set.

[0070] The backup path includes a video channel for providing an alternative transmission channel for video switching, an audio channel for providing an alternative transmission channel for audio output, and a projection detection command to re-verify the image presentation after projection power is supplied. The host executes these control actions sequentially according to the minimum takeover sequence; the next target takeover segment is triggered after the previous target takeover segment receives confirmation. For example, when the video switching path corresponds to a blocked path, the host keeps the projection power supply on and only changes the video channel connectivity; when the audio output path corresponds to a blocked path, the host keeps the amplification path on and only changes the audio channel connectivity.

[0071] The host associates the takeover status response set with the control segment containing the blocked path and the subsequent control segment in the target takeover segment set according to the takeover arrangement table, and obtains the takeover result of the blocked path.

[0072] Preferably, the results of the blocked access takeover are arranged in the order of the control segment where the blocked path is located first, followed by the control segment in the takeover release segment, so as to ensure that the results of the blocked access takeover are consistent with the takeover arrangement table.

[0073] S4.4. The host extracts the takeover status response set from the blocked path takeover result and inserts the takeover status response set into the corresponding positions in the running event chain that correspond to the control segments where the blocked path is located and the subsequent control segments in the takeover release segment, thus obtaining the continuation event chain. The continuation event chain is used to characterize the continuous process of control actions and status responses continuing to extend after the blocked path takeover control. The continuation event chain maintains the original order of the running event chain, only supplementing the event segments corresponding to the subsequent control segments in the control segments where the blocked path is located and the target takeover segment set.

[0074] The host re-executes action confirmation and scene confirmation for the blocked segment in the continuation event chain and the subsequent control segment in the target takeover segment set to obtain the continuation segment result. Action confirmation is used to verify whether the takeover control of the blocked path has been implemented to the corresponding device group of the takeover object set. Scene confirmation is used to verify whether the stop status in the port connection status, screen display status, classroom sound status and actuator movement status after the takeover control of the blocked path has reached the corresponding confirmation items in the control segment base table.

[0075] Preferably, the video switching path corresponds to the continuation segment results, with a focus on verifying the port connection status and screen display status; the audio output path corresponds to the continuation segment results, with a focus on verifying the classroom sound output status; the screen execution path corresponds to the continuation segment results, with a focus on verifying the stopping status of the actuator movement; and the projection light path corresponds to the continuation segment results, with a focus on verifying the screen display status. The host computer then verifies the correspondence between the continuation segment results and the minimum takeover sequence to confirm that each target takeover segment in the minimum takeover sequence has formed a continuous recovery relationship.

[0076] Furthermore, the host marks the blocking segment or subsequent control segment in the continuation segment results where both the action confirmation result and the scene confirmation result are true as a takeover established segment. Device items that have been switched to the working state, retransmitted to the action state, or remained in the working state during the takeover control process are marked as takeover activated device items, thus obtaining takeover closed-loop items. The host then registers the takeover closed-loop items with the blocking path takeover results to obtain a takeover control record. The host registers the continuation segment results with the blocking path takeover results and the minimum takeover sequence to obtain a takeover control record. The takeover control record includes the blocking path, takeover release segment, takeover object set, blocking path takeover result, and continuation segment result.

[0077] Among them, the "takeover activated equipment" item is used to characterize the equipment status that, although not recorded as an established segment in the original release stage, has formed an actual working state through takeover control and needs to be removed during clearing.

[0078] It should be noted that after the host adds the result of the blocked path takeover to the running event chain, it continues to perform action confirmation and scenario confirmation. This can ensure that the blocked path takeover control and the original segmented interlock release maintain the same judgment rules. This can ensure that the control segment after takeover continues to complete the confirmation in the order of control segments, and that the takeover control record directly reflects the blocked path processing result and the subsequent control segment continuation result.

[0079] S5. Collect scene execution records and takeover control records to form a control operation file, and combine the control operation file and the clearing fragments in the control fragment base table to perform reverse sequence control and control aggregation, and generate regulatory control results.

[0080] S5.1. The host collects scenario execution records and takeover control records, and sequentially registers established segments, blocked paths, blocked path takeover results, and minimum takeover sequences according to the control segment order, thus obtaining a control operation file. The control operation file represents the control execution process from the start of the opening segment to the end of the blocked path takeover. Established segments in the control operation file represent control segments that have been released. Blocked paths in the control operation file represent abnormal paths corresponding to blocked segments. Blocked path takeover results in the control operation file represent the processing results of blocked paths after undergoing blocked path takeover control.

[0081] The host extracts established segments, takeover established segments that have been re-satisfied with action confirmation and scenario confirmation after being taken over by the blocked path, and takeover activated device items that have formed an actual working state through takeover control from the control operation file. The extracted content is then compiled into a clearing basis set. The extraction of the clearing basis set is not restricted by the control segment locking constraints outside the takeover release segment in S4.2. Locking is only used to prevent control actions during the operation phase from being rewritten, not to restrict the corresponding device from participating in exit control during the clearing phase. All devices that have formed an actual working state in the control operation file are included in the clearing basis set. The host then retrieves the clearing segments from the control segment base table and determines the device objects entering the clearing process and their reverse exit order based on the clearing basis set, generating a clearing control sequence. The takeover established segments represent control segments that have been restored to an established state after takeover control. The takeover activated device items represent device states that, although not recorded as established segments in the original release phase, have formed an actual working state through takeover control and need to exit during the clearing phase. The clearing control sequence represents the device objects, execution order, and exit relationships corresponding to each exit action after the course ends.

[0082] S5.2. The host executes the corresponding exit actions sequentially according to the clearing control sequence, and collects the status response corresponding to each exit action to obtain the clearing status chain. Among them, the status response corresponding to signal release includes at least the port disconnected state; the status response corresponding to sound reinforcement exit includes at least the mute state or no output state; the status response corresponding to projection exit includes at least the branch power off state and the screen no image state; the status response corresponding to screen reset includes at least the screen reset stop state; and the status response corresponding to environmental equipment exit includes at least the environmental equipment shutdown state.

[0083] The clearing control sequence is generated by mapping the clearing basis set. Specifically, the host matches the established segments, takeover established segments, and takeover activated device items in the clearing basis set one by one with the corresponding device groups and control relationships according to the clearing segment definitions in the control segment base table. Then, it performs reverse sorting according to the action order of each control segment in the control segment base table, mapping the device objects that have participated in control execution and are in the working state to the corresponding exit actions, thereby generating a clearing control sequence that corresponds one-to-one with the actual working state of the devices. The clearing basis set is used to limit the scope of devices participating in the clearing, and the clearing control sequence is used to determine the specific exit actions and execution order.

[0084] When a takeover activation device entry exists in the control operation file, the host computer incorporates the following into the clearing state chain generation process: disconnecting the backup video channel, disconnecting the backup audio channel, disconnecting the projection link that remains operational after takeover, and resetting the actuator that forms an action state after retransmission. This ensures the corresponding exit of the device's operational state after the blocked path is taken over.

[0085] During the clearing process, the takeover of a segment does not trigger a new segment-level exit action on its own. Instead, it performs a unified reverse exit according to the clearing path of its corresponding equipment group being merged into the established segment. For equipment that has been successfully taken over but has not been marked as an established segment, it is identified by the takeover activation equipment item and directly mapped to an independent exit action when the clearing control sequence is generated. This allows such equipment to participate in the clearing exit even if a complete control segment has not been formed.

[0086] The host system integrates the clearing state chain with the control operation file to obtain the monitoring control result. Specifically, the control integration is used to associate and register the established segments, blocking paths, blocking path takeover results, takeover established segments, takeover activated device items, and minimum takeover sequence in the control operation file with the corresponding exit results in the clearing state chain. The monitoring control result characterizes the complete execution result of the multimedia classroom equipment integrated monitoring control method, from control segment arrangement, operation event chain formation, segmented interlocking release, blocking path takeover control to clearing reverse sequence control.

[0087] This embodiment also provides a computer device applicable to the integrated monitoring and control method for multimedia classroom equipment, comprising: a memory and a processor; the memory is used to store computer-executable instructions, and the processor is used to execute the computer-executable instructions to implement the integrated monitoring and control method for multimedia classroom equipment as proposed in the above embodiment.

[0088] The computer device can be a terminal, comprising a processor, memory, communication interface, display screen, and input devices connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, carrier networks, NFC (Near Field Communication), or other technologies. The display screen can be an LCD screen or an e-ink screen. The input devices can be a touch layer covering the display screen, buttons, a trackball, or a touchpad on the computer device's casing, or an external keyboard, touchpad, or mouse.

[0089] This embodiment also provides a storage medium storing a computer program, which, when executed by a processor, implements the multimedia classroom equipment integrated monitoring and control method proposed in the above embodiments. The storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Red-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0090] In summary, this invention generates a control segment base table through device registration and control segment arrangement, enabling bus response, branch power supply status, port connection status, sound output status, and actuator movement status to be uniformly mapped to class start segment, signal takeover segment, screen establishment segment, sound reinforcement establishment segment, switching segment, and clearing segment. This improves the organization and sequence of control relationships among various devices in the multimedia classroom. By calling the control segment base table to issue screen control, projector power supply, video switching, and sound reinforcement connection, and forming a chain of operational events, a temporal correspondence is established between control actions and status responses, thereby providing confirmation for subsequent actions and the environment. Scene confirmation provides continuous event evidence; by performing segmented interlocking release on the running event chain, distinguishing between established segments and blocked segments and marking blocked paths, the implementation of control actions and the formation of teaching scenarios can be uniformly verified, thereby improving the accuracy of blockage location; by using the minimum takeover sequence optimization algorithm of blocked segment-path coupling to perform takeover control on blocked paths and continue segment confirmation, the takeover scope is limited to the target takeover segment set that is effective for scene recovery, and the execution sequence with the smaller total cost is selected from multiple candidate takeover sequences, thereby avoiding repeated start-stop of the entire chain and improving local recovery capability.

[0091] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A method for integrated monitoring and control of multimedia classroom equipment, characterized in that: include, The host performs device registration and control segment arrangement for bus response, branch power supply status, port connection status, sound output status and actuator movement status, and generates a control segment base table; The control segment base table is invoked to issue screen control, projector power supply, video switching and sound amplification connection according to the control segment, and the status response corresponding to each control action is collected to generate a running event chain; Perform segmented interlocking and release of action confirmation and scenario confirmation for each control segment in the running event chain and control segment base table, distinguish between established segments and blocked segments and mark the blocking path, and generate scenario execution records; Based on the scenario execution record, determine the target takeover fragment set and minimum takeover sequence for the blocked path, execute the takeover control of the blocked path according to the minimum takeover sequence, confirm the status response continuation fragment after takeover, and generate a takeover control record. The system compiles scenario execution records and takeover control records to form a control operation archive. It then combines the control operation archive with the clearing segments in the control segment base table to perform reverse sequence control and control aggregation, generating regulatory control results.

2. The multimedia classroom equipment integrated monitoring and control method as described in claim 1, characterized in that: The generation of the control fragment base table specifically includes: The host reads the addresses and online status of each node through the dedicated bus and the extended bus to obtain the device address set; Register the device address set with the power supply status of each controlled branch, the connection status of each video channel port, the sound output status of each amplification channel, and the motion status of each actuator to obtain the device relationship table; Configure the class start segment, signal takeover segment, screen setup segment, sound reinforcement setup segment, switching segment, and clearing segment according to the equipment relationship table, and label the equipment group, action sequence, and confirmation items of each control segment to obtain the control segment base table.

3. The multimedia classroom equipment integrated monitoring and control method as described in claim 2, characterized in that: The generation of the runtime event chain specifically includes: The host retrieves the class start segment and signal takeover segment from the control segment base table, and sequentially issues screen control, projector power supply, video switching and sound amplification connection to obtain the control action sequence; The control action sequence is collected in correspondence with changes in branch power supply, port connection status, screen display status, and sound output status to obtain a status response set. The state response set is sequentially associated according to the control action sequence, and the state responses corresponding to each control segment are arranged into segment event segments to obtain the running event chain.

4. The multimedia classroom equipment integrated monitoring and control method as described in claim 3, characterized in that: The segmented interlocking release of the execution action confirmation and scenario confirmation includes: Extract the fragment event segments and control fragment base table from the runtime event chain to form fragment confirmation items; Based on the segment confirmation item, verify whether the control action has been implemented to the corresponding equipment group of the control segment, and obtain the action confirmation result; The action confirmation result is compared with the screen display status, classroom sound status, port connection status, and the stop status in the actuator movement status to obtain the scene confirmation result. The action confirmation results and scene confirmation results are mapped to each control segment to obtain the segment release results.

5. The multimedia classroom equipment integrated monitoring and control method as described in claim 4, characterized in that: The generated scenario execution record specifically includes: According to the control segment order, control segments in the segment release results where both action confirmation and scene confirmation results are true are marked as established segments, thus obtaining the established segment set; Maintain the device state corresponding to the established fragment set, and mark the current control fragment that only obtains action confirmation results but not scene confirmation results as a blocked fragment, stop releasing subsequent control fragments, and obtain a blocked fragment set; The path mapping results are obtained by mapping the screen movement in the blocked segment to the screen stop state, the video switching to the port connection state, the projection power supply to the screen image state, and the sound reinforcement connection to the classroom sound output state. Based on the path correspondence results and in conjunction with the corresponding device group's path, the blocked segments are marked as the corresponding paths in the screen execution path, video switching path, audio output path, and projection light path path, thus obtaining the scene execution record. The scene execution record registers the segment correlation degree, path switching cost, and scene recovery priority corresponding to each blocked path.

6. The multimedia classroom equipment integrated monitoring and control method as described in claim 5, characterized in that: The execution of the blocked path takeover control specifically includes: Read the blocked paths, corresponding device groups, and backup paths from the scenario execution records, and extract the fragment correlation, path switching cost, and scenario recovery priority corresponding to the blocked paths to construct a takeover candidate set; Maintain the device status corresponding to the established segment, define the target takeover segment set according to the influence range of each candidate segment in the takeover candidate set on the subsequent control segment, and generate the candidate takeover sequence from high to low according to the scenario recovery priority; Perform sequence cost calculation on the candidate takeover sequences, and filter out the smallest takeover sequence with the minimum total cost that satisfies the segment continuous release constraint to obtain the takeover object set; Perform blocking path takeover control on the takeover object set, switch to the video channel in the backup path in the video switching path, switch to the audio channel in the backup path in the audio output path, resend the screen action command in the screen execution path, and issue the projection detection command in the projection light path path to obtain the takeover status response set. By associating the takeover status response set with the subsequent control segments in the blocked path and the target takeover segment set, the takeover result of the blocked path is obtained.

7. The multimedia classroom equipment integrated monitoring and control method as described in claim 6, characterized in that: The generation of the takeover control record specifically includes: Extract the takeover status response set from the takeover results of the blocked path, and add the takeover status response set into the running event chain to obtain the continuation event chain; For the blocked segments in the continuation event chain and the subsequent control segments in the target takeover segment set, the action confirmation and scene confirmation are re-executed to obtain the continuation segment result; The results of the continued segment are registered in correspondence with the results of the blocked path takeover and the minimum takeover sequence to obtain the takeover control record.

8. The multimedia classroom equipment integrated monitoring and control method as described in claim 7, characterized in that: The generation of regulatory control results specifically includes: Collect scene execution records and takeover control records, register established segments, blocked paths, blocked pathway takeover results and minimum takeover sequence in the order of control segments, and obtain the control operation file; Retrieve the clearing segment from the control segment base table and combine it with the established segments in the control operation file to issue signals in reverse order: release, exit the sound amplification, exit the projection, reset the screen, and exit the environmental equipment to obtain the clearing state chain. The clearing status chain and control operation files are controlled and aggregated to obtain the regulatory control results.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, it implements the steps of the multimedia classroom equipment integrated monitoring and control method according to any one of claims 1 to 8.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the processor, it implements the steps of the multimedia classroom equipment integrated monitoring and control method according to any one of claims 1 to 8.

Images