Millisecond-level forced insertion intelligent adaptation method and system for multi-mode emergency broadcast large screen

Abstract

The invention provides a millisecond-level forced insertion intelligent adaptation method and system for a multi-mode emergency broadcast large screen, and relates to the technical field of emergency broadcast, and the method comprises the steps: 1, receiving an emergency broadcast signal from a superior emergency broadcast platform and at least one path of external multimedia input signal; and step 2, performing preprocessing and caching based on a divide-and-conquer strategy on the emergency broadcast signal and the external multimedia input signal, decomposing each path of input signal into independent signal processing subtasks by the divide-and-conquer strategy, performing decoding and caching operation on each subtask in parallel, and endowing the emergency broadcast signal with the highest priority. According to the invention, rapid broadcasting of the emergency information, multi-mode fusion display and intelligent recovery of the playing state are realized.

Description

Technical Field

[0001] This invention relates to the field of emergency broadcasting technology, and in particular to a millisecond-level forced insertion intelligent adaptation method and system for multimodal emergency broadcasting large screens. Background Technology

[0002] With the continuous advancement of smart city construction and the ongoing improvement of the public safety system, emergency broadcasting, as the core carrier for the release of early warning information for emergencies, has an increasingly urgent need for accurate dissemination and rapid response of multimodal information. However, traditional emergency broadcasting terminals have long suffered from problems such as a single form of information display, outdated control methods, untimely emergency response, weak remote management capabilities, and insufficient compatibility.

[0003] For example, an outdoor display screen in a commercial complex routinely plays commercial advertisements and public service announcements in a loop using existing media players. However, when a sudden safety incident occurs in the surrounding area and an emergency warning message needs to be broadcast, the traditional equipment not only cannot quickly interrupt the current playback process, but also struggles to effectively integrate and present warning videos, safety guidance images, and text prompts. It can only push information in a single text format, resulting in the public's understanding of the warning content being neither intuitive nor comprehensive. Furthermore, after the emergency information broadcast ends, management personnel need to manually restore the original playback status on-site, delaying the timeliness of emergency information dissemination. Summary of the Invention

[0004] The technical problem to be solved by this invention is to provide a millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast large screen, so as to realize the rapid broadcasting of emergency information, multimodal fusion display and intelligent recovery of playback status.

[0005] To solve the aforementioned technical problem, the technical solution of the present invention is as follows:

[0006] Firstly, a millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast screens, the method comprising:

[0007] Step 1: Receive emergency broadcast signals from the superior emergency broadcast platform and at least one external multimedia input signal;

[0008] Step 2: Perform preprocessing and buffering on emergency broadcast signals and external multimedia input signals based on a divide-and-conquer strategy. The divide-and-conquer strategy decomposes each input signal into an independent signal processing subtask, performs decoding and buffering operations on each subtask in parallel, and assigns the highest priority to the emergency broadcast signal.

[0009] Step 3: Monitor emergency broadcast signals in real time. When an emergency broadcast signal is detected, prioritize scheduling the emergency broadcast signal based on the preset task scheduling strategy. At the same time, according to the layout configuration information of the current display terminal, perform multimodal fusion and arrangement of the emergency broadcast content and the external multimedia content being played to obtain the fused content.

[0010] Step 4: Based on the arranged and integrated content, generate corresponding output control instructions. Control the display terminal to switch to the emergency broadcast content playback state within milliseconds according to the output control instructions, and automatically restore the original external multimedia signal playback state after the emergency broadcast ends.

[0011] Furthermore, it receives emergency broadcast signals from the superior emergency broadcast platform and at least one external multimedia input signal, including:

[0012] Step 11: Receive IP streaming media signals from the upper-level emergency broadcasting platform through the RJ45 network interface, and parse the IP streaming media signals to determine that the encapsulation format is one of RTSP, RTMP and HLS, while extracting the emergency broadcast content data stream within the encapsulation.

[0013] Step 12: Based on the emergency broadcast content data stream, if the image data is incomplete, receive the high-definition video signal from the external multimedia playback device through at least one HDMI interface, and decode the high-definition video signal into auxiliary video data that matches the resolution of the emergency broadcast content data stream;

[0014] Step 13: Based on the emergency broadcast content data stream and auxiliary video data, if there is still a lack of graphic and textual information, receive media content from the local storage device via the USB interface, parse and render the media content, and generate an overlayable graphic and textual information layer as a supplement and fusion signal source for the audiovisual content obtained in the first two steps.

[0015] Further, in step 2, the emergency broadcast signal and the external multimedia input signal are preprocessed and buffered based on a divide-and-conquer strategy. The divide-and-conquer strategy decomposes each input signal into independent signal processing subtasks, performs decoding and buffering operations on each subtask in parallel, and assigns the highest priority to the emergency broadcast signal, including:

[0016] Step 21: Decompose the type of each input signal into an independent media decoding subtask and a data parsing subtask;

[0017] Step 22: The media decoding subtask and the data parsing subtask are assigned to different cores of the embedded processor to perform decoding and parsing operations in parallel to obtain the decoded emergency broadcast content data. The decoding subtask of the emergency broadcast signal is assigned to a dedicated processing core and configured to real-time scheduling mode.

[0018] Step 23: Store the decoded emergency broadcast content data into a separate priority buffer queue, store the decoded data of the external multimedia input signal into a regular buffer queue, and mark the emergency broadcast content data in the priority buffer queue with the highest priority tag.

[0019] Furthermore, step 21 includes:

[0020] Step 211: Process the IP streaming media signal received through the RJ45 network interface, and break it down into independent network protocol parsing subtasks and media stream decoding subtasks according to the network protocol format. The network protocol parsing subtask is used to extract valid media data packets from RTSP, RTMP, and HLS protocol streams, while the media stream decoding subtask decodes the extracted data packets to obtain the first channel of decoded media data.

[0021] Step 212: Based on the obtained first-channel decoded media data, the high-definition video signal received through at least one HDMI interface is processed and decomposed into independent HDMI protocol parsing subtasks and video frame decoding subtasks according to the interface protocol characteristics. The video frame decoding subtask performs color space conversion and resolution adaptation processing on the separated original video frames to obtain the second-channel decoded media data.

[0022] Step 213: Based on the obtained decoded media data, process the local storage media content received through the USB interface. Decompose the media content into independent file reading subtasks and content format parsing subtasks according to file storage characteristics. The file reading subtask is used to read media files in the USB storage device. The content format parsing subtask decodes and renders the read JPG, PNG, BMP image files, TXT, and XML text files to generate the third channel of decoded media data. By completing the independent subtask decomposition of all input signals, media decoding subtasks and data parsing subtasks corresponding to each channel of decoded media data are formed.

[0023] Furthermore, step 22 includes:

[0024] Step 221: Based on the various subtasks obtained from the decomposition, the network protocol parsing subtask, the HDMI protocol parsing subtask, and the file reading subtask are assigned to the first core group of the embedded processor for parallel execution. By executing the subtasks, the original data packets, original video frame data, and media file data are extracted from the network stream, the HDMI signal stream, and the local file, respectively, and the extracted original data are uniformly stored in the shared memory buffer.

[0025] Step 222: Based on the various raw data in the shared memory buffer, the media stream decoding subtask, video frame decoding subtask, and content format parsing subtask are allocated to the second core group of the embedded processor for parallel execution; among them, to ensure the real-time performance of emergency broadcast processing, the media stream decoding subtask corresponding to the emergency broadcast signal is fixedly allocated to the dedicated core with the highest clock frequency in the second core group, and a real-time scheduling strategy that can preempt other subtasks is configured for the dedicated core, thereby forming a priority task execution environment for emergency broadcast;

[0026] Step 223: Based on the priority task execution environment, the dedicated core reads the original data corresponding to the emergency broadcast signal from the shared memory buffer and performs media stream decoding to generate structured emergency broadcast content data containing video frame sequences, image layers and text rendering data.

[0027] Furthermore, step 3 includes:

[0028] Step 31: Poll the priority cache queue in real time. When emergency broadcast content data with the highest priority tag is detected in the priority cache queue, it is determined that an emergency broadcast signal has been triggered.

[0029] Step 32: In response to the emergency broadcast signal, based on the preset task scheduling strategy, immediately interrupt the currently executing external multimedia content playback task, and save the on-site status information of the external multimedia content playback task to the designated status temporary storage area.

[0030] Step 33: parse the emergency broadcast content data in the priority cache queue and break it down into independent video element units, image element units, and text element units;

[0031] Step 34: Based on the external multimedia content currently playing, obtained from the state buffer area, it is also divided into corresponding background video units and background graphic units.

[0032] Step 35: Based on the preset current display terminal layout configuration information, call the corresponding split-screen fusion template. The split-screen fusion template defines the area coordinates, stacking order and transparency of the video layer, image layer and text layer.

[0033] Step 36: The video element units, image element units, and text element units of the emergency broadcast, along with the background video unit and background graphic unit, are taken as input. Parallel layout calculation and pixel-level fusion are performed according to the rules defined in the split-screen fusion template to generate a fused screen that contains emergency information and background information and conforms to the target layout, thus obtaining the arranged fused content.

[0034] Furthermore, step 36 includes:

[0035] Step 361: Based on the coordinates of each layer area defined in the called split-screen fusion template, the fused screen to be generated is divided into independent rendering blocks corresponding to each layer, and each rendering block is defined as an independent pixel calculation task.

[0036] Step 362: Based on each independent rendering block, the emergency broadcast video element unit, image element unit, and text element unit are distributed to the corresponding video rendering task, image rendering task, and text rendering task, respectively; at the same time, the background video unit and background graphic unit are distributed to the corresponding background rendering task.

[0037] Step 363: Based on the assigned rendering tasks, each rendering task is executed in parallel. In each rendering task, the received element units are rendered at the pixel level according to the stacking order and transparency defined for the layers by the split-screen fusion template, generating independent layer images corresponding to each rendering block.

[0038] Step 364: Based on the images of each independent layer, and in accordance with the overlay order defined by the split-screen fusion template, the images of each layer are sequentially overlaid and synthesized. During the overlay process, pixel mixing calculations are performed based on the transparency defined by each layer to obtain the final fused image, which serves as the fused content after editing.

[0039] Furthermore, based on the integrated content, corresponding output control commands are generated. These commands control the display terminal to switch to emergency broadcast content playback mode within milliseconds, and automatically revert to the original external multimedia signal playback mode after the emergency broadcast ends. This includes:

[0040] Step 41: Encode the final merged image into high-definition video frame data that conforms to the HDMI 2.0 protocol standard;

[0041] Step 42: Generate an output control instruction set containing a synchronization clock, data enable signal, and pixel data based on the high-definition video frame data;

[0042] Step 43: Send the electrical signal corresponding to the output control command set to the connected display terminal through at least one HDMI output interface, and control the display terminal to switch to playing the merged screen within a delay of no more than 300 milliseconds and enter the emergency broadcast content playback state;

[0043] Step 44: During the playback of the emergency broadcast content, continuously monitor the playback status of the emergency broadcast content. When the playback of the emergency broadcast content is detected to be completed or a playback end instruction is received from the superior platform, it is determined that the emergency broadcast playback has ended.

[0044] Step 45: In response to the determination that the emergency broadcast has ended, read the on-site status information from the status temporary storage area and generate a recovery control command based on the on-site status information;

[0045] Step 46: Execute the recovery control command to control the display terminal to switch back to the original external multimedia signal source specified by the on-site status information and restore the interrupted playback state, thus completing the automatic recovery.

[0046] Secondly, a multimodal emergency broadcast screen millisecond-level forced insertion intelligent adaptation system includes:

[0047] The acquisition module is used to receive emergency broadcast signals from the superior emergency broadcast platform and at least one external multimedia input signal;

[0048] The decomposition module is used to preprocess and buffer the emergency broadcast signal and the external multimedia input signal respectively based on the divide-and-conquer strategy. The divide-and-conquer strategy decomposes each input signal into an independent signal processing subtask, performs decoding and buffering operations on each subtask in parallel, and assigns the highest priority to the emergency broadcast signal.

[0049] The fusion module is used to monitor emergency broadcast signals in real time. When an emergency broadcast signal is detected, it prioritizes the scheduling of the emergency broadcast signal based on a preset task scheduling strategy. At the same time, according to the layout configuration information of the current display terminal, it performs multimodal fusion and arrangement of the emergency broadcast content with the external multimedia content that is being played to obtain the fused content.

[0050] The processing module is used to generate corresponding output control commands based on the synced content, and control the display terminal to switch to the emergency broadcast content playback state within milliseconds according to the output control commands, and automatically restore the original external multimedia signal playback state after the emergency broadcast ends.

[0051] Thirdly, a computing device includes:

[0052] One or more processors;

[0053] A storage device for storing one or more programs that, when executed by one or more processors, cause the one or more processors to implement the method.

[0054] Fourthly, a computer-readable storage medium storing a program that, when executed by a processor, implements the method.

[0055] The solution of the present invention has at least the following beneficial effects:

[0056] Because this invention employs a multi-source signal collaborative reception system that integrates RJ45 network ports, HDMI interfaces, and USB interfaces to supplement information, along with sub-task decomposition, multi-core parallel execution, a divide-and-conquer strategy for real-time scheduling and priority caching of emergency signal-specific cores, multi-modal fusion orchestration with split-screen fusion templates and pixel-level parallel rendering, HDMI 2.0 protocol encoding, millisecond-level switching within 300 milliseconds, and automatic recovery of state temporary storage and restoration, it effectively overcomes the technical problems of traditional emergency broadcast terminals, such as slow response speed, single information display format, insufficient compatibility, complex operation and maintenance, and inability to automatically restore the original playback state after emergency insertion. This achieves the technical effects of millisecond-level precise insertion of emergency information, intuitive fusion display of multi-modal content, seamless adaptation of multiple types of terminals and signal sources, improved remote operation and maintenance efficiency, and seamless connection between daily playback and emergency broadcasting, thereby enhancing the practical effectiveness and public service capabilities of the emergency broadcast system. Attached Figure Description

[0057] Figure 1 This is a flowchart illustrating a millisecond-level forced insertion intelligent adaptation method for a multimodal emergency broadcast screen provided by an embodiment of the present invention.

[0058] Figure 2 This is a schematic diagram of a millisecond-level forced insertion intelligent adaptation system for a multimodal emergency broadcast screen provided by an embodiment of the present invention. Detailed Implementation

[0059] Exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0060] like Figure 1 As shown, an embodiment of the present invention proposes a millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast screens, the method comprising the following steps:

[0061] Step 1: Receive emergency broadcast signals from the superior emergency broadcast platform and at least one external multimedia input signal;

[0062] Step 2: Perform preprocessing and buffering on emergency broadcast signals and external multimedia input signals based on a divide-and-conquer strategy. The divide-and-conquer strategy decomposes each input signal into an independent signal processing subtask, performs decoding and buffering operations on each subtask in parallel, and assigns the highest priority to the emergency broadcast signal.

[0063] Step 3: Monitor emergency broadcast signals in real time. When an emergency broadcast signal is detected, prioritize scheduling the emergency broadcast signal based on the preset task scheduling strategy. At the same time, according to the layout configuration information of the current display terminal, perform multimodal fusion and arrangement of the emergency broadcast content and the external multimedia content being played to obtain the fused content.

[0064] Step 4: Based on the arranged and integrated content, generate corresponding output control instructions. Control the display terminal to switch to the emergency broadcast content playback state within milliseconds according to the output control instructions, and automatically restore the original external multimedia signal playback state after the emergency broadcast ends.

[0065] In this embodiment of the invention, by employing multi-source signal access (receiving an emergency broadcast signal from an upper level and at least one external multimedia input signal), a divide-and-conquer strategy to decompose each input signal into an independent processing sub-task and perform decoding and caching in parallel while assigning the highest priority to the emergency broadcast signal, real-time monitoring of emergency signal triggering and priority scheduling, and multi-modal fusion orchestration based on display terminal layout configuration, and generating output control commands based on the fused content to achieve millisecond-level switching and automatic restoration of the original playback state after emergency playback ends, the technical problems of slow response speed, single information display format, lack of refined management capabilities, and the need for manual intervention to restore the original playback state after emergency insertion are effectively overcome by adopting the following technical means: millisecond-level precise insertion of emergency information, intuitive fusion display of multi-modal content, seamless connection between emergency and daily playback, and improved intelligent level of equipment management. This enhances the practical response efficiency and public service capabilities of the emergency broadcast system.

[0066] In a preferred embodiment of the present invention, step 1 may include:

[0067] Step 11: Receive IP streaming media signals from the upper-level emergency broadcasting platform via the RJ45 network interface, and parse the IP streaming media signals to determine that the encapsulation format is one of RTSP, RTMP, and HLS. At the same time, extract the emergency broadcast content data stream within the encapsulation. Specifically, after the device starts up, it first initializes the RJ45 network interface, completes the configuration of network parameters such as IP address, subnet mask, and gateway, and establishes a stable network connection with the upper-level emergency broadcasting platform. After the connection is established, the device continuously monitors network data transmission on the designated port. When it detects an IP streaming media signal from the upper-level platform, it immediately initiates the signal reception process, strictly adhering to network transmission protocol specifications to receive complete signal data packets. After signal reception, it enters the encapsulation format parsing stage. By analyzing key information such as the protocol header characteristics and data structure identifiers of the signal data packets, it identifies the encapsulation format of the IP streaming media signal one by one, determining whether it belongs to RTSP, RTMP, or HLS. After the format is determined, the corresponding protocol parsing tool is called to decapsulate the signal, stripping away redundant control information in the encapsulation layer and accurately extracting the emergency broadcast content data stream containing video data, audio data, and text warning information. After extraction, the data stream is checked for integrity. A data integrity threshold of 95% is set. If the check result reaches this threshold, the data stream is deemed valid and proceeds directly to the subsequent processing stage. If the threshold is not reached, a new signal reception request is initiated until a complete and valid emergency broadcast content data stream is obtained.

[0068] Step 12: Based on the emergency broadcast content data stream, if the image data is incomplete, receive the high-definition video signal from the external multimedia playback device through at least one HDMI interface, and decode the high-definition video signal into auxiliary video data that matches the resolution of the emergency broadcast content data stream. Specifically, this includes: first, performing image data integrity detection on the extracted emergency broadcast content data stream; by analyzing the pixel fill rate, frame structure integrity, and key image information integrity of the video data frame by frame, setting the image data integrity threshold to 90%; when the detection result is lower than this threshold, it is determined that the image data is incomplete, and the HDMI interface activation process is immediately triggered; the device automatically activates at least one HDMI interface, establishes a physical connection and signal communication with the external multimedia playback device, and receives the high-definition video signal transmitted by the external multimedia playback device. Upon receiving the signal, the decoding process is initiated, calling a decoder compatible with mainstream encoding formats such as H.264, H.265, and VP9 to decode the high-definition video signal and restore the original video frame data. Simultaneously, the resolution parameters of the emergency broadcast content data stream are read, and the video processing parameters during the decoding process are adjusted according to the resolution parameters. The decoded original video frame data is processed by color space conversion, pixel resampling, and size scaling to ensure that the processed auxiliary video data is fully matched with the emergency broadcast content data stream in terms of resolution, display ratio, and color depth, ensuring seamless integration between the two.

[0069] Step 13: Based on the emergency broadcast content data stream and auxiliary video data, if there is still missing graphic and textual information, receive media content from the local storage device via the USB interface, parse and render the media content to generate an overlayable graphic and textual information layer as a supplementary and fusion signal source for the audiovisual content obtained in the first two steps. Specifically, this includes: comprehensively detecting the acquired emergency broadcast content data stream and generated auxiliary video data, focusing on verifying whether it contains key graphic and textual information necessary for emergency warnings, including disaster type prompts, escape route guidance maps, safety protection instructions, etc., setting the completeness threshold of key graphic and textual information to 100%. If the detection finds that more than two key graphic and textual information items are missing, it is determined that there is still missing graphic and textual information, and the USB interface supplementation process is initiated; the device enables the USB interface and detects the connected local storage device to establish data... After reading the channel, the system traverses the storage device to read media files according to the file system directory structure. It then identifies the format of the read media files, distinguishing between JPG, PNG, and BMP image files and TXT and XML text files, and calls the corresponding file parsing tools to parse the content, extracting graphic elements from the images and text information from the text. After parsing, the rendering process is initiated. Based on the resolution and display parameters of the emergency broadcast content data stream and auxiliary video data, the extracted graphic elements and text information are processed for size adaptation, position calibration, and transparency adjustment, generating an overlayable graphic and text information layer with independent layer attributes. This graphic and text information layer accurately matches the display specifications of the audiovisual content obtained in the first two steps, serving as a supplement to the fusion signal source, emergency broadcast content data stream, and auxiliary video data to form a complete multimodal emergency information data set.

[0070] In this embodiment of the invention, because the invention adopts a layered, multi-source signal collaborative reception technology that first receives and parses the IP streaming media signal from the upper-level emergency broadcasting platform through the RJ45 network interface, receives and decodes the high-definition video signal and matches the resolution when the image data is incomplete through the HDMI interface, and receives local media through the USB interface and parses and renders it to generate a layer of superimposed image and text information, it effectively overcomes the technical problems of traditional emergency broadcasting signal reception being singular and prone to image or text information loss leading to incomplete emergency content. Thus, it achieves the technical effect of comprehensive coverage of emergency broadcasting audiovisual content and complete data without omission.

[0071] In a preferred embodiment of the present invention, step 2 may include:

[0072] Step 21 involves breaking down each input signal type into independent media decoding and data parsing subtasks. Specifically, after device startup, all incoming input signals are first identified, revealing three categories: IP streaming media signals received via the RJ45 network interface, high-definition video signals received via the HDMI interface, and locally stored media content received via the USB interface. For each identified input signal, it is further broken down into independent media decoding and data parsing subtasks according to signal processing logic. For IP streaming media signals, this is further broken down into a network protocol parsing subtask and a media stream decoding subtask. The network protocol parsing subtask is responsible for extracting valid media data packets from the signal, while the media stream decoding subtask... The task is responsible for decoding the extracted encoded video data. For high-definition video signals, it is broken down into an HDMI protocol parsing subtask and a video frame decoding subtask. The HDMI protocol parsing subtask is responsible for separating the video data channel and the audio data channel in the signal, while the video frame decoding subtask is responsible for further processing the separated original video frames. For locally stored media content, it is broken down into a file system reading subtask and a content format parsing subtask. The file system reading subtask is responsible for reading media files from the USB storage device, while the content format parsing subtask is responsible for decoding and generating rendering data from the read files. After all subtasks are broken down, an association mapping between the subtasks and the corresponding input signals is established to ensure that the processing subtasks of each signal are clear and traceable.

[0073] Step 22: The media decoding subtask and data parsing subtask are assigned to different cores of the embedded processor for parallel decoding and parsing operations to obtain the decoded emergency broadcast content data. The emergency broadcast signal decoding subtask is assigned to a dedicated processing core and configured in real-time scheduling mode. Specifically, this includes: firstly, dividing the core resources of the embedded processor into a first core group and a second core group, resulting in a functional division between the two groups; secondly, uniformly assigning the decomposed network protocol parsing subtask, HDMI protocol parsing subtask, and file system reading subtask to the first core group of the embedded processor; and thirdly, having the first core group execute these subtasks simultaneously according to a parallel processing mechanism, extracting raw data packets, raw video frame data, and media file data from the network stream, HDMI signal stream, and local file, respectively, and then combining all the extracted raw data... The data is stored in a pre-defined shared memory buffer to ensure centralized data management and easy subsequent retrieval. Then, the media stream decoding subtask, video frame decoding subtask, and content format parsing subtask are allocated to the second core group of the embedded processor for parallel execution. For the media stream decoding subtask corresponding to the emergency broadcast signal, special resource allocation is performed, fixing it to a dedicated core with the highest clock frequency in the second core group. A real-time scheduling strategy is configured for this dedicated core to preempt other subtasks. When the emergency broadcast signal decoding subtask starts, the execution of other non-emergency subtasks in the second core group can be paused, prioritizing the real-time performance of the emergency signal decoding. The dedicated core reads the original data corresponding to the emergency broadcast signal from the shared memory buffer, performs media stream decoding operations, and finally generates structured emergency broadcast content data containing video frame sequences, image layers, and text rendering data.

[0074] Step 23: Store the decoded emergency broadcast content data in a separate priority buffer queue, and store the decoded data of external multimedia input signals in a regular buffer queue. Mark the emergency broadcast content data in the priority buffer queue with the highest priority tag. Specifically, the device pre-creates two independent buffer queues: a priority buffer queue and a regular buffer queue, and determines the storage rules and priority differences between the two queues. The structured emergency broadcast content data generated by the dedicated core decoding is stored in the priority buffer queue according to the data transmission order. Simultaneously, a highest priority tag is added to each piece of emergency broadcast content data in this queue. The tag is embedded in the data header as a unique identifier field to ensure rapid identification during subsequent scheduling. For external multimedia input signal data decoded by other cores in the second core group, including HDMI high-definition video signal decoding data and USB local media content parsing data, they are stored sequentially in the regular buffer queue according to the receiving order, without adding priority tags. After the buffer data storage is completed, the device activates a queue monitoring mechanism to continuously scan the data status of the priority buffer queue and the regular buffer queue, focusing on monitoring whether there is emergency broadcast content data to be broadcast in the priority buffer queue. Once a new data with the highest priority tag is detected stored in the priority buffer queue, the device will detect it.

[0075] In this embodiment of the invention, because the invention employs the technical means of decomposing each input signal into independent media decoding subtasks and data parsing subtasks, allocating these subtasks to different cores of the embedded processor for parallel execution, allocating the emergency broadcast signal decoding subtask to a dedicated processing core and configuring a real-time scheduling mode, storing the decoded emergency broadcast content data in an independent priority cache queue and marking it with the highest priority, and storing external multimedia data in a regular cache queue, the invention effectively overcomes the technical problems of low efficiency in traditional emergency broadcast signal processing and delayed emergency response caused by the lack of priority distinction between emergency signals and regular signals. This results in improved processing speed of multi-source signals and ensures priority decoding and caching of emergency broadcast signals.

[0076] In a preferred embodiment of the present invention, step 21 may include:

[0077] Step 211: Process the IP streaming media signal received through the RJ45 network interface. Based on the network protocol format, break it down into independent network protocol parsing subtasks and media stream decoding subtasks. The network protocol parsing subtask extracts valid media data packets from RTSP, RTMP, and HLS protocol streams. The media stream decoding subtask decodes the extracted data packets to obtain the first channel of decoded media data. Specifically, the device first performs preliminary identification of the IP streaming media signal received through the RJ45 network interface. After confirming that the signal source is the upper-level emergency broadcast platform, it initiates the protocol format analysis process. By detecting key features such as the signal's protocol header identifier and data transmission format, it determines the network protocol type used by the IP streaming media signal, distinguishing it from one of the three protocols: Real-time Streaming Protocol (RTP), Real-time Messaging Protocol (RMPP), Hypertext Transfer Protocol (HTP), or Live Streaming Protocol (LLP). Based on the determined network protocol format, the IP streaming media signal is broken down into two independent processing subtasks: the network protocol parsing subtask and the media stream decoding subtask. The network protocol parsing subtask focuses on parsing the protocol stream layer by layer, stripping away redundant information such as control commands and check fields, and accurately extracting the valid media data packets containing the core content of the emergency broadcast. The media stream decoding subtask calls a decoder compatible with mainstream encoding formats to decode the extracted video data packets encoded in H.264, H.265, or VP9 formats, restoring the original video frames, audio data, and text information, and finally integrating them to form the first channel of decoded media data.

[0078] Step 212: Based on the obtained first-channel decoded media data, process the high-definition video signal received through at least one HDMI interface. Decompose the signal into independent HDMI protocol parsing subtasks and video frame decoding subtasks according to interface protocol characteristics. The video frame decoding subtask performs color space conversion and resolution adaptation processing on the separated original video frames to obtain the second-channel decoded media data. Specifically, this includes: firstly, reading the key parameters of the generated first-channel decoded media data, including core information such as resolution, color space, and frame rate; then, performing interface protocol characteristic analysis on the high-definition video signal received through at least one HDMI interface to obtain the HDMI signal transmission specifications and data structure; and finally... The high-definition video signal is broken down into independent HDMI protocol parsing subtasks and video frame decoding subtasks. The HDMI protocol parsing subtask is responsible for performing channel separation processing on the received signal according to the HDMI interface protocol standard, accurately separating the video data channel and the audio data channel to ensure that the two types of data are independent and complete. The video frame decoding subtask performs targeted processing on the separated original video frame data. First, it performs color space conversion to adjust the color format of the original video frame to be consistent with the format of the first decoded media data. Then, it performs resolution adaptation through operations such as pixel resampling and size scaling to ensure that the two data are completely matched in terms of display specifications, and finally generates the second decoded media data.

[0079] Step 213: Based on the obtained decoded media data, process the local storage media content received via the USB interface. This is broken down into independent file reading subtasks and content format parsing subtasks based on file storage characteristics. The file reading subtask reads media files from the USB storage device, while the content format parsing subtask decodes and renders the read JPG, PNG, BMP image files, TXT, and XML text files to generate the third channel of decoded media data. By completing the independent subtask decomposition of all input signals, media decoding subtasks and data parsing subtasks corresponding to each channel of decoded media data are formed. Specifically, this includes: comprehensively reading the complete parameters of the first and second channels of decoded media data, including display resolution, layer attributes, and data format, to obtain the processing standard for the local storage media content; and performing file storage characteristic analysis on the media content received via the USB interface to understand the file system structure, file naming rules, and other characteristics of the storage device. Storage path; based on these characteristics, the local storage media content is broken down into independent file reading subtasks and content format parsing subtasks; the file reading subtask traverses all media files on the USB storage device one by one according to the file system directory structure, accurately reading the target files related to emergency broadcasting; the content format parsing subtask identifies the format of the read files, distinguishing between JPG, PNG, and BMP image files and TXT and XML text files, calling the corresponding parsing tools for different formats to extract graphic elements and color information from image files and text content from text files, and then performing rendering data generation processing on these extracted information, including size adaptation, clarity optimization, text layout, etc., to ensure that the generated rendering data is completely consistent with the display parameters of the first two decoded media data, ultimately forming the third decoded media data; through the independent subtask decomposition and targeted processing of the three input signals, media decoding subtasks and data parsing subtasks corresponding one-to-one with each decoded media data are formed.

[0080] In this embodiment of the invention, because the invention employs the following techniques: for IP streaming media signals from RJ45 network interfaces, it decomposes them into independent network protocol parsing subtasks and media stream decoding subtasks based on network protocol formats; for high-definition video signals from HDMI interfaces, it decomposes them into independent HDMI protocol parsing subtasks and video frame decoding subtasks based on interface protocol characteristics; and for local storage media content from USB interfaces, it decomposes them into independent file reading subtasks and content format parsing subtasks based on file storage characteristics. Furthermore, it processes the next signal sequentially based on the previous decoded media data, thus completing the decomposition of all input signals into independent subtasks. Therefore, this invention effectively overcomes the technical problems of traditional multi-source signal mixed processing, such as lack of targeted decomposition, resulting in low parsing and decoding efficiency, data format incompatibility, and resolution mismatch. As a result, it achieves that all types of signals can receive dedicated and accurate processing, ensuring accurate adaptation of each decoded media data.

[0081] In a preferred embodiment of the present invention, step 22 may include:

[0082] Step 221: Based on the various subtasks obtained from the decomposition, the network protocol parsing subtask, HDMI protocol parsing subtask, and file reading subtask are allocated to the first core group of the embedded processor for parallel execution. By executing the subtasks, raw data packets, raw video frame data, and media file data are extracted from the network stream, HDMI signal stream, and local file, respectively. The extracted raw data is then uniformly stored in a shared memory buffer. Specifically, this includes: firstly, pre-dividing the core resources of the embedded processor to determine the number of cores and functional boundaries of the first core group, which is specifically responsible for the parallel processing of basic data extraction subtasks; secondly, based on the decomposition of the network protocol parsing subtask, HDMI protocol parsing subtask, and file reading subtask, the system task scheduler simultaneously allocates these three types of subtasks to different cores of the first core group, initiating a parallel execution flow. The process consists of three subtasks: a network protocol parsing subtask for IP streaming media signals received via the RJ45 network interface, which parses the signals layer by layer according to the corresponding RTSP / RTMP / HLS protocol specifications, stripping away protocol control fields and redundant information to accurately extract valid raw data packets containing emergency broadcast content; an HDMI protocol parsing subtask for high-definition video signals received via the HDMI interface, which separates the video data channel and audio data channel according to the HDMI interface protocol standard to extract the unprocessed raw video frame data; and a file reading subtask for local storage devices connected via the USB interface, which traverses the target directory according to the file structure of the storage device to read media file data related to emergency broadcasts. After the three subtasks are completed, a shared memory buffer is automatically established, and the extracted raw data packets, raw video frame data, and media file data are stored in the buffer according to their data types.

[0083] Step 222: Based on the various raw data in the shared memory buffer, the media stream decoding subtask, video frame decoding subtask, and content format parsing subtask are allocated to the second core group of the embedded processor for parallel execution. To ensure the real-time performance of emergency broadcast processing, the media stream decoding subtask corresponding to the emergency broadcast signal is fixedly assigned to the dedicated core with the highest clock frequency in the second core group. A real-time scheduling strategy is configured for this dedicated core to preempt other subtasks, thus forming a priority task execution environment for emergency broadcasts. Specifically, after the first core group completes the extraction of raw data and stores it in the shared memory buffer, the task allocation process of the second core group is immediately initiated. The second core group is specifically responsible for core decoding and format parsing subtasks. The system uses a task scheduler to allocate media stream decoding subtasks, video frame decoding subtasks, and content format parsing subtasks to different cores within the core group, initiating parallel decoding and parsing operations. To address the issue of delayed emergency response in traditional equipment, a special resource allocation strategy is implemented for the media stream decoding subtask corresponding to the emergency broadcast signal. First, the core with the highest clock frequency in the second core group is identified as a dedicated core, and the media stream decoding subtask for the emergency broadcast signal is fixedly assigned to this dedicated core. Subsequently, a preemptive real-time scheduling strategy is configured for this dedicated core. When the media stream decoding subtask for the emergency broadcast signal starts, other non-emergency subtasks currently executing on the dedicated core can be forcibly paused, prioritizing the use of core resources to execute the emergency decoding operation. Through this configuration, a priority task execution environment specifically for emergency broadcasts is formed.

[0084] Step 223: Based on the priority task execution environment, the dedicated core reads the original data corresponding to the emergency broadcast signal from the shared memory buffer and performs media stream decoding to generate structured emergency broadcast content data containing video frame sequences, image layers, and text rendering data. Specifically, after the priority task execution environment is set up, the dedicated core reads the original data packet corresponding to the emergency broadcast signal from the shared memory buffer according to a preset program and starts the media stream decoding process. The dedicated core calls a high-performance decoder compatible with mainstream encoding formats such as H.264 and H.265 VP9 to decode the original data packet and restore the original video frame sequence corresponding to the emergency broadcast. At the same time, for the image data involved in the decoding process, the dedicated core extracts graphic elements, color information, etc., and generates independent image layer data. For the text warning information contained in the original data packet, the dedicated core performs text format parsing and rendering parameter configuration to generate text rendering data that conforms to the display standard. After completing the video frame sequence decoding, image layer generation, and text rendering data configuration, the dedicated core integrates these three types of data in a structured manner and combines them according to the preset data format specifications to form structured emergency broadcast content data containing video frame sequences, image layers, and text rendering data.

[0085] In this embodiment of the invention, by employing a technique that assigns network protocol parsing, HDMI protocol parsing, and file reading subtasks to the first core group of the embedded processor for parallel execution and stores the extracted raw data uniformly in a shared memory buffer, and assigns media stream decoding, video frame decoding, and content format parsing subtasks to the second core group for parallel execution, and by fixing the media stream decoding subtask corresponding to the emergency broadcast signal to the dedicated core with the highest clock frequency in the second core group and configuring a real-time scheduling strategy that can preempt other subtasks, and then having the dedicated core read the emergency raw data from the shared memory buffer to perform decoding and generate structured emergency broadcast content data, the technical problems of chaotic multi-core task allocation, low processing efficiency, frequent task conflicts, and delayed emergency response caused by the lack of dedicated resources for emergency signal decoding are effectively overcome. This achieves the technical effects of orderly and efficient parallel processing of multi-source signals, absolute guarantee of the real-time performance and priority of emergency broadcast signal decoding, and structured and standardized emergency content data.

[0086] In a preferred embodiment of the present invention, step 3 may include:

[0087] Step 31: Real-time polling of the priority cache queue. When emergency broadcast content data carrying the highest priority tag is detected in the priority cache queue, it is determined that an emergency broadcast signal has been triggered. Specifically, this includes: immediately starting the real-time polling mechanism of the priority cache queue after the device starts up, setting the polling interval to 10 milliseconds to ensure that data changes in the queue can be captured quickly; during the polling process, the device will perform attribute detection on each piece of data in the priority cache queue one by one, focusing on identifying whether the data header contains a preset highest priority tag; the highest priority tag is embedded in the data structure in the form of a dedicated identifier field. The device compares the specific value of this field with the system's preset highest priority tag. When the identifier field of a piece of data is detected to be completely consistent with the preset value, it is immediately determined that an emergency broadcast signal has been triggered.

[0088] Step 32: In response to the emergency broadcast signal, based on the preset task scheduling strategy, immediately interrupt the currently executing external multimedia content playback task and save the on-site status information of the external multimedia content playback task to the designated status temporary storage area. Specifically, this includes: based on the preset task scheduling strategy, immediately sending a forced interrupt command to the currently executing external multimedia content playback task. The forced interrupt command has higher priority than all non-emergency task commands, ensuring that the playback task is paused within 10 milliseconds; after the interruption is completed, the device automatically starts the on-site status information saving process, comprehensively collecting key status parameters of the current playback task, including the playback progress of the external multimedia content, the signal source type (HDMI input or USB input), the signal source number, the current layout parameters of the display terminal, the volume, the screen brightness and contrast, and all other information affecting the playback status; subsequently, the collected on-site status information is classified and stored in the designated status temporary storage area according to the preset data storage format. The status temporary storage area adopts an independent storage partition design to ensure data storage security and prevent it from being overwritten by other tasks.

[0089] Step 33: Parse the emergency broadcast content data in the priority cache queue and break it down into independent video element units, image element units, and text element units. Specifically, this includes: After the emergency broadcast signal is triggered, the device calls a dedicated data parsing tool to read the emergency broadcast content data carrying the highest priority tag in the priority cache queue; the emergency broadcast content data is in a structured format, and the parsing tool, according to the data structure specifications, first separates the video data segment, image data segment, and text data segment; for the video data segment, extract the continuous video frame sequence, remove redundant control fields, and form an independent video element unit, which contains complete video playback timing, resolution, frame rate, and other key parameters; for the image data segment, extract the independent image layer information, including graphic elements, color parameters, size data, etc., to form an independent image element unit; for the text data segment, extract the warning text content, text format font, font size, color, rendering parameters, etc., to form an independent text element unit.

[0090] Step 34: Based on the currently playing external multimedia content obtained from the status buffer, the device is also divided into corresponding background video units and background graphic units. Specifically, this includes: the device fully reads the saved on-site status information of the currently playing external multimedia content from the status buffer, and retrieves the corresponding original data of the external multimedia content according to the signal source type and number in the status information; then, following the same divide-and-conquer logic as the emergency broadcast content data, the external multimedia content is processed; first, the dynamic video portion is extracted, including the video frame at the current pause time and the subsequent video frame sequence to be played, forming a background video unit, which retains the original video's resolution, frame rate, color space, and other parameters; then, the static graphic portion is extracted, including images, text labels, advertising graphics, and other content superimposed on the video, and integrated to form a background graphic unit, obtaining parameters such as the position coordinates, transparency, and superposition order of each graphic element in the background graphic unit; the decomposed background video unit and background graphic unit correspond to the decomposed emergency broadcast element units.

[0091] Step 35: Based on the preset current display terminal layout configuration information, the corresponding split-screen fusion template is invoked. The split-screen fusion template defines the area coordinates, overlay order, and transparency of the video layer, image layer, and text layer. Specifically, the device pre-stores multiple split-screen fusion templates adapted to different display terminals. Template types cover full-screen layout, two-screen layout, three-screen layout, and other forms. Each template is specifically designed according to the resolutions of common display terminals, such as 1920×1080 and 3840×2160. When a template needs to be invoked, the device first reads the current display terminal's layout configuration information, including key parameters such as terminal resolution, screen size, and display ratio. The parameters are then compared with the adaptation parameters of the pre-stored templates to select a perfectly matching split-screen fusion template. The split-screen fusion template defines the specific area coordinates of the video layer, image layer, and text layer, accurate to the pixel. For example, the video layer occupies 60% of the left side of the screen, the image layer occupies 20% of the upper right side, and the text layer occupies 20% of the bottom side. The stacking order of each layer is also defined, such as the text layer being the top layer, the image layer being the middle layer, and the video layer being the bottom layer. The transparency values ​​of each layer are also set, with the transparency of emergency-related layers set to 80% and the transparency of the background layer set to 50%, ensuring that emergency information is clearly visible without completely obscuring the background content.

[0092] Step 36: Taking the video element units, image element units, and text element units of the emergency broadcast, along with the background video unit and background graphic unit, as input, parallel layout calculations and pixel-level fusion are performed according to the rules defined in the split-screen fusion template to generate a fused screen containing emergency information and background information that conforms to the target layout, resulting in the arranged fused content. Specifically, this includes: receiving the disassembled emergency broadcast element units, disassembled background element units, and the split-screen fusion template parameters called in the step, and then starting the parallel layout calculation process; firstly, according to the coordinates of each layer area defined in the template, the fused screen to be generated is divided into multiple independent calculation areas, each area corresponding to the display range of a layer; then, an independent calculation task is assigned to each calculation area, and multiple calculation threads are started simultaneously to process the layout calculation of each area in parallel to determine the emergency video. The layout calculations include parameters such as the specific positions and size adaptation ratios of elements, image elements, text elements, background video elements, and graphic elements within their respective areas. After the layout calculations are completed, the pixel-level fusion stage begins. Following the stacking order and transparency values ​​defined in the template, the pixel data of each element unit is mixed. For example, in the text layer area, the pixel data of the emergency text element is mixed with the pixel data of the background layer at 80% and 50% transparency ratios to ensure the text is clear and does not obscure the background. In the video layer area, the pixel data of the emergency video element and the background video element are merged according to the stacking order to maintain smooth video playback. After all areas are merged, a complete fused image is formed, containing emergency information and background information, with standardized layout and visual harmony. This complete fused image is the edited fused content.

[0093] In this embodiment of the invention, because the invention employs a real-time polling priority caching queue to determine the triggering of emergency broadcast signals, immediately interrupts the current external multimedia playback and saves the on-site state after the triggering response, decomposes the emergency broadcast content and the currently playing content into independent element units, calls a preset split-screen fusion template and performs parallel layout calculations and pixel-level fusion to generate a fused screen according to the template rules, it effectively overcomes the technical problems of delayed response to traditional emergency broadcast signal triggering, difficulty in coordinating the display of emergency content and existing playback content, and poor intuitiveness due to chaotic information layout. Thus, it achieves the technical effects of rapid and accurate triggering of emergency signals, natural fusion of multimodal content, and standardized adaptation of display layout, allowing emergency information to be presented with priority and organically combined with background content, thereby improving the public's efficiency in receiving and understanding emergency information.

[0094] In a preferred embodiment of the present invention, step 36 may include:

[0095] Step 361: Based on the coordinates of each layer region defined in the called split-screen fusion template, the fused screen to be generated is divided into independent rendering blocks corresponding to each layer. Each rendering block is defined as an independent pixel calculation task. Specifically, this includes: first, reading the called split-screen fusion template and extracting the predefined region coordinate information of the video layer, image layer, and text layer in the template. These coordinates precisely define the display range of each layer on the display terminal in pixels. Based on the region coordinates of each layer, the fused screen to be generated is divided into corresponding independent rendering blocks according to the layer type. The boundary of each rendering block is completely consistent with the coordinate range of the corresponding layer, ensuring accurate and non-overlapping rendering ranges. Subsequently, each independent rendering block is defined as an independent pixel calculation task, and a unique identifier is assigned to each task. The calculation range of each task is all pixels within the corresponding block.

[0096] Step 362: Based on each independent rendering block, the emergency broadcast video element units, image element units, and text element units are distributed to the corresponding video rendering tasks, image rendering tasks, and text rendering tasks, respectively. Simultaneously, background video units and background graphic units are distributed to the corresponding background rendering tasks. Specifically, this includes: activating the task distribution mechanism based on the divided independent rendering blocks and their corresponding pixel calculation tasks; first, identifying the layer type corresponding to each rendering block; distributing the emergency broadcast video element units to the video rendering task corresponding to the video layer rendering block, the emergency broadcast image element units to the image rendering task corresponding to the image layer rendering block, and the emergency broadcast text element units to the text rendering task corresponding to the text layer rendering block; simultaneously, for the background content extracted from the status buffer, distributing the background video units to the background video rendering task and the background graphic units to the background graphic rendering task, ensuring that each rendering task only processes element units of the corresponding type, and that the element units and the layer types of the rendering blocks are precisely matched, avoiding rendering errors caused by mixing different types of elements.

[0097] Step 363: Based on the assigned rendering tasks, execute each rendering task in parallel. In each rendering task, according to the overlay order and transparency defined for the layers in the split-screen fusion template, perform pixel-level rendering on the received element units to generate independent layer images corresponding to each rendering block. Specifically, this includes: after task distribution, starting a multi-threaded parallel execution mechanism, simultaneously triggering all assigned video rendering tasks, image rendering tasks, text rendering tasks, and background rendering tasks; during the execution of each rendering task, first read the overlay order and transparency values ​​set for the corresponding layers in the split-screen fusion template, where the transparency of emergency-related layers is uniformly set to 80%, and the transparency of background layers is... The threshold is set to 50%. Subsequently, pixel-level rendering is performed on the element units received by the task. The video rendering task parses the pixel data of the video element units frame by frame, and combines the frame rate parameters to ensure smooth video rendering. The image rendering task optimizes the color parameters and sharpness of the image element units to ensure the integrity of image details. The text rendering task renders the text according to the preset font size and color parameters to ensure that the text is clear and legible. The background rendering task maintains the original texture of the background elements and only makes basic adjustments based on the transparency parameters. After each rendering task is completed, an independent layer image that completely matches the corresponding rendering block is generated to ensure that the pixel range and display parameters of each layer image are consistent with the requirements of the rendering block.

[0098] Step 364: Based on the images of each independent layer, according to the stacking order defined by the split-screen fusion template, the images of each layer are sequentially stacked and synthesized. During the stacking process, pixel blending calculations are performed based on the transparency defined by each layer to obtain the final merged image, which serves as the fused content after arrangement. Specifically, this includes: After the preceding rendering task is completed and multiple independent layer images including the emergency video layer, emergency image layer, emergency text layer, and background layer are obtained, the layer geometry precision calibration process is first started; based on the pixel coordinates of the target area of ​​each layer preset by the split-screen fusion template, a multi-parameter calibration system is constructed using an affine transformation algorithm. By extracting the pixel coordinate set of the target area boundary, an affine transformation matrix is ​​constructed, and geometric parameter correction processing is performed on each independent layer image. For the emergency text layer, based on the width and height pixel dimensions of the template text area, the horizontal and vertical scaling coefficients are solved, and pixel-level adaptation of the text layout is achieved through matrix operations to ensure that the text area completely fits the target boundary; for the emergency image layer, the translation vector is solved through matrix inverse operation to correct the position offset of the image pixel matrix and avoid pixel overlap or gaps with the emergency video layer; for the background layer... Layers, combined with the physical resolution of the display terminal and the template layout ratio coefficient, are corrected for stretching distortion and compression deviation through affine transformation. This ensures precise geometric alignment of all independent layers with the target area of ​​the template, guaranteeing no pixel-level misalignment, missing edges, or boundary overflow issues. After geometric calibration, the multi-channel layer images enter the layer priority compositing process. According to the layer priority sorting rules preset in the split-screen fusion template, layer overlay processing is performed. The priority sorting follows the core logic of emergency text layer > emergency image layer > emergency video layer > background layer, ensuring that the emergency information carrying layer is always in the visual display priority level and is not obscured by background content. During the overlay of adjacent layers, pixel-level weighted fusion calculation is initiated. Based on the preset transparency weight parameters of each layer, the pixel values ​​of corresponding pixel positions of the upper and lower layers are fused. The specific weighted summation process is as follows: First, the preset transparency weight parameters of the upper and lower layers in the split-screen fusion template are read to obtain the weight coefficients of the upper layer and the lower layer. Taking the upper emergency text layer and the lower emergency image layer as an example, the upper layer weight coefficient is mapped to 0.8, and the lower layer weight coefficient is mapped to 0.5. The second step is to separate the pixel channels of the upper and lower layers, extracting the pixel values ​​of each of the three RGB channels. The pixel value range of each channel is 0-255, ensuring that the three channels of data at each pixel position are extracted and calculated independently. The third step is to multiply the pixel value of the corresponding channel of the upper layer with the upper layer weight coefficient for the same pixel coordinate position to obtain the weighted pixel value of the upper layer channel. At the same time, multiply the pixel value of the corresponding channel of the lower layer with the lower layer weight coefficient to obtain the weighted pixel value of the lower layer channel. The fourth step is to perform an accumulation operation on the weighted pixel values ​​of the upper and lower layers of the same channel to obtain the merged intermediate pixel value of that channel. The fifth step is to start the pixel value clamping processing mechanism to constrain the merged intermediate pixel value to the standard pixel value range of 0-255. Within this process, to avoid pixel value overflow due to weighted accumulation, if the median value is greater than 255, it is taken as 255; if it is less than 0, it is taken as 0. In the sixth step, the fused pixel values ​​of the three channels are recombined to generate the final fused pixel value for that pixel position, achieving weighted fusion of a single pixel. Through a pixel-by-pixel, channel-by-channel weighted summation process, both the recognizability of the emergency text information and the effective information of the background image are preserved, achieving a clear visual overlay effect. After completing the priority overlay and pixel fusion calculations for all layers in sequence, the fused pixel matrix undergoes integrity verification and optimization, removing abnormal pixels and correcting pixel deviations in the fusion transition area, ultimately generating a complete fused image with multimodal information collaborative carrying capabilities, which serves as the choreographed fused content.

[0099] In this embodiment of the invention, because the invention adopts the technical means of dividing independent rendering blocks according to the split-screen fusion template and defining them as pixel calculation tasks, distributing each element unit of the emergency broadcast and each background unit to the corresponding rendering task, performing pixel-level rendering in parallel to generate independent layer images, and mixing and compositing according to the template stacking order and transparency, it effectively overcomes the technical problems of low rendering efficiency, chaotic layer stacking, and poor transparency adaptation leading to inconsistent images when traditionally fusion of multimodal content. Thus, it achieves the technical effect of efficient parallel rendering of multiple elements, standardized and accurate layout of the fused screen, organic stacking of each layer, and clear and natural visual effects.

[0100] In a preferred embodiment of the present invention, step 4 may include:

[0101] Step 41 encodes the final merged image into high-definition video frame data conforming to the HDMI 2.0 protocol standard. Specifically, this includes: first, calling a high-definition video encoder conforming to the HDMI 2.0 protocol standard to read the final merged image data, which contains the fusion information of emergency video image text and background content; configuring the encoder according to the HDMI 2.0 protocol requirements, including setting the resolution to 4K or 1080P to adapt to the display terminal specifications, fixing the frame rate to 60 frames per second, setting the color depth to 24 bits to ensure color reproduction, and adjusting the pixel format to RGB888 to ensure accurate image color; then, performing frame-by-frame encoding processing on the merged image, converting the pixel matrix data of the image into serial video frame data conforming to the HDMI 2.0 protocol specifications. During the encoding process, the signal timing, data transmission rate, and other requirements specified in the protocol are strictly followed to ensure that the encoded high-definition video frame data can be correctly recognized and decoded by various display terminals compatible with the HDMI 2.0 protocol.

[0102] Step 42: Based on the high-definition video frame data, generate an output control instruction set containing a synchronization clock, data enable signal, and pixel data. Specifically, this includes: based on the encoded high-definition video frame data; firstly, extracting the timing characteristics of the video frame data to generate a synchronization clock signal, with the synchronization clock frequency set to 148.5 MHz to ensure the display terminal accurately and synchronously receives the video data; then, generating a data enable signal based on the effective pixel range of the video frame. When the video frame data contains valid pixels, the data enable signal is at a high level, triggering the display terminal to receive and display that portion of the pixel data; when it contains invalid pixels, the data enable signal is at a low level, pausing reception to save transmission resources; simultaneously, arranging the encoded pixel data according to the transmission order specified by the HDMI 2.0 protocol, integrating it with the synchronization clock signal and data enable signal to form a complete output control instruction set. The control instruction set contains the transmission control logic for each frame of video data, ensuring that the display terminal receives and parses the pixel data in the correct timing sequence, avoiding image distortion.

[0103] Step 43: Send the electrical signal corresponding to the output control command set to the connected display terminal through at least one HDMI output interface. Control the display terminal to switch to playing the merged picture within a delay of no more than 300 milliseconds and enter the emergency broadcast content playback state. Specifically, this includes: the device pre-activating at least one HDMI 2.0 output interface, completing the physical connection detection and communication link establishment between the interface and the display terminal, ensuring that the interface transmission rate is stable at 18 gigabits per second to meet the transmission requirements of 4K 60Hz high-definition video data; converting the generated output control command set into differential electrical signals conforming to the HDMI 2.0 protocol and sending it to the connected display terminal through the signal transmission channel of the HDMI output interface; during the transmission process, monitoring the signal transmission status in real time, and automatically activating the signal gain compensation mechanism if signal attenuation or interference occurs to ensure signal transmission quality; at the same time, controlling the signal switching process of the display terminal, skipping unnecessary initialization steps, directly decoding the received high-definition video frame data, ensuring that the total delay from sending the control command to the display terminal starting to play the merged picture does not exceed 300 milliseconds, and quickly entering the emergency broadcast content playback state.

[0104] Step 44: During the playback of the emergency broadcast content, continuously monitor the playback status of the emergency broadcast content. When the emergency broadcast content is detected to have finished playing or a playback end command is received from the superior platform, the emergency broadcast playback is determined to have ended. Specifically, after the emergency broadcast content begins playing, the device activates a continuous playback status monitoring mechanism, setting the monitoring interval to 50 milliseconds to ensure real-time monitoring of the playback dynamics. The monitoring content includes two aspects: first, the playback progress of the emergency broadcast content, which is determined by reading parameters such as video frame playback count and audio playback duration to determine whether the total duration of the merged image has been reached. When the playback progress reaches 100% of the total duration, the emergency broadcast content is determined to have finished playing; second, the superior platform command reception status, which is continuously monitored through the network interface for commands issued by the superior emergency broadcast platform. When a control command containing a playback end indicator is received, the emergency broadcast playback is immediately determined to have ended. Meeting either of these two conditions triggers the subsequent termination process, ensuring accurate and timely determination of the emergency broadcast playback end and avoiding premature termination or playback exceeding the timeout period.

[0105] Step 45: In response to the determination that the emergency broadcast playback has ended, read the on-site status information from the status buffer and generate a recovery control command based on the on-site status information. Specifically, this includes: responding immediately upon determining that the emergency broadcast playback has ended and initiating the status recovery preparation process; firstly, accessing the designated status buffer, which uses an independent storage partition design to ensure that the stored on-site status information is not tampered with or lost. The read on-site status information includes the type of the original external multimedia signal source (HDMI or USB input), the signal source number, the playback progress at the time of interruption, parameters such as the brightness, contrast, and volume of the display terminal, the playback mode, and all other key information affecting the playback status; based on the read information, generate the corresponding recovery control command, which specifies the original signal source path to be switched back to, the playback progress recovery node, and the restored values ​​of the display parameters, ensuring that the recovery control command accurately matches the playback status before the interruption.

[0106] Step 46: Execute the recovery control command to control the display terminal to switch back to the original external multimedia signal source specified by the on-site status information and restore the interrupted playback state, completing the automatic recovery. Specifically, this includes: executing the generated recovery control command; first, controlling the display terminal to cut off the signal source of the current emergency broadcast content and shutting down the emergency video frame data transmitted through the HDMI output interface; then, according to the original external multimedia signal source information specified in the recovery control command, switching the signal receiving channel to connect to the interrupted original signal source; simultaneously, sending the playback progress parameters at the time of interruption to the playback module corresponding to the original signal source, controlling the playback module to continue playback from that progress node, ensuring continuous playback without jumps. Furthermore, according to the restored display parameter values ​​in the command, adjusting the display terminal's brightness, contrast, volume, and other settings to maintain consistency with before the interruption; the entire recovery process requires no manual intervention, automatically switching from emergency mode to normal playback mode and restoring the interrupted playback state.

[0107] In this embodiment of the invention, because the invention employs technical means to encode the final fused image into high-definition video frame data of the HDMI 2.0 protocol standard, generate an output control instruction set including a synchronization clock, data enable signal, and pixel data, control the display terminal to switch to emergency playback state within 300 milliseconds through the HDMI output interface, continuously monitor the emergency broadcast status, and read information from the status temporary storage area after the emergency broadcast ends to generate a recovery control instruction to restore the original playback state, it effectively overcomes the technical problems of prolonged emergency broadcast switching time, poor adaptability of high-definition image transmission, and the need for manual intervention to restore the original playback state after the emergency broadcast ends. Thus, it achieves the technical effects of millisecond-level rapid presentation of emergency information, stable output of high-definition images, seamless connection between emergency and daily playback, and no need for manual operation, ensuring the timeliness of emergency broadcasting and the continuity of the playback process.

[0108] like Figure 2As shown, embodiments of the present invention also provide a millisecond-level forced insertion intelligent adaptation system for multimodal emergency broadcast screens, comprising:

[0109] The acquisition module is used to receive emergency broadcast signals from the superior emergency broadcast platform and at least one external multimedia input signal;

[0110] The decomposition module is used to preprocess and buffer the emergency broadcast signal and the external multimedia input signal respectively based on the divide-and-conquer strategy. The divide-and-conquer strategy decomposes each input signal into an independent signal processing subtask, performs decoding and buffering operations on each subtask in parallel, and assigns the highest priority to the emergency broadcast signal.

[0111] The fusion module is used to monitor emergency broadcast signals in real time. When an emergency broadcast signal is detected, it prioritizes the scheduling of the emergency broadcast signal based on a preset task scheduling strategy. At the same time, according to the layout configuration information of the current display terminal, it performs multimodal fusion and arrangement of the emergency broadcast content with the external multimedia content that is being played to obtain the fused content.

[0112] The processing module is used to generate corresponding output control commands based on the synced content, and control the display terminal to switch to the emergency broadcast content playback state within milliseconds according to the output control commands, and automatically restore the original external multimedia signal playback state after the emergency broadcast ends.

[0113] The above description represents the preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast screens, characterized in that, The method includes: Step 1: Receive emergency broadcast signals from the superior emergency broadcast platform and at least one external multimedia input signal; Step 2: Perform preprocessing and buffering on emergency broadcast signals and external multimedia input signals based on a divide-and-conquer strategy. The divide-and-conquer strategy decomposes each input signal into an independent signal processing subtask, performs decoding and buffering operations on each subtask in parallel, and assigns the highest priority to the emergency broadcast signal. Step 3: Monitor emergency broadcast signals in real time. When an emergency broadcast signal is detected, prioritize scheduling the emergency broadcast signal based on the preset task scheduling strategy. At the same time, according to the layout configuration information of the current display terminal, perform multimodal fusion and arrangement of the emergency broadcast content and the external multimedia content being played to obtain the fused content. Step 4: Based on the arranged and integrated content, generate corresponding output control instructions. Control the display terminal to switch to the emergency broadcast content playback state within milliseconds according to the output control instructions, and automatically restore the original external multimedia signal playback state after the emergency broadcast ends.

2. The millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast screens according to claim 1, characterized in that, Step 1: Receive emergency broadcast signals from the superior emergency broadcast platform and at least one external multimedia input signal, including: Step 11: Receive IP streaming media signals from the upper-level emergency broadcasting platform through the RJ45 network interface, and parse the IP streaming media signals to determine that the encapsulation format is one of RTSP, RTMP and HLS, while extracting the emergency broadcast content data stream within the encapsulation. Step 12: Based on the emergency broadcast content data stream, if the image data is incomplete, receive the high-definition video signal from the external multimedia playback device through at least one HDMI interface, and decode the high-definition video signal into auxiliary video data that matches the resolution of the emergency broadcast content data stream; Step 13: Based on the emergency broadcast content data stream and auxiliary video data, if there is still a lack of graphic and textual information, receive media content from the local storage device via the USB interface, parse and render the media content, and generate an overlayable graphic and textual information layer as a supplement and fusion signal source for the audiovisual content obtained in the first two steps.

3. The millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast screens according to claim 2, characterized in that, Step 2 involves preprocessing and buffering the emergency broadcast signal and external multimedia input signal using a divide-and-conquer strategy. This strategy decomposes each input signal into independent signal processing subtasks, performs decoding and buffering operations on each subtask in parallel, and assigns the highest priority to the emergency broadcast signal, including: Step 21: Decompose the type of each input signal into an independent media decoding subtask and a data parsing subtask; Step 22: The media decoding subtask and the data parsing subtask are assigned to different cores of the embedded processor to perform decoding and parsing operations in parallel to obtain the decoded emergency broadcast content data. The decoding subtask of the emergency broadcast signal is assigned to a dedicated processing core and configured to real-time scheduling mode. Step 23: Store the decoded emergency broadcast content data into a separate priority buffer queue, store the decoded data of the external multimedia input signal into a regular buffer queue, and mark the emergency broadcast content data in the priority buffer queue with the highest priority tag.

4. The millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast screens according to claim 3, characterized in that, Step 21 includes: Step 211: Process the IP streaming media signal received through the RJ45 network interface, and break it down into independent network protocol parsing subtasks and media stream decoding subtasks according to the network protocol format. The network protocol parsing subtask is used to extract valid media data packets from RTSP, RTMP, and HLS protocol streams, while the media stream decoding subtask decodes the extracted data packets to obtain the first channel of decoded media data. Step 212: Based on the obtained first-channel decoded media data, the high-definition video signal received through at least one HDMI interface is processed and decomposed into independent HDMI protocol parsing subtasks and video frame decoding subtasks according to the interface protocol characteristics. The video frame decoding subtask performs color space conversion and resolution adaptation processing on the separated original video frames to obtain the second-channel decoded media data. Step 213: Based on the obtained decoded media data, process the local storage media content received through the USB interface. Decompose the media content into independent file reading subtasks and content format parsing subtasks according to file storage characteristics. The file reading subtask is used to read media files in the USB storage device. The content format parsing subtask decodes and renders the read JPG, PNG, BMP image files, TXT, and XML text files to generate the third channel of decoded media data. By completing the independent subtask decomposition of all input signals, media decoding subtasks and data parsing subtasks corresponding to each channel of decoded media data are formed.

5. The millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast screens according to claim 4, characterized in that, Step 22 includes: Step 221: Based on the various subtasks obtained from the decomposition, the network protocol parsing subtask, the HDMI protocol parsing subtask, and the file reading subtask are assigned to the first core group of the embedded processor for parallel execution. By executing the subtasks, the original data packets, original video frame data, and media file data are extracted from the network stream, the HDMI signal stream, and the local file, respectively, and the extracted original data are uniformly stored in the shared memory buffer. Step 222: Based on the various raw data in the shared memory buffer, the media stream decoding subtask, video frame decoding subtask, and content format parsing subtask are allocated to the second core group of the embedded processor for parallel execution; among them, to ensure the real-time performance of emergency broadcast processing, the media stream decoding subtask corresponding to the emergency broadcast signal is fixedly allocated to the dedicated core with the highest clock frequency in the second core group, and a real-time scheduling strategy that can preempt other subtasks is configured for the dedicated core, thereby forming a priority task execution environment for emergency broadcast; Step 223: Based on the priority task execution environment, the dedicated core reads the original data corresponding to the emergency broadcast signal from the shared memory buffer and performs media stream decoding to generate structured emergency broadcast content data containing video frame sequences, image layers and text rendering data.

6. The millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast screens according to claim 5, characterized in that, Step 3 includes: Step 31: Poll the priority cache queue in real time. When emergency broadcast content data with the highest priority tag is detected in the priority cache queue, it is determined that an emergency broadcast signal has been triggered. Step 32: In response to the emergency broadcast signal, based on the preset task scheduling strategy, immediately interrupt the currently executing external multimedia content playback task, and save the on-site status information of the external multimedia content playback task to the designated status temporary storage area. Step 33: parse the emergency broadcast content data in the priority cache queue and break it down into independent video element units, image element units, and text element units; Step 34: Based on the external multimedia content currently playing, obtained from the state buffer area, it is also divided into corresponding background video units and background graphic units. Step 35: Based on the preset current display terminal layout configuration information, call the corresponding split-screen fusion template. The split-screen fusion template defines the area coordinates, stacking order and transparency of the video layer, image layer and text layer. Step 36: The video element units, image element units, and text element units of the emergency broadcast, along with the background video unit and background graphic unit, are taken as input. Parallel layout calculation and pixel-level fusion are performed according to the rules defined in the split-screen fusion template to generate a fused screen that contains emergency information and background information and conforms to the target layout, thus obtaining the arranged fused content.

7. The millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast screens according to claim 6, characterized in that, Step 36 includes: Step 361: Based on the coordinates of each layer area defined in the called split-screen fusion template, the fused screen to be generated is divided into independent rendering blocks corresponding to each layer, and each rendering block is defined as an independent pixel calculation task. Step 362: Based on each independent rendering block, the emergency broadcast video element unit, image element unit, and text element unit are distributed to the corresponding video rendering task, image rendering task, and text rendering task, respectively; at the same time, the background video unit and background graphic unit are distributed to the corresponding background rendering task. Step 363: Based on the assigned rendering tasks, each rendering task is executed in parallel. In each rendering task, the received element units are rendered at the pixel level according to the stacking order and transparency defined for the layers by the split-screen fusion template, generating independent layer images corresponding to each rendering block. Step 364: Based on the images of each independent layer, and in accordance with the overlay order defined by the split-screen fusion template, the images of each layer are sequentially overlaid and synthesized. During the overlay process, pixel mixing calculations are performed based on the transparency defined by each layer to obtain the final fused image, which serves as the fused content after editing.

8. The millisecond-level forced insertion intelligent adaptation method for multimodal emergency broadcast screens according to claim 7, characterized in that, Step 4: Based on the arranged and integrated content, generate corresponding output control commands. Using these commands, control the display terminal to switch to emergency broadcast content playback mode within milliseconds. After the emergency broadcast ends, automatically restore the original external multimedia signal playback mode, including: Step 41: Encode the final merged image into high-definition video frame data that conforms to the HDMI 2.0 protocol standard; Step 42: Generate an output control instruction set containing a synchronization clock, data enable signal, and pixel data based on the high-definition video frame data; Step 43: Send the electrical signal corresponding to the output control command set to the connected display terminal through at least one HDMI output interface, and control the display terminal to switch to playing the merged screen within a delay of no more than 300 milliseconds and enter the emergency broadcast content playback state; Step 44: During the playback of the emergency broadcast content, continuously monitor the playback status of the emergency broadcast content. When the playback of the emergency broadcast content is detected to be completed or a playback end instruction is received from the superior platform, it is determined that the emergency broadcast playback has ended. Step 45: In response to the determination that the emergency broadcast has ended, read the on-site status information from the status temporary storage area and generate a recovery control command based on the on-site status information; Step 46: Execute the recovery control command to control the display terminal to switch back to the original external multimedia signal source specified by the on-site status information and restore the interrupted playback state, thus completing the automatic recovery.

9. A millisecond-level forced insertion intelligent adaptation system for a multimodal emergency broadcast screen, wherein the system implements the method as described in any one of claims 1 to 8, characterized in that, include: The acquisition module is used to receive emergency broadcast signals from the superior emergency broadcast platform and at least one external multimedia input signal; The decomposition module is used to preprocess and buffer the emergency broadcast signal and the external multimedia input signal respectively based on the divide-and-conquer strategy. The divide-and-conquer strategy decomposes each input signal into an independent signal processing subtask, performs decoding and buffering operations on each subtask in parallel, and assigns the highest priority to the emergency broadcast signal. The fusion module is used to monitor emergency broadcast signals in real time. When an emergency broadcast signal is detected, it prioritizes the scheduling of the emergency broadcast signal based on a preset task scheduling strategy. At the same time, according to the layout configuration information of the current display terminal, it performs multimodal fusion and arrangement of the emergency broadcast content with the external multimedia content that is being played to obtain the fused content. The processing module is used to generate corresponding output control commands based on the synced content, and control the display terminal to switch to the emergency broadcast content playback state within milliseconds according to the output control commands, and automatically restore the original external multimedia signal playback state after the emergency broadcast ends.

Images