Multimedia task scheduling method based on table look-up method
Through the multimedia task scheduling method based on the table lookup method, the codec resource allocation is automatically performed according to the conference layout, solving the problems of low efficiency and resource waste in the existing technology, and achieving efficient and flexible resource utilization.
Patent Information
- Application Number
- CN202411531553.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-30
- Publication Date
- 2025-02-07
- Estimated Expiration
- 2044-10-30
AI Technical Summary
The existing multimedia task scheduling methods are inefficient and rely on manual allocation, making it difficult to efficiently schedule in complex scenarios, resulting in waste of resources and degradation of system performance.
Using the multimedia task scheduling method based on the table lookup method, the codec resource allocation is automatically performed according to the conference layout by querying multiple tables (layout ID table, chip combination table, chip codec path number table, chip decoding output layout table) and dynamically adjusting it Resource configuration.
Automatic scheduling without manual intervention is realized, resource allocation efficiency is improved, resource waste is reduced, and resource utilization is ensured. Each codec chip is fully utilized, and system performance and flexibility are improved.
Smart Images

Figure CN119402617A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of multimedia processing technology, and in particular to a multimedia task scheduling method based on a table lookup method. Background Art
[0002] Multimedia task scheduling refers to the process of effectively allocating and managing audio, video, and data streams in multimedia systems. With the rapid development of network technology and multimedia applications, users' demand for high-quality real-time audio and video communications is growing. The core goal of multimedia task scheduling is to ensure the real-time transmission and processing of multimedia data by reasonably allocating system resources. The design of scheduling algorithms not only involves the priority sorting of tasks, but also needs to consider multiple factors such as network bandwidth, latency, and load balancing to ensure smooth playback and efficient transmission of multimedia content.
[0003] The current multimedia task scheduling method mainly relies on manual allocation, and the system administrator manually allocates multimedia tasks to different codec boards and processing units for resource scheduling. The inventors realize that this method can meet the basic task scheduling needs in simple scenarios, but it takes a lot of time and effort in complex scenarios, and manual allocation is particularly inefficient. In addition, manual allocation depends on the experience and judgment of the system administrator, which is often affected by subjective factors and fails to make full use of available codec resources, causing some codecs to be idle, affecting the overall system performance, and it is difficult to ensure that it can adapt to different user needs and conference layouts, and the flexibility is poor. Summary of the invention
[0004] The present application provides a multimedia task scheduling method based on a table lookup method, aiming to solve the technical problem of low efficiency of existing multimedia task scheduling methods.
[0005] A multimedia task scheduling method based on table lookup method is applied to a multimedia board scheduling system, wherein the multimedia board scheduling system includes a media board, the media board includes a plurality of codec chips, each of which is connected to an HDMI matrix and a switch; the method includes:
[0006] S1, the media board receives the conference information sent by the signaling board, analyzes and obtains the group layout of the target conference, and then queries the chip combination table corresponding to the layout according to the group layout of the target conference, finds all the codec chip combinations that can meet the target conference, and queries the chip combination table to determine the corresponding codec chip combination scheme for each codec chip combination;
[0007] S2, according to the codec status of each codec chip of each codec chip combination given in the chip codec path table, traverse all codec chips, check the remaining codec capacity and HDMI resource usage of each codec chip, and determine the codec chip combination with the highest cost performance;
[0008] S3, according to the output layout of each codec chip given in the chip decoding output layout table, sends instructions to the codec chip responsible for decoding in the codec chip combination with the highest cost performance, informing it of the video stream to be decoded and the corresponding output layout, and sends instructions to the codec chip responsible for encoding, informing it of the encoding style and the pattern collected from the HDMI matrix.
[0009] In the above solution, optionally, before step S1, the method further includes:
[0010] List all group meeting layouts and establish a layout ID table; the layout ID table records the layout ID corresponding to each group meeting layout and the corresponding number of split screens for the game;
[0011] According to different codec chip combinations, a chip combination table is established, wherein the chip combination table records the chip combination ID corresponding to each codec chip combination and the corresponding codec chip combination scheme;
[0012] According to the parameters of each group layout in the layout ID table, determine all codec chip combinations that can meet each group layout from the chip combination table, and establish a layout corresponding chip combination matching table;
[0013] Establishing a chip codec path table, wherein the chip codec path table records the codec status of each codec chip in charge of each group layout corresponding to each codec chip combination;
[0014] A chip decoding output layout table is established, wherein the chip decoding output layout table records the output layout of each codec chip corresponding to each codec chip combination for each group layout.
[0015] In the above solution, further optionally, step S1 further includes:
[0016] According to the group meeting layout of the target conference, the layout ID table is queried, and the correctness is checked according to the corresponding number of split screens for the game.
[0017] In the above scheme, optionally, the multiple codec chips include multiple high-performance codec chips and multiple standard codec chips, the high-performance codec chips can decode 8-channel 4K video streams, and the standard codec chips can decode 2-channel 4K video streams.
[0018] In the above scheme, further optionally, the media board is provided with a high-performance chip position and a standard chip position, and the high-performance chip position and the standard chip position are both provided with multiple slots; the multiple high-performance codec chips are respectively inserted into the multiple slots of the high-performance chip position, and the multiple standard codec chips are respectively inserted into the multiple slots of the standard chip position.
[0019] In the above scheme, further optionally, one of the high-performance codec chips is used as the main processor to execute steps S1-S3; the slot of the main processor is fixed, and other high-performance codec chips are arbitrarily inserted into the remaining slots of the high-performance chip area; the multiple standard codec chips are arbitrarily inserted into multiple slots of the standard chip area.
[0020] In the above solution, further optionally, each codec chip can read the slot number of the slot where it is located through the GPIO interface; after power-on, each codec chip configures its own intra-domain IP address according to the slot number of the slot where it is located.
[0021] In the above solution, further optionally, a TCP short link is used between the main processor and other codec chips.
[0022] In the above scheme, optionally, there are 13 codec chips in total; the HDMI matrix has 64 inputs and 26 outputs; the conference information includes participating terminals, media transceiver ports of the terminals, media stream related information and group meeting layout.
[0023] In the above solution, optionally, in the layout corresponding to the chipset group matching table, all codec chip combinations corresponding to each group layout are arranged from high to low according to the cost performance.
[0024] Compared with the prior art, this application has at least the following beneficial effects:
[0025] In the multimedia task scheduling method provided in the embodiment of the present application, after receiving the conference information, according to the group layout of the target conference, by querying the layout corresponding to the chipset matching table, the chip combination table, the chip codec path table, and the chip decoding output layout table, it is possible to automatically perform table lookup scheduling according to the actual conference layout of the target conference without relying on manual work, and dynamically allocate codec resources, thereby improving resource allocation efficiency; the media board can receive the conference information from the signaling board in real time, and quickly analyze the group layout of the target conference. This dynamic response mechanism enables the system to adjust resource configuration according to actual needs, rather than relying on fixed preset configurations, thereby reducing Waste of resources; relying on the table lookup method, the system can quickly find all codec chip combinations that meet the needs of the target meeting. This process greatly reduces the time for manual configuration and debugging and improves scheduling efficiency; based on the chip combination obtained by the query, the system can clarify the role and task of each codec chip to ensure that each chip can be fully utilized; when selecting a codec chip, the system will traverse the remaining codec capabilities and HDMI resource usage of all chips. This comprehensive resource evaluation can ensure that the system selects the most cost-effective chip combination, ensure that the selected combination can maximize the use of existing resources, make full and reasonable use of resources, and improve resource utilization efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1 A schematic diagram of an application environment of a multimedia task scheduling method based on a table lookup method provided by an embodiment of the present application;
[0027] Figure 2 A flowchart of a multimedia task scheduling method based on table lookup is provided for one embodiment of the present application. DETAILED DESCRIPTION
[0028] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0029] In the description of the present application: unless otherwise specified, expressions such as “include”, “comprising”, “having”, etc. also mean “not limited to” (certain units, components, materials, steps, etc.).
[0030] In one embodiment, a multimedia task scheduling method based on table lookup is provided, and the method is applied to a multimedia board scheduling system, such as Figure 1 As shown, the multimedia board scheduling system includes a media board 1, the media board 1 includes a plurality of codec chips 11, each codec chip 11 is connected to an HDMI matrix 2 and a switch 3; Figure 2As shown, the method comprises the following steps:
[0031] S1, the media board receives the conference information sent by the signaling board, analyzes and obtains the group layout of the target conference, and then queries the chip combination table corresponding to the layout according to the group layout of the target conference, finds all the codec chip combinations that can meet the target conference, and queries the chip combination table to determine the corresponding codec chip combination scheme for each codec chip combination;
[0032] S2, according to the codec status of each codec chip of each codec chip combination given in the chip codec path table, traverse all codec chips, check the remaining codec capacity and HDMI resource usage of each codec chip, and determine the codec chip combination with the highest cost performance;
[0033] S3, according to the output layout of each codec chip given in the chip decoding output layout table, sends instructions to the codec chip responsible for decoding in the codec chip combination with the highest cost performance, informing it of the video stream to be decoded and the corresponding output layout, and sends instructions to the codec chip responsible for encoding, informing it of the encoding style and the pattern collected from the HDMI matrix.
[0034] Among them, the conference information includes the participating terminals, the media transceiver ports of the terminals, the media stream related information and the group conference layout. The media stream related information is the relevant format of the conference, including resolution, bandwidth, frame rate, protocol, etc. The signaling board (mainly used to send the relevant parameters of the group conference, including adding conference terminal members, the layout mode of the conference, and the relevant format of the conference (resolution, bandwidth, frame rate, etc.).
[0035] A group conference layout refers to different visual presentation modes or split-screen configurations in a video conference. This layout determines how the media streams of participants are arranged and displayed on the display device so that participants can clearly see each member or content in the conference.
[0036] Furthermore, before step S1, the method further includes:
[0037] List all group meeting layouts and create a layout ID table; the layout ID table records the layout ID corresponding to each group meeting layout and the corresponding number of split screens for the game;
[0038] According to different codec chip combinations, a chip combination table is established, in which the chip combination ID corresponding to each codec chip combination and the corresponding codec chip combination scheme are recorded;
[0039] According to the parameters of each group layout in the layout ID table, determine all codec chip combinations that can meet each group layout from the chip combination table, and establish a layout corresponding chip combination matching table;
[0040] Establishing a chip codec path table, wherein the chip codec path table records the codec status of each codec chip in charge of each group layout corresponding to each codec chip combination;
[0041] A chip decoding output layout table is established, wherein the chip decoding output layout table records the output layout of each codec chip corresponding to each codec chip combination for each group layout.
[0042] Among them, in the layout corresponding to the chipset matching table, each group will arrange all the corresponding codec chip combinations from high to low according to the cost performance.
[0043] In other words, the process of building each table is as follows:
[0044] 1: List all group layouts, form a layout ID table, and return the corresponding game split screen number according to the ID. (Table 1)
[0045] The layout ID table can be found in Table 1 below. The left side of the curly brackets is the layout ID, and the number on the right is the number of split screens. When looking up the table, you can find the corresponding number of split screens based on the layout ID.
[0046] Table 1 Layout ID table
[0047]
[0048]
[0049] 2: According to different board chip combinations, a chip combination table is formed. (Table 2)
[0050] Table 2 below is the chip combination ID, indicating all chip combinations. For example, {0,0,1,cp_31} indicates a chip combination with ID number 0, which has 0 high-performance codec chips and 1 standard codec chip. The encoding is completed by the standard codec chip.
[0051] Table 2 Chip combination table
[0052]
[0053]
[0054] 3: Find all the board chip combinations that meet each layout according to the layout style, the number of members involved in the layout, and the resolution; among all the combinations that meet the same layout, form a layout ID and layout combination mapping table from high to low in terms of cost performance. Each layout can have n chip combinations, and each combination can meet the layout, which is the layout corresponding to the chipset matching table shown in Table 3 below. (Table 3)
[0055] Table 3 below shows which chip combinations can be completed for a layout ID, and each combination ID is a chip combination in Table 2. For example, the fourth type in Table 3, {4, {3, 6, 2, 4}}, means that when completing a conference with layout ID 4, there can be 4 chip combinations of 3, 6, 2, and 4, among which 3 has the highest cost performance. These 3, 6, 2, and 4 correspond to the chip combinations in Table 2.
[0056] Table 3 Layout corresponding chipset suitable matching table
[0057]
[0058]
[0059] 4: Based on the n chip combinations of each layout, a chip codec table is formed. The content in the table is the codec status of each board in each chip combination, including how many code streams each board needs to decode and whether encoding is required. (Table 4)
[0060] The chip codec number table shown in Table 4 below is the optional codec situation of the chip combination after the chip combination is determined in the previous step. For example, the 13th subscript {13, {{2, {{5}}}, {4, {{5}, {4, 1}}}}} in Table 4 indicates that when the layout ID is 13, the chip combination 2 or 4 can be selected. When the chip combination 4 is selected, there are two codec schemes, namely, one standard codec chip decodes 5 channels and the other encodes, or one standard codec chip decodes 4 channels and the other decodes 1 channel.
[0061] Table 4 Chip encoding and decoding path table
[0062]
[0063]
[0064]
[0065] 5: According to the codec table, the codec paths of the combined chip are determined, but the chip does not know the layout style that needs to be synthesized and output after decoding. Therefore, another table is built to determine the output layout of each chip (HDMI output, used for the encoding chip to collect HDMI input) when the chip combination and the codec of each chip are determined. (Table 5)
[0066] The chip decoding output layout table shown in Table 5 below is based on Table 4, and the decoding content of each chip is synthesized and output. The output layout format is the query style of Table 5.
[0067] Table 5 Chip decoding output layout table
[0068]
[0069]
[0070] Furthermore, step S1 further includes:
[0071] According to the group meeting layout of the target conference, the layout ID table is queried, and the correctness is checked according to the corresponding number of split screens for the game.
[0072] In other words, to implement this table lookup method, at least five tables are needed, namely, the layout ID table (Table 1), the chip combination table (Table 2), the layout corresponding chipset matching table (Table 3), the chip combination decoding path table (Table 4), and the chip decoding output layout table (Table 5).
[0073] Based on these five tables, once the conference layout and the parameters of the participating terminals are determined, you can look up the table based on the current usage of the media board to find the best solution to meet the meeting.
[0074] Scheduling logic:
[0075] 1: After the media board receives conference-related signaling, it first analyzes the following points:
[0076] a: Participants, i.e. terminals (video conference terminals, which send media streams to the media scheduling board and receive the synthesized code streams sent by the media board), as well as the media transceiver ports of each terminal and media stream related information (resolution, protocol, etc.);
[0077] b: conference layout mode, conference ID;
[0078] 2: According to the above statistical information, terminal members are added to the conference. After joining the conference, these terminals will send video streams to the media board and receive the streams synthesized by the media board.
[0079] 3: According to the conference layout mode (layout ID), first query the layout mode conversion table (Table 1), that is, find the number of split screens according to the layout mode. Then do a correctness check based on the number of split screens.
[0080] 4: Then query the best chip combination table (Table 3) according to the layout ID. Each layout ID will correspond to the minimum 4 chip combinations. Each combination is a combination ID. The chip combination used by the combination ID can be found through the ID chip mapping table (Table 2), including how many high-performance chips (high-performance codec chips) and how many low-performance chips (standard codec chips) are used.
[0081] 5: According to the combination given in Table 4, traverse all boards, check the remaining encoding and decoding capabilities and HDMI resource usage of each board, and find a combination with the best cost performance.
[0082] 6: Then, according to the chip combination, there is another mapping table (Table 5). According to the decoding status of each board, TCP signaling is sent to inform the corresponding board of the code stream that needs to be decoded and the layout style that needs to be output on HDMI.
[0083] At the same time, inform the board that needs to be encoded, the style that needs to be encoded, and the image style collected from HDMI, and finally complete the encoding after cropping, decoding and synthesis.
[0084] After the conference parameters are sent, the main scheduling board schedules the media resources according to the table lookup method.
[0085] Furthermore, in the multimedia board scheduling system, the plurality of codec chips include a plurality of high-performance codec chips and a plurality of standard codec chips.
[0086] Among them, there are 13 codec chips in total; 13 boards (5 high-performance codec chips plus 8 standard codec chips) constitute the media board. The high-performance codec chip, as a high-performance board, can decode 8-channel 4k video streams, and the standard codec chip can decode 2-channel 4K video streams.
[0087] Furthermore, the media board is provided with a high-performance chip area and a standard chip area, and both the high-performance chip area and the standard chip area are provided with multiple slots; multiple high-performance codec chips are respectively inserted into the multiple slots of the high-performance chip area, and multiple standard codec chips are respectively inserted into the multiple slots of the standard chip area.
[0088] One of the high-performance codec chips is used as the main processor to execute steps S1-S3; the slot of the main processor is fixed, and other high-performance codec chips are arbitrarily inserted into the remaining slots of the high-performance chip area; multiple standard codec chips are arbitrarily inserted into multiple slots of the standard chip area.
[0089] Each codec chip can read the slot number of its slot through the GPIO interface; after power-on, each codec chip configures its own intra-domain IP address according to the slot number of its slot. TCP short links are used between the main processor and other codec chips.
[0090] In other words, the first high-performance codec chip is used as the main CPU, connected to the switch through eth0, eth1 is used as the control port and network transceiver port, and there are 3 other network ports (all eth1) that are also led out to the panel and can be used as out-of-band monitoring ports. There is also an HDMI matrix that simultaneously connects to the HDMI output and input of 13 boards, with 64 inputs (8x8) and 2x13 outputs, for a total of 26 channels, which are controlled by the main CPU or others (a total of 4 boards) through i2c, and the control source can be switched.
[0091] That is to say, in the multimedia card scheduling system provided in the embodiment of the present application, each card can read its own slot number (1-13) through Gpio, the main CPU slot number is fixed, the high-performance codec chip and the standard codec chip are fixed in position and cannot be mixed. The cards in the position can be inserted into various positions at will.
[0092] After power-on, each board configures its own intra-domain IP address according to its slot number, which is more flexible and reliable, can avoid IP conflicts, and facilitate interaction with the main CPU. TCP short links are used between the main CPU and the slave media board to reduce repeated heartbeats between each other. There are three interfaces with the MCU signaling board: 1: merge 2: add_input 3: remove_input.
[0093] The scheduling algorithm involved in the multimedia board scheduling system includes: counting all layout styles, and then determining how to complete each style (chip combination). For the same layout style, there can be n chip combinations, and each combination can meet the layout plan. Arrange from high to low cost performance, select several, and form a combination table. When the synthesis style is sent from the signaling board to the media board, first query the combination according to the table lookup method, and then see if the current resources can meet the combination: (1) If it can be met, cut the layout style into several pieces according to the current chip combination, distribute each terminal code stream participating in the layout to the selected combination chip, and select the chip that needs to complete the encoding (each combination will have an optimal chip as the main editing chip, specified in the table); (2) If it cannot be met, continue to select the suboptimal combination until a satisfactory combination is found and repeat step (1). After deciding on the main editing chip, configure the HDMI matrix through the I2C interface and switch the required HDMI input to the main editing chip.
[0094] In summary, the embodiment of the present application provides an algorithm system for multimedia board scheduling based on the table lookup method. The system uses multiple embedded codec boards to complete the media scheduling algorithm in a distributed manner and then sends it to each sub-board to complete the corresponding code stream decoding and synthesis encoding, thereby realizing the encoding and decoding of the media stream.
[0095] The algorithm system for multimedia board scheduling includes embedded codec board, switch chip, HDMI matrix, etc.; the switch chip forms a local area network by cascading embedded decoders; the media board mainly includes media scheduling board and media codec board, etc., which are interconnected through the network and HDMI matrix; HDMI matrix is used to output the media stream transmitted by the embedded distributed decoder and access the corresponding media board.
[0096] The beneficial effects of this application include:
[0097] 1) This card-type media scheduling system has rich encoding and decoding resources, which can meet the needs of more than 60 channels of 4K resolution decoding and more than 20 channels of encoding, and can meet the needs of dozens of high-resolution conferences online at the same time;
[0098] 2) The card-type media scheduling system is flexible to use and can be equipped with different cards according to different user needs;
[0099] 3) The table lookup scheduling algorithm can automatically perform table lookup scheduling according to the conference layout type, fully utilize the resources of each board, and achieve full and reasonable utilization of resources; the advantage of the scheduling method provided in this application is that the algorithm is flexible and can make full use of encoding and decoding resources.
[0100] It should be understood that although Figure 2 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 2 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.
[0101] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, which involves all or part of the processes in the above-mentioned embodiment method.
[0102] In one embodiment, a computer program product is also provided, including a computer program / instruction, which implements all or part of the process in the above-mentioned embodiment method when executed by a processor.
[0103] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
Claims
1. A multimedia task scheduling method based on table lookup method, characterized in that: Applied to a multimedia board scheduling system, the multimedia board scheduling system includes a media board, the media board includes a plurality of codec chips, each codec chip is connected to an HDMI matrix and a switch; the method includes: S1, the media board receives the conference information sent by the signaling board, analyzes and obtains the group layout of the target conference, and then queries the chip combination table corresponding to the layout according to the group layout of the target conference, finds all the codec chip combinations that can meet the target conference, and queries the chip combination table to determine the corresponding codec chip combination scheme for each codec chip combination; S2, according to the codec status of each codec chip of each codec chip combination given in the chip codec path table, traverse all codec chips, check the remaining codec capacity and HDMI resource usage of each codec chip, and determine the codec chip combination with the highest cost performance; S3, according to the output layout of each codec chip given in the chip decoding output layout table, sends instructions to the codec chip responsible for decoding in the codec chip combination with the highest cost performance, informing it of the video stream to be decoded and the corresponding output layout, and sends instructions to the codec chip responsible for encoding, informing it of the encoding style and the pattern collected from the HDMI matrix.
2. The multimedia task scheduling method based on table lookup method according to claim 1 is characterized in that: Before step S1, the method further includes: List all group meeting layouts and establish a layout ID table; the layout ID table records the layout ID corresponding to each group meeting layout and the corresponding number of split screens for the game; According to different codec chip combinations, a chip combination table is established, wherein the chip combination table records the chip combination ID corresponding to each codec chip combination and the corresponding codec chip combination scheme; According to the parameters of each group layout in the layout ID table, determine all codec chip combinations that can meet each group layout from the chip combination table, and establish a layout corresponding chip combination matching table; Establishing a chip codec path table, wherein the chip codec path table records the codec status of each codec chip in charge of each group layout corresponding to each codec chip combination; A chip decoding output layout table is established, wherein the chip decoding output layout table records the output layout of each codec chip corresponding to each codec chip combination for each group layout.
3. The multimedia task scheduling method based on table lookup method according to claim 2 is characterized in that: Step S1 also includes: According to the group meeting layout of the target conference, the layout ID table is queried, and the correctness is checked according to the corresponding number of split screens for the game.
4. The multimedia task scheduling method based on table lookup method according to claim 1 is characterized in that: The multiple codec chips include multiple high-performance codec chips and multiple standard codec chips. The high-performance codec chips can decode 8-channel 4K video streams, and the standard codec chips can decode 2-channel 4K video streams.
5. The multimedia task scheduling method based on table lookup method according to claim 4 is characterized in that: The media board is provided with a high-performance chip position and a standard chip position, and the high-performance chip position and the standard chip position are both provided with a plurality of slots; the plurality of high-performance codec chips are respectively inserted into the plurality of slots of the high-performance chip position, and the plurality of standard codec chips are respectively inserted into the plurality of slots of the standard chip position.
6. The multimedia task scheduling method based on table lookup method according to claim 5 is characterized in that: One of the high-performance codec chips is used as a main processor to execute steps S1-S3; the slot of the main processor is fixed, and other high-performance codec chips are arbitrarily inserted into the remaining slots of the high-performance chip area; the multiple standard codec chips are arbitrarily inserted into multiple slots of the standard chip area.
7. The multimedia task scheduling method based on table lookup method according to claim 5 is characterized in that: Each codec chip can read the slot number of the slot where it is located through the GPIO interface; after power-on, each codec chip configures its own intra-domain IP address according to the slot number of the slot where it is located.
8. The multimedia task scheduling method based on table lookup method according to claim 6 is characterized in that: The main processor and other codec chips use a TCP short link.
9. The multimedia task scheduling method based on table lookup method according to claim 1, characterized in that: There are 13 codec chips in total; the HDMI matrix has 64 inputs and 26 outputs; the conference information includes participating terminals, media transceiver ports of the terminals, media stream related information and group conference layout.
10. The multimedia task scheduling method based on table lookup method according to claim 1, characterized in that: In the layout corresponding to the chipset matching table, all codec chip combinations corresponding to each layout are arranged from high to low according to the cost performance.
Citation Information
Patent Citations
Heterogeneous hardware multi-board card fusion resource scheduling system
CN117749732A
Source scheduling method for implementing image processing in conference telephone system
CN1913621A
Method and apparatus for multipoint conferencing
US7627629B1
Media service orchestration method and apparatus, and media server and storage medium
WO2023241693A1
Coding and decoding resource allocation method and apparatus, and electronic device
WO2023246946A1
Cited By
Tensor processor system based on three-layer heterogeneous architecture and data processing method thereof
CN121524125A
Tensor processor system based on three-layer heterogeneous architecture and data processing method thereof
CN121524125B