Audio and video session data processing method and system based on 5G

Abstract

The embodiment of the invention provides a 5G-based audio and video session data processing method and system, and aims to accurately match a session processing model in a target session processing system by obtaining 5G audio and video data stream segments and related session positioning information and stream transmission feature information thereof. Furthermore, by analyzing audio and video data streams in real time, identifying focus session content data and dynamically deploying processing resources according to the priority of the focus session content data, quick identification and response to key information are achieved, and the method aims at providing a more efficient and accurate audio and video data processing scheme for the power industry and improving the power quality of the power industry. And the safety and the operation efficiency of the power system are improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of power operation and maintenance platforms. Specifically, the present application relates to a method and system for processing audio and video session data based on 5G. Background Art

[0002] In the power industry, the demand for processing audio and video data streams is increasing day by day. Especially in scenarios such as power grid monitoring, fault troubleshooting, and remote dispatching, efficient audio and video data processing capabilities are particularly important. Traditional methods for processing audio and video data are often limited by network transmission speed and data processing capabilities, and often cannot meet the high requirements of the power industry for real-time performance and accuracy. With the rapid development and popularization of 5G technology, its characteristics of high speed and low latency bring new possibilities to the power industry.

[0003] However, the power industry still faces some challenges in audio and video data processing. On the one hand, due to the complexity and diversity of audio and video data streams, how to accurately identify and locate key information, such as equipment failures and abnormal situations, is an urgent problem to be solved. On the other hand, traditional solutions often cannot perform flexible resource allocation, resulting in key information that may not be processed in a timely manner.

[0004] In power scenarios, the processing of 5G audio and video data streams requires not only high-efficient network transmission speed but also intelligent data processing methods to extract valuable information from massive audio and video data and make timely responses. Therefore, developing a method for processing 5G audio and video session data that can analyze audio and video data streams in real time, identify key information, and dynamically allocate processing resources according to the priority of information has become an urgent technological innovation in the power industry. Summary of the Invention

[0005] In order to at least overcome the above deficiencies in the prior art, the purpose of the embodiments of the present application is to provide a method and system for processing 5G audio and video session data.

[0006] In a first aspect, the embodiments of the present application provide a method for processing 5G audio and video session data, the method comprising: Obtaining a 5G audio and video data stream segment to be processed; the 5G audio and video data stream segment is used to represent any continuous audio and video data stream obtained during the 5G session transmission; Obtaining session location information and stream transmission feature information of the 5G audio and video data stream segment during the 5G session transmission; the session location information characterizes the transmission node information of the 5G audio and video data stream segment during the 5G session transmission, and the stream transmission feature information characterizes the transmission label information of the 5G audio and video data stream segment during the 5G session transmission; Based on the session location information and the stream transmission feature information, determine the session processing model corresponding to the 5G audio and video data stream segment in the target session processing system; Generate a model loading channel mapped by the session processing model within the session processing process of the target session processing system, and add the 5G audio and video data stream segment to the model loading channel mapped by the session processing model; Perform real-time analysis on the 5G audio and video data stream segments added to the model loading channel, identify each focus session content data, mark the identified focus session content data with priorities according to the session attention degrees of each focus session content data, and dynamically adjust the processing resources for the session processing model to process each focus session content data according to the resource allocation policies corresponding to the priorities of each focus session content data.

[0007] In a possible implementation manner of the first aspect, the determining the session processing model corresponding to the 5G audio and video data stream segment in the target session processing system based on the session location information and the stream transmission feature information includes: Obtain the standard processing parameters constructed for the session processing process; the standard processing parameters represent the standard data processing parameters of any session processing model within the session processing process; Based on the standard processing parameters and the session location information, determine the session processing unit corresponding to the 5G audio and video data stream segment in the target session processing system; Match the session processing unit with the stream transmission feature information to generate a matching result; According to the matching result, determine the session processing model corresponding to the 5G audio and video data stream segment in the target session processing system.

[0008] In a possible implementation manner of the first aspect, the step of matching the session processing unit with the stream transmission feature information to generate a matching result includes: Extract key features from the stream transmission feature information, where the key features include data type, data size, transmission rate, transmission protocol, coding method, etc.; Obtain the feature requirements of the session processing unit, where the feature requirements describe the data types, size ranges, and transmission rates that the session processing unit can effectively process; Compare the key features extracted from the stream transmission feature information with the feature requirements of the session processing unit one by one. During the comparison process, adopt strategies such as similarity calculation, fuzzy matching, or rule-based matching to determine the target features initially matched with the session processing unit among the key features and the matching degrees corresponding to the target features; Set a weight value for each target feature to be compared, and the weight value is used to represent the importance of the target feature; Generate a matching degree score corresponding to each target feature according to the matching degree and weight value corresponding to each target feature, and sum up the matching degree scores of all target features to obtain a comprehensive score, where the comprehensive score represents the matching degree between the streaming transmission feature information and the session processing unit; When the comprehensive score exceeds a preset threshold, it is determined that the session processing unit matches the streaming transmission feature information, otherwise it is determined that the session processing unit does not match the streaming transmission feature information, and a matching result is generated.

[0009] In a possible implementation manner of the first aspect, the step of determining the session processing model corresponding to the 5G audio and video data stream segment in the target session processing system according to the matching result includes: Determine the target session processing unit with the highest comprehensive score according to the matching result; Obtain the session processing model mapped by the target session processing unit as the session processing model corresponding to the 5G audio and video data stream segment in the target session processing system, where each session processing unit is associated with one or more specific session processing models.

[0010] In a possible implementation manner of the first aspect, the determining the session processing unit corresponding to the 5G audio and video data stream segment in the target session processing system based on the standard processing parameters and the session location information includes: According to the initial resource allocation strategy, perform resource initialization processing on the session location information and the standard processing parameters to generate an initial processing resource identifier; According to the termination resource allocation strategy, perform resource termination processing on the session location information and the standard processing parameters to generate a termination processing resource identifier; Based on the initial processing resource identifier and the termination processing resource identifier, determine the session processing unit corresponding to the 5G audio and video data stream segment in the target session processing system; In a possible implementation manner of the first aspect, the step of determining the session processing unit corresponding to the 5G audio and video data stream segment in the target session processing system based on the initial processing resource identifier and the termination processing resource identifier includes: Analyze the initial processing resource identifier and the termination processing resource identifier, and extract the key information contained therein, where the key information includes a time stamp, a resource number, and a path attribute; In the target session processing system, construct a resource mapping table; Using the initial processing resource identifier and the termination processing resource identifier, locate the corresponding session processing unit range in the resource mapping table, where the session processing unit range represents the set of session processing units required to process the 5G audio and video data stream segment; Within the session processing unit range, filter out session processing units that meet the preset conditions, where the preset conditions include the status condition, processing capacity condition, and compatibility condition of the processing unit; If there are multiple session processing units that meet the preset conditions, select the session processing unit with the lowest load rate for processing; In a possible implementation manner of the first aspect, the method further includes: Allocate the filtered session processing unit to the 5G audio and video data stream segment, and after the allocation, perform a confirmation operation to check whether the session processing unit has successfully received and is ready to process the 5G audio and video data stream segment; If an exception occurs during the allocation or processing of the session processing unit, start a backup mechanism, where the backup mechanism includes reallocating processing units, enabling redundant processing units, or switching to an alternative processing path.

[0011] In a possible implementation manner of the first aspect, the session location information includes the time point information of the 5G audio and video data stream segment within the 5G transmission path; the 5G transmission path is used to represent the path attribute information for transmitting the 5G audio and video data stream segment during the 5G session transmission process; The resource initialization process of combining the session location information with the standard processing parameters according to the initial resource allocation strategy to generate an initial processing resource identifier includes: Identify the initial timestamp of the 5G audio and video data stream segment in the 5G transmission path; According to the initial resource allocation rule, map the initial timestamp to the standard processing parameters to obtain an initialized processing resource number; Determine this initialized processing resource number as the initial processing resource identifier.

[0012] In a possible implementation manner of the first aspect, the session location information includes the time point information of the 5G audio and video data stream segment within the 5G transmission path and the transmission duration of the 5G audio and video data stream segment within the 5G transmission path; The resource termination process of combining the session location information with the standard processing parameters according to the termination resource allocation strategy to generate a termination processing resource identifier includes: Record the starting transmission moment of the 5G audio and video data stream segment in the 5G transmission stream and mark it as the starting transmission time point; Detect the complete transmission duration of the 5G audio-video data stream segment and define it as the transmission duration parameter; According to the termination resource allocation rule, perform a synthesis operation on the start transmission time point and the transmission duration parameter; Based on the result of the synthesis operation, combine it with the standard processing parameter to obtain an identification value of the termination processing resource; Determine the identification value of the termination processing resource as the termination processing resource identifier.

[0013] In a possible implementation manner of the first aspect, the session processing model includes a first session processing model and a second session processing model; generating a model loading channel mapped by the session processing model within the session processing process of the target session processing system includes: Generate a first model loading channel mapped by the first session processing model within the session processing process; Generate a second model loading channel mapped by the second session processing model within the session processing process; Output the first model loading channel and the second model loading channel as the model loading channel mapped by the session processing model.

[0014] In a possible implementation manner of the first aspect, the audio-video session timing processed by the first session processing model is earlier than the audio-video session timing processed by the second session processing model; Adding the 5G audio-video data stream segment to the model loading channel mapped by the session processing model includes: Obtain the standard processing parameter constructed for the session processing process; the standard processing parameter represents the standard data processing parameter of any session processing model within the session processing process; According to the initial processing point decision mechanism, calculate the standard processing parameter and the session positioning information to generate the initial processing point of the 5G audio-video data stream segment in the first model loading channel; According to the termination processing point decision mechanism, calculate the standard processing parameter and the session positioning information to generate the termination processing point of the 5G audio-video data stream segment in the second model loading channel; Determine the initial processing point in the first model loading channel to the termination processing point in the second model loading channel as the session processing range of the 5G audio-video data stream segment, and add the 5G audio-video data stream segment to the session processing range.

[0015] In a second aspect, an embodiment of the present application further provides a 5G-based audio and video session data processing system, the 5G-based audio and video session data processing system includes a processor and a machine-readable storage medium, and machine-executable instructions are stored in the machine-readable storage medium, and the machine-executable instructions are loaded and executed by the processor to implement the 5G-based audio and video session data processing method in any possible implementation manner of the first aspect.

[0016] As described above in any aspect, the embodiments of the present application significantly improve the processing efficiency and accuracy of audio and video data streams in the power scenario. By acquiring 5G audio and video data stream segments and their related session location information and stream transmission feature information, the data stream segments can be accurately matched to appropriate session processing models in the target session processing system, which not only optimizes the data processing process but also ensures that the data stream can be processed efficiently and professionally. In the power scenario, especially in key links such as power grid monitoring, fault troubleshooting, and remote command, the present application can achieve real-time analysis of 5G audio and video data stream segments. By identifying the focus session content data and performing priority marking, important session content (such as equipment fault alarms, emergency dispatch instructions, etc.) can be quickly identified and processed preferentially, thus greatly improving the emergency response ability and operation efficiency of the power system. In addition, by dynamically adjusting the processing resources and allocating corresponding processing resources according to the priority of the focus session content data, not only is it ensured that the key session content can be processed in a timely manner, but also the utilization of system resources is optimized and the operation cost is reduced. Therefore, by accurately matching the session processing model, real-time analyzing the audio and video data stream, and dynamically adjusting the processing resources, the professionalism, real-time performance, and efficiency of audio and video data processing are significantly improved, providing a strong guarantee for the safe and stable operation of the power system. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention, and therefore should not be regarded as limiting the scope. For those of ordinary skill in the art, other related drawings can be extracted in combination with these drawings without creative efforts.

[0018] Figure 1 It is a schematic flowchart of the 5G-based audio and video session data processing method provided by the embodiment of the present invention; Figure 2 It is a schematic block diagram of the structure of the 5G-based audio and video session data processing system for implementing the above 5G-based audio and video session data processing method provided by the embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0019] The following description is provided to enable a person of ordinary skill in the art to implement and combine the present invention, and this description is provided in the context of a specific application scenario and its requirements. For a person of ordinary skill in the art, it is obvious that various changes can be made to the disclosed embodiments, and when not departing from the principles and scope of the present invention, the general principles defined in the present invention can be applied to other embodiments and application scenarios. Therefore, the present invention is not limited to the described embodiments, but should be given the broadest scope consistent with the claims.

[0020] Figure 1 FIG. 4 is a schematic flowchart of a 5G-based audio and video session data processing method provided by an embodiment of the present invention. The 5G-based audio and video session data processing method will be introduced in detail below.

[0021] Step S110: Obtain a 5G audio and video data stream segment to be processed. The 5G audio and video data stream segment is used to represent any continuous audio and video data stream obtained during the 5G session transmission.

[0022] Specifically, in the power scenario, the 5G audio and video data stream segment refers to a part of the audio and video data related to the power system transmitted through the 5G network. For example, it can be a real-time video stream or audio stream captured from a smart meter, a surveillance camera, or other power equipment. For instance, assume that a power service platform is using the 5G network to obtain a real-time video stream from a remote substation surveillance camera to monitor the status and security of the equipment. These video streams will be segmented into data stream segments for transmission.

[0023] That is to say, in this embodiment, in the remote monitoring center of the power system, the 5G-based audio and video session data processing system, as a server, receives 5G audio and video data stream segments transmitted in real time through the 5G network from the smart grid site. These 5G audio and video data stream segments are captured by cameras and sensors arranged at key nodes of the power grid and are used to monitor the operating status of the power grid in real time. The server needs to process these 5G audio and video data stream segments to promptly detect abnormal situations in the power grid.

[0024] Step S120: Obtain the session location information and stream transmission feature information of the 5G audio and video data stream segment during the 5G session transmission. The session location information represents the transmission node information of the 5G audio and video data stream segment during the 5G session transmission, and the stream transmission feature information represents the transmission label information of the 5G audio and video data stream segment during the 5G session transmission.

[0025] Specifically, in the power scenario, the session location information refers to the transmission path information of the 5G audio-visual data stream segment from the source to the destination in the 5G network, identifying which power device or system the 5G audio-visual data stream segment is sent from, which network nodes it passes through, and which receiving end it will finally reach. For example, in a smart grid, a 5G audio-visual data stream segment may start from a remote monitoring device, pass through multiple network nodes (such as base stations, data centers, etc.), and finally be transmitted to the control center of the power company. The information of these nodes constitutes the session location information.

[0026] In the power scenario, the stream transmission characteristic information describes the technical characteristics and parameters of the data stream segment during the transmission process, such as data type, encoding method, data rate, etc. For example, assume that the power company is transmitting the data stream collected from smart meters. The stream transmission characteristic information of these data can include the data format (such as XML, JSON, etc.), compression method, transmission rate, etc. These information help the control center correctly parse and process the received data.

[0027] That is, in this embodiment, after the server receives the 5G audio-visual data stream, it starts to extract the session location information and stream transmission characteristic information of these 5G audio-visual data stream segments. The session location information includes the specific time points and transmission paths of the 5G audio-visual data stream segments during the transmission in the 5G network, which helps the server understand the source and transmission process of the 5G audio-visual data stream segments. The stream transmission characteristic information includes the type, size, transmission rate, etc. of the 5G audio-visual data stream segments, and these information are crucial for subsequently selecting an appropriate session processing model.

[0028] Step S130, based on the session location information and the stream transmission characteristic information, determine the session processing model corresponding to the 5G audio-visual data stream segment in the target session processing system.

[0029] Specifically, the session processing model refers to a preset model or algorithm in the target session processing system for processing specific types of 5G audio-visual data stream segments. The session processing model can include a series of operations such as data decoding, data processing, data analysis, etc. to ensure that the audio-visual data stream segment can be correctly parsed, processed, and converted into useful information or instructions. For example, in a power monitoring system, the session processing model can be an algorithm specifically used to identify abnormal situations (such as equipment failures, fires, etc.) in the camera video stream. When the 5G audio-visual data stream segment is transmitted to the monitoring system, this model will analyze it and trigger an alarm when an abnormal situation is detected.

[0030] The target session processing system refers to a system responsible for receiving, processing, and managing 5G audio and video data stream segments. It can be a composite software and hardware platform with powerful data processing and analysis capabilities, capable of efficiently processing data streams according to different session processing models. For example, in the power scenario, the target session processing system can be an intelligent power grid monitoring platform, responsible for receiving 5G audio and video data stream segments from various devices such as smart meters and surveillance cameras, and using the session processing model to perform real-time analysis and management on these data.

[0031] That is, in this embodiment, according to the extracted session location information and stream transmission characteristic information, the server starts to determine which session processing model should be used to process these 5G audio and video data streams. For example, if the 5G audio and video data stream comes from a key power grid monitoring point and the 5G audio and video data stream is large and has a high transmission rate, the server can select a high-performance session processing model to ensure real-time processing of the data. For specific details, please refer to the relevant descriptions in the subsequent embodiments.

[0032] Step S140, generate a model loading channel mapped by the session processing model within the session processing process of the target session processing system, and add the 5G audio and video data stream segment to the model loading channel mapped by the session processing model.

[0033] Specifically, the model loading channel refers to a data transmission and processing path created within the target session processing system for a specific session processing model, responsible for transmitting the 5G audio and video data stream segment from the receiving end to the session processing model and ensuring the integrity and accuracy of the 5G audio and video data stream segment during the transmission process. For example, in a power monitoring system, when a new 5G audio and video data stream segment arrives, the session processing model to be used can be determined according to its session location information and stream transmission characteristic information. Then, a model loading channel is created internally to transmit the 5G audio and video data stream segment from the network interface to the corresponding session processing model for processing.

[0034] Then, when a new 5G audio and video data stream segment arrives at the target session processing system, an appropriate session processing model can be selected according to its session location information and stream transmission characteristic information. Then, a model loading channel is created internally to transmit the 5G audio and video data stream segment to this session processing model for processing, ensuring that the data can be correctly parsed, processed, and converted into useful information or instructions, thereby supporting the real-time monitoring and management requirements of the power system.

[0035] That is to say, after the server determines the session processing model, it starts to generate a model loading channel mapped by the session processing model in its session processing process. This model loading channel is specifically set up to process these 5G audio and video data streams, ensuring that the data streams can be processed by the processing model efficiently and accurately. Subsequently, the server adds these 5G audio and video data stream segments to this model loading channel for subsequent processing.

[0036] Step S150: Perform real-time analysis on the 5G audio and video data stream segments added to the model loading channel, identify each focus session content data, mark the identified focus session content data with priorities according to the session attention degrees of each focus session content data, and dynamically adjust the processing resources for the session processing model to process each focus session content data according to the resource allocation strategies corresponding to the priorities of each focus session content data.

[0037] In this embodiment, after the 5G audio and video data stream segments enter the model loading channel, the server starts to perform real-time analysis on them. For example, through image recognition and data analysis algorithms, the server can identify the key content information in the 5G audio and video data stream segments, such as the operating status and abnormal conditions of power grid equipment. These information are regarded as focus session content data, and the server can mark priorities according to the session attention degrees (i.e., importance) of the focus session content data. For example, if the server identifies a serious equipment failure, it will mark a high priority for this failure information.

[0038] Next, the server will dynamically adjust the processing resources according to the priorities of these focus session content data. For high-priority data, the server will allocate more processing resources to ensure its timely and accurate processing. In this way, when a failure or abnormal condition occurs in the power grid, the server can respond quickly to ensure the stable operation of the power system.

[0039] Specifically, after the 5G audio and video data stream segments are added to the model loading channel, the server will immediately start a real-time analysis program. This real-time analysis program uses natural language processing (NLP) and speech recognition technologies to identify each focus session content data in the data stream. For example, it may identify key information such as "the temperature of the transformer has risen abnormally" or "the staff is performing equipment maintenance".

[0040] Once the focus session content data is identified, priorities are marked for it according to the session attention degrees of these focus session content data (for example, judged by keyword occurrence frequency, speech rate, intonation, etc.). For example, "the temperature of the transformer has risen abnormally" may be regarded as high priority because it may indicate potential safety hazards, while "the staff is performing equipment maintenance" may be regarded as medium priority.

[0041] Dynamically adjust the processing resources allocated to the session processing model according to the priority of the focus session content data. For session content data with high priority, more CPU and memory resources can be allocated to ensure that this data can be processed and analyzed in a timely manner. For example, when session content such as "abnormal increase in transformer temperature" is recognized, additional processing resources can be immediately allocated to the session processing model responsible for analyzing this content in order to issue an alarm and take corresponding measures as soon as possible.

[0042] As a result, the efficiency of fault prevention and response can be greatly improved. For example, in the case of recognizing an abnormality in a key device, relevant personnel can be quickly notified for inspection and repair, thus avoiding potential safety accidents. At the same time, by optimizing resource allocation, it can be ensured that important session content is preferentially processed, improving the overall operation efficiency and safety. That is to say, by performing real-time analysis on the 5G audio and video data stream segments added to the model loading channel, identifying the focus session content data, marking the priority, and dynamically adjusting the processing resources, the power service platform can achieve more efficient and intelligent monitoring and management.

[0043] Based on the above steps, the embodiments of the present application significantly improve the processing efficiency and accuracy of the audio and video data stream in the power scenario. By obtaining the 5G audio and video data stream segments and their related session positioning information and stream transmission characteristic information, the data stream segments can be accurately matched to the appropriate session processing model in the target session processing system, which not only optimizes the data processing process but also ensures that the data stream can be processed efficiently and professionally. In the power scenario, especially in key links such as power grid monitoring, fault troubleshooting, and remote command, the present application can achieve real-time analysis of the 5G audio and video data stream segments. By identifying the focus session content data and marking the priority, important session content (such as device fault alarms, emergency dispatch instructions, etc.) can be quickly recognized and preferentially processed, thus greatly enhancing the emergency response ability and operation efficiency of the power system. In addition, by dynamically adjusting the processing resources and allocating corresponding processing resources according to the priority of the focus session content data, it not only ensures that key session content can be processed in a timely manner but also optimizes the utilization of system resources and reduces the operation cost. As a result, by accurately matching the session processing model, real-time analyzing the audio and video data stream, and dynamically adjusting the processing resources, the professionalism, real-time performance, and efficiency of audio and video data processing are significantly improved, providing a strong guarantee for the safe and stable operation of the power system.

[0044] In a possible implementation manner, step S130 may include: Step S131, obtaining the standard processing parameters constructed for the session processing process. The standard processing parameters represent the standard data processing parameters of any session processing model within the session processing process.

[0045] In this embodiment, the server first accesses the parameter database inside it. This parameter database stores various standard processing parameters built for the session processing process. These standard processing parameters are preset and used to describe the data processing capabilities and requirements of each session processing model within the session processing process. For example, a certain session processing model may require the input data to have a resolution of 1080p, a frame rate of 30fps, and an encoding format of H.264, etc. The server extracts these standard processing parameters from the database for subsequent use.

[0046] Step S132: Based on the standard processing parameters and the session location information, determine the session processing unit corresponding to the 5G audio and video data stream segment in the target session processing system.

[0047] In this embodiment, the server then compares the session location information with the standard processing parameters. The session location information contains the transmission node information of the data stream segment, and these transmission node information can help the server judge the source and transmission path of the data stream segment. Based on these transmission node information, the server can identify which session processing units (i.e., processing modules or processors) are responsible for processing the data stream segments from specific nodes or paths. For example, if the session location information shows that the data stream segment comes from a certain specific base station or network node, the server will assign it to the session processing unit responsible for processing the data of that node.

[0048] Step S133: Match the session processing unit with the stream transmission feature information to generate a matching result.

[0049] In this embodiment, after determining the session processing units responsible for processing, the server further matches these units with the stream transmission feature information. The stream transmission feature information includes key attributes such as the type of the data stream segment, the encoding method, and the resolution. The server generates a matching result by comparing these attributes with the processing capabilities of the session processing units. For example, if a certain session processing unit can only process video streams encoded in H.264, and the stream transmission feature information shows that the current data stream segment is encoded in H.265, then this session processing unit is not suitable for processing this data stream segment. The server will record this matching relationship for subsequent decision-making.

[0050] Step S134: According to the matching result, determine the session processing model corresponding to the 5G audio and video data stream segment in the target session processing system.

[0051] Finally, the server determines which session processing model to specifically use to process the current 5G audio and video data stream segment based on the matching results. If multiple session processing units can meet the requirements of the stream transmission characteristic information, the server can select the most suitable session processing model according to factors such as load balancing and processing efficiency. Once selected, the server will send the data stream segment to this model for further processing and analysis. For example, in a power monitoring system, this session processing model can be an algorithm for identifying device failures or abnormal conditions in the video stream. Through this series of steps, the server can ensure that each 5G audio and video data stream segment can be correctly parsed, processed, and converted into useful information or instructions.

[0052] In a possible implementation manner, step S133 may include: Step S1331, extract key features from the stream transmission characteristic information, where the key features include data type, data size, transmission rate, transmission protocol, encoding method, etc.

[0053] In this embodiment, the server first extracts key features from the stream transmission characteristic information. These key features include data type (such as video stream, audio stream), data size (such as the total number of bytes of the data stream), transmission rate (such as the amount of data transmitted per second), transmission protocol (such as RTP, RTCP, etc.), and encoding method (such as H.264, H.265, etc.). For example, the server can extract key features such as "data type: video stream, data size: 100MB, transmission rate: 5Mbps, transmission protocol: RTP, encoding method: H.265".

[0054] Step S1332, obtain the feature requirements of the session processing unit, where the feature requirements describe the data type, size range, and transmission rate that the session processing unit can effectively process.

[0055] In this embodiment, the server then accesses its internal database to obtain the feature requirements of each session processing unit. These feature requirements describe the data type, size range, transmission rate, etc. that each session processing unit can effectively process. For example, the feature requirements of a certain session processing unit can be "data type: video stream, data size range: 50MB - 200MB, transmission rate range: 3Mbps - 10Mbps, encoding method: H.265".

[0056] Step S1333, compare the key features extracted from the stream transmission characteristic information with the feature requirements of the session processing unit one by one. During the comparison process, adopt strategies such as similarity calculation, fuzzy matching, or rule-based matching to determine the target features in the key features that are initially matched with the session processing unit and the matching degree corresponding to the target features.

[0057] In this embodiment, the server compares the feature requirements of the session processing unit with the key features extracted from the streaming feature information one by one. During the comparison process, the server uses similarity calculation, fuzzy matching, or rule-based matching strategies to determine the target features that are initially matched with the session processing unit among the key features and the matching degrees of these target features. For example, for the previously extracted key features "Data type: video stream, Data size: 100MB", the server will compare them with the feature requirements of the session processing unit "Data type: video stream, Data size range: 50MB - 200MB" and determine the matching degree of these two features.

[0058] Step S1334, set a weight value for each compared target feature, and the weight value is used to represent the importance of the target feature.

[0059] In this embodiment, the server sets a weight value for each compared target feature to represent the importance of the target feature. For example, "Data type" may be regarded as a very important feature and thus is assigned a relatively high weight value, such as 0.4; while "Data size" may be relatively less important and is assigned a lower weight value, such as 0.2, and these weight values will be used for subsequent comprehensive score calculation.

[0060] Step S1335, generate a matching degree score corresponding to each target feature according to the matching degree and weight value corresponding to each target feature, and sum up the matching degree scores of all target features to obtain a comprehensive score, and the comprehensive score represents the matching degree between the streaming feature information and the session processing unit.

[0061] In this embodiment, the server generates a corresponding matching degree score according to the matching degree and weight value of each target feature, and sums up the matching degree scores of all target features to obtain a comprehensive score. For example, the matching degree score of "Data type" is 0.9 (indicating a high degree of matching), and the matching degree score of "Data size" is 0.8 (indicating a good matching). According to the weight value and the matching degree score, the server calculates the comprehensive score, such as 0.4×0.9 + 0.2×0.8 = 0.52, and this comprehensive score represents the matching degree between the streaming feature information and the session processing unit.

[0062] Step S1336, when the comprehensive score exceeds a preset threshold, determine that the session processing unit matches the streaming feature information, otherwise determine that the session processing unit does not match the streaming feature information, and generate a matching result.

[0063] In this embodiment, the server sets a preset threshold, such as 0.5, to determine whether the comprehensive score meets the matching requirements. In the current example, the comprehensive score of 0.52 exceeds the preset threshold of 0.5. Therefore, the server determines that the session processing unit matches the stream transmission feature information. If the comprehensive score is lower than the preset threshold, it is determined as unmatched. Finally, the server generates a matching result and stores or transmits it to the subsequent processing flow.

[0064] In a possible implementation manner, step S134 may include: Step S1341, according to the matching result, determine the target session processing unit with the highest comprehensive score.

[0065] In the previous steps, the server has matched multiple session processing units with the stream transmission feature information of the 5G audio and video data stream segments, and calculated a comprehensive score for each session processing unit. Now, the server needs to find the one with the highest comprehensive score from these session processing units.

[0066] For example, the server determines a scoring list that records three session processing units and their corresponding comprehensive scores: Session processing unit A: Comprehensive score 0.75 Session processing unit B: Comprehensive score 0.82 Session processing unit C: Comprehensive score 0.78 The server determines through comparison that the comprehensive score of session processing unit B is the highest, which is 0.82. Therefore, the server selects session processing unit B as the target session processing unit.

[0067] Step S1342, obtain the session processing model mapped by the target session processing unit as the session processing model corresponding to the 5G audio and video data stream segment processed in the target session processing system, where each session processing unit is associated with one or more specific session processing models.

[0068] Once the target session processing unit (session processing unit B in this example) is determined, the server then needs to find the session processing model mapped by this session processing unit.

[0069] There is a mapping table inside the server, which records each session processing unit and its associated session processing model. The server queries this mapping table to find the session processing model corresponding to session processing unit B.

[0070] For example, the mapping table may have the following records: Session processing unit A → Session processing model X Session processing unit B → Session processing model Y Session processing unit C → Session processing model Z Based on the query result, the server determines that the session processing unit B maps to the session processing model Y. Therefore, the server selects the session processing model Y as the session processing model corresponding to the 5G audio-visual data stream segment for processing in the target session processing system.

[0071] Finally, the server sends the 5G audio-visual data stream segment to the session processing model Y for further processing and analysis. This process ensures that the data stream segment can be processed by the most suitable model, thereby improving the processing efficiency and accuracy.

[0072] In a possible implementation manner, step S132 may include: Step S1321, according to the initial resource allocation policy, perform resource initialization processing on the session location information and the standard processing parameters to generate an initial processing resource identifier.

[0073] In this embodiment, when the server receives the 5G audio-visual data stream segment, it first performs resource initialization processing on the session location information and the standard processing parameters according to the initial resource allocation policy. The purpose of this step is to determine the initial resource requirements for processing this data stream segment.

[0074] For example, the server can allocate an initial resource set based on the data transmission start point, end point, and path in the session location information, as well as the processing capacity requirements (such as CPU, memory, bandwidth, etc.) defined in the standard processing parameters. This resource set can ensure that the data stream segment can obtain sufficient resource support at the start of processing. The server will generate a unique initial processing resource identifier for this initial resource set, such as a specific ID or label, for subsequent resource management and tracking.

[0075] Step S1322, according to the termination resource allocation policy, perform resource termination processing on the session location information and the standard processing parameters to generate a termination processing resource identifier.

[0076] In this embodiment, next, the server will perform resource termination processing on the session location information and the standard processing parameters according to the termination resource allocation policy. The purpose of this step is to determine how to release and recycle the allocated resources when the data stream segment processing is completed.

[0077] For example, the server can reserve a part of the resources for resource cleaning and recycling work after processing according to the estimated processing duration of the data stream segment and the resource recycling policy after transmission completion. This can ensure the efficient use of resources and avoid resource waste. Similarly, the server will generate a termination processing resource identifier for this termination resource set so that these resources can be accurately identified and recycled at the end of processing.

[0078] Step S1323, based on the initial processing resource identifier and the termination processing resource identifier, determine the session processing unit corresponding to the 5G audio and video data stream segment in the target session processing system.

[0079] Finally, the server will determine the session processing unit corresponding to the 5G audio and video data stream segment in the target session processing system based on the initial processing resource identifier and the termination processing resource identifier.

[0080] Specifically, the server will query its internal resource management database to find the session processing unit that matches the initial processing resource identifier and the termination processing resource identifier. This session processing unit should have the initial resources required to process this data stream segment and be able to release and recycle resources according to the termination resource allocation policy after processing.

[0081] For example, if the resource configuration of a certain session processing unit exactly matches the initial processing resource identifier and the termination processing resource identifier, then the server will select this session processing unit to process the 5G audio and video data stream segment. In this way, the server can ensure that each data stream segment can be assigned to the most suitable session processing unit for processing, thereby improving processing efficiency and resource utilization.

[0082] In a possible implementation, step S1323 may include: Step S1323-1, parse the initial processing resource identifier and the termination processing resource identifier, and extract the key information contained therein. The key information includes a timestamp, a resource number, and a path attribute.

[0083] In this embodiment, after the server receives the initial processing resource identifier and the termination processing resource identifier, it first parses these two identifiers. During the parsing process, the server extracts the key information in the identifiers, including a timestamp (indicating the time point of resource allocation or release), a resource number (a number uniquely identifying a specific resource), and a path attribute (information describing the location of the resource or the allocation path).

[0084] For example, the initial processing resource identifier may contain a timestamp "2023-04-01 10:00:00", a resource number "R12345", and a path attribute " / server / resources / cpu / core1". These information tell the server that at the start of processing, it needs to use a specific CPU core resource numbered "R12345", and this resource is located at a specific path of the server.

[0085] Step S1323-2, construct a resource mapping table in the target session processing system.

[0086] In the target session processing system, the server constructs a resource mapping table, which is a database structure for recording the correspondence between resource numbers and session processing units. Each resource number is mapped to one or more session processing units that have the ability to process specific resources.

[0087] For example, there may be a row in the resource mapping table showing that the resource number "R12345" is mapped to the session processing units "SPU001" and "SPU002", indicating that both of these processing units can process the resource numbered "R12345".

[0088] Step S1323-3: Using the initial processing resource identifier and the termination processing resource identifier, locate the corresponding range of session processing units in the resource mapping table. The range of session processing units represents the set of session processing units required to process the 5G audio-video data stream segment.

[0089] In this embodiment, using the resource numbers in the initial processing resource identifier and the termination processing resource identifier, the server locates the corresponding range of session processing units in the resource mapping table. This range represents all the session processing units that can process the 5G audio-video data stream segment.

[0090] Continuing with the above example, by querying the resource mapping table, the server finds that the range of session processing units corresponding to the resource number "R12345" is "SPU001" and "SPU002".

[0091] Step S1323-4: Within the range of session processing units, filter out the session processing units that meet the preset conditions. The preset conditions include the status conditions, processing capacity conditions, and compatibility conditions of the processing units.

[0092] After determining the range of session processing units, the server begins to filter out the session processing units that meet the preset conditions. These preset conditions can include the status of the processing units (such as whether they are online or idle), processing capacity (such as CPU frequency, memory capacity), and compatibility (such as whether they support specific audio-video coding formats).

[0093] For example, the server checks the status of "SPU001" and "SPU002" and finds that "SPU001" is currently busy with other tasks, while "SPU002" is in an idle state. Further checking the processing capacity, the CPU frequency and memory capacity of "SPU002" both meet the requirements for processing this audio-video data stream segment. Finally, it is confirmed that "SPU002" is compatible with the required audio-video coding format.

[0094] Step S1323-5, if there are multiple session processing units that meet the preset conditions, select the session processing unit with the lowest load rate for processing.

[0095] If there are multiple session processing units that meet the preset conditions, the server will select the one with the lowest load rate for processing. The load rate is an indicator that measures the busy degree of the processing unit and is usually calculated based on the number of tasks currently being processed by the processing unit and its total processing capacity.

[0096] In the previous example, since only "SPU002" meets the conditions and it is currently idle, its load rate is the lowest. Therefore, the server selects "SPU002" to process the 5G audio and video data stream segment. If "SPU001" also meets the conditions and the load rates of the two processing units are similar, the server can make a final choice based on other factors (such as recent usage history, maintenance records, etc.).

[0097] In a possible implementation manner, the method further includes: Step S1323-6, allocate the selected session processing unit to the 5G audio and video data stream segment, and after the allocation, perform a confirmation operation to check whether the session processing unit has successfully received and is ready to process the 5G audio and video data stream segment.

[0098] In this embodiment, after determining the session processing unit "SPU002" with the lowest load rate, the server starts to allocate this session processing unit to a specific 5G audio and video data stream segment. During the allocation process, the server will update the internal management record, associate this data stream segment with "SPU002", and send an instruction to "SPU002" to notify it to be ready to receive and process this data stream segment.

[0099] After the allocation is completed, the server will perform a confirmation operation. This confirmation operation usually includes sending a confirmation request to "SPU002" to ask whether it has successfully received the allocation instruction and whether it is ready to process the upcoming 5G audio and video data stream segment. The server will wait for the response from "SPU002". If the response indicates that everything is ready, then the server will continue with the subsequent operations.

[0100] Step S1323-7, if an exception occurs during the allocation or processing of the session processing unit, start the backup mechanism. The backup mechanism includes reallocating the processing unit, enabling redundant processing units, or switching to an alternative processing path.

[0101] During the allocation or processing, if the server detects an abnormality in "SPU002", such as a response timeout, a slow processing speed, or an error message, etc., it will immediately activate the backup mechanism to ensure the normal processing of the data flow segment.

[0102] The backup mechanism may include the following steps: Reallocate the processing unit: The server will attempt to reallocate the session processing unit to another session processing unit with a lower load rate and meeting the conditions, such as "SPU003". This process is similar to the previous allocation process but is faster to minimize the processing delay caused by the abnormality.

[0103] Enable redundant processing units: If the reallocation fails or to further improve the system's reliability, the server can enable redundant processing units. These redundant processing units are pre-configured backup processing resources that have the same processing capabilities as the original processing unit. When the primary processing unit fails, the redundant processing units will immediately take over its work to ensure the continuous processing of the data flow segment.

[0104] Switch to the backup processing path: In some cases, if all the processing units on the primary processing path have problems, the server can switch to the backup processing path. The backup processing path is another pre-configured processing link that is relatively independent of the original path. By switching to the backup path, the server can ensure that the data flow segment can still be processed in a timely manner when the primary path fails.

[0105] Throughout the process, the server will continuously monitor the status and processing progress of the processing units to ensure that the 5G audio and video data flow segments can be processed stably and efficiently.

[0106] In a possible implementation manner, the session location information includes the time point information of the 5G audio and video data flow segment within the 5G transmission path. The 5G transmission path is used to represent the path attribute information for transmitting the 5G audio and video data flow segment during the 5G session transmission process.

[0107] Step S1321 may include: Step S1321-1, identify the initial timestamp of the 5G audio and video data flow segment in the 5G transmission path.

[0108] Step S1321-2, according to the initial resource allocation rule, correspond the initial timestamp with the standard processing parameters to obtain an initialized processing resource number.

[0109] Step S1321-3, determine this initialized processing resource number as the initial processing resource identifier.

[0110] In this embodiment, when the 5G audio-video data stream segment starts to be transmitted, the server will first identify the initial timestamp of this data stream segment in the 5G transmission path, and this timestamp marks the exact time point when the data stream segment starts to be transmitted.

[0111] For example, assume that a 5G audio-video data stream segment starts to be transmitted on the 5G network. The server will record this time point, such as "2023-07-19 14:30:00.000". This timestamp is the initial timestamp of the data stream segment and will be used for subsequent resource allocation and processing.

[0112] After identifying the initial timestamp, the server will, according to the preset initial resource allocation rule, correspond this timestamp with the standard processing parameters. The standard processing parameters can include the required number of CPU cores, memory size, bandwidth requirements, etc. These parameters are set according to the characteristics and processing requirements of the 5G audio-video data stream segment.

[0113] For example, the rule may stipulate that during a specific time period of each day (such as peak hours), for audio-video data stream segments with a specific coding format and resolution, more processing resources need to be allocated. Therefore, the server will correspond the initial timestamp "2023-04-01 10:00:00" with these standard processing parameters to determine the required amount of processing resources.

[0114] According to the corresponding result of the initial timestamp and the standard processing parameters, the server will calculate an initialized processing resource number, which is unique and represents the processing resources initially allocated for this 5G audio-video data stream segment.

[0115] For example, the server can calculate a resource number, such as resource number "R12345", according to the timestamp and processing parameters, and it includes the timestamp "2023-04-01 10:00:00", as well as the path attribute " / server / resources / cpu / core1". This resource number and the related attached information will be determined as the initial processing resource identifier to identify and track the initial resource allocation situation of this data stream segment in the processing system.

[0116] To sum up, by identifying the initial timestamp, corresponding it with the standard processing parameters according to the rule, and calculating the initialized processing resource number, the server can accurately allocate the required initial processing resources for the 5G audio-video data stream segment and ensure its efficient and accurate processing.

[0117] In a possible implementation manner, the session location information includes the time point information of the 5G audio-video data stream segment within the 5G transmission path and the transmission duration of the 5G audio-video data stream segment within the 5G transmission path.

[0118] Step S1322 may include: Step S1322-1, record the starting transmission moment of the 5G audio-visual data stream segment in the 5G transport stream and mark it as the starting transmission time point.

[0119] Step S1322-2, detect the complete transmission duration of the 5G audio-visual data stream segment and define it as the transmission duration parameter.

[0120] Step S1322-3, perform a synthesis operation on the starting transmission time point and the transmission duration parameter according to the termination resource allocation rule.

[0121] Step S1322-4, through the result of the synthesis operation, combine with the standard processing parameter to obtain an identification value of the termination processing resource.

[0122] Step S1322-5, determine the identification value of the termination processing resource as the termination processing resource identifier.

[0123] In this embodiment, when a 5G audio-visual data stream segment starts to be transmitted, the server will immediately record the starting transmission moment of this stream segment. For example, assume that at a certain moment, the server detects that a new 5G audio-visual data stream segment starts to be transmitted, and it will immediately record this time point, such as "2023-09-15 09:15:00.000", and mark this time point as the starting transmission time point of this data stream segment.

[0124] During the transmission of the 5G audio-visual data stream segment, the server will continuously monitor the transmission situation of this stream segment. When the stream segment transmission is completed, the server will detect and record the time taken for the entire transmission process, that is, the duration between the starting transmission time point and the end time point of the transmission. For example, if the stream segment ends transmission at "2023-09-15 09:17:30.000", then the transmission duration is 2 minutes and 30 seconds, and this time length is defined as the transmission duration parameter.

[0125] After the server obtains the starting transmission time point and the transmission duration parameter, it will perform a synthesis operation on these two parameters according to the preset termination resource allocation rule. This operation may involve performing specific mathematical processing on the time point and the duration to obtain a synthesis value for resource termination processing. For example, the rule may stipulate converting the starting time point into a specific timestamp format and performing a weighted sum with the transmission duration to obtain a unique synthesis value.

[0126] After performing the synthesis operation, the server combines this result with the standard processing parameters to obtain an identification value for the termination processing resource. The standard processing parameters can include the CPU time required to process this stream segment, the memory occupancy, etc. These parameters are set according to the characteristics of the stream segment and the processing requirements. For example, the server can perform a certain form of operation (such as multiplication, addition, etc.) on the synthesis value and the standard processing parameters to obtain a unique identification value for the termination processing resource.

[0127] Finally, the server determines the obtained identification value for the termination processing resource as the identification for the termination processing resource of this 5G audio and video data stream segment. This identification for the termination processing resource will be used for subsequent resource release, logging, etc. operations to ensure that resources can be correctly and efficiently recycled and reused. For example, the server can store this identification in the database and query the database when needed to find and release the corresponding resources.

[0128] In a possible implementation manner, the session processing model includes a first session processing model and a second session processing model.

[0129] Step S140 may include: Step S141, generating a first model loading channel mapped by the first session processing model within the session processing process.

[0130] Step S142, generating a second model loading channel mapped by the second session processing model within the session processing process.

[0131] Step S143, outputting the first model loading channel and the second model loading channel as the model loading channel mapped by the session processing model.

[0132] In this embodiment, when the server starts the target session processing system, it first loads the first session processing model. This first session processing model can be for the processing of audio streams, such as speech recognition or audio encoding and decoding, etc. To load and run this first session processing model, the server needs to create a dedicated channel within the session processing process. This channel is the first model loading channel.

[0133] Specifically, the server allocates a certain amount of memory and computing resources to establish a running environment for the first session processing model. This running environment includes the input and output interfaces of the first session processing model, the data processing flow, and the interaction mechanism with other systems, etc. Once this channel is successfully established, the first session processing model can receive audio stream data through this channel and perform corresponding processing.

[0134] After loading the first session processing model, the server also needs to load the second session processing model, which can be used for processing video streams, such as video encoding / decoding, image recognition, etc. Similar to the first session processing model, in order to load and run the second session processing model, the server also needs to create a dedicated channel within the session processing process, namely the second model loading channel.

[0135] The server will also allocate a certain amount of memory and computing resources to establish a running environment for the second session processing model. This running environment is similar to the first model loading channel, but will be optimized and adjusted according to the characteristics of video processing. Once the second model loading channel is successfully established, the second session processing model can receive video stream data through this channel and perform corresponding processing.

[0136] After both the first model loading channel and the second model loading channel are established, the server will integrate these two channels and output them as the model loading channel mapped by the session processing model. The integration process can include standardizing the input and output interfaces of the two channels and ensuring smooth data interaction between the two channels.

[0137] The output model loading channel can be regarded as a unified interface or platform. It is responsible for receiving 5G audio-video data stream segments and distributing them to the corresponding processing models (the first session processing model or the second session processing model) for processing according to the data type (audio or video). In this way, the server can efficiently process the audio-video data in the 5G session through this unified model loading channel.

[0138] In a possible implementation manner, the audio-video session timing processed by the first session processing model is earlier than the audio-video session timing processed by the second session processing model.

[0139] Step S140 can further include: Step S144, obtaining the standard processing parameters constructed for the session processing process. The standard processing parameters represent the standard data processing parameters of any session processing model within the session processing process.

[0140] Step S145, according to the initial processing point decision mechanism, calculating the standard processing parameters and the session location information to generate the initial processing point of the 5G audio-video data stream segment in the first model loading channel.

[0141] Step S146, according to the termination processing point decision mechanism, calculating the standard processing parameters and the session location information to generate the termination processing point of the 5G audio-video data stream segment in the second model loading channel.

[0142] Step S147: Determine the session processing range of the 5G audio-video data stream segment from the initial processing point in the first model loading channel to the termination processing point in the second model loading channel, and add the 5G audio-video data stream segment to the session processing range.

[0143] In this embodiment, the server first reads standard processing parameters from the configuration file of the session processing process. These parameters are preset and used to guide how the session processing model processes the audio-video data stream. For example, the standard processing parameters may include the data processing speed, memory occupancy limit, data cache size, etc. These parameters ensure that the session processing process can meet the performance requirements without over-consuming server resources.

[0144] Next, the server will calculate the initial processing point of the 5G audio-video data stream segment in the first model loading channel according to the initial processing point decision mechanism, using the standard processing parameters and session location information. This calculation process may involve multiple factors, such as the start timestamp of the data stream segment, the transmission duration, and the processing capacity of the first session processing model, etc. Through this information, the server can determine when the data stream segment starts to be processed by the first session processing model to ensure data continuity and real-time performance.

[0145] For example, if the session location information shows that the start timestamp of the data stream segment is T1, and the first session processing model can process X data units per second, then the initial processing point may be the time point after adding the necessary buffer time to T1.

[0146] Similar to calculating the initial processing point, the server will calculate the termination processing point of the 5G audio-video data stream segment in the second model loading channel according to the termination processing point decision mechanism, using the standard processing parameters and session location information. This calculation also takes into account factors such as the transmission duration of the data stream segment and the processing capacity of the second session processing model.

[0147] For example, if the transmission duration of the data stream segment is D seconds, and the second session processing model can process Y data units per second, then the termination processing point may be the time point after adding D seconds to the start processing point and then subtracting the necessary processing time.

[0148] Once the server calculates the initial processing point and the termination processing point, it will determine the time range between these two points as the session processing range of the 5G audio-video data stream segment. This range ensures that the data stream segment can start being processed by the first session processing model and end being processed by the second session processing model, thus guaranteeing data integrity and processing continuity.

[0149] Finally, the server will add 5G audio and video data stream segments to this session processing scope for sequential processing by two session processing models, so that the server can efficiently manage and process a large number of 5G audio and video data stream segments.

[0150] Figure 2 FIG. shows the hardware structure diagram of a 5G-based audio and video session data processing system 100 provided by an embodiment of the present invention for implementing the above-mentioned 5G-based audio and video session data processing method, as Figure 2 shown, the 5G-based audio and video session data processing system 100 may include a processor 110, a machine-readable storage medium 120, a bus 130, and a communication unit 140.

[0151] In an exemplary design concept, the 5G-based audio and video session data processing system 100 can be a single 5G-based audio and video session data processing system or a server group. The server group can be centralized or distributed (for example, the 5G-based audio and video session data processing system 100 can be a distributed system). In an exemplary design concept, the 5G-based audio and video session data processing system 100 can be local or remote. For example, the 5G-based audio and video session data processing system 100 can access data stored in the machine-readable storage medium 120 via a network and / or data. Again, for example, the 5G-based audio and video session data processing system 100 can be directly connected to the machine-readable storage medium 120 to access the stored data and / or data. In an exemplary design concept, the 5G-based audio and video session data processing system 100 can be implemented on a cloud platform. Merely by way of example, the cloud platform can include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-layer cloud, etc. or any combination thereof.

[0152] The machine-readable storage medium 120 can store data and / or instructions. In an exemplary design concept, the machine-readable storage medium 120 can store multi-dimensional monitoring data obtained from an external terminal. In an exemplary design concept, the machine-readable storage medium 120 can store the multi-dimensional monitoring data and / or instructions that the 5G-based audio and video session data processing system 100 is used to execute or utilize to complete the exemplary methods described in the present invention. In an exemplary design concept, the machine-readable storage medium 120 may include a mass storage device, a removable storage device, a volatile read-write memory, a read-only memory (ROM), etc., or any combination thereof. Exemplary mass storage devices may include magnetic disks, optical disks, solid state disks, etc. Exemplary removable storage devices may include flash drives, floppy disks, optical disks, memory cards, compact disks, magnetic tapes, etc. Exemplary volatile read-write memories may include random access memory (RAM). Exemplary RAM may include dynamic random access memory (DRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), static random access memory (SRAM), thyristor random access memory (T-RAM), and zero-capacitor random access memory (Z-RAM), etc. Exemplary read-only memories may include mask ROM (MROM), programmable ROM (PROM), erasable programmable ROM (PEROM), electrically erasable programmable ROM (EEPROM), CD-ROM, and digital versatile disk ROM, etc. In an exemplary design concept, the machine-readable storage medium 120 can be implemented on a cloud platform. By way of example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-layer cloud, etc., or any combination thereof.

[0153] In a specific implementation process, at least one processor 110 executes the computer-executable instructions stored in the machine-readable storage medium 120, so that the processor 110 can execute the 5G-based audio and video session data processing method in the above method embodiment. The processor 110, the machine-readable storage medium 120, and the communication unit 140 are connected through a bus 130, and the processor 110 can be used to control the transceiver actions of the communication unit 140.

[0154] For the specific implementation process of the processor 110, reference can be made to the respective method embodiments executed by the above 5G-based audio and video session data processing system 100. Their implementation principles and technical effects are similar, and will not be elaborated here in this embodiment.

[0155] In addition, an embodiment of the present invention further provides a readable storage medium, in which computer-executable instructions are preset. When a processor executes the computer-executable instructions, the 5G-based audio and video session data processing method as described above is implemented.

[0156] It should be understood that the above description is for illustrative purposes only and is not intended to limit the scope of the present invention. For those of ordinary skill in the art, various modifications and changes can be made in combination with the description of the present invention. However, these modifications and changes do not depart from the scope of the present invention.

[0157] The basic concepts have been described above. Obviously, for those of ordinary skill in the art after reading this application, the above invention disclosure is only an example and does not constitute a limitation to the present invention. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to the present invention. Such modifications, improvements and corrections are proposed in the present invention, so such modifications, improvements and corrections still fall within the spirit and scope of the exemplary embodiments of the present invention.

[0158] Meanwhile, the present invention uses specific terms to describe the embodiments of the present invention. For example, "one embodiment", "an embodiment", and / or "some embodiments" mean a certain feature, structure or characteristic related to at least one embodiment of the present invention. Therefore, it should be emphasized and noted that the "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned two or more times in different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures or characteristics in one or more embodiments of the present invention can be appropriately combined.

[0159] In addition, those of ordinary skill in the art can understand that various aspects of the present invention can be described and illustrated in combination with multiple patentable categories or situations, including any new and useful process, machine, product or composition of matter, or any new and useful improvement thereof. Accordingly, various aspects of the present invention can be executed entirely by hardware, entirely by software (including firmware, resident software, microcode, etc.), or by a combination of hardware and software. The above hardware or software can all be referred to as "units", "modules" or "systems". In addition, various aspects disclosed in the present invention can take the form of a computer program product embodied in one or more computer-readable media, in which computer-readable program code is included.

[0160] A computer-readable signal medium may include a propagated data signal embodying computer program code therein, for example, on a baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including electromagnetic, optical, or any suitable combination thereof. The computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium that can be connected to an instruction execution system, apparatus, or device to implement communication, propagation, or transmission for use of a program. The program code located on the computer-readable signal medium may be propagated with any suitable medium, including radio, cable, fiber optic cable, RF, or the like, or any combination thereof.

[0161] The computer program code required for the operation of various parts of the present invention may be written in any one or more programming languages, including object-oriented programming languages such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB.NET, Python, etc., conventional procedural programming languages such as C, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, active programming languages such as Python, Ruby, and Groovy, or other programming languages. The program code may run entirely on a computer, or as a stand-alone software package on a computer, or partly on a computer and partly on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer may be connected to the computer in any form of network, such as a local area network (LAN) or a wide area network (WAN), or connected to an external computer (e.g., in connection with the Internet), or in a cloud computing environment, or used as a service such as software as a service (SaaS).

[0162] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences, the use of numerical letters, or the use of other names in the present invention is not used to limit the order of the processes and methods of the present invention. Although various examples are discussed in combination with the above disclosure for some currently useful embodiments of the invention, it should be understood that such details are for illustrative purposes only, and the appended claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that match the essence and scope of the embodiments of the present invention. For example, although the system components described above may be implemented in combination with hardware devices, they may also be implemented only in combination with software solutions, such as installing the described system on an existing server or mobile device.

[0163] Similarly, it should be noted that, in order to simplify the description of the present invention disclosure and thus help the understanding of one or more embodiments of the invention, in the foregoing description of the embodiments of the present invention, sometimes multiple features are incorporated into one embodiment, drawing or description thereof. Similarly, it should be noted that, in order to simplify the description of the present invention disclosure and thus help the understanding of one or more embodiments of the invention, in the foregoing description of the embodiments of the present invention, sometimes multiple features are incorporated into one embodiment, drawing or description thereof.

Claims

1. A method for processing audio and video session data based on 5G, characterized in that, The method includes: Obtain a 5G audio - video data stream segment to be processed; the 5G audio - video data stream segment is used to represent any continuous audio - video data stream obtained during the 5G session transmission. Obtain the session location information and stream transmission feature information of the 5G audio - video data stream segment during the 5G session transmission; the session location information characterizes the transmission node information of the 5G audio - video data stream segment during the 5G session transmission, and the stream transmission feature information characterizes the transmission label information of the 5G audio - video data stream segment during the 5G session transmission. Based on the session location information and the stream transmission feature information, determine the session processing model corresponding to the 5G audio - video data stream segment for processing in the target session processing system. Generate a model loading channel mapped by the session processing model within the session processing process of the target session processing system, and add the 5G audio - video data stream segment to the model loading channel mapped by the session processing model. Perform real - time analysis on the 5G audio - video data stream segment added to the model loading channel, identify each focus session content data, mark the priority of the identified focus session content data according to the session attention degree of each focus session content data, and dynamically adjust the processing resources for the session processing model to process each focus session content data according to the resource allocation strategy corresponding to the priority of each focus session content data.

2. The method for processing audio and video session data based on 5G according to claim 1, wherein The step of determining the session processing model corresponding to the 5G audio - video data stream segment for processing in the target session processing system based on the session location information and the stream transmission feature information includes: Obtain the standard processing parameters constructed for the session processing process; the standard processing parameters represent the standard data processing parameters of any session processing model within the session processing process. Based on the standard processing parameters and the session location information, determine the session processing unit corresponding to the 5G audio - video data stream segment in the target session processing system. Match the session processing unit with the stream transmission feature information to generate a matching result. According to the matching result, determine the session processing model corresponding to the 5G audio - video data stream segment in the target session processing system.

3. The method for processing audio and video session data based on 5G according to claim 2, wherein, The step of matching the session processing unit with the stream transmission feature information to generate a matching result includes: Extract key features from the stream transmission feature information, where the key features include data type, data size, transmission rate, transmission protocol, coding method, etc. Obtain the feature requirements of the session processing unit, and the feature requirements describe the data types, size ranges, and transmission rates that the session processing unit can effectively process. Compare the key features extracted from the stream transmission feature information with the feature requirements of the session processing unit one by one. During the comparison process, adopt strategies such as similarity calculation, fuzzy matching, or rule - based matching to determine the target features initially matched with the session processing unit among the key features and the corresponding matching degree of the target features. Set a weight value for each target feature to be compared, and the weight value is used to represent the importance of the target feature; Generate a matching degree score corresponding to each target feature according to the matching degree and weight value corresponding to each target feature, and sum up the matching degree scores of all target features to obtain a comprehensive score, which represents the matching degree between the flow transmission feature information and the session processing unit; When the comprehensive score exceeds a preset threshold, it is determined that the session processing unit matches the flow transmission feature information, otherwise it is determined that the session processing unit does not match the flow transmission feature information, and a matching result is generated.

4. The method for processing audio and video session data based on 5G according to claim 3, wherein The step of determining the session processing model corresponding to the 5G audio and video data stream segment in the target session processing system according to the matching result includes: Determine the target session processing unit with the highest comprehensive score according to the matching result; Obtain the session processing model mapped by the target session processing unit as the session processing model corresponding to the 5G audio and video data stream segment in the target session processing system, where each session processing unit is associated with one or more specific session processing models.

5. The method for processing audio and video session data based on 5G according to claim 2, wherein The step of determining the session processing unit corresponding to the 5G audio and video data stream segment in the target session processing system based on the standard processing parameters and the session location information includes: According to the initial resource allocation strategy, perform resource initialization processing on the session location information and the standard processing parameters to generate an initial processing resource identifier; According to the termination resource allocation strategy, perform resource termination processing on the session location information and the standard processing parameters to generate a termination processing resource identifier; Based on the initial processing resource identifier and the termination processing resource identifier, determine the session processing unit corresponding to the 5G audio and video data stream segment in the target session processing system; The step of determining the session processing unit corresponding to the 5G audio and video data stream segment in the target session processing system based on the initial processing resource identifier and the termination processing resource identifier includes: Parse the initial processing resource identifier and the termination processing resource identifier, and extract the key information contained therein, where the key information includes a time stamp, a resource number, and a path attribute; Construct a resource mapping table in the target session processing system; Use the initial processing resource identifier and the termination processing resource identifier to locate the corresponding session processing unit range in the resource mapping table, and the session processing unit range represents the set of session processing units required to process the 5G audio and video data stream segment; Within the session processing unit range, filter out session processing units that meet the preset conditions, and the preset conditions include the status condition, processing capacity condition, and compatibility condition of the processing unit; If there are multiple session processing units that meet the preset conditions, select the session processing unit with the lowest load rate for processing; Among them, the method further includes: Assign the selected session processing unit to the 5G audio-video data stream segment, and after the assignment, perform a confirmation operation to check whether the session processing unit has successfully received and is ready to process the 5G audio-video data stream segment; If an exception occurs during the assignment or processing of the session processing unit, start the backup mechanism, which includes reassigning the processing unit, enabling redundant processing units, or switching to an alternative processing path.

6. The method for processing audio and video session data based on 5G according to claim 5, wherein The session location information includes the time point information of the 5G audio-video data stream segment within the 5G transmission path; the 5G transmission path is used to represent the path attribute information for transmitting the 5G audio-video data stream segment during the 5G session transmission process; The resource initialization process of combining the session location information with the standard processing parameters according to the initial resource allocation strategy to generate an initial processing resource identifier includes: Identify the initial timestamp of the 5G audio-video data stream segment in the 5G transmission path; According to the initial resource allocation rule, map the initial timestamp to the standard processing parameters to obtain an initialized processing resource number; Determine this initialized processing resource number as the initial processing resource identifier.

7. The method for processing audio and video session data based on 5G according to claim 5, wherein The session location information includes the time point information of the 5G audio-video data stream segment within the 5G transmission path and the transmission duration of the 5G audio-video data stream segment within the 5G transmission path; The resource termination process of combining the session location information with the standard processing parameters according to the termination resource allocation strategy to generate a termination processing resource identifier includes: Record the start transmission moment of the 5G audio-video data stream segment in the 5G transmission stream and mark it as the start transmission time point; Detect the complete transmission duration of the 5G audio-video data stream segment and define it as the transmission duration parameter; According to the termination resource allocation rule, perform a synthesis operation on the start transmission time point and the transmission duration parameter; Based on the result of the synthesis operation and in combination with the standard processing parameters, obtain an identification value of the termination processing resource; Determine the identification value of the termination processing resource as the termination processing resource identifier.

8. The method for processing audio and video session data based on 5G according to claim 1, wherein The session processing model includes a first session processing model and a second session processing model; generating the model loading channels mapped by the session processing model within the session processing process of the target session processing system includes: Generate a first model loading channel mapped by the first session processing model within the session processing process; Generate a second model loading channel mapped by the second session processing model within the session processing process; Output the first model loading channel and the second model loading channel as the model loading channels mapped by the session processing model.

9. The method for processing audio and video session data based on 5G according to claim 8, wherein, The audio-video session timing processed by the first session processing model is earlier than the audio-video session timing processed by the second session processing model; Adding the 5G audio-video data stream segment to the model loading channels mapped by the session processing model includes: Obtain the standard processing parameters constructed for the session processing process; the standard processing parameters represent the standard data processing parameters of any session processing model within the session processing process; According to the initial processing point decision mechanism, calculate the standard processing parameters and the session positioning information to generate the initial processing point of the 5G audio-video data stream segment in the first model loading channel; According to the termination processing point decision mechanism, calculate the standard processing parameters and the session positioning information to generate the termination processing point of the 5G audio-video data stream segment in the second model loading channel; Determine the session processing range of the 5G audio-video data stream segment from the initial processing point in the first model loading channel to the termination processing point in the second model loading channel, and add the 5G audio-video data stream segment to the session processing range.

10. An audio and video session data processing system based on 5G, characterized in that, The 5G-based audio-video session data processing system includes a processor and a machine-readable storage medium. Machine-executable instructions are stored in the machine-readable storage medium, and the machine-executable instructions are loaded and executed by the processor to implement the 5G-based audio-video session data processing method according to any one of claims 1-9.

Images