Electronic information instant display method and system
By classifying data flows, urgency evaluation and dynamic priority configuration, the problems of data latency and bandwidth consumption in electronic data processing are solved, and more efficient data transmission and user experience are achieved.
Patent Information
- Application Number
- CN202411137322.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-19
- Publication Date
- 2024-11-29
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing electronic data processing technology fails to fully consider the real-time changes in data content and network bandwidth fluctuations, resulting in delays in data processing and display, affecting user experience. Especially in data monitoring and real-time communication applications, important data transmission is affected, and the increase is added. Uncertainty and risks of information transmission.
By receiving the data stream transmitted by the network, each data packet is assigned a unique identifier, grouping and classification according to the data characteristics, detecting scene changes, evaluating information urgency, adjusting the data stream transmission sequence and encoding rate, dynamic priority configuration and frame rate Adjust to generate instant information display results.
Ensure priority processing of key information, improve response speed and data processing efficiency, flexibly adjust resource allocation according to network conditions, optimize data transmission, and provide a smoother and higher-quality visual experience.
Smart Images

Figure CN119052575A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of electronic data processing, and in particular to a method and system for real-time display of electronic information. Background Art
[0002] The field of electronic data processing technology uses electronic technology to collect, store, process, analyze, and disseminate information. In addition, the field uses computer hardware and software to process data, including data input, processing, and output, to achieve effective management and automated processing of information. Electronic data processing is widely used in many industries such as business, education, healthcare, and government to process various forms of data such as text, images, audio, and video.
[0003] Among them, the electronic information instant display method is a branch of the electronic data processing field, which is used for real-time processing and display of data. The method processes data through instant analysis and visualization, so that the information can be seen and used by users at the moment of collection and generation. The main applications include data monitoring, real-time communication and dynamic data display, so as to achieve the purpose of reducing data display delay and ensure that users can obtain and respond to the latest data information in real time.
[0004] The static data processing methods in the prior art fail to fully consider the real-time changes in data content and the actual fluctuations in network bandwidth, resulting in delays in data processing and display, affecting user experience. For example, in data monitoring and real-time communication applications, delays in data display may result in key information not being reflected in a timely manner. In addition, in the case of network congestion or limited bandwidth, it is difficult to dynamically adjust the priority of data streams, causing important data transmission to be affected, increasing the uncertainty and risk of information transmission. This results in reduced system efficiency and uneven resource utilization. Summary of the invention
[0005] The purpose of the present invention is to solve the shortcomings of the prior art and to propose a method and system for real-time display of electronic information.
[0006] In order to achieve the above object, the present invention adopts the following technical solution: a method for real-time display of electronic information, comprising the following steps:
[0007] S1: Receive data streams transmitted from the network, assign a unique identifier to each data packet, group them according to data characteristics, record data grouping information, and generate data stream classification results;
[0008] S2: Based on the data stream classification result, perform scene change detection on the audio and video data, record the urgency level and importance of each type of data, and generate an information urgency assessment result;
[0009] S3: adjusting the data stream transmission order based on the information urgency assessment result and the current network bandwidth status, and recording the order adjustment steps to generate a dynamic priority configuration result;
[0010] S4: performing frame analysis on the video data stream in the dynamic priority configuration result, extracting the frequency component of each frame, identifying key video frames by frequency intensity and change and recording parameters, and generating a frequency component extraction result;
[0011] S5: Based on the frequency component extraction result, according to the activity intensity of the changed area in the video, apply corresponding data rate encoding, record the frames and areas of encoding adjustment and the used data rate, and generate the area encoding adjustment result;
[0012] S6: According to the regional coding adjustment result and the dynamic priority configuration result, the dynamic frame rate of the video stream is adjusted according to the degree of scene change to generate an instant information display result.
[0013] The present invention has improvements in that the data stream classification result includes the identification label of the data group, the classification to which it belongs, and the source address information corresponding to each type of data; the information urgency assessment result includes the emergency response level of the data type, the data impact range, and the impact duration; the dynamic priority configuration result includes the priority sorting of the data type, the expected transmission time window, and the transmission path adjusted according to the network conditions; the frequency component extraction result includes the frequency range of the key video frame, the frequency peak position, and the contribution of the frequency component to the video content analysis; the regional coding adjustment result includes the data rate setting of the target area and the impact of the application setting on the video quality; the instant information display result includes the display quality of the adjusted video frame, the scene response speed, and the stability data of the output video stream.
[0014] The present invention is improved in that the specific steps of receiving a data stream transmitted from a network, assigning a unique identifier to each data packet, grouping data according to data characteristics, recording data grouping information, and generating a data stream classification result are as follows:
[0015] S101: receiving a data stream transmitted from a network, reading data packets one by one, and assigning a sequence number to each data packet to obtain a data packet identifier;
[0016] S102: using the data packet identifier, classifying the data according to the type and source address of the data packet, and grouping the data according to the video frame rate and resolution, to generate a data grouping index;
[0017] S103: Record each classification information, including the number of group members and data characteristics, through the data group index, and generate a data stream classification result.
[0018] The present invention is improved in that, based on the data stream classification result, scene change detection is performed on the audio and video data, the urgency level and importance of each type of data are recorded, and the specific steps of generating the information urgency assessment result are as follows:
[0019] S201: Based on the data stream classification result, analyze the audio and video data frame by frame, identify scene changes, and create indexes for the changed scenes to obtain scene change indexes;
[0020] S202: Using the scene change index, setting emergency levels and importance scores for multiple types of data according to the urgency and visual impact of key frames in the video stream, and generating an emergency level index;
[0021] S203: Record the emergency response level and impact range of each group of data through the emergency level index to obtain an information urgency assessment result.
[0022] The present invention is improved in that, in combination with the information urgency assessment result and the current network bandwidth status, the data stream transmission order is adjusted, and the order adjustment steps are recorded. The specific steps of generating the dynamic priority configuration result are as follows:
[0023] S301: Using the information urgency assessment result, real-time monitoring of the current network bandwidth status, dynamically matching the bandwidth with the data urgency level, and generating a basic dynamic priority index;
[0024] S302: reordering the audio and video data streams based on the basic dynamic priority index, performing transmission operations according to the data stream priorities, and generating a priority adjustment log;
[0025] S303: Arrange the priority adjustment log, record the adjustment steps and transmission time of each data flow, and generate a dynamic priority configuration result.
[0026] The present invention is improved in that the specific steps of performing frame analysis on the video data stream in the dynamic priority configuration result, extracting the frequency component of each frame, identifying the key video frame by the frequency intensity and change and recording the parameters, and generating the frequency component extraction result are as follows:
[0027] S401: Based on the dynamic priority configuration result, the video data stream is analyzed frame by frame, the frequency component of each frame is extracted by discrete cosine transform method, the key frequency value of each frame is recorded, and the frequency basic data is obtained;
[0028] S402: Analyze the frequency basic data, calibrate key frames according to the change amplitude, record the frequency intensity and change characteristics of the frames, and generate key frequency change information;
[0029] S403: Analyze all key frames using the key frequency change information, record the analysis results and key parameters, and generate frequency component extraction results.
[0030] The present invention is improved in that the discrete cosine transform method is according to the formula:
[0031]
[0032] Extract the frequency components of each frame;
[0033] Among them, F i ′(f) is the DCT coefficient of the i-th frame at frequency f, x is the index of the pixel position, P is the total number of pixels in the i-th frame, and a x is the brightness value of the pixel position x in the i-th frame, U is the urgency level of the data packet, T is the data packet type, S is the scene change index, B is the current network bandwidth, and f is the target frequency.
[0034] The present invention is improved in that, based on the frequency component extraction result, according to the activity intensity of the changed area in the video, the corresponding data rate encoding is applied, the encoding adjustment frame and area and the used data rate are recorded, and the specific steps of generating the area encoding adjustment result are as follows:
[0035] S501: Based on the frequency component extraction result, analyze the intensity of dynamic activities in the video regions one by one, evaluate and set the data rate requirement of each region according to the change of the dynamic activities, and generate a data rate allocation result;
[0036] S502: Using the data rate allocation result, adjust the data rate encoding of the video frame region by region, and generate a data rate adjustment record;
[0037] S503: Arrange the data rate adjustment records, record the encoding adjustment parameters and applied data rate of each video region, and obtain the regional encoding adjustment result.
[0038] The present invention is improved in that, according to the regional coding adjustment result and the dynamic priority configuration result, the dynamic frame rate of the video stream is adjusted according to the degree of scene change, and the specific steps of generating the instant information display result are as follows:
[0039] S601: Analyze scene changes in each video stream based on the region coding adjustment result and the dynamic priority configuration result, evaluate the impact of the scene change, capture the video stream frame rate that needs to be adjusted, and generate a frame rate adjustment list;
[0040] S602: Execute frame rate adjustment of the video stream according to the frame rate adjustment list, record each operation and adjustment data, and generate a frame rate adjustment record;
[0041] S603: Analyze the frame rate adjustment record, evaluate the display quality and stability of the adjusted video stream, and generate an instant information display result.
[0042] An electronic information instant display system, the system comprising:
[0043] The data classification module reads the data packets one by one based on the data stream transmitted from the network, assigns a sequence number to each data packet, classifies and groups the data packets according to their type and source address, and generates a data stream classification result;
[0044] The scene change assessment module analyzes the audio and video data frame by frame based on the data stream classification result, identifies scene changes, creates indexes for the changed scenes, sets priorities according to the urgency and visual impact of key frames, and generates urgency assessment results;
[0045] The priority allocation module monitors the current network bandwidth status in real time based on the urgency assessment result, dynamically matches the bandwidth with the data urgency level, reorders the audio and video data streams, records the priority adjustment log, and generates a dynamic priority configuration result;
[0046] The frequency analysis module analyzes the video data stream frame by frame based on the dynamic priority configuration result, extracts the frequency component of each frame, calibrates the key frame according to the frequency intensity and change, records the key parameters, and generates the frequency component extraction result;
[0047] The dynamic frame rate adjustment module analyzes the scene changes in the video stream based on the frequency component extraction results and the dynamic priority configuration results, evaluates their impact and captures the video stream frame rate that needs to be adjusted, performs frame rate adjustment of the video stream, records each operation and adjustment data, and generates instant information display results.
[0048] Compared with the prior art, the advantages and positive effects of the present invention are:
[0049] In the present invention, by evaluating the urgency level and importance of the data packet, the priority of the data packet is updated in real time, ensuring that key information can be processed first, thereby improving the response speed and data processing efficiency. The data stream transmission order is dynamically adjusted according to the network bandwidth situation, so that the system can flexibly adjust resource allocation according to actual network conditions. In addition, through the refined analysis and coding adjustment of the frequency components, the system can dynamically adjust the coding rate and frame rate according to the actual changes in the content, thereby optimizing data transmission and reducing bandwidth consumption. It is suitable for high-quality video transmission and real-time communication applications, providing users with a smoother and higher-quality visual experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] Figure 1 A flow chart of a method for real-time display of electronic information is proposed for the present invention;
[0051] Figure 2 This is a detailed flow chart of step S1 of the present invention;
[0052] Figure 3 This is a detailed flow chart of step S2 of the present invention;
[0053] Figure 4 This is a detailed flow chart of step S3 of the present invention;
[0054] Figure 5 This is a detailed flow chart of step S4 of the present invention;
[0055] Figure 6 This is a detailed flow chart of step S5 of the present invention;
[0056] Figure 7 This is a detailed flow chart of step S6 of the present invention;
[0057] Figure 8 A module diagram of an electronic information instant display system is proposed for the present invention. DETAILED DESCRIPTION
[0058] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0059] In the description of the present invention, it should be understood that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating positions or positional relationships, are based on the positions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, in the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.
[0060] See also Figure 1 The present invention provides a technical solution: a method for instant display of electronic information, comprising the following steps:
[0061] S1: Receive data streams transmitted from the network, assign a unique identifier to each data packet, group them according to data characteristics, record data grouping information, and generate data stream classification results;
[0062] S2: Based on the data stream classification results, the scene change detection is performed on the audio and video data, the urgency level and importance of each type of data is recorded, and the information urgency assessment results are generated;
[0063] S3: Based on the information urgency assessment result and the current network bandwidth status, the data stream transmission order is adjusted, and the order adjustment steps are recorded to generate a dynamic priority configuration result;
[0064] S4: Perform frame analysis on the video data stream in the dynamic priority configuration result, extract the frequency component of each frame, identify key video frames by frequency intensity and change, record parameters, and generate frequency component extraction results;
[0065] S5: Based on the frequency component extraction result, according to the activity intensity of the changed area in the video, apply the corresponding data rate encoding, record the encoding adjusted frames and areas and the used data rate, and generate the area encoding adjustment result;
[0066] S6: According to the regional coding adjustment result and the dynamic priority configuration result, the dynamic frame rate of the video stream is adjusted according to the degree of scene change, and an instant information display result is generated.
[0067] The data stream classification results include the identification label of the data group, the classification it belongs to, and the source address information corresponding to each type of data. The information urgency assessment results include the emergency response level of the data type, the data impact scope, and the impact duration. The dynamic priority configuration results include the priority sorting of the data type, the expected transmission time window, and the transmission path adjusted according to the network conditions. The frequency component extraction results include the frequency range of the key video frames, the frequency peak position, and the contribution of the frequency component to the video content analysis. The regional coding adjustment results include the data rate setting of the target area and the impact of the application settings on the video quality. The real-time information display results include the display quality of the adjusted video frames, the scene response speed, and the stability data of the output video stream.
[0068] See also Figure 2 , receiving the data stream transmitted from the network, assigning a unique identifier to each data packet, grouping according to data characteristics, recording data grouping information, and generating data stream classification results. The specific steps are as follows:
[0069] S101: receiving a data stream transmitted from a network, reading data packets one by one, and assigning a sequence number to each data packet to obtain a data packet identifier;
[0070] Receiving Data Streams and Assigning Sequence Numbers When data streams arrive through a network interface, the system assigns a unique sequence number to each packet. j is the time when the jth data packet arrives, x j is the corresponding sequence number. The sequence number increases one by one according to the order in which the data packets arrive to ensure the uniqueness of each data packet. The sequence number allocation can be expressed by the following formula: j =x j-1 +1,x jrepresents the sequence number of the jth data packet, x j-1 is the sequence number of the previous packet. Starting from the first packet, the sequence number is incremented for each packet that arrives.
[0071] S102: using data packet identifiers, classifying data according to data packet types and source addresses, and grouping data according to video frame rates and resolutions, and generating data grouping indexes;
[0072] Classification and Grouping The received data packets are classified according to the source address and type. j and v j Respectively represent the type and source address of the jth data packet. Packets are grouped according to type and source address, and frame rate f and resolution r are further considered. The classification and grouping process can be defined by the following formula: g k represents the number of packets belonging to the kth class, n is the total number of packets, θ f and θ r is the threshold of frame rate and resolution. This formula ensures that data packets are accurately classified and grouped according to the preset criteria.
[0073] S103: The process of recording each classification information, including the number of group members and data characteristics, through the data group index to generate the data flow classification result is as follows;
[0074] Record classification information For each classification, count the number of members and calculate the average frame rate and resolution. Let m k represents the number of packets in the kth class, φ f and φ r are the average frame rate and resolution in this category respectively. The calculation process can be expressed as: m k represents the number of packets of a specific category, φ f and φ r It is the calculated average frame rate and resolution, which ensures that detailed data feature information is provided for subsequent steps.
[0075] See also Figure 3 ,Based on the data stream classification results, the scene change detection is performed on the audio and video data, the urgency level and importance of each type of data are recorded, and the specific steps for generating the information urgency assessment results are as follows:
[0076] S201: Based on the data stream classification result, the audio and video data are analyzed frame by frame, scene changes are identified, and indexes are created for the changed scenes. The process of obtaining the scene change index is as follows;
[0077] Analyze audio and video data frame by frame to identify scene changes.i represents the brightness level of the i-th frame, H in Represents the color histogram value of the nth color channel in the i-th frame. The detection of scene changes is defined as calculating the difference between consecutive frames:
[0078] Δ i Indicates the degree of scene change between the i-th frame and the previous frame i-1, L i and L i-1 are the brightness levels of two consecutive frames, H in and H i-1,n is the color histogram value of the corresponding color channel, and M is the total number of color channels. i If it exceeds a predetermined threshold θ, it is considered that a significant scene change has occurred in the i-th frame. This threshold is used to identify important visual changes.
[0079] S202: Using scene change index, according to the urgency and visual impact of key frames in the video stream, multiple types of data are set with urgency level and importance score, and the process of generating urgency level index is as follows;
[0080] Set the emergency level and importance score according to the scenario change indicator Δ i , set the emergency level U for each detected scene change frame i And visual impact V i The urgency level and visual impact scores are calculated using the following formula: i =α·U i +β·V i , where U i =Δ i ,V i =max(Δ i-1 ,Δ i ,Δ i+1 ), E i is the urgency level index of the i-th frame, U i Directly from Δ i Decision, indicating the urgency of the scene change, V i The maximum change of the frames before and after the i-frame is considered to capture the strongest visual impact. The weights α and β adjust the influence of urgency level and visual impact on the total score.
[0081] S203: The process of recording the emergency response level and impact scope of each set of data through the emergency level index and obtaining the information urgency assessment result is as follows;
[0082] Record the emergency response level and impact range for each frame's emergency level index E i , evaluate and record the emergency response level and impact range of the data, and perform the following calculations: P represents the weighted sum of the emergency response levels of all frames, Q is the maximum emergency response level of these frames, ω i is the weight of the i-th frame, and N is the total number of analyzed frames. These calculations help quantify the overall urgency and potential impact of the video stream, thereby formulating effective response measures.
[0083] See also Figure 4 , combined with the information urgency assessment results and the current network bandwidth conditions, adjust the data stream transmission order and record the order adjustment steps. The specific steps to generate the dynamic priority configuration results are as follows:
[0084] S301: Using the information urgency assessment result, real-time monitoring of the current network bandwidth status, dynamic matching based on bandwidth and data urgency level, and generating a basic dynamic priority index process;
[0085] Using the information urgency evaluation result E calculated in the previous step i , which is the urgency score of the i-th frame, combined with the available bandwidth B of the current network, to dynamically match the priority. Set η i is the priority index of the i-th frame calculated based on bandwidth and urgency, and the calculation formula is as follows: E i represents the emergency level score of the i-th frame, is the sum of the urgency scores of all frames, B is the currently available network bandwidth, and N is the total number of frames. This formula calculates the bandwidth priority share of each frame data by multiplying the ratio of the urgency score of each frame to the sum of the total urgency scores by the current bandwidth.
[0086] S302: based on the basic dynamic priority index, reorder the audio and video data streams, perform transmission operations according to the data stream priorities, and generate a priority adjustment log;
[0087] The reordering and transmission operations of audio and video data streams are based on the calculated priority index η i , the system reorders the audio and video data streams. Set σ as the sorted data stream sequence, and use the following formula to prioritize the data streams: σ(i) is the data stream at position i in the sequence after reordering, and the argmax function is used to select the data stream with the largest η k The data flow with high value is guaranteed to be transmitted first.
[0088] S303: Arranging the priority adjustment log, recording the adjustment steps and transmission time of each data flow, and generating the dynamic priority configuration result;
[0089] Record the adjustment steps and estimated transmission time for each data flow. Set τ iis the estimated transmission time of the i-th data stream calculated according to the priority index, and the calculation formula is: Here, τ i represents the estimated transmission time of the i-th data stream, η i is the priority index of the i-th data stream, and C is an adjustment factor used to convert bandwidth priority into a specific time measurement, reflecting that higher priority data streams will enjoy faster transmission speeds.
[0090] See also Figure 5 , perform frame analysis on the video data stream in the dynamic priority configuration result, extract the frequency components of each frame, identify key video frames by frequency intensity and change, and record the parameters. The specific steps to generate the frequency component extraction result are as follows:
[0091] S401: Based on the dynamic priority configuration result, the video data stream is analyzed frame by frame, the frequency component of each frame is extracted by discrete cosine transform method, and the key frequency value of each frame is recorded to obtain the frequency basic data;
[0092] A discrete cosine transform is performed on each frame of the video data stream to extract the frequency components.
[0093] Discrete cosine transform method, according to the formula:
[0094]
[0095] Extract the frequency components of each frame;
[0096] Among them, F i ′(f) is the improved DCT coefficient of the i-th frame at frequency f, which is used to describe the frequency characteristics after considering the emergency level, data type and scene change. x is the index of the pixel position, which is used to traverse all pixels in the frame and exists as a variable in the summation expression. P is the total number of pixels in the i-th frame. a x is the brightness value of the pixel position x in the i-th frame, which is the brightness information of a specific pixel in the video frame. U is the urgency level of the data packet, which affects the weight of the pixel in the frequency component calculation and reflects the priority processing of emergency information. T is the data packet type. Depending on the data type, the contribution to the frequency component is also different, reflecting the impact of the data type on the processing priority. S is the scene change index, which indicates the magnitude of the scene change and is used for weighting in the frequency component calculation to ensure that the scene change is properly reflected. B is the current network bandwidth, which is used to adjust the denominator in the cosine transform and reflects the impact of the network bandwidth on the frequency component calculation. f is the target frequency, which is used to specify the frequency components to be calculated in the discrete cosine transform.
[0097] The calculation process is as follows:
[0098] Brightness value a x :
[0099] is the brightness value at each pixel position x in the video frame. It is assumed that the values have been obtained by the image capture hardware and are used as data input.
[0100] Packet urgency level U and packet type T:
[0101] U and T are extracted from the metadata of the video stream. It is assumed that U is calculated by analyzing the priority field in the packet header, where a higher value indicates a higher urgency level. T represents the packet type, such as video, audio, or control data, which is classified according to the identifier in the packet header. It is assumed that different types of packets correspond to different processing weights, such as T is 2 for video packets and 1 for audio packets.
[0102] Scene change index S:
[0103] Assume that S is calculated by analyzing the pixel differences between consecutive frames, for example, by calculating the rate of change of pixel brightness between the previous and next frames and then taking the average.
[0104] Network bandwidth B:
[0105] B can be obtained in real time through network monitoring tools, or through statistical data of network interfaces.
[0106] Calculate F i ′(f):
[0107] For each frame i and each frequency f, we first calculate the impact factor (a x ·U·T+S). Here, the brightness value of each pixel is a x It is weighted by U and T, and the scene change index S is added to reflect the relative importance of each pixel in the frame under the current network conditions and the importance of the data packet. Then, the cosine function in the discrete cosine transform is used to calculate the value of each frequency component. The parameters of the cosine function are adjusted by the current network bandwidth B to adapt to changes in network conditions.
[0108] The calculated F i ′(f) describes the transformation coefficients of the video frame at different frequencies, taking into account the urgency, type, scene changes, and network bandwidth of the data packet. This allows the system to process and optimize the video data more accurately, dynamically adjusting the data transmission according to the real-time network conditions and the importance of the content. This approach can not only improve the quality and stability of the video stream, but also optimize the use of network resources, ensuring that critical content can still maintain a high quality when the network is congested.
[0109] S402: Analyze frequency basic data, calibrate key frames according to the change amplitude, record the frequency intensity and change characteristics of the frame, and generate key frequency change information;
[0110] Calibrate the key frames and record the frequency intensity and change characteristics. i (f) Analysis: The system calibrates the key frames and records the frequency change characteristics of each frame. Define the key frequency change index G i As follows: G i =max f |F i (f)-F i-1 (f)|,G i is the key frequency change index of the i-th frame, indicating the maximum frequency change. max is a mathematical operation for finding the maximum value under specified conditions. f is a frequency index used to compare the difference in DCT coefficients of two consecutive frames at the same frequency.
[0111] S403: Analyze all key frames using key frequency change information, record analysis results and key parameters, and generate frequency component extraction results;
[0112] Analyze all key frames and summarize the frequency component analysis results. i Representing this summary data: H i is the frequency content summary of the i-th frame weighted by the frequency variation index. Q is the highest frequency range considered, ensuring that the analysis covers all relevant frequencies. f is the frequency index used to traverse all considered frequency ranges.
[0113] See also Figure 6 , based on the frequency component extraction results, according to the activity intensity of the changed area in the video, the corresponding data rate encoding is applied, and the encoding adjustment frames and areas and the used data rate are recorded. The specific steps for generating the regional encoding adjustment results are as follows:
[0114] S501: Based on the frequency component extraction result, the dynamic activity intensity in the video area is analyzed one by one, and the data rate requirement of each area is evaluated and set according to the change size of the dynamic activity. The process of generating the data rate allocation result is as follows;
[0115] Analyze the dynamic activity intensity of each video area based on the frequency component extraction results, and set the data rate requirement accordingly. ra represents the dynamic activity intensity of region r on frequency component a, R r is the corresponding data rate requirement. The calculation formula for the data rate requirement is A r Represents the total number of frequency components considered in region r. ω a Indicates the weight of the impact of frequency component a on the data rate requirement. ra The intensity of dynamic activity of region r on frequency component a obtained from frequency component analysis.r The final data rate requirement of region r. a is the index used to iterate each frequency component in region r.
[0116] S502: Using the data rate allocation result, the data rate encoding of the video frame is adjusted region by region, and the process of generating a data rate adjustment record is as follows;
[0117] Based on the data rate requirement R of each area r , adjust the data rate encoding of the video frame. The adjusted data rate D r Calculate using the following formula: D r =R r γ r , γ r Represents the adjustment coefficient of region r, which adjusts the final data rate according to the regional characteristics. r is the adjusted data rate for region r.
[0118] S503: sorting data rate adjustment records, recording the encoding adjustment parameters and applied data rates of each video region, and obtaining the regional encoding adjustment results;
[0119] Record and organize the encoding adjustment parameters and applied data rate of each video area. The encoding adjustment result C of each area r Calculated by the following formula: D ra represents the data rate of region r after frequency component a is adjusted. r is the encoding adjustment result of region r, which is the average value of all adjusted data rates.
[0120] See also Figure 7 , according to the regional coding adjustment results and dynamic priority configuration results, the dynamic frame rate of the video stream is adjusted according to the degree of scene change, and the specific steps for generating instant information display results are as follows:
[0121] S601: Based on the regional coding adjustment result and the dynamic priority configuration result, the scene change in each video stream is analyzed, the impact of the scene change is evaluated, the frame rate of the video stream to be adjusted is captured, and the process of generating a frame rate adjustment list is as follows;
[0122] Analyze the scene changes in each video stream and evaluate the impact of these changes on the frame rate of the video stream. v,t represents the scene change index of the video stream v at time t, F V Indicates the frame rate that the video stream v needs to adjust. The calculation formula is: Z v,t T is the scene change index of the video stream v at time t. V is the time series index set of the video stream v. Vis the final adjusted frame rate of the video stream v, based on the maximum value of the scene change index.
[0123] S602: Execute frame rate adjustment of the video stream according to the frame rate adjustment list, record each operation and adjustment data, and generate a frame rate adjustment record;
[0124] Perform frame rate adjustment of video streams Perform frame rate adjustment of each video stream according to the frame rate adjustment list. Record the adjustment operation and data for each video stream v. Let Θ V To record the adjustment of the video stream v, use the following formula to record the adjustment operation: Θ V is the average adjusted frame rate of the video stream v. |T v | is the total number of time frames of the video stream v.
[0125] S603: The process of analyzing the frame rate adjustment record, evaluating the display quality and stability of the adjusted video stream, and generating an instant information display result is as follows;
[0126] Analyze the frame rate adjustment records Analyze the frame rate adjustment records of each video stream and evaluate the display quality and stability of the video stream after adjustment. v is the display quality evaluation result of the video stream v, and the calculation formula is: Θ v,t is the adjusted frame rate of the video stream v at time t. Q v is the average display quality assessment result of the video stream v.
[0127] See also Figure 8 , an electronic information instant display system, the system comprising:
[0128] The data classification module reads the data packets one by one based on the data stream transmitted from the network, assigns a sequence number to each data packet, classifies and groups the data packets according to their type and source address, and generates a data stream classification result;
[0129] The scene change assessment module analyzes the audio and video data frame by frame based on the data stream classification results, identifies scene changes, creates indexes for the changed scenes, sets priorities based on the urgency and visual impact of key frames, and generates urgency assessment results;
[0130] Based on the urgency assessment results, the priority allocation module monitors the current network bandwidth status in real time, dynamically matches the bandwidth with the data urgency level, reorders the audio and video data streams, records the priority adjustment log, and generates dynamic priority configuration results;
[0131] The frequency analysis module analyzes the video data stream frame by frame based on the dynamic priority configuration results, extracts the frequency components of each frame, calibrates key frames according to frequency intensity and changes, records key parameters, and generates frequency component extraction results;
[0132] The dynamic frame rate adjustment module analyzes the scene changes in the video stream based on the frequency component extraction results and the dynamic priority configuration results, evaluates their impact and captures the video stream frame rate that needs to be adjusted, performs the frame rate adjustment of the video stream, records each operation and adjustment data, and generates instant information display results.
[0133] The above are only preferred embodiments of the present invention and are not intended to limit the present invention in other forms. Any technician familiar with the profession may use the technical contents disclosed above to change or modify them into equivalent embodiments with equivalent changes and apply them to other fields. However, any simple modification, equivalent change and modification made to the above embodiments based on the technical essence of the present invention without departing from the technical solution of the present invention still falls within the protection scope of the technical solution of the present invention.
Claims
1. A method for real-time display of electronic information, characterized in that: The following steps are involved: Receive data streams transmitted from the network, assign a unique identifier to each data packet, group them according to data characteristics, record data grouping information, and generate data stream classification results; Based on the data stream classification result, scene change detection is performed on the audio and video data, the urgency level and importance of each type of data are recorded, and an information urgency assessment result is generated; In combination with the information urgency assessment result and the current network bandwidth status, the data stream transmission order is adjusted, and the order adjustment steps are recorded to generate a dynamic priority configuration result; Performing frame analysis on the video data stream in the dynamic priority configuration result, extracting the frequency component of each frame, identifying key video frames by frequency intensity and change and recording parameters, and generating a frequency component extraction result; Based on the frequency component extraction result, according to the activity intensity of the changed area in the video, the corresponding data rate encoding is applied, the encoding adjustment frame and area and the used data rate are recorded, and the area encoding adjustment result is generated; According to the regional coding adjustment result and the dynamic priority configuration result, the dynamic frame rate of the video stream is adjusted according to the degree of scene change to generate an instant information display result.
2. The method for real-time display of electronic information according to claim 1, characterized in that: The data stream classification result includes the identification label of the data group, the classification it belongs to, and the source address information corresponding to each type of data; the information urgency assessment result includes the emergency response level of the data type, the data impact range, and the impact duration; the dynamic priority configuration result includes the priority sorting of the data type, the expected transmission time window, and the transmission path adjusted according to the network conditions; the frequency component extraction result includes the frequency range of the key video frame, the frequency peak position, and the contribution of the frequency component to the video content analysis; the regional coding adjustment result includes the data rate setting of the target area and the impact of the application settings on the video quality; the instant information display result includes the display quality of the adjusted video frame, the scene response speed, and the stability data of the output video stream.
3. The method for real-time display of electronic information according to claim 1, characterized in that: The specific steps of receiving data streams transmitted from the network, assigning a unique identifier to each data packet, grouping them according to data characteristics, recording data grouping information, and generating data stream classification results are as follows: Receive the data stream transmitted from the network, read the data packets one by one, and assign a sequence number to each data packet to obtain the data packet identifier; Using the data packet identifier, classifying the data according to the type and source address of the data packet, and grouping the data according to the video frame rate and resolution, to generate a data grouping index; Through the data grouping index, each classification information is recorded, including the number of group members and data characteristics, to generate a data stream classification result.
4. The method for real-time display of electronic information according to claim 1, characterized in that: Based on the data stream classification results, the specific steps of performing scene change detection on the audio and video data, recording the urgency level and importance of each type of data, and generating the information urgency assessment results are as follows: Based on the data stream classification result, analyzing the audio and video data frame by frame, identifying scene changes, and creating indexes for the changed scenes to obtain scene change indexes; Using the scene change index, setting emergency levels and importance scores for multiple types of data according to the urgency and visual impact of key frames in the video stream, and generating an emergency level index; The emergency response level and impact range of each set of data are recorded through the emergency level index to obtain the information urgency assessment result.
5. The method for real-time display of electronic information according to claim 1, characterized in that: Combined with the information urgency assessment result and the current network bandwidth status, the data stream transmission order is adjusted, and the order adjustment steps are recorded. The specific steps of generating the dynamic priority configuration result are as follows: Using the information urgency assessment results, the current network bandwidth status is monitored in real time, and a basic dynamic priority index is generated based on the dynamic matching of bandwidth and data urgency level; Based on the basic dynamic priority index, reorder the audio and video data streams, perform transmission operations according to the data stream priorities, and generate a priority adjustment log; The priority adjustment log is sorted, the adjustment steps and transmission time of each data flow are recorded, and a dynamic priority configuration result is generated.
6. The method for real-time display of electronic information according to claim 1, characterized in that: The specific steps of performing frame analysis on the video data stream in the dynamic priority configuration result, extracting the frequency component of each frame, identifying key video frames by frequency intensity and change and recording parameters, and generating the frequency component extraction result are as follows: Based on the dynamic priority configuration result, the video data stream is analyzed frame by frame, the frequency component of each frame is extracted by discrete cosine transform method, the key frequency value of each frame is recorded, and the frequency basic data is obtained; Analyze the frequency basic data, calibrate key frames according to the change amplitude, record the frequency intensity and change characteristics of the frames, and generate key frequency change information; Utilizing the key frequency change information, all key frames are analyzed, the analysis results and key parameters are recorded, and frequency component extraction results are generated.
7. The method for real-time display of electronic information according to claim 6, characterized in that: The discrete cosine transform method is according to the formula: Extract the frequency components of each frame; Among them, F i ′(f) is the DCT coefficient of the i-th frame at frequency f, x is the index of the pixel position, P is the total number of pixels in the i-th frame, and a x is the brightness value of the pixel position x in the i-th frame, U is the urgency level of the data packet, T is the data packet type, S is the scene change index, B is the current network bandwidth, and f is the target frequency.
8. The method for real-time display of electronic information according to claim 1, characterized in that: Based on the frequency component extraction result, according to the activity intensity of the changed area in the video, the corresponding data rate encoding is applied, the encoding adjustment frame and area and the used data rate are recorded, and the specific steps of generating the area encoding adjustment result are as follows: Based on the frequency component extraction result, the dynamic activity intensity in each video area is analyzed one by one, and the data rate requirement of each area is evaluated and set according to the change size of the dynamic activity to generate a data rate allocation result; Using the data rate allocation result, adjusting the data rate encoding of the video frame region by region, and generating a data rate adjustment record; The data rate adjustment records are sorted out, the encoding adjustment parameters and the applied data rate of each video region are recorded, and the regional encoding adjustment result is obtained.
9. The method for real-time display of electronic information according to claim 1, characterized in that: According to the regional coding adjustment result and the dynamic priority configuration result, the specific steps of adjusting the dynamic frame rate of the video stream according to the degree of scene change and generating the instant information display result are as follows: Based on the regional coding adjustment result and the dynamic priority configuration result, analyzing the scene changes in each video stream, evaluating the impact of the scene changes, capturing the video stream frame rate that needs to be adjusted, and generating a frame rate adjustment list; According to the frame rate adjustment list, the frame rate of the video stream is adjusted, each operation and adjustment data are recorded, and a frame rate adjustment record is generated; The frame rate adjustment record is analyzed, the display quality and stability of the adjusted video stream are evaluated, and an instant information display result is generated.
10. An electronic information real-time display system, characterized in that: According to any one of claims 1 to 9, the method for real-time display of electronic information is implemented, and the system comprises: The data classification module reads the data packets one by one based on the data stream transmitted from the network, assigns a sequence number to each data packet, classifies and groups the data packets according to their type and source address, and generates a data stream classification result; The scene change assessment module analyzes the audio and video data frame by frame based on the data stream classification result, identifies scene changes, creates indexes for the changed scenes, sets priorities according to the urgency and visual impact of key frames, and generates urgency assessment results; The priority allocation module monitors the current network bandwidth status in real time based on the urgency assessment result, dynamically matches the bandwidth with the data urgency level, reorders the audio and video data streams, records the priority adjustment log, and generates a dynamic priority configuration result; The frequency analysis module analyzes the video data stream frame by frame based on the dynamic priority configuration result, extracts the frequency component of each frame, calibrates the key frame according to the frequency intensity and change, records the key parameters, and generates the frequency component extraction result; The dynamic frame rate adjustment module analyzes the scene changes in the video stream based on the frequency component extraction results and the dynamic priority configuration results, evaluates their impact and captures the video stream frame rate that needs to be adjusted, performs frame rate adjustment of the video stream, records each operation and adjustment data, and generates instant information display results.
Citation Information
Cited By
Surveying and mapping geographic space big data processing method and system
CN122132773A
