Computer graphic image transmission system

By employing adaptive compression and dynamic transmission strategies, and combining cloud and edge computing to optimize image transmission, the problem of image transmission latency and stuttering under limited network bandwidth has been solved, achieving efficient and secure image data transmission.

CN119052484AInactive Publication Date: 2024-11-29LULIANG UNIV
View PDF 0 Cites 4 Cited by

Patent Information

Application Number
CN202411175940.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-26
Publication Date
2024-11-29
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In situations where network bandwidth is limited or the network is unstable, existing technologies suffer from delays and stuttering in image transmission, causing users to wait too long or be unable to view image information normally.

Method used

Data compression is achieved using an image compression module, which, combined with an image transmission module, a cloud processing module, and an edge computing module, optimizes the image transmission process through adaptive compression algorithms and dynamic transmission strategies. The computing collaboration module dynamically allocates tasks, and the security and privacy protection module ensures data security.

Benefits of technology

It enables efficient transmission of image data under limited network conditions, reduces latency and stuttering, improves user experience, and ensures image quality and security.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119052484A_ABST
    Figure CN119052484A_ABST
Patent Text Reader

Abstract

The invention discloses a transmission system for computer graphics and images. The transmission system comprises an image compression module which is responsible for compressing original image data through a compression algorithm; the image transmission module is responsible for transmitting the compressed image data to target equipment or a system through a network; the cloud processing module is responsible for performing complex image processing tasks at the cloud; the edge calculation module is responsible for performing a real-time or low-delay image processing task at the edge of the network; the computing collaboration module is responsible for dynamically distributing the tasks to the cloud processing module or the edge computing module by analyzing task types and priorities; the user interaction module is responsible for providing an interaction interface; according to the invention, discrete cosine transform (DCT) and discrete wavelet transform (DWT) are built in the image compression module, a user can select the most suitable algorithm according to the actual demand, and meanwhile, the image compression module can analyze the image content and automatically adjust the compression parameters to achieve the balance between the optimal compression effect and the image quality.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of graphic image transmission technology, and in particular to a transmission system for computer graphic images. Background Art

[0002] Graphics and image processing technology is to digitally process and analyze graphics and images, extract useful information from them, or modify, enhance, compress and perform other operations on images to meet specific application requirements. The transmission system is part of the data communication system, which is responsible for connecting the source and destination ends in the communication system to achieve data transmission and exchange. In the application of computer graphics and images, a large amount of graphic image data needs to be transmitted between different devices or systems. Transmission systems for computer graphics and images came into being.

[0003] After searching, the invention patent with Chinese patent publication number CN116156068A discloses an image transmission method, device, computer equipment and storage medium, which belongs to the field of computer application technology. The method includes: obtaining an image transmission request sent by a client; the image transmission request carries image identification information and identification information related to a specified sub-region; determining a target image according to the image identification information, the target image includes multiple sub-regions; determining a specified sub-region from the multiple sub-regions according to the identification information related to the specified sub-region; in response to the image transmission request, sending the image information corresponding to the specified sub-region to the client in a full transmission mode, and sending the image information corresponding to other sub-regions in the target image other than the specified sub-region to the client in a component transmission mode.

[0004] Compared with the prior art, the invention patent with Chinese patent publication number CN116156068A, when performing image transmission, uses a full transmission method to send image information corresponding to a specified sub-region to the client, and uses a component transmission method to send image information corresponding to other sub-regions other than the specified sub-region in the target image to the client. Since a part of the sub-regions use the component transmission method to send the corresponding image information to the client, compared with the prior art that all sub-regions use the full transmission method, when the embodiment of the present application performs image transmission, the amount of data transmitted is reduced, and therefore, the transmission time is shortened. Accordingly, the waiting time when the client displays the target image is also shortened.

[0005] However, during the use of the above-mentioned device, although part of the bandwidth is saved through component transmission, when the network bandwidth is limited, even if component transmission is adopted, it may result in slow transmission speed and affect the user experience, especially when high-definition or ultra-high-definition image transmission, even if only part of the image information is transmitted, the data volume may still be very large, and the bandwidth requirement is high. When the network bandwidth is limited or the network is unstable, transmission delays and freezes are common problems, which will cause users to wait too long or be unable to view the image information normally. Therefore, a transmission system for computer graphics images is proposed. Summary of the invention

[0006] The purpose of the present invention is to solve the problems existing in the prior art, that is, when the network bandwidth is limited or the network is unstable, transmission delay and freeze are common problems, which will cause users to wait too long or be unable to view image information normally, and to propose a transmission system for computer graphics images.

[0007] In order to achieve the above object, the present invention adopts the following technical solutions:

[0008] A transmission system for computer graphics images, comprising:

[0009] Image compression module: responsible for compressing the original image data through compression algorithm to reduce the data size for easy storage and transmission;

[0010] Image transmission module: responsible for transmitting the compressed image data to the target device or system through the network;

[0011] Cloud processing module: responsible for performing complex image processing tasks in the cloud;

[0012] Edge computing module: responsible for real-time or low-latency image processing tasks at the edge of the network (such as smart devices, terminals, etc.);

[0013] Computing coordination module: responsible for dynamically allocating tasks to the cloud processing module or edge computing module by analyzing task types and priorities;

[0014] User interaction module: responsible for providing the interactive interface;

[0015] Security and privacy protection module: responsible for ensuring the security and privacy of image data during transmission and storage;

[0016] The image compression module passes the compressed image data to the image transmission module, and the image transmission module sends the image data to the computing collaboration module. The computing collaboration module assigns the task to the cloud processing module or the edge computing module according to the task type and priority. The cloud processing module or the edge computing module returns the execution result (such as the processing result, execution status, etc.) to the computing collaboration module, and the cloud processing module or the edge computing module returns the processing result (such as the image analysis result, the enhanced image, etc.) to the user interaction module. The user inputs the image data or sets the processing parameters through the user interaction module, and the input image data or the set processing parameters are passed to the image compression module or the image transmission module for processing.

[0017] The above technical solution further includes:

[0018] Furthermore, the image compression module includes an input unit, a preprocessing unit, a compression algorithm selection unit, a compression processing unit, a real-time preview unit and an output unit. The input unit is responsible for receiving image data uploaded by a user. The input unit passes the image data to the preprocessing unit for necessary format conversion and preparation. The preprocessing unit is responsible for performing preprocessing operations such as format conversion and size adjustment on the input image data. The preprocessing unit passes the preprocessed image data to the compression algorithm selection unit. The compression algorithm selection unit is responsible for selecting a suitable compression algorithm according to user selection or system recommendation. The compression algorithm selection unit passes the selected compression algorithm and the preprocessed image data to the compression processing unit. The compression processing unit is responsible for executing the selected compression algorithm and compressing the image data. During the compression process, the compression processing unit dynamically adjusts the compression parameters according to the adaptive compression parameter adjustment mechanism. The compression processing unit transmits the compressed image data and the compression parameter information to the real-time preview unit and the output unit. The real-time preview unit is responsible for receiving the compressed image data and the compression parameter information transmitted by the compression processing unit, generating a real-time compression preview, and displaying it to the user for viewing. The user can adjust the compression parameters through the interface and preview the adjusted effect in real time. The output unit is responsible for receiving the final compressed image data transmitted by the compression processing unit, and saving the compressed image data to a local storage device or sending it to the image transmission module.

[0019] Furthermore, the compression algorithm selection unit includes DCT and DWT, the DCT is used in JPEG compression, and the DWT multi-scale analysis capability performs better in certain scenarios. The specific process of the compression processing unit adjusting the adaptive compression parameters is as follows:

[0020] Image segmentation: Divide an image into multiple regions or blocks so that each region can be processed independently. These regions can be divided based on characteristics such as texture and color.

[0021] Feature extraction: Extract key features from each region, such as texture complexity, color distribution, edge information, etc. The key features are used for subsequent adaptive parameter adjustment;

[0022] Adaptive parameter adjustment: After DCT or DWT transformation, the quantization step size is adjusted according to the characteristics of the region. For example, for areas with complex textures, a smaller quantization step size can be used to retain more details; for smooth areas, a larger quantization step size can be used to reduce the amount of data. In DWT transformation, unimportant high-frequency information is removed by setting different thresholds, and the thresholds are dynamically adjusted according to the characteristics of the region;

[0023] Coding algorithm: Select a coding algorithm to encode the quantized coefficients, such as Huffman coding, arithmetic coding, etc. The coding algorithm can further reduce data redundancy and improve the compression ratio;

[0024] Quality control: During the encoding process, the quality of the compressed image is monitored to ensure that the image quality remains within an acceptable range while achieving the predetermined compression ratio;

[0025] Decoding: Decode the compressed data to restore the original image or an approximate image;

[0026] Quality verification: Evaluate the effects of compression algorithms and adaptive parameter adjustments by comparing the original image and the decoded image, using various image quality assessment metrics such as peak signal-to-noise ratio (PSNR), structural similarity (SSIM), etc.

[0027] Performance optimization: According to the decoded image quality and compression ratio, the adaptive parameter adjustment strategy is optimized, including adjusting the segmentation strategy, feature extraction method, quantization step adjustment rules, etc.

[0028] Iterative processing: Through multiple iterative processing, the adaptive compression parameter adjustment strategy is continuously optimized to achieve the best balance between compression effect and image quality;

[0029] DCT as an example:

[0030] Image segmentation: divide the image into multiple 8x8 pixel blocks;

[0031] DCT transform: perform two-dimensional DCT transform on each pixel block;

[0032] Adaptive quantization: Calculate the average brightness or color value of each pixel block, select an appropriate quantization table (such as the quantization table in JPEG) based on the average value or other characteristics, and quantize the DCT coefficients. The quantization step size can be dynamically adjusted according to the characteristics of the pixel block;

[0033] Coding: Zigzag scanning, run-length coding, and Huffman coding are performed on the quantized coefficients to generate a compressed data stream;

[0034] Decoding and verification: Decode the compressed data and verify the compression effect using image quality assessment indicators.

[0035] Furthermore, the image transmission module includes a data encapsulation unit, an encryption unit, a transmission control unit, an intelligent component identification unit, a progressive transmission control unit and a dynamic transmission adjustment unit. The data encapsulation unit is responsible for encapsulating the compressed image data according to the requirements of the network transmission protocol. The data encapsulation unit transmits the encapsulated data packet to the encryption unit for encryption processing. The encryption unit is responsible for receiving the data packet transmitted by the data encapsulation unit and performing encryption processing. The encryption unit transmits the encrypted data packet to the transmission control unit for transmission. The transmission control unit is responsible for sending the encrypted data packet to the target device or system through the network. The intelligent component identification unit is responsible for identifying the image before or during transmission. The intelligent component recognition unit transmits the recognition result to the transmission control unit so as to give priority to the transmission of these key information. The progressive transmission control unit is responsible for implementing the progressive transmission strategy. The progressive transmission control unit divides the image data into multiple levels (such as contour, general information, detail information, etc.) and transmits them in sequence. The progressive transmission control unit transmits the layered information to the transmission control unit for actual transmission. The dynamic transmission adjustment unit is responsible for monitoring the network bandwidth and the processing capacity of the user equipment. The dynamic transmission adjustment unit dynamically adjusts the transmission speed and image quality parameters according to the monitoring results. The dynamic transmission adjustment unit transmits the adjusted parameters to the transmission control unit to realize dynamic transmission adjustment.

[0036] Furthermore, the image transmission module dynamically adjusts the transmission strategy according to the real-time situation of the network bandwidth, such as reducing the quality or quantity of the transmitted image when the network bandwidth is low to ensure the smoothness of the transmission, including the following steps:

[0037] Real-time monitoring of network bandwidth: Use network monitoring tools or algorithms to monitor the real-time status of network bandwidth in real time. You can use SNMP (Simple Network Management Protocol) to query the bandwidth usage of network devices, or use special network monitoring software to obtain the real-time value of the current network bandwidth, recorded as BW_current;

[0038] Set transmission strategy parameters: According to application requirements and network conditions, preset transmission strategy parameters under different network bandwidths, such as image quality, resolution, frame rate, etc. Set multiple bandwidth thresholds BW_threshold_i (i = 1, 2,..., n), each threshold corresponding to a set of transmission strategy parameters, and each set of strategy parameters includes image quality Q_i, resolution R_i, and frame rate F_i;

[0039] Judge and adjust the transmission strategy: Compare the real-time monitored network bandwidth BW_current with the preset bandwidth thresholds, and adjust the transmission strategy parameters according to the comparison results;

[0040] If BW_current < BW_threshold_1, then adopt the transmission strategy with the lowest quality, lowest resolution, and lowest frame rate (Q_1, R_1, F_1);

[0041] If BW_threshold_1 <= BW_current < BW_threshold_2, then adopt the transmission strategy with the second lowest quality (Q_2, R_2, F_2), and so on. If BW_current >= BW_threshold_n, then adopt the transmission strategy with the highest quality (Q_n, R_n, F_n);

[0042] Implement the adjusted transmission strategy: According to the adjusted transmission strategy parameters, process the data to be transmitted (such as compression, degradation, etc.), and perform the transmission operation. The processing methods include image compression, frame rate adjustment, and transmission execution;

[0043] Image compression: Compress according to the target resolution and image quality. Frame rate adjustment: Adjust the video frame rate through frame dropping or frame interpolation techniques. Transmission execution: Use an appropriate network protocol (such as TCP / IP) to transmit the processed data to the target end;

[0044] Feedback and optimization: Collect performance metrics during the transmission process (such as packet loss rate, latency, etc.), and continuously optimize the transmission strategy based on the feedback of the performance metrics. The optimization directions include: Adjusting the bandwidth thresholds and corresponding transmission strategy parameters according to the transmission effect; Introducing more advanced compression algorithms or transmission protocols to improve transmission efficiency; Using machine learning techniques to predict the network bandwidth change trend and adjusting the transmission strategy in advance.

[0045] Furthermore, the cloud processing module includes a cloud storage service, a cloud processing service, an algorithm library and a management console. The cloud storage service is responsible for storing and managing image data uploaded by users. The cloud storage service receives data and its parameters for cloud processing specified by the computing collaboration module, including tasks (such as image recognition, feature extraction), priority and other parameters, and provides the data and its parameters to the cloud processing service. The cloud processing service is responsible for performing image preprocessing, analysis and recognition, and enhancement. The cloud processing service interacts with the algorithm library and calls specific algorithms for image analysis. The management console is responsible for monitoring the operating status of the cloud processing service and the cloud storage service, managing the task queue, and configuring algorithm parameters.

[0046] Furthermore, the edge computing module includes edge nodes, smart terminals and network infrastructure. The edge nodes are responsible for executing real-time image processing tasks, caching popular data, and making intelligent decisions. The edge nodes transmit processing results (such as recognition results, analysis reports, etc.) to the smart terminals. The smart terminals are responsible for sending image data to edge nodes for processing and receiving processing results. The network infrastructure is responsible for recording information of electronic components to achieve real-time management and tracking of inventory. The optimization suggestion unit connects the communication network of edge nodes and smart terminals to ensure efficient transmission of data between units. The edge nodes communicate with other edge nodes and smart terminals through the network infrastructure.

[0047] Furthermore, the computing collaboration module includes a task request unit and a computing collaboration module. The task request unit is responsible for generating applications or devices for task requests, such as smart cameras, sensors, user applications, etc. The task request unit sends the task request to the computing collaboration module. The computing collaboration module is the core unit of task allocation, and contains an intelligent task allocation algorithm and a resource monitoring mechanism. The computing collaboration module receives task requests, performs task analysis and resource evaluation, and makes task allocation decisions. The computing collaboration module allocates tasks to the cloud processing module or the edge computing module based on the task allocation decision.

[0048] Furthermore, the security and privacy protection module includes a data encryption unit, an access control unit and a data backup and recovery unit. The data encryption unit is responsible for the implementation of the encryption algorithm and the management of the encryption key. The data encryption unit encrypts the data before data transmission and decrypts it at the receiving end. The access control unit is responsible for implementing identity authentication and authority management functions, verifying the user's identity and authority, and controlling access to image data. The data backup and recovery unit is responsible for regular data backup and recovery operations, and manages the storage location and recovery strategy of backup data.

[0049] The present invention has the following beneficial effects:

[0050] 1. In the present invention, the image compression module has built-in discrete cosine transform (DCT) and discrete wavelet transform (DWT). Users can choose the most appropriate algorithm according to actual needs. At the same time, it can analyze the image content and automatically adjust the compression parameters to achieve the best balance between compression effect and image quality.

[0051] 2. In the present invention, through intelligent component transmission, progressive transmission and dynamic transmission adjustment, the transmission process of image data is optimized, the transmission efficiency is improved, the transmission time is reduced, and the user experience is guaranteed.

[0052] 3. In the present invention, some computing-intensive tasks are migrated to the cloud for execution, and the powerful computing power and storage space of the cloud are utilized to reduce the burden on local devices. At the same time, edge nodes are deployed at the edge of the network to cache popular image data and process tasks with low latency requirements, reduce data transmission delays and improve response speed, intelligently determine task types and priorities, and assign suitable tasks to the cloud or edge nodes for processing, thereby achieving efficient use of resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 The present invention provides a system block diagram of a computer graphics image transmission system. DETAILED DESCRIPTION

[0054] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0055] See also Figure 1 As shown, the present invention is a transmission system for computer graphics images, comprising:

[0056] Image compression module: responsible for compressing the original image data through compression algorithm to reduce the data size for easy storage and transmission;

[0057] Image transmission module: responsible for transmitting the compressed image data to the target device or system through the network;

[0058] Cloud processing module: responsible for performing complex image processing tasks in the cloud;

[0059] Edge computing module: responsible for real-time or low-latency image processing tasks at the edge of the network (such as smart devices, terminals, etc.);

[0060] Computing coordination module: responsible for dynamically allocating tasks to the cloud processing module or edge computing module by analyzing task types and priorities;

[0061] User interaction module: responsible for providing the interactive interface;

[0062] Security and privacy protection module: responsible for ensuring the security and privacy of image data during transmission and storage;

[0063] The image compression module passes the compressed image data to the image transmission module, the image transmission module sends the image data to the computing collaboration module, the computing collaboration module assigns the task to the cloud processing module or the edge computing module according to the task type and priority, the cloud processing module or the edge computing module returns the execution result (such as processing result, execution status, etc.) to the computing collaboration module, the cloud processing module or the edge computing module returns the processing result (such as image analysis result, enhanced image, etc.) to the user interaction module, the user inputs image data or sets processing parameters through the user interaction module, and the input image data or set processing parameters are passed to the image compression module or the image transmission module for processing.

[0064] The working principle of a computer graphic image transmission system proposed by the present invention is that a user starts the system through a user interaction module and can select or input image data; an image compression module receives original image data from the user interaction module, compresses the image using a suitable compression algorithm according to a compression ratio or other compression parameters set by the user, and transmits the compressed image data to an image transmission module; before transmission, the image transmission module encrypts the image data according to instructions of a security and privacy protection module, and sends the encrypted (or unencrypted) compressed image data to a computing collaboration module through a network;

[0065] The computing collaboration module analyzes the received task types, such as image recognition, enhancement, analysis, etc., as well as their priorities. Based on the task characteristics and the current load of the cloud processing module and the edge computing module, it dynamically determines the task execution location and assigns the task to the cloud processing module or the edge computing module.

[0066] The cloud processing module or edge computing module receives the tasks assigned by the computing collaboration module, performs complex image processing tasks such as image recognition, enhancement, and analysis according to the task requirements, and returns the processing results to the computing collaboration module;

[0067] The computing collaboration module receives the processing results from the cloud processing module or the edge computing module and forwards the processing results to the user interaction module. The user interaction module displays the processing results to the user and collects the user's feedback on the processing results, including suggestions for reprocessing requests or adjusting parameters;

[0068] The security and privacy protection module monitors the transmission and storage process of image data to ensure compliance with security standards, provides data encryption services, protects the security of data during transmission and storage, and implements strict access control policies to ensure that only authorized users can access image data.

[0069] In one embodiment, for the above-mentioned image compression module, the image compression module includes an input unit, a preprocessing unit, a compression algorithm selection unit, a compression processing unit, a real-time preview unit and an output unit. The input unit is responsible for receiving the image data uploaded by the user, and the input unit passes the image data to the preprocessing unit for necessary format conversion and preparation. The preprocessing unit is responsible for performing preprocessing operations such as format conversion and size adjustment on the input image data. The preprocessing unit passes the preprocessed image data to the compression algorithm selection unit. The compression algorithm selection unit is responsible for selecting a suitable compression algorithm according to the user's selection or the system's recommendation. The compression algorithm selection unit passes the selected compression algorithm and the preprocessed image data to the compression algorithm selection unit. The processing unit is responsible for executing the selected compression algorithm and compressing the image data. During the compression process, the compression processing unit dynamically adjusts the compression parameters according to the adaptive compression parameter adjustment mechanism. The compression processing unit transmits the compressed image data and the compression parameter information to the real-time preview unit and the output unit. The real-time preview unit is responsible for receiving the compressed image data and the compression parameter information from the compression processing unit, generating a real-time compression preview, and displaying it to the user. The user can adjust the compression parameters through the interface and preview the adjusted effect in real time. The output unit is responsible for receiving the final compressed image data from the compression processing unit, and saving the compressed image data to the local storage device or sending it to the image transmission module.

[0070] In one embodiment, for the above-mentioned compression algorithm selection unit, the compression algorithm selection unit includes DCT and DWT. DCT is applied in JPEG compression. DWT multi-scale analysis capability performs better in some scenarios. The specific process of the compression processing unit adjusting according to the adaptive compression parameter is as follows:

[0071] Image segmentation: Divide an image into multiple regions or blocks so that each region can be processed independently. These regions can be divided based on characteristics such as texture and color.

[0072] Feature extraction: Extract key features from each region, such as texture complexity, color distribution, edge information, etc. The key features are used for subsequent adaptive parameter adjustment;

[0073] Adaptive parameter adjustment: After DCT or DWT transformation, the quantization step size is adjusted according to the characteristics of the region. For example, for areas with complex textures, a smaller quantization step size can be used to retain more details; for smooth areas, a larger quantization step size can be used to reduce the amount of data. In DWT transformation, different thresholds are set to remove unimportant high-frequency information, and the threshold is dynamically adjusted according to the characteristics of the region.

[0074] Coding algorithm: Select a coding algorithm to encode the quantized coefficients, such as Huffman coding, arithmetic coding, etc. The coding algorithm can further reduce data redundancy and improve the compression ratio;

[0075] Quality control: During the encoding process, the quality of the compressed image is monitored to ensure that the image quality remains within an acceptable range while achieving the predetermined compression ratio;

[0076] Decoding: Decode the compressed data to restore the original image or an approximate image;

[0077] Quality verification: Evaluate the effects of compression algorithms and adaptive parameter adjustments by comparing the original image and the decoded image, using various image quality assessment metrics such as peak signal-to-noise ratio (PSNR), structural similarity (SSIM), etc.

[0078] Performance optimization: According to the decoded image quality and compression ratio, the adaptive parameter adjustment strategy is optimized, including adjusting the segmentation strategy, feature extraction method, quantization step adjustment rules, etc.

[0079] Iterative processing: Through multiple iterative processing, the adaptive compression parameter adjustment strategy is continuously optimized to achieve the best balance between compression effect and image quality;

[0080] DCT as an example:

[0081] Image segmentation: divide the image into multiple 8x8 pixel blocks;

[0082] DCT transform: perform two-dimensional DCT transform on each pixel block;

[0083] Adaptive quantization: Calculate the average brightness or color value of each pixel block, select an appropriate quantization table (such as the quantization table in JPEG) based on the average value or other characteristics, and quantize the DCT coefficients. The quantization step size can be dynamically adjusted according to the characteristics of the pixel block;

[0084] Coding: Zigzag scanning, run-length coding, and Huffman coding are performed on the quantized coefficients to generate a compressed data stream;

[0085] Decoding and verification: Decode the compressed data and verify the compression effect using image quality assessment indicators.

[0086] In one embodiment, for the above-mentioned image transmission module, the image transmission module includes a data encapsulation unit, an encryption unit, a transmission control unit, an intelligent component identification unit, a progressive transmission control unit and a dynamic transmission adjustment unit. The data encapsulation unit is responsible for encapsulating the compressed image data according to the requirements of the network transmission protocol. The data encapsulation unit transmits the encapsulated data packet to the encryption unit for encryption processing. The encryption unit is responsible for receiving the data packet transmitted by the data encapsulation unit and performing encryption processing. The encryption unit transmits the encrypted data packet to the transmission control unit for transmission. The transmission control unit is responsible for sending the encrypted data packet to the target device or system through the network. The intelligent component identification unit is responsible for transmitting the encrypted data packet before or during transmission. During the transmission process, the important areas or feature points in the image are identified, and the intelligent component identification unit passes the identification results to the transmission control unit so as to give priority to the transmission of these key information. The progressive transmission control unit is responsible for implementing the progressive transmission strategy. The progressive transmission control unit divides the image data into multiple levels (such as contours, general information, detailed information, etc.) and transmits them in sequence. The progressive transmission control unit passes the layered information to the transmission control unit for actual transmission. The dynamic transmission adjustment unit is responsible for monitoring the network bandwidth and the processing capacity of the user equipment. The dynamic transmission adjustment unit dynamically adjusts the transmission speed and image quality parameters according to the monitoring results. The dynamic transmission adjustment unit passes the adjusted parameters to the transmission control unit to achieve dynamic transmission adjustment.

[0087] In one embodiment, for the above-mentioned image transmission module, the image transmission module dynamically adjusts the transmission strategy according to the real-time situation of the network bandwidth, such as reducing the quality or quantity of the transmitted image when the network bandwidth is low to ensure the smoothness of the transmission, including the following steps:

[0088] Real-time monitoring of network bandwidth: Use network monitoring tools or algorithms to monitor the real-time status of network bandwidth in real time. You can use SNMP (Simple Network Management Protocol) to query the bandwidth usage of network devices, or use special network monitoring software to obtain the real-time value of the current network bandwidth, recorded as BW_current;

[0089] Set transmission strategy parameters: according to application requirements and network conditions, preset transmission strategy parameters under different network bandwidths, such as image quality, resolution, frame rate, etc., set multiple bandwidth thresholds BW_threshold_i (i=1,2,...,n), each threshold corresponds to a set of transmission strategy parameters, each set of strategy parameters includes image quality Q_i, resolution R_i, frame rate F_i;

[0090] Determine and adjust the transmission strategy: compare the real-time monitored network bandwidth BW_current with the preset bandwidth threshold, and adjust the transmission strategy parameters according to the comparison result;

[0091] If BW_current < BW_threshold_1, then adopt the transmission strategy (Q_1, R_1, F_1) with the lowest quality, lowest resolution, and lowest frame rate;

[0092] If BW_threshold_1 <= BW_current < BW_threshold_2, then adopt the second lowest quality transmission strategy (Q_2, R_2, F_2), and so on. If BW_current >= BW_threshold_n, then adopt the highest quality transmission strategy (Q_n, R_n, F_n);

[0093] Implement the adjusted transmission strategy: According to the adjusted transmission strategy parameters, process the data to be transmitted (such as compression, degradation, etc.), and perform the transmission operation. The processing methods include image compression, frame rate adjustment, and transmission execution;

[0094] Image compression: Compress according to the target resolution and image quality. Frame rate adjustment: Adjust the video frame rate through frame extraction or frame interpolation techniques. Transmission execution: Use an appropriate network protocol (such as TCP / IP) to transmit the processed data to the target end;

[0095] Feedback and optimization: Collect performance metrics during the transmission process (such as packet loss rate, latency, etc.), and continuously optimize the transmission strategy based on the feedback of the performance metrics. The optimization directions include: Adjust the bandwidth threshold and corresponding transmission strategy parameters according to the transmission effect; Introduce more advanced compression algorithms or transmission protocols to improve transmission efficiency; Use machine learning techniques to predict the network bandwidth change trend and adjust the transmission strategy in advance.

[0096] In one embodiment, for the above cloud processing module, the cloud processing module includes a cloud storage service, a cloud processing service, an algorithm library, and a management console. The cloud storage service is responsible for storing and managing the image data uploaded by users. The cloud storage service receives the data and its parameters specified by the computing collaboration module for cloud processing, including tasks (such as image recognition, feature extraction), priority, and other parameters, and provides the data and its parameters to the cloud processing service. The cloud processing service is responsible for performing image preprocessing, analysis and recognition, and enhancement. The cloud processing service interacts with the algorithm library and calls specific algorithms for image analysis. The management console is responsible for monitoring the running status of the cloud processing service and the cloud storage service, managing the task queue, and configuring algorithm parameters.

[0097] In one embodiment, for the above-mentioned edge computing module, the edge computing module includes edge nodes, smart terminals and network infrastructure. The edge nodes are responsible for executing real-time image processing tasks, caching popular data, and making intelligent decisions. The edge nodes transmit the processing results (such as recognition results, analysis reports, etc.) to the smart terminals. The smart terminals are responsible for sending image data to the edge nodes for processing and receiving the processing results. The network infrastructure is responsible for recording the information of electronic components, realizing real-time management and tracking of inventory, optimizing the communication network of the suggestion unit connecting the edge nodes and the smart terminals, and ensuring efficient transmission of data between the units. The edge nodes communicate with other edge nodes and smart terminals through the network infrastructure.

[0098] In one embodiment, for the above-mentioned computing collaboration module, the computing collaboration module includes a task request unit and a computing collaboration module. The task request unit is responsible for generating applications or devices for task requests, such as smart cameras, sensors, user applications, etc. The task request unit sends the task request to the computing collaboration module. The computing collaboration module is the core unit for task allocation, and contains an intelligent task allocation algorithm and a resource monitoring mechanism. The computing collaboration module receives task requests, performs task analysis and resource evaluation, and makes task allocation decisions. The computing collaboration module allocates tasks to the cloud processing module or the edge computing module based on the task allocation decision.

[0099] In one embodiment, for the above-mentioned security and privacy protection module, the security and privacy protection module includes a data encryption unit, an access control unit, and a data backup and recovery unit. The data encryption unit is responsible for the implementation of the encryption algorithm and the management of the encryption key. The data encryption unit encrypts the data before data transmission and decrypts it at the receiving end. The access control unit is responsible for implementing identity authentication and authority management functions, verifying the user's identity and authority, and controlling access to image data. The data backup and recovery unit is responsible for regular data backup and recovery operations, and manages the storage location and recovery strategy of backup data.

[0100] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A computer graphics image transmission system, characterized in that: include: Image compression module: responsible for compressing the original image data through compression algorithm; Image transmission module: responsible for transmitting the compressed image data to the target device or system through the network; Cloud processing module: responsible for performing complex image processing tasks in the cloud; Edge computing module: responsible for real-time or low-latency image processing tasks at the edge of the network; Computing coordination module: responsible for dynamically allocating tasks to the cloud processing module or edge computing module by analyzing task types and priorities; User interaction module: responsible for providing the interactive interface; Security and privacy protection module: responsible for ensuring the security and privacy of image data during transmission and storage; The image compression module passes the compressed image data to the image transmission module, the image transmission module sends the image data to the computing collaboration module, the computing collaboration module assigns the task to the cloud processing module or the edge computing module according to the task type and priority, the cloud processing module or the edge computing module returns the execution result to the computing collaboration module, the cloud processing module or the edge computing module returns the processing result to the user interaction module, the user inputs the image data or sets the processing parameters through the user interaction module, and the input image data or the set processing parameters are passed to the image compression module or the image transmission module for processing.

2. A computer graphics image transmission system according to claim 1, characterized in that: The image compression module includes an input unit, a preprocessing unit, a compression algorithm selection unit, a compression processing unit, a real-time preview unit and an output unit. The input unit is responsible for receiving image data uploaded by a user. The input unit passes the image data to the preprocessing unit for necessary format conversion and preparation. The preprocessing unit is responsible for performing preprocessing operations such as format conversion and size adjustment on the input image data. The preprocessing unit passes the preprocessed image data to the compression algorithm selection unit. The compression algorithm selection unit is responsible for selecting a suitable compression algorithm. The compression algorithm selection unit passes the selected compression algorithm and the preprocessed image data to the compression processing unit. The compression processing unit is responsible for executing the selected compression algorithm and compressing the image data. During the compression process, the compression processing unit dynamically adjusts the compression parameters according to the adaptive compression parameter adjustment mechanism. The compression processing unit passes the compressed image data and compression parameter information to the real-time preview unit and the output unit. The real-time preview unit is responsible for receiving the compressed image data and compression parameter information transmitted by the compression processing unit and generating a real-time compression preview. The output unit is responsible for receiving the final compressed image data transmitted by the compression processing unit and saving the compressed image data to a local storage device or sending it to the image transmission module.

3. A computer graphics image transmission system according to claim 2, characterized in that: The compression algorithm selection unit includes DCT and DWT. The DCT is used in JPEG compression. The multi-scale analysis capability of the DWT performs better in some scenarios. The specific process of the compression processing unit adjusting according to the adaptive compression parameter is as follows: Image segmentation: splitting an image into multiple regions or blocks; Feature extraction: Extract key features from each region, which are used for subsequent adaptive parameter adjustment; Adaptive parameter adjustment: After DCT or DWT transformation, the quantization step size is adjusted according to the characteristics of the region. In DWT transformation, unimportant high-frequency information is removed by setting different thresholds, and the thresholds are dynamically adjusted according to the characteristics of the region. Coding algorithm: Select a coding algorithm to encode the quantized coefficients; Quality control: During the encoding process, monitor the quality of the compressed image; Decoding: Decode the compressed data to restore the original image or an approximate image; Quality verification: Evaluate the effectiveness of compression algorithms and adaptive parameter adjustments by comparing the original image and the decoded image; Performance optimization: optimize the adaptive parameter adjustment strategy based on the decoded image quality and compression ratio; Iterative processing: Through multiple iterative processing, the adaptive compression parameter adjustment strategy is continuously optimized.

4. A computer graphics image transmission system according to claim 1, characterized in that: The image transmission module includes a data encapsulation unit, an encryption unit, a transmission control unit, an intelligent component identification unit, a progressive transmission control unit and a dynamic transmission adjustment unit. The data encapsulation unit is responsible for encapsulating the compressed image data according to the requirements of the network transmission protocol. The data encapsulation unit transmits the encapsulated data packet to the encryption unit for encryption processing. The encryption unit is responsible for receiving the data packet transmitted by the data encapsulation unit and performing encryption processing. The encryption unit transmits the encrypted data packet to the transmission control unit for transmission. The transmission control unit is responsible for sending the encrypted data packet to the target device or system through the network. The intelligent component identification unit is responsible for identifying important areas or feature points in the image before or during transmission. The intelligent component identification unit transmits the identification result to the transmission control unit. The progressive transmission control unit is responsible for implementing the progressive transmission strategy. The progressive transmission control unit divides the image data into multiple levels and transmits them in sequence. The progressive transmission control unit transmits the layered information to the transmission control unit for actual transmission. The dynamic transmission adjustment unit is responsible for monitoring the network bandwidth and the processing capacity of the user equipment. The dynamic transmission adjustment unit dynamically adjusts the transmission speed and image quality parameters according to the monitoring results. The dynamic transmission adjustment unit transmits the adjusted parameters to the transmission control unit.

5. A computer graphics image transmission system according to claim 1, characterized in that: The image transmission module dynamically adjusts the transmission strategy according to the real-time situation of the network bandwidth, including the following steps: Real-time monitoring of network bandwidth: Use network monitoring tools or algorithms to monitor the real-time status of network bandwidth in real time and obtain the real-time value of the current network bandwidth, recorded as BW_current; Set transmission strategy parameters: according to application requirements and network conditions, preset transmission strategy parameters under different network bandwidths, set multiple bandwidth thresholds BW_threshold_i (i=1,2,...,n), each threshold corresponds to a set of transmission strategy parameters, each set of strategy parameters includes image quality Q_i, resolution R_i, frame rate F_i; Determine and adjust the transmission strategy: compare the real-time monitored network bandwidth BW_current with the preset bandwidth threshold, and adjust the transmission strategy parameters according to the comparison result; If BW_current < BW_threshold_1, then adopt the transmission strategy (Q_1, R_1, F_1) with the lowest quality, lowest resolution, and lowest frame rate; If BW_threshold_1 <= BW_current < BW_threshold_2, then adopt the second lowest quality transmission strategy (Q_2, R_2, F_2), and so on. If BW_current >= BW_threshold_n, then adopt the highest quality transmission strategy (Q_n, R_n, F_n); Implement the adjusted transmission strategy: According to the adjusted transmission strategy parameters, process the data to be transmitted and perform the transmission operation. The processing methods include image compression, frame rate adjustment, and transmission execution; Feedback and optimization: Collect the performance metrics during the transmission process and continuously optimize the transmission strategy based on the feedback of the performance metrics.

6. A computer graphics image transmission system according to claim 1, characterized in that: The cloud processing module includes a cloud storage service, a cloud processing service, an algorithm library, and a management console. The cloud storage service is responsible for storing and managing the image data uploaded by users. The cloud storage service receives the data and its parameters specified by the computing collaboration module for cloud processing and provides the data and its parameters to the cloud processing service. The cloud processing service is responsible for performing image preprocessing, analysis and recognition, and enhancement. The cloud processing service interacts with the algorithm library and calls specific algorithms for image analysis. The management console is responsible for monitoring the operating status of the cloud processing service and the cloud storage service, managing the task queue, and configuring algorithm parameters.

7. A computer graphics image transmission system according to claim 1, characterized in that: The edge computing module includes edge nodes, intelligent terminals, and network infrastructure. The edge nodes are responsible for performing real-time image processing tasks, caching popular data, and making intelligent decisions. The edge nodes transmit the processing results to the intelligent terminals. The intelligent terminals are responsible for sending the image data to the edge nodes for processing and receiving the processing results. The network infrastructure is responsible for recording the information of electronic components and realizing the real-time management and tracking of inventory. The network infrastructure connects the communication networks of the edge nodes and the intelligent terminals. The edge nodes communicate with other edge nodes and intelligent terminals through the network infrastructure.

8. A computer graphics image transmission system according to claim 1, characterized in that: The computing collaboration module includes a task request unit and a computing collaboration module. The task request unit is responsible for generating the applications or devices that issue task requests. The task request unit sends the task requests to the computing collaboration module. The computing collaboration module is the core unit for task allocation, including an intelligent task allocation algorithm and a resource monitoring mechanism. The computing collaboration module receives the task requests, performs task analysis and resource evaluation, and makes task allocation decisions. The computing collaboration module allocates the tasks to the cloud processing module or the edge computing module according to the task allocation decisions.

9. A computer graphics image transmission system according to claim 1, characterized in that: The security and privacy protection module includes a data encryption unit, an access control unit and a data backup and recovery unit. The data encryption unit is responsible for the implementation of the encryption algorithm and the management of the encryption key. The data encryption unit encrypts the data before data transmission and decrypts it at the receiving end. The access control unit is responsible for implementing identity authentication and authority management functions, verifying the user's identity and authority, and controlling access to image data. The data backup and recovery unit is responsible for regular data backup and recovery operations, and manages the storage location and recovery strategy of backup data.

Citation Information

Cited By

  • Control system for infrared image transmission and reproduction

    CN120475111A

  • A control system for infrared image transmission and reproduction

    CN120475111B

  • Image and video compression system based on AI

    CN120658889A

  • Eddy current data compression transmission optimization method

    CN121309684A