23 results about "Data compression ratio" patented technology

The invention relates to the technical field of electrical variable measurement, in particular to a self-adaptive power quality monitoring method for a power cabinet, which comprises the following steps of: starting a low-frequency acquisition unit arranged at a monitoring node of the power cabinet, and acquiring a low-frequency coarse scanning voltage signal of the power cabinet in a current monitoring period at a preset low-frequency sampling rate; according to the method, compressed observation vectors are transmitted, sparse basis inversion calculation is executed by using an orthogonal matching pursuit algorithm, high-precision power quality time domain waveform data are reconstructed, rich high-frequency transient details are restored under the condition of low-data-volume transmission, distortion feature analysis is carried out based on reconstructed waveforms, disturbance types are identified, and a monitoring analysis report is generated and uploaded. The real-time dynamic adjustment of the sampling scale and the matrix structure along with the signal fluctuation state is realized, the optimal balance of the data compression ratio and the signal reconstruction quality is achieved, the contradiction between the storage and transmission bandwidth limitation of massive high-frequency data in a complex power grid environment is solved, and the sensitivity for transient abnormality is improved.

This specification provides a data compression method and apparatus. The data compression method is applied to an intelligent storage device and includes: acquiring at least one piece of business data to be processed; compressing each piece of business data to be processed according to a preset storage sector size to obtain a storage block to be compressed corresponding to each piece of business data to be processed, wherein the storage block to be compressed includes at least one storage sector; compressing the fill data in each storage block to be compressed to obtain a target storage block, wherein the target storage block includes compressed business data corresponding to each piece of business data to be processed, and the fill data is used to fill the free space in the storage sector. This method compresses the original business data at a preset storage sector size granularity, aligns the compressed business data at the storage sector granularity, and fills the empty space with fill data. In the hardware compression stage, the fill data in each storage sector is compressed, improving the data compression ratio.

The embodiment of the invention provides a data compression method and device, a logic chip and electronic equipment, and relates to the technical field of data processing, and the method comprises the steps: carrying out the hash transformation of a to-be-processed data segment, and obtaining a first hash value; a second number of first initial positions recorded in the data dictionary are inquired with the first hash value as an index, the first initial positions are the positions of the data segments with the hash dictionary value being the first hash value in the original data, and the second number is larger than or equal to 2; if each first initial position is an invalid position, encoding the byte to be encoded, and updating any first initial position to a second initial position of the data segment to be processed in the original data; and if the valid initial position exists, performing byte-by-byte comparison from the valid first initial position and the second initial position to the data tail direction to obtain a continuous repetition length, and based on continuous repetition length coding, updating the position to be updated in the first initial position by using the second initial position. The data compression ratio can be improved.

The embodiment of the invention provides a universal component adaptation system and method for edge equipment and cloud collaboration, and the system comprises a standard interface layer and a dynamic adaptation layer which are deployed at the edge side, and a cloud service component deployed at the cloud, the standard interface layer encapsulates the isomerism of bottom hardware and software through a unified calling interface, a data format and configuration parameters, and realizes cross-platform deployment of components; the dynamic adaptation layer is in communication connection with the standard interface layer and comprises an environment sensing module and a parameter adjusting module, and the environment sensing module is used for collecting local parameters such as equipment computing power and network bandwidth in real time; the parameter adjusting module is used for dynamically optimizing operation settings of the components according to the parameters, such as a data compression ratio and a calculation task splitting strategy; and the cloud service component interacts with the edge side standard interface layer and is used for receiving the processed data or issuing an instruction.

The invention discloses a video analysis method and system for coal mine multi-service scenes, and relates to the technical field of video analysis. The method comprises the following steps: performing multi-device semantic segmentation and feature region clipping on an original video stream of a coal mine production region to obtain a clipped video stream; calculating an initial operation risk coefficient of the equipment based on the operation state monitoring data and the expected work task; correcting the initial operation risk coefficient based on the equipment operation association mapping, and adjusting the initial data compression proportion of the corresponding equipment to obtain an adaptive data compression proportion; and calling a corresponding video compression plug-in to carry out data dimension reduction on the clipped video stream based on the equipment type and the adaptive data compression proportion to obtain dimension-reduced video data, and carrying out state abnormity identification according to the dimension-reduced video data to obtain an abnormity identification result of each equipment. According to the method, dynamic adaptation of video analysis resources and equipment risks in a complex coal mine scene is realized, and the data transmission and storage efficiency is optimized while the anomaly recognition precision is guaranteed.

The invention provides a data grading sharing interface device and method in a vehicle and road cloud three-level cloud architecture, and belongs to the technical field of data security, and the device comprises an authority control module which is used for receiving a data access request, and carrying out the authentication of the request based on a preset three-level authority matrix, the three-level permission matrix is used for defining data access ranges of the edge cloud, the region cloud and the center cloud; the format conversion module is used for performing format conversion on the authenticated data and dynamically adjusting the data compression ratio based on the real-time network bandwidth; and the protocol interaction module is used for transmitting the data subjected to format conversion and compression through a request-response-acknowledgement mechanism based on an MQTT-SN protocol. According to the invention, the security and reliability of data access are improved, the data transmission efficiency is optimized, and the high requirements of vehicle-road cooperation, intelligent traffic and other application scenes on data security, real-time performance and reliability are met.

The invention discloses an intelligent cloud collaborative geological disaster monitoring and early warning platform in the field of geological disaster monitoring and early warning. Comprising a cloud collaborative monitoring architecture, an edge computing optimization front-end processing module, an intelligent video monitoring and behavior analysis system, a multi-level information interaction and linkage mechanism, a unified access standard and a centralized power supply solution. The cloud collaborative monitoring architecture is used for cloud storage, analysis and three-dimensional geological modeling of multi-source data; and the edge calculation optimization front-end processing module is deployed at a port of the mobile acquisition equipment and executes data screening and compression. Quantitative control is realized through a data compression ratio formula, an anomaly recognition accuracy formula and an early warning response time model, and transmission and security are optimized in combination with 5G communication and a block chain technology. According to the invention, in mountain landslide monitoring, the investigation efficiency can be improved by 60%, the early warning response time can be shortened by 83%, the hardware cost can be reduced by 40%, and the method is suitable for engineering investigation, three-dimensional visualization and emergency response scenes in a complex geological environment.

The triangular mesh processing method, device, electronic equipment and storage medium provided by the present application relate to the field of oral digital technology. The method obtains an original triangular mesh; based on the geometric structure and topological connection relationship of the original triangular mesh, the curvature of each vertex and the characteristic mark of each edge in the original triangular mesh are obtained; according to the curvature of each vertex and the characteristic mark of each edge, each triangle face to be subdivided and each edge to be folded in the original triangular mesh are determined; each triangle face to be subdivided is subjected to subdivision processing, and each edge to be folded is subjected to folding processing to obtain a target triangular mesh, so that an optimal balance is achieved between geometric fidelity, topological rationality and data compression ratio, and the practicability and robustness of the triangular mesh in three-dimensional reconstruction, real-time rendering, physical simulation and downstream AI-driven mesh processing tasks are improved.

This application relates to a method, apparatus, computer equipment, and storage medium for the safe operation and maintenance of distributed photovoltaic (PV) systems. The method includes: acquiring electrical quantity data and environmental parameters of PV modules in an edge system; evaluating latency sensitivity using a trained support vector machine based on the electrical quantity data and environmental parameters to obtain a target latency sensitivity level; determining a decision action space using a trained decision network based on the target latency sensitivity level, communication bandwidth resources, and equipment load rate; the decision action space includes sampling frame rate, data compression ratio, and model index; receiving a fault location identification model matched to the model index from a cloud server; acquiring image data and electrical quantity sequences transmitted at the sampling frame rate and data compression ratio; and using the fault location identification model to identify fault locations, obtaining fault location identification results. This achieves efficient fault identification in distributed PV edge systems.

The invention discloses a self-adaptive remote communication control system and method based on a large model. The system comprises a dynamic weight channel evaluation module, a multi-mode communication intention analysis module, a self-adaptive TopK gradient sparse module, a distributed feeder automation 5G cooperative control module, a federal communication knowledge distillation module and a self-adaptive remote communication control module. The dynamic weight channel evaluation module combines parameters of the 5G cooperative control module to calculate a channel weight, the multi-modal communication intention analysis module processes terminal multi-modal data and outputs a result, and the adaptive TopK gradient sparse module screens a large model key gradient and transmits the large model key gradient to the federal communication knowledge distillation module; and model parameters after distillation, the weights and analysis results are all transmitted to the self-adaptive remote communication control module. According to the method, the communication link, the transmission rate and the data compression ratio are adjusted, the communication stability and the self-adaptive capability are improved, and the distributed feeder automation 5G scene requirements are met.

The invention provides an age-aware routing and unloading joint optimization method for a satellite network, and the method comprises the steps: enabling each satellite node to broadcast a lightweight HELLO beacon to a neighbor at the beginning of each decision time slot, and receiving the beacon of the neighbor; starting an independent optimization process for each observation task newly arriving at a satellite node in the time slot to determine a joint decision tuple; each satellite node enters a local execution stage, and after each time slot is finished, the queue value and the real battery energy of the virtual energy queue are updated according to the actual energy consumption and the energy collection amount of the satellite node in the time slot; according to the invention, a virtual energy queue is introduced to realize long-term energy balance constraint conversion, a block coordinate descent method is adopted to solve an optimal routing path, unloading nodes and a data compression ratio are calculated, and a self-adaptive energy sensing routing mechanism and a scheduling strategy based on an information age priority are combined to obtain an optimal routing path. And dynamic optimal balance among information freshness, data processing precision and energy sustainability is realized.

The present invention suppresses delay of drawing or operation even if a demagnification ratio becomes small when a graph is reduced and displayed for a time-series signal.　This display device that displays digital signals in time series comprises: a signal history acquisition unit that acquires a signal history of the digital signals; a demagnification ratio reception unit that receives input of a demagnification ratio related to time-series display of the signal history of the digital signals; a display width / compression ratio determination unit that determines a display width ratio and a data compression ratio on the basis of the received demagnification ratio and a threshold of the demagnification ratio; and a data compression unit that compresses the signal history of the acquired digital signals at the determined data compression ratio. The display device performs the time-series display of the compressed signal history on the basis of the display width ratio.

The invention provides an offshore yield increase operation dynamic monitoring optimization method based on data interface conversion, and the method comprises the steps: collecting original collection data during yield increase operations such as offshore acidification, fracturing, sand prevention, and the like, so as to calculate an interference index of a simulation channel and an RS485 channel; respectively carrying out standardization processing on the data of the analog channel and the RS485 channel, and generating a compensated analog signal sequence and an effectiveness score of the RS485 channel; calculating the state score of each channel, and arranging the state scores of each channel in a descending order to form a high-priority uploading queue; and inputting the high-priority upload queue into the MCU for caching and estimating the channel quality, adaptively adjusting the data compression ratio, the redundancy overhead and the transmission interval, and automatically downshifting the transmission power in a low-voltage state. The method can be directly deployed in various scenes of offshore yield increase operation, the wiring and maintenance cost is remarkably reduced, and the monitoring safety and the decision-making efficiency are improved.

[Problem] To provide a method for analyzing a target organism, which can analyze data from a compression ratio without normalization, and a method for acquiring a graph from which various types of biological information can be analyzed. [Solution] A method for analyzing a target organism, comprising compression ratio fluctuation examination step of obtaining a compression ratio of sequence data on the target organism for each variable related to the target organism, wherein the compression ratio fluctuation examination step includes: a sequence data acquisition step of obtaining a plurality of pieces of sequence data based on the target organism for each of the variables; and a compression ratio calculation step of compressing the plurality of pieces of sequence data to obtain a data compression ratio.

The application provides a data transmission method and device, electronic equipment, storage medium and product, relates to the technical field of artificial intelligence, and comprises the following steps: obtaining to-be-transmitted data; inputting the to-be-transmitted data into a data compression model to obtain compressed data corresponding to the to-be-transmitted data output by the data compression model; and sending the compressed data to a data receiving end; wherein the data compression model is obtained based on sample transmission data and sample compressed data corresponding to the sample transmission data. In the foregoing manner, the to-be-transmitted data is input into the data compression model, the compressed data corresponding to the to-be-transmitted data output by the data compression model is obtained, an artificial intelligence model is introduced in the data compression process, data feature mining and data compression are realized by the model, the defect that the compression limit is limited by the algorithm itself when data compression is performed by using a mathematical statistical method can be avoided, the data compression ratio is improved, and the efficiency of data compression and data transmission is improved.

The invention relates to the technical field of data processing and scheduling, in particular to a multi-source heterogeneous data adaptive acquisition and scheduling algorithm, which comprises the following steps of: S1, adaptively sensing the type, the structure, the real-time requirement and the data quality feature of multi-source heterogeneous data based on a feature extraction network of neural computation, and mapping into uniform vector coding; according to the method, optimal matching and dynamic resource quota allocation of acquisition tasks and resource nodes are realized through a dynamic game algorithm driven by neural computation, and the acquisition frequency, the data compression ratio and transmission parameters are dynamically optimized according to a reinforcement learning feedback regulation mechanism fusing multi-granularity efficiency indexes; the node resource utilization rate and the task scheduling adaptability are effectively improved, the task completion delay, the data packet loss rate and the link congestion risk are remarkably reduced, and the real-time performance, the reliability and the service effectiveness maximization of multi-source heterogeneous data collection are guaranteed.

This invention discloses an AI-powered holographic image adaptive enhancement system that adapts to network latency fluctuations, belonging to the field of communication and holographic imaging technology. By monitoring network latency, bandwidth, and packet loss rate in real time, this invention dynamically and adaptively adjusts the resolution, frame rate, data compression ratio, and transmission priority of the holographic image using AI algorithms. It is compatible with all network types, including 6G, 5G, WiFi 6 / 7, and Ethernet. When network conditions are good, it improves image quality; when network fluctuations occur, it prioritizes ensuring smooth interaction, achieving an optimal balance between image quality and latency. Simultaneously, it achieves multi-dimensional synchronous adaptation of holographic images, spatial audio, and interactive commands. This invention significantly avoids image stuttering, tearing, and blurring caused by network fluctuations, while reducing terminal computing power and power consumption, and can be widely adapted to various holographic interactive terminals.

The application provides an industrial data acquisition method with adaptive sampling rate adjustment, and belongs to the technical field of industrial data acquisition. The application acquires process parameters at a benchmark sampling rate by deploying data acquisition terminals in an industrial field, calculates first-order difference values and second-order difference values using a sliding time window, compares the values with dynamic thresholds to identify suspected mutation points, inputs the suspected mutation points into a deep learning model with an adaptive convolution mechanism to perform confidence evaluation, triggers a high-frequency sampling mode when a real mutation is confirmed and synchronously increases the sampling rate of associated parameters, performs wavelet decomposition on high-frequency data to extract features and upload the features to the cloud while storing original data in a local buffer, realizes smooth exit of the sampling rate through a stable window determination mechanism, and dynamically adjusts data compression ratio according to network bandwidth, thereby solving the technical problem that fixed sampling rate industrial data acquisition cannot balance mutation event capture accuracy and data transmission efficiency.

This application discloses a data anomaly detection method, apparatus, and electronic device. The method, applied to an electronic device, includes: sampling and obtaining data to be detected from the stored data of the electronic device; performing a risk assessment on the data to be detected to obtain a risk assessment result corresponding to the data; wherein the risk assessment at least includes detecting compression ratio anomalies in the data to be detected; and determining the data anomaly state of the electronic device based on the risk assessment result. Implementing this application embodiment enables data security monitoring through data compression ratio anomaly detection, thereby improving the data security of the electronic device while ensuring the overall performance stability of the electronic device.

This invention discloses a method and system for multimodal capture of labor scenarios based on edge computing, belonging to the field of data processing networks and distributed computing technology. It includes acquiring network link quality parameters and node distribution density parameters and performing bandwidth prediction, generating an available transmission capacity assessment value, adjusting the acquisition frequency and data compression ratio, generating an adapted data stream, processing it, generating a multimodal fusion feature vector, performing classification and detection, generating real-time status labels for the labor scenario, making decisions based on the available transmission capacity assessment value, generating a data upload decision command and performing conditional judgments, and sending the matching results to a cloud server. This invention employs a collaborative processing mechanism combining network state-aware driven data source adaptive adjustment and scenario semantic-driven upload decision, enabling the filtering and transmission of labor scenario information in dynamic network environments, improving the response capability to critical events and the efficiency of network resource utilization.

This application provides a method, apparatus, and storage system for data compression and decompression. The method includes: acquiring FastQ data and BAM data, wherein the FastQ data includes multiple sequences, and the BAM data includes multiple comparison terms corresponding to the multiple sequences, the multiple comparison terms being obtained by comparing the multiple sequences with a reference genome respectively; determining a first comparison term corresponding to a first sequence among the multiple sequences, the first comparison term being one of the multiple comparison terms, the first comparison term including the comparison result of the first sequence, the comparison result of the first sequence including the position information of the first sequence in the reference genome; and performing reference compression on the first sequence based on the comparison result of the first sequence included in the first comparison term to obtain compressed data of the FastQ data. This method can improve both the data compression ratio and the data compression performance.

This invention discloses a method for lightweighting 3D model data of regular buildings, comprising the following steps: S1, reading data; S2, detecting planes that can be simplified; S3, simplifying the triangulation mesh; S4, detecting and adjusting the effect after simplification. The lightweighting method of this invention, while ensuring the structural integrity of the 3D model and without deleting pyramids, achieves a significant improvement in data compression ratio by planning and simplifying the triangulation mesh, utilizing the convergence and movement of vertices within the mesh. Furthermore, since this invention does not involve image reading and compression, the demand for GPU and image processing computing power is greatly reduced, effectively lowering costs.

Embodiments of the present application relate to the technical field of data processing, and disclose a data processing method, device and electronic equipment. The method comprises: obtaining to-be-processed data, wherein the to-be-processed data comprises data of at least one to-be-written data row; classifying the to-be-processed data to obtain classification information of the to-be-processed data; determining a target row group corresponding to the classification information among a plurality of row groups included in a column storage file according to the classification information of the to-be-processed data, wherein the classification information corresponding to different row groups among the plurality of row groups is different; and writing the to-be-processed data into the target row group in the column storage file. The technical solution of the present application can reduce the occupation of storage space by data and improve the data compression ratio.