354 results about "File size" patented technology

A real-time anomaly detection system for high-volume managed file transfers (MFT), consisting of: a secure, hardware-accelerated monitoring unit configured to interface with a managed file transfer server and intercept file transfer session data at wire-speed; a metadata extraction engine embedded in the hardware-accelerated unit, the metadata extraction engine configured to analyze protocol-specific session attributes, including, but not limited to, file size, transfer duration, encryption status, source and destination endpoints, transfer frequency, and payload entropy; a contextual AI inference engine communicatively coupled to the metadata extraction engine, the AI inference engine comprising a deep learning model trained on labeled historical MFT activity logs to detect contextual deviations from normative behavior; a federated learning architecture with a plurality of edge nodes, each hosting a local anomaly detection model trained on localized transmission metadata and configured to synchronize with a central aggregator using differentially private gradient updates; an Explainable AI (XAI) subsystem integrated into and configured to generate human-readable anomaly justifications, feature importance maps, and threat categorization labels; and a policy orchestration module configured to dynamically execute pre-configured or AI-based security responses, where the security responses include selective session termination, quarantining of transferred files, generation of alerts, or redirection of MFT workflows.

An AI-based audio compression method for use with audio formats, alone or in combination with other audio compression and enhancement approaches. A combination of audio pre-processing, sound to visual transcoding of audio, and a sequence of AI-enabled methods enabling maximal entropy order extraction applied within the sound and dimensionally extended visual domain projection of the audio significantly increases the degree of compression of audio files, thereby reducing storage, transmission and processing overhead associated with audio. A unique AI-driven domain conversion is leveraged together with domain-specific AI processing stages to reduce file size, while supporting optional use of standard and proprietary audio encoding, decoding, compression, and other methods. Support for native mode photonic computer processing of the higher-dimensional order representation of media enables further optimization via photonic computing methods that would not be possible if the audio was not extended into higher order visual domain space.

The invention discloses a large file concurrent uploading method and system based on a dynamic fragmentation strategy and resource optimization, and the method comprises the steps: a client generates a file fingerprint according to the file size of a large file and metadata, and dynamically calculates the fragmentation size of the large file; the client carries out fragment cutting on the large file according to the calculated fragment size, establishes a concurrent uploading queue and uploads a plurality of fragments to a server side in parallel; the server selects an optimal storage node to store each fragment based on a consistent hash ring and a multi-dimensional weight model; the client side and the server side track a fragment uploading state through a fragment serial number and a cyclic redundancy check (CRC) value, and after all fragments are uploaded, integrity check and logic recombination are carried out; and when network interruption or uploading failure is detected, the client side and the server side execute an intelligent retry strategy or a splitting rescheduling strategy of breakpoint resume and failure fragmentation.

The invention provides a remote upgrading system and method for energy storage equipment of an energy storage power station, which comprises a cloud platform, an energy management control unit (EMU) and the energy storage equipment, and is characterized in that the cloud platform is used for receiving an upgrading file uploaded by a user and issuing a downloading instruction containing a file downloading URL, a file size and a CRC32 check code to the EMU; the EMU is used for downloading an upgrading file from the cloud platform, performing format, size and CRC32 triple verification on the file, executing system self-inspection before upgrading, executing staged shutdown protection strategies in sequence, issuing an upgrading instruction to the energy storage equipment and recovering a system state; and the energy storage equipment is used for downloading the upgrading file from the EMU and finishing firmware updating.

The invention discloses a method, a system, a medium and equipment for extracting unified aggregated text content of all types of files, and relates to the technical field of file processing, the method comprises the following steps: system initialization and configuration, signature verification, extraction judgment, proxy forwarding, content extraction, and result storage and return. A single and stable service entry point (Endpoint) and a standardized API (Application Program Interface) specification are provided for all upper-layer businesses; through a standard S3 signature verification mechanism, the security and reliability of each call are ensured; in combination with an AK / SK system, unified authority control, flow limitation and post auditing can be conveniently carried out; a service-oriented architecture is adopted, and the extraction capability of different types of files is provided by an independent micro-service module. When a new file type needs to be supported, only a new content extraction module needs to be developed and registered into the mapping table, a main process and an upper layer service do not need to be changed, and the system expansibility is extremely high. And in combination with file size judgment, executing logic of combining synchronous extraction and asynchronous extraction of the file.

The invention relates to the technical field of image compression processing. The invention provides a video compression processing method and device. The method comprises the following steps: performing video feature extraction on a to-be-processed video, wherein video features comprise space complexity, time complexity and color complexity; configuring the size of a target file corresponding to the to-be-processed video, and determining the size of each target file according to a specific scene and a user demand; dynamically generating compression parameters through weighted calculation based on the extracted video features and the determined size of the target file; and performing dynamic evaluation according to the video compression effects under different compression parameters to determine the range of the optimal compression parameter, selecting the optimal compression parameter from the determined range of the optimal compression parameter, and performing video compression on the to-be-processed video according to the selected optimal compression parameter. According to the invention, the optimal compression parameter corresponding to the to-be-processed video can be determined, and more efficient and accurate video compression can be realized.

Methods and systems are provided for a histogram model configuring a computing system to derive an indicator of compromise signature based on a sliding window index of identified malware samples, and a matching rule constructor configuring a computing system to generate matching signatures by selecting statistically relevant n-grams of an unidentified file sample. A matching rule constructor configures the computing system to construct a matching rule including, as a signature, 32 n-grams found in the unidentified file sample which occur most frequently, and another 32 n-grams found in the unidentified file sample which occur least frequently amongst records of the threat database across 32 discrete file size ranges. These functions can configure backend operations to a sample identification operation performed by a user operating a client computing device, in a fashion that does not require a user to manually discern strings from the unidentified file sample to derive a signature for the matching engine to search against the threat database.

The embodiment of the invention discloses a file fragment uploading method and device, electronic equipment, a computer program and a storage medium. According to the embodiment of the invention, a to-be-uploaded file and file information are obtained, wherein the file information at least comprises a file size; segmenting a to-be-uploaded file according to the initial network speed of the current network to obtain a plurality of initial file fragments; uploading the initial file fragments to the server in sequence, and recording uploading time consumption and uploading rate corresponding to the initial file fragments; adjusting the size of the next initial file fragment according to the uploading time consumption and the uploading rate of the uploaded initial file fragment to obtain a target file fragment; and uploading the target file fragments to the server. Therefore, in the file uploading process, the real-time network state is determined according to the uploading condition of the uploaded fragment by adopting a mode of'dynamic fragment uploading + network self-adaption ', and the size of the fragment is dynamically adjusted according to the real-time network state, so that the file uploading success rate and the user experience are improved, and the method is flexibly applied to various large file uploading scenes.

The embodiment of the invention provides a core dump file generation method and device, electronic equipment and a medium, and relates to the technical field of data processing.The method comprises the steps that in response to abnormity of a target process, a thread causing the abnormity of the target process is determined as a target thread from threads of the target process; retrieving a virtual memory address from a register occupied by the target thread and a stack memory area of the target thread; determining a target address of a data page which belongs to a heap memory area and has mapping from the retrieved virtual memory address; and generating a core dump file containing the data page mapped by the target address. By applying the scheme provided by the embodiment of the invention, the validity of the core dump file can be improved while the size of the core dump file is reduced.

The invention relates to an attachment certificate dynamic form processing method and system, and belongs to the technical field of enterprise financial certificate intelligent processing, and the method comprises the steps: receiving an attachment certificate uploaded by a user, and extracting metadata features such as a file size, a format type and a hash value to generate an attachment object; carrying out fragmentation storage on the object by adopting an Erase Coding algorithm, and generating a voucher type identification cue word based on metadata; analyzing the voucher through a hybrid recognition model fusing a convolutional neural network and a Transform encoder, and outputting structured data containing a voucher type identifier; mapping the data into a database entity and triggering a voucher life cycle state change event, and driving a business rule engine to dynamically generate a form mode definition associated with a voucher type; and in response to user query, generating an interactive form through a responsive rendering engine in combination with a voucher type, state and authority dynamic combination form mode and instance data.

The invention discloses a distributed document analysis method and device, equipment and a medium. The method comprises the steps that a target to-be-analyzed document is acquired; extracting content feature data of the target to-be-analyzed document; the content feature data is used for reflecting the content complexity of the target to-be-analyzed document; according to the content feature data, determining estimated time consumption for analyzing the target to-be-analyzed document; based on load balancing, according to the estimated time consumption, distributing a target parsing task of the target to-be-parsed document to a target computing power node; and the target computing power node executes the target analysis task to obtain an analysis result. Therefore, the analysis duration is pre-estimated based on the content feature data of the document instead of determining the pre-estimated time consumption singly depending on the size of the document, the method is adaptive to the time consumption fluctuation characteristics of different documents, the precision of the pre-estimated time consumption is improved, calculation power stage distribution is performed based on load balance according to the pre-estimated time consumption, and the calculation efficiency is improved. The resource utilization rate and the load balancing effect of the system are improved.

An AI-based audio compression method for use with audio formats, alone or in combination with other audio compression and enhancement approaches. A combination of audio pre-processing, sound to visual transcoding of audio, and a sequence of AI-enabled methods enabling maximal entropy order extraction applied within the sound and dimensionally extended visual domain projection of the audio significantly increases the degree of compression of audio files, thereby reducing storage, transmission and processing overhead associated with audio. A unique AI-driven domain conversion is leveraged together with domain-specific AI processing stages to reduce file size, while supporting optional use of standard and proprietary audio encoding, decoding, compression, and other methods. Support for native mode photonic computer processing of the higher-dimensional order representation of media enables further optimization via photonic computing methods that would not be possible if the audio was not extended into higher order visual domain space.

The invention provides an intelligent file merging method and device, electronic equipment and a storage medium, and relates to the technical field of artificial intelligence and cloud computing, in particular to the technical direction of big data. According to the specific implementation scheme, first-class files and second-class files are recognized from a to-be-processed file set, the file size of the first-class files is smaller than a target size, and the file size of the second-class files is larger than that of the first-class files; splitting the second class file into a plurality of sub-files; determining a to-be-merged file set based on the plurality of sub-files and the first type of files; and carrying out merging operation on the to-be-merged file set.

The present disclosure relates to a distributed data storage control method and apparatus, a readable medium, and an electronic device. The method includes: after receiving a write lock and modifying a file size according to the write lock, caching, by a worker node, the modified file size in the worker node until a write lock request sent by a distributed lock management and control node for taking back the write lock is responded to, and then transmitting the modified file size to the distributed lock management and control node, so that the distributed lock management and control node updates the file size.

The disclosure presents systems and methods for hierarchical classification of input data across a plurality of categories. A machine learning model processes various data formats, starting with dimensional reduction using tokenization techniques, such as Bert-tiny tokenization, to create model-readable representations. The system predicts super-categories, sub-categories, and granular categories through selective activation of sub-layers tied to identified super-categories, optimizing computational efficiency. Label smoothing during training mitigates overconfidence in predictions, while softmax normalization refines inference outputs. Synthetic data generation using Large Language Models (LLMs) supplements training datasets, and an automated data labeling pipeline efficiently generates hierarchical labels. Modifications to the model, such as stop word removal and file size limitations, further reduce latency. Inference analyzes logits to predict hierarchical paths, providing detailed classifications with clear outputs. The method is adaptable for multimodal formats, ensuring scalable and accurate predictions across diverse data types while minimizing computational costs and improving reliability.

The invention provides a firmware rapid loading method and circuit of a photoelectric DSP chip and an optical module.The method is applied to a DSP unit, the DSP unit is used for being installed in the optical module and executing a starting program, the DSP unit is electrically connected with an MCU of the optical module and obtains loading information of the MCU, and the step of obtaining the loading information of the MCU comprises the substeps that first information is obtained, acquiring second information according to the first information; the file size of the first information is smaller than that of the second information, and the first information comprises communication parameter information used for obtaining the second information; the second information comprises target firmware of the DSP unit. On the basis of saving the hardware cost, the loading speed of the DSP chip firmware is improved, the development work of the control program of the MCU is reduced, and the method has good compatibility.

The invention relates to a Json file parallel analysis and data writing method and device based on DataX. The method comprises the following steps: acquiring a source end Json file set, and dividing the source end Json file set into small file subsets and large file subsets according to file sizes; the small file aggregation path is configured with a json reader of the DataX, and parallel reading and analysis are carried out; splitting a root array of the large file into a plurality of independent small Json files through a Python script, aggregating paths, and reading and analyzing by using a DataX parallel channel; and finally executing the DataX Job to write the data into a target end. Through a classification processing strategy, the large-scale Json data analysis writing efficiency is remarkably improved, the large file memory occupation risk is reduced, the file scale is automatically adapted, a mature DataX frame and a Python script are reused, high performance and low maintenance cost are both considered, multi-type target end storage is supported, and the problems that a traditional tool is weak in parallel, high in resource consumption, poor in flexibility and the like are effectively solved.

The invention discloses a file access method, device and equipment and a computer readable storage medium, and belongs to the technical field of storage. The method is applied to a first node in a file system and comprises the steps that a first write request for a file is received, the first write request comprises first file data and IO information, and the IO information represents an address range for writing the first file data; in response to the first write request, metadata of the file is obtained, and the metadata comprises an extension attribute and a file size; according to the IO information and the file size, under the condition that it is determined that the written file size does not exceed the reference threshold value, the first file data is written into the extension attribute, and the written file size is the file size after the first file data is written. The file data is embedded in the metadata of the file, and the file data can be accessed while the metadata of the small file is accessed, so that the step of accessing the file data is reduced, the response time delay of the file system to the access request is reduced, and the purpose of improving the access performance of the system is achieved.

The invention discloses a processing method for exporting partition table data, which is used for solving the technical problems of low cross-partition query efficiency, inconsistent file size and lack of concurrent processing capability in the prior art. The method comprises the following steps: firstly, reading configuration information from a task detail table to generate an export task, counting the data volume of each partition, and distributing data to an output file with a fixed line number according to a sequential filling strategy; an innovative coding scheme is adopted to record a distribution result, different partition data containing conditions are represented through characters'-'and'. 'and numbers, and compressed coding is carried out on continuous empty partitions; sending a distribution result to a message queue to realize multi-server concurrent processing; the consumer decodes the distribution information and then executes restrictive query according to a partition sequence, and data is exported concurrently by using streaming query in cooperation with multiple threads; and a perfect state monitoring and exception recovery mechanism is established, and an MD5 verification file is generated to ensure data integrity. According to the method, the processing efficiency of partition table data export and the system reliability are effectively improved.

The invention relates to a DataX-based FTP (File Transfer Protocol) unstructured file transmission breakpoint resume implementation method and device. The method comprises the steps that a progress tracking module is integrated in a DataX Writer, and a transmission progress metadata file (TPMF) containing information such as the number of uploaded bytes and the state is created for each file and dynamically updated; deploying an independent process monitor to monitor task interruption, and triggering progress persistence to TPMF; and a user selects a file through the independent FTP continuous transmission scheduler, reads the TPMF and the size of a target file at a server side to judge a breakpoint, calls an FTP REST command to perform continuous transmission from the breakpoint, and updates the state after the continuous transmission is completed. According to the method, accurate progress recording, abnormal interruption active storage and user controllable continuous transmission are realized, redundant retransmission is avoided, the transmission efficiency and the resource utilization rate are improved, the data synchronization robustness is enhanced, and the operation and maintenance complexity is reduced. The method is small in DataX core invasiveness, high in universality and suitable for high-reliability synchronization scenes of large-scale unstructured files.

In an embodiment of the disclosed technology, file type information and file size information are provided through an extra header segment of a command unit and a file mapping table based on the file type information and the file size information is generated and managed. Therefore, by loading in advance an address mapping table associated with a file configured by read-requested data upon a read request, the performance of a read operation based on a mapping table may be improved.

The invention discloses a virtual data lake remote file mapping method and system, which are applied to the technical field of data processing, and the method comprises the following steps: creating a proxy file with the same size as a remote file in a local system, and establishing a mapping directory table of the proxy file and the remote file; when a computing node accesses the memory space mapped by the proxy file to trigger missing page interruption, reading corresponding remote data from a remote host according to the mapping directory table and a remote direct memory access technology, and storing the remote data in a memory missing page; two files to be fused are mapped into the same process space at the same time, and data fusion is carried out; through core technologies such as proxy file mapping, missing page drive loading and RDMA transmission, efficient access and zero copy fusion of remote data are realized, and frequent network requests are reduced.

The present application provides an operator compilation method and apparatus. The method includes: a first device obtains a first execution file and sends the first execution file to a second device, where the first execution file is a binary file obtained by compiling a first operator; and, the first device obtains a model file and sends the model file to the second device, where the model file is a binary file obtained by compiling an AI model, and the execution logic of the first execution file is included in the model file. In this way, the first device sets the executable file of the operator outside the model file of the AI model, which can effectively reduce the size of the model file of the AI model, facilitate the update management of the operator and the AI model, avoid a large amount of repeated compilation, reduce resource waste, and help improve the execution speed of the AI model.

The invention relates to a three-dimensional model fingerprint generation method and system, a terminal and a storage medium. The method comprises the following steps: identifying a file type, analyzing a file structure for the file type containing structured entity information, and extracting triangular mesh entity data; executing a block sampling strategy based on the file size for the file type which does not contain the structured entity information; counting the total number of triangular facets for the triangular mesh entity data, and selecting an adaptive hierarchical sampling strategy according to the total number of the triangular facets; triangular surface area sampling is carried out on a triangular mesh entity, a sampling block-jumping block alternating traversal mode is adopted, and compared with an existing mode, the performance is improved by 69-83 times; besides, a two-level Hash structure is adopted, the first level is to calculate the MD5 value of the area accumulated sum for each sampling block, the second level is to calculate the overall MD5 value for the connection sequence of all block level MD5 values, and the two-level structure enhances the uniqueness and collision resistance of fingerprints.

The present invention discloses a video information hiding method, system, device, and medium based on inter-block pairing. The method comprises: obtaining encoded H.264 video data and obtaining coefficients of all 4×4 luminance blocks in the H.264 video data; sorting all 4×4 luminance blocks according to the absolute values ​​of their DC coefficients; pairing the AC coefficients from the second to the last digit in adjacent luminance blocks to obtain coefficient pairs; shifting the luminance blocks accordingly based on the coefficient pairs, the data to be embedded, and a two-dimensional histogram transfer map; and placing the embedded 4×4 luminance blocks into the encoded H.264 video data in their original order. The present invention uses inter-block pairing to modify the luminance blocks in the video data according to the embedded data, thereby embedding hidden data and effectively reducing the impact on video quality and the increase in video file size. The present invention can be widely applied in the field of multimedia information security technology.

The embodiments of the present application provide a server startup method, apparatus and system, and a non-volatile readable storage medium and an electronic device. An initialization module, a boot loader and a storage space are deployed on a server, wherein the initialization module is configured to initialize server hardware of the server when the server is started up, and the boot loader is used for storing a system file in the storage space and using the system file to load an operating system for the server. The method is applied to the initialization module, and comprises: when a server is started up and before the server runs a boot loader, detecting a reference storage segment in a storage space, wherein the reference storage segment is a storage segment, the storage capacity of which is smaller than the file size of a system file, in the storage space; and editing the reference storage segment as a target storage segment that is not allowed to be allocated to the boot loader for storage of the system file. The present application solves the problem of low server startup efficiency, thereby achieving the effect of improving the server startup efficiency.

The invention provides a heterogeneous file generation method and device, equipment, a medium and a product. The method comprises the steps that before a binary code of any processor architecture is written into a heterogeneous file, whether a binary code of a first processor architecture corresponding to the processor architecture exists in the heterogeneous file or not is determined; if yes, metadata of binary codes of the processor architecture is stored in a storage area of the heterogeneous file, the binary codes of the processor architecture do not execute write-in operation, and the metadata comprises identification information of the processor architecture, offset and the size of a memory occupied by the binary codes. The offset and the occupied memory size of the binary code of the processor architecture are the same as the offset and the occupied memory size of the binary code of the first processor architecture. According to the method and the device, repeated binary codes are not stored repeatedly, and multiplexing of a multiprocessor architecture can be realized while the file volume is reduced.

Claim 1: Captcha System A captcha system for verifying whether a website visitor is a human, comprising: • Server software that stores a large number of images and drawings, all of which have the same file size and format. • A function for randomly generating and storing values ​​that are assigned to each image, whereby these values ​​are not visible to the website visitor.

The application relates to the technical field of electronic equipment, in particular to a method for flashing an operating system, which comprises the following steps: generating restriction information containing a customer identification ID and an image validity period, encrypting the restriction information as a file header through the customer identification ID, forming a double-encrypted file by encrypting the main body of the image with the restriction information; binding a flashing tool with the customer identification ID and hardware information of a flashing device, decrypting the file header and checking the consistency of the customer identification ID and the image validity period in the restriction information after checking the legality of the binding; decrypting the main body of the image and burning it to a target device after the checking, and clearing temporary data after the burning is completed. The double-encryption mechanism prevents the image from being leaked and tampered with, the hardware binding realizes the authorization checking in an offline scene, the multi-dimensional checking such as the validity period and the file size precisely controls the use range of the image, and the safety and controllability of the flashing process are effectively improved.

The present invention discloses a software refresh anti-miswriting method, which includes the following steps: S1: Before refreshing the program, identify the starting value of the bin file. S2: Before refreshing the program, identify the file size to be written. S3: When reading the hardware version number, enter the underlying software for reading using the 1002 service, and at the same time compare the hardware version number to avoid the unsuccessful refresh of the TCU software caused by the application layer hardware version number during library flipping. After reading the underlying hardware version number, perform a 1103 reset and then perform software refresh; S4: The 1001 service and the 1003 service are separated by 100 ms to avoid the TCU not responding due to too short an interval between sending commands; S5: When the 36 service transfers data during the writing process, the packet size is 1044. The present invention can improve the writing accuracy while ensuring the refresh efficiency of the controller, and improve the efficiency of software development work.