257 results about "File size" patented technology

The invention discloses a large file concurrent uploading method and system based on a dynamic fragmentation strategy and resource optimization, and the method comprises the steps: a client generates a file fingerprint according to the file size of a large file and metadata, and dynamically calculates the fragmentation size of the large file; the client carries out fragment cutting on the large file according to the calculated fragment size, establishes a concurrent uploading queue and uploads a plurality of fragments to a server side in parallel; the server selects an optimal storage node to store each fragment based on a consistent hash ring and a multi-dimensional weight model; the client side and the server side track a fragment uploading state through a fragment serial number and a cyclic redundancy check (CRC) value, and after all fragments are uploaded, integrity check and logic recombination are carried out; and when network interruption or uploading failure is detected, the client side and the server side execute an intelligent retry strategy or a splitting rescheduling strategy of breakpoint resume and failure fragmentation.

The embodiment of the invention discloses a file fragment uploading method and device, electronic equipment, a computer program and a storage medium. According to the embodiment of the invention, a to-be-uploaded file and file information are obtained, wherein the file information at least comprises a file size; segmenting a to-be-uploaded file according to the initial network speed of the current network to obtain a plurality of initial file fragments; uploading the initial file fragments to the server in sequence, and recording uploading time consumption and uploading rate corresponding to the initial file fragments; adjusting the size of the next initial file fragment according to the uploading time consumption and the uploading rate of the uploaded initial file fragment to obtain a target file fragment; and uploading the target file fragments to the server. Therefore, in the file uploading process, the real-time network state is determined according to the uploading condition of the uploaded fragment by adopting a mode of'dynamic fragment uploading + network self-adaption ', and the size of the fragment is dynamically adjusted according to the real-time network state, so that the file uploading success rate and the user experience are improved, and the method is flexibly applied to various large file uploading scenes.

The embodiment of the invention provides a core dump file generation method and device, electronic equipment and a medium, and relates to the technical field of data processing.The method comprises the steps that in response to abnormity of a target process, a thread causing the abnormity of the target process is determined as a target thread from threads of the target process; retrieving a virtual memory address from a register occupied by the target thread and a stack memory area of the target thread; determining a target address of a data page which belongs to a heap memory area and has mapping from the retrieved virtual memory address; and generating a core dump file containing the data page mapped by the target address. By applying the scheme provided by the embodiment of the invention, the validity of the core dump file can be improved while the size of the core dump file is reduced.

The invention relates to an attachment certificate dynamic form processing method and system, and belongs to the technical field of enterprise financial certificate intelligent processing, and the method comprises the steps: receiving an attachment certificate uploaded by a user, and extracting metadata features such as a file size, a format type and a hash value to generate an attachment object; carrying out fragmentation storage on the object by adopting an Erase Coding algorithm, and generating a voucher type identification cue word based on metadata; analyzing the voucher through a hybrid recognition model fusing a convolutional neural network and a Transform encoder, and outputting structured data containing a voucher type identifier; mapping the data into a database entity and triggering a voucher life cycle state change event, and driving a business rule engine to dynamically generate a form mode definition associated with a voucher type; and in response to user query, generating an interactive form through a responsive rendering engine in combination with a voucher type, state and authority dynamic combination form mode and instance data.

The invention discloses a distributed document analysis method and device, equipment and a medium. The method comprises the steps that a target to-be-analyzed document is acquired; extracting content feature data of the target to-be-analyzed document; the content feature data is used for reflecting the content complexity of the target to-be-analyzed document; according to the content feature data, determining estimated time consumption for analyzing the target to-be-analyzed document; based on load balancing, according to the estimated time consumption, distributing a target parsing task of the target to-be-parsed document to a target computing power node; and the target computing power node executes the target analysis task to obtain an analysis result. Therefore, the analysis duration is pre-estimated based on the content feature data of the document instead of determining the pre-estimated time consumption singly depending on the size of the document, the method is adaptive to the time consumption fluctuation characteristics of different documents, the precision of the pre-estimated time consumption is improved, calculation power stage distribution is performed based on load balance according to the pre-estimated time consumption, and the calculation efficiency is improved. The resource utilization rate and the load balancing effect of the system are improved.

The invention provides an intelligent file merging method and device, electronic equipment and a storage medium, and relates to the technical field of artificial intelligence and cloud computing, in particular to the technical direction of big data. According to the specific implementation scheme, first-class files and second-class files are recognized from a to-be-processed file set, the file size of the first-class files is smaller than a target size, and the file size of the second-class files is larger than that of the first-class files; splitting the second class file into a plurality of sub-files; determining a to-be-merged file set based on the plurality of sub-files and the first type of files; and carrying out merging operation on the to-be-merged file set.

The disclosure presents systems and methods for hierarchical classification of input data across a plurality of categories. A machine learning model processes various data formats, starting with dimensional reduction using tokenization techniques, such as Bert-tiny tokenization, to create model-readable representations. The system predicts super-categories, sub-categories, and granular categories through selective activation of sub-layers tied to identified super-categories, optimizing computational efficiency. Label smoothing during training mitigates overconfidence in predictions, while softmax normalization refines inference outputs. Synthetic data generation using Large Language Models (LLMs) supplements training datasets, and an automated data labeling pipeline efficiently generates hierarchical labels. Modifications to the model, such as stop word removal and file size limitations, further reduce latency. Inference analyzes logits to predict hierarchical paths, providing detailed classifications with clear outputs. The method is adaptable for multimodal formats, ensuring scalable and accurate predictions across diverse data types while minimizing computational costs and improving reliability.

The invention provides a firmware rapid loading method and circuit of a photoelectric DSP chip and an optical module.The method is applied to a DSP unit, the DSP unit is used for being installed in the optical module and executing a starting program, the DSP unit is electrically connected with an MCU of the optical module and obtains loading information of the MCU, and the step of obtaining the loading information of the MCU comprises the substeps that first information is obtained, acquiring second information according to the first information; the file size of the first information is smaller than that of the second information, and the first information comprises communication parameter information used for obtaining the second information; the second information comprises target firmware of the DSP unit. On the basis of saving the hardware cost, the loading speed of the DSP chip firmware is improved, the development work of the control program of the MCU is reduced, and the method has good compatibility.

The invention relates to a Json file parallel analysis and data writing method and device based on DataX. The method comprises the following steps: acquiring a source end Json file set, and dividing the source end Json file set into small file subsets and large file subsets according to file sizes; the small file aggregation path is configured with a json reader of the DataX, and parallel reading and analysis are carried out; splitting a root array of the large file into a plurality of independent small Json files through a Python script, aggregating paths, and reading and analyzing by using a DataX parallel channel; and finally executing the DataX Job to write the data into a target end. Through a classification processing strategy, the large-scale Json data analysis writing efficiency is remarkably improved, the large file memory occupation risk is reduced, the file scale is automatically adapted, a mature DataX frame and a Python script are reused, high performance and low maintenance cost are both considered, multi-type target end storage is supported, and the problems that a traditional tool is weak in parallel, high in resource consumption, poor in flexibility and the like are effectively solved.

The invention discloses a file access method, device and equipment and a computer readable storage medium, and belongs to the technical field of storage. The method is applied to a first node in a file system and comprises the steps that a first write request for a file is received, the first write request comprises first file data and IO information, and the IO information represents an address range for writing the first file data; in response to the first write request, metadata of the file is obtained, and the metadata comprises an extension attribute and a file size; according to the IO information and the file size, under the condition that it is determined that the written file size does not exceed the reference threshold value, the first file data is written into the extension attribute, and the written file size is the file size after the first file data is written. The file data is embedded in the metadata of the file, and the file data can be accessed while the metadata of the small file is accessed, so that the step of accessing the file data is reduced, the response time delay of the file system to the access request is reduced, and the purpose of improving the access performance of the system is achieved.

The invention discloses a processing method for exporting partition table data, which is used for solving the technical problems of low cross-partition query efficiency, inconsistent file size and lack of concurrent processing capability in the prior art. The method comprises the following steps: firstly, reading configuration information from a task detail table to generate an export task, counting the data volume of each partition, and distributing data to an output file with a fixed line number according to a sequential filling strategy; an innovative coding scheme is adopted to record a distribution result, different partition data containing conditions are represented through characters'-'and'. 'and numbers, and compressed coding is carried out on continuous empty partitions; sending a distribution result to a message queue to realize multi-server concurrent processing; the consumer decodes the distribution information and then executes restrictive query according to a partition sequence, and data is exported concurrently by using streaming query in cooperation with multiple threads; and a perfect state monitoring and exception recovery mechanism is established, and an MD5 verification file is generated to ensure data integrity. According to the method, the processing efficiency of partition table data export and the system reliability are effectively improved.

The invention relates to a DataX-based FTP (File Transfer Protocol) unstructured file transmission breakpoint resume implementation method and device. The method comprises the steps that a progress tracking module is integrated in a DataX Writer, and a transmission progress metadata file (TPMF) containing information such as the number of uploaded bytes and the state is created for each file and dynamically updated; deploying an independent process monitor to monitor task interruption, and triggering progress persistence to TPMF; and a user selects a file through the independent FTP continuous transmission scheduler, reads the TPMF and the size of a target file at a server side to judge a breakpoint, calls an FTP REST command to perform continuous transmission from the breakpoint, and updates the state after the continuous transmission is completed. According to the method, accurate progress recording, abnormal interruption active storage and user controllable continuous transmission are realized, redundant retransmission is avoided, the transmission efficiency and the resource utilization rate are improved, the data synchronization robustness is enhanced, and the operation and maintenance complexity is reduced. The method is small in DataX core invasiveness, high in universality and suitable for high-reliability synchronization scenes of large-scale unstructured files.

The invention relates to a three-dimensional model fingerprint generation method and system, a terminal and a storage medium. The method comprises the following steps: identifying a file type, analyzing a file structure for the file type containing structured entity information, and extracting triangular mesh entity data; executing a block sampling strategy based on the file size for the file type which does not contain the structured entity information; counting the total number of triangular facets for the triangular mesh entity data, and selecting an adaptive hierarchical sampling strategy according to the total number of the triangular facets; triangular surface area sampling is carried out on a triangular mesh entity, a sampling block-jumping block alternating traversal mode is adopted, and compared with an existing mode, the performance is improved by 69-83 times; besides, a two-level Hash structure is adopted, the first level is to calculate the MD5 value of the area accumulated sum for each sampling block, the second level is to calculate the overall MD5 value for the connection sequence of all block level MD5 values, and the two-level structure enhances the uniqueness and collision resistance of fingerprints.

The present invention discloses a video information hiding method, system, device, and medium based on inter-block pairing. The method comprises: obtaining encoded H.264 video data and obtaining coefficients of all 4×4 luminance blocks in the H.264 video data; sorting all 4×4 luminance blocks according to the absolute values ​​of their DC coefficients; pairing the AC coefficients from the second to the last digit in adjacent luminance blocks to obtain coefficient pairs; shifting the luminance blocks accordingly based on the coefficient pairs, the data to be embedded, and a two-dimensional histogram transfer map; and placing the embedded 4×4 luminance blocks into the encoded H.264 video data in their original order. The present invention uses inter-block pairing to modify the luminance blocks in the video data according to the embedded data, thereby embedding hidden data and effectively reducing the impact on video quality and the increase in video file size. The present invention can be widely applied in the field of multimedia information security technology.

The invention provides a heterogeneous file generation method and device, equipment, a medium and a product. The method comprises the steps that before a binary code of any processor architecture is written into a heterogeneous file, whether a binary code of a first processor architecture corresponding to the processor architecture exists in the heterogeneous file or not is determined; if yes, metadata of binary codes of the processor architecture is stored in a storage area of the heterogeneous file, the binary codes of the processor architecture do not execute write-in operation, and the metadata comprises identification information of the processor architecture, offset and the size of a memory occupied by the binary codes. The offset and the occupied memory size of the binary code of the processor architecture are the same as the offset and the occupied memory size of the binary code of the first processor architecture. According to the method and the device, repeated binary codes are not stored repeatedly, and multiplexing of a multiprocessor architecture can be realized while the file volume is reduced.

Claim 1: Captcha System A captcha system for verifying whether a website visitor is a human, comprising: • Server software that stores a large number of images and drawings, all of which have the same file size and format. • A function for randomly generating and storing values ​​that are assigned to each image, whereby these values ​​are not visible to the website visitor.

The application relates to the technical field of electronic equipment, in particular to a method for flashing an operating system, which comprises the following steps: generating restriction information containing a customer identification ID and an image validity period, encrypting the restriction information as a file header through the customer identification ID, forming a double-encrypted file by encrypting the main body of the image with the restriction information; binding a flashing tool with the customer identification ID and hardware information of a flashing device, decrypting the file header and checking the consistency of the customer identification ID and the image validity period in the restriction information after checking the legality of the binding; decrypting the main body of the image and burning it to a target device after the checking, and clearing temporary data after the burning is completed. The double-encryption mechanism prevents the image from being leaked and tampered with, the hardware binding realizes the authorization checking in an offline scene, the multi-dimensional checking such as the validity period and the file size precisely controls the use range of the image, and the safety and controllability of the flashing process are effectively improved.

The invention relates to the technical field of simulation, and discloses a wire frame type flexible body MNF file generation method and device, equipment and a medium, and the method comprises the steps: loading a to-be-analyzed part geometric model, and carrying out the mesh generation of the part geometric model, and obtaining a mesh unit; selecting key nodes related to modal analysis from the grid units on the basis of geometric features of the geometric model of the part; connecting the key nodes by using a virtual connection unit until a complete wireframe type structure is formed; and performing modal analysis on the wireframe type structure, and outputting an analysis result as the wireframe type flexible body MNF file. According to the technical scheme provided by the invention, the process of generating the MNF file can be optimized, and the calculation time, the file volume and the operation complexity are reduced.

The application provides a lightweight log generation method, system and electronic equipment, and relates to the technical field of computer software.The method comprises the following steps: creating a running log management task and an operation log management task with lower priority than an application task, and establishing a message queue; when a log event is generated by the application task, a formatted log message containing a timestamp, a log level, a module identifier and content is generated and sent to the message queue; the log management task asynchronously acquires the log message, and distributes the log message to a running log folder or an operation log folder according to the log level and type; and the size of the log file is monitored, and when the capacity threshold is reached, a cover writing mechanism is enabled to recycle the file storage area.The application realizes asynchronous decoupling of log recording and the application task, supports hierarchical classified storage and cyclic coverage, significantly improves the maintainability and debugging efficiency of the embedded system while ensuring real-time performance, and meets the lightweight log demand in a resource-limited environment.

The application discloses a printing method and system of super large format files based on cloud services, and relates to the technical field of printing. The method comprises the following steps: a printer receives a printing message which is divided into multiple network messages, and obtains the size of a format file to be printed from the network messages. If the size of the format file exceeds a preset available memory safety value of the printer, printing work order information is obtained from the network messages, and the network messages are restructured and sent to a cloud server, and the available memory safety value of the printer is also sent to the cloud server. After the cloud server receives the network messages, the format file is separated. According to the available memory safety value of the printer, the format file is restructured into a plurality of segmentation files with sizes not exceeding the value. The printer continuously receives the segmentation files from the cloud server, and constructs a printing task for each segmentation file according to the printing work order. The application breaks through the limitation of the printer memory, realizes the printing of super large format files, and does not require the user to interact with the cloud server, thereby guaranteeing the user experience.

The invention relates to the technical field of audio quality evaluation, in particular to a multi-dimension-based audio quality evaluation method, which uniformly quantifies file size, tone quality loss, coding and decoding complexity and multi-scene applicability into a single comprehensive score, and obtains an audio quality evaluation result through an adjustable sensitivity factor, dynamic slope amplification and a geometric mean short plate sensitivity mechanism. And meanwhile, the smooth constant epsilon ensures the numerical stability of logarithm operation, and quick, objective and automatic audio quality batch evaluation is realized. Therefore, the problem that an existing audio quality evaluation system is single in dimension is solved.

The application discloses a kind of self-adapting wal log inflation solutions, it is related to cloud computing and big data technical field.The self-adapting wal log inflation solutions, it includes the following steps: S1, wal file size and wal file remaining space in disk are detected regularly, whether disk remaining space is lower than threshold value, if yes, then enter adaptive adjustment;S2, enter adaptive adjustment, according to adaptive adjustment algorithm, submit delay transaction adjustment wal log generation speed;S3, S1 and S2 are circulated.The application is by regularly detecting wal file size and wal file remaining space in disk, when disk remaining space is lower than threshold value, take adaptive algorithm control wal file generation speed technology, reaches the obvious control effect to the inflation speed of wal file, solves the problem of database disk burst disk unusable caused by wal log inflation in prior art.

A method for managing driving record files is adapted for a driving recorder that includes a processor and a storage medium supporting FAT32. The method is implemented by the processor and includes: performing a formatting process on the storage medium by generating multiple files as hidden files with uniform file size in a directory, where each file is named with a file name according to a naming rule and stores multiple data pieces that are successively arranged in a sequential order, and generating multiple directory entries respectively for the files, where the directory entries have a uniform size and are in a directory table that corresponds to the directory; when a first-type error has occurred in the directory table, performing a first repairing procedure for repairing the first-type error; and when a second-type error has occurred in the directory table, performing a second repairing procedure for repairing the second-type error.

The invention discloses a card activating method and electronic equipment in the technical field of storage media, and the method comprises the steps: obtaining the file size of card activating firmware, and increasing the partition size of a mirror image configured in a boot loader according to the file size of the card activating firmware; starting program compiling of a bus function in the configuration corresponding to the boot loader; burning the card opening firmware in the boot loader execution stage to obtain card opening data, and sending the card opening data to a to-be-opened disk through the bus function to complete card opening of the to-be-opened disk. According to the method and the device, the to-be-opened chuck does not need to be placed in a special card opening tool, and the boot loader can be conveniently transplanted between platforms supporting boot loader starting, so that the development cost is saved.

The invention provides a file identifier display method, electronic equipment and a storage medium, and the method comprises the steps: determining a target folder from a plurality of information folders according to a to-be-queried file path included in a file identifier display request; determining a primary folder from a plurality of sub-folders in the target folder; establishing a primary folder identifier corresponding to each primary folder; performing congeneric clustering on the plurality of primary folders to obtain a plurality of primary folder class groups; establishing a folder identifier of a folder corresponding to each secondary folder identifier; and arranging the folder identifiers corresponding to the sub-folders in the target folder to form a file identifier hierarchy graph and displaying the file identifier hierarchy graph. According to the method, the display interface of the file identifier display system displays the primary folder identifiers as many as possible under the condition that the size of the canvas is fixed, and the sizes of the files included in the corresponding information folders can be intuitively reflected by checking the radiuses of the primary folder identifiers.

Adaptive content delivery systems and methods are disclosed herein. An example system is configured to determine capabilities of a requesting end user system, interface with a database designed to store images characterized by criteria, select an image from the database that balances a highest quality and a smallest file size for the end user system, based on the capabilities, and provide the image to a network for delivery to the end user system.

The present application provides a method for generating, embedding, and verifying fragile watermarks for high-precision maps based on geometric features. This relates to the field of vector geographic data processing technology. The watermark generation method includes: calculating the watermark embedding position based on the geometric features in the high-precision map document, generating watermark reference content, generating the salt value required for the hash function, generating Argon2 and Blake2b hash values, and generating road feature watermarks, document watermarks, and non-road feature watermarks. The watermarks generated and embedded by this application will not cause display anomalies or file size changes, and the introduced errors will not affect the normal use of the data.

The application relates to the technical field of data compression storage, and provides a high-throughput genome sequencing quality score data parallel compression method.The method comprises the following steps: segmenting an original gene sequencing file; performing random sampling and k-mer analysis on the sampling data to obtain statistical characteristic information and establish a parallel sequence partition model for binary classification; splicing two partition files obtained through binary classification according to splicing parameters; predicting the to-be-compressed file through a multivariate linear regression analysis prediction method to obtain compression rate gain and establish a parallel four-level run prediction mapping model for data redundancy elimination; and performing context modeling on two redundancy-eliminated subfiles through a multi-core processor cluster, and performing cascade compression in combination with arithmetic coding to obtain a final compressed file.Under the premise of significantly reducing quality score data compression time and peak memory overhead, the application also improves the quality score data compression rate, reduces the size of to-be-compressed storage files, and saves the construction cost of basic storage facilities.

The invention discloses a cache optimization method and device based on distributed storage, and relates to the technical field of distributed storage systems. The method comprises the following steps: dynamically calculating a weight factor of a cache file, attenuating the weight factor based on the access frequency and timeliness of the file, and compensating and adjusting according to the size of the file; the maximum file threshold value set by the system is dynamically adjusted according to the size distribution of the files in the cache, and the maximum file threshold value is determined based on a preset quantile range so as to eliminate interference of extremely large files on weight calculation; when the weight factor of the cache file is lower than a preset threshold value, the file is removed from the cache, and the cache space is released; when the cache capacity is insufficient, the file with the minimum weight is selected for replacement based on the weight factor of the current cache file, and the high-value file is preferentially reserved in the cache. According to the method, the cache hit rate of small files in the distributed storage system is effectively increased, cache space waste and metadata operation overhead are reduced, and system performance and resource utilization rate are remarkably improved.

The application provides a firmware fast loading method and circuit of an optical-electric DSP chip and an optical module. The method is applied to a DSP unit which is installed in the optical module and is used for executing a starting program. The DSP unit is electrically connected with an MCU unit of the optical module and obtains loading information of the MCU unit. The method comprises the following steps: obtaining first information and obtaining second information according to the first information. The file size of the first information is smaller than that of the second information, and the first information contains communication parameter information used for obtaining the second information. The second information contains target firmware of the DSP unit. The application can improve the loading speed of the firmware of the DSP chip, reduce the development work of the control program of the MCU and has good compatibility on the basis of saving hardware cost.